2022-03-17T15:10:53.495 INFO:root:teuthology version: 1.1.0-a0900922 2022-03-17T15:10:53.498 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --owner scheduled_yuriw@teuthology --name yuriw-2022-03-17_14:54:32-rados-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi --description rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} --archive /home/teuthworker/archive/yuriw-2022-03-17_14:54:32-rados-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/6742179 -- /home/teuthworker/archive/yuriw-2022-03-17_14:54:32-rados-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/6742179/orig.config.yaml 2022-03-17T15:10:53.563 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2022-03-17T15:10:53.649 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2022-03-17_14:54:32-rados-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/6742179 branch: wip-yuri10-testing-2022-03-16-1432-pacific description: rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} email: ceph-qa@ceph.io first_in_suite: false job_id: '6742179' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: yuriw-2022-03-17_14:54:32-rados-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri10-testing-2022-03-16-1432-pacific ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 osd shutdown pgref assert: true flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 workunit: branch: wip-yuri10-testing-2022-03-16-1432-pacific sha1: b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6 owner: scheduled_yuriw@teuthology priority: 79 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - host.b - osd.4 - osd.5 - osd.6 - osd.7 sha1: b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6 sleep_before_teardown: 0 suite: rados suite_branch: wip-yuri10-testing-2022-03-16-1432-pacific suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6 targets: smithi061.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC43TJqrgjIHX1VJOBAw6KrGdoIpL4oVzClmXO23jgayqzO61A+bZBdKwMg2FEJ5b63jaOrrTTbjeWa4M3MPmVqQzYKN+n/Cbc5AekQktGeof5/MbaOCUqEKqoSU0TAFRi5bqc/9zzzy9mtfffe7lFIxdgtKZ4vayPXDWsPAFnC/lG5nI5lAqgW06wItdJQSyq8S2fW1TBAsZicD8x0JHOcHc/iQg6bowXeTlZkYwtd+7jMONYVxxZncxPlz0aSJeQ8R8mobserQhRz/SQiwQfXAZP5G2bdZpiF7sIHERr6Iidvpbe3elEe5vUH84Png5OkZKW/o/DT6HGrzJ0SSNmCnXt0FlH34jCwA72PvVyAB3pSzxJ+9uSFP1DjVSgRe05Bq5rRDzLl/Arq5YfN7KRBJ8tw+YktYQotRMmfZwtPjy+wFV5WSOONRrdP4GWwCuKexKzAw/ks7z6rRm2vzwnAJq8zojmGEjZHuopmv/eIM7QYyGay20O+mYhA3Bt0iPs= smithi067.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCvNndpwgT2d2aGmdvxulEMlQIyFZxvXhqMAcSp/7rWOUuqcNOYmkGSPZsU06LcPdzdajTP5pVWDQK83sZJOrn3V2NDuvhn9+UFy/WHS5fEYqy6SwChSxzj0cKJ7dQ2Kp8EoxQym19LLWBlrYQSwcVWKNlKSTLNr0qtYopPpJs7idwYDMTD9/4bRiEDC11UH9/4c9eA2ywTj2XMzdBmd/vqWwsnphqmJOzYq31k2S8l5fdph3uVQjWa4ByLvUALcqg6jSUVwjaZDfRDsqxpg2ThrRyYSE96Rq6GkWnf+Sk2HocwZzb5l8lYOU+K3MaoPUGvsLpeo8Ld1eg4HYYOFub0pMlnVcFG4S28T96t5HTGN6uy691cGQm1p+5aW6I6+EK5BK7efdZ2k8RbCRAwsK4IQJqDRRyMLDtLlzE3DOwpFAiUwR8jAxaXsrSQfD4SuuWxH+kNw1Sbli4MFnwKBUN4f03FFE9s+adFuJvLvVDPb3Mdf4QuAvdU+/wyxn9CHVM= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - cephadm: avoid_pacific_features: true cephadm_branch: v16.2.4 cephadm_git_url: https://github.com/ceph/ceph image: docker.io/ceph/ceph:v16.2.4 roleless: true - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - vip.exec: all-hosts: - systemctl stop nfs-server - cephadm.shell: host.a: - ceph fs volume create foofs - cephadm.wait_for_service: service: mds.foofs - cephadm.shell: host.a: - ceph nfs cluster create foo --placement=2 || ceph nfs cluster create cephfs foo --placement=2 - ceph nfs export create cephfs --fsname foofs --clusterid foo --binding /fake || ceph nfs export create cephfs --fsname foofs --cluster-id foo --pseudo-path /fake - while ! ceph orch ls | grep nfs | grep 2/2 ; do sleep 1 ; done - vip.exec: host.a: - mkdir /mnt/foo - while ! mount -t nfs $(hostname):/fake /mnt/foo -o sync ; do sleep 5 ; done - echo test > /mnt/foo/testfile - sync - parallel: - upgrade-tasks - workload-tasks - vip.exec: host.a: - umount /mnt/foo - cephadm.shell: host.a: - ceph nfs cluster ls | grep foo - ceph nfs export ls foo --detailed - rados -p .nfs --all ls - - ceph config get mgr mgr/cephadm/migration_current | grep 5 teuthology_branch: master teuthology_sha1: a09009223dc44ca923b2e6ad4cd4c4fe88381b22 timestamp: 2022-03-17_14:54:32 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph mgr module enable nfs --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - cephadm.wait_for_service: service: nfs.foo user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.22301 workload-tasks: sequential: - exec: host.a: - cd /mnt/foo && dbench 5 -t 600 || true - umount /mnt/foo - while ! mount -t nfs $(hostname):/fake /mnt/foo ; do sleep 5 ; done - cd /mnt/foo && dbench 5 -t 5 2022-03-17T15:10:53.650 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6/qa; will attempt to use it 2022-03-17T15:10:53.652 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6/qa/tasks 2022-03-17T15:10:53.653 INFO:teuthology.run_tasks:Running task internal.check_packages... 2022-03-17T15:10:53.661 INFO:teuthology.task.internal:Checking packages... 2022-03-17T15:10:53.712 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6' 2022-03-17T15:10:53.713 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2022-03-17T15:10:53.715 INFO:teuthology.packaging:ref: None 2022-03-17T15:10:53.715 INFO:teuthology.packaging:tag: None 2022-03-17T15:10:53.716 INFO:teuthology.packaging:branch: wip-yuri10-testing-2022-03-16-1432-pacific 2022-03-17T15:10:53.716 INFO:teuthology.packaging:sha1: b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6 2022-03-17T15:10:53.719 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri10-testing-2022-03-16-1432-pacific 2022-03-17T15:10:53.894 INFO:teuthology.task.internal:Found packages for ceph version 16.2.7-635.gb5b991d4 2022-03-17T15:10:53.894 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2022-03-17T15:10:53.903 INFO:teuthology.task.internal:no buildpackages task found 2022-03-17T15:10:53.906 INFO:teuthology.run_tasks:Running task internal.save_config... 2022-03-17T15:10:54.020 INFO:teuthology.task.internal:Saving configuration 2022-03-17T15:10:54.042 INFO:teuthology.run_tasks:Running task internal.check_lock... 2022-03-17T15:10:54.206 INFO:teuthology.task.internal.check_lock:Checking locks... 2022-03-17T15:10:54.233 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi061.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-03-17_14:54:32-rados-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/6742179', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-03-17 15:05:45.791080', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOvGoTNyG4o708/HC5HHtZm83Szzm/kC7g0Htvtbo/rNPqOhBOMHnrbcXWPVXv7sarQdLIcU06NfAc0zGrittac='} 2022-03-17T15:10:54.259 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi067.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2022-03-17_14:54:32-rados-wip-yuri10-testing-2022-03-16-1432-pacific-distro-default-smithi/6742179', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2022-03-17 15:05:45.789615', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLQw3Q+YEcf5XEQV/q3ZAEJsJV9WYxGYBgGLUL2EYofHEpQOUVQJ86I3gU6XHBu2LMaTeaAzsULu22Wteqrr0j4='} 2022-03-17T15:10:54.259 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2022-03-17T15:10:54.311 INFO:teuthology.task.internal:roles: ubuntu@smithi061.front.sepia.ceph.com - ['host.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2022-03-17T15:10:54.311 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['host.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2022-03-17T15:10:54.311 INFO:teuthology.run_tasks:Running task console_log... 2022-03-17T15:10:54.465 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fbbc5fd7950>, signals=[15]) 2022-03-17T15:10:54.468 INFO:teuthology.run_tasks:Running task internal.connect... 2022-03-17T15:10:54.478 INFO:teuthology.task.internal:Opening connections... 2022-03-17T15:10:54.478 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi061.front.sepia.ceph.com 2022-03-17T15:10:54.484 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-17T15:10:54.605 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2022-03-17T15:10:54.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-17T15:10:54.729 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2022-03-17T15:10:54.737 DEBUG:teuthology.orchestra.run.smithi061:> uname -m 2022-03-17T15:10:54.772 INFO:teuthology.orchestra.run.smithi061.stdout:x86_64 2022-03-17T15:10:54.773 DEBUG:teuthology.orchestra.run.smithi061:> cat /etc/os-release 2022-03-17T15:10:54.843 INFO:teuthology.orchestra.run.smithi061.stdout:NAME="CentOS Stream" 2022-03-17T15:10:54.844 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION="8" 2022-03-17T15:10:54.844 INFO:teuthology.orchestra.run.smithi061.stdout:ID="centos" 2022-03-17T15:10:54.844 INFO:teuthology.orchestra.run.smithi061.stdout:ID_LIKE="rhel fedora" 2022-03-17T15:10:54.845 INFO:teuthology.orchestra.run.smithi061.stdout:VERSION_ID="8" 2022-03-17T15:10:54.845 INFO:teuthology.orchestra.run.smithi061.stdout:PLATFORM_ID="platform:el8" 2022-03-17T15:10:54.845 INFO:teuthology.orchestra.run.smithi061.stdout:PRETTY_NAME="CentOS Stream 8" 2022-03-17T15:10:54.845 INFO:teuthology.orchestra.run.smithi061.stdout:ANSI_COLOR="0;31" 2022-03-17T15:10:54.855 INFO:teuthology.orchestra.run.smithi061.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-03-17T15:10:54.855 INFO:teuthology.orchestra.run.smithi061.stdout:HOME_URL="https://centos.org/" 2022-03-17T15:10:54.856 INFO:teuthology.orchestra.run.smithi061.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-03-17T15:10:54.856 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-03-17T15:10:54.856 INFO:teuthology.orchestra.run.smithi061.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-03-17T15:10:54.857 INFO:teuthology.lock.ops:Updating smithi061.front.sepia.ceph.com on lock server 2022-03-17T15:10:54.882 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2022-03-17T15:10:54.918 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2022-03-17T15:10:54.918 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2022-03-17T15:10:54.978 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="CentOS Stream" 2022-03-17T15:10:54.978 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="8" 2022-03-17T15:10:54.979 INFO:teuthology.orchestra.run.smithi067.stdout:ID="centos" 2022-03-17T15:10:54.979 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE="rhel fedora" 2022-03-17T15:10:54.980 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="8" 2022-03-17T15:10:54.980 INFO:teuthology.orchestra.run.smithi067.stdout:PLATFORM_ID="platform:el8" 2022-03-17T15:10:54.980 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="CentOS Stream 8" 2022-03-17T15:10:54.980 INFO:teuthology.orchestra.run.smithi067.stdout:ANSI_COLOR="0;31" 2022-03-17T15:10:54.981 INFO:teuthology.orchestra.run.smithi067.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2022-03-17T15:10:54.981 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://centos.org/" 2022-03-17T15:10:54.981 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2022-03-17T15:10:54.981 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2022-03-17T15:10:54.983 INFO:teuthology.orchestra.run.smithi067.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2022-03-17T15:10:54.984 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2022-03-17T15:10:55.014 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2022-03-17T15:10:55.028 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2022-03-17T15:10:55.197 INFO:teuthology.task.internal:Checking for old test directory... 2022-03-17T15:10:55.198 DEBUG:teuthology.orchestra.run.smithi061:> test '!' -e /home/ubuntu/cephtest 2022-03-17T15:10:55.207 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2022-03-17T15:10:55.227 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2022-03-17T15:10:55.288 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2022-03-17T15:10:55.288 DEBUG:teuthology.orchestra.run.smithi061:> test -z $(ls -A /var/lib/ceph) 2022-03-17T15:10:55.291 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2022-03-17T15:10:55.315 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2022-03-17T15:10:55.459 INFO:teuthology.run_tasks:Running task kernel... 2022-03-17T15:10:55.508 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2022-03-17T15:10:55.509 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2022-03-17T15:10:55.509 DEBUG:teuthology.orchestra.run.smithi061:> uname -r 2022-03-17T15:10:55.510 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2022-03-17T15:10:55.537 INFO:teuthology.orchestra.run.smithi067.stdout:4.18.0-358.el8.x86_64 2022-03-17T15:10:55.538 INFO:teuthology.orchestra.run.smithi061.stdout:4.18.0-358.el8.x86_64 2022-03-17T15:10:55.538 INFO:teuthology.task.kernel:Running kernel on smithi067: 4.18.0-358.el8.x86_64 2022-03-17T15:10:55.540 DEBUG:teuthology.orchestra.run.smithi067:> sudo yum install -y kernel 2022-03-17T15:10:55.547 INFO:teuthology.task.kernel:Running kernel on smithi061: 4.18.0-358.el8.x86_64 2022-03-17T15:10:55.547 DEBUG:teuthology.orchestra.run.smithi061:> sudo yum install -y kernel 2022-03-17T15:10:56.354 INFO:teuthology.orchestra.run.smithi061.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-17T15:10:56.355 INFO:teuthology.orchestra.run.smithi061.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-17T15:10:56.558 INFO:teuthology.orchestra.run.smithi067.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-17T15:10:56.558 INFO:teuthology.orchestra.run.smithi067.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-17T15:10:58.038 INFO:teuthology.orchestra.run.smithi061.stdout:CentOS-8 - AppStream 31 MB/s | 20 MB 00:00 2022-03-17T15:10:58.312 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS-8 - AppStream 33 MB/s | 20 MB 00:00 2022-03-17T15:11:02.401 INFO:teuthology.orchestra.run.smithi061.stdout:CentOS-8 - Base 37 MB/s | 19 MB 00:00 2022-03-17T15:11:02.829 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS-8 - Base 29 MB/s | 19 MB 00:00 2022-03-17T15:11:05.731 INFO:teuthology.orchestra.run.smithi061.stdout:CentOS-8 - Extras 54 kB/s | 18 kB 00:00 2022-03-17T15:11:05.937 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS-8 - Extras 160 kB/s | 18 kB 00:00 2022-03-17T15:11:06.098 INFO:teuthology.orchestra.run.smithi061.stdout:CentOS-8 - PowerTools 17 MB/s | 4.2 MB 00:00 2022-03-17T15:11:06.299 INFO:teuthology.orchestra.run.smithi067.stdout:CentOS-8 - PowerTools 18 MB/s | 4.2 MB 00:00 2022-03-17T15:11:09.182 INFO:teuthology.orchestra.run.smithi061.stdout:Copr repo for python3-asyncssh owned by ceph 1.6 kB/s | 3.5 kB 00:02 2022-03-17T15:11:09.189 INFO:teuthology.orchestra.run.smithi067.stdout:Copr repo for python3-asyncssh owned by ceph 1.7 kB/s | 3.5 kB 00:02 2022-03-17T15:11:10.265 INFO:teuthology.orchestra.run.smithi061.stdout:Extra Packages for Enterprise Linux 12 MB/s | 11 MB 00:00 2022-03-17T15:11:10.288 INFO:teuthology.orchestra.run.smithi067.stdout:Extra Packages for Enterprise Linux 12 MB/s | 11 MB 00:00 2022-03-17T15:11:13.158 INFO:teuthology.orchestra.run.smithi061.stdout:lab-extras 484 kB/s | 24 kB 00:00 2022-03-17T15:11:13.263 INFO:teuthology.orchestra.run.smithi067.stdout:lab-extras 432 kB/s | 24 kB 00:00 2022-03-17T15:11:15.779 INFO:teuthology.orchestra.run.smithi061.stdout:Package kernel-4.18.0-358.el8.x86_64 is already installed. 2022-03-17T15:11:15.780 INFO:teuthology.orchestra.run.smithi061.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2022-03-17T15:11:15.874 INFO:teuthology.orchestra.run.smithi061.stdout:Dependencies resolved. 2022-03-17T15:11:15.875 INFO:teuthology.orchestra.run.smithi061.stdout:================================================================================ 2022-03-17T15:11:15.875 INFO:teuthology.orchestra.run.smithi061.stdout: Package Architecture Version Repository Size 2022-03-17T15:11:15.876 INFO:teuthology.orchestra.run.smithi061.stdout:================================================================================ 2022-03-17T15:11:15.876 INFO:teuthology.orchestra.run.smithi061.stdout:Installing: 2022-03-17T15:11:15.876 INFO:teuthology.orchestra.run.smithi061.stdout: kernel x86_64 4.18.0-365.el8 CentOS-Base 7.7 M 2022-03-17T15:11:15.876 INFO:teuthology.orchestra.run.smithi061.stdout: kernel-core x86_64 4.18.0-365.el8 CentOS-Base 39 M 2022-03-17T15:11:15.876 INFO:teuthology.orchestra.run.smithi061.stdout: kernel-modules x86_64 4.18.0-365.el8 CentOS-Base 31 M 2022-03-17T15:11:15.877 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:11:15.877 INFO:teuthology.orchestra.run.smithi061.stdout:Transaction Summary 2022-03-17T15:11:15.877 INFO:teuthology.orchestra.run.smithi061.stdout:================================================================================ 2022-03-17T15:11:15.877 INFO:teuthology.orchestra.run.smithi061.stdout:Install 3 Packages 2022-03-17T15:11:15.878 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:11:15.878 INFO:teuthology.orchestra.run.smithi061.stdout:Total download size: 78 M 2022-03-17T15:11:15.878 INFO:teuthology.orchestra.run.smithi061.stdout:Installed size: 92 M 2022-03-17T15:11:15.878 INFO:teuthology.orchestra.run.smithi061.stdout:Downloading Packages: 2022-03-17T15:11:15.935 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-4.18.0-358.el8.x86_64 is already installed. 2022-03-17T15:11:15.935 INFO:teuthology.orchestra.run.smithi067.stdout:Package kernel-4.18.0-305.3.1.el8.x86_64 is already installed. 2022-03-17T15:11:16.037 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2022-03-17T15:11:16.037 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2022-03-17T15:11:16.037 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2022-03-17T15:11:16.038 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2022-03-17T15:11:16.038 INFO:teuthology.orchestra.run.smithi067.stdout:Installing: 2022-03-17T15:11:16.038 INFO:teuthology.orchestra.run.smithi067.stdout: kernel x86_64 4.18.0-365.el8 CentOS-Base 7.7 M 2022-03-17T15:11:16.038 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-core x86_64 4.18.0-365.el8 CentOS-Base 39 M 2022-03-17T15:11:16.039 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-modules x86_64 4.18.0-365.el8 CentOS-Base 31 M 2022-03-17T15:11:16.039 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:11:16.039 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2022-03-17T15:11:16.039 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2022-03-17T15:11:16.039 INFO:teuthology.orchestra.run.smithi067.stdout:Install 3 Packages 2022-03-17T15:11:16.040 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:11:16.040 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 78 M 2022-03-17T15:11:16.041 INFO:teuthology.orchestra.run.smithi067.stdout:Installed size: 92 M 2022-03-17T15:11:16.041 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2022-03-17T15:11:16.141 INFO:teuthology.orchestra.run.smithi061.stdout:(1/3): kernel-4.18.0-365.el8.x86_64.rpm 29 MB/s | 7.7 MB 00:00 2022-03-17T15:11:17.073 INFO:teuthology.orchestra.run.smithi067.stdout:(1/3): kernel-4.18.0-365.el8.x86_64.rpm 7.5 MB/s | 7.7 MB 00:01 2022-03-17T15:11:17.235 INFO:teuthology.orchestra.run.smithi061.stdout:(2/3): kernel-modules-4.18.0-365.el8.x86_64.rpm 23 MB/s | 31 MB 00:01 2022-03-17T15:11:17.650 INFO:teuthology.orchestra.run.smithi061.stdout:(3/3): kernel-core-4.18.0-365.el8.x86_64.rpm 22 MB/s | 39 MB 00:01 2022-03-17T15:11:17.653 INFO:teuthology.orchestra.run.smithi061.stdout:-------------------------------------------------------------------------------- 2022-03-17T15:11:17.653 INFO:teuthology.orchestra.run.smithi061.stdout:Total 44 MB/s | 78 MB 00:01 2022-03-17T15:11:18.031 INFO:teuthology.orchestra.run.smithi067.stdout:(2/3): kernel-core-4.18.0-365.el8.x86_64.rpm 20 MB/s | 39 MB 00:01 2022-03-17T15:11:18.255 INFO:teuthology.orchestra.run.smithi061.stdout:Running transaction check 2022-03-17T15:11:18.339 INFO:teuthology.orchestra.run.smithi067.stdout:(3/3): kernel-modules-4.18.0-365.el8.x86_64.rpm 14 MB/s | 31 MB 00:02 2022-03-17T15:11:18.345 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2022-03-17T15:11:18.345 INFO:teuthology.orchestra.run.smithi067.stdout:Total 34 MB/s | 78 MB 00:02 2022-03-17T15:11:18.604 INFO:teuthology.orchestra.run.smithi061.stdout:Transaction check succeeded. 2022-03-17T15:11:18.604 INFO:teuthology.orchestra.run.smithi061.stdout:Running transaction test 2022-03-17T15:11:18.952 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2022-03-17T15:11:19.356 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2022-03-17T15:11:19.356 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2022-03-17T15:11:19.927 INFO:teuthology.orchestra.run.smithi061.stdout:Transaction test succeeded. 2022-03-17T15:11:19.937 INFO:teuthology.orchestra.run.smithi061.stdout:Running transaction 2022-03-17T15:11:20.726 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2022-03-17T15:11:20.735 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2022-03-17T15:11:22.883 INFO:teuthology.orchestra.run.smithi061.stdout: Preparing : 1/1 2022-03-17T15:11:23.325 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : kernel-core-4.18.0-365.el8.x86_64 1/3 2022-03-17T15:11:23.417 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2022-03-17T15:11:23.868 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : kernel-core-4.18.0-365.el8.x86_64 1/3 2022-03-17T15:11:27.115 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: kernel-core-4.18.0-365.el8.x86_64 1/3 2022-03-17T15:11:27.470 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : kernel-modules-4.18.0-365.el8.x86_64 2/3 2022-03-17T15:11:27.593 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-core-4.18.0-365.el8.x86_64 1/3 2022-03-17T15:11:27.930 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : kernel-modules-4.18.0-365.el8.x86_64 2/3 2022-03-17T15:11:30.859 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: kernel-modules-4.18.0-365.el8.x86_64 2/3 2022-03-17T15:11:31.311 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-modules-4.18.0-365.el8.x86_64 2/3 2022-03-17T15:11:31.443 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : kernel-4.18.0-365.el8.x86_64 3/3 2022-03-17T15:11:31.598 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : kernel-4.18.0-365.el8.x86_64 3/3 2022-03-17T15:12:00.985 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: kernel-core-4.18.0-365.el8.x86_64 3/3 2022-03-17T15:12:01.037 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-core-4.18.0-365.el8.x86_64 3/3 2022-03-17T15:12:01.361 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: kernel-4.18.0-365.el8.x86_64 3/3 2022-03-17T15:12:01.362 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : kernel-4.18.0-365.el8.x86_64 1/3 2022-03-17T15:12:01.362 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : kernel-core-4.18.0-365.el8.x86_64 2/3 2022-03-17T15:12:01.403 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: kernel-4.18.0-365.el8.x86_64 3/3 2022-03-17T15:12:01.404 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-4.18.0-365.el8.x86_64 1/3 2022-03-17T15:12:01.404 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-core-4.18.0-365.el8.x86_64 2/3 2022-03-17T15:12:01.889 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : kernel-modules-4.18.0-365.el8.x86_64 3/3 2022-03-17T15:12:01.890 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:12:01.890 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2022-03-17T15:12:01.890 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-4.18.0-365.el8.x86_64 kernel-core-4.18.0-365.el8.x86_64 2022-03-17T15:12:01.890 INFO:teuthology.orchestra.run.smithi067.stdout: kernel-modules-4.18.0-365.el8.x86_64 2022-03-17T15:12:01.891 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:12:01.891 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2022-03-17T15:12:01.911 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : kernel-modules-4.18.0-365.el8.x86_64 3/3 2022-03-17T15:12:01.911 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:12:01.912 INFO:teuthology.orchestra.run.smithi061.stdout:Installed: 2022-03-17T15:12:01.912 INFO:teuthology.orchestra.run.smithi061.stdout: kernel-4.18.0-365.el8.x86_64 kernel-core-4.18.0-365.el8.x86_64 2022-03-17T15:12:01.912 INFO:teuthology.orchestra.run.smithi061.stdout: kernel-modules-4.18.0-365.el8.x86_64 2022-03-17T15:12:01.912 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:12:01.913 INFO:teuthology.orchestra.run.smithi061.stdout:Complete! 2022-03-17T15:12:01.985 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q kernel --last | head -n 1 2022-03-17T15:12:02.018 DEBUG:teuthology.orchestra.run.smithi061:> rpm -q kernel --last | head -n 1 2022-03-17T15:12:02.180 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-4.18.0-365.el8.x86_64 Thu 17 Mar 2022 03:11:31 PM UTC 2022-03-17T15:12:02.180 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-365.el8.x86_64 2022-03-17T15:12:02.180 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-358.el8.x86_64 Expected: 4.18.0-365.el8.x86_64 2022-03-17T15:12:02.181 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2022-03-17T15:12:02.181 DEBUG:teuthology.task.kernel:src is distro, skipping download 2022-03-17T15:12:02.181 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2022-03-17T15:12:02.182 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi067.front.sepia.ceph.com, path=None, version=distro) 2022-03-17T15:12:02.182 DEBUG:teuthology.orchestra.run.smithi067:> rpm -q kernel --last | head -n 1 2022-03-17T15:12:02.237 INFO:teuthology.orchestra.run.smithi061.stdout:kernel-4.18.0-365.el8.x86_64 Thu 17 Mar 2022 03:11:30 PM UTC 2022-03-17T15:12:02.239 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-365.el8.x86_64 2022-03-17T15:12:02.239 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-358.el8.x86_64 Expected: 4.18.0-365.el8.x86_64 2022-03-17T15:12:02.240 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2022-03-17T15:12:02.240 DEBUG:teuthology.task.kernel:src is distro, skipping download 2022-03-17T15:12:02.240 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2022-03-17T15:12:02.240 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi061.front.sepia.ceph.com, path=None, version=distro) 2022-03-17T15:12:02.241 DEBUG:teuthology.orchestra.run.smithi061:> rpm -q kernel --last | head -n 1 2022-03-17T15:12:02.358 INFO:teuthology.orchestra.run.smithi067.stdout:kernel-4.18.0-365.el8.x86_64 Thu 17 Mar 2022 03:11:31 PM UTC 2022-03-17T15:12:02.362 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-365.el8.x86_64 2022-03-17T15:12:02.362 DEBUG:teuthology.orchestra.run.smithi067:> sudo rpm -qi grub2-tools 2022-03-17T15:12:02.400 INFO:teuthology.orchestra.run.smithi067.stdout:Name : grub2-tools 2022-03-17T15:12:02.401 INFO:teuthology.orchestra.run.smithi067.stdout:Epoch : 1 2022-03-17T15:12:02.401 INFO:teuthology.orchestra.run.smithi067.stdout:Version : 2.02 2022-03-17T15:12:02.401 INFO:teuthology.orchestra.run.smithi067.stdout:Release : 106.el8 2022-03-17T15:12:02.401 INFO:teuthology.orchestra.run.smithi067.stdout:Architecture: x86_64 2022-03-17T15:12:02.402 INFO:teuthology.orchestra.run.smithi067.stdout:Install Date: Fri 04 Feb 2022 04:06:37 PM UTC 2022-03-17T15:12:02.402 INFO:teuthology.orchestra.run.smithi067.stdout:Group : System Environment/Base 2022-03-17T15:12:02.402 INFO:teuthology.orchestra.run.smithi067.stdout:Size : 9265339 2022-03-17T15:12:02.402 INFO:teuthology.orchestra.run.smithi067.stdout:License : GPLv3+ 2022-03-17T15:12:02.403 INFO:teuthology.orchestra.run.smithi067.stdout:Signature : RSA/SHA256, Mon 08 Nov 2021 06:49:52 AM UTC, Key ID 05b555b38483c65d 2022-03-17T15:12:02.403 INFO:teuthology.orchestra.run.smithi067.stdout:Source RPM : grub2-2.02-106.el8.src.rpm 2022-03-17T15:12:02.407 INFO:teuthology.orchestra.run.smithi067.stdout:Build Date : Mon 08 Nov 2021 06:39:57 AM UTC 2022-03-17T15:12:02.407 INFO:teuthology.orchestra.run.smithi067.stdout:Build Host : kbuilder.bsys.centos.org 2022-03-17T15:12:02.407 INFO:teuthology.orchestra.run.smithi067.stdout:Relocations : (not relocatable) 2022-03-17T15:12:02.407 INFO:teuthology.orchestra.run.smithi067.stdout:Packager : CentOS BuildSystem 2022-03-17T15:12:02.408 INFO:teuthology.orchestra.run.smithi067.stdout:Vendor : CentOS 2022-03-17T15:12:02.408 INFO:teuthology.orchestra.run.smithi067.stdout:URL : http://www.gnu.org/software/grub/ 2022-03-17T15:12:02.408 INFO:teuthology.orchestra.run.smithi067.stdout:Summary : Support tools for GRUB. 2022-03-17T15:12:02.408 INFO:teuthology.orchestra.run.smithi067.stdout:Description : 2022-03-17T15:12:02.409 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:12:02.409 INFO:teuthology.orchestra.run.smithi067.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2022-03-17T15:12:02.409 INFO:teuthology.orchestra.run.smithi067.stdout:customizable bootloader with modular architecture. It supports a rich 2022-03-17T15:12:02.409 INFO:teuthology.orchestra.run.smithi067.stdout:variety of kernel formats, file systems, computer architectures and 2022-03-17T15:12:02.410 INFO:teuthology.orchestra.run.smithi067.stdout:hardware devices. 2022-03-17T15:12:02.410 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:12:02.410 INFO:teuthology.orchestra.run.smithi067.stdout:This subpackage provides tools for support of all platforms. 2022-03-17T15:12:02.412 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2022-03-17T15:12:02.412 INFO:teuthology.task.kernel:Updating grub on smithi067 to boot 4.18.0-365.el8.x86_64 2022-03-17T15:12:02.413 DEBUG:teuthology.orchestra.run.smithi067:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2022-03-17T15:12:02.440 INFO:teuthology.orchestra.run.smithi061.stdout:kernel-4.18.0-365.el8.x86_64 Thu 17 Mar 2022 03:11:30 PM UTC 2022-03-17T15:12:02.441 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-365.el8.x86_64 2022-03-17T15:12:02.441 DEBUG:teuthology.orchestra.run.smithi061:> sudo rpm -qi grub2-tools 2022-03-17T15:12:02.490 INFO:teuthology.orchestra.run.smithi061.stdout:Name : grub2-tools 2022-03-17T15:12:02.490 INFO:teuthology.orchestra.run.smithi061.stdout:Epoch : 1 2022-03-17T15:12:02.491 INFO:teuthology.orchestra.run.smithi061.stdout:Version : 2.02 2022-03-17T15:12:02.491 INFO:teuthology.orchestra.run.smithi061.stdout:Release : 106.el8 2022-03-17T15:12:02.491 INFO:teuthology.orchestra.run.smithi061.stdout:Architecture: x86_64 2022-03-17T15:12:02.491 INFO:teuthology.orchestra.run.smithi061.stdout:Install Date: Fri 04 Feb 2022 04:06:37 PM UTC 2022-03-17T15:12:02.491 INFO:teuthology.orchestra.run.smithi061.stdout:Group : System Environment/Base 2022-03-17T15:12:02.492 INFO:teuthology.orchestra.run.smithi061.stdout:Size : 9265339 2022-03-17T15:12:02.492 INFO:teuthology.orchestra.run.smithi061.stdout:License : GPLv3+ 2022-03-17T15:12:02.492 INFO:teuthology.orchestra.run.smithi061.stdout:Signature : RSA/SHA256, Mon 08 Nov 2021 06:49:52 AM UTC, Key ID 05b555b38483c65d 2022-03-17T15:12:02.492 INFO:teuthology.orchestra.run.smithi061.stdout:Source RPM : grub2-2.02-106.el8.src.rpm 2022-03-17T15:12:02.492 INFO:teuthology.orchestra.run.smithi061.stdout:Build Date : Mon 08 Nov 2021 06:39:57 AM UTC 2022-03-17T15:12:02.493 INFO:teuthology.orchestra.run.smithi061.stdout:Build Host : kbuilder.bsys.centos.org 2022-03-17T15:12:02.493 INFO:teuthology.orchestra.run.smithi061.stdout:Relocations : (not relocatable) 2022-03-17T15:12:02.493 INFO:teuthology.orchestra.run.smithi061.stdout:Packager : CentOS BuildSystem 2022-03-17T15:12:02.493 INFO:teuthology.orchestra.run.smithi061.stdout:Vendor : CentOS 2022-03-17T15:12:02.493 INFO:teuthology.orchestra.run.smithi061.stdout:URL : http://www.gnu.org/software/grub/ 2022-03-17T15:12:02.494 INFO:teuthology.orchestra.run.smithi061.stdout:Summary : Support tools for GRUB. 2022-03-17T15:12:02.494 INFO:teuthology.orchestra.run.smithi061.stdout:Description : 2022-03-17T15:12:02.494 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:12:02.494 INFO:teuthology.orchestra.run.smithi061.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2022-03-17T15:12:02.496 INFO:teuthology.orchestra.run.smithi061.stdout:customizable bootloader with modular architecture. It supports a rich 2022-03-17T15:12:02.496 INFO:teuthology.orchestra.run.smithi061.stdout:variety of kernel formats, file systems, computer architectures and 2022-03-17T15:12:02.497 INFO:teuthology.orchestra.run.smithi061.stdout:hardware devices. 2022-03-17T15:12:02.497 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:12:02.497 INFO:teuthology.orchestra.run.smithi061.stdout:This subpackage provides tools for support of all platforms. 2022-03-17T15:12:02.497 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2022-03-17T15:12:02.498 INFO:teuthology.task.kernel:Updating grub on smithi061 to boot 4.18.0-365.el8.x86_64 2022-03-17T15:12:02.498 DEBUG:teuthology.orchestra.run.smithi061:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2022-03-17T15:12:03.493 INFO:teuthology.orchestra.run.smithi061.stderr:Generating grub configuration file ... 2022-03-17T15:12:03.545 INFO:teuthology.orchestra.run.smithi067.stderr:Generating grub configuration file ... 2022-03-17T15:12:05.588 INFO:teuthology.orchestra.run.smithi061.stderr:done 2022-03-17T15:12:05.589 DEBUG:teuthology.orchestra.run.smithi061:> mktemp 2022-03-17T15:12:05.608 INFO:teuthology.orchestra.run.smithi067.stderr:done 2022-03-17T15:12:05.608 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2022-03-17T15:12:05.614 INFO:teuthology.orchestra.run.smithi061.stdout:/tmp/tmp.mn6aaUYoZ9 2022-03-17T15:12:05.615 DEBUG:teuthology.orchestra.run.smithi061:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.mn6aaUYoZ9 2022-03-17T15:12:05.668 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.FwWrkbSu4m 2022-03-17T15:12:05.668 DEBUG:teuthology.orchestra.run.smithi067:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.FwWrkbSu4m 2022-03-17T15:12:05.729 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 0666 /tmp/tmp.mn6aaUYoZ9 2022-03-17T15:12:05.761 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.FwWrkbSu4m 2022-03-17T15:12:05.903 DEBUG:teuthology.orchestra.remote:smithi061:/tmp/tmp.mn6aaUYoZ9 is 6KB 2022-03-17T15:12:05.930 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.FwWrkbSu4m is 6KB 2022-03-17T15:12:05.977 DEBUG:teuthology.orchestra.run.smithi061:> rm -fr /tmp/tmp.mn6aaUYoZ9 2022-03-17T15:12:05.997 DEBUG:teuthology.orchestra.run.smithi061:> sudo /bin/ls /boot/loader/entries || true 2022-03-17T15:12:06.033 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.FwWrkbSu4m 2022-03-17T15:12:06.060 DEBUG:teuthology.orchestra.run.smithi067:> sudo /bin/ls /boot/loader/entries || true 2022-03-17T15:12:06.065 INFO:teuthology.orchestra.run.smithi061.stdout:de9f16d36b2643dd85552c363843f45b-0-rescue.conf 2022-03-17T15:12:06.065 INFO:teuthology.orchestra.run.smithi061.stdout:de9f16d36b2643dd85552c363843f45b-4.18.0-305.3.1.el8.x86_64.conf 2022-03-17T15:12:06.065 INFO:teuthology.orchestra.run.smithi061.stdout:de9f16d36b2643dd85552c363843f45b-4.18.0-358.el8.x86_64.conf 2022-03-17T15:12:06.066 INFO:teuthology.orchestra.run.smithi061.stdout:de9f16d36b2643dd85552c363843f45b-4.18.0-365.el8.x86_64.conf 2022-03-17T15:12:06.077 DEBUG:teuthology.orchestra.run.smithi061:> sudo grub2-set-default de9f16d36b2643dd85552c363843f45b-4.18.0-365.el8.x86_64 2022-03-17T15:12:06.132 INFO:teuthology.orchestra.run.smithi067.stdout:de9f16d36b2643dd85552c363843f45b-0-rescue.conf 2022-03-17T15:12:06.141 INFO:teuthology.orchestra.run.smithi067.stdout:de9f16d36b2643dd85552c363843f45b-4.18.0-305.3.1.el8.x86_64.conf 2022-03-17T15:12:06.142 INFO:teuthology.orchestra.run.smithi067.stdout:de9f16d36b2643dd85552c363843f45b-4.18.0-358.el8.x86_64.conf 2022-03-17T15:12:06.142 INFO:teuthology.orchestra.run.smithi067.stdout:de9f16d36b2643dd85552c363843f45b-4.18.0-365.el8.x86_64.conf 2022-03-17T15:12:06.142 DEBUG:teuthology.orchestra.run.smithi067:> sudo grub2-set-default de9f16d36b2643dd85552c363843f45b-4.18.0-365.el8.x86_64 2022-03-17T15:12:06.232 DEBUG:teuthology.orchestra.run.smithi061:> sudo shutdown -r now 2022-03-17T15:12:06.295 DEBUG:teuthology.orchestra.run.smithi067:> sudo shutdown -r now 2022-03-17T15:12:36.274 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2022-03-17T15:12:36.275 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2022-03-17T15:12:36.276 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-17T15:12:36.324 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2022-03-17T15:12:36.325 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2022-03-17T15:12:36.325 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-17T15:13:10.863 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2022-03-17T15:13:10.864 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.61 2022-03-17T15:13:40.894 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2022-03-17T15:13:40.896 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-17T15:13:40.897 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2022-03-17T15:13:40.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-17T15:13:48.317 DEBUG:teuthology.orchestra.run.smithi061:> true 2022-03-17T15:13:48.647 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi061.front.sepia.ceph.com' 2022-03-17T15:13:48.648 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-365.el8.x86_64"... 2022-03-17T15:13:48.648 DEBUG:teuthology.orchestra.run.smithi061:> uname -r 2022-03-17T15:13:48.667 INFO:teuthology.orchestra.run.smithi061.stdout:4.18.0-365.el8.x86_64 2022-03-17T15:13:48.668 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-365.el8.x86_64 vs 4.18.0-365.el8.x86_64 2022-03-17T15:13:48.668 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2022-03-17T15:13:48.668 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2022-03-17T15:13:49.669 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2022-03-17T15:13:49.670 DEBUG:teuthology.orchestra.run.smithi061:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-03-17T15:13:49.785 INFO:teuthology.orchestra.run.smithi061.stdout:ttyS1 2022-03-17T15:13:49.809 DEBUG:teuthology.parallel:result is None 2022-03-17T15:13:56.508 DEBUG:teuthology.orchestra.run.smithi067:> true 2022-03-17T15:13:56.760 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi067.front.sepia.ceph.com' 2022-03-17T15:13:56.761 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-365.el8.x86_64"... 2022-03-17T15:13:56.761 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2022-03-17T15:13:56.779 INFO:teuthology.orchestra.run.smithi067.stdout:4.18.0-365.el8.x86_64 2022-03-17T15:13:56.779 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-365.el8.x86_64 vs 4.18.0-365.el8.x86_64 2022-03-17T15:13:56.780 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2022-03-17T15:13:56.780 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2022-03-17T15:13:57.781 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2022-03-17T15:13:57.782 DEBUG:teuthology.orchestra.run.smithi067:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2022-03-17T15:13:57.899 INFO:teuthology.orchestra.run.smithi067.stdout:ttyS1 2022-03-17T15:13:57.924 DEBUG:teuthology.parallel:result is None 2022-03-17T15:13:57.924 INFO:teuthology.run_tasks:Running task internal.base... 2022-03-17T15:13:57.933 INFO:teuthology.task.internal:Creating test directory... 2022-03-17T15:13:57.934 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-03-17T15:13:57.939 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2022-03-17T15:13:57.960 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2022-03-17T15:13:58.021 INFO:teuthology.run_tasks:Running task internal.archive... 2022-03-17T15:13:58.123 INFO:teuthology.task.internal:Creating archive directory... 2022-03-17T15:13:58.127 DEBUG:teuthology.orchestra.run.smithi061:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-03-17T15:13:58.130 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2022-03-17T15:13:58.182 INFO:teuthology.run_tasks:Running task internal.coredump... 2022-03-17T15:13:58.191 INFO:teuthology.task.internal:Enabling coredump saving... 2022-03-17T15:13:58.192 DEBUG:teuthology.orchestra.run.smithi061:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-03-17T15:13:58.219 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2022-03-17T15:13:58.248 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-03-17T15:13:58.256 INFO:teuthology.orchestra.run.smithi061.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-03-17T15:13:58.262 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-03-17T15:13:58.271 INFO:teuthology.orchestra.run.smithi061.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2022-03-17T15:13:58.271 INFO:teuthology.run_tasks:Running task internal.sudo... 2022-03-17T15:13:58.295 INFO:teuthology.task.internal:Configuring sudo... 2022-03-17T15:13:58.295 DEBUG:teuthology.orchestra.run.smithi061:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-03-17T15:13:58.314 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2022-03-17T15:13:58.343 INFO:teuthology.run_tasks:Running task internal.syslog... 2022-03-17T15:13:58.516 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2022-03-17T15:13:58.518 DEBUG:teuthology.orchestra.run.smithi061:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-03-17T15:13:58.521 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2022-03-17T15:13:58.540 DEBUG:teuthology.orchestra.run.smithi061:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-03-17T15:13:58.623 DEBUG:teuthology.orchestra.run.smithi061:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-03-17T15:13:58.671 DEBUG:teuthology.orchestra.run.smithi061:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-03-17T15:13:58.755 DEBUG:teuthology.orchestra.run.smithi061:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-03-17T15:13:58.798 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2022-03-17T15:13:58.799 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-03-17T15:13:58.869 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2022-03-17T15:13:58.987 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2022-03-17T15:13:59.240 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2022-03-17T15:13:59.669 DEBUG:teuthology.orchestra.run.smithi067:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2022-03-17T15:14:00.149 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2022-03-17T15:14:00.150 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2022-03-17T15:14:00.538 DEBUG:teuthology.orchestra.run.smithi061:> sudo service rsyslog restart 2022-03-17T15:14:00.541 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2022-03-17T15:14:00.614 INFO:teuthology.orchestra.run.smithi067.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-03-17T15:14:00.619 INFO:teuthology.orchestra.run.smithi061.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2022-03-17T15:14:01.081 INFO:teuthology.run_tasks:Running task internal.timer... 2022-03-17T15:14:01.091 INFO:teuthology.task.internal:Starting timer... 2022-03-17T15:14:01.091 INFO:teuthology.run_tasks:Running task pcp... 2022-03-17T15:14:01.295 INFO:teuthology.run_tasks:Running task selinux... 2022-03-17T15:14:01.352 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2022-03-17T15:14:01.353 DEBUG:teuthology.orchestra.run.smithi061:> sudo service auditd rotate 2022-03-17T15:14:01.434 INFO:teuthology.orchestra.run.smithi061.stdout:Rotating logs: 2022-03-17T15:14:01.436 DEBUG:teuthology.orchestra.run.smithi067:> sudo service auditd rotate 2022-03-17T15:14:01.509 INFO:teuthology.orchestra.run.smithi067.stdout:Rotating logs: 2022-03-17T15:14:01.511 DEBUG:teuthology.task.selinux:Getting current SELinux state 2022-03-17T15:14:01.512 DEBUG:teuthology.orchestra.run.smithi061:> /usr/sbin/getenforce 2022-03-17T15:14:01.548 INFO:teuthology.orchestra.run.smithi061.stdout:Permissive 2022-03-17T15:14:01.549 DEBUG:teuthology.orchestra.run.smithi067:> /usr/sbin/getenforce 2022-03-17T15:14:01.641 INFO:teuthology.orchestra.run.smithi067.stdout:Permissive 2022-03-17T15:14:01.641 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi061.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi067.front.sepia.ceph.com': 'permissive'} 2022-03-17T15:14:01.642 DEBUG:teuthology.orchestra.run.smithi061:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-03-17T15:14:01.670 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-03-17T15:14:01.671 DEBUG:teuthology.orchestra.run.smithi067:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|comm="sss_cache"\|context=system_u:system_r:NetworkManager_dispatcher_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2022-03-17T15:14:01.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2022-03-17T15:14:01.702 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2022-03-17T15:14:01.702 DEBUG:teuthology.orchestra.run.smithi061:> sudo /usr/sbin/setenforce permissive 2022-03-17T15:14:01.759 DEBUG:teuthology.orchestra.run.smithi067:> sudo /usr/sbin/setenforce permissive 2022-03-17T15:14:01.787 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2022-03-17T15:14:01.801 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2022-03-17T15:14:01.807 INFO:teuthology.repo_utils:Fetching master from origin 2022-03-17T15:14:01.903 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2022-03-17T15:14:01.947 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2022-03-17T15:14:01.953 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi061.front.sepia.ceph.com,smithi067.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2022-03-17T15:19:11.624 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi061.front.sepia.ceph.com'), Remote(name='ubuntu@smithi067.front.sepia.ceph.com')] 2022-03-17T15:19:11.627 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi061.front.sepia.ceph.com' 2022-03-17T15:19:11.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi061.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-17T15:19:11.700 DEBUG:teuthology.orchestra.run.smithi061:> true 2022-03-17T15:19:11.768 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi067.front.sepia.ceph.com' 2022-03-17T15:19:11.769 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2022-03-17T15:19:11.838 DEBUG:teuthology.orchestra.run.smithi067:> true 2022-03-17T15:19:11.903 INFO:teuthology.run_tasks:Running task clock... 2022-03-17T15:19:11.916 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2022-03-17T15:19:11.916 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-03-17T15:19:11.919 DEBUG:teuthology.orchestra.run.smithi061:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-03-17T15:19:11.921 INFO:teuthology.orchestra.run:Running command with timeout 360 2022-03-17T15:19:11.922 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2022-03-17T15:19:11.952 INFO:teuthology.orchestra.run.smithi061.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-03-17T15:19:11.967 INFO:teuthology.orchestra.run.smithi061.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-03-17T15:19:11.975 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2022-03-17T15:19:11.990 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2022-03-17T15:19:12.033 INFO:teuthology.orchestra.run.smithi061.stderr:sudo: ntpd: command not found 2022-03-17T15:19:12.045 INFO:teuthology.orchestra.run.smithi061.stdout:506 Cannot talk to daemon 2022-03-17T15:19:12.060 INFO:teuthology.orchestra.run.smithi061.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-03-17T15:19:12.065 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: ntpd: command not found 2022-03-17T15:19:12.074 INFO:teuthology.orchestra.run.smithi061.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-03-17T15:19:12.077 INFO:teuthology.orchestra.run.smithi067.stdout:506 Cannot talk to daemon 2022-03-17T15:19:12.092 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntp.service: Unit ntp.service not found. 2022-03-17T15:19:12.106 INFO:teuthology.orchestra.run.smithi067.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2022-03-17T15:19:12.138 INFO:teuthology.orchestra.run.smithi061.stderr:bash: ntpq: command not found 2022-03-17T15:19:12.141 INFO:teuthology.orchestra.run.smithi061.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-03-17T15:19:12.142 INFO:teuthology.orchestra.run.smithi061.stdout:=============================================================================== 2022-03-17T15:19:12.142 INFO:teuthology.orchestra.run.smithi061.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-17T15:19:12.142 INFO:teuthology.orchestra.run.smithi061.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-17T15:19:12.142 INFO:teuthology.orchestra.run.smithi061.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-17T15:19:12.143 INFO:teuthology.orchestra.run.smithi061.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-17T15:19:12.167 INFO:teuthology.orchestra.run.smithi067.stderr:bash: ntpq: command not found 2022-03-17T15:19:12.170 INFO:teuthology.orchestra.run.smithi067.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2022-03-17T15:19:12.171 INFO:teuthology.orchestra.run.smithi067.stdout:=============================================================================== 2022-03-17T15:19:12.171 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-17T15:19:12.171 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-17T15:19:12.172 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-17T15:19:12.172 INFO:teuthology.orchestra.run.smithi067.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2022-03-17T15:19:12.173 INFO:teuthology.run_tasks:Running task pexec... 2022-03-17T15:19:12.186 INFO:teuthology.task.pexec:Executing custom commands... 2022-03-17T15:19:12.186 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi061.front.sepia.ceph.com 2022-03-17T15:19:12.187 DEBUG:teuthology.orchestra.run.smithi061:> TESTDIR=/home/ubuntu/cephtest bash -s 2022-03-17T15:19:12.187 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi067.front.sepia.ceph.com 2022-03-17T15:19:12.188 DEBUG:teuthology.orchestra.run.smithi067:> TESTDIR=/home/ubuntu/cephtest bash -s 2022-03-17T15:19:12.412 INFO:teuthology.orchestra.run.smithi061.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-17T15:19:12.413 INFO:teuthology.orchestra.run.smithi061.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-17T15:19:12.438 INFO:teuthology.orchestra.run.smithi067.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-17T15:19:12.438 INFO:teuthology.orchestra.run.smithi067.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-17T15:19:12.829 INFO:teuthology.orchestra.run.smithi061.stdout:Last metadata expiration check: 0:01:08 ago on Thu 17 Mar 2022 03:18:04 PM UTC. 2022-03-17T15:19:12.852 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:08 ago on Thu 17 Mar 2022 03:18:04 PM UTC. 2022-03-17T15:19:13.962 INFO:teuthology.orchestra.run.smithi061.stdout:Dependencies resolved. 2022-03-17T15:19:13.964 INFO:teuthology.orchestra.run.smithi061.stdout:================================================================================ 2022-03-17T15:19:13.964 INFO:teuthology.orchestra.run.smithi061.stdout: Package Architecture Version Repository Size 2022-03-17T15:19:13.964 INFO:teuthology.orchestra.run.smithi061.stdout:================================================================================ 2022-03-17T15:19:13.964 INFO:teuthology.orchestra.run.smithi061.stdout:Resetting modules: 2022-03-17T15:19:13.964 INFO:teuthology.orchestra.run.smithi061.stdout: container-tools 2022-03-17T15:19:13.965 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:19:13.965 INFO:teuthology.orchestra.run.smithi061.stdout:Transaction Summary 2022-03-17T15:19:13.965 INFO:teuthology.orchestra.run.smithi061.stdout:================================================================================ 2022-03-17T15:19:13.965 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:19:13.978 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2022-03-17T15:19:13.979 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2022-03-17T15:19:13.979 INFO:teuthology.orchestra.run.smithi067.stdout: Package Architecture Version Repository Size 2022-03-17T15:19:13.979 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2022-03-17T15:19:13.979 INFO:teuthology.orchestra.run.smithi067.stdout:Resetting modules: 2022-03-17T15:19:13.980 INFO:teuthology.orchestra.run.smithi067.stdout: container-tools 2022-03-17T15:19:13.980 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:19:13.980 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2022-03-17T15:19:13.980 INFO:teuthology.orchestra.run.smithi067.stdout:================================================================================ 2022-03-17T15:19:13.980 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:19:14.216 INFO:teuthology.orchestra.run.smithi061.stdout:Complete! 2022-03-17T15:19:14.221 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2022-03-17T15:19:14.464 INFO:teuthology.orchestra.run.smithi067.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-17T15:19:14.465 INFO:teuthology.orchestra.run.smithi067.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-17T15:19:14.467 INFO:teuthology.orchestra.run.smithi061.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-17T15:19:14.468 INFO:teuthology.orchestra.run.smithi061.stderr:Invalid configuration value: failovermethod=priority in /etc/yum.repos.d/epel-testing.repo; Configuration: OptionBinding with id "failovermethod" does not exist 2022-03-17T15:19:14.879 INFO:teuthology.orchestra.run.smithi067.stdout:Last metadata expiration check: 0:01:10 ago on Thu 17 Mar 2022 03:18:04 PM UTC. 2022-03-17T15:19:14.880 INFO:teuthology.orchestra.run.smithi061.stdout:Last metadata expiration check: 0:01:10 ago on Thu 17 Mar 2022 03:18:04 PM UTC. 2022-03-17T15:19:16.014 INFO:teuthology.orchestra.run.smithi067.stdout:Dependencies resolved. 2022-03-17T15:19:16.016 INFO:teuthology.orchestra.run.smithi067.stdout:======================================================================================================= 2022-03-17T15:19:16.016 INFO:teuthology.orchestra.run.smithi067.stdout: Package Arch Version Repository Size 2022-03-17T15:19:16.016 INFO:teuthology.orchestra.run.smithi067.stdout:======================================================================================================= 2022-03-17T15:19:16.017 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrading: 2022-03-17T15:19:16.017 INFO:teuthology.orchestra.run.smithi067.stdout: conmon x86_64 2:2.1.0-1.module_el8.7.0+1106+45480ee0 CentOS-AppStream 55 k 2022-03-17T15:19:16.017 INFO:teuthology.orchestra.run.smithi067.stdout: container-selinux noarch 2:2.180.0-1.module_el8.7.0+1106+45480ee0 CentOS-AppStream 59 k 2022-03-17T15:19:16.017 INFO:teuthology.orchestra.run.smithi067.stdout: containernetworking-plugins x86_64 1:1.1.1-1.module_el8.7.0+1106+45480ee0 CentOS-AppStream 18 M 2022-03-17T15:19:16.017 INFO:teuthology.orchestra.run.smithi067.stdout: containers-common x86_64 2:1-23.module_el8.7.0+1106+45480ee0 CentOS-AppStream 96 k 2022-03-17T15:19:16.018 INFO:teuthology.orchestra.run.smithi067.stdout: fuse-overlayfs x86_64 1.8.2-1.module_el8.7.0+1106+45480ee0 CentOS-AppStream 73 k 2022-03-17T15:19:16.018 INFO:teuthology.orchestra.run.smithi067.stdout: runc x86_64 1:1.0.3-3.module_el8.7.0+1106+45480ee0 CentOS-AppStream 3.0 M 2022-03-17T15:19:16.018 INFO:teuthology.orchestra.run.smithi067.stdout: slirp4netns x86_64 1.1.8-2.module_el8.7.0+1106+45480ee0 CentOS-AppStream 51 k 2022-03-17T15:19:16.018 INFO:teuthology.orchestra.run.smithi067.stdout:Installing group/module packages: 2022-03-17T15:19:16.019 INFO:teuthology.orchestra.run.smithi067.stdout: buildah x86_64 1:1.24.2-2.module_el8.7.0+1106+45480ee0 CentOS-AppStream 8.1 M 2022-03-17T15:19:16.019 INFO:teuthology.orchestra.run.smithi067.stdout: cockpit-podman noarch 43-1.module_el8.7.0+1106+45480ee0 CentOS-AppStream 494 k 2022-03-17T15:19:16.019 INFO:teuthology.orchestra.run.smithi067.stdout: crun x86_64 1.4.3-1.module_el8.7.0+1106+45480ee0 CentOS-AppStream 209 k 2022-03-17T15:19:16.019 INFO:teuthology.orchestra.run.smithi067.stdout: python3-podman noarch 4.0.0-1.module_el8.7.0+1106+45480ee0 CentOS-AppStream 149 k 2022-03-17T15:19:16.020 INFO:teuthology.orchestra.run.smithi067.stdout: skopeo x86_64 2:1.6.1-1.module_el8.7.0+1106+45480ee0 CentOS-AppStream 6.7 M 2022-03-17T15:19:16.020 INFO:teuthology.orchestra.run.smithi067.stdout: toolbox x86_64 0.0.99.3-1.module_el8.5.0+877+1c30e0c9 CentOS-AppStream 2.3 M 2022-03-17T15:19:16.020 INFO:teuthology.orchestra.run.smithi067.stdout: udica noarch 0.2.6-2.module_el8.6.0+944+d413f95e CentOS-AppStream 48 k 2022-03-17T15:19:16.020 INFO:teuthology.orchestra.run.smithi067.stdout:Installing dependencies: 2022-03-17T15:19:16.021 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 CentOS-AppStream 25 k 2022-03-17T15:19:16.021 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyxdg noarch 0.25-16.el8 CentOS-AppStream 94 k 2022-03-17T15:19:16.021 INFO:teuthology.orchestra.run.smithi067.stdout: yajl x86_64 2.1.0-10.el8 CentOS-AppStream 41 k 2022-03-17T15:19:16.021 INFO:teuthology.orchestra.run.smithi067.stdout:Installing module profiles: 2022-03-17T15:19:16.022 INFO:teuthology.orchestra.run.smithi067.stdout: container-tools/common 2022-03-17T15:19:16.022 INFO:teuthology.orchestra.run.smithi067.stdout:Enabling module streams: 2022-03-17T15:19:16.022 INFO:teuthology.orchestra.run.smithi067.stdout: container-tools rhel8 2022-03-17T15:19:16.022 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:19:16.023 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction Summary 2022-03-17T15:19:16.023 INFO:teuthology.orchestra.run.smithi067.stdout:======================================================================================================= 2022-03-17T15:19:16.023 INFO:teuthology.orchestra.run.smithi067.stdout:Install 10 Packages 2022-03-17T15:19:16.023 INFO:teuthology.orchestra.run.smithi067.stdout:Upgrade 7 Packages 2022-03-17T15:19:16.024 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:19:16.024 INFO:teuthology.orchestra.run.smithi061.stdout:Dependencies resolved. 2022-03-17T15:19:16.025 INFO:teuthology.orchestra.run.smithi067.stdout:Total download size: 40 M 2022-03-17T15:19:16.025 INFO:teuthology.orchestra.run.smithi067.stdout:Downloading Packages: 2022-03-17T15:19:16.027 INFO:teuthology.orchestra.run.smithi061.stdout:======================================================================================================= 2022-03-17T15:19:16.027 INFO:teuthology.orchestra.run.smithi061.stdout: Package Arch Version Repository Size 2022-03-17T15:19:16.027 INFO:teuthology.orchestra.run.smithi061.stdout:======================================================================================================= 2022-03-17T15:19:16.028 INFO:teuthology.orchestra.run.smithi061.stdout:Upgrading: 2022-03-17T15:19:16.028 INFO:teuthology.orchestra.run.smithi061.stdout: conmon x86_64 2:2.1.0-1.module_el8.7.0+1106+45480ee0 CentOS-AppStream 55 k 2022-03-17T15:19:16.028 INFO:teuthology.orchestra.run.smithi061.stdout: container-selinux noarch 2:2.180.0-1.module_el8.7.0+1106+45480ee0 CentOS-AppStream 59 k 2022-03-17T15:19:16.028 INFO:teuthology.orchestra.run.smithi061.stdout: containernetworking-plugins x86_64 1:1.1.1-1.module_el8.7.0+1106+45480ee0 CentOS-AppStream 18 M 2022-03-17T15:19:16.029 INFO:teuthology.orchestra.run.smithi061.stdout: containers-common x86_64 2:1-23.module_el8.7.0+1106+45480ee0 CentOS-AppStream 96 k 2022-03-17T15:19:16.029 INFO:teuthology.orchestra.run.smithi061.stdout: fuse-overlayfs x86_64 1.8.2-1.module_el8.7.0+1106+45480ee0 CentOS-AppStream 73 k 2022-03-17T15:19:16.029 INFO:teuthology.orchestra.run.smithi061.stdout: runc x86_64 1:1.0.3-3.module_el8.7.0+1106+45480ee0 CentOS-AppStream 3.0 M 2022-03-17T15:19:16.029 INFO:teuthology.orchestra.run.smithi061.stdout: slirp4netns x86_64 1.1.8-2.module_el8.7.0+1106+45480ee0 CentOS-AppStream 51 k 2022-03-17T15:19:16.030 INFO:teuthology.orchestra.run.smithi061.stdout:Installing group/module packages: 2022-03-17T15:19:16.030 INFO:teuthology.orchestra.run.smithi061.stdout: buildah x86_64 1:1.24.2-2.module_el8.7.0+1106+45480ee0 CentOS-AppStream 8.1 M 2022-03-17T15:19:16.030 INFO:teuthology.orchestra.run.smithi061.stdout: cockpit-podman noarch 43-1.module_el8.7.0+1106+45480ee0 CentOS-AppStream 494 k 2022-03-17T15:19:16.030 INFO:teuthology.orchestra.run.smithi061.stdout: crun x86_64 1.4.3-1.module_el8.7.0+1106+45480ee0 CentOS-AppStream 209 k 2022-03-17T15:19:16.031 INFO:teuthology.orchestra.run.smithi061.stdout: python3-podman noarch 4.0.0-1.module_el8.7.0+1106+45480ee0 CentOS-AppStream 149 k 2022-03-17T15:19:16.031 INFO:teuthology.orchestra.run.smithi061.stdout: skopeo x86_64 2:1.6.1-1.module_el8.7.0+1106+45480ee0 CentOS-AppStream 6.7 M 2022-03-17T15:19:16.031 INFO:teuthology.orchestra.run.smithi061.stdout: toolbox x86_64 0.0.99.3-1.module_el8.5.0+877+1c30e0c9 CentOS-AppStream 2.3 M 2022-03-17T15:19:16.031 INFO:teuthology.orchestra.run.smithi061.stdout: udica noarch 0.2.6-2.module_el8.6.0+944+d413f95e CentOS-AppStream 48 k 2022-03-17T15:19:16.032 INFO:teuthology.orchestra.run.smithi061.stdout:Installing dependencies: 2022-03-17T15:19:16.032 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 CentOS-AppStream 25 k 2022-03-17T15:19:16.032 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pyxdg noarch 0.25-16.el8 CentOS-AppStream 94 k 2022-03-17T15:19:16.032 INFO:teuthology.orchestra.run.smithi061.stdout: yajl x86_64 2.1.0-10.el8 CentOS-AppStream 41 k 2022-03-17T15:19:16.033 INFO:teuthology.orchestra.run.smithi061.stdout:Installing module profiles: 2022-03-17T15:19:16.033 INFO:teuthology.orchestra.run.smithi061.stdout: container-tools/common 2022-03-17T15:19:16.033 INFO:teuthology.orchestra.run.smithi061.stdout:Enabling module streams: 2022-03-17T15:19:16.033 INFO:teuthology.orchestra.run.smithi061.stdout: container-tools rhel8 2022-03-17T15:19:16.034 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:19:16.034 INFO:teuthology.orchestra.run.smithi061.stdout:Transaction Summary 2022-03-17T15:19:16.034 INFO:teuthology.orchestra.run.smithi061.stdout:======================================================================================================= 2022-03-17T15:19:16.034 INFO:teuthology.orchestra.run.smithi061.stdout:Install 10 Packages 2022-03-17T15:19:16.035 INFO:teuthology.orchestra.run.smithi061.stdout:Upgrade 7 Packages 2022-03-17T15:19:16.035 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:19:16.036 INFO:teuthology.orchestra.run.smithi061.stdout:Total download size: 40 M 2022-03-17T15:19:16.036 INFO:teuthology.orchestra.run.smithi061.stdout:Downloading Packages: 2022-03-17T15:19:16.116 INFO:teuthology.orchestra.run.smithi067.stdout:(1/17): crun-1.4.3-1.module_el8.7.0+1106+45480e 2.1 MB/s | 209 kB 00:00 2022-03-17T15:19:16.140 INFO:teuthology.orchestra.run.smithi067.stdout:(2/17): cockpit-podman-43-1.module_el8.7.0+1106 4.0 MB/s | 494 kB 00:00 2022-03-17T15:19:16.144 INFO:teuthology.orchestra.run.smithi061.stdout:(1/17): cockpit-podman-43-1.module_el8.7.0+1106 4.3 MB/s | 494 kB 00:00 2022-03-17T15:19:16.158 INFO:teuthology.orchestra.run.smithi067.stdout:(3/17): python3-pytoml-0.1.14-5.git7dea353.el8. 1.4 MB/s | 25 kB 00:00 2022-03-17T15:19:16.169 INFO:teuthology.orchestra.run.smithi061.stdout:(2/17): crun-1.4.3-1.module_el8.7.0+1106+45480e 1.5 MB/s | 209 kB 00:00 2022-03-17T15:19:16.183 INFO:teuthology.orchestra.run.smithi067.stdout:(4/17): python3-podman-4.0.0-1.module_el8.7.0+1 2.2 MB/s | 149 kB 00:00 2022-03-17T15:19:16.194 INFO:teuthology.orchestra.run.smithi061.stdout:(3/17): python3-pytoml-0.1.14-5.git7dea353.el8. 992 kB/s | 25 kB 00:00 2022-03-17T15:19:16.208 INFO:teuthology.orchestra.run.smithi067.stdout:(5/17): python3-pyxdg-0.25-16.el8.noarch.rpm 1.8 MB/s | 94 kB 00:00 2022-03-17T15:19:16.219 INFO:teuthology.orchestra.run.smithi061.stdout:(4/17): python3-podman-4.0.0-1.module_el8.7.0+1 1.9 MB/s | 149 kB 00:00 2022-03-17T15:19:16.245 INFO:teuthology.orchestra.run.smithi061.stdout:(5/17): python3-pyxdg-0.25-16.el8.noarch.rpm 1.8 MB/s | 94 kB 00:00 2022-03-17T15:19:16.392 INFO:teuthology.orchestra.run.smithi067.stdout:(6/17): buildah-1.24.2-2.module_el8.7.0+1106+45 22 MB/s | 8.1 MB 00:00 2022-03-17T15:19:16.408 INFO:teuthology.orchestra.run.smithi067.stdout:(7/17): udica-0.2.6-2.module_el8.6.0+944+d413f9 2.9 MB/s | 48 kB 00:00 2022-03-17T15:19:16.420 INFO:teuthology.orchestra.run.smithi061.stdout:(6/17): toolbox-0.0.99.3-1.module_el8.5.0+877+1 13 MB/s | 2.3 MB 00:00 2022-03-17T15:19:16.425 INFO:teuthology.orchestra.run.smithi067.stdout:(8/17): yajl-2.1.0-10.el8.x86_64.rpm 2.4 MB/s | 41 kB 00:00 2022-03-17T15:19:16.446 INFO:teuthology.orchestra.run.smithi061.stdout:(7/17): udica-0.2.6-2.module_el8.6.0+944+d413f9 1.9 MB/s | 48 kB 00:00 2022-03-17T15:19:16.471 INFO:teuthology.orchestra.run.smithi061.stdout:(8/17): yajl-2.1.0-10.el8.x86_64.rpm 1.6 MB/s | 41 kB 00:00 2022-03-17T15:19:16.484 INFO:teuthology.orchestra.run.smithi067.stdout:(9/17): toolbox-0.0.99.3-1.module_el8.5.0+877+1 8.2 MB/s | 2.3 MB 00:00 2022-03-17T15:19:16.496 INFO:teuthology.orchestra.run.smithi061.stdout:(9/17): conmon-2.1.0-1.module_el8.7.0+1106+4548 2.2 MB/s | 55 kB 00:00 2022-03-17T15:19:16.518 INFO:teuthology.orchestra.run.smithi067.stdout:(10/17): conmon-2.1.0-1.module_el8.7.0+1106+454 599 kB/s | 55 kB 00:00 2022-03-17T15:19:16.521 INFO:teuthology.orchestra.run.smithi061.stdout:(10/17): container-selinux-2.180.0-1.module_el8 2.3 MB/s | 59 kB 00:00 2022-03-17T15:19:16.543 INFO:teuthology.orchestra.run.smithi067.stdout:(11/17): container-selinux-2.180.0-1.module_el8 997 kB/s | 59 kB 00:00 2022-03-17T15:19:16.585 INFO:teuthology.orchestra.run.smithi067.stdout:(12/17): containers-common-1-23.module_el8.7.0+ 2.3 MB/s | 96 kB 00:00 2022-03-17T15:19:16.619 INFO:teuthology.orchestra.run.smithi067.stdout:(13/17): fuse-overlayfs-1.8.2-1.module_el8.7.0+ 2.2 MB/s | 73 kB 00:00 2022-03-17T15:19:16.671 INFO:teuthology.orchestra.run.smithi061.stdout:(11/17): buildah-1.24.2-2.module_el8.7.0+1106+4 13 MB/s | 8.1 MB 00:00 2022-03-17T15:19:16.705 INFO:teuthology.orchestra.run.smithi061.stdout:(12/17): containers-common-1-23.module_el8.7.0+ 2.8 MB/s | 96 kB 00:00 2022-03-17T15:19:16.730 INFO:teuthology.orchestra.run.smithi061.stdout:(13/17): fuse-overlayfs-1.8.2-1.module_el8.7.0+ 2.9 MB/s | 73 kB 00:00 2022-03-17T15:19:16.881 INFO:teuthology.orchestra.run.smithi061.stdout:(14/17): runc-1.0.3-3.module_el8.7.0+1106+45480 20 MB/s | 3.0 MB 00:00 2022-03-17T15:19:16.885 INFO:teuthology.orchestra.run.smithi067.stdout:(14/17): runc-1.0.3-3.module_el8.7.0+1106+45480 11 MB/s | 3.0 MB 00:00 2022-03-17T15:19:16.906 INFO:teuthology.orchestra.run.smithi061.stdout:(15/17): slirp4netns-1.1.8-2.module_el8.7.0+110 2.0 MB/s | 51 kB 00:00 2022-03-17T15:19:16.919 INFO:teuthology.orchestra.run.smithi067.stdout:(15/17): slirp4netns-1.1.8-2.module_el8.7.0+110 1.5 MB/s | 51 kB 00:00 2022-03-17T15:19:17.053 INFO:teuthology.orchestra.run.smithi067.stdout:(16/17): skopeo-1.6.1-1.module_el8.7.0+1106+454 7.7 MB/s | 6.7 MB 00:00 2022-03-17T15:19:17.131 INFO:teuthology.orchestra.run.smithi061.stdout:(16/17): skopeo-1.6.1-1.module_el8.7.0+1106+454 7.3 MB/s | 6.7 MB 00:00 2022-03-17T15:19:17.286 INFO:teuthology.orchestra.run.smithi067.stdout:(17/17): containernetworking-plugins-1.1.1-1.mo 24 MB/s | 18 MB 00:00 2022-03-17T15:19:17.289 INFO:teuthology.orchestra.run.smithi067.stdout:-------------------------------------------------------------------------------- 2022-03-17T15:19:17.289 INFO:teuthology.orchestra.run.smithi067.stdout:Total 31 MB/s | 40 MB 00:01 2022-03-17T15:19:17.323 INFO:teuthology.orchestra.run.smithi061.stdout:(17/17): containernetworking-plugins-1.1.1-1.mo 23 MB/s | 18 MB 00:00 2022-03-17T15:19:17.325 INFO:teuthology.orchestra.run.smithi061.stdout:-------------------------------------------------------------------------------- 2022-03-17T15:19:17.326 INFO:teuthology.orchestra.run.smithi061.stdout:Total 31 MB/s | 40 MB 00:01 2022-03-17T15:19:17.675 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction check 2022-03-17T15:19:17.712 INFO:teuthology.orchestra.run.smithi061.stdout:Running transaction check 2022-03-17T15:19:17.717 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction check succeeded. 2022-03-17T15:19:17.718 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction test 2022-03-17T15:19:17.756 INFO:teuthology.orchestra.run.smithi061.stdout:Transaction check succeeded. 2022-03-17T15:19:17.756 INFO:teuthology.orchestra.run.smithi061.stdout:Running transaction test 2022-03-17T15:19:18.104 INFO:teuthology.orchestra.run.smithi067.stdout:Transaction test succeeded. 2022-03-17T15:19:18.107 INFO:teuthology.orchestra.run.smithi067.stdout:Running transaction 2022-03-17T15:19:18.170 INFO:teuthology.orchestra.run.smithi061.stdout:Transaction test succeeded. 2022-03-17T15:19:18.174 INFO:teuthology.orchestra.run.smithi061.stdout:Running transaction 2022-03-17T15:19:19.081 INFO:teuthology.orchestra.run.smithi067.stdout: Preparing : 1/1 2022-03-17T15:19:19.126 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 1/24 2022-03-17T15:19:19.139 INFO:teuthology.orchestra.run.smithi061.stdout: Preparing : 1/1 2022-03-17T15:19:19.167 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 1/24 2022-03-17T15:19:19.327 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 1/24 2022-03-17T15:19:19.346 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 1/24 2022-03-17T15:19:36.869 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 1/24 2022-03-17T15:19:37.140 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 1/24 2022-03-17T15:19:37.393 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : slirp4netns-1.1.8-2.module_el8.7.0+1106+45480ee0.x 2/24 2022-03-17T15:19:37.604 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : runc-1:1.0.3-3.module_el8.7.0+1106+45480ee0.x86_64 3/24 2022-03-17T15:19:37.648 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : slirp4netns-1.1.8-2.module_el8.7.0+1106+45480ee0.x 2/24 2022-03-17T15:19:37.744 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : fuse-overlayfs-1.8.2-1.module_el8.7.0+1106+45480ee 4/24 2022-03-17T15:19:37.762 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: fuse-overlayfs-1.8.2-1.module_el8.7.0+1106+45480ee 4/24 2022-03-17T15:19:37.820 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : runc-1:1.0.3-3.module_el8.7.0+1106+45480ee0.x86_64 3/24 2022-03-17T15:19:37.938 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : yajl-2.1.0-10.el8.x86_64 5/24 2022-03-17T15:19:37.975 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : fuse-overlayfs-1.8.2-1.module_el8.7.0+1106+45480ee 4/24 2022-03-17T15:19:37.993 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: fuse-overlayfs-1.8.2-1.module_el8.7.0+1106+45480ee 4/24 2022-03-17T15:19:38.116 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : crun-1.4.3-1.module_el8.7.0+1106+45480ee0.x86_64 6/24 2022-03-17T15:19:38.127 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : yajl-2.1.0-10.el8.x86_64 5/24 2022-03-17T15:19:38.299 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : containers-common-2:1-23.module_el8.7.0+1106+45480 7/24 2022-03-17T15:19:38.300 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : crun-1.4.3-1.module_el8.7.0+1106+45480ee0.x86_64 6/24 2022-03-17T15:19:38.437 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 8/24 2022-03-17T15:19:38.478 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : containers-common-2:1-23.module_el8.7.0+1106+45480 7/24 2022-03-17T15:19:38.617 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 8/24 2022-03-17T15:19:38.632 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 9/24 2022-03-17T15:19:38.854 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 9/24 2022-03-17T15:19:39.561 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : python3-podman-4.0.0-1.module_el8.7.0+1106+45480ee 10/24 2022-03-17T15:19:39.741 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : python3-podman-4.0.0-1.module_el8.7.0+1106+45480ee 10/24 2022-03-17T15:19:40.409 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : buildah-1:1.24.2-2.module_el8.7.0+1106+45480ee0.x8 11/24 2022-03-17T15:19:40.505 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : buildah-1:1.24.2-2.module_el8.7.0+1106+45480ee0.x8 11/24 2022-03-17T15:19:40.590 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : skopeo-2:1.6.1-1.module_el8.7.0+1106+45480ee0.x86_ 12/24 2022-03-17T15:19:40.654 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : skopeo-2:1.6.1-1.module_el8.7.0+1106+45480ee0.x86_ 12/24 2022-03-17T15:19:42.459 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 13/24 2022-03-17T15:19:42.541 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 13/24 2022-03-17T15:19:42.661 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : containernetworking-plugins-1:1.1.1-1.module_el8.7 14/24 2022-03-17T15:19:42.733 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : containernetworking-plugins-1:1.1.1-1.module_el8.7 14/24 2022-03-17T15:19:43.044 INFO:teuthology.orchestra.run.smithi061.stdout: Upgrading : conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_ 15/24 2022-03-17T15:19:43.091 INFO:teuthology.orchestra.run.smithi067.stdout: Upgrading : conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_ 15/24 2022-03-17T15:19:43.242 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 16/24 2022-03-17T15:19:43.257 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 16/24 2022-03-17T15:19:43.395 INFO:teuthology.orchestra.run.smithi061.stdout: Installing : cockpit-podman-43-1.module_el8.7.0+1106+45480ee0.n 17/24 2022-03-17T15:19:43.401 INFO:teuthology.orchestra.run.smithi067.stdout: Installing : cockpit-podman-43-1.module_el8.7.0+1106+45480ee0.n 17/24 2022-03-17T15:19:43.535 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : containers-common-2:1-6.module_el8.6.0+954+963caf3 18/24 2022-03-17T15:19:43.535 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : container-selinux-2:2.170.0-1.module_el8.6.0+954+9 19/24 2022-03-17T15:19:43.547 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : containers-common-2:1-6.module_el8.6.0+954+963caf3 18/24 2022-03-17T15:19:43.547 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : container-selinux-2:2.170.0-1.module_el8.6.0+954+9 19/24 2022-03-17T15:19:43.719 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: container-selinux-2:2.170.0-1.module_el8.6.0+954+9 19/24 2022-03-17T15:19:43.737 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: container-selinux-2:2.170.0-1.module_el8.6.0+954+9 19/24 2022-03-17T15:19:43.901 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : runc-1.0.2-1.module_el8.6.0+926+8bef8ae7.x86_64 20/24 2022-03-17T15:19:43.911 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : runc-1.0.2-1.module_el8.6.0+926+8bef8ae7.x86_64 20/24 2022-03-17T15:19:44.037 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : fuse-overlayfs-1.7.1-1.module_el8.6.0+926+8bef8ae7 21/24 2022-03-17T15:19:44.051 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : fuse-overlayfs-1.7.1-1.module_el8.6.0+926+8bef8ae7 21/24 2022-03-17T15:19:44.188 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : slirp4netns-1.1.8-1.module_el8.6.0+926+8bef8ae7.x8 22/24 2022-03-17T15:19:44.215 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : slirp4netns-1.1.8-1.module_el8.6.0+926+8bef8ae7.x8 22/24 2022-03-17T15:19:44.334 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : containernetworking-plugins-1.0.1-1.module_el8.6.0 23/24 2022-03-17T15:19:44.395 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : containernetworking-plugins-1.0.1-1.module_el8.6.0 23/24 2022-03-17T15:19:44.459 INFO:teuthology.orchestra.run.smithi067.stdout: Cleanup : conmon-2:2.0.30-1.module_el8.6.0+944+d413f95e.x86_ 24/24 2022-03-17T15:19:44.544 INFO:teuthology.orchestra.run.smithi061.stdout: Cleanup : conmon-2:2.0.30-1.module_el8.6.0+944+d413f95e.x86_ 24/24 2022-03-17T15:19:45.018 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 24/24 2022-03-17T15:19:45.123 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 24/24 2022-03-17T15:19:45.512 INFO:teuthology.orchestra.run.smithi067.stdout: Running scriptlet: conmon-2:2.0.30-1.module_el8.6.0+944+d413f95e.x86_ 24/24 2022-03-17T15:19:45.512 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : buildah-1:1.24.2-2.module_el8.7.0+1106+45480ee0.x8 1/24 2022-03-17T15:19:45.513 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : cockpit-podman-43-1.module_el8.7.0+1106+45480ee0.n 2/24 2022-03-17T15:19:45.513 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : crun-1.4.3-1.module_el8.7.0+1106+45480ee0.x86_64 3/24 2022-03-17T15:19:45.513 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-podman-4.0.0-1.module_el8.7.0+1106+45480ee 4/24 2022-03-17T15:19:45.513 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 5/24 2022-03-17T15:19:45.513 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 6/24 2022-03-17T15:19:45.514 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : skopeo-2:1.6.1-1.module_el8.7.0+1106+45480ee0.x86_ 7/24 2022-03-17T15:19:45.514 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 8/24 2022-03-17T15:19:45.514 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 9/24 2022-03-17T15:19:45.514 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 10/24 2022-03-17T15:19:45.515 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_ 11/24 2022-03-17T15:19:45.515 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : conmon-2:2.0.30-1.module_el8.6.0+944+d413f95e.x86_ 12/24 2022-03-17T15:19:45.515 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 13/24 2022-03-17T15:19:45.515 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : container-selinux-2:2.170.0-1.module_el8.6.0+954+9 14/24 2022-03-17T15:19:45.515 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : containernetworking-plugins-1:1.1.1-1.module_el8.7 15/24 2022-03-17T15:19:45.516 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : containernetworking-plugins-1.0.1-1.module_el8.6.0 16/24 2022-03-17T15:19:45.516 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : containers-common-2:1-23.module_el8.7.0+1106+45480 17/24 2022-03-17T15:19:45.516 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : containers-common-2:1-6.module_el8.6.0+954+963caf3 18/24 2022-03-17T15:19:45.516 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-overlayfs-1.8.2-1.module_el8.7.0+1106+45480ee 19/24 2022-03-17T15:19:45.517 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : fuse-overlayfs-1.7.1-1.module_el8.6.0+926+8bef8ae7 20/24 2022-03-17T15:19:45.517 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : runc-1:1.0.3-3.module_el8.7.0+1106+45480ee0.x86_64 21/24 2022-03-17T15:19:45.517 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : runc-1.0.2-1.module_el8.6.0+926+8bef8ae7.x86_64 22/24 2022-03-17T15:19:45.517 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : slirp4netns-1.1.8-2.module_el8.7.0+1106+45480ee0.x 23/24 2022-03-17T15:19:45.631 INFO:teuthology.orchestra.run.smithi061.stdout: Running scriptlet: conmon-2:2.0.30-1.module_el8.6.0+944+d413f95e.x86_ 24/24 2022-03-17T15:19:45.631 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : buildah-1:1.24.2-2.module_el8.7.0+1106+45480ee0.x8 1/24 2022-03-17T15:19:45.631 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : cockpit-podman-43-1.module_el8.7.0+1106+45480ee0.n 2/24 2022-03-17T15:19:45.632 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : crun-1.4.3-1.module_el8.7.0+1106+45480ee0.x86_64 3/24 2022-03-17T15:19:45.632 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-podman-4.0.0-1.module_el8.7.0+1106+45480ee 4/24 2022-03-17T15:19:45.632 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 5/24 2022-03-17T15:19:45.632 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 6/24 2022-03-17T15:19:45.633 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : skopeo-2:1.6.1-1.module_el8.7.0+1106+45480ee0.x86_ 7/24 2022-03-17T15:19:45.633 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86 8/24 2022-03-17T15:19:45.633 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 9/24 2022-03-17T15:19:45.633 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 10/24 2022-03-17T15:19:45.633 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_ 11/24 2022-03-17T15:19:45.634 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : conmon-2:2.0.30-1.module_el8.6.0+944+d413f95e.x86_ 12/24 2022-03-17T15:19:45.634 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : container-selinux-2:2.180.0-1.module_el8.7.0+1106+ 13/24 2022-03-17T15:19:45.634 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : container-selinux-2:2.170.0-1.module_el8.6.0+954+9 14/24 2022-03-17T15:19:45.635 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : containernetworking-plugins-1:1.1.1-1.module_el8.7 15/24 2022-03-17T15:19:45.635 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : containernetworking-plugins-1.0.1-1.module_el8.6.0 16/24 2022-03-17T15:19:45.635 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : containers-common-2:1-23.module_el8.7.0+1106+45480 17/24 2022-03-17T15:19:45.635 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : containers-common-2:1-6.module_el8.6.0+954+963caf3 18/24 2022-03-17T15:19:45.636 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : fuse-overlayfs-1.8.2-1.module_el8.7.0+1106+45480ee 19/24 2022-03-17T15:19:45.636 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : fuse-overlayfs-1.7.1-1.module_el8.6.0+926+8bef8ae7 20/24 2022-03-17T15:19:45.637 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : runc-1:1.0.3-3.module_el8.7.0+1106+45480ee0.x86_64 21/24 2022-03-17T15:19:45.637 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : runc-1.0.2-1.module_el8.6.0+926+8bef8ae7.x86_64 22/24 2022-03-17T15:19:45.638 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : slirp4netns-1.1.8-2.module_el8.7.0+1106+45480ee0.x 23/24 2022-03-17T15:19:46.193 INFO:teuthology.orchestra.run.smithi067.stdout: Verifying : slirp4netns-1.1.8-1.module_el8.6.0+926+8bef8ae7.x8 24/24 2022-03-17T15:19:46.193 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:19:46.194 INFO:teuthology.orchestra.run.smithi067.stdout:Upgraded: 2022-03-17T15:19:46.194 INFO:teuthology.orchestra.run.smithi067.stdout: conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.194 INFO:teuthology.orchestra.run.smithi067.stdout: container-selinux-2:2.180.0-1.module_el8.7.0+1106+45480ee0.noarch 2022-03-17T15:19:46.194 INFO:teuthology.orchestra.run.smithi067.stdout: containernetworking-plugins-1:1.1.1-1.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.194 INFO:teuthology.orchestra.run.smithi067.stdout: containers-common-2:1-23.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.195 INFO:teuthology.orchestra.run.smithi067.stdout: fuse-overlayfs-1.8.2-1.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.195 INFO:teuthology.orchestra.run.smithi067.stdout: runc-1:1.0.3-3.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.195 INFO:teuthology.orchestra.run.smithi067.stdout: slirp4netns-1.1.8-2.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.195 INFO:teuthology.orchestra.run.smithi067.stdout:Installed: 2022-03-17T15:19:46.196 INFO:teuthology.orchestra.run.smithi067.stdout: buildah-1:1.24.2-2.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.196 INFO:teuthology.orchestra.run.smithi067.stdout: cockpit-podman-43-1.module_el8.7.0+1106+45480ee0.noarch 2022-03-17T15:19:46.196 INFO:teuthology.orchestra.run.smithi067.stdout: crun-1.4.3-1.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.196 INFO:teuthology.orchestra.run.smithi067.stdout: python3-podman-4.0.0-1.module_el8.7.0+1106+45480ee0.noarch 2022-03-17T15:19:46.196 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2022-03-17T15:19:46.197 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyxdg-0.25-16.el8.noarch 2022-03-17T15:19:46.197 INFO:teuthology.orchestra.run.smithi067.stdout: skopeo-2:1.6.1-1.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.197 INFO:teuthology.orchestra.run.smithi067.stdout: toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86_64 2022-03-17T15:19:46.197 INFO:teuthology.orchestra.run.smithi067.stdout: udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 2022-03-17T15:19:46.198 INFO:teuthology.orchestra.run.smithi067.stdout: yajl-2.1.0-10.el8.x86_64 2022-03-17T15:19:46.198 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:19:46.198 INFO:teuthology.orchestra.run.smithi067.stdout:Complete! 2022-03-17T15:19:46.397 INFO:teuthology.orchestra.run.smithi061.stdout: Verifying : slirp4netns-1.1.8-1.module_el8.6.0+926+8bef8ae7.x8 24/24 2022-03-17T15:19:46.397 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:19:46.397 INFO:teuthology.orchestra.run.smithi061.stdout:Upgraded: 2022-03-17T15:19:46.398 INFO:teuthology.orchestra.run.smithi061.stdout: conmon-2:2.1.0-1.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.398 INFO:teuthology.orchestra.run.smithi061.stdout: container-selinux-2:2.180.0-1.module_el8.7.0+1106+45480ee0.noarch 2022-03-17T15:19:46.398 INFO:teuthology.orchestra.run.smithi061.stdout: containernetworking-plugins-1:1.1.1-1.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.398 INFO:teuthology.orchestra.run.smithi061.stdout: containers-common-2:1-23.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.399 INFO:teuthology.orchestra.run.smithi061.stdout: fuse-overlayfs-1.8.2-1.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.399 INFO:teuthology.orchestra.run.smithi061.stdout: runc-1:1.0.3-3.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.399 INFO:teuthology.orchestra.run.smithi061.stdout: slirp4netns-1.1.8-2.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.399 INFO:teuthology.orchestra.run.smithi061.stdout:Installed: 2022-03-17T15:19:46.399 INFO:teuthology.orchestra.run.smithi061.stdout: buildah-1:1.24.2-2.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.400 INFO:teuthology.orchestra.run.smithi061.stdout: cockpit-podman-43-1.module_el8.7.0+1106+45480ee0.noarch 2022-03-17T15:19:46.400 INFO:teuthology.orchestra.run.smithi061.stdout: crun-1.4.3-1.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.400 INFO:teuthology.orchestra.run.smithi061.stdout: python3-podman-4.0.0-1.module_el8.7.0+1106+45480ee0.noarch 2022-03-17T15:19:46.400 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2022-03-17T15:19:46.401 INFO:teuthology.orchestra.run.smithi061.stdout: python3-pyxdg-0.25-16.el8.noarch 2022-03-17T15:19:46.401 INFO:teuthology.orchestra.run.smithi061.stdout: skopeo-2:1.6.1-1.module_el8.7.0+1106+45480ee0.x86_64 2022-03-17T15:19:46.401 INFO:teuthology.orchestra.run.smithi061.stdout: toolbox-0.0.99.3-1.module_el8.5.0+877+1c30e0c9.x86_64 2022-03-17T15:19:46.401 INFO:teuthology.orchestra.run.smithi061.stdout: udica-0.2.6-2.module_el8.6.0+944+d413f95e.noarch 2022-03-17T15:19:46.401 INFO:teuthology.orchestra.run.smithi061.stdout: yajl-2.1.0-10.el8.x86_64 2022-03-17T15:19:46.402 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:19:46.402 INFO:teuthology.orchestra.run.smithi061.stdout:Complete! 2022-03-17T15:19:46.442 DEBUG:teuthology.parallel:result is None 2022-03-17T15:19:46.690 DEBUG:teuthology.parallel:result is None 2022-03-17T15:19:46.690 INFO:teuthology.run_tasks:Running task cephadm... 2022-03-17T15:19:46.771 INFO:tasks.cephadm:Config: {'avoid_pacific_features': True, 'cephadm_branch': 'v16.2.4', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'docker.io/ceph/ceph:v16.2.4', 'roleless': True, 'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20, 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6'} 2022-03-17T15:19:46.772 INFO:tasks.cephadm:Cluster image is docker.io/ceph/ceph:v16.2.4 2022-03-17T15:19:46.773 INFO:tasks.cephadm:Cluster fsid is ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:19:46.774 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2022-03-17T15:19:46.774 INFO:tasks.cephadm:No mon roles; fabricating mons 2022-03-17T15:19:46.774 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi061': '172.21.15.61', 'mon.smithi067': '172.21.15.67'} 2022-03-17T15:19:46.775 INFO:tasks.cephadm:Normalizing hostnames... 2022-03-17T15:19:46.775 DEBUG:teuthology.orchestra.run.smithi061:> sudo hostname $(hostname -s) 2022-03-17T15:19:46.803 DEBUG:teuthology.orchestra.run.smithi067:> sudo hostname $(hostname -s) 2022-03-17T15:19:46.833 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v16.2.4)... 2022-03-17T15:19:46.834 DEBUG:teuthology.orchestra.run.smithi061:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v16.2.4/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2022-03-17T15:19:46.962 INFO:teuthology.orchestra.run.smithi061.stdout:-rw-rw-r--. 1 ubuntu ubuntu 292005 Mar 17 15:19 /home/ubuntu/cephtest/cephadm 2022-03-17T15:19:46.963 DEBUG:teuthology.orchestra.run.smithi067:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v16.2.4/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2022-03-17T15:19:47.069 INFO:teuthology.orchestra.run.smithi067.stdout:-rw-rw-r--. 1 ubuntu ubuntu 292005 Mar 17 15:19 /home/ubuntu/cephtest/cephadm 2022-03-17T15:19:47.070 DEBUG:teuthology.orchestra.run.smithi061:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2022-03-17T15:19:47.089 DEBUG:teuthology.orchestra.run.smithi067:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2022-03-17T15:19:47.119 DEBUG:teuthology.orchestra.run.smithi061:> sudo mkdir -p /etc/ceph 2022-03-17T15:19:47.158 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph 2022-03-17T15:19:47.186 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 777 /etc/ceph 2022-03-17T15:19:47.225 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /etc/ceph 2022-03-17T15:19:47.252 INFO:tasks.cephadm:Writing seed config... 2022-03-17T15:19:47.254 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2022-03-17T15:19:47.254 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2022-03-17T15:19:47.255 INFO:tasks.cephadm: override: [mon] debug mon = 20 2022-03-17T15:19:47.255 INFO:tasks.cephadm: override: [mon] debug ms = 1 2022-03-17T15:19:47.255 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2022-03-17T15:19:47.256 INFO:tasks.cephadm: override: [osd] debug ms = 1 2022-03-17T15:19:47.256 INFO:tasks.cephadm: override: [osd] debug osd = 20 2022-03-17T15:19:47.256 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2022-03-17T15:19:47.257 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2022-03-17T15:19:47.257 DEBUG:teuthology.orchestra.run.smithi061:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2022-03-17T15:19:47.281 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ae1b9b88-a605-11ec-8c35-001a4aab830c [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2022-03-17T15:19:47.282 DEBUG:teuthology.orchestra.run.smithi061:mon.smithi061> sudo journalctl -f -n 0 -u ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mon.smithi061.service 2022-03-17T15:19:47.324 INFO:tasks.cephadm:Bootstrapping... 2022-03-17T15:19:47.325 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 -v bootstrap --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.61 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2022-03-17T15:19:47.351 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:-- Logs begin at Thu 2022-03-17 15:13:33 UTC. -- 2022-03-17T15:19:47.604 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2022-03-17T15:19:48.827 INFO:teuthology.orchestra.run.smithi061.stderr:/bin/podman: 4.0.2 2022-03-17T15:19:48.884 INFO:teuthology.orchestra.run.smithi061.stderr:Verifying podman|docker is present... 2022-03-17T15:19:48.885 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2022-03-17T15:19:48.926 INFO:teuthology.orchestra.run.smithi061.stderr:/bin/podman: 4.0.2 2022-03-17T15:19:49.039 INFO:teuthology.orchestra.run.smithi061.stderr:Verifying lvm2 is present... 2022-03-17T15:19:49.039 INFO:teuthology.orchestra.run.smithi061.stderr:Verifying time synchronization is in place... 2022-03-17T15:19:49.039 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl is-enabled chrony.service 2022-03-17T15:19:49.047 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2022-03-17T15:19:49.047 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl is-active chrony.service 2022-03-17T15:19:49.053 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: inactive 2022-03-17T15:19:49.054 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl is-enabled chronyd.service 2022-03-17T15:19:49.060 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: enabled 2022-03-17T15:19:49.061 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl is-active chronyd.service 2022-03-17T15:19:49.066 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: active 2022-03-17T15:19:49.067 INFO:teuthology.orchestra.run.smithi061.stderr:Unit chronyd.service is enabled and running 2022-03-17T15:19:49.068 INFO:teuthology.orchestra.run.smithi061.stderr:Repeating the final host check... 2022-03-17T15:19:49.068 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman version --format {{.Client.Version}} 2022-03-17T15:19:49.105 INFO:teuthology.orchestra.run.smithi061.stderr:/bin/podman: 4.0.2 2022-03-17T15:19:49.213 INFO:teuthology.orchestra.run.smithi061.stderr:podman|docker (/bin/podman) is present 2022-03-17T15:19:49.213 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl is present 2022-03-17T15:19:49.214 INFO:teuthology.orchestra.run.smithi061.stderr:lvcreate is present 2022-03-17T15:19:49.214 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl is-enabled chrony.service 2022-03-17T15:19:49.219 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2022-03-17T15:19:49.219 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl is-active chrony.service 2022-03-17T15:19:49.225 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: inactive 2022-03-17T15:19:49.226 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl is-enabled chronyd.service 2022-03-17T15:19:49.231 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: enabled 2022-03-17T15:19:49.232 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl is-active chronyd.service 2022-03-17T15:19:49.238 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: active 2022-03-17T15:19:49.239 INFO:teuthology.orchestra.run.smithi061.stderr:Unit chronyd.service is enabled and running 2022-03-17T15:19:49.239 INFO:teuthology.orchestra.run.smithi061.stderr:Host looks OK 2022-03-17T15:19:49.239 INFO:teuthology.orchestra.run.smithi061.stderr:Cluster fsid: ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:19:49.239 INFO:teuthology.orchestra.run.smithi061.stderr:Acquiring lock 140503618277504 on /run/cephadm/ae1b9b88-a605-11ec-8c35-001a4aab830c.lock 2022-03-17T15:19:49.240 INFO:teuthology.orchestra.run.smithi061.stderr:Lock 140503618277504 acquired on /run/cephadm/ae1b9b88-a605-11ec-8c35-001a4aab830c.lock 2022-03-17T15:19:49.240 INFO:teuthology.orchestra.run.smithi061.stderr:Verifying IP 172.21.15.61 port 3300 ... 2022-03-17T15:19:49.241 INFO:teuthology.orchestra.run.smithi061.stderr:Verifying IP 172.21.15.61 port 6789 ... 2022-03-17T15:19:49.241 INFO:teuthology.orchestra.run.smithi061.stderr:Base mon IP is 172.21.15.61, final addrv is [v2:172.21.15.61:3300,v1:172.21.15.61:6789] 2022-03-17T15:19:49.241 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /sbin/ip route ls 2022-03-17T15:19:49.243 INFO:teuthology.orchestra.run.smithi061.stderr:/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2022-03-17T15:19:49.243 INFO:teuthology.orchestra.run.smithi061.stderr:/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.61 metric 100 2022-03-17T15:19:49.243 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /sbin/ip -6 route ls 2022-03-17T15:19:49.246 INFO:teuthology.orchestra.run.smithi061.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2022-03-17T15:19:49.246 INFO:teuthology.orchestra.run.smithi061.stderr:/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2022-03-17T15:19:49.246 INFO:teuthology.orchestra.run.smithi061.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1798sec hoplimit 64 pref medium 2022-03-17T15:19:49.247 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /sbin/ip -6 addr ls 2022-03-17T15:19:49.248 INFO:teuthology.orchestra.run.smithi061.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2022-03-17T15:19:49.249 INFO:teuthology.orchestra.run.smithi061.stderr:/sbin/ip: inet6 ::1/128 scope host 2022-03-17T15:19:49.249 INFO:teuthology.orchestra.run.smithi061.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2022-03-17T15:19:49.249 INFO:teuthology.orchestra.run.smithi061.stderr:/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2022-03-17T15:19:49.249 INFO:teuthology.orchestra.run.smithi061.stderr:/sbin/ip: inet6 fe80::ec4:7aff:feb6:f8b9/64 scope link 2022-03-17T15:19:49.250 INFO:teuthology.orchestra.run.smithi061.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2022-03-17T15:19:49.250 INFO:teuthology.orchestra.run.smithi061.stderr:Mon IP 172.21.15.61 is in CIDR network 172.21.0.0/20 2022-03-17T15:19:49.251 INFO:teuthology.orchestra.run.smithi061.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2022-03-17T15:19:49.251 INFO:teuthology.orchestra.run.smithi061.stderr:Pulling container image docker.io/ceph/ceph:v16.2.4... 2022-03-17T15:19:49.252 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman pull docker.io/ceph/ceph:v16.2.4 2022-03-17T15:19:49.341 INFO:teuthology.orchestra.run.smithi061.stderr:/bin/podman: Trying to pull docker.io/ceph/ceph:v16.2.4... 2022-03-17T15:19:49.745 INFO:teuthology.orchestra.run.smithi061.stderr:/bin/podman: Getting image source signatures 2022-03-17T15:19:49.756 INFO:teuthology.orchestra.run.smithi061.stderr:/bin/podman: Copying blob sha256:551101690791055467b1840be133b2e6b029d263771bc6c46a96bb7acdacac39 2022-03-17T15:19:49.757 INFO:teuthology.orchestra.run.smithi061.stderr:/bin/podman: Copying blob sha256:7a0437f04f83f084b7ed68ad9c4a4947e12fc4e1b006b38129bac89114ec3621 2022-03-17T15:19:49.892 INFO:teuthology.orchestra.run.smithi061.stderr:/bin/podman: Copying blob sha256:551101690791055467b1840be133b2e6b029d263771bc6c46a96bb7acdacac39 2022-03-17T15:19:49.942 INFO:teuthology.orchestra.run.smithi061.stderr:/bin/podman: Copying blob sha256:7a0437f04f83f084b7ed68ad9c4a4947e12fc4e1b006b38129bac89114ec3621 2022-03-17T15:20:01.266 INFO:teuthology.orchestra.run.smithi061.stderr:/bin/podman: Copying config sha256:8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29 2022-03-17T15:20:01.316 INFO:teuthology.orchestra.run.smithi061.stderr:/bin/podman: Writing manifest to image destination 2022-03-17T15:20:01.316 INFO:teuthology.orchestra.run.smithi061.stderr:/bin/podman: Storing signatures 2022-03-17T15:20:01.638 INFO:teuthology.orchestra.run.smithi061.stderr:/bin/podman: 8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29 2022-03-17T15:20:01.742 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --version 2022-03-17T15:20:02.272 INFO:teuthology.orchestra.run.smithi061.stderr:ceph: ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable) 2022-03-17T15:20:02.598 INFO:teuthology.orchestra.run.smithi061.stderr:Ceph version: ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable) 2022-03-17T15:20:02.599 INFO:teuthology.orchestra.run.smithi061.stderr:Extracting ceph user uid/gid from container image... 2022-03-17T15:20:02.599 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint stat --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 -c %u %g /var/lib/ceph 2022-03-17T15:20:02.923 INFO:teuthology.orchestra.run.smithi061.stderr:stat: 167 167 2022-03-17T15:20:03.250 INFO:teuthology.orchestra.run.smithi061.stderr:Creating initial keys... 2022-03-17T15:20:03.250 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2022-03-17T15:20:03.591 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-authtool: AQCjUTNiJPe7IhAAEmzcg0tDGzQr6yBT1UeHVA== 2022-03-17T15:20:03.895 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2022-03-17T15:20:04.258 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-authtool: AQCkUTNix1PWDhAAswW8/Gbk/nw/VJPpwgIKPw== 2022-03-17T15:20:04.644 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 docker.io/ceph/ceph:v16.2.4 --gen-print-key 2022-03-17T15:20:04.958 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-authtool: AQCkUTNi7MTAOBAAYIo5gY82wx3zeqfXhxSh0g== 2022-03-17T15:20:05.295 INFO:teuthology.orchestra.run.smithi061.stderr:Creating initial monmap... 2022-03-17T15:20:05.295 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/monmaptool --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /tmp/ceph-tmpyu0rslt9:/tmp/monmap:z docker.io/ceph/ceph:v16.2.4 --create --clobber --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c --addv smithi061 [v2:172.21.15.61:3300,v1:172.21.15.61:6789] /tmp/monmap 2022-03-17T15:20:05.625 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2022-03-17T15:20:05.625 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:20:05.625 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2022-03-17T15:20:05.943 INFO:teuthology.orchestra.run.smithi061.stderr:monmaptool for smithi061 [v2:172.21.15.61:3300,v1:172.21.15.61:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2022-03-17T15:20:05.943 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/monmaptool: set fsid to ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:20:05.944 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2022-03-17T15:20:05.944 INFO:teuthology.orchestra.run.smithi061.stderr: 2022-03-17T15:20:05.944 INFO:teuthology.orchestra.run.smithi061.stderr:Creating mon... 2022-03-17T15:20:05.945 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph-mon --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061:/var/lib/ceph/mon/ceph-smithi061:z -v /tmp/ceph-tmpm7ffjwid:/tmp/keyring:z -v /tmp/ceph-tmpyu0rslt9:/tmp/monmap:z docker.io/ceph/ceph:v16.2.4 --mkfs -i smithi061 --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2022-03-17T15:20:06.332 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.298+0000 7fcc1a051700 0 set uid:gid to 167:167 (ceph:ceph) 2022-03-17T15:20:06.332 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.299+0000 7fcc1a051700 1 imported monmap: 2022-03-17T15:20:06.333 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: epoch 0 2022-03-17T15:20:06.333 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: fsid ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:20:06.333 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: last_changed 2022-03-17T15:20:05.621514+0000 2022-03-17T15:20:06.334 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: created 2022-03-17T15:20:05.621514+0000 2022-03-17T15:20:06.334 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2022-03-17T15:20:06.334 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: election_strategy: 1 2022-03-17T15:20:06.334 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] mon.smithi061 2022-03-17T15:20:06.335 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.335 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.299+0000 7fcc1a051700 0 /usr/bin/ceph-mon: set fsid to ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:20:06.335 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.299+0000 7fcc1a051700 4 rocksdb: RocksDB version: 6.8.1 2022-03-17T15:20:06.335 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.336 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-03-17T15:20:06.336 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Compile date May 13 2021 2022-03-17T15:20:06.336 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: DB SUMMARY 2022-03-17T15:20:06.336 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.337 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi061/store.db dir, Total Num: 0, files: 2022-03-17T15:20:06.337 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.337 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi061/store.db: 2022-03-17T15:20:06.338 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.338 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.error_if_exists: 0 2022-03-17T15:20:06.339 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.create_if_missing: 1 2022-03-17T15:20:06.339 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.paranoid_checks: 1 2022-03-17T15:20:06.339 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.env: 0x56386143e1c0 2022-03-17T15:20:06.340 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.fs: Posix File System 2022-03-17T15:20:06.340 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.info_log: 0x56386331eec0 2022-03-17T15:20:06.340 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.max_file_opening_threads: 16 2022-03-17T15:20:06.340 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.statistics: (nil) 2022-03-17T15:20:06.341 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.use_fsync: 0 2022-03-17T15:20:06.341 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.max_log_file_size: 0 2022-03-17T15:20:06.341 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2022-03-17T15:20:06.342 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.log_file_time_to_roll: 0 2022-03-17T15:20:06.342 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.keep_log_file_num: 1000 2022-03-17T15:20:06.342 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.recycle_log_file_num: 0 2022-03-17T15:20:06.342 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.allow_fallocate: 1 2022-03-17T15:20:06.343 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.allow_mmap_reads: 0 2022-03-17T15:20:06.343 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.allow_mmap_writes: 0 2022-03-17T15:20:06.344 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.use_direct_reads: 0 2022-03-17T15:20:06.344 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-03-17T15:20:06.344 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.create_missing_column_families: 0 2022-03-17T15:20:06.344 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.db_log_dir: 2022-03-17T15:20:06.345 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi061/store.db 2022-03-17T15:20:06.345 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.table_cache_numshardbits: 6 2022-03-17T15:20:06.345 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.max_subcompactions: 1 2022-03-17T15:20:06.345 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.max_background_flushes: -1 2022-03-17T15:20:06.346 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.WAL_ttl_seconds: 0 2022-03-17T15:20:06.346 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.WAL_size_limit_MB: 0 2022-03-17T15:20:06.346 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-03-17T15:20:06.346 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2022-03-17T15:20:06.347 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.is_fd_close_on_exec: 1 2022-03-17T15:20:06.347 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.advise_random_on_open: 1 2022-03-17T15:20:06.347 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.db_write_buffer_size: 0 2022-03-17T15:20:06.347 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.write_buffer_manager: 0x563863325530 2022-03-17T15:20:06.348 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2022-03-17T15:20:06.348 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-03-17T15:20:06.348 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2022-03-17T15:20:06.348 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.use_adaptive_mutex: 0 2022-03-17T15:20:06.348 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.rate_limiter: (nil) 2022-03-17T15:20:06.349 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-03-17T15:20:06.349 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.wal_recovery_mode: 2 2022-03-17T15:20:06.349 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.enable_thread_tracking: 0 2022-03-17T15:20:06.349 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.enable_pipelined_write: 0 2022-03-17T15:20:06.349 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.unordered_write: 0 2022-03-17T15:20:06.350 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2022-03-17T15:20:06.350 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-03-17T15:20:06.350 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2022-03-17T15:20:06.350 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2022-03-17T15:20:06.351 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.row_cache: None 2022-03-17T15:20:06.351 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.wal_filter: None 2022-03-17T15:20:06.351 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2022-03-17T15:20:06.351 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.allow_ingest_behind: 0 2022-03-17T15:20:06.352 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.preserve_deletes: 0 2022-03-17T15:20:06.352 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.two_write_queues: 0 2022-03-17T15:20:06.352 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.manual_wal_flush: 0 2022-03-17T15:20:06.352 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.atomic_flush: 0 2022-03-17T15:20:06.352 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-03-17T15:20:06.353 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.persist_stats_to_disk: 0 2022-03-17T15:20:06.353 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.write_dbid_to_manifest: 0 2022-03-17T15:20:06.353 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.log_readahead_size: 0 2022-03-17T15:20:06.353 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2022-03-17T15:20:06.354 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.max_background_jobs: 2 2022-03-17T15:20:06.354 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.max_background_compactions: -1 2022-03-17T15:20:06.354 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2022-03-17T15:20:06.354 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-03-17T15:20:06.355 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.delayed_write_rate : 16777216 2022-03-17T15:20:06.355 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.max_total_wal_size: 0 2022-03-17T15:20:06.355 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-03-17T15:20:06.355 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.stats_dump_period_sec: 600 2022-03-17T15:20:06.356 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.stats_persist_period_sec: 600 2022-03-17T15:20:06.356 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2022-03-17T15:20:06.356 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.max_open_files: -1 2022-03-17T15:20:06.356 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.bytes_per_sync: 0 2022-03-17T15:20:06.357 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.wal_bytes_per_sync: 0 2022-03-17T15:20:06.357 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.strict_bytes_per_sync: 0 2022-03-17T15:20:06.357 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Options.compaction_readahead_size: 0 2022-03-17T15:20:06.357 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Compression algorithms supported: 2022-03-17T15:20:06.357 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2022-03-17T15:20:06.358 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: kZSTD supported: 0 2022-03-17T15:20:06.358 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: kXpressCompression supported: 0 2022-03-17T15:20:06.358 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: kLZ4HCCompression supported: 1 2022-03-17T15:20:06.358 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: kLZ4Compression supported: 1 2022-03-17T15:20:06.359 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: kBZip2Compression supported: 0 2022-03-17T15:20:06.359 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: kZlibCompression supported: 1 2022-03-17T15:20:06.359 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: kSnappyCompression supported: 1 2022-03-17T15:20:06.359 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: Fast CRC32 supported: Supported on x86 2022-03-17T15:20:06.360 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.300+0000 7fcc1a051700 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2022-03-17T15:20:06.360 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.360 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi061/store.db/MANIFEST-000001 2022-03-17T15:20:06.360 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.360 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2022-03-17T15:20:06.361 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.361 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-03-17T15:20:06.361 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.merge_operator: 2022-03-17T15:20:06.361 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compaction_filter: None 2022-03-17T15:20:06.362 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compaction_filter_factory: None 2022-03-17T15:20:06.362 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.memtable_factory: SkipListFactory 2022-03-17T15:20:06.362 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.table_factory: BlockBasedTable 2022-03-17T15:20:06.362 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563863236120) 2022-03-17T15:20:06.363 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2022-03-17T15:20:06.363 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2022-03-17T15:20:06.363 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2022-03-17T15:20:06.363 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2022-03-17T15:20:06.363 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: index_type: 0 2022-03-17T15:20:06.364 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2022-03-17T15:20:06.364 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: index_shortening: 1 2022-03-17T15:20:06.364 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2022-03-17T15:20:06.364 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2022-03-17T15:20:06.365 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: checksum: 1 2022-03-17T15:20:06.365 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2022-03-17T15:20:06.365 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: block_cache: 0x56386326cd10 2022-03-17T15:20:06.365 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2022-03-17T15:20:06.365 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: block_cache_options: 2022-03-17T15:20:06.366 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: capacity : 536870912 2022-03-17T15:20:06.366 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2022-03-17T15:20:06.366 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2022-03-17T15:20:06.367 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2022-03-17T15:20:06.367 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2022-03-17T15:20:06.367 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2022-03-17T15:20:06.367 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: block_size: 4096 2022-03-17T15:20:06.368 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2022-03-17T15:20:06.368 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2022-03-17T15:20:06.368 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2022-03-17T15:20:06.368 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2022-03-17T15:20:06.368 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: partition_filters: 0 2022-03-17T15:20:06.369 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2022-03-17T15:20:06.369 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2022-03-17T15:20:06.369 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2022-03-17T15:20:06.369 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: verify_compression: 0 2022-03-17T15:20:06.369 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2022-03-17T15:20:06.370 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: format_version: 2 2022-03-17T15:20:06.370 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2022-03-17T15:20:06.370 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: block_align: 0 2022-03-17T15:20:06.370 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.371 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.write_buffer_size: 33554432 2022-03-17T15:20:06.371 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.max_write_buffer_number: 2 2022-03-17T15:20:06.371 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compression: NoCompression 2022-03-17T15:20:06.371 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.bottommost_compression: Disabled 2022-03-17T15:20:06.372 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.prefix_extractor: nullptr 2022-03-17T15:20:06.372 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-03-17T15:20:06.372 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.num_levels: 7 2022-03-17T15:20:06.372 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-03-17T15:20:06.373 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-03-17T15:20:06.373 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-03-17T15:20:06.373 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-03-17T15:20:06.373 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2022-03-17T15:20:06.373 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-03-17T15:20:06.374 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-03-17T15:20:06.374 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-03-17T15:20:06.374 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2022-03-17T15:20:06.375 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compression_opts.window_bits: -14 2022-03-17T15:20:06.375 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compression_opts.level: 32767 2022-03-17T15:20:06.375 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compression_opts.strategy: 0 2022-03-17T15:20:06.375 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-03-17T15:20:06.375 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-03-17T15:20:06.376 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compression_opts.enabled: false 2022-03-17T15:20:06.376 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-03-17T15:20:06.376 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-03-17T15:20:06.376 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2022-03-17T15:20:06.377 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.target_file_size_base: 67108864 2022-03-17T15:20:06.377 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.target_file_size_multiplier: 1 2022-03-17T15:20:06.377 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2022-03-17T15:20:06.377 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-03-17T15:20:06.377 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-03-17T15:20:06.378 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-03-17T15:20:06.378 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-03-17T15:20:06.378 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-03-17T15:20:06.378 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-03-17T15:20:06.379 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-03-17T15:20:06.379 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-03-17T15:20:06.379 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-03-17T15:20:06.380 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-03-17T15:20:06.380 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2022-03-17T15:20:06.380 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.arena_block_size: 4194304 2022-03-17T15:20:06.380 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-03-17T15:20:06.381 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-03-17T15:20:06.381 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-03-17T15:20:06.381 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.disable_auto_compactions: 0 2022-03-17T15:20:06.381 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-03-17T15:20:06.382 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-03-17T15:20:06.382 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-03-17T15:20:06.382 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-03-17T15:20:06.382 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-03-17T15:20:06.382 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-03-17T15:20:06.383 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-03-17T15:20:06.383 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-03-17T15:20:06.383 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-03-17T15:20:06.383 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-03-17T15:20:06.384 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.table_properties_collectors: 2022-03-17T15:20:06.384 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.inplace_update_support: 0 2022-03-17T15:20:06.384 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.inplace_update_num_locks: 10000 2022-03-17T15:20:06.384 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-03-17T15:20:06.385 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2022-03-17T15:20:06.385 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.memtable_huge_page_size: 0 2022-03-17T15:20:06.385 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.bloom_locality: 0 2022-03-17T15:20:06.385 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.max_successive_merges: 0 2022-03-17T15:20:06.385 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.optimize_filters_for_hits: 0 2022-03-17T15:20:06.386 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.paranoid_file_checks: 0 2022-03-17T15:20:06.386 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.force_consistency_checks: 0 2022-03-17T15:20:06.386 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.report_bg_io_stats: 0 2022-03-17T15:20:06.386 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.ttl: 2592000 2022-03-17T15:20:06.387 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: Options.periodic_compaction_seconds: 0 2022-03-17T15:20:06.387 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi061/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-03-17T15:20:06.387 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.387 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.301+0000 7fcc1a051700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2022-03-17T15:20:06.388 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.388 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.302+0000 7fcc1a051700 4 rocksdb: DB pointer 0x563863331800 2022-03-17T15:20:06.388 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.302+0000 7fcc02eea700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2022-03-17T15:20:06.388 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.302+0000 7fcc02eea700 4 rocksdb: [db_impl/db_impl.cc:851] 2022-03-17T15:20:06.388 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2022-03-17T15:20:06.389 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2022-03-17T15:20:06.389 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-03-17T15:20:06.389 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-03-17T15:20:06.389 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-03-17T15:20:06.390 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-03-17T15:20:06.390 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-03-17T15:20:06.390 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-03-17T15:20:06.390 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.391 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2022-03-17T15:20:06.391 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:20:06.391 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:20:06.391 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-03-17T15:20:06.392 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-03-17T15:20:06.392 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.392 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2022-03-17T15:20:06.392 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:20:06.393 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:20:06.393 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2022-03-17T15:20:06.393 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2022-03-17T15:20:06.393 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2022-03-17T15:20:06.393 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2022-03-17T15:20:06.394 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2022-03-17T15:20:06.394 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2022-03-17T15:20:06.394 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:20:06.394 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:20:06.395 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-03-17T15:20:06.395 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.395 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2022-03-17T15:20:06.395 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.396 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2022-03-17T15:20:06.396 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:20:06.396 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:20:06.396 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-03-17T15:20:06.397 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-03-17T15:20:06.397 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.397 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2022-03-17T15:20:06.397 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:20:06.397 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:20:06.398 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2022-03-17T15:20:06.398 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2022-03-17T15:20:06.398 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2022-03-17T15:20:06.398 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2022-03-17T15:20:06.399 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2022-03-17T15:20:06.399 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2022-03-17T15:20:06.399 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:20:06.399 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:20:06.399 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-03-17T15:20:06.400 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.400 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2022-03-17T15:20:06.400 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: 2022-03-17T15:20:06.400 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.304+0000 7fcc1a051700 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2022-03-17T15:20:06.401 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.304+0000 7fcc1a051700 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2022-03-17T15:20:06.401 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph-mon: debug 2022-03-17T15:20:06.304+0000 7fcc1a051700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-smithi061 for mon.smithi061 2022-03-17T15:20:06.694 INFO:teuthology.orchestra.run.smithi061.stderr:create mon.smithi061 on 2022-03-17T15:20:06.695 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:20:06.700 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl disable ceph.target 2022-03-17T15:20:06.800 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl enable ceph.target 2022-03-17T15:20:06.807 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2022-03-17T15:20:06.893 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl start ceph.target 2022-03-17T15:20:06.900 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl enable ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c.target 2022-03-17T15:20:06.906 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c.target → /etc/systemd/system/ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c.target. 2022-03-17T15:20:06.906 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c.target → /etc/systemd/system/ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c.target. 2022-03-17T15:20:06.993 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl start ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c.target 2022-03-17T15:20:07.010 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl daemon-reload 2022-03-17T15:20:07.097 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl stop ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mon.smithi061 2022-03-17T15:20:07.123 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl reset-failed ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mon.smithi061 2022-03-17T15:20:07.128 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: Failed to reset failed state of unit ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mon.smithi061.service: Unit ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mon.smithi061.service not loaded. 2022-03-17T15:20:07.128 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl enable ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mon.smithi061 2022-03-17T15:20:07.134 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: Created symlink /etc/systemd/system/ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c.target.wants/ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mon.smithi061.service → /etc/systemd/system/ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@.service. 2022-03-17T15:20:07.220 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl start ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mon.smithi061 2022-03-17T15:20:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:07 smithi061 systemd[1]: Starting Ceph mon.smithi061 for ae1b9b88-a605-11ec-8c35-001a4aab830c... 2022-03-17T15:20:07.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:07 smithi061 podman[30755]: 2022-03-17T15:20:07.652 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl is-enabled firewalld.service 2022-03-17T15:20:07.661 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: disabled 2022-03-17T15:20:07.661 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl is-active firewalld.service 2022-03-17T15:20:07.668 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: inactive 2022-03-17T15:20:07.669 INFO:teuthology.orchestra.run.smithi061.stderr:firewalld.service is not enabled 2022-03-17T15:20:07.669 INFO:teuthology.orchestra.run.smithi061.stderr:Not possible to enable service . firewalld.service is not available 2022-03-17T15:20:07.669 INFO:teuthology.orchestra.run.smithi061.stderr:Not possible to open ports <[]>. firewalld.service is not available 2022-03-17T15:20:07.670 INFO:teuthology.orchestra.run.smithi061.stderr:Waiting for mon to start... 2022-03-17T15:20:07.670 INFO:teuthology.orchestra.run.smithi061.stderr:Waiting for mon... 2022-03-17T15:20:07.671 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061:/var/lib/ceph/mon/ceph-smithi061:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status 2022-03-17T15:20:07.912 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:07 smithi061 bash[30755]: b50b63145512a17d694a665ce8b001a04a6b3bf089e31473cbea442000ece7b4 2022-03-17T15:20:07.912 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:07 smithi061 systemd[1]: Started Ceph mon.smithi061 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:20:07.913 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[30771]: cluster 2022-03-17T15:20:07.690809+0000 mon.smithi061 (mon.0) 0 : [INF] mkfs ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:20:07.913 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[30771]: cluster 2022-03-17T15:20:07.668892+0000 mon.smithi061 (mon.0) 1 : cluster [INF] mon.smithi061 is new leader, mons smithi061 in quorum (ranks 0) 2022-03-17T15:20:08.264 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: cluster: 2022-03-17T15:20:08.265 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: id: ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:20:08.265 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: health: HEALTH_OK 2022-03-17T15:20:08.265 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: 2022-03-17T15:20:08.265 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: services: 2022-03-17T15:20:08.265 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: mon: 1 daemons, quorum smithi061 (age 0.573185s) 2022-03-17T15:20:08.266 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: mgr: no daemons active 2022-03-17T15:20:08.266 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2022-03-17T15:20:08.266 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: 2022-03-17T15:20:08.266 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: data: 2022-03-17T15:20:08.266 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2022-03-17T15:20:08.267 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2022-03-17T15:20:08.267 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2022-03-17T15:20:08.267 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: pgs: 2022-03-17T15:20:08.267 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: 2022-03-17T15:20:08.618 INFO:teuthology.orchestra.run.smithi061.stderr:mon is available 2022-03-17T15:20:08.618 INFO:teuthology.orchestra.run.smithi061.stderr:Assimilating anything we can from ceph.conf... 2022-03-17T15:20:08.618 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z -v /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061:/var/lib/ceph/mon/ceph-smithi061:z docker.io/ceph/ceph:v16.2.4 config assimilate-conf -i /var/lib/ceph/mon/ceph-smithi061/config 2022-03-17T15:20:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[30771]: cluster 2022-03-17T15:20:07.687750+0000 mon.smithi061 (mon.0) 2 : cluster [INF] mon.smithi061 is new leader, mons smithi061 in quorum (ranks 0) 2022-03-17T15:20:09.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[30771]: cluster 2022-03-17T15:20:07.687989+0000 mon.smithi061 (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {smithi061=[v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0]} 2022-03-17T15:20:09.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[30771]: cluster 2022-03-17T15:20:07.694819+0000 mon.smithi061 (mon.0) 4 : cluster [DBG] fsmap 2022-03-17T15:20:09.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[30771]: cluster 2022-03-17T15:20:07.703952+0000 mon.smithi061 (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2022-03-17T15:20:09.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[30771]: cluster 2022-03-17T15:20:07.705402+0000 mon.smithi061 (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2022-03-17T15:20:09.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[30771]: audit 2022-03-17T15:20:08.260900+0000 mon.smithi061 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.61:0/795077357' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2022-03-17T15:20:09.160 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: 2022-03-17T15:20:09.160 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: [global] 2022-03-17T15:20:09.161 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: fsid = ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:20:09.161 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.61:3300,v1:172.21.15.61:6789] 2022-03-17T15:20:09.161 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2022-03-17T15:20:09.161 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2022-03-17T15:20:09.162 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2022-03-17T15:20:09.162 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2022-03-17T15:20:09.162 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: 2022-03-17T15:20:09.162 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: [mgr] 2022-03-17T15:20:09.162 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2022-03-17T15:20:09.163 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: 2022-03-17T15:20:09.163 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: [osd] 2022-03-17T15:20:09.163 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2022-03-17T15:20:09.163 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: osd_memory_target_autotune = true 2022-03-17T15:20:09.164 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2022-03-17T15:20:09.564 INFO:teuthology.orchestra.run.smithi061.stderr:Generating new minimal ceph.conf... 2022-03-17T15:20:09.565 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z -v /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061:/var/lib/ceph/mon/ceph-smithi061:z docker.io/ceph/ceph:v16.2.4 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-smithi061/config 2022-03-17T15:20:09.775 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[30771]: audit 2022-03-17T15:20:09.153492+0000 mon.smithi061 (mon.0) 8 : audit [INF] from='client.? 172.21.15.61:0/1961565217' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2022-03-17T15:20:09.775 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[30771]: audit 2022-03-17T15:20:09.156769+0000 mon.smithi061 (mon.0) 9 : audit [INF] from='client.? 172.21.15.61:0/1961565217' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2022-03-17T15:20:10.503 INFO:teuthology.orchestra.run.smithi061.stderr:Restarting the monitor... 2022-03-17T15:20:10.504 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl restart ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mon.smithi061 2022-03-17T15:20:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:10 smithi061 systemd[1]: Stopping Ceph mon.smithi061 for ae1b9b88-a605-11ec-8c35-001a4aab830c... 2022-03-17T15:20:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[30771]: debug 2022-03-17T15:20:10.585+0000 7f4c56cb8700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.smithi061 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2022-03-17T15:20:10.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[30771]: debug 2022-03-17T15:20:10.585+0000 7f4c56cb8700 -1 mon.smithi061@0(leader) e1 *** Got Signal Terminated *** 2022-03-17T15:20:11.224 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 podman[31102]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061 2022-03-17T15:20:11.225 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mon.smithi061.service: Succeeded. 2022-03-17T15:20:11.225 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 systemd[1]: Stopped Ceph mon.smithi061 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:20:11.225 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 systemd[1]: Starting Ceph mon.smithi061 for ae1b9b88-a605-11ec-8c35-001a4aab830c... 2022-03-17T15:20:11.478 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 podman[31170]: 2022-03-17T15:20:11.478 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 bash[31170]: e511ef46814748da555692e71621eee30d7e95c06290e2c4ba52ae25405e8fd8 2022-03-17T15:20:11.500 INFO:teuthology.orchestra.run.smithi061.stderr:Setting mon public_network to 172.21.0.0/20 2022-03-17T15:20:11.500 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mon public_network 172.21.0.0/20 2022-03-17T15:20:11.731 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.474+0000 7f71c0a47700 0 set uid:gid to 167:167 (ceph:ceph) 2022-03-17T15:20:11.731 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.474+0000 7f71c0a47700 0 ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable), process ceph-mon, pid 7 2022-03-17T15:20:11.731 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.474+0000 7f71c0a47700 0 pidfile_write: ignore empty --pid-file 2022-03-17T15:20:11.731 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 0 load: jerasure load: lrc load: isa 2022-03-17T15:20:11.732 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: RocksDB version: 6.8.1 2022-03-17T15:20:11.732 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.732 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-03-17T15:20:11.732 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Compile date May 13 2021 2022-03-17T15:20:11.732 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: DB SUMMARY 2022-03-17T15:20:11.733 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.733 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: CURRENT file: CURRENT 2022-03-17T15:20:11.733 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.733 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: IDENTITY file: IDENTITY 2022-03-17T15:20:11.734 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.734 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2022-03-17T15:20:11.734 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.734 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi061/store.db dir, Total Num: 1, files: 000004.sst 2022-03-17T15:20:11.734 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.735 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi061/store.db: 000006.log size: 79874 ; 2022-03-17T15:20:11.735 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.735 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.error_if_exists: 0 2022-03-17T15:20:11.735 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.create_if_missing: 0 2022-03-17T15:20:11.735 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.paranoid_checks: 1 2022-03-17T15:20:11.736 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.env: 0x564b9adee1c0 2022-03-17T15:20:11.736 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.fs: Posix File System 2022-03-17T15:20:11.736 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.info_log: 0x564b9c243960 2022-03-17T15:20:11.736 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_file_opening_threads: 16 2022-03-17T15:20:11.737 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.statistics: (nil) 2022-03-17T15:20:11.737 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.use_fsync: 0 2022-03-17T15:20:11.737 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_log_file_size: 0 2022-03-17T15:20:11.737 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2022-03-17T15:20:11.737 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.log_file_time_to_roll: 0 2022-03-17T15:20:11.738 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.keep_log_file_num: 1000 2022-03-17T15:20:11.738 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.recycle_log_file_num: 0 2022-03-17T15:20:11.738 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.allow_fallocate: 1 2022-03-17T15:20:11.738 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.allow_mmap_reads: 0 2022-03-17T15:20:11.738 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.allow_mmap_writes: 0 2022-03-17T15:20:11.739 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.use_direct_reads: 0 2022-03-17T15:20:11.739 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-03-17T15:20:11.739 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.create_missing_column_families: 0 2022-03-17T15:20:11.739 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.db_log_dir: 2022-03-17T15:20:11.740 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi061/store.db 2022-03-17T15:20:11.740 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.table_cache_numshardbits: 6 2022-03-17T15:20:11.740 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_subcompactions: 1 2022-03-17T15:20:11.740 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_background_flushes: -1 2022-03-17T15:20:11.741 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.WAL_ttl_seconds: 0 2022-03-17T15:20:11.741 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.WAL_size_limit_MB: 0 2022-03-17T15:20:11.741 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-03-17T15:20:11.741 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2022-03-17T15:20:11.741 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.is_fd_close_on_exec: 1 2022-03-17T15:20:11.742 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.advise_random_on_open: 1 2022-03-17T15:20:11.742 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.db_write_buffer_size: 0 2022-03-17T15:20:11.742 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.write_buffer_manager: 0x564b9ceb8030 2022-03-17T15:20:11.742 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2022-03-17T15:20:11.743 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-03-17T15:20:11.743 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2022-03-17T15:20:11.743 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.use_adaptive_mutex: 0 2022-03-17T15:20:11.743 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.rate_limiter: (nil) 2022-03-17T15:20:11.743 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-03-17T15:20:11.744 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.wal_recovery_mode: 2 2022-03-17T15:20:11.744 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.enable_thread_tracking: 0 2022-03-17T15:20:11.744 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.enable_pipelined_write: 0 2022-03-17T15:20:11.744 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.unordered_write: 0 2022-03-17T15:20:11.744 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2022-03-17T15:20:11.745 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-03-17T15:20:11.745 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2022-03-17T15:20:11.745 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2022-03-17T15:20:11.745 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.row_cache: None 2022-03-17T15:20:11.745 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.wal_filter: None 2022-03-17T15:20:11.746 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2022-03-17T15:20:11.746 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.allow_ingest_behind: 0 2022-03-17T15:20:11.746 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.preserve_deletes: 0 2022-03-17T15:20:11.746 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.two_write_queues: 0 2022-03-17T15:20:11.747 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.manual_wal_flush: 0 2022-03-17T15:20:11.747 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.atomic_flush: 0 2022-03-17T15:20:11.747 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-03-17T15:20:11.747 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.persist_stats_to_disk: 0 2022-03-17T15:20:11.747 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.write_dbid_to_manifest: 0 2022-03-17T15:20:11.748 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.log_readahead_size: 0 2022-03-17T15:20:11.748 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2022-03-17T15:20:11.748 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_background_jobs: 2 2022-03-17T15:20:11.748 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_background_compactions: -1 2022-03-17T15:20:11.748 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2022-03-17T15:20:11.749 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-03-17T15:20:11.749 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.delayed_write_rate : 16777216 2022-03-17T15:20:11.749 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_total_wal_size: 0 2022-03-17T15:20:11.749 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-03-17T15:20:11.750 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.stats_dump_period_sec: 600 2022-03-17T15:20:11.750 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.stats_persist_period_sec: 600 2022-03-17T15:20:11.750 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2022-03-17T15:20:11.750 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_open_files: -1 2022-03-17T15:20:11.750 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.bytes_per_sync: 0 2022-03-17T15:20:11.751 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.wal_bytes_per_sync: 0 2022-03-17T15:20:11.751 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.strict_bytes_per_sync: 0 2022-03-17T15:20:11.751 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compaction_readahead_size: 0 2022-03-17T15:20:11.751 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Compression algorithms supported: 2022-03-17T15:20:11.752 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2022-03-17T15:20:11.752 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: kZSTD supported: 0 2022-03-17T15:20:11.752 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: kXpressCompression supported: 0 2022-03-17T15:20:11.752 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: kLZ4HCCompression supported: 1 2022-03-17T15:20:11.752 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: kLZ4Compression supported: 1 2022-03-17T15:20:11.753 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: kBZip2Compression supported: 0 2022-03-17T15:20:11.753 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: kZlibCompression supported: 1 2022-03-17T15:20:11.753 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: kSnappyCompression supported: 1 2022-03-17T15:20:11.753 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Fast CRC32 supported: Supported on x86 2022-03-17T15:20:11.753 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi061/store.db/MANIFEST-000005 2022-03-17T15:20:11.754 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.754 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2022-03-17T15:20:11.754 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.754 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-03-17T15:20:11.754 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.merge_operator: 2022-03-17T15:20:11.755 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compaction_filter: None 2022-03-17T15:20:11.755 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compaction_filter_factory: None 2022-03-17T15:20:11.755 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.memtable_factory: SkipListFactory 2022-03-17T15:20:11.755 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.table_factory: BlockBasedTable 2022-03-17T15:20:11.755 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564b9c15a128) 2022-03-17T15:20:11.756 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cache_index_and_filter_blocks: 1 2022-03-17T15:20:11.756 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cache_index_and_filter_blocks_with_high_priority: 0 2022-03-17T15:20:11.756 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: pin_l0_filter_and_index_blocks_in_cache: 0 2022-03-17T15:20:11.756 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: pin_top_level_index_and_filter: 1 2022-03-17T15:20:11.756 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: index_type: 0 2022-03-17T15:20:11.757 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: data_block_index_type: 0 2022-03-17T15:20:11.757 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: index_shortening: 1 2022-03-17T15:20:11.757 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: data_block_hash_table_util_ratio: 0.750000 2022-03-17T15:20:11.757 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: hash_index_allow_collision: 1 2022-03-17T15:20:11.757 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: checksum: 1 2022-03-17T15:20:11.758 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: no_block_cache: 0 2022-03-17T15:20:11.758 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: block_cache: 0x564b9c190f10 2022-03-17T15:20:11.758 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: block_cache_name: BinnedLRUCache 2022-03-17T15:20:11.758 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: block_cache_options: 2022-03-17T15:20:11.758 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: capacity : 536870912 2022-03-17T15:20:11.759 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: num_shard_bits : 4 2022-03-17T15:20:11.759 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: strict_capacity_limit : 0 2022-03-17T15:20:11.759 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: high_pri_pool_ratio: 0.000 2022-03-17T15:20:11.759 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: block_cache_compressed: (nil) 2022-03-17T15:20:11.760 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: persistent_cache: (nil) 2022-03-17T15:20:11.760 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: block_size: 4096 2022-03-17T15:20:11.760 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: block_size_deviation: 10 2022-03-17T15:20:11.760 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: block_restart_interval: 16 2022-03-17T15:20:11.760 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: index_block_restart_interval: 1 2022-03-17T15:20:11.761 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: metadata_block_size: 4096 2022-03-17T15:20:11.761 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: partition_filters: 0 2022-03-17T15:20:11.761 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: use_delta_encoding: 1 2022-03-17T15:20:11.761 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: filter_policy: rocksdb.BuiltinBloomFilter 2022-03-17T15:20:11.761 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: whole_key_filtering: 1 2022-03-17T15:20:11.762 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: verify_compression: 0 2022-03-17T15:20:11.762 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: read_amp_bytes_per_bit: 0 2022-03-17T15:20:11.762 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: format_version: 2 2022-03-17T15:20:11.762 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: enable_index_compression: 1 2022-03-17T15:20:11.762 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: block_align: 0 2022-03-17T15:20:11.763 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.763 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.write_buffer_size: 33554432 2022-03-17T15:20:11.763 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_write_buffer_number: 2 2022-03-17T15:20:11.763 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compression: NoCompression 2022-03-17T15:20:11.763 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.bottommost_compression: Disabled 2022-03-17T15:20:11.764 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.prefix_extractor: nullptr 2022-03-17T15:20:11.764 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-03-17T15:20:11.764 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.num_levels: 7 2022-03-17T15:20:11.764 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-03-17T15:20:11.764 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-03-17T15:20:11.765 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-03-17T15:20:11.765 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-03-17T15:20:11.765 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2022-03-17T15:20:11.765 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-03-17T15:20:11.765 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-03-17T15:20:11.766 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-03-17T15:20:11.766 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2022-03-17T15:20:11.766 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compression_opts.window_bits: -14 2022-03-17T15:20:11.766 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compression_opts.level: 32767 2022-03-17T15:20:11.766 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compression_opts.strategy: 0 2022-03-17T15:20:11.767 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-03-17T15:20:11.767 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-03-17T15:20:11.767 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compression_opts.enabled: false 2022-03-17T15:20:11.767 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-03-17T15:20:11.767 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-03-17T15:20:11.768 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2022-03-17T15:20:11.768 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.target_file_size_base: 67108864 2022-03-17T15:20:11.768 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.target_file_size_multiplier: 1 2022-03-17T15:20:11.768 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2022-03-17T15:20:11.768 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-03-17T15:20:11.769 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-03-17T15:20:11.769 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-03-17T15:20:11.769 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-03-17T15:20:11.769 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-03-17T15:20:11.769 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-03-17T15:20:11.770 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-03-17T15:20:11.770 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-03-17T15:20:11.770 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-03-17T15:20:11.770 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-03-17T15:20:11.770 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2022-03-17T15:20:11.771 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.arena_block_size: 4194304 2022-03-17T15:20:11.771 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-03-17T15:20:11.771 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-03-17T15:20:11.771 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-03-17T15:20:11.771 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.disable_auto_compactions: 0 2022-03-17T15:20:11.772 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-03-17T15:20:11.772 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-03-17T15:20:11.772 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-03-17T15:20:11.772 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-03-17T15:20:11.772 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-03-17T15:20:11.773 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-03-17T15:20:11.773 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-03-17T15:20:11.773 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-03-17T15:20:11.773 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-03-17T15:20:11.773 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-03-17T15:20:11.774 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.table_properties_collectors: 2022-03-17T15:20:11.774 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.inplace_update_support: 0 2022-03-17T15:20:11.774 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.479+0000 7f71c0a47700 4 rocksdb: Options.inplace_update_num_locks: 10000 2022-03-17T15:20:11.774 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.480+0000 7f71c0a47700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-03-17T15:20:11.774 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.480+0000 7f71c0a47700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2022-03-17T15:20:11.775 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.480+0000 7f71c0a47700 4 rocksdb: Options.memtable_huge_page_size: 0 2022-03-17T15:20:11.775 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.480+0000 7f71c0a47700 4 rocksdb: Options.bloom_locality: 0 2022-03-17T15:20:11.775 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.480+0000 7f71c0a47700 4 rocksdb: Options.max_successive_merges: 0 2022-03-17T15:20:11.775 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.480+0000 7f71c0a47700 4 rocksdb: Options.optimize_filters_for_hits: 0 2022-03-17T15:20:11.775 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.480+0000 7f71c0a47700 4 rocksdb: Options.paranoid_file_checks: 0 2022-03-17T15:20:11.776 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.480+0000 7f71c0a47700 4 rocksdb: Options.force_consistency_checks: 0 2022-03-17T15:20:11.776 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.480+0000 7f71c0a47700 4 rocksdb: Options.report_bg_io_stats: 0 2022-03-17T15:20:11.776 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.480+0000 7f71c0a47700 4 rocksdb: Options.ttl: 2592000 2022-03-17T15:20:11.776 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.480+0000 7f71c0a47700 4 rocksdb: Options.periodic_compaction_seconds: 0 2022-03-17T15:20:11.776 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.480+0000 7f71c0a47700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi061/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-03-17T15:20:11.777 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.777 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.480+0000 7f71c0a47700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2022-03-17T15:20:11.777 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.777 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.480+0000 7f71c0a47700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1647530411481993, "job": 1, "event": "recovery_started", "log_files": [6]} 2022-03-17T15:20:11.777 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.480+0000 7f71c0a47700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2022-03-17T15:20:11.778 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.481+0000 7f71c0a47700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2022-03-17T15:20:11.778 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.481+0000 7f71c0a47700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1647530411482850, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 76862, "table_properties": {"data_size": 75159, "index_size": 308, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 581, "raw_key_size": 9152, "raw_average_key_size": 47, "raw_value_size": 69862, "raw_average_value_size": 361, "num_data_blocks": 10, "num_entries": 193, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1647530411, "oldest_key_time": 3, "file_creation_time": 0}} 2022-03-17T15:20:11.778 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.481+0000 7f71c0a47700 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2022-03-17T15:20:11.778 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.779 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.481+0000 7f71c0a47700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1647530411483226, "job": 1, "event": "recovery_finished"} 2022-03-17T15:20:11.779 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.482+0000 7f71c0a47700 4 rocksdb: DB pointer 0x564b9c255800 2022-03-17T15:20:11.779 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.482+0000 7f71a785f700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2022-03-17T15:20:11.779 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.482+0000 7f71a785f700 4 rocksdb: [db_impl/db_impl.cc:851] 2022-03-17T15:20:11.779 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: ** DB Stats ** 2022-03-17T15:20:11.780 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Uptime(secs): 0.0 total, 0.0 interval 2022-03-17T15:20:11.780 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-03-17T15:20:11.780 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-03-17T15:20:11.780 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-03-17T15:20:11.780 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-03-17T15:20:11.781 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-03-17T15:20:11.781 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-03-17T15:20:11.781 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.781 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: ** Compaction Stats [default] ** 2022-03-17T15:20:11.781 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:20:11.782 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:20:11.782 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: L0 2/0 76.75 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.3 0.00 0.00 1 0.001 0 0 2022-03-17T15:20:11.782 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Sum 2/0 76.75 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.3 0.00 0.00 1 0.001 0 0 2022-03-17T15:20:11.782 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.3 0.00 0.00 1 0.001 0 0 2022-03-17T15:20:11.782 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.783 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: ** Compaction Stats [default] ** 2022-03-17T15:20:11.783 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:20:11.783 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:20:11.783 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 133.3 0.00 0.00 1 0.001 0 0 2022-03-17T15:20:11.783 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Uptime(secs): 0.0 total, 0.0 interval 2022-03-17T15:20:11.784 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Flush(GB): cumulative 0.000, interval 0.000 2022-03-17T15:20:11.784 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: AddFile(GB): cumulative 0.000, interval 0.000 2022-03-17T15:20:11.784 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: AddFile(Total Files): cumulative 0, interval 0 2022-03-17T15:20:11.784 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: AddFile(L0 Files): cumulative 0, interval 0 2022-03-17T15:20:11.784 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: AddFile(Keys): cumulative 0, interval 0 2022-03-17T15:20:11.785 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Cumulative compaction: 0.00 GB write, 25.97 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:20:11.785 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Interval compaction: 0.00 GB write, 25.97 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:20:11.785 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-03-17T15:20:11.785 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.786 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: ** File Read Latency Histogram By Level [default] ** 2022-03-17T15:20:11.786 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.786 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: ** Compaction Stats [default] ** 2022-03-17T15:20:11.786 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:20:11.786 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:20:11.787 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: L0 2/0 76.75 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.3 0.00 0.00 1 0.001 0 0 2022-03-17T15:20:11.787 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Sum 2/0 76.75 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 133.3 0.00 0.00 1 0.001 0 0 2022-03-17T15:20:11.787 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-03-17T15:20:11.787 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.787 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: ** Compaction Stats [default] ** 2022-03-17T15:20:11.788 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:20:11.788 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:20:11.788 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 133.3 0.00 0.00 1 0.001 0 0 2022-03-17T15:20:11.788 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Uptime(secs): 0.0 total, 0.0 interval 2022-03-17T15:20:11.789 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Flush(GB): cumulative 0.000, interval 0.000 2022-03-17T15:20:11.789 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: AddFile(GB): cumulative 0.000, interval 0.000 2022-03-17T15:20:11.789 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: AddFile(Total Files): cumulative 0, interval 0 2022-03-17T15:20:11.789 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: AddFile(L0 Files): cumulative 0, interval 0 2022-03-17T15:20:11.789 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: AddFile(Keys): cumulative 0, interval 0 2022-03-17T15:20:11.790 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Cumulative compaction: 0.00 GB write, 25.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:20:11.790 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:20:11.790 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-03-17T15:20:11.790 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.790 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: ** File Read Latency Histogram By Level [default] ** 2022-03-17T15:20:11.791 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.791 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.483+0000 7f71c0a47700 0 starting mon.smithi061 rank 0 at public addrs [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] at bind addrs [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi061 fsid ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:20:11.791 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.484+0000 7f71c0a47700 1 mon.smithi061@-1(???) e1 preinit fsid ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:20:11.791 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.484+0000 7f71c0a47700 0 mon.smithi061@-1(???).mds e1 new map 2022-03-17T15:20:11.791 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.484+0000 7f71c0a47700 0 mon.smithi061@-1(???).mds e1 print_map 2022-03-17T15:20:11.792 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: e1 2022-03-17T15:20:11.792 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: enable_multiple, ever_enabled_multiple: 1,1 2022-03-17T15:20:11.792 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-03-17T15:20:11.792 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: legacy client fscid: -1 2022-03-17T15:20:11.792 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.793 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: No filesystems configured 2022-03-17T15:20:11.793 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: 2022-03-17T15:20:11.793 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.484+0000 7f71c0a47700 0 mon.smithi061@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2022-03-17T15:20:11.793 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.484+0000 7f71c0a47700 0 mon.smithi061@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2022-03-17T15:20:11.793 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.484+0000 7f71c0a47700 0 mon.smithi061@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2022-03-17T15:20:11.794 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.484+0000 7f71c0a47700 0 mon.smithi061@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2022-03-17T15:20:11.794 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:09.153492+0000 mon.smithi061 (mon.0) 8 : audit [INF] from='client.? 172.21.15.61:0/1961565217' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2022-03-17T15:20:11.794 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:09.156769+0000 mon.smithi061 (mon.0) 9 : audit [INF] from='client.? 172.21.15.61:0/1961565217' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2022-03-17T15:20:11.794 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.484+0000 7f71c0a47700 1 mon.smithi061@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2022-03-17T15:20:11.795 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.485+0000 7f71c0a47700 20 expand_channel_meta expand map: {default=false} 2022-03-17T15:20:11.795 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.485+0000 7f71c0a47700 20 expand_channel_meta from 'false' to 'false' 2022-03-17T15:20:11.795 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.485+0000 7f71c0a47700 20 expand_channel_meta expanded map: {default=false} 2022-03-17T15:20:11.795 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.485+0000 7f71c0a47700 20 expand_channel_meta expand map: {default=info} 2022-03-17T15:20:11.795 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.485+0000 7f71c0a47700 20 expand_channel_meta from 'info' to 'info' 2022-03-17T15:20:11.796 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.485+0000 7f71c0a47700 20 expand_channel_meta expanded map: {default=info} 2022-03-17T15:20:11.796 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.485+0000 7f71c0a47700 20 expand_channel_meta expand map: {default=daemon} 2022-03-17T15:20:11.796 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.485+0000 7f71c0a47700 20 expand_channel_meta from 'daemon' to 'daemon' 2022-03-17T15:20:11.796 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.485+0000 7f71c0a47700 20 expand_channel_meta expanded map: {default=daemon} 2022-03-17T15:20:11.796 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.485+0000 7f71c0a47700 20 expand_channel_meta expand map: {default=debug} 2022-03-17T15:20:11.797 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.485+0000 7f71c0a47700 20 expand_channel_meta from 'debug' to 'debug' 2022-03-17T15:20:11.797 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:20:11.485+0000 7f71c0a47700 20 expand_channel_meta expanded map: {default=debug} 2022-03-17T15:20:11.797 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 systemd[1]: Started Ceph mon.smithi061 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:20:11.797 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:11.501017+0000 mon.smithi061 (mon.0) 1 : cluster [INF] mon.smithi061 is new leader, mons smithi061 in quorum (ranks 0) 2022-03-17T15:20:11.797 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:11.501107+0000 mon.smithi061 (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {smithi061=[v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0]} 2022-03-17T15:20:11.798 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:11.501158+0000 mon.smithi061 (mon.0) 3 : cluster [DBG] fsmap 2022-03-17T15:20:11.798 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:11.501201+0000 mon.smithi061 (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2022-03-17T15:20:11.798 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:11.501817+0000 mon.smithi061 (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2022-03-17T15:20:12.448 INFO:teuthology.orchestra.run.smithi061.stderr:Wrote config to /etc/ceph/ceph.conf 2022-03-17T15:20:12.448 INFO:teuthology.orchestra.run.smithi061.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2022-03-17T15:20:12.448 INFO:teuthology.orchestra.run.smithi061.stderr:Creating mgr... 2022-03-17T15:20:12.449 INFO:teuthology.orchestra.run.smithi061.stderr:Verifying port 9283 ... 2022-03-17T15:20:12.450 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl daemon-reload 2022-03-17T15:20:12.544 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl stop ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mgr.smithi061.kxplwz 2022-03-17T15:20:12.568 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl reset-failed ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mgr.smithi061.kxplwz 2022-03-17T15:20:12.574 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: Failed to reset failed state of unit ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mgr.smithi061.kxplwz.service: Unit ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mgr.smithi061.kxplwz.service not loaded. 2022-03-17T15:20:12.574 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl enable ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mgr.smithi061.kxplwz 2022-03-17T15:20:12.580 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: Created symlink /etc/systemd/system/ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c.target.wants/ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mgr.smithi061.kxplwz.service → /etc/systemd/system/ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@.service. 2022-03-17T15:20:12.665 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl start ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mgr.smithi061.kxplwz 2022-03-17T15:20:13.195 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:12.090489+0000 mon.smithi061 (mon.0) 6 : audit [INF] from='client.? 172.21.15.61:0/3781259842' entity='client.admin' 2022-03-17T15:20:13.198 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl is-enabled firewalld.service 2022-03-17T15:20:13.206 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: disabled 2022-03-17T15:20:13.207 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl is-active firewalld.service 2022-03-17T15:20:13.214 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: inactive 2022-03-17T15:20:13.215 INFO:teuthology.orchestra.run.smithi061.stderr:firewalld.service is not enabled 2022-03-17T15:20:13.216 INFO:teuthology.orchestra.run.smithi061.stderr:Not possible to enable service . firewalld.service is not available 2022-03-17T15:20:13.216 INFO:teuthology.orchestra.run.smithi061.stderr:Not possible to open ports <[]>. firewalld.service is not available 2022-03-17T15:20:13.216 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl is-enabled firewalld.service 2022-03-17T15:20:13.223 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: disabled 2022-03-17T15:20:13.223 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl is-active firewalld.service 2022-03-17T15:20:13.230 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: inactive 2022-03-17T15:20:13.231 INFO:teuthology.orchestra.run.smithi061.stderr:firewalld.service is not enabled 2022-03-17T15:20:13.231 INFO:teuthology.orchestra.run.smithi061.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2022-03-17T15:20:13.231 INFO:teuthology.orchestra.run.smithi061.stderr:Waiting for mgr to start... 2022-03-17T15:20:13.232 INFO:teuthology.orchestra.run.smithi061.stderr:Waiting for mgr... 2022-03-17T15:20:13.232 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2022-03-17T15:20:13.873 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: 2022-03-17T15:20:13.873 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: { 2022-03-17T15:20:13.873 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "fsid": "ae1b9b88-a605-11ec-8c35-001a4aab830c", 2022-03-17T15:20:13.874 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "health": { 2022-03-17T15:20:13.874 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2022-03-17T15:20:13.874 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "checks": {}, 2022-03-17T15:20:13.874 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "mutes": [] 2022-03-17T15:20:13.874 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:13.875 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "election_epoch": 5, 2022-03-17T15:20:13.875 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "quorum": [ 2022-03-17T15:20:13.875 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: 0 2022-03-17T15:20:13.876 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: ], 2022-03-17T15:20:13.876 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "quorum_names": [ 2022-03-17T15:20:13.876 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "smithi061" 2022-03-17T15:20:13.876 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: ], 2022-03-17T15:20:13.877 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "quorum_age": 2, 2022-03-17T15:20:13.877 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "monmap": { 2022-03-17T15:20:13.877 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 1, 2022-03-17T15:20:13.877 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2022-03-17T15:20:13.877 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_mons": 1 2022-03-17T15:20:13.878 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:13.878 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "osdmap": { 2022-03-17T15:20:13.878 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 1, 2022-03-17T15:20:13.878 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_osds": 0, 2022-03-17T15:20:13.878 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_up_osds": 0, 2022-03-17T15:20:13.879 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "osd_up_since": 0, 2022-03-17T15:20:13.879 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_in_osds": 0, 2022-03-17T15:20:13.879 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "osd_in_since": 0, 2022-03-17T15:20:13.879 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2022-03-17T15:20:13.880 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:13.880 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "pgmap": { 2022-03-17T15:20:13.880 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "pgs_by_state": [], 2022-03-17T15:20:13.880 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_pgs": 0, 2022-03-17T15:20:13.880 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_pools": 0, 2022-03-17T15:20:13.881 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_objects": 0, 2022-03-17T15:20:13.881 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "data_bytes": 0, 2022-03-17T15:20:13.881 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "bytes_used": 0, 2022-03-17T15:20:13.881 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "bytes_avail": 0, 2022-03-17T15:20:13.881 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "bytes_total": 0 2022-03-17T15:20:13.882 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:13.882 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "fsmap": { 2022-03-17T15:20:13.882 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 1, 2022-03-17T15:20:13.882 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "by_rank": [], 2022-03-17T15:20:13.883 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "up:standby": 0 2022-03-17T15:20:13.883 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:13.883 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "mgrmap": { 2022-03-17T15:20:13.883 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "available": false, 2022-03-17T15:20:13.884 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_standbys": 0, 2022-03-17T15:20:13.884 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "modules": [ 2022-03-17T15:20:13.884 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "iostat", 2022-03-17T15:20:13.884 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "restful" 2022-03-17T15:20:13.884 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: ], 2022-03-17T15:20:13.885 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "services": {} 2022-03-17T15:20:13.885 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:13.885 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "servicemap": { 2022-03-17T15:20:13.885 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 1, 2022-03-17T15:20:13.886 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "modified": "2022-03-17T15:20:07.691290+0000", 2022-03-17T15:20:13.886 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "services": {} 2022-03-17T15:20:13.886 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:13.886 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "progress_events": {} 2022-03-17T15:20:13.886 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: } 2022-03-17T15:20:14.178 INFO:teuthology.orchestra.run.smithi061.stderr:mgr not available, waiting (1/15)... 2022-03-17T15:20:14.212 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:13.863189+0000 mon.smithi061 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.61:0/1217743815' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-03-17T15:20:16.180 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2022-03-17T15:20:16.775 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: 2022-03-17T15:20:16.775 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: { 2022-03-17T15:20:16.775 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "fsid": "ae1b9b88-a605-11ec-8c35-001a4aab830c", 2022-03-17T15:20:16.776 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "health": { 2022-03-17T15:20:16.776 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2022-03-17T15:20:16.776 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "checks": {}, 2022-03-17T15:20:16.776 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "mutes": [] 2022-03-17T15:20:16.776 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:16.777 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "election_epoch": 5, 2022-03-17T15:20:16.777 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "quorum": [ 2022-03-17T15:20:16.777 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: 0 2022-03-17T15:20:16.777 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: ], 2022-03-17T15:20:16.778 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "quorum_names": [ 2022-03-17T15:20:16.778 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "smithi061" 2022-03-17T15:20:16.778 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: ], 2022-03-17T15:20:16.778 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "quorum_age": 5, 2022-03-17T15:20:16.779 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "monmap": { 2022-03-17T15:20:16.779 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 1, 2022-03-17T15:20:16.779 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2022-03-17T15:20:16.779 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_mons": 1 2022-03-17T15:20:16.779 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:16.780 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "osdmap": { 2022-03-17T15:20:16.780 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 1, 2022-03-17T15:20:16.780 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_osds": 0, 2022-03-17T15:20:16.780 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_up_osds": 0, 2022-03-17T15:20:16.781 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "osd_up_since": 0, 2022-03-17T15:20:16.781 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_in_osds": 0, 2022-03-17T15:20:16.781 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "osd_in_since": 0, 2022-03-17T15:20:16.781 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2022-03-17T15:20:16.782 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:16.782 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "pgmap": { 2022-03-17T15:20:16.782 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "pgs_by_state": [], 2022-03-17T15:20:16.782 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_pgs": 0, 2022-03-17T15:20:16.782 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_pools": 0, 2022-03-17T15:20:16.783 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_objects": 0, 2022-03-17T15:20:16.783 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "data_bytes": 0, 2022-03-17T15:20:16.783 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "bytes_used": 0, 2022-03-17T15:20:16.783 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "bytes_avail": 0, 2022-03-17T15:20:16.783 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "bytes_total": 0 2022-03-17T15:20:16.784 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:16.784 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "fsmap": { 2022-03-17T15:20:16.784 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 1, 2022-03-17T15:20:16.784 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "by_rank": [], 2022-03-17T15:20:16.785 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "up:standby": 0 2022-03-17T15:20:16.785 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:16.785 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "mgrmap": { 2022-03-17T15:20:16.785 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "available": false, 2022-03-17T15:20:16.785 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_standbys": 0, 2022-03-17T15:20:16.786 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "modules": [ 2022-03-17T15:20:16.786 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "iostat", 2022-03-17T15:20:16.786 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "restful" 2022-03-17T15:20:16.786 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: ], 2022-03-17T15:20:16.787 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "services": {} 2022-03-17T15:20:16.787 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:16.787 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "servicemap": { 2022-03-17T15:20:16.787 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 1, 2022-03-17T15:20:16.787 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "modified": "2022-03-17T15:20:07.691290+0000", 2022-03-17T15:20:16.788 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "services": {} 2022-03-17T15:20:16.788 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:16.788 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "progress_events": {} 2022-03-17T15:20:16.788 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: } 2022-03-17T15:20:17.124 INFO:teuthology.orchestra.run.smithi061.stderr:mgr not available, waiting (2/15)... 2022-03-17T15:20:17.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:16.766527+0000 mon.smithi061 (mon.0) 8 : audit [DBG] from='client.? 172.21.15.61:0/3347990958' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-03-17T15:20:19.126 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2022-03-17T15:20:19.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:19.143250+0000 mon.smithi061 (mon.0) 9 : cluster [INF] Activating manager daemon smithi061.kxplwz 2022-03-17T15:20:19.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:19.145902+0000 mon.smithi061 (mon.0) 10 : cluster [DBG] mgrmap e2: smithi061.kxplwz(active, starting, since 0.00282307s) 2022-03-17T15:20:19.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:19.147376+0000 mon.smithi061 (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.61:0/2814232387' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-03-17T15:20:19.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:19.147614+0000 mon.smithi061 (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.61:0/2814232387' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-03-17T15:20:19.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:19.147829+0000 mon.smithi061 (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.61:0/2814232387' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-03-17T15:20:19.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:19.148036+0000 mon.smithi061 (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.61:0/2814232387' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi061"}]: dispatch 2022-03-17T15:20:19.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:19.148442+0000 mon.smithi061 (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.61:0/2814232387' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr metadata", "who": "smithi061.kxplwz", "id": "smithi061.kxplwz"}]: dispatch 2022-03-17T15:20:19.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:19.161939+0000 mon.smithi061 (mon.0) 16 : cluster [INF] Manager daemon smithi061.kxplwz is now available 2022-03-17T15:20:19.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:19.173926+0000 mon.smithi061 (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.61:0/2814232387' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:19.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:19.177684+0000 mon.smithi061 (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.61:0/2814232387' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:20:19.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:19.178911+0000 mon.smithi061 (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.61:0/2814232387' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:20:19.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:19.186400+0000 mon.smithi061 (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.61:0/2814232387' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:19.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:19.191484+0000 mon.smithi061 (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.61:0/2814232387' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:19.708 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: 2022-03-17T15:20:19.709 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: { 2022-03-17T15:20:19.709 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "fsid": "ae1b9b88-a605-11ec-8c35-001a4aab830c", 2022-03-17T15:20:19.709 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "health": { 2022-03-17T15:20:19.709 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2022-03-17T15:20:19.710 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "checks": {}, 2022-03-17T15:20:19.710 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "mutes": [] 2022-03-17T15:20:19.710 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:19.711 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "election_epoch": 5, 2022-03-17T15:20:19.711 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "quorum": [ 2022-03-17T15:20:19.711 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: 0 2022-03-17T15:20:19.711 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: ], 2022-03-17T15:20:19.711 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "quorum_names": [ 2022-03-17T15:20:19.712 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "smithi061" 2022-03-17T15:20:19.712 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: ], 2022-03-17T15:20:19.712 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "quorum_age": 8, 2022-03-17T15:20:19.712 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "monmap": { 2022-03-17T15:20:19.713 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 1, 2022-03-17T15:20:19.713 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2022-03-17T15:20:19.713 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_mons": 1 2022-03-17T15:20:19.713 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:19.713 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "osdmap": { 2022-03-17T15:20:19.714 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 1, 2022-03-17T15:20:19.714 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_osds": 0, 2022-03-17T15:20:19.714 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_up_osds": 0, 2022-03-17T15:20:19.715 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "osd_up_since": 0, 2022-03-17T15:20:19.715 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_in_osds": 0, 2022-03-17T15:20:19.715 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "osd_in_since": 0, 2022-03-17T15:20:19.715 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2022-03-17T15:20:19.716 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:19.716 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "pgmap": { 2022-03-17T15:20:19.716 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "pgs_by_state": [], 2022-03-17T15:20:19.717 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_pgs": 0, 2022-03-17T15:20:19.717 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_pools": 0, 2022-03-17T15:20:19.717 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_objects": 0, 2022-03-17T15:20:19.717 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "data_bytes": 0, 2022-03-17T15:20:19.718 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "bytes_used": 0, 2022-03-17T15:20:19.718 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "bytes_avail": 0, 2022-03-17T15:20:19.718 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "bytes_total": 0 2022-03-17T15:20:19.719 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:19.719 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "fsmap": { 2022-03-17T15:20:19.719 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 1, 2022-03-17T15:20:19.719 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "by_rank": [], 2022-03-17T15:20:19.720 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "up:standby": 0 2022-03-17T15:20:19.720 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:19.720 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "mgrmap": { 2022-03-17T15:20:19.720 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "available": false, 2022-03-17T15:20:19.721 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_standbys": 0, 2022-03-17T15:20:19.721 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "modules": [ 2022-03-17T15:20:19.721 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "iostat", 2022-03-17T15:20:19.721 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "restful" 2022-03-17T15:20:19.722 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: ], 2022-03-17T15:20:19.722 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "services": {} 2022-03-17T15:20:19.722 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:19.722 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "servicemap": { 2022-03-17T15:20:19.723 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 1, 2022-03-17T15:20:19.723 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "modified": "2022-03-17T15:20:07.691290+0000", 2022-03-17T15:20:19.723 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "services": {} 2022-03-17T15:20:19.723 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:19.724 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "progress_events": {} 2022-03-17T15:20:19.724 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: } 2022-03-17T15:20:20.170 INFO:teuthology.orchestra.run.smithi061.stderr:mgr not available, waiting (3/15)... 2022-03-17T15:20:20.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:19.699350+0000 mon.smithi061 (mon.0) 22 : audit [DBG] from='client.? 172.21.15.61:0/3369421392' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-03-17T15:20:20.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:20.148423+0000 mon.smithi061 (mon.0) 23 : cluster [DBG] mgrmap e3: smithi061.kxplwz(active, since 1.00535s) 2022-03-17T15:20:22.172 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 status -f json-pretty 2022-03-17T15:20:22.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:21.204296+0000 mon.smithi061 (mon.0) 24 : cluster [DBG] mgrmap e4: smithi061.kxplwz(active, since 2s) 2022-03-17T15:20:23.039 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: 2022-03-17T15:20:23.039 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: { 2022-03-17T15:20:23.040 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "fsid": "ae1b9b88-a605-11ec-8c35-001a4aab830c", 2022-03-17T15:20:23.040 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "health": { 2022-03-17T15:20:23.040 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2022-03-17T15:20:23.040 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "checks": {}, 2022-03-17T15:20:23.040 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "mutes": [] 2022-03-17T15:20:23.041 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:23.041 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "election_epoch": 5, 2022-03-17T15:20:23.041 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "quorum": [ 2022-03-17T15:20:23.041 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: 0 2022-03-17T15:20:23.042 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: ], 2022-03-17T15:20:23.042 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "quorum_names": [ 2022-03-17T15:20:23.044 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "smithi061" 2022-03-17T15:20:23.044 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: ], 2022-03-17T15:20:23.044 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "quorum_age": 11, 2022-03-17T15:20:23.044 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "monmap": { 2022-03-17T15:20:23.045 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 1, 2022-03-17T15:20:23.045 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2022-03-17T15:20:23.045 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_mons": 1 2022-03-17T15:20:23.045 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:23.045 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "osdmap": { 2022-03-17T15:20:23.046 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 1, 2022-03-17T15:20:23.046 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_osds": 0, 2022-03-17T15:20:23.046 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_up_osds": 0, 2022-03-17T15:20:23.046 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "osd_up_since": 0, 2022-03-17T15:20:23.050 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_in_osds": 0, 2022-03-17T15:20:23.051 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "osd_in_since": 0, 2022-03-17T15:20:23.051 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2022-03-17T15:20:23.051 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:23.051 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "pgmap": { 2022-03-17T15:20:23.051 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "pgs_by_state": [], 2022-03-17T15:20:23.052 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_pgs": 0, 2022-03-17T15:20:23.052 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_pools": 0, 2022-03-17T15:20:23.052 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_objects": 0, 2022-03-17T15:20:23.052 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "data_bytes": 0, 2022-03-17T15:20:23.053 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "bytes_used": 0, 2022-03-17T15:20:23.053 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "bytes_avail": 0, 2022-03-17T15:20:23.053 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "bytes_total": 0 2022-03-17T15:20:23.053 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:23.053 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "fsmap": { 2022-03-17T15:20:23.054 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 1, 2022-03-17T15:20:23.054 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "by_rank": [], 2022-03-17T15:20:23.054 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "up:standby": 0 2022-03-17T15:20:23.054 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:23.055 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "mgrmap": { 2022-03-17T15:20:23.055 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "available": true, 2022-03-17T15:20:23.055 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_standbys": 0, 2022-03-17T15:20:23.055 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "modules": [ 2022-03-17T15:20:23.055 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "iostat", 2022-03-17T15:20:23.056 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "restful" 2022-03-17T15:20:23.056 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: ], 2022-03-17T15:20:23.056 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "services": {} 2022-03-17T15:20:23.056 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:23.057 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "servicemap": { 2022-03-17T15:20:23.057 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 1, 2022-03-17T15:20:23.057 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "modified": "2022-03-17T15:20:07.691290+0000", 2022-03-17T15:20:23.057 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "services": {} 2022-03-17T15:20:23.057 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: }, 2022-03-17T15:20:23.058 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "progress_events": {} 2022-03-17T15:20:23.058 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: } 2022-03-17T15:20:23.368 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:23.035676+0000 mon.smithi061 (mon.0) 25 : audit [DBG] from='client.? 172.21.15.61:0/2305213719' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2022-03-17T15:20:23.421 INFO:teuthology.orchestra.run.smithi061.stderr:mgr is available 2022-03-17T15:20:23.421 INFO:teuthology.orchestra.run.smithi061.stderr:Enabling cephadm module... 2022-03-17T15:20:23.421 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable cephadm 2022-03-17T15:20:24.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:24.210086+0000 mon.smithi061 (mon.0) 26 : audit [INF] from='client.? 172.21.15.61:0/3920050153' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2022-03-17T15:20:24.671 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr stat 2022-03-17T15:20:25.528 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: { 2022-03-17T15:20:25.528 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 5, 2022-03-17T15:20:25.529 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "available": true, 2022-03-17T15:20:25.529 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "active_name": "smithi061.kxplwz", 2022-03-17T15:20:25.529 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_standby": 0 2022-03-17T15:20:25.529 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: } 2022-03-17T15:20:25.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:24.263015+0000 mon.smithi061 (mon.0) 27 : audit [INF] from='client.? 172.21.15.61:0/3920050153' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2022-03-17T15:20:25.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:24.263080+0000 mon.smithi061 (mon.0) 28 : cluster [DBG] mgrmap e5: smithi061.kxplwz(active, since 5s) 2022-03-17T15:20:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:25.525378+0000 mon.smithi061 (mon.0) 29 : audit [DBG] from='client.? 172.21.15.61:0/3871388769' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2022-03-17T15:20:27.912 INFO:teuthology.orchestra.run.smithi061.stderr:Waiting for the mgr to restart... 2022-03-17T15:20:27.912 INFO:teuthology.orchestra.run.smithi061.stderr:Waiting for mgr epoch 5... 2022-03-17T15:20:27.912 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 tell mgr mgr_status 2022-03-17T15:20:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:30.277202+0000 mon.smithi061 (mon.0) 30 : cluster [INF] Active manager daemon smithi061.kxplwz restarted 2022-03-17T15:20:30.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:30.277583+0000 mon.smithi061 (mon.0) 31 : cluster [INF] Activating manager daemon smithi061.kxplwz 2022-03-17T15:20:30.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:30.281713+0000 mon.smithi061 (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2022-03-17T15:20:31.356 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: { 2022-03-17T15:20:31.356 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2022-03-17T15:20:31.357 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "initialized": true 2022-03-17T15:20:31.357 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: } 2022-03-17T15:20:31.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:30.332376+0000 mon.smithi061 (mon.0) 33 : cluster [DBG] mgrmap e6: smithi061.kxplwz(active, starting, since 0.054864s) 2022-03-17T15:20:31.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:30.335031+0000 mon.smithi061 (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi061"}]: dispatch 2022-03-17T15:20:31.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:30.335745+0000 mon.smithi061 (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr metadata", "who": "smithi061.kxplwz", "id": "smithi061.kxplwz"}]: dispatch 2022-03-17T15:20:31.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:30.336527+0000 mon.smithi061 (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-03-17T15:20:31.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:30.336739+0000 mon.smithi061 (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-03-17T15:20:31.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:30.336893+0000 mon.smithi061 (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-03-17T15:20:31.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:30.350839+0000 mon.smithi061 (mon.0) 39 : cluster [INF] Manager daemon smithi061.kxplwz is now available 2022-03-17T15:20:31.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:30.366487+0000 mon.smithi061 (mon.0) 40 : audit [INF] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:31.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:30.369276+0000 mon.smithi061 (mon.0) 41 : audit [INF] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:31.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:30.371804+0000 mon.smithi061 (mon.0) 42 : audit [INF] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:31.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:30.494417+0000 mon.smithi061 (mon.0) 43 : audit [INF] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:31.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:30.495129+0000 mon.smithi061 (mon.0) 44 : audit [DBG] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:20:31.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:30.496302+0000 mon.smithi061 (mon.0) 45 : audit [DBG] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:20:31.806 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:30.498500+0000 mon.smithi061 (mon.0) 46 : audit [DBG] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:20:31.806 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:30.510133+0000 mon.smithi061 (mon.0) 47 : audit [INF] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:20:31.806 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:30.511431+0000 mon.smithi061 (mon.0) 48 : audit [INF] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:20:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:31.342200+0000 mgr.smithi061.kxplwz (mgr.14116) 1 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2022-03-17T15:20:32.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:31.343047+0000 mon.smithi061 (mon.0) 49 : cluster [DBG] mgrmap e7: smithi061.kxplwz(active, since 1.06553s) 2022-03-17T15:20:32.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:31.353596+0000 mgr.smithi061.kxplwz (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2022-03-17T15:20:33.665 INFO:teuthology.orchestra.run.smithi061.stderr:mgr epoch 5 is available 2022-03-17T15:20:33.665 INFO:teuthology.orchestra.run.smithi061.stderr:Setting orchestrator backend to cephadm... 2022-03-17T15:20:33.665 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch set backend cephadm 2022-03-17T15:20:33.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:32.494257+0000 mon.smithi061 (mon.0) 50 : cluster [DBG] mgrmap e8: smithi061.kxplwz(active, since 2s) 2022-03-17T15:20:36.414 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm set-user root 2022-03-17T15:20:37.135 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: value unchanged 2022-03-17T15:20:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:36.028297+0000 mgr.smithi061.kxplwz (mgr.14116) 3 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:20:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:36.032402+0000 mon.smithi061 (mon.0) 51 : audit [INF] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:36.036290+0000 mon.smithi061 (mon.0) 52 : audit [DBG] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:20:37.456 INFO:teuthology.orchestra.run.smithi061.stderr:Generating ssh key... 2022-03-17T15:20:37.456 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm generate-key 2022-03-17T15:20:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:37.133454+0000 mgr.smithi061.kxplwz (mgr.14116) 4 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:20:38.697 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 cephadm get-pub-key 2022-03-17T15:20:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:20:38.225323+0000 mgr.smithi061.kxplwz (mgr.14116) 6 : cephadm [INF] Generating ssh key... 2022-03-17T15:20:39.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:38.358224+0000 mon.smithi061 (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:39.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:38.360053+0000 mon.smithi061 (mon.0) 54 : audit [INF] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:39.405 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQlXBiZlW7iFx6U4dx/VLKK7FzVdD5rb4IWTDzv7xUKY7iWi/OBzu6iOlQjtdJzpwtplsvPiStVEF2ttCcd1Q2tDD8PioB7galt7T1gQUjKNZTDk5EgnOc3gsV2lW5sV9eh+R+0W1suyy7p6g03dASDhwXjBTUqQ0KsgW9KcZAwcb9qrY6GPiN6uLPkMN6AmIandXfhih/xYnQuaU26NwK723d96CBjj+E/h/vZ8jq2Uzn+blBlCtRCBQQP/gKAzpHIJlS1YxvU+fUmOyQKU6/inwY82XBlrWvRzEZNUkjJ8TCfplvYH9a8FethPO3N2eOUAoTmKOP3Gm2ULvkx3RJCK3w4QKkeGit4jlecjw1kgje2W3tcAf/RVMtM3M4gKAxllUsLHZBIfEFHdfS1NeAM5JRmqSV8nUtxKovAnARGQcgFugNhTc3DDQqtSTnZARIW3spxqI34cCfx3duVjlGFWlj5MNcWXKa9RTXIgRN3fkkt0zgONs15P/1ePE7VPU= ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:20:39.839 INFO:teuthology.orchestra.run.smithi061.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2022-03-17T15:20:39.840 INFO:teuthology.orchestra.run.smithi061.stderr:Adding key to root@localhost authorized_keys... 2022-03-17T15:20:39.841 INFO:teuthology.orchestra.run.smithi061.stderr:Adding host smithi061... 2022-03-17T15:20:39.841 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch host add smithi061 172.21.15.61 2022-03-17T15:20:40.633 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:39.402562+0000 mgr.smithi061.kxplwz (mgr.14116) 7 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:20:41.336 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: Added host 'smithi061' 2022-03-17T15:20:41.684 INFO:teuthology.orchestra.run.smithi061.stderr:Deploying mon service with default placement... 2022-03-17T15:20:41.684 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply mon 2022-03-17T15:20:41.729 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:40.608285+0000 mgr.smithi061.kxplwz (mgr.14116) 8 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi061", "addr": "172.21.15.61", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:20:41.730 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:41.327265+0000 mon.smithi061 (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:41.730 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:41.327874+0000 mon.smithi061 (mon.0) 56 : audit [DBG] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:20:42.474 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: Scheduled mon update... 2022-03-17T15:20:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:20:41.327608+0000 mgr.smithi061.kxplwz (mgr.14116) 9 : cephadm [INF] Added host smithi061 2022-03-17T15:20:42.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:42.471289+0000 mon.smithi061 (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:42.826 INFO:teuthology.orchestra.run.smithi061.stderr:Deploying mgr service with default placement... 2022-03-17T15:20:42.827 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply mgr 2022-03-17T15:20:43.759 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: Scheduled mgr update... 2022-03-17T15:20:43.796 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:42.468266+0000 mgr.smithi061.kxplwz (mgr.14116) 10 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:20:43.796 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:20:42.469026+0000 mgr.smithi061.kxplwz (mgr.14116) 11 : cephadm [INF] Saving service mon spec with placement count:5 2022-03-17T15:20:44.181 INFO:teuthology.orchestra.run.smithi061.stderr:Deploying crash service with default placement... 2022-03-17T15:20:44.181 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply crash 2022-03-17T15:20:44.975 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: Scheduled crash update... 2022-03-17T15:20:45.000 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:43.709472+0000 mon.smithi061 (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:45.000 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:43.752730+0000 mgr.smithi061.kxplwz (mgr.14116) 12 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:20:45.001 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:20:43.753342+0000 mgr.smithi061.kxplwz (mgr.14116) 13 : cephadm [INF] Saving service mgr spec with placement count:2 2022-03-17T15:20:45.001 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:43.755806+0000 mon.smithi061 (mon.0) 59 : audit [INF] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:45.001 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:44.060335+0000 mon.smithi061 (mon.0) 60 : audit [INF] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:45.523 INFO:teuthology.orchestra.run.smithi061.stderr:Enabling mgr prometheus module... 2022-03-17T15:20:45.523 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable prometheus 2022-03-17T15:20:46.265 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:44.970555+0000 mgr.smithi061.kxplwz (mgr.14116) 14 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:20:46.265 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:20:44.971273+0000 mgr.smithi061.kxplwz (mgr.14116) 15 : cephadm [INF] Saving service crash spec with placement * 2022-03-17T15:20:46.266 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:44.973403+0000 mon.smithi061 (mon.0) 61 : audit [INF] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:46.266 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:45.584952+0000 mon.smithi061 (mon.0) 62 : audit [INF] from='mgr.14116 172.21.15.61:0/2697138246' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:47.258 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:46.346294+0000 mon.smithi061 (mon.0) 63 : audit [INF] from='client.? 172.21.15.61:0/3918708642' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2022-03-17T15:20:47.265 INFO:teuthology.orchestra.run.smithi061.stderr:Deploying prometheus service with default placement... 2022-03-17T15:20:47.265 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply prometheus 2022-03-17T15:20:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:46.978269+0000 mon.smithi061 (mon.0) 64 : audit [INF] from='client.? 172.21.15.61:0/3918708642' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2022-03-17T15:20:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:46.978333+0000 mon.smithi061 (mon.0) 65 : cluster [DBG] mgrmap e9: smithi061.kxplwz(active, since 16s) 2022-03-17T15:20:54.057 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: Scheduled prometheus update... 2022-03-17T15:20:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:52.995086+0000 mon.smithi061 (mon.0) 66 : cluster [INF] Active manager daemon smithi061.kxplwz restarted 2022-03-17T15:20:54.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:52.995524+0000 mon.smithi061 (mon.0) 67 : cluster [INF] Activating manager daemon smithi061.kxplwz 2022-03-17T15:20:54.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:52.997077+0000 mon.smithi061 (mon.0) 68 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2022-03-17T15:20:54.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:53.047670+0000 mon.smithi061 (mon.0) 69 : cluster [DBG] mgrmap e10: smithi061.kxplwz(active, starting, since 0.052255s) 2022-03-17T15:20:54.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:53.048879+0000 mon.smithi061 (mon.0) 70 : audit [DBG] from='mgr.14144 172.21.15.61:0/1676595339' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi061"}]: dispatch 2022-03-17T15:20:54.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:53.049689+0000 mon.smithi061 (mon.0) 71 : audit [DBG] from='mgr.14144 172.21.15.61:0/1676595339' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr metadata", "who": "smithi061.kxplwz", "id": "smithi061.kxplwz"}]: dispatch 2022-03-17T15:20:54.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:53.050548+0000 mon.smithi061 (mon.0) 72 : audit [DBG] from='mgr.14144 172.21.15.61:0/1676595339' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-03-17T15:20:54.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:53.050708+0000 mon.smithi061 (mon.0) 73 : audit [DBG] from='mgr.14144 172.21.15.61:0/1676595339' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-03-17T15:20:54.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:53.050851+0000 mon.smithi061 (mon.0) 74 : audit [DBG] from='mgr.14144 172.21.15.61:0/1676595339' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-03-17T15:20:54.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:53.064869+0000 mon.smithi061 (mon.0) 75 : cluster [INF] Manager daemon smithi061.kxplwz is now available 2022-03-17T15:20:54.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:53.201543+0000 mon.smithi061 (mon.0) 76 : audit [DBG] from='mgr.14144 172.21.15.61:0/1676595339' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:20:54.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:53.203106+0000 mon.smithi061 (mon.0) 77 : audit [DBG] from='mgr.14144 172.21.15.61:0/1676595339' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:20:54.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:53.220296+0000 mon.smithi061 (mon.0) 78 : audit [INF] from='mgr.14144 172.21.15.61:0/1676595339' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:20:54.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:53.223674+0000 mon.smithi061 (mon.0) 79 : audit [INF] from='mgr.14144 172.21.15.61:0/1676595339' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:20:54.320 INFO:teuthology.orchestra.run.smithi061.stderr:Deploying grafana service with default placement... 2022-03-17T15:20:54.320 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply grafana 2022-03-17T15:20:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:54.049799+0000 mon.smithi061 (mon.0) 80 : cluster [DBG] mgrmap e11: smithi061.kxplwz(active, since 1.05438s) 2022-03-17T15:20:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:20:54.051552+0000 mgr.smithi061.kxplwz (mgr.14144) 2 : cephadm [INF] Saving service prometheus spec with placement count:1 2022-03-17T15:20:55.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:54.053615+0000 mon.smithi061 (mon.0) 81 : audit [INF] from='mgr.14144 172.21.15.61:0/1676595339' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:55.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:54.874343+0000 mon.smithi061 (mon.0) 82 : audit [INF] from='mgr.14144 172.21.15.61:0/1676595339' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:55.401 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: Scheduled grafana update... 2022-03-17T15:20:55.865 INFO:teuthology.orchestra.run.smithi061.stderr:Deploying node-exporter service with default placement... 2022-03-17T15:20:55.866 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply node-exporter 2022-03-17T15:20:56.792 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: Scheduled node-exporter update... 2022-03-17T15:20:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:55.396174+0000 mgr.smithi061.kxplwz (mgr.14144) 3 : audit [DBG] from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:20:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:20:55.396736+0000 mgr.smithi061.kxplwz (mgr.14144) 4 : cephadm [INF] Saving service grafana spec with placement count:1 2022-03-17T15:20:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:55.398917+0000 mon.smithi061 (mon.0) 83 : audit [INF] from='mgr.14144 172.21.15.61:0/1676595339' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:56.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:20:55.876974+0000 mon.smithi061 (mon.0) 84 : cluster [DBG] mgrmap e12: smithi061.kxplwz(active, since 2s) 2022-03-17T15:20:57.110 INFO:teuthology.orchestra.run.smithi061.stderr:Deploying alertmanager service with default placement... 2022-03-17T15:20:57.111 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 orch apply alertmanager 2022-03-17T15:20:57.895 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: Scheduled alertmanager update... 2022-03-17T15:20:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:56.787066+0000 mgr.smithi061.kxplwz (mgr.14144) 5 : audit [DBG] from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:20:58.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:20:56.787802+0000 mgr.smithi061.kxplwz (mgr.14144) 6 : cephadm [INF] Saving service node-exporter spec with placement * 2022-03-17T15:20:58.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:56.790113+0000 mon.smithi061 (mon.0) 85 : audit [INF] from='mgr.14144 172.21.15.61:0/1676595339' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:58.253 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mgr mgr/cephadm/container_init True --force 2022-03-17T15:20:59.288 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:57.889996+0000 mgr.smithi061.kxplwz (mgr.14144) 7 : audit [DBG] from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:20:59.288 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:20:57.890567+0000 mgr.smithi061.kxplwz (mgr.14144) 8 : cephadm [INF] Saving service alertmanager spec with placement count:1 2022-03-17T15:20:59.288 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:57.892624+0000 mon.smithi061 (mon.0) 86 : audit [INF] from='mgr.14144 172.21.15.61:0/1676595339' entity='mgr.smithi061.kxplwz' 2022-03-17T15:20:59.297 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config set mgr mgr/dashboard/ssl_server_port 8443 2022-03-17T15:21:00.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:58.998281+0000 mon.smithi061 (mon.0) 87 : audit [INF] from='client.? 172.21.15.61:0/2338589248' entity='client.admin' 2022-03-17T15:21:00.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:20:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:20:59.995922+0000 mon.smithi061 (mon.0) 88 : audit [INF] from='client.? 172.21.15.61:0/937902569' entity='client.admin' 2022-03-17T15:21:00.338 INFO:teuthology.orchestra.run.smithi061.stderr:Enabling the dashboard module... 2022-03-17T15:21:00.338 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr module enable dashboard 2022-03-17T15:21:01.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:01.128131+0000 mon.smithi061 (mon.0) 89 : audit [INF] from='client.? 172.21.15.61:0/3429902250' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2022-03-17T15:21:01.780 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 mgr stat 2022-03-17T15:21:02.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:01.181336+0000 mon.smithi061 (mon.0) 90 : audit [INF] from='client.? 172.21.15.61:0/3429902250' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2022-03-17T15:21:02.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:01.181386+0000 mon.smithi061 (mon.0) 91 : cluster [DBG] mgrmap e13: smithi061.kxplwz(active, since 8s) 2022-03-17T15:21:02.572 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: { 2022-03-17T15:21:02.573 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "epoch": 13, 2022-03-17T15:21:02.573 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "available": true, 2022-03-17T15:21:02.573 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "active_name": "smithi061.kxplwz", 2022-03-17T15:21:02.573 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "num_standby": 0 2022-03-17T15:21:02.574 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: } 2022-03-17T15:21:02.922 INFO:teuthology.orchestra.run.smithi061.stderr:Waiting for the mgr to restart... 2022-03-17T15:21:02.923 INFO:teuthology.orchestra.run.smithi061.stderr:Waiting for mgr epoch 13... 2022-03-17T15:21:02.923 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 tell mgr mgr_status 2022-03-17T15:21:03.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:02.569896+0000 mon.smithi061 (mon.0) 92 : audit [DBG] from='client.? 172.21.15.61:0/701145037' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2022-03-17T15:21:08.517 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: { 2022-03-17T15:21:08.518 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "mgrmap_epoch": 15, 2022-03-17T15:21:08.518 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: "initialized": true 2022-03-17T15:21:08.518 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: } 2022-03-17T15:21:08.546 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:07.191103+0000 mon.smithi061 (mon.0) 93 : cluster [INF] Active manager daemon smithi061.kxplwz restarted 2022-03-17T15:21:08.547 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:07.191558+0000 mon.smithi061 (mon.0) 94 : cluster [INF] Activating manager daemon smithi061.kxplwz 2022-03-17T15:21:08.547 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:07.193208+0000 mon.smithi061 (mon.0) 95 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2022-03-17T15:21:08.547 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:07.499107+0000 mon.smithi061 (mon.0) 96 : cluster [DBG] mgrmap e14: smithi061.kxplwz(active, starting, since 0.30764s) 2022-03-17T15:21:08.548 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:07.500281+0000 mon.smithi061 (mon.0) 97 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi061"}]: dispatch 2022-03-17T15:21:08.548 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:07.501014+0000 mon.smithi061 (mon.0) 98 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr metadata", "who": "smithi061.kxplwz", "id": "smithi061.kxplwz"}]: dispatch 2022-03-17T15:21:08.548 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:07.501990+0000 mon.smithi061 (mon.0) 99 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-03-17T15:21:08.548 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:07.502190+0000 mon.smithi061 (mon.0) 100 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-03-17T15:21:08.548 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:07.502355+0000 mon.smithi061 (mon.0) 101 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-03-17T15:21:08.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:07.516042+0000 mon.smithi061 (mon.0) 102 : cluster [INF] Manager daemon smithi061.kxplwz is now available 2022-03-17T15:21:08.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:07.652550+0000 mon.smithi061 (mon.0) 103 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:21:08.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:07.653851+0000 mon.smithi061 (mon.0) 104 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:21:08.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:07.678929+0000 mon.smithi061 (mon.0) 105 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:21:08.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:07.683858+0000 mon.smithi061 (mon.0) 106 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:21:08.877 INFO:teuthology.orchestra.run.smithi061.stderr:mgr epoch 13 is available 2022-03-17T15:21:08.877 INFO:teuthology.orchestra.run.smithi061.stderr:Generating a dashboard self-signed certificate... 2022-03-17T15:21:08.877 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 dashboard create-self-signed-cert 2022-03-17T15:21:09.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:08.503520+0000 mgr.smithi061.kxplwz (mgr.14164) 1 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2022-03-17T15:21:09.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:08.503662+0000 mon.smithi061 (mon.0) 107 : cluster [DBG] mgrmap e15: smithi061.kxplwz(active, since 1.3122s) 2022-03-17T15:21:09.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:08.514219+0000 mgr.smithi061.kxplwz (mgr.14164) 2 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2022-03-17T15:21:09.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:09.358040+0000 mon.smithi061 (mon.0) 108 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:09.866 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: Self-signed certificate created 2022-03-17T15:21:10.226 INFO:teuthology.orchestra.run.smithi061.stderr:Creating initial admin user... 2022-03-17T15:21:10.227 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp80npw78b:/tmp/dashboard.pw:z docker.io/ceph/ceph:v16.2.4 dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2022-03-17T15:21:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:09.513065+0000 mon.smithi061 (mon.0) 109 : cluster [DBG] mgrmap e16: smithi061.kxplwz(active, since 2s) 2022-03-17T15:21:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:09.739868+0000 mgr.smithi061.kxplwz (mgr.14164) 3 : audit [DBG] from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:21:10.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:09.862037+0000 mon.smithi061 (mon.0) 110 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:10.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:09.863826+0000 mon.smithi061 (mon.0) 111 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:11.418 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$GVH/iLwmkz4HvLjNHGt1NOafazUm6vBPmwJC5Y/Q40Vbxigzef9f2", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1647530471, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2022-03-17T15:21:11.712 INFO:teuthology.orchestra.run.smithi061.stderr:Fetching dashboard port number... 2022-03-17T15:21:11.713 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /bin/podman run --rm --ipc=host --no-hosts --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=docker.io/ceph/ceph:v16.2.4 -e NODE_NAME=smithi061 -e CEPH_USE_RANDOM_NONCE=1 -v /var/log/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpfy54qbjb:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmpev6ywmtv:/etc/ceph/ceph.conf:z docker.io/ceph/ceph:v16.2.4 config get mgr mgr/dashboard/ssl_server_port 2022-03-17T15:21:11.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:11.170750+0000 mgr.smithi061.kxplwz (mgr.14164) 4 : audit [DBG] from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:21:11.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:11.415646+0000 mon.smithi061 (mon.0) 112 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:12.426 INFO:teuthology.orchestra.run.smithi061.stderr:/usr/bin/ceph: 8443 2022-03-17T15:21:12.754 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl is-enabled firewalld.service 2022-03-17T15:21:12.762 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: disabled 2022-03-17T15:21:12.763 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: systemctl is-active firewalld.service 2022-03-17T15:21:12.769 INFO:teuthology.orchestra.run.smithi061.stderr:systemctl: inactive 2022-03-17T15:21:12.770 INFO:teuthology.orchestra.run.smithi061.stderr:firewalld.service is not enabled 2022-03-17T15:21:12.770 INFO:teuthology.orchestra.run.smithi061.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2022-03-17T15:21:12.773 INFO:teuthology.orchestra.run.smithi061.stderr:Ceph Dashboard is now available at: 2022-03-17T15:21:12.774 INFO:teuthology.orchestra.run.smithi061.stderr: 2022-03-17T15:21:12.774 INFO:teuthology.orchestra.run.smithi061.stderr: URL: https://smithi061.front.sepia.ceph.com:8443/ 2022-03-17T15:21:12.774 INFO:teuthology.orchestra.run.smithi061.stderr: User: admin 2022-03-17T15:21:12.774 INFO:teuthology.orchestra.run.smithi061.stderr: Password: eb8iofoyum 2022-03-17T15:21:12.775 INFO:teuthology.orchestra.run.smithi061.stderr: 2022-03-17T15:21:12.775 INFO:teuthology.orchestra.run.smithi061.stderr:You can access the Ceph CLI with: 2022-03-17T15:21:12.775 INFO:teuthology.orchestra.run.smithi061.stderr: 2022-03-17T15:21:12.775 INFO:teuthology.orchestra.run.smithi061.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2022-03-17T15:21:12.776 INFO:teuthology.orchestra.run.smithi061.stderr: 2022-03-17T15:21:12.776 INFO:teuthology.orchestra.run.smithi061.stderr:Please consider enabling telemetry to help improve Ceph: 2022-03-17T15:21:12.776 INFO:teuthology.orchestra.run.smithi061.stderr: 2022-03-17T15:21:12.776 INFO:teuthology.orchestra.run.smithi061.stderr: ceph telemetry on 2022-03-17T15:21:12.776 INFO:teuthology.orchestra.run.smithi061.stderr: 2022-03-17T15:21:12.777 INFO:teuthology.orchestra.run.smithi061.stderr:For more information see: 2022-03-17T15:21:12.777 INFO:teuthology.orchestra.run.smithi061.stderr: 2022-03-17T15:21:12.777 INFO:teuthology.orchestra.run.smithi061.stderr: https://docs.ceph.com/docs/pacific/mgr/telemetry/ 2022-03-17T15:21:12.777 INFO:teuthology.orchestra.run.smithi061.stderr: 2022-03-17T15:21:12.777 INFO:teuthology.orchestra.run.smithi061.stderr:Bootstrap complete. 2022-03-17T15:21:12.778 INFO:teuthology.orchestra.run.smithi061.stderr:Releasing lock 140503618277504 on /run/cephadm/ae1b9b88-a605-11ec-8c35-001a4aab830c.lock 2022-03-17T15:21:12.778 INFO:teuthology.orchestra.run.smithi061.stderr:Lock 140503618277504 released on /run/cephadm/ae1b9b88-a605-11ec-8c35-001a4aab830c.lock 2022-03-17T15:21:12.778 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:12.424208+0000 mon.smithi061 (mon.0) 113 : audit [DBG] from='client.? 172.21.15.61:0/3236519037' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2022-03-17T15:21:12.827 INFO:tasks.cephadm:Fetching config... 2022-03-17T15:21:12.828 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2022-03-17T15:21:12.828 DEBUG:teuthology.orchestra.run.smithi061:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2022-03-17T15:21:12.849 INFO:tasks.cephadm:Fetching client.admin keyring... 2022-03-17T15:21:12.849 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2022-03-17T15:21:12.849 DEBUG:teuthology.orchestra.run.smithi061:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2022-03-17T15:21:12.906 INFO:tasks.cephadm:Fetching mon keyring... 2022-03-17T15:21:12.907 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2022-03-17T15:21:12.907 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd if=/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/keyring of=/dev/stdout 2022-03-17T15:21:12.975 INFO:tasks.cephadm:Fetching pub ssh key... 2022-03-17T15:21:12.976 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2022-03-17T15:21:12.976 DEBUG:teuthology.orchestra.run.smithi061:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2022-03-17T15:21:13.033 INFO:tasks.cephadm:Installing pub ssh key for root users... 2022-03-17T15:21:13.034 DEBUG:teuthology.orchestra.run.smithi061:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQlXBiZlW7iFx6U4dx/VLKK7FzVdD5rb4IWTDzv7xUKY7iWi/OBzu6iOlQjtdJzpwtplsvPiStVEF2ttCcd1Q2tDD8PioB7galt7T1gQUjKNZTDk5EgnOc3gsV2lW5sV9eh+R+0W1suyy7p6g03dASDhwXjBTUqQ0KsgW9KcZAwcb9qrY6GPiN6uLPkMN6AmIandXfhih/xYnQuaU26NwK723d96CBjj+E/h/vZ8jq2Uzn+blBlCtRCBQQP/gKAzpHIJlS1YxvU+fUmOyQKU6/inwY82XBlrWvRzEZNUkjJ8TCfplvYH9a8FethPO3N2eOUAoTmKOP3Gm2ULvkx3RJCK3w4QKkeGit4jlecjw1kgje2W3tcAf/RVMtM3M4gKAxllUsLHZBIfEFHdfS1NeAM5JRmqSV8nUtxKovAnARGQcgFugNhTc3DDQqtSTnZARIW3spxqI34cCfx3duVjlGFWlj5MNcWXKa9RTXIgRN3fkkt0zgONs15P/1ePE7VPU= ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2022-03-17T15:21:13.114 INFO:teuthology.orchestra.run.smithi061.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQlXBiZlW7iFx6U4dx/VLKK7FzVdD5rb4IWTDzv7xUKY7iWi/OBzu6iOlQjtdJzpwtplsvPiStVEF2ttCcd1Q2tDD8PioB7galt7T1gQUjKNZTDk5EgnOc3gsV2lW5sV9eh+R+0W1suyy7p6g03dASDhwXjBTUqQ0KsgW9KcZAwcb9qrY6GPiN6uLPkMN6AmIandXfhih/xYnQuaU26NwK723d96CBjj+E/h/vZ8jq2Uzn+blBlCtRCBQQP/gKAzpHIJlS1YxvU+fUmOyQKU6/inwY82XBlrWvRzEZNUkjJ8TCfplvYH9a8FethPO3N2eOUAoTmKOP3Gm2ULvkx3RJCK3w4QKkeGit4jlecjw1kgje2W3tcAf/RVMtM3M4gKAxllUsLHZBIfEFHdfS1NeAM5JRmqSV8nUtxKovAnARGQcgFugNhTc3DDQqtSTnZARIW3spxqI34cCfx3duVjlGFWlj5MNcWXKa9RTXIgRN3fkkt0zgONs15P/1ePE7VPU= ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:21:13.127 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQlXBiZlW7iFx6U4dx/VLKK7FzVdD5rb4IWTDzv7xUKY7iWi/OBzu6iOlQjtdJzpwtplsvPiStVEF2ttCcd1Q2tDD8PioB7galt7T1gQUjKNZTDk5EgnOc3gsV2lW5sV9eh+R+0W1suyy7p6g03dASDhwXjBTUqQ0KsgW9KcZAwcb9qrY6GPiN6uLPkMN6AmIandXfhih/xYnQuaU26NwK723d96CBjj+E/h/vZ8jq2Uzn+blBlCtRCBQQP/gKAzpHIJlS1YxvU+fUmOyQKU6/inwY82XBlrWvRzEZNUkjJ8TCfplvYH9a8FethPO3N2eOUAoTmKOP3Gm2ULvkx3RJCK3w4QKkeGit4jlecjw1kgje2W3tcAf/RVMtM3M4gKAxllUsLHZBIfEFHdfS1NeAM5JRmqSV8nUtxKovAnARGQcgFugNhTc3DDQqtSTnZARIW3spxqI34cCfx3duVjlGFWlj5MNcWXKa9RTXIgRN3fkkt0zgONs15P/1ePE7VPU= ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2022-03-17T15:21:13.184 INFO:teuthology.orchestra.run.smithi067.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDQlXBiZlW7iFx6U4dx/VLKK7FzVdD5rb4IWTDzv7xUKY7iWi/OBzu6iOlQjtdJzpwtplsvPiStVEF2ttCcd1Q2tDD8PioB7galt7T1gQUjKNZTDk5EgnOc3gsV2lW5sV9eh+R+0W1suyy7p6g03dASDhwXjBTUqQ0KsgW9KcZAwcb9qrY6GPiN6uLPkMN6AmIandXfhih/xYnQuaU26NwK723d96CBjj+E/h/vZ8jq2Uzn+blBlCtRCBQQP/gKAzpHIJlS1YxvU+fUmOyQKU6/inwY82XBlrWvRzEZNUkjJ8TCfplvYH9a8FethPO3N2eOUAoTmKOP3Gm2ULvkx3RJCK3w4QKkeGit4jlecjw1kgje2W3tcAf/RVMtM3M4gKAxllUsLHZBIfEFHdfS1NeAM5JRmqSV8nUtxKovAnARGQcgFugNhTc3DDQqtSTnZARIW3spxqI34cCfx3duVjlGFWlj5MNcWXKa9RTXIgRN3fkkt0zgONs15P/1ePE7VPU= ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:21:13.197 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2022-03-17T15:21:14.793 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:13.515405+0000 mon.smithi061 (mon.0) 114 : cluster [DBG] mgrmap e17: smithi061.kxplwz(active, since 6s) 2022-03-17T15:21:15.343 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi067 2022-03-17T15:21:15.343 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2022-03-17T15:21:15.344 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/etc/ceph/ceph.conf 2022-03-17T15:21:15.365 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2022-03-17T15:21:15.366 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/etc/ceph/ceph.client.admin.keyring 2022-03-17T15:21:15.425 INFO:tasks.cephadm:Adding host smithi067 to orchestrator... 2022-03-17T15:21:15.426 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph orch host add smithi067 2022-03-17T15:21:15.976 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:14.908414+0000 mon.smithi061 (mon.0) 115 : audit [INF] from='client.? 172.21.15.61:0/1651697300' entity='client.admin' 2022-03-17T15:21:17.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:16.364456+0000 mon.smithi061 (mon.0) 116 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:17.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:16.777522+0000 mon.smithi061 (mon.0) 117 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:17.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:21:16.786407+0000 mgr.smithi061.kxplwz (mgr.14164) 5 : cephadm [INF] Deploying daemon alertmanager.smithi061 on smithi061 2022-03-17T15:21:23.456 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:22.246671+0000 mon.smithi061 (mon.0) 118 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:23.456 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:22.247723+0000 mon.smithi061 (mon.0) 119 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi061", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-03-17T15:21:23.457 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:22.251998+0000 mon.smithi061 (mon.0) 120 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi061", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2022-03-17T15:21:23.457 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:22.252670+0000 mon.smithi061 (mon.0) 121 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:21:23.457 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:21:22.253237+0000 mgr.smithi061.kxplwz (mgr.14164) 6 : cephadm [INF] Deploying daemon crash.smithi061 on smithi061 2022-03-17T15:21:25.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:24.148235+0000 mon.smithi061 (mon.0) 122 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:25.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:24.364981+0000 mon.smithi061 (mon.0) 123 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:25.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:24.366813+0000 mon.smithi061 (mon.0) 124 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:25.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:24.367260+0000 mon.smithi061 (mon.0) 125 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2022-03-17T15:21:25.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:24.370019+0000 mon.smithi061 (mon.0) 126 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:24.367747+0000 mgr.smithi061.kxplwz (mgr.14164) 7 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2022-03-17T15:21:26.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:21:24.373688+0000 mgr.smithi061.kxplwz (mgr.14164) 8 : cephadm [INF] Deploying daemon grafana.smithi061 on smithi061 2022-03-17T15:21:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:27.503140+0000 mgr.smithi061.kxplwz (mgr.14164) 9 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:21:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:29.503386+0000 mgr.smithi061.kxplwz (mgr.14164) 10 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:21:30.971 INFO:teuthology.orchestra.run.smithi067.stdout:Added host 'smithi067' 2022-03-17T15:21:31.435 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph orch host ls --format=json 2022-03-17T15:21:32.296 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:30.325909+0000 mgr.smithi061.kxplwz (mgr.14164) 11 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi067", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:21:32.296 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:30.967895+0000 mon.smithi061 (mon.0) 127 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:32.296 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:21:30.968272+0000 mgr.smithi061.kxplwz (mgr.14164) 12 : cephadm [INF] Added host smithi067 2022-03-17T15:21:33.112 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:21:33.112 INFO:teuthology.orchestra.run.smithi067.stdout:[{"addr": "172.21.15.61", "hostname": "smithi061", "labels": [], "status": ""}, {"addr": "smithi067", "hostname": "smithi067", "labels": [], "status": ""}] 2022-03-17T15:21:33.266 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:31.503618+0000 mgr.smithi061.kxplwz (mgr.14164) 13 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:21:33.482 INFO:tasks.cephadm:Setting crush tunables to default 2022-03-17T15:21:33.483 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph osd crush tunables default 2022-03-17T15:21:34.227 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:33.109150+0000 mgr.smithi061.kxplwz (mgr.14164) 14 : audit [DBG] from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-03-17T15:21:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:33.503864+0000 mgr.smithi061.kxplwz (mgr.14164) 15 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:21:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:34.368215+0000 mon.smithi061 (mon.0) 128 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:35.983 INFO:teuthology.orchestra.run.smithi061.stderr:adjusted tunables profile to default 2022-03-17T15:21:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:21:34.369989+0000 mgr.smithi061.kxplwz (mgr.14164) 16 : cephadm [INF] Deploying daemon node-exporter.smithi061 on smithi061 2022-03-17T15:21:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:35.557713+0000 mon.smithi061 (mon.0) 129 : audit [INF] from='client.? 172.21.15.61:0/3484055850' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2022-03-17T15:21:37.043 INFO:tasks.cephadm:Adding mon.smithi061 on smithi061 2022-03-17T15:21:37.043 INFO:tasks.cephadm:Adding mon.smithi067 on smithi067 2022-03-17T15:21:37.044 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph orch apply mon '2;smithi061:172.21.15.61=smithi061;smithi067:172.21.15.67=smithi067' 2022-03-17T15:21:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:35.504123+0000 mgr.smithi061.kxplwz (mgr.14164) 17 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:21:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:35.977303+0000 mon.smithi061 (mon.0) 130 : audit [INF] from='client.? 172.21.15.61:0/3484055850' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2022-03-17T15:21:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:35.977393+0000 mon.smithi061 (mon.0) 131 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2022-03-17T15:21:38.598 INFO:teuthology.orchestra.run.smithi067.stdout:Scheduled mon update... 2022-03-17T15:21:38.925 DEBUG:teuthology.orchestra.run.smithi067:mon.smithi067> sudo journalctl -f -n 0 -u ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mon.smithi067.service 2022-03-17T15:21:38.927 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-03-17T15:21:38.928 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-03-17T15:21:38.957 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:-- Logs begin at Thu 2022-03-17 15:13:37 UTC. -- 2022-03-17T15:21:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:37.504378+0000 mgr.smithi061.kxplwz (mgr.14164) 18 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:21:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:37.773411+0000 mon.smithi061 (mon.0) 132 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:39.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:21:37.780596+0000 mgr.smithi061.kxplwz (mgr.14164) 19 : cephadm [INF] Deploying daemon prometheus.smithi061 on smithi061 2022-03-17T15:21:39.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:38.595346+0000 mon.smithi061 (mon.0) 133 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:38.591801+0000 mgr.smithi061.kxplwz (mgr.14164) 20 : audit [DBG] from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi061:172.21.15.61=smithi061;smithi067:172.21.15.67=smithi067", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:21:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:21:38.593096+0000 mgr.smithi061.kxplwz (mgr.14164) 21 : cephadm [INF] Saving service mon spec with placement smithi061:172.21.15.61=smithi061;smithi067:172.21.15.67=smithi067;count:2 2022-03-17T15:21:40.598 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:21:40.599 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":1,"fsid":"ae1b9b88-a605-11ec-8c35-001a4aab830c","modified":"2022-03-17T15:20:05.621514Z","created":"2022-03-17T15:20:05.621514Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi061","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:3300","nonce":0},{"type":"v1","addr":"172.21.15.61:6789","nonce":0}]},"addr":"172.21.15.61:6789/0","public_addr":"172.21.15.61:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-03-17T15:21:40.600 INFO:teuthology.orchestra.run.smithi067.stderr:dumped monmap epoch 1 2022-03-17T15:21:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:39.504627+0000 mgr.smithi061.kxplwz (mgr.14164) 22 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:21:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:40.596283+0000 mon.smithi061 (mon.0) 134 : audit [DBG] from='client.? 172.21.15.67:0/660899094' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-03-17T15:21:41.995 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-03-17T15:21:41.996 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-03-17T15:21:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:41.504844+0000 mgr.smithi061.kxplwz (mgr.14164) 23 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:21:43.601 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:21:43.601 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":1,"fsid":"ae1b9b88-a605-11ec-8c35-001a4aab830c","modified":"2022-03-17T15:20:05.621514Z","created":"2022-03-17T15:20:05.621514Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi061","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:3300","nonce":0},{"type":"v1","addr":"172.21.15.61:6789","nonce":0}]},"addr":"172.21.15.61:6789/0","public_addr":"172.21.15.61:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-03-17T15:21:43.602 INFO:teuthology.orchestra.run.smithi067.stderr:dumped monmap epoch 1 2022-03-17T15:21:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:43.505085+0000 mgr.smithi061.kxplwz (mgr.14164) 24 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:21:44.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:43.598053+0000 mon.smithi061 (mon.0) 135 : audit [DBG] from='client.? 172.21.15.67:0/1846778288' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-03-17T15:21:44.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:44.354458+0000 mon.smithi061 (mon.0) 136 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:44.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:44.355056+0000 mon.smithi061 (mon.0) 137 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:21:44.972 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-03-17T15:21:44.973 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-03-17T15:21:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:44.711390+0000 mon.smithi061 (mon.0) 138 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:46.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:45.201449+0000 mon.smithi061 (mon.0) 139 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:46.732 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:21:46.732 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":1,"fsid":"ae1b9b88-a605-11ec-8c35-001a4aab830c","modified":"2022-03-17T15:20:05.621514Z","created":"2022-03-17T15:20:05.621514Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi061","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:3300","nonce":0},{"type":"v1","addr":"172.21.15.61:6789","nonce":0}]},"addr":"172.21.15.61:6789/0","public_addr":"172.21.15.61:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-03-17T15:21:46.734 INFO:teuthology.orchestra.run.smithi067.stderr:dumped monmap epoch 1 2022-03-17T15:21:47.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:45.505349+0000 mgr.smithi061.kxplwz (mgr.14164) 25 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:21:47.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:46.729655+0000 mon.smithi061 (mon.0) 140 : audit [DBG] from='client.? 172.21.15.67:0/3819100031' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-03-17T15:21:48.637 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-03-17T15:21:48.638 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-03-17T15:21:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:47.505564+0000 mgr.smithi061.kxplwz (mgr.14164) 26 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:21:49.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:48.657871+0000 mon.smithi061 (mon.0) 141 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:49.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:48.782310+0000 mon.smithi061 (mon.0) 142 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:50.226 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:21:50.226 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":1,"fsid":"ae1b9b88-a605-11ec-8c35-001a4aab830c","modified":"2022-03-17T15:20:05.621514Z","created":"2022-03-17T15:20:05.621514Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi061","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:3300","nonce":0},{"type":"v1","addr":"172.21.15.61:6789","nonce":0}]},"addr":"172.21.15.61:6789/0","public_addr":"172.21.15.61:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-03-17T15:21:50.228 INFO:teuthology.orchestra.run.smithi067.stderr:dumped monmap epoch 1 2022-03-17T15:21:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:49.246138+0000 mon.smithi061 (mon.0) 143 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:50.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:49.249379+0000 mon.smithi061 (mon.0) 144 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:50.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:49.250558+0000 mon.smithi061 (mon.0) 145 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-03-17T15:21:50.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:49.255348+0000 mon.smithi061 (mon.0) 146 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2022-03-17T15:21:50.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:49.256145+0000 mon.smithi061 (mon.0) 147 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:21:50.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:21:49.256817+0000 mgr.smithi061.kxplwz (mgr.14164) 27 : cephadm [INF] Deploying daemon crash.smithi067 on smithi067 2022-03-17T15:21:50.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:49.505834+0000 mgr.smithi061.kxplwz (mgr.14164) 28 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:21:50.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:50.223295+0000 mon.smithi061 (mon.0) 148 : audit [DBG] from='client.? 172.21.15.67:0/4031893991' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-03-17T15:21:51.799 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-03-17T15:21:51.799 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-03-17T15:21:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:51.505562+0000 mon.smithi061 (mon.0) 149 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:52.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:51.506073+0000 mgr.smithi061.kxplwz (mgr.14164) 29 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:21:52.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:51.507086+0000 mon.smithi061 (mon.0) 150 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.rdualw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-03-17T15:21:52.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:51.516594+0000 mon.smithi061 (mon.0) 151 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.rdualw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2022-03-17T15:21:52.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:51.517530+0000 mon.smithi061 (mon.0) 152 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr services"}]: dispatch 2022-03-17T15:21:52.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:51.518659+0000 mon.smithi061 (mon.0) 153 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:21:52.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:21:51.519796+0000 mgr.smithi061.kxplwz (mgr.14164) 30 : cephadm [INF] Deploying daemon mgr.smithi067.rdualw on smithi067 2022-03-17T15:21:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:53.506481+0000 mgr.smithi061.kxplwz (mgr.14164) 31 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:21:55.545 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:21:55.546 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":1,"fsid":"ae1b9b88-a605-11ec-8c35-001a4aab830c","modified":"2022-03-17T15:20:05.621514Z","created":"2022-03-17T15:20:05.621514Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi061","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:3300","nonce":0},{"type":"v1","addr":"172.21.15.61:6789","nonce":0}]},"addr":"172.21.15.61:6789/0","public_addr":"172.21.15.61:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-03-17T15:21:55.547 INFO:teuthology.orchestra.run.smithi067.stderr:dumped monmap epoch 1 2022-03-17T15:21:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:55.506867+0000 mgr.smithi061.kxplwz (mgr.14164) 32 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:21:56.848 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:55.542554+0000 mon.smithi061 (mon.0) 154 : audit [DBG] from='client.? 172.21.15.67:0/1767595018' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-03-17T15:21:58.438 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-03-17T15:21:58.438 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-03-17T15:21:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:57.307756+0000 mon.smithi061 (mon.0) 155 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:21:58.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:57.309109+0000 mon.smithi061 (mon.0) 156 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-03-17T15:21:58.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:21:57.310094+0000 mon.smithi061 (mon.0) 157 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:21:58.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:21:57.311205+0000 mgr.smithi061.kxplwz (mgr.14164) 33 : cephadm [INF] Deploying daemon mon.smithi067 on smithi067 2022-03-17T15:21:58.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:21:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:57.507267+0000 mgr.smithi061.kxplwz (mgr.14164) 34 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:21:59.507663+0000 mgr.smithi061.kxplwz (mgr.14164) 35 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:01.508126+0000 mgr.smithi061.kxplwz (mgr.14164) 36 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:03.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:03 smithi067 systemd[1]: Starting Ceph mon.smithi067 for ae1b9b88-a605-11ec-8c35-001a4aab830c... 2022-03-17T15:22:04.047 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:22:04.048 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":1,"fsid":"ae1b9b88-a605-11ec-8c35-001a4aab830c","modified":"2022-03-17T15:20:05.621514Z","created":"2022-03-17T15:20:05.621514Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi061","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:3300","nonce":0},{"type":"v1","addr":"172.21.15.61:6789","nonce":0}]},"addr":"172.21.15.61:6789/0","public_addr":"172.21.15.61:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2022-03-17T15:22:04.049 INFO:teuthology.orchestra.run.smithi067.stderr:dumped monmap epoch 1 2022-03-17T15:22:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:03.289892+0000 mon.smithi061 (mon.0) 158 : cluster [DBG] Standby manager daemon smithi067.rdualw started 2022-03-17T15:22:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:03.292001+0000 mon.smithi061 (mon.0) 159 : audit [DBG] from='mgr.? 172.21.15.67:0/925300981' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/crt"}]: dispatch 2022-03-17T15:22:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:03.293020+0000 mon.smithi061 (mon.0) 160 : audit [DBG] from='mgr.? 172.21.15.67:0/925300981' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-03-17T15:22:04.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:03.296180+0000 mon.smithi061 (mon.0) 161 : audit [DBG] from='mgr.? 172.21.15.67:0/925300981' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/key"}]: dispatch 2022-03-17T15:22:04.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:03.296749+0000 mon.smithi061 (mon.0) 162 : audit [DBG] from='mgr.? 172.21.15.67:0/925300981' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-03-17T15:22:04.246 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:03 smithi067 podman[32982]: 2022-03-17T15:22:04.246 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.093+0000 7eff1d838700 0 set uid:gid to 167:167 (ceph:ceph) 2022-03-17T15:22:04.247 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.093+0000 7eff1d838700 0 ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable), process ceph-mon, pid 7 2022-03-17T15:22:04.247 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.093+0000 7eff1d838700 0 pidfile_write: ignore empty --pid-file 2022-03-17T15:22:04.247 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.097+0000 7eff1d838700 0 load: jerasure load: lrc load: isa 2022-03-17T15:22:04.247 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: RocksDB version: 6.8.1 2022-03-17T15:22:04.247 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.248 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-03-17T15:22:04.248 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Compile date May 13 2021 2022-03-17T15:22:04.248 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: DB SUMMARY 2022-03-17T15:22:04.248 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.249 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: CURRENT file: CURRENT 2022-03-17T15:22:04.249 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.249 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: IDENTITY file: IDENTITY 2022-03-17T15:22:04.249 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.249 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2022-03-17T15:22:04.250 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.250 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi067/store.db dir, Total Num: 0, files: 2022-03-17T15:22:04.250 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.250 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi067/store.db: 000003.log size: 511 ; 2022-03-17T15:22:04.251 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.251 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.error_if_exists: 0 2022-03-17T15:22:04.251 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.create_if_missing: 0 2022-03-17T15:22:04.251 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.paranoid_checks: 1 2022-03-17T15:22:04.251 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.env: 0x560af9b9a1c0 2022-03-17T15:22:04.254 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.fs: Posix File System 2022-03-17T15:22:04.254 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.info_log: 0x560afb83d960 2022-03-17T15:22:04.254 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_file_opening_threads: 16 2022-03-17T15:22:04.255 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.statistics: (nil) 2022-03-17T15:22:04.255 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.use_fsync: 0 2022-03-17T15:22:04.255 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_log_file_size: 0 2022-03-17T15:22:04.255 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2022-03-17T15:22:04.255 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.log_file_time_to_roll: 0 2022-03-17T15:22:04.256 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.keep_log_file_num: 1000 2022-03-17T15:22:04.256 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.recycle_log_file_num: 0 2022-03-17T15:22:04.256 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.allow_fallocate: 1 2022-03-17T15:22:04.256 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.allow_mmap_reads: 0 2022-03-17T15:22:04.256 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.allow_mmap_writes: 0 2022-03-17T15:22:04.257 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.use_direct_reads: 0 2022-03-17T15:22:04.257 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-03-17T15:22:04.257 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.create_missing_column_families: 0 2022-03-17T15:22:04.257 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.db_log_dir: 2022-03-17T15:22:04.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi067/store.db 2022-03-17T15:22:04.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.table_cache_numshardbits: 6 2022-03-17T15:22:04.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_subcompactions: 1 2022-03-17T15:22:04.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_background_flushes: -1 2022-03-17T15:22:04.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.WAL_ttl_seconds: 0 2022-03-17T15:22:04.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.WAL_size_limit_MB: 0 2022-03-17T15:22:04.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-03-17T15:22:04.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2022-03-17T15:22:04.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.is_fd_close_on_exec: 1 2022-03-17T15:22:04.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.advise_random_on_open: 1 2022-03-17T15:22:04.260 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.db_write_buffer_size: 0 2022-03-17T15:22:04.260 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.write_buffer_manager: 0x560afc4b2030 2022-03-17T15:22:04.260 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2022-03-17T15:22:04.260 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-03-17T15:22:04.261 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2022-03-17T15:22:04.261 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.use_adaptive_mutex: 0 2022-03-17T15:22:04.261 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.rate_limiter: (nil) 2022-03-17T15:22:04.261 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-03-17T15:22:04.261 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.wal_recovery_mode: 2 2022-03-17T15:22:04.262 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.enable_thread_tracking: 0 2022-03-17T15:22:04.262 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.enable_pipelined_write: 0 2022-03-17T15:22:04.262 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.unordered_write: 0 2022-03-17T15:22:04.262 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2022-03-17T15:22:04.263 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-03-17T15:22:04.263 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2022-03-17T15:22:04.263 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2022-03-17T15:22:04.263 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.row_cache: None 2022-03-17T15:22:04.263 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.wal_filter: None 2022-03-17T15:22:04.264 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2022-03-17T15:22:04.264 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.allow_ingest_behind: 0 2022-03-17T15:22:04.264 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.preserve_deletes: 0 2022-03-17T15:22:04.264 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.two_write_queues: 0 2022-03-17T15:22:04.265 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.manual_wal_flush: 0 2022-03-17T15:22:04.265 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.atomic_flush: 0 2022-03-17T15:22:04.265 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-03-17T15:22:04.265 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.persist_stats_to_disk: 0 2022-03-17T15:22:04.265 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.write_dbid_to_manifest: 0 2022-03-17T15:22:04.266 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.log_readahead_size: 0 2022-03-17T15:22:04.266 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2022-03-17T15:22:04.266 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_background_jobs: 2 2022-03-17T15:22:04.266 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_background_compactions: -1 2022-03-17T15:22:04.266 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2022-03-17T15:22:04.267 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-03-17T15:22:04.267 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.delayed_write_rate : 16777216 2022-03-17T15:22:04.267 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_total_wal_size: 0 2022-03-17T15:22:04.267 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-03-17T15:22:04.268 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.stats_dump_period_sec: 600 2022-03-17T15:22:04.268 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.stats_persist_period_sec: 600 2022-03-17T15:22:04.268 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2022-03-17T15:22:04.268 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_open_files: -1 2022-03-17T15:22:04.268 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.bytes_per_sync: 0 2022-03-17T15:22:04.269 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.wal_bytes_per_sync: 0 2022-03-17T15:22:04.269 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.strict_bytes_per_sync: 0 2022-03-17T15:22:04.269 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compaction_readahead_size: 0 2022-03-17T15:22:04.269 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Compression algorithms supported: 2022-03-17T15:22:04.269 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2022-03-17T15:22:04.270 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: kZSTD supported: 0 2022-03-17T15:22:04.270 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: kXpressCompression supported: 0 2022-03-17T15:22:04.270 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: kLZ4HCCompression supported: 1 2022-03-17T15:22:04.270 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: kLZ4Compression supported: 1 2022-03-17T15:22:04.270 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: kBZip2Compression supported: 0 2022-03-17T15:22:04.271 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: kZlibCompression supported: 1 2022-03-17T15:22:04.271 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: kSnappyCompression supported: 1 2022-03-17T15:22:04.271 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Fast CRC32 supported: Supported on x86 2022-03-17T15:22:04.271 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi067/store.db/MANIFEST-000001 2022-03-17T15:22:04.272 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.272 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2022-03-17T15:22:04.272 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.272 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-03-17T15:22:04.272 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.merge_operator: 2022-03-17T15:22:04.273 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compaction_filter: None 2022-03-17T15:22:04.273 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compaction_filter_factory: None 2022-03-17T15:22:04.273 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.memtable_factory: SkipListFactory 2022-03-17T15:22:04.273 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.table_factory: BlockBasedTable 2022-03-17T15:22:04.273 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560afb754128) 2022-03-17T15:22:04.274 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cache_index_and_filter_blocks: 1 2022-03-17T15:22:04.274 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cache_index_and_filter_blocks_with_high_priority: 0 2022-03-17T15:22:04.274 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: pin_l0_filter_and_index_blocks_in_cache: 0 2022-03-17T15:22:04.274 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: pin_top_level_index_and_filter: 1 2022-03-17T15:22:04.274 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: index_type: 0 2022-03-17T15:22:04.275 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: data_block_index_type: 0 2022-03-17T15:22:04.275 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: index_shortening: 1 2022-03-17T15:22:04.275 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: data_block_hash_table_util_ratio: 0.750000 2022-03-17T15:22:04.275 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: hash_index_allow_collision: 1 2022-03-17T15:22:04.275 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: checksum: 1 2022-03-17T15:22:04.276 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: no_block_cache: 0 2022-03-17T15:22:04.276 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: block_cache: 0x560afb78af10 2022-03-17T15:22:04.276 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: block_cache_name: BinnedLRUCache 2022-03-17T15:22:04.276 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: block_cache_options: 2022-03-17T15:22:04.277 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: capacity : 536870912 2022-03-17T15:22:04.277 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: num_shard_bits : 4 2022-03-17T15:22:04.277 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: strict_capacity_limit : 0 2022-03-17T15:22:04.277 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: high_pri_pool_ratio: 0.000 2022-03-17T15:22:04.277 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: block_cache_compressed: (nil) 2022-03-17T15:22:04.278 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: persistent_cache: (nil) 2022-03-17T15:22:04.278 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: block_size: 4096 2022-03-17T15:22:04.278 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: block_size_deviation: 10 2022-03-17T15:22:04.278 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: block_restart_interval: 16 2022-03-17T15:22:04.278 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: index_block_restart_interval: 1 2022-03-17T15:22:04.279 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: metadata_block_size: 4096 2022-03-17T15:22:04.279 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: partition_filters: 0 2022-03-17T15:22:04.279 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: use_delta_encoding: 1 2022-03-17T15:22:04.279 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: filter_policy: rocksdb.BuiltinBloomFilter 2022-03-17T15:22:04.280 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: whole_key_filtering: 1 2022-03-17T15:22:04.280 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: verify_compression: 0 2022-03-17T15:22:04.280 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: read_amp_bytes_per_bit: 0 2022-03-17T15:22:04.281 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: format_version: 2 2022-03-17T15:22:04.281 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: enable_index_compression: 1 2022-03-17T15:22:04.281 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: block_align: 0 2022-03-17T15:22:04.281 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.282 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.write_buffer_size: 33554432 2022-03-17T15:22:04.282 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_write_buffer_number: 2 2022-03-17T15:22:04.282 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compression: NoCompression 2022-03-17T15:22:04.282 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.bottommost_compression: Disabled 2022-03-17T15:22:04.283 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.prefix_extractor: nullptr 2022-03-17T15:22:04.283 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-03-17T15:22:04.283 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.num_levels: 7 2022-03-17T15:22:04.283 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-03-17T15:22:04.284 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-03-17T15:22:04.284 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-03-17T15:22:04.284 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-03-17T15:22:04.284 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2022-03-17T15:22:04.285 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-03-17T15:22:04.285 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-03-17T15:22:04.285 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-03-17T15:22:04.286 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2022-03-17T15:22:04.286 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compression_opts.window_bits: -14 2022-03-17T15:22:04.286 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compression_opts.level: 32767 2022-03-17T15:22:04.286 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compression_opts.strategy: 0 2022-03-17T15:22:04.287 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-03-17T15:22:04.287 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-03-17T15:22:04.287 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compression_opts.enabled: false 2022-03-17T15:22:04.287 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-03-17T15:22:04.287 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-03-17T15:22:04.288 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2022-03-17T15:22:04.288 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.target_file_size_base: 67108864 2022-03-17T15:22:04.288 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.target_file_size_multiplier: 1 2022-03-17T15:22:04.289 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2022-03-17T15:22:04.289 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-03-17T15:22:04.289 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-03-17T15:22:04.289 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-03-17T15:22:04.290 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-03-17T15:22:04.290 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-03-17T15:22:04.290 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-03-17T15:22:04.290 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-03-17T15:22:04.291 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-03-17T15:22:04.291 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-03-17T15:22:04.291 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-03-17T15:22:04.291 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2022-03-17T15:22:04.292 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.arena_block_size: 4194304 2022-03-17T15:22:04.292 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-03-17T15:22:04.292 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-03-17T15:22:04.292 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-03-17T15:22:04.293 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.disable_auto_compactions: 0 2022-03-17T15:22:04.293 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-03-17T15:22:04.293 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-03-17T15:22:04.293 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-03-17T15:22:04.294 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-03-17T15:22:04.294 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-03-17T15:22:04.294 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-03-17T15:22:04.295 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-03-17T15:22:04.295 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-03-17T15:22:04.295 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-03-17T15:22:04.295 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-03-17T15:22:04.296 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.table_properties_collectors: 2022-03-17T15:22:04.296 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.inplace_update_support: 0 2022-03-17T15:22:04.296 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.inplace_update_num_locks: 10000 2022-03-17T15:22:04.296 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-03-17T15:22:04.297 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2022-03-17T15:22:04.297 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.memtable_huge_page_size: 0 2022-03-17T15:22:04.297 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.bloom_locality: 0 2022-03-17T15:22:04.297 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.max_successive_merges: 0 2022-03-17T15:22:04.298 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.optimize_filters_for_hits: 0 2022-03-17T15:22:04.298 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.paranoid_file_checks: 0 2022-03-17T15:22:04.298 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.force_consistency_checks: 0 2022-03-17T15:22:04.299 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.report_bg_io_stats: 0 2022-03-17T15:22:04.299 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.ttl: 2592000 2022-03-17T15:22:04.299 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.098+0000 7eff1d838700 4 rocksdb: Options.periodic_compaction_seconds: 0 2022-03-17T15:22:04.299 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.099+0000 7eff1d838700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi067/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-03-17T15:22:04.300 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.300 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.099+0000 7eff1d838700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2022-03-17T15:22:04.300 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.300 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.099+0000 7eff1d838700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1647530524101126, "job": 1, "event": "recovery_started", "log_files": [3]} 2022-03-17T15:22:04.301 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.099+0000 7eff1d838700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2022-03-17T15:22:04.301 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.099+0000 7eff1d838700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2022-03-17T15:22:04.301 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.100+0000 7eff1d838700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1647530524101622, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1647530524, "oldest_key_time": 3, "file_creation_time": 0}} 2022-03-17T15:22:04.302 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.100+0000 7eff1d838700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2022-03-17T15:22:04.302 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.302 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.100+0000 7eff1d838700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1647530524101996, "job": 1, "event": "recovery_finished"} 2022-03-17T15:22:04.302 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.101+0000 7eff1d838700 4 rocksdb: DB pointer 0x560afb84f800 2022-03-17T15:22:04.303 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.101+0000 7eff04650700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2022-03-17T15:22:04.303 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.101+0000 7eff04650700 4 rocksdb: [db_impl/db_impl.cc:851] 2022-03-17T15:22:04.303 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: ** DB Stats ** 2022-03-17T15:22:04.303 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Uptime(secs): 0.0 total, 0.0 interval 2022-03-17T15:22:04.304 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-03-17T15:22:04.304 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-03-17T15:22:04.304 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-03-17T15:22:04.304 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-03-17T15:22:04.305 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-03-17T15:22:04.305 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-03-17T15:22:04.305 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.305 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: ** Compaction Stats [default] ** 2022-03-17T15:22:04.306 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:22:04.306 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:22:04.306 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2022-03-17T15:22:04.307 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2022-03-17T15:22:04.307 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2022-03-17T15:22:04.307 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.307 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: ** Compaction Stats [default] ** 2022-03-17T15:22:04.307 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:22:04.308 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:22:04.308 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2022-03-17T15:22:04.308 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Uptime(secs): 0.0 total, 0.0 interval 2022-03-17T15:22:04.308 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Flush(GB): cumulative 0.000, interval 0.000 2022-03-17T15:22:04.309 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: AddFile(GB): cumulative 0.000, interval 0.000 2022-03-17T15:22:04.309 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: AddFile(Total Files): cumulative 0, interval 0 2022-03-17T15:22:04.309 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: AddFile(L0 Files): cumulative 0, interval 0 2022-03-17T15:22:04.309 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: AddFile(Keys): cumulative 0, interval 0 2022-03-17T15:22:04.310 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Cumulative compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:22:04.310 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Interval compaction: 0.00 GB write, 0.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:22:04.310 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-03-17T15:22:04.310 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.311 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: ** File Read Latency Histogram By Level [default] ** 2022-03-17T15:22:04.311 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.311 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: ** Compaction Stats [default] ** 2022-03-17T15:22:04.311 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:22:04.312 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:22:04.312 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2022-03-17T15:22:04.312 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2022-03-17T15:22:04.312 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-03-17T15:22:04.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: ** Compaction Stats [default] ** 2022-03-17T15:22:04.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:22:04.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:22:04.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.0 0.00 0.00 1 0.000 0 0 2022-03-17T15:22:04.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Uptime(secs): 0.0 total, 0.0 interval 2022-03-17T15:22:04.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Flush(GB): cumulative 0.000, interval 0.000 2022-03-17T15:22:04.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: AddFile(GB): cumulative 0.000, interval 0.000 2022-03-17T15:22:04.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: AddFile(Total Files): cumulative 0, interval 0 2022-03-17T15:22:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: AddFile(L0 Files): cumulative 0, interval 0 2022-03-17T15:22:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: AddFile(Keys): cumulative 0, interval 0 2022-03-17T15:22:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Cumulative compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:22:04.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:22:04.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-03-17T15:22:04.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: ** File Read Latency Histogram By Level [default] ** 2022-03-17T15:22:04.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.101+0000 7eff1d838700 0 mon.smithi067 does not exist in monmap, will attempt to join an existing cluster 2022-03-17T15:22:04.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.101+0000 7eff1d838700 0 using public_addr v2:172.21.15.67:0/0 -> [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2022-03-17T15:22:04.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.102+0000 7eff1d838700 0 starting mon.smithi067 rank -1 at public addrs [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] at bind addrs [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi067 fsid ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:22:04.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.103+0000 7eff1d838700 1 mon.smithi067@-1(???) e0 preinit fsid ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:22:04.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 bash[32982]: 6ba46ec348eda84815ced8a4f46248ccedcdbbc7cb655f5d64424917e553b29c 2022-03-17T15:22:04.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.126+0000 7eff06e55700 0 mon.smithi067@-1(synchronizing).mds e1 new map 2022-03-17T15:22:04.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.126+0000 7eff06e55700 0 mon.smithi067@-1(synchronizing).mds e1 print_map 2022-03-17T15:22:04.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: e1 2022-03-17T15:22:04.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: enable_multiple, ever_enabled_multiple: 1,1 2022-03-17T15:22:04.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-03-17T15:22:04.320 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: legacy client fscid: -1 2022-03-17T15:22:04.320 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.320 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: No filesystems configured 2022-03-17T15:22:04.320 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: 2022-03-17T15:22:04.320 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.126+0000 7eff06e55700 1 mon.smithi067@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2022-03-17T15:22:04.321 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.126+0000 7eff06e55700 1 mon.smithi067@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2022-03-17T15:22:04.321 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.126+0000 7eff06e55700 1 mon.smithi067@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2022-03-17T15:22:04.321 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.126+0000 7eff06e55700 1 mon.smithi067@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2022-03-17T15:22:04.322 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.126+0000 7eff06e55700 1 mon.smithi067@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2022-03-17T15:22:04.322 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.126+0000 7eff06e55700 1 mon.smithi067@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2022-03-17T15:22:04.322 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.126+0000 7eff06e55700 1 mon.smithi067@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2022-03-17T15:22:04.323 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.127+0000 7eff06e55700 0 mon.smithi067@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2022-03-17T15:22:04.323 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.127+0000 7eff06e55700 0 mon.smithi067@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2022-03-17T15:22:04.323 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.127+0000 7eff06e55700 0 mon.smithi067@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2022-03-17T15:22:04.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.127+0000 7eff06e55700 0 mon.smithi067@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2022-03-17T15:22:04.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:03.289892+0000 mon.smithi061 (mon.0) 158 : cluster [DBG] Standby manager daemon smithi067.rdualw started 2022-03-17T15:22:04.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:03.292001+0000 mon.smithi061 (mon.0) 159 : audit [DBG] from='mgr.? 172.21.15.67:0/925300981' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/crt"}]: dispatch 2022-03-17T15:22:04.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:03.293020+0000 mon.smithi061 (mon.0) 160 : audit [DBG] from='mgr.? 172.21.15.67:0/925300981' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-03-17T15:22:04.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:03.296180+0000 mon.smithi061 (mon.0) 161 : audit [DBG] from='mgr.? 172.21.15.67:0/925300981' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/key"}]: dispatch 2022-03-17T15:22:04.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:03.296749+0000 mon.smithi061 (mon.0) 162 : audit [DBG] from='mgr.? 172.21.15.67:0/925300981' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-03-17T15:22:04.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:22:04.127+0000 7eff06e55700 1 mon.smithi067@-1(synchronizing).paxosservice(auth 1..7) refresh upgraded, format 0 -> 3 2022-03-17T15:22:04.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:04 smithi067 systemd[1]: Started Ceph mon.smithi067 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:22:05.512 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2022-03-17T15:22:05.512 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph mon dump -f json 2022-03-17T15:22:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:03.508454+0000 mgr.smithi061.kxplwz (mgr.14164) 37 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:09.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:04.136220+0000 mon.smithi061 (mon.0) 167 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi061"}]: dispatch 2022-03-17T15:22:09.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:04.136449+0000 mon.smithi061 (mon.0) 168 : cluster [INF] mon.smithi061 calling monitor election 2022-03-17T15:22:09.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:04.149145+0000 mon.smithi061 (mon.0) 169 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:22:09.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:05.133091+0000 mon.smithi061 (mon.0) 170 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:22:09.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:05.508742+0000 mgr.smithi061.kxplwz (mgr.14164) 38 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:09.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:06.133197+0000 mon.smithi061 (mon.0) 171 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:22:09.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:06.134344+0000 mon.smithi067 (mon.1) 1 : cluster [INF] mon.smithi067 calling monitor election 2022-03-17T15:22:09.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:07.133014+0000 mon.smithi061 (mon.0) 172 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:22:09.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:07.509039+0000 mgr.smithi061.kxplwz (mgr.14164) 39 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:09.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:07.683165+0000 mon.smithi061 (mon.0) 173 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:22:09.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:07.685562+0000 mon.smithi061 (mon.0) 174 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:22:09.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:08.133557+0000 mon.smithi061 (mon.0) 175 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:22:09.556 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:09.133425+0000 mon.smithi061 (mon.0) 176 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:22:09.556 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:09.163173+0000 mon.smithi061 (mon.0) 177 : cluster [INF] mon.smithi061 is new leader, mons smithi061,smithi067 in quorum (ranks 0,1) 2022-03-17T15:22:09.556 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:09.171960+0000 mon.smithi061 (mon.0) 178 : cluster [DBG] monmap e2: 2 mons at {smithi061=[v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0],smithi067=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0]} 2022-03-17T15:22:09.556 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:09.172028+0000 mon.smithi061 (mon.0) 179 : cluster [DBG] fsmap 2022-03-17T15:22:09.557 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:09.172068+0000 mon.smithi061 (mon.0) 180 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2022-03-17T15:22:09.557 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:09.172462+0000 mon.smithi061 (mon.0) 181 : cluster [DBG] mgrmap e18: smithi061.kxplwz(active, since 61s), standbys: smithi067.rdualw 2022-03-17T15:22:09.557 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:09.178045+0000 mon.smithi061 (mon.0) 182 : cluster [INF] overall HEALTH_OK 2022-03-17T15:22:09.557 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:09.181561+0000 mon.smithi061 (mon.0) 183 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:03.508454+0000 mgr.smithi061.kxplwz (mgr.14164) 37 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:09.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:04.136220+0000 mon.smithi061 (mon.0) 167 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi061"}]: dispatch 2022-03-17T15:22:09.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:04.136449+0000 mon.smithi061 (mon.0) 168 : cluster [INF] mon.smithi061 calling monitor election 2022-03-17T15:22:09.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:04.149145+0000 mon.smithi061 (mon.0) 169 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:22:09.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:05.133091+0000 mon.smithi061 (mon.0) 170 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:22:09.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:05.508742+0000 mgr.smithi061.kxplwz (mgr.14164) 38 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:09.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:06.133197+0000 mon.smithi061 (mon.0) 171 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:22:09.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:06.134344+0000 mon.smithi067 (mon.1) 1 : cluster [INF] mon.smithi067 calling monitor election 2022-03-17T15:22:09.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:07.133014+0000 mon.smithi061 (mon.0) 172 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:22:09.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:07.509039+0000 mgr.smithi061.kxplwz (mgr.14164) 39 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:09.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:07.683165+0000 mon.smithi061 (mon.0) 173 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:22:09.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:07.685562+0000 mon.smithi061 (mon.0) 174 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:22:09.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:08.133557+0000 mon.smithi061 (mon.0) 175 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:22:09.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:09.133425+0000 mon.smithi061 (mon.0) 176 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:22:09.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:09.163173+0000 mon.smithi061 (mon.0) 177 : cluster [INF] mon.smithi061 is new leader, mons smithi061,smithi067 in quorum (ranks 0,1) 2022-03-17T15:22:09.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:09.171960+0000 mon.smithi061 (mon.0) 178 : cluster [DBG] monmap e2: 2 mons at {smithi061=[v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0],smithi067=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0]} 2022-03-17T15:22:09.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:09.172028+0000 mon.smithi061 (mon.0) 179 : cluster [DBG] fsmap 2022-03-17T15:22:09.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:09.172068+0000 mon.smithi061 (mon.0) 180 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2022-03-17T15:22:09.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:09.172462+0000 mon.smithi061 (mon.0) 181 : cluster [DBG] mgrmap e18: smithi061.kxplwz(active, since 61s), standbys: smithi067.rdualw 2022-03-17T15:22:09.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:09.178045+0000 mon.smithi061 (mon.0) 182 : cluster [INF] overall HEALTH_OK 2022-03-17T15:22:09.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:09.181561+0000 mon.smithi061 (mon.0) 183 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:10.116 INFO:teuthology.orchestra.run.smithi067.stdout: 2022-03-17T15:22:10.116 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":2,"fsid":"ae1b9b88-a605-11ec-8c35-001a4aab830c","modified":"2022-03-17T15:22:04.133216Z","created":"2022-03-17T15:20:05.621514Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi061","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:3300","nonce":0},{"type":"v1","addr":"172.21.15.61:6789","nonce":0}]},"addr":"172.21.15.61:6789/0","public_addr":"172.21.15.61:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi067","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:3300","nonce":0},{"type":"v1","addr":"172.21.15.67:6789","nonce":0}]},"addr":"172.21.15.67:6789/0","public_addr":"172.21.15.67:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2022-03-17T15:22:10.117 INFO:teuthology.orchestra.run.smithi067.stderr:dumped monmap epoch 2 2022-03-17T15:22:10.405 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:09.182720+0000 mgr.smithi061.kxplwz (mgr.14164) 40 : cephadm [INF] Deploying daemon node-exporter.smithi067 on smithi067 2022-03-17T15:22:10.405 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:10.112019+0000 mon.smithi061 (mon.0) 184 : audit [DBG] from='client.? 172.21.15.67:0/2499711249' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-03-17T15:22:10.405 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:10.133403+0000 mon.smithi061 (mon.0) 185 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:22:10.472 INFO:tasks.cephadm:Generating final ceph.conf file... 2022-03-17T15:22:10.473 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph config generate-minimal-conf 2022-03-17T15:22:10.508 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:09.182720+0000 mgr.smithi061.kxplwz (mgr.14164) 40 : cephadm [INF] Deploying daemon node-exporter.smithi067 on smithi067 2022-03-17T15:22:10.509 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:10.112019+0000 mon.smithi061 (mon.0) 184 : audit [DBG] from='client.? 172.21.15.67:0/2499711249' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2022-03-17T15:22:10.509 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:10.133403+0000 mon.smithi061 (mon.0) 185 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:22:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:09.509329+0000 mgr.smithi061.kxplwz (mgr.14164) 41 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:09.509329+0000 mgr.smithi061.kxplwz (mgr.14164) 41 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:12.097 INFO:teuthology.orchestra.run.smithi061.stdout:# minimal ceph.conf for ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:22:12.098 INFO:teuthology.orchestra.run.smithi061.stdout:[global] 2022-03-17T15:22:12.098 INFO:teuthology.orchestra.run.smithi061.stdout: fsid = ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:22:12.098 INFO:teuthology.orchestra.run.smithi061.stdout: mon_host = [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] 2022-03-17T15:22:12.526 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2022-03-17T15:22:12.526 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2022-03-17T15:22:12.526 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd of=/etc/ceph/ceph.conf 2022-03-17T15:22:12.597 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2022-03-17T15:22:12.597 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2022-03-17T15:22:12.665 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2022-03-17T15:22:12.666 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.conf 2022-03-17T15:22:12.700 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2022-03-17T15:22:12.700 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2022-03-17T15:22:12.768 INFO:tasks.cephadm:Deploying OSDs... 2022-03-17T15:22:12.769 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2022-03-17T15:22:12.769 DEBUG:teuthology.orchestra.run.smithi061:> dd if=/scratch_devs of=/dev/stdout 2022-03-17T15:22:12.787 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-03-17T15:22:12.788 DEBUG:teuthology.orchestra.run.smithi061:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-03-17T15:22:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-03-17T15:22:12.847 INFO:teuthology.orchestra.run.smithi061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-17T15:22:12.847 INFO:teuthology.orchestra.run.smithi061.stdout:Device: 6h/6d Inode: 150493 Links: 1 2022-03-17T15:22:12.847 INFO:teuthology.orchestra.run.smithi061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-17T15:22:12.847 INFO:teuthology.orchestra.run.smithi061.stdout:Context: system_u:object_r:device_t:s0 2022-03-17T15:22:12.848 INFO:teuthology.orchestra.run.smithi061.stdout:Access: 2022-03-17 15:21:43.729224838 +0000 2022-03-17T15:22:12.848 INFO:teuthology.orchestra.run.smithi061.stdout:Modify: 2022-03-17 15:18:42.321311404 +0000 2022-03-17T15:22:12.848 INFO:teuthology.orchestra.run.smithi061.stdout:Change: 2022-03-17 15:18:42.321311404 +0000 2022-03-17T15:22:12.848 INFO:teuthology.orchestra.run.smithi061.stdout: Birth: - 2022-03-17T15:22:12.857 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records in 2022-03-17T15:22:12.858 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records out 2022-03-17T15:22:12.858 INFO:teuthology.orchestra.run.smithi061.stderr:512 bytes copied, 0.000322102 s, 1.6 MB/s 2022-03-17T15:22:12.861 DEBUG:teuthology.orchestra.run.smithi061:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-03-17T15:22:12.918 INFO:teuthology.orchestra.run.smithi061.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-03-17T15:22:12.918 INFO:teuthology.orchestra.run.smithi061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-17T15:22:12.918 INFO:teuthology.orchestra.run.smithi061.stdout:Device: 6h/6d Inode: 153123 Links: 1 2022-03-17T15:22:12.919 INFO:teuthology.orchestra.run.smithi061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-17T15:22:12.919 INFO:teuthology.orchestra.run.smithi061.stdout:Context: system_u:object_r:device_t:s0 2022-03-17T15:22:12.919 INFO:teuthology.orchestra.run.smithi061.stdout:Access: 2022-03-17 15:21:43.730224820 +0000 2022-03-17T15:22:12.919 INFO:teuthology.orchestra.run.smithi061.stdout:Modify: 2022-03-17 15:18:42.668305085 +0000 2022-03-17T15:22:12.919 INFO:teuthology.orchestra.run.smithi061.stdout:Change: 2022-03-17 15:18:42.668305085 +0000 2022-03-17T15:22:12.920 INFO:teuthology.orchestra.run.smithi061.stdout: Birth: - 2022-03-17T15:22:12.928 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records in 2022-03-17T15:22:12.928 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records out 2022-03-17T15:22:12.928 INFO:teuthology.orchestra.run.smithi061.stderr:512 bytes copied, 0.000229613 s, 2.2 MB/s 2022-03-17T15:22:12.931 DEBUG:teuthology.orchestra.run.smithi061:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-03-17T15:22:12.989 INFO:teuthology.orchestra.run.smithi061.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-03-17T15:22:12.990 INFO:teuthology.orchestra.run.smithi061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-17T15:22:12.990 INFO:teuthology.orchestra.run.smithi061.stdout:Device: 6h/6d Inode: 153258 Links: 1 2022-03-17T15:22:12.990 INFO:teuthology.orchestra.run.smithi061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-17T15:22:12.990 INFO:teuthology.orchestra.run.smithi061.stdout:Context: system_u:object_r:device_t:s0 2022-03-17T15:22:12.990 INFO:teuthology.orchestra.run.smithi061.stdout:Access: 2022-03-17 15:21:43.730224820 +0000 2022-03-17T15:22:12.991 INFO:teuthology.orchestra.run.smithi061.stdout:Modify: 2022-03-17 15:18:43.013298801 +0000 2022-03-17T15:22:12.991 INFO:teuthology.orchestra.run.smithi061.stdout:Change: 2022-03-17 15:18:43.013298801 +0000 2022-03-17T15:22:12.991 INFO:teuthology.orchestra.run.smithi061.stdout: Birth: - 2022-03-17T15:22:13.000 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records in 2022-03-17T15:22:13.000 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records out 2022-03-17T15:22:13.000 INFO:teuthology.orchestra.run.smithi061.stderr:512 bytes copied, 0.000269125 s, 1.9 MB/s 2022-03-17T15:22:13.003 DEBUG:teuthology.orchestra.run.smithi061:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-03-17T15:22:13.059 INFO:teuthology.orchestra.run.smithi061.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-03-17T15:22:13.060 INFO:teuthology.orchestra.run.smithi061.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-17T15:22:13.060 INFO:teuthology.orchestra.run.smithi061.stdout:Device: 6h/6d Inode: 155775 Links: 1 2022-03-17T15:22:13.060 INFO:teuthology.orchestra.run.smithi061.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-17T15:22:13.061 INFO:teuthology.orchestra.run.smithi061.stdout:Context: system_u:object_r:device_t:s0 2022-03-17T15:22:13.061 INFO:teuthology.orchestra.run.smithi061.stdout:Access: 2022-03-17 15:21:43.730224820 +0000 2022-03-17T15:22:13.061 INFO:teuthology.orchestra.run.smithi061.stdout:Modify: 2022-03-17 15:18:43.363292425 +0000 2022-03-17T15:22:13.061 INFO:teuthology.orchestra.run.smithi061.stdout:Change: 2022-03-17 15:18:43.363292425 +0000 2022-03-17T15:22:13.061 INFO:teuthology.orchestra.run.smithi061.stdout: Birth: - 2022-03-17T15:22:13.070 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records in 2022-03-17T15:22:13.070 INFO:teuthology.orchestra.run.smithi061.stderr:1+0 records out 2022-03-17T15:22:13.071 INFO:teuthology.orchestra.run.smithi061.stderr:512 bytes copied, 0.000175641 s, 2.9 MB/s 2022-03-17T15:22:13.073 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2022-03-17T15:22:13.074 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2022-03-17T15:22:13.093 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2022-03-17T15:22:13.093 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2022-03-17T15:22:13.149 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2022-03-17T15:22:13.150 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-17T15:22:13.150 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 155972 Links: 1 2022-03-17T15:22:13.150 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-17T15:22:13.150 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2022-03-17T15:22:13.151 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2022-03-17 15:22:09.836794563 +0000 2022-03-17T15:22:13.151 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2022-03-17 15:18:42.328016763 +0000 2022-03-17T15:22:13.151 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2022-03-17 15:18:42.328016763 +0000 2022-03-17T15:22:13.151 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2022-03-17T15:22:13.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2022-03-17T15:22:13.160 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2022-03-17T15:22:13.161 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000227415 s, 2.3 MB/s 2022-03-17T15:22:13.163 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2022-03-17T15:22:13.221 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2022-03-17T15:22:13.221 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-17T15:22:13.221 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 156804 Links: 1 2022-03-17T15:22:13.221 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-17T15:22:13.222 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2022-03-17T15:22:13.222 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2022-03-17 15:22:09.836794563 +0000 2022-03-17T15:22:13.222 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2022-03-17 15:18:42.688008861 +0000 2022-03-17T15:22:13.222 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2022-03-17 15:18:42.688008861 +0000 2022-03-17T15:22:13.222 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2022-03-17T15:22:13.233 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2022-03-17T15:22:13.233 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2022-03-17T15:22:13.233 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000210409 s, 2.4 MB/s 2022-03-17T15:22:13.236 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2022-03-17T15:22:13.295 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2022-03-17T15:22:13.295 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-17T15:22:13.296 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 156906 Links: 1 2022-03-17T15:22:13.296 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-17T15:22:13.296 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2022-03-17T15:22:13.296 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2022-03-17 15:22:09.836794563 +0000 2022-03-17T15:22:13.297 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2022-03-17 15:18:43.033001288 +0000 2022-03-17T15:22:13.297 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2022-03-17 15:18:43.033001288 +0000 2022-03-17T15:22:13.297 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2022-03-17T15:22:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:11.509556+0000 mgr.smithi061.kxplwz (mgr.14164) 42 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:12.079485+0000 mon.smithi061 (mon.0) 186 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:13.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:12.080252+0000 mon.smithi061 (mon.0) 187 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:22:13.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:12.095449+0000 mon.smithi061 (mon.0) 188 : audit [DBG] from='client.? 172.21.15.61:0/724514334' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:13.308 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2022-03-17T15:22:13.308 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2022-03-17T15:22:13.309 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000212688 s, 2.4 MB/s 2022-03-17T15:22:13.312 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2022-03-17T15:22:13.368 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2022-03-17T15:22:13.370 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2022-03-17T15:22:13.371 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 153136 Links: 1 2022-03-17T15:22:13.371 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2022-03-17T15:22:13.371 INFO:teuthology.orchestra.run.smithi067.stdout:Context: system_u:object_r:device_t:s0 2022-03-17T15:22:13.371 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2022-03-17 15:22:09.836794563 +0000 2022-03-17T15:22:13.372 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2022-03-17 15:18:43.368993913 +0000 2022-03-17T15:22:13.372 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2022-03-17 15:18:43.368993913 +0000 2022-03-17T15:22:13.372 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2022-03-17T15:22:13.376 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:11.509556+0000 mgr.smithi061.kxplwz (mgr.14164) 42 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:13.377 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:12.079485+0000 mon.smithi061 (mon.0) 186 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:13.377 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:12.080252+0000 mon.smithi061 (mon.0) 187 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:22:13.377 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:12.095449+0000 mon.smithi061 (mon.0) 188 : audit [DBG] from='client.? 172.21.15.61:0/724514334' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:13.379 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2022-03-17T15:22:13.379 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2022-03-17T15:22:13.379 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000159515 s, 3.2 MB/s 2022-03-17T15:22:13.382 INFO:tasks.cephadm:Deploying osd.0 on smithi061 with /dev/vg_nvme/lv_4... 2022-03-17T15:22:13.382 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2022-03-17T15:22:15.407 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:13.509818+0000 mgr.smithi061.kxplwz (mgr.14164) 43 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:15.407 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:14.203076+0000 mon.smithi061 (mon.0) 189 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:15.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:13.509818+0000 mgr.smithi061.kxplwz (mgr.14164) 43 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:15.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:14.203076+0000 mon.smithi061 (mon.0) 189 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:15.909 INFO:teuthology.orchestra.run.smithi061.stderr:--> Zapping: /dev/vg_nvme/lv_4 2022-03-17T15:22:15.909 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2022-03-17T15:22:15.910 INFO:teuthology.orchestra.run.smithi061.stderr: stderr: 10+0 records in 2022-03-17T15:22:15.910 INFO:teuthology.orchestra.run.smithi061.stderr:10+0 records out 2022-03-17T15:22:15.910 INFO:teuthology.orchestra.run.smithi061.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0110112 s, 952 MB/s 2022-03-17T15:22:15.910 INFO:teuthology.orchestra.run.smithi061.stderr:--> Zapping successful for: 2022-03-17T15:22:16.573 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi061:vg_nvme/lv_4 2022-03-17T15:22:17.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:15.510094+0000 mgr.smithi061.kxplwz (mgr.14164) 44 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:17.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:15.510094+0000 mgr.smithi061.kxplwz (mgr.14164) 44 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:17.510381+0000 mgr.smithi061.kxplwz (mgr.14164) 45 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:17.880329+0000 mon.smithi061 (mon.0) 190 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:18.288768+0000 mon.smithi061 (mon.0) 191 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:18.291030+0000 mon.smithi061 (mon.0) 192 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-03-17T15:22:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:18.291661+0000 mon.smithi061 (mon.0) 193 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-03-17T15:22:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:18.292298+0000 mon.smithi061 (mon.0) 194 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:19.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:18.623678+0000 mon.smithi061 (mon.0) 195 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-03-17T15:22:19.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:18.625420+0000 mon.smithi061 (mon.0) 196 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-03-17T15:22:19.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:18.626105+0000 mon.smithi061 (mon.0) 197 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:17.510381+0000 mgr.smithi061.kxplwz (mgr.14164) 45 : cluster [DBG] pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:19.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:17.880329+0000 mon.smithi061 (mon.0) 190 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:19.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:18.288768+0000 mon.smithi061 (mon.0) 191 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:19.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:18.291030+0000 mon.smithi061 (mon.0) 192 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-03-17T15:22:19.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:18.291661+0000 mon.smithi061 (mon.0) 193 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-03-17T15:22:19.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:18.292298+0000 mon.smithi061 (mon.0) 194 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:19.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:18.623678+0000 mon.smithi061 (mon.0) 195 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-03-17T15:22:19.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:18.625420+0000 mon.smithi061 (mon.0) 196 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-03-17T15:22:19.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:18.626105+0000 mon.smithi061 (mon.0) 197 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:18.290784+0000 mgr.smithi061.kxplwz (mgr.14164) 46 : cephadm [INF] Reconfiguring mon.smithi061 (unknown last config time)... 2022-03-17T15:22:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:18.293059+0000 mgr.smithi061.kxplwz (mgr.14164) 47 : cephadm [INF] Reconfiguring daemon mon.smithi061 on smithi061 2022-03-17T15:22:20.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:18.622782+0000 mgr.smithi061.kxplwz (mgr.14164) 48 : audit [DBG] from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi061:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:22:20.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:18.625168+0000 mgr.smithi061.kxplwz (mgr.14164) 49 : cephadm [INF] Applying service osd.None on host smithi061... 2022-03-17T15:22:20.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:19.603880+0000 mon.smithi061 (mon.0) 198 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:20.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:19.604611+0000 mon.smithi061 (mon.0) 199 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi061.kxplwz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-03-17T15:22:20.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:19.605306+0000 mon.smithi061 (mon.0) 200 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr services"}]: dispatch 2022-03-17T15:22:20.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:19.605870+0000 mon.smithi061 (mon.0) 201 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:20.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:18.290784+0000 mgr.smithi061.kxplwz (mgr.14164) 46 : cephadm [INF] Reconfiguring mon.smithi061 (unknown last config time)... 2022-03-17T15:22:20.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:18.293059+0000 mgr.smithi061.kxplwz (mgr.14164) 47 : cephadm [INF] Reconfiguring daemon mon.smithi061 on smithi061 2022-03-17T15:22:20.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:18.622782+0000 mgr.smithi061.kxplwz (mgr.14164) 48 : audit [DBG] from='client.14214 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi061:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:22:20.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:18.625168+0000 mgr.smithi061.kxplwz (mgr.14164) 49 : cephadm [INF] Applying service osd.None on host smithi061... 2022-03-17T15:22:20.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:19.603880+0000 mon.smithi061 (mon.0) 198 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:20.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:19.604611+0000 mon.smithi061 (mon.0) 199 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi061.kxplwz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-03-17T15:22:20.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:19.605306+0000 mon.smithi061 (mon.0) 200 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr services"}]: dispatch 2022-03-17T15:22:20.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:19.605870+0000 mon.smithi061 (mon.0) 201 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:21.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:19.510853+0000 mgr.smithi061.kxplwz (mgr.14164) 50 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:21.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:19.604366+0000 mgr.smithi061.kxplwz (mgr.14164) 51 : cephadm [INF] Reconfiguring mgr.smithi061.kxplwz (unknown last config time)... 2022-03-17T15:22:21.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:19.606365+0000 mgr.smithi061.kxplwz (mgr.14164) 52 : cephadm [INF] Reconfiguring daemon mgr.smithi061.kxplwz on smithi061 2022-03-17T15:22:21.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:19.510853+0000 mgr.smithi061.kxplwz (mgr.14164) 50 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:21.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:19.604366+0000 mgr.smithi061.kxplwz (mgr.14164) 51 : cephadm [INF] Reconfiguring mgr.smithi061.kxplwz (unknown last config time)... 2022-03-17T15:22:21.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:19.606365+0000 mgr.smithi061.kxplwz (mgr.14164) 52 : cephadm [INF] Reconfiguring daemon mgr.smithi061.kxplwz on smithi061 2022-03-17T15:22:22.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:20.971037+0000 mon.smithi061 (mon.0) 202 : audit [INF] from='client.? 172.21.15.61:0/506000201' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b8effeb-5d87-4a98-8050-a3f7147dbab5"}]: dispatch 2022-03-17T15:22:22.420 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:20.974760+0000 mon.smithi061 (mon.0) 203 : audit [INF] from='client.? 172.21.15.61:0/506000201' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b8effeb-5d87-4a98-8050-a3f7147dbab5"}]': finished 2022-03-17T15:22:22.420 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:20.974808+0000 mon.smithi061 (mon.0) 204 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2022-03-17T15:22:22.420 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:20.974899+0000 mon.smithi061 (mon.0) 205 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:22:22.421 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:21.405647+0000 mon.smithi061 (mon.0) 206 : audit [DBG] from='client.? 172.21.15.61:0/3002217720' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-03-17T15:22:22.421 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:20.971037+0000 mon.smithi061 (mon.0) 202 : audit [INF] from='client.? 172.21.15.61:0/506000201' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9b8effeb-5d87-4a98-8050-a3f7147dbab5"}]: dispatch 2022-03-17T15:22:22.422 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:20.974760+0000 mon.smithi061 (mon.0) 203 : audit [INF] from='client.? 172.21.15.61:0/506000201' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9b8effeb-5d87-4a98-8050-a3f7147dbab5"}]': finished 2022-03-17T15:22:22.422 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:20.974808+0000 mon.smithi061 (mon.0) 204 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2022-03-17T15:22:22.422 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:20.974899+0000 mon.smithi061 (mon.0) 205 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:22:22.422 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:21.405647+0000 mon.smithi061 (mon.0) 206 : audit [DBG] from='client.? 172.21.15.61:0/3002217720' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-03-17T15:22:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:21.511342+0000 mgr.smithi061.kxplwz (mgr.14164) 53 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:21.511342+0000 mgr.smithi061.kxplwz (mgr.14164) 53 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:25.293 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:23.511656+0000 mgr.smithi061.kxplwz (mgr.14164) 54 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:23.511656+0000 mgr.smithi061.kxplwz (mgr.14164) 54 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:26.705 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:25.337357+0000 mon.smithi061 (mon.0) 207 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:26.706 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:25.337936+0000 mgr.smithi061.kxplwz (mgr.14164) 55 : cephadm [INF] Reconfiguring alertmanager.smithi061 (dependencies changed)... 2022-03-17T15:22:26.706 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:25.340449+0000 mgr.smithi061.kxplwz (mgr.14164) 56 : cephadm [INF] Reconfiguring daemon alertmanager.smithi061 on smithi061 2022-03-17T15:22:26.706 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:25.511940+0000 mgr.smithi061.kxplwz (mgr.14164) 57 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:25.337357+0000 mon.smithi061 (mon.0) 207 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:26.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:25.337936+0000 mgr.smithi061.kxplwz (mgr.14164) 55 : cephadm [INF] Reconfiguring alertmanager.smithi061 (dependencies changed)... 2022-03-17T15:22:26.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:25.340449+0000 mgr.smithi061.kxplwz (mgr.14164) 56 : cephadm [INF] Reconfiguring daemon alertmanager.smithi061 on smithi061 2022-03-17T15:22:26.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:25.511940+0000 mgr.smithi061.kxplwz (mgr.14164) 57 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:27.602 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:26.743550+0000 mon.smithi061 (mon.0) 208 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2022-03-17T15:22:27.603 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:26.744192+0000 mon.smithi061 (mon.0) 209 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:27.603 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:26.744728+0000 mgr.smithi061.kxplwz (mgr.14164) 58 : cephadm [INF] Deploying daemon osd.0 on smithi061 2022-03-17T15:22:27.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:26.743550+0000 mon.smithi061 (mon.0) 208 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2022-03-17T15:22:27.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:26.744192+0000 mon.smithi061 (mon.0) 209 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:27.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:26.744728+0000 mgr.smithi061.kxplwz (mgr.14164) 58 : cephadm [INF] Deploying daemon osd.0 on smithi061 2022-03-17T15:22:28.756 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:27.512333+0000 mgr.smithi061.kxplwz (mgr.14164) 59 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:27.512333+0000 mgr.smithi061.kxplwz (mgr.14164) 59 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:30.594 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:29.388861+0000 mon.smithi061 (mon.0) 210 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:30.594 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:29.389338+0000 mgr.smithi061.kxplwz (mgr.14164) 60 : cephadm [INF] Reconfiguring crash.smithi061 (monmap changed)... 2022-03-17T15:22:30.594 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:29.389567+0000 mon.smithi061 (mon.0) 211 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi061", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-03-17T15:22:30.595 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:29.390281+0000 mon.smithi061 (mon.0) 212 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:30.595 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:29.390802+0000 mgr.smithi061.kxplwz (mgr.14164) 61 : cephadm [INF] Reconfiguring daemon crash.smithi061 on smithi061 2022-03-17T15:22:30.595 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:29.512604+0000 mgr.smithi061.kxplwz (mgr.14164) 62 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:29.388861+0000 mon.smithi061 (mon.0) 210 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:29.389338+0000 mgr.smithi061.kxplwz (mgr.14164) 60 : cephadm [INF] Reconfiguring crash.smithi061 (monmap changed)... 2022-03-17T15:22:30.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:29.389567+0000 mon.smithi061 (mon.0) 211 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi061", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-03-17T15:22:30.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:29.390281+0000 mon.smithi061 (mon.0) 212 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:30.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:29.390802+0000 mgr.smithi061.kxplwz (mgr.14164) 61 : cephadm [INF] Reconfiguring daemon crash.smithi061 on smithi061 2022-03-17T15:22:30.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:29.512604+0000 mgr.smithi061.kxplwz (mgr.14164) 62 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:32.079 INFO:teuthology.orchestra.run.smithi061.stdout:Created osd(s) 0 on host 'smithi061' 2022-03-17T15:22:32.708 DEBUG:teuthology.orchestra.run.smithi061:osd.0> sudo journalctl -f -n 0 -u ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service 2022-03-17T15:22:32.711 INFO:tasks.cephadm:Deploying osd.1 on smithi061 with /dev/vg_nvme/lv_3... 2022-03-17T15:22:32.711 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2022-03-17T15:22:32.750 INFO:journalctl@ceph.osd.0.smithi061.stdout:-- Logs begin at Thu 2022-03-17 15:13:33 UTC. -- 2022-03-17T15:22:33.451 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:31.512976+0000 mgr.smithi061.kxplwz (mgr.14164) 63 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:33.451 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:32.070931+0000 mon.smithi061 (mon.0) 213 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:33.451 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:32.075162+0000 mon.smithi061 (mon.0) 214 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:33.452 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:32.982438+0000 mon.smithi061 (mon.0) 215 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:33.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:31.512976+0000 mgr.smithi061.kxplwz (mgr.14164) 63 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:33.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:32.070931+0000 mon.smithi061 (mon.0) 213 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:33.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:32.075162+0000 mon.smithi061 (mon.0) 214 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:33.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:32.982438+0000 mon.smithi061 (mon.0) 215 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:34.424 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:32.982991+0000 mgr.smithi061.kxplwz (mgr.14164) 64 : cephadm [INF] Reconfiguring grafana.smithi061 (dependencies changed)... 2022-03-17T15:22:34.425 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:32.987375+0000 mgr.smithi061.kxplwz (mgr.14164) 65 : cephadm [INF] Reconfiguring daemon grafana.smithi061 on smithi061 2022-03-17T15:22:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:32.982991+0000 mgr.smithi061.kxplwz (mgr.14164) 64 : cephadm [INF] Reconfiguring grafana.smithi061 (dependencies changed)... 2022-03-17T15:22:34.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:32.987375+0000 mgr.smithi061.kxplwz (mgr.14164) 65 : cephadm [INF] Reconfiguring daemon grafana.smithi061 on smithi061 2022-03-17T15:22:34.938 INFO:teuthology.orchestra.run.smithi061.stderr:--> Zapping: /dev/vg_nvme/lv_3 2022-03-17T15:22:34.939 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2022-03-17T15:22:34.939 INFO:teuthology.orchestra.run.smithi061.stderr: stderr: 10+0 records in 2022-03-17T15:22:34.939 INFO:teuthology.orchestra.run.smithi061.stderr:10+0 records out 2022-03-17T15:22:34.940 INFO:teuthology.orchestra.run.smithi061.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.012916 s, 812 MB/s 2022-03-17T15:22:34.940 INFO:teuthology.orchestra.run.smithi061.stderr:--> Zapping successful for: 2022-03-17T15:22:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:33.513254+0000 mgr.smithi061.kxplwz (mgr.14164) 66 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:35.303 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:22:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.0[41623]: debug 2022-03-17T15:22:35.227+0000 7fafd1035080 -1 osd.0 0 log_to_monitors {default=true} 2022-03-17T15:22:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:33.513254+0000 mgr.smithi061.kxplwz (mgr.14164) 66 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:35.604 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi061:vg_nvme/lv_3 2022-03-17T15:22:36.191 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:35.231998+0000 mon.smithi061 (mon.0) 216 : audit [INF] from='osd.0 [v2:172.21.15.61:6802/1147946424,v1:172.21.15.61:6803/1147946424]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2022-03-17T15:22:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:35.231998+0000 mon.smithi061 (mon.0) 216 : audit [INF] from='osd.0 [v2:172.21.15.61:6802/1147946424,v1:172.21.15.61:6803/1147946424]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2022-03-17T15:22:37.096 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:22:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.0[41623]: debug 2022-03-17T15:22:37.091+0000 7fafc75a6700 -1 osd.0 0 waiting for initial osdmap 2022-03-17T15:22:37.097 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:35.513514+0000 mgr.smithi061.kxplwz (mgr.14164) 67 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:37.097 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:36.083616+0000 mon.smithi061 (mon.0) 217 : audit [INF] from='osd.0 [v2:172.21.15.61:6802/1147946424,v1:172.21.15.61:6803/1147946424]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2022-03-17T15:22:37.097 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:36.083675+0000 mon.smithi061 (mon.0) 218 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2022-03-17T15:22:37.098 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:36.083771+0000 mon.smithi061 (mon.0) 219 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:22:37.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:36.084131+0000 mon.smithi061 (mon.0) 220 : audit [INF] from='osd.0 [v2:172.21.15.61:6802/1147946424,v1:172.21.15.61:6803/1147946424]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]: dispatch 2022-03-17T15:22:37.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:36.656131+0000 mon.smithi061 (mon.0) 221 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:37.475 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:22:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.0[41623]: debug 2022-03-17T15:22:37.097+0000 7fafc1d1e700 -1 osd.0 8 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2022-03-17T15:22:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:35.513514+0000 mgr.smithi061.kxplwz (mgr.14164) 67 : cluster [DBG] pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:37.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:36.083616+0000 mon.smithi061 (mon.0) 217 : audit [INF] from='osd.0 [v2:172.21.15.61:6802/1147946424,v1:172.21.15.61:6803/1147946424]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2022-03-17T15:22:37.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:36.083675+0000 mon.smithi061 (mon.0) 218 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2022-03-17T15:22:37.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:36.083771+0000 mon.smithi061 (mon.0) 219 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:22:37.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:36.084131+0000 mon.smithi061 (mon.0) 220 : audit [INF] from='osd.0 [v2:172.21.15.61:6802/1147946424,v1:172.21.15.61:6803/1147946424]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]: dispatch 2022-03-17T15:22:37.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:36.656131+0000 mon.smithi061 (mon.0) 221 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:38.376 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:36.656842+0000 mgr.smithi061.kxplwz (mgr.14164) 68 : cephadm [INF] Reconfiguring prometheus.smithi061 (dependencies changed)... 2022-03-17T15:22:38.376 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:36.659198+0000 mgr.smithi061.kxplwz (mgr.14164) 69 : cephadm [INF] Reconfiguring daemon prometheus.smithi061 on smithi061 2022-03-17T15:22:38.377 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:37.090200+0000 mon.smithi061 (mon.0) 222 : audit [INF] from='osd.0 [v2:172.21.15.61:6802/1147946424,v1:172.21.15.61:6803/1147946424]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]': finished 2022-03-17T15:22:38.377 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:37.090303+0000 mon.smithi061 (mon.0) 223 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2022-03-17T15:22:38.377 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:37.090704+0000 mon.smithi061 (mon.0) 224 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:22:38.378 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:37.096333+0000 mon.smithi061 (mon.0) 225 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:22:38.378 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:37.558383+0000 mon.smithi061 (mon.0) 226 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-03-17T15:22:38.379 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:37.559723+0000 mon.smithi061 (mon.0) 227 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-03-17T15:22:38.379 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:37.560322+0000 mon.smithi061 (mon.0) 228 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:36.656842+0000 mgr.smithi061.kxplwz (mgr.14164) 68 : cephadm [INF] Reconfiguring prometheus.smithi061 (dependencies changed)... 2022-03-17T15:22:38.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:36.659198+0000 mgr.smithi061.kxplwz (mgr.14164) 69 : cephadm [INF] Reconfiguring daemon prometheus.smithi061 on smithi061 2022-03-17T15:22:38.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:37.090200+0000 mon.smithi061 (mon.0) 222 : audit [INF] from='osd.0 [v2:172.21.15.61:6802/1147946424,v1:172.21.15.61:6803/1147946424]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]': finished 2022-03-17T15:22:38.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:37.090303+0000 mon.smithi061 (mon.0) 223 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2022-03-17T15:22:38.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:37.090704+0000 mon.smithi061 (mon.0) 224 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:22:38.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:37.096333+0000 mon.smithi061 (mon.0) 225 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:22:38.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:37.558383+0000 mon.smithi061 (mon.0) 226 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-03-17T15:22:38.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:37.559723+0000 mon.smithi061 (mon.0) 227 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-03-17T15:22:38.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:37.560322+0000 mon.smithi061 (mon.0) 228 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:39.124 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:36.232667+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2022-03-17T15:22:39.125 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:36.232768+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2022-03-17T15:22:39.125 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:37.513750+0000 mgr.smithi061.kxplwz (mgr.14164) 70 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:39.125 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:37.557599+0000 mgr.smithi061.kxplwz (mgr.14164) 71 : audit [DBG] from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi061:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:22:39.125 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:37.559535+0000 mgr.smithi061.kxplwz (mgr.14164) 72 : cephadm [INF] Applying service osd.None on host smithi061... 2022-03-17T15:22:39.126 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:38.093986+0000 mon.smithi061 (mon.0) 229 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:22:39.126 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:38.101098+0000 mon.smithi061 (mon.0) 230 : cluster [INF] osd.0 [v2:172.21.15.61:6802/1147946424,v1:172.21.15.61:6803/1147946424] boot 2022-03-17T15:22:39.126 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:38.101132+0000 mon.smithi061 (mon.0) 231 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2022-03-17T15:22:39.127 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:38.101598+0000 mon.smithi061 (mon.0) 232 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:22:39.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:36.232667+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2022-03-17T15:22:39.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:36.232768+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2022-03-17T15:22:39.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:37.513750+0000 mgr.smithi061.kxplwz (mgr.14164) 70 : cluster [DBG] pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2022-03-17T15:22:39.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:37.557599+0000 mgr.smithi061.kxplwz (mgr.14164) 71 : audit [DBG] from='client.14232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi061:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:22:39.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:37.559535+0000 mgr.smithi061.kxplwz (mgr.14164) 72 : cephadm [INF] Applying service osd.None on host smithi061... 2022-03-17T15:22:39.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:38.093986+0000 mon.smithi061 (mon.0) 229 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:22:39.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:38.101098+0000 mon.smithi061 (mon.0) 230 : cluster [INF] osd.0 [v2:172.21.15.61:6802/1147946424,v1:172.21.15.61:6803/1147946424] boot 2022-03-17T15:22:39.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:38.101132+0000 mon.smithi061 (mon.0) 231 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2022-03-17T15:22:39.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:38.101598+0000 mon.smithi061 (mon.0) 232 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:22:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:39.101637+0000 mon.smithi061 (mon.0) 233 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2022-03-17T15:22:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:40.077674+0000 mon.smithi061 (mon.0) 234 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:40.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:40.078444+0000 mon.smithi061 (mon.0) 235 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-03-17T15:22:40.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:40.079141+0000 mon.smithi061 (mon.0) 236 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:40.546 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:39.101637+0000 mon.smithi061 (mon.0) 233 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2022-03-17T15:22:40.547 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:40.077674+0000 mon.smithi061 (mon.0) 234 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:40.547 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:40.078444+0000 mon.smithi061 (mon.0) 235 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-03-17T15:22:40.547 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:40.079141+0000 mon.smithi061 (mon.0) 236 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:39.514032+0000 mgr.smithi061.kxplwz (mgr.14164) 73 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:41.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:40.078209+0000 mgr.smithi061.kxplwz (mgr.14164) 74 : cephadm [INF] Reconfiguring crash.smithi067 (monmap changed)... 2022-03-17T15:22:41.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:40.079644+0000 mgr.smithi061.kxplwz (mgr.14164) 75 : cephadm [INF] Reconfiguring daemon crash.smithi067 on smithi067 2022-03-17T15:22:41.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:41.060538+0000 mon.smithi061 (mon.0) 237 : audit [INF] from='client.? 172.21.15.61:0/4050106331' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91b2c37f-7a12-403d-8e52-790abd3686e9"}]: dispatch 2022-03-17T15:22:41.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:41.064568+0000 mon.smithi061 (mon.0) 238 : audit [INF] from='client.? 172.21.15.61:0/4050106331' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91b2c37f-7a12-403d-8e52-790abd3686e9"}]': finished 2022-03-17T15:22:41.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:41.064613+0000 mon.smithi061 (mon.0) 239 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2022-03-17T15:22:41.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:41.064715+0000 mon.smithi061 (mon.0) 240 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:22:41.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:39.514032+0000 mgr.smithi061.kxplwz (mgr.14164) 73 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:41.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:40.078209+0000 mgr.smithi061.kxplwz (mgr.14164) 74 : cephadm [INF] Reconfiguring crash.smithi067 (monmap changed)... 2022-03-17T15:22:41.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:40.079644+0000 mgr.smithi061.kxplwz (mgr.14164) 75 : cephadm [INF] Reconfiguring daemon crash.smithi067 on smithi067 2022-03-17T15:22:41.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:41.060538+0000 mon.smithi061 (mon.0) 237 : audit [INF] from='client.? 172.21.15.61:0/4050106331' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "91b2c37f-7a12-403d-8e52-790abd3686e9"}]: dispatch 2022-03-17T15:22:41.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:41.064568+0000 mon.smithi061 (mon.0) 238 : audit [INF] from='client.? 172.21.15.61:0/4050106331' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "91b2c37f-7a12-403d-8e52-790abd3686e9"}]': finished 2022-03-17T15:22:41.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:41.064613+0000 mon.smithi061 (mon.0) 239 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2022-03-17T15:22:41.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:41.064715+0000 mon.smithi061 (mon.0) 240 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:22:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:41.178938+0000 mon.smithi061 (mon.0) 241 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:42.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:41.179452+0000 mgr.smithi061.kxplwz (mgr.14164) 76 : cephadm [INF] Reconfiguring mgr.smithi067.rdualw (monmap changed)... 2022-03-17T15:22:42.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:41.179707+0000 mon.smithi061 (mon.0) 242 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.rdualw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-03-17T15:22:42.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:41.180472+0000 mon.smithi061 (mon.0) 243 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr services"}]: dispatch 2022-03-17T15:22:42.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:41.181067+0000 mon.smithi061 (mon.0) 244 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:42.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:41.181607+0000 mgr.smithi061.kxplwz (mgr.14164) 77 : cephadm [INF] Reconfiguring daemon mgr.smithi067.rdualw on smithi067 2022-03-17T15:22:42.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:41.486196+0000 mon.smithi061 (mon.0) 245 : audit [DBG] from='client.? 172.21.15.61:0/3795399178' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-03-17T15:22:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:41.178938+0000 mon.smithi061 (mon.0) 241 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:41.179452+0000 mgr.smithi061.kxplwz (mgr.14164) 76 : cephadm [INF] Reconfiguring mgr.smithi067.rdualw (monmap changed)... 2022-03-17T15:22:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:41.179707+0000 mon.smithi061 (mon.0) 242 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.rdualw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-03-17T15:22:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:41.180472+0000 mon.smithi061 (mon.0) 243 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr services"}]: dispatch 2022-03-17T15:22:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:41.181067+0000 mon.smithi061 (mon.0) 244 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:41.181607+0000 mgr.smithi061.kxplwz (mgr.14164) 77 : cephadm [INF] Reconfiguring daemon mgr.smithi067.rdualw on smithi067 2022-03-17T15:22:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:41.486196+0000 mon.smithi061 (mon.0) 245 : audit [DBG] from='client.? 172.21.15.61:0/3795399178' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-03-17T15:22:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:41.514301+0000 mgr.smithi061.kxplwz (mgr.14164) 78 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:42.272682+0000 mon.smithi061 (mon.0) 246 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:43.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:42.273630+0000 mon.smithi061 (mon.0) 247 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-03-17T15:22:43.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:42.274515+0000 mon.smithi061 (mon.0) 248 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-03-17T15:22:43.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:42.275363+0000 mon.smithi061 (mon.0) 249 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:43.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:41.514301+0000 mgr.smithi061.kxplwz (mgr.14164) 78 : cluster [DBG] pgmap v47: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:43.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:42.272682+0000 mon.smithi061 (mon.0) 246 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:43.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:42.273630+0000 mon.smithi061 (mon.0) 247 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-03-17T15:22:43.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:42.274515+0000 mon.smithi061 (mon.0) 248 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-03-17T15:22:43.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:42.275363+0000 mon.smithi061 (mon.0) 249 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:42.273342+0000 mgr.smithi061.kxplwz (mgr.14164) 79 : cephadm [INF] Reconfiguring mon.smithi067 (monmap changed)... 2022-03-17T15:22:44.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:42.276104+0000 mgr.smithi061.kxplwz (mgr.14164) 80 : cephadm [INF] Reconfiguring daemon mon.smithi067 on smithi067 2022-03-17T15:22:44.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:43.265277+0000 mon.smithi061 (mon.0) 250 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:44.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:43.268601+0000 mon.smithi061 (mon.0) 251 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2022-03-17T15:22:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:42.273342+0000 mgr.smithi061.kxplwz (mgr.14164) 79 : cephadm [INF] Reconfiguring mon.smithi067 (monmap changed)... 2022-03-17T15:22:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:42.276104+0000 mgr.smithi061.kxplwz (mgr.14164) 80 : cephadm [INF] Reconfiguring daemon mon.smithi067 on smithi067 2022-03-17T15:22:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:43.265277+0000 mon.smithi061 (mon.0) 250 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:44.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:43.268601+0000 mon.smithi061 (mon.0) 251 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2022-03-17T15:22:45.421 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:43.269061+0000 mgr.smithi061.kxplwz (mgr.14164) 81 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2022-03-17T15:22:45.421 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:43.514703+0000 mgr.smithi061.kxplwz (mgr.14164) 82 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:45.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:43.269061+0000 mgr.smithi061.kxplwz (mgr.14164) 81 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2022-03-17T15:22:45.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:43.514703+0000 mgr.smithi061.kxplwz (mgr.14164) 82 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:47.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:45.515015+0000 mgr.smithi061.kxplwz (mgr.14164) 83 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:47.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:46.280513+0000 mon.smithi061 (mon.0) 252 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2022-03-17T15:22:47.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:46.281178+0000 mon.smithi061 (mon.0) 253 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:47.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:45.515015+0000 mgr.smithi061.kxplwz (mgr.14164) 83 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:47.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:46.280513+0000 mon.smithi061 (mon.0) 252 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2022-03-17T15:22:47.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:46.281178+0000 mon.smithi061 (mon.0) 253 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:48.420 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:46.281719+0000 mgr.smithi061.kxplwz (mgr.14164) 84 : cephadm [INF] Deploying daemon osd.1 on smithi061 2022-03-17T15:22:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:46.281719+0000 mgr.smithi061.kxplwz (mgr.14164) 84 : cephadm [INF] Deploying daemon osd.1 on smithi061 2022-03-17T15:22:49.239 INFO:teuthology.orchestra.run.smithi061.stdout:Created osd(s) 1 on host 'smithi061' 2022-03-17T15:22:49.267 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:47.515336+0000 mgr.smithi061.kxplwz (mgr.14164) 85 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:47.515336+0000 mgr.smithi061.kxplwz (mgr.14164) 85 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:49.626 DEBUG:teuthology.orchestra.run.smithi061:osd.1> sudo journalctl -f -n 0 -u ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.1.service 2022-03-17T15:22:49.629 INFO:tasks.cephadm:Deploying osd.2 on smithi061 with /dev/vg_nvme/lv_2... 2022-03-17T15:22:49.629 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2022-03-17T15:22:49.662 INFO:journalctl@ceph.osd.1.smithi061.stdout:-- Logs begin at Thu 2022-03-17 15:13:33 UTC. -- 2022-03-17T15:22:50.052 INFO:journalctl@ceph.osd.1.smithi061.stdout:Mar 17 15:22:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.1[44693]: debug 2022-03-17T15:22:49.694+0000 7fc40caf6080 -1 Falling back to public interface 2022-03-17T15:22:50.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:49.231748+0000 mon.smithi061 (mon.0) 254 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:50.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:49.235362+0000 mon.smithi061 (mon.0) 255 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:50.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:49.250722+0000 mon.smithi061 (mon.0) 256 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.61:9093"}]: dispatch 2022-03-17T15:22:50.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:49.254817+0000 mon.smithi061 (mon.0) 257 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:50.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:49.258648+0000 mon.smithi061 (mon.0) 258 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2022-03-17T15:22:50.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:49.264802+0000 mon.smithi061 (mon.0) 259 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.61:3000"}]: dispatch 2022-03-17T15:22:50.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:49.269090+0000 mon.smithi061 (mon.0) 260 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:50.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:49.272935+0000 mon.smithi061 (mon.0) 261 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2022-03-17T15:22:50.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:49.278992+0000 mon.smithi061 (mon.0) 262 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.61:9095"}]: dispatch 2022-03-17T15:22:50.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:49.285138+0000 mon.smithi061 (mon.0) 263 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:50.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:49.287877+0000 mon.smithi061 (mon.0) 264 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:22:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:49.231748+0000 mon.smithi061 (mon.0) 254 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:49.235362+0000 mon.smithi061 (mon.0) 255 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:49.250722+0000 mon.smithi061 (mon.0) 256 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.61:9093"}]: dispatch 2022-03-17T15:22:50.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:49.254817+0000 mon.smithi061 (mon.0) 257 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:50.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:49.258648+0000 mon.smithi061 (mon.0) 258 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2022-03-17T15:22:50.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:49.264802+0000 mon.smithi061 (mon.0) 259 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.61:3000"}]: dispatch 2022-03-17T15:22:50.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:49.269090+0000 mon.smithi061 (mon.0) 260 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:50.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:49.272935+0000 mon.smithi061 (mon.0) 261 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2022-03-17T15:22:50.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:49.278992+0000 mon.smithi061 (mon.0) 262 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.61:9095"}]: dispatch 2022-03-17T15:22:50.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:49.285138+0000 mon.smithi061 (mon.0) 263 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:50.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:49.287877+0000 mon.smithi061 (mon.0) 264 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:22:51.297 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:49.251078+0000 mgr.smithi061.kxplwz (mgr.14164) 86 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.61:9093"}]: dispatch 2022-03-17T15:22:51.297 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:49.258970+0000 mgr.smithi061.kxplwz (mgr.14164) 87 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2022-03-17T15:22:51.298 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:49.265157+0000 mgr.smithi061.kxplwz (mgr.14164) 88 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.61:3000"}]: dispatch 2022-03-17T15:22:51.298 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:49.273307+0000 mgr.smithi061.kxplwz (mgr.14164) 89 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2022-03-17T15:22:51.298 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:49.279363+0000 mgr.smithi061.kxplwz (mgr.14164) 90 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.61:9095"}]: dispatch 2022-03-17T15:22:51.298 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:49.515622+0000 mgr.smithi061.kxplwz (mgr.14164) 91 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:51.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:49.251078+0000 mgr.smithi061.kxplwz (mgr.14164) 86 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.61:9093"}]: dispatch 2022-03-17T15:22:51.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:49.258970+0000 mgr.smithi061.kxplwz (mgr.14164) 87 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2022-03-17T15:22:51.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:49.265157+0000 mgr.smithi061.kxplwz (mgr.14164) 88 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.61:3000"}]: dispatch 2022-03-17T15:22:51.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:49.273307+0000 mgr.smithi061.kxplwz (mgr.14164) 89 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2022-03-17T15:22:51.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:49.279363+0000 mgr.smithi061.kxplwz (mgr.14164) 90 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.61:9095"}]: dispatch 2022-03-17T15:22:51.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:49.515622+0000 mgr.smithi061.kxplwz (mgr.14164) 91 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:51.762 INFO:teuthology.orchestra.run.smithi061.stderr:--> Zapping: /dev/vg_nvme/lv_2 2022-03-17T15:22:51.763 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2022-03-17T15:22:51.763 INFO:teuthology.orchestra.run.smithi061.stderr: stderr: 10+0 records in 2022-03-17T15:22:51.763 INFO:teuthology.orchestra.run.smithi061.stderr:10+0 records out 2022-03-17T15:22:51.764 INFO:teuthology.orchestra.run.smithi061.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0136971 s, 766 MB/s 2022-03-17T15:22:51.764 INFO:teuthology.orchestra.run.smithi061.stderr:--> Zapping successful for: 2022-03-17T15:22:52.218 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi061:vg_nvme/lv_2 2022-03-17T15:22:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:51.315821+0000 mon.smithi061 (mon.0) 265 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:52.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:51.515878+0000 mgr.smithi061.kxplwz (mgr.14164) 92 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:52.553 INFO:journalctl@ceph.osd.1.smithi061.stdout:Mar 17 15:22:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.1[44693]: debug 2022-03-17T15:22:52.449+0000 7fc40caf6080 -1 osd.1 0 log_to_monitors {default=true} 2022-03-17T15:22:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:51.315821+0000 mon.smithi061 (mon.0) 265 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:52.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:51.515878+0000 mgr.smithi061.kxplwz (mgr.14164) 92 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:53.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:52.453444+0000 mon.smithi061 (mon.0) 266 : audit [INF] from='osd.1 [v2:172.21.15.61:6810/2253612076,v1:172.21.15.61:6811/2253612076]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2022-03-17T15:22:53.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:52.453444+0000 mon.smithi061 (mon.0) 266 : audit [INF] from='osd.1 [v2:172.21.15.61:6810/2253612076,v1:172.21.15.61:6811/2253612076]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2022-03-17T15:22:54.802 INFO:journalctl@ceph.osd.1.smithi061.stdout:Mar 17 15:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.1[44693]: debug 2022-03-17T15:22:54.334+0000 7fc403067700 -1 osd.1 0 waiting for initial osdmap 2022-03-17T15:22:54.803 INFO:journalctl@ceph.osd.1.smithi061.stdout:Mar 17 15:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.1[44693]: debug 2022-03-17T15:22:54.337+0000 7fc3fefe2700 -1 osd.1 13 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2022-03-17T15:22:54.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:53.324807+0000 mon.smithi061 (mon.0) 267 : audit [INF] from='osd.1 [v2:172.21.15.61:6810/2253612076,v1:172.21.15.61:6811/2253612076]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2022-03-17T15:22:54.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:53.324881+0000 mon.smithi061 (mon.0) 268 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2022-03-17T15:22:54.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:53.324997+0000 mon.smithi061 (mon.0) 269 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:22:54.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:53.325361+0000 mon.smithi061 (mon.0) 270 : audit [INF] from='osd.1 [v2:172.21.15.61:6810/2253612076,v1:172.21.15.61:6811/2253612076]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]: dispatch 2022-03-17T15:22:54.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:53.516320+0000 mgr.smithi061.kxplwz (mgr.14164) 93 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:54.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:54.227967+0000 mgr.smithi061.kxplwz (mgr.14164) 94 : audit [DBG] from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi061:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:22:54.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:54.228761+0000 mon.smithi061 (mon.0) 271 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-03-17T15:22:54.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:22:54.229983+0000 mgr.smithi061.kxplwz (mgr.14164) 95 : cephadm [INF] Applying service osd.None on host smithi061... 2022-03-17T15:22:54.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:54.230203+0000 mon.smithi061 (mon.0) 272 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-03-17T15:22:54.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:54.230775+0000 mon.smithi061 (mon.0) 273 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:53.324807+0000 mon.smithi061 (mon.0) 267 : audit [INF] from='osd.1 [v2:172.21.15.61:6810/2253612076,v1:172.21.15.61:6811/2253612076]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2022-03-17T15:22:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:53.324881+0000 mon.smithi061 (mon.0) 268 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2022-03-17T15:22:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:53.324997+0000 mon.smithi061 (mon.0) 269 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:22:54.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:53.325361+0000 mon.smithi061 (mon.0) 270 : audit [INF] from='osd.1 [v2:172.21.15.61:6810/2253612076,v1:172.21.15.61:6811/2253612076]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]: dispatch 2022-03-17T15:22:54.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:53.516320+0000 mgr.smithi061.kxplwz (mgr.14164) 93 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:54.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:54.227967+0000 mgr.smithi061.kxplwz (mgr.14164) 94 : audit [DBG] from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi061:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:22:54.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:54.228761+0000 mon.smithi061 (mon.0) 271 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-03-17T15:22:54.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:22:54.229983+0000 mgr.smithi061.kxplwz (mgr.14164) 95 : cephadm [INF] Applying service osd.None on host smithi061... 2022-03-17T15:22:54.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:54.230203+0000 mon.smithi061 (mon.0) 272 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-03-17T15:22:54.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:54.230775+0000 mon.smithi061 (mon.0) 273 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:22:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:54.331795+0000 mon.smithi061 (mon.0) 274 : audit [INF] from='osd.1 [v2:172.21.15.61:6810/2253612076,v1:172.21.15.61:6811/2253612076]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]': finished 2022-03-17T15:22:55.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:54.331906+0000 mon.smithi061 (mon.0) 275 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2022-03-17T15:22:55.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:54.332347+0000 mon.smithi061 (mon.0) 276 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:22:55.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:54.336375+0000 mon.smithi061 (mon.0) 277 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:22:55.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:55.185806+0000 mon.smithi061 (mon.0) 278 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:55.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:54.331795+0000 mon.smithi061 (mon.0) 274 : audit [INF] from='osd.1 [v2:172.21.15.61:6810/2253612076,v1:172.21.15.61:6811/2253612076]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]': finished 2022-03-17T15:22:55.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:54.331906+0000 mon.smithi061 (mon.0) 275 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2022-03-17T15:22:55.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:54.332347+0000 mon.smithi061 (mon.0) 276 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:22:55.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:54.336375+0000 mon.smithi061 (mon.0) 277 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:22:55.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:55.185806+0000 mon.smithi061 (mon.0) 278 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:22:56.521 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:53.476537+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2022-03-17T15:22:56.521 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:53.476634+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2022-03-17T15:22:56.521 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:55.336806+0000 mon.smithi061 (mon.0) 279 : cluster [INF] osd.1 [v2:172.21.15.61:6810/2253612076,v1:172.21.15.61:6811/2253612076] boot 2022-03-17T15:22:56.521 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:55.336832+0000 mon.smithi061 (mon.0) 280 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2022-03-17T15:22:56.522 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:55.337127+0000 mon.smithi061 (mon.0) 281 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:22:56.522 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:55.516686+0000 mgr.smithi061.kxplwz (mgr.14164) 96 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:53.476537+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2022-03-17T15:22:56.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:53.476634+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2022-03-17T15:22:56.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:55.336806+0000 mon.smithi061 (mon.0) 279 : cluster [INF] osd.1 [v2:172.21.15.61:6810/2253612076,v1:172.21.15.61:6811/2253612076] boot 2022-03-17T15:22:56.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:55.336832+0000 mon.smithi061 (mon.0) 280 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2022-03-17T15:22:56.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:55.337127+0000 mon.smithi061 (mon.0) 281 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:22:56.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:55.516686+0000 mgr.smithi061.kxplwz (mgr.14164) 96 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2022-03-17T15:22:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:56.349095+0000 mon.smithi061 (mon.0) 282 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2022-03-17T15:22:57.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:56.676169+0000 mon.smithi061 (mon.0) 283 : audit [INF] from='client.? 172.21.15.61:0/2946055353' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d702a33b-2b25-424d-89ef-92f8352e2d83"}]: dispatch 2022-03-17T15:22:57.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:56.681310+0000 mon.smithi061 (mon.0) 284 : audit [INF] from='client.? 172.21.15.61:0/2946055353' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d702a33b-2b25-424d-89ef-92f8352e2d83"}]': finished 2022-03-17T15:22:57.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:56.681359+0000 mon.smithi061 (mon.0) 285 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2022-03-17T15:22:57.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:56.681459+0000 mon.smithi061 (mon.0) 286 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:22:57.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:22:57.125910+0000 mon.smithi061 (mon.0) 287 : audit [DBG] from='client.? 172.21.15.61:0/1307099542' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-03-17T15:22:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:56.349095+0000 mon.smithi061 (mon.0) 282 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2022-03-17T15:22:57.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:56.676169+0000 mon.smithi061 (mon.0) 283 : audit [INF] from='client.? 172.21.15.61:0/2946055353' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d702a33b-2b25-424d-89ef-92f8352e2d83"}]: dispatch 2022-03-17T15:22:57.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:56.681310+0000 mon.smithi061 (mon.0) 284 : audit [INF] from='client.? 172.21.15.61:0/2946055353' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d702a33b-2b25-424d-89ef-92f8352e2d83"}]': finished 2022-03-17T15:22:57.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:56.681359+0000 mon.smithi061 (mon.0) 285 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2022-03-17T15:22:57.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:56.681459+0000 mon.smithi061 (mon.0) 286 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:22:57.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:22:57.125910+0000 mon.smithi061 (mon.0) 287 : audit [DBG] from='client.? 172.21.15.61:0/1307099542' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-03-17T15:22:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:22:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:57.517029+0000 mgr.smithi061.kxplwz (mgr.14164) 97 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2022-03-17T15:22:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:22:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:57.517029+0000 mgr.smithi061.kxplwz (mgr.14164) 97 : cluster [DBG] pgmap v60: 0 pgs: ; 0 B data, 9.5 MiB used, 179 GiB / 179 GiB avail 2022-03-17T15:23:00.643 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:22:59.517310+0000 mgr.smithi061.kxplwz (mgr.14164) 98 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-03-17T15:23:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:22:59.517310+0000 mgr.smithi061.kxplwz (mgr.14164) 98 : cluster [DBG] pgmap v61: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-03-17T15:23:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:01.517571+0000 mgr.smithi061.kxplwz (mgr.14164) 99 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-03-17T15:23:03.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:23:01.779928+0000 mgr.smithi061.kxplwz (mgr.14164) 100 : cephadm [INF] Detected new or changed devices on smithi061 2022-03-17T15:23:03.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:01.784645+0000 mon.smithi061 (mon.0) 288 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:03.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:01.788932+0000 mon.smithi061 (mon.0) 289 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:03.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:01.791883+0000 mon.smithi061 (mon.0) 290 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:23:03.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:02.656217+0000 mon.smithi061 (mon.0) 291 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2022-03-17T15:23:03.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:02.656916+0000 mon.smithi061 (mon.0) 292 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:23:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:01.517571+0000 mgr.smithi061.kxplwz (mgr.14164) 99 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-03-17T15:23:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:23:01.779928+0000 mgr.smithi061.kxplwz (mgr.14164) 100 : cephadm [INF] Detected new or changed devices on smithi061 2022-03-17T15:23:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:01.784645+0000 mon.smithi061 (mon.0) 288 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:03.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:01.788932+0000 mon.smithi061 (mon.0) 289 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:03.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:01.791883+0000 mon.smithi061 (mon.0) 290 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:23:03.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:02.656217+0000 mon.smithi061 (mon.0) 291 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2022-03-17T15:23:03.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:02.656916+0000 mon.smithi061 (mon.0) 292 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:23:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:23:02.657480+0000 mgr.smithi061.kxplwz (mgr.14164) 101 : cephadm [INF] Deploying daemon osd.2 on smithi061 2022-03-17T15:23:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:23:02.657480+0000 mgr.smithi061.kxplwz (mgr.14164) 101 : cephadm [INF] Deploying daemon osd.2 on smithi061 2022-03-17T15:23:05.244 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:03.517946+0000 mgr.smithi061.kxplwz (mgr.14164) 102 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-03-17T15:23:05.244 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:03.909282+0000 mon.smithi061 (mon.0) 293 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:03.517946+0000 mgr.smithi061.kxplwz (mgr.14164) 102 : cluster [DBG] pgmap v63: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-03-17T15:23:05.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:03.909282+0000 mon.smithi061 (mon.0) 293 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:06.236 INFO:teuthology.orchestra.run.smithi061.stdout:Created osd(s) 2 on host 'smithi061' 2022-03-17T15:23:06.881 DEBUG:teuthology.orchestra.run.smithi061:osd.2> sudo journalctl -f -n 0 -u ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.2.service 2022-03-17T15:23:06.884 INFO:tasks.cephadm:Deploying osd.3 on smithi061 with /dev/vg_nvme/lv_1... 2022-03-17T15:23:06.884 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2022-03-17T15:23:06.914 INFO:journalctl@ceph.osd.2.smithi061.stdout:-- Logs begin at Thu 2022-03-17 15:13:33 UTC. -- 2022-03-17T15:23:07.486 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:05.518235+0000 mgr.smithi061.kxplwz (mgr.14164) 103 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-03-17T15:23:07.486 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:06.227543+0000 mon.smithi061 (mon.0) 294 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:07.487 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:06.232759+0000 mon.smithi061 (mon.0) 295 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:05.518235+0000 mgr.smithi061.kxplwz (mgr.14164) 103 : cluster [DBG] pgmap v64: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-03-17T15:23:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:06.227543+0000 mon.smithi061 (mon.0) 294 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:07.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:06.232759+0000 mon.smithi061 (mon.0) 295 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:08.912 INFO:teuthology.orchestra.run.smithi061.stderr:--> Zapping: /dev/vg_nvme/lv_1 2022-03-17T15:23:08.912 INFO:teuthology.orchestra.run.smithi061.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2022-03-17T15:23:08.913 INFO:teuthology.orchestra.run.smithi061.stderr: stderr: 10+0 records in 2022-03-17T15:23:08.913 INFO:teuthology.orchestra.run.smithi061.stderr:10+0 records out 2022-03-17T15:23:08.914 INFO:teuthology.orchestra.run.smithi061.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0143913 s, 729 MB/s 2022-03-17T15:23:08.914 INFO:teuthology.orchestra.run.smithi061.stderr:--> Zapping successful for: 2022-03-17T15:23:08.948 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:07.518517+0000 mgr.smithi061.kxplwz (mgr.14164) 104 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-03-17T15:23:08.948 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:07.643170+0000 mon.smithi061 (mon.0) 296 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:07.518517+0000 mgr.smithi061.kxplwz (mgr.14164) 104 : cluster [DBG] pgmap v65: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-03-17T15:23:09.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:07.643170+0000 mon.smithi061 (mon.0) 296 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:09.288 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi061:vg_nvme/lv_1 2022-03-17T15:23:09.552 INFO:journalctl@ceph.osd.2.smithi061.stdout:Mar 17 15:23:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.2[48259]: debug 2022-03-17T15:23:09.422+0000 7f270b577080 -1 osd.2 0 log_to_monitors {default=true} 2022-03-17T15:23:09.988 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:09.183850+0000 mon.smithi061 (mon.0) 297 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:23:09.989 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:09.184074+0000 mon.smithi061 (mon.0) 298 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:23:09.989 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:09.427107+0000 mon.smithi061 (mon.0) 299 : audit [INF] from='osd.2 [v2:172.21.15.61:6818/202284814,v1:172.21.15.61:6819/202284814]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-03-17T15:23:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:09.183850+0000 mon.smithi061 (mon.0) 297 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:23:10.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:09.184074+0000 mon.smithi061 (mon.0) 298 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:23:10.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:09.427107+0000 mon.smithi061 (mon.0) 299 : audit [INF] from='osd.2 [v2:172.21.15.61:6818/202284814,v1:172.21.15.61:6819/202284814]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2022-03-17T15:23:10.764 INFO:journalctl@ceph.osd.2.smithi061.stdout:Mar 17 15:23:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.2[48259]: debug 2022-03-17T15:23:10.653+0000 7f2701ae8700 -1 osd.2 0 waiting for initial osdmap 2022-03-17T15:23:10.764 INFO:journalctl@ceph.osd.2.smithi061.stdout:Mar 17 15:23:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.2[48259]: debug 2022-03-17T15:23:10.659+0000 7f26faa5d700 -1 osd.2 18 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2022-03-17T15:23:10.764 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:09.518823+0000 mgr.smithi061.kxplwz (mgr.14164) 105 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-03-17T15:23:10.765 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:09.652140+0000 mon.smithi061 (mon.0) 300 : audit [INF] from='osd.2 [v2:172.21.15.61:6818/202284814,v1:172.21.15.61:6819/202284814]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2022-03-17T15:23:10.765 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:09.652206+0000 mon.smithi061 (mon.0) 301 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2022-03-17T15:23:10.765 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:09.652502+0000 mon.smithi061 (mon.0) 302 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:23:10.765 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:09.653043+0000 mon.smithi061 (mon.0) 303 : audit [INF] from='osd.2 [v2:172.21.15.61:6818/202284814,v1:172.21.15.61:6819/202284814]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]: dispatch 2022-03-17T15:23:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:09.518823+0000 mgr.smithi061.kxplwz (mgr.14164) 105 : cluster [DBG] pgmap v66: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-03-17T15:23:11.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:09.652140+0000 mon.smithi061 (mon.0) 300 : audit [INF] from='osd.2 [v2:172.21.15.61:6818/202284814,v1:172.21.15.61:6819/202284814]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2022-03-17T15:23:11.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:09.652206+0000 mon.smithi061 (mon.0) 301 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2022-03-17T15:23:11.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:09.652502+0000 mon.smithi061 (mon.0) 302 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:23:11.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:09.653043+0000 mon.smithi061 (mon.0) 303 : audit [INF] from='osd.2 [v2:172.21.15.61:6818/202284814,v1:172.21.15.61:6819/202284814]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]: dispatch 2022-03-17T15:23:11.988 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:10.651592+0000 mon.smithi061 (mon.0) 304 : audit [INF] from='osd.2 [v2:172.21.15.61:6818/202284814,v1:172.21.15.61:6819/202284814]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]': finished 2022-03-17T15:23:11.988 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:10.651685+0000 mon.smithi061 (mon.0) 305 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2022-03-17T15:23:11.988 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:10.652042+0000 mon.smithi061 (mon.0) 306 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:23:11.989 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:10.656935+0000 mon.smithi061 (mon.0) 307 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:23:11.989 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:11.185437+0000 mon.smithi061 (mon.0) 308 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:11.989 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:11.188444+0000 mon.smithi061 (mon.0) 309 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:11.989 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:11.191360+0000 mon.smithi061 (mon.0) 310 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:23:11.989 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:11.316335+0000 mon.smithi061 (mon.0) 311 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-03-17T15:23:11.990 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:11.317757+0000 mon.smithi061 (mon.0) 312 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-03-17T15:23:11.990 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:11.318391+0000 mon.smithi061 (mon.0) 313 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:23:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:10.651592+0000 mon.smithi061 (mon.0) 304 : audit [INF] from='osd.2 [v2:172.21.15.61:6818/202284814,v1:172.21.15.61:6819/202284814]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]': finished 2022-03-17T15:23:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:10.651685+0000 mon.smithi061 (mon.0) 305 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2022-03-17T15:23:12.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:10.652042+0000 mon.smithi061 (mon.0) 306 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:23:12.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:10.656935+0000 mon.smithi061 (mon.0) 307 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:23:12.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:11.185437+0000 mon.smithi061 (mon.0) 308 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:12.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:11.188444+0000 mon.smithi061 (mon.0) 309 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:12.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:11.191360+0000 mon.smithi061 (mon.0) 310 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:23:12.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:11.316335+0000 mon.smithi061 (mon.0) 311 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-03-17T15:23:12.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:11.317757+0000 mon.smithi061 (mon.0) 312 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-03-17T15:23:12.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:11.318391+0000 mon.smithi061 (mon.0) 313 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:23:12.976 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:10.400935+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2022-03-17T15:23:12.977 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:10.401041+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2022-03-17T15:23:12.977 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:11.315306+0000 mgr.smithi061.kxplwz (mgr.14164) 106 : audit [DBG] from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi061:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:23:12.977 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:23:11.317523+0000 mgr.smithi061.kxplwz (mgr.14164) 107 : cephadm [INF] Applying service osd.None on host smithi061... 2022-03-17T15:23:12.977 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:11.519158+0000 mgr.smithi061.kxplwz (mgr.14164) 108 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-03-17T15:23:12.978 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:11.655514+0000 mon.smithi061 (mon.0) 314 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:23:12.978 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:11.658871+0000 mon.smithi061 (mon.0) 315 : cluster [INF] osd.2 [v2:172.21.15.61:6818/202284814,v1:172.21.15.61:6819/202284814] boot 2022-03-17T15:23:12.978 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:11.658907+0000 mon.smithi061 (mon.0) 316 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2022-03-17T15:23:12.978 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:11.659668+0000 mon.smithi061 (mon.0) 317 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:23:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:10.400935+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2022-03-17T15:23:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:10.401041+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2022-03-17T15:23:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:11.315306+0000 mgr.smithi061.kxplwz (mgr.14164) 106 : audit [DBG] from='client.14268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi061:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:23:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:23:11.317523+0000 mgr.smithi061.kxplwz (mgr.14164) 107 : cephadm [INF] Applying service osd.None on host smithi061... 2022-03-17T15:23:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:11.519158+0000 mgr.smithi061.kxplwz (mgr.14164) 108 : cluster [DBG] pgmap v69: 0 pgs: ; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2022-03-17T15:23:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:11.655514+0000 mon.smithi061 (mon.0) 314 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:23:13.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:11.658871+0000 mon.smithi061 (mon.0) 315 : cluster [INF] osd.2 [v2:172.21.15.61:6818/202284814,v1:172.21.15.61:6819/202284814] boot 2022-03-17T15:23:13.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:11.658907+0000 mon.smithi061 (mon.0) 316 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2022-03-17T15:23:13.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:11.659668+0000 mon.smithi061 (mon.0) 317 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:23:14.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:13.195047+0000 mon.smithi061 (mon.0) 318 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2022-03-17T15:23:14.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:13.256735+0000 mon.smithi061 (mon.0) 319 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:14.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:13.742605+0000 mon.smithi061 (mon.0) 320 : audit [INF] from='client.? 172.21.15.61:0/1491653800' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c9531e9-302c-4bc3-a901-5a59968e1555"}]: dispatch 2022-03-17T15:23:14.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:13.746228+0000 mon.smithi061 (mon.0) 321 : audit [INF] from='client.? 172.21.15.61:0/1491653800' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4c9531e9-302c-4bc3-a901-5a59968e1555"}]': finished 2022-03-17T15:23:14.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:13.746303+0000 mon.smithi061 (mon.0) 322 : cluster [DBG] osdmap e21: 4 total, 3 up, 4 in 2022-03-17T15:23:14.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:13.746426+0000 mon.smithi061 (mon.0) 323 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:23:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:13.195047+0000 mon.smithi061 (mon.0) 318 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2022-03-17T15:23:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:13.256735+0000 mon.smithi061 (mon.0) 319 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:13.742605+0000 mon.smithi061 (mon.0) 320 : audit [INF] from='client.? 172.21.15.61:0/1491653800' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4c9531e9-302c-4bc3-a901-5a59968e1555"}]: dispatch 2022-03-17T15:23:14.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:13.746228+0000 mon.smithi061 (mon.0) 321 : audit [INF] from='client.? 172.21.15.61:0/1491653800' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4c9531e9-302c-4bc3-a901-5a59968e1555"}]': finished 2022-03-17T15:23:14.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:13.746303+0000 mon.smithi061 (mon.0) 322 : cluster [DBG] osdmap e21: 4 total, 3 up, 4 in 2022-03-17T15:23:14.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:13.746426+0000 mon.smithi061 (mon.0) 323 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:23:15.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:13.519385+0000 mgr.smithi061.kxplwz (mgr.14164) 109 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:15.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:14.193295+0000 mon.smithi061 (mon.0) 324 : audit [DBG] from='client.? 172.21.15.61:0/3357106827' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-03-17T15:23:15.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:13.519385+0000 mgr.smithi061.kxplwz (mgr.14164) 109 : cluster [DBG] pgmap v72: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:15.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:14.193295+0000 mon.smithi061 (mon.0) 324 : audit [DBG] from='client.? 172.21.15.61:0/3357106827' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-03-17T15:23:17.455 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:15.519684+0000 mgr.smithi061.kxplwz (mgr.14164) 110 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:17.456 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:16.498916+0000 mon.smithi061 (mon.0) 325 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:17.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:15.519684+0000 mgr.smithi061.kxplwz (mgr.14164) 110 : cluster [DBG] pgmap v74: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:17.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:16.498916+0000 mon.smithi061 (mon.0) 325 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:19.440 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:17.519982+0000 mgr.smithi061.kxplwz (mgr.14164) 111 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:17.519982+0000 mgr.smithi061.kxplwz (mgr.14164) 111 : cluster [DBG] pgmap v75: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:19.520278+0000 mgr.smithi061.kxplwz (mgr.14164) 112 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:20.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:23:19.527724+0000 mgr.smithi061.kxplwz (mgr.14164) 113 : cephadm [INF] Detected new or changed devices on smithi061 2022-03-17T15:23:20.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:19.532563+0000 mon.smithi061 (mon.0) 326 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:20.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:19.898682+0000 mon.smithi061 (mon.0) 327 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:20.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:20.350275+0000 mon.smithi061 (mon.0) 328 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2022-03-17T15:23:20.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:20.350931+0000 mon.smithi061 (mon.0) 329 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:23:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:19.520278+0000 mgr.smithi061.kxplwz (mgr.14164) 112 : cluster [DBG] pgmap v76: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:23:19.527724+0000 mgr.smithi061.kxplwz (mgr.14164) 113 : cephadm [INF] Detected new or changed devices on smithi061 2022-03-17T15:23:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:19.532563+0000 mon.smithi061 (mon.0) 326 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:20.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:19.898682+0000 mon.smithi061 (mon.0) 327 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:20.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:20.350275+0000 mon.smithi061 (mon.0) 328 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2022-03-17T15:23:20.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:20.350931+0000 mon.smithi061 (mon.0) 329 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:23:21.687 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:23:20.351463+0000 mgr.smithi061.kxplwz (mgr.14164) 114 : cephadm [INF] Deploying daemon osd.3 on smithi061 2022-03-17T15:23:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:23:20.351463+0000 mgr.smithi061.kxplwz (mgr.14164) 114 : cephadm [INF] Deploying daemon osd.3 on smithi061 2022-03-17T15:23:22.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:21.520845+0000 mgr.smithi061.kxplwz (mgr.14164) 115 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:21.520845+0000 mgr.smithi061.kxplwz (mgr.14164) 115 : cluster [DBG] pgmap v77: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:23.631 INFO:teuthology.orchestra.run.smithi061.stdout:Created osd(s) 3 on host 'smithi061' 2022-03-17T15:23:24.127 DEBUG:teuthology.orchestra.run.smithi061:osd.3> sudo journalctl -f -n 0 -u ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.3.service 2022-03-17T15:23:24.130 INFO:tasks.cephadm:Deploying osd.4 on smithi067 with /dev/vg_nvme/lv_4... 2022-03-17T15:23:24.130 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2022-03-17T15:23:24.160 INFO:journalctl@ceph.osd.3.smithi061.stdout:-- Logs begin at Thu 2022-03-17 15:13:33 UTC. -- 2022-03-17T15:23:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:23.521311+0000 mgr.smithi061.kxplwz (mgr.14164) 116 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:23.614590+0000 mon.smithi061 (mon.0) 330 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:23:24.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:23.618372+0000 mon.smithi061 (mon.0) 331 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:24.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:23.627220+0000 mon.smithi061 (mon.0) 332 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:24.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:23.629476+0000 mon.smithi061 (mon.0) 333 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-03-17T15:23:24.807 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:23.521311+0000 mgr.smithi061.kxplwz (mgr.14164) 116 : cluster [DBG] pgmap v78: 0 pgs: ; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:24.807 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:23.614590+0000 mon.smithi061 (mon.0) 330 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:23:24.807 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:23.618372+0000 mon.smithi061 (mon.0) 331 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:24.808 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:23.627220+0000 mon.smithi061 (mon.0) 332 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:24.808 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:23.629476+0000 mon.smithi061 (mon.0) 333 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-03-17T15:23:25.806 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping: /dev/vg_nvme/lv_4 2022-03-17T15:23:25.806 INFO:teuthology.orchestra.run.smithi067.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2022-03-17T15:23:25.806 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10+0 records in 2022-03-17T15:23:25.807 INFO:teuthology.orchestra.run.smithi067.stderr:10+0 records out 2022-03-17T15:23:25.807 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.010974 s, 956 MB/s 2022-03-17T15:23:25.807 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping successful for: 2022-03-17T15:23:26.027 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:24.627806+0000 mon.smithi061 (mon.0) 334 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2022-03-17T15:23:26.028 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:24.627874+0000 mon.smithi061 (mon.0) 335 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2022-03-17T15:23:26.028 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:24.628031+0000 mon.smithi061 (mon.0) 336 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:23:26.028 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:24.629038+0000 mon.smithi061 (mon.0) 337 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-03-17T15:23:26.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:24.627806+0000 mon.smithi061 (mon.0) 334 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2022-03-17T15:23:26.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:24.627874+0000 mon.smithi061 (mon.0) 335 : cluster [DBG] osdmap e22: 4 total, 3 up, 4 in 2022-03-17T15:23:26.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:24.628031+0000 mon.smithi061 (mon.0) 336 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:23:26.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:24.629038+0000 mon.smithi061 (mon.0) 337 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-03-17T15:23:26.275 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi067:vg_nvme/lv_4 2022-03-17T15:23:26.899 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:25.521595+0000 mgr.smithi061.kxplwz (mgr.14164) 117 : cluster [DBG] pgmap v80: 1 pgs: 1 unknown; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:26.899 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:25.631770+0000 mon.smithi061 (mon.0) 338 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2022-03-17T15:23:26.899 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:25.631855+0000 mon.smithi061 (mon.0) 339 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2022-03-17T15:23:26.900 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:25.632085+0000 mon.smithi061 (mon.0) 340 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:23:27.052 INFO:journalctl@ceph.osd.3.smithi061.stdout:Mar 17 15:23:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.3[51873]: debug 2022-03-17T15:23:26.721+0000 7fd8ff343080 -1 osd.3 0 log_to_monitors {default=true} 2022-03-17T15:23:27.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:25.521595+0000 mgr.smithi061.kxplwz (mgr.14164) 117 : cluster [DBG] pgmap v80: 1 pgs: 1 unknown; 0 B data, 14 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:27.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:25.631770+0000 mon.smithi061 (mon.0) 338 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2022-03-17T15:23:27.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:25.631855+0000 mon.smithi061 (mon.0) 339 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2022-03-17T15:23:27.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:25.632085+0000 mon.smithi061 (mon.0) 340 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:23:27.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:26.641222+0000 mon.smithi061 (mon.0) 341 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2022-03-17T15:23:27.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:26.641350+0000 mon.smithi061 (mon.0) 342 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:23:27.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:26.725269+0000 mon.smithi061 (mon.0) 343 : audit [INF] from='osd.3 [v2:172.21.15.61:6826/2924456645,v1:172.21.15.61:6827/2924456645]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-03-17T15:23:28.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:26.641222+0000 mon.smithi061 (mon.0) 341 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2022-03-17T15:23:28.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:26.641350+0000 mon.smithi061 (mon.0) 342 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:23:28.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:26.725269+0000 mon.smithi061 (mon.0) 343 : audit [INF] from='osd.3 [v2:172.21.15.61:6826/2924456645,v1:172.21.15.61:6827/2924456645]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2022-03-17T15:23:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:27.521876+0000 mgr.smithi061.kxplwz (mgr.14164) 118 : cluster [DBG] pgmap v83: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:28.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:27.647002+0000 mon.smithi061 (mon.0) 344 : audit [INF] from='osd.3 [v2:172.21.15.61:6826/2924456645,v1:172.21.15.61:6827/2924456645]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2022-03-17T15:23:28.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:27.647088+0000 mon.smithi061 (mon.0) 345 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2022-03-17T15:23:28.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:27.647341+0000 mon.smithi061 (mon.0) 346 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:23:28.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:27.647691+0000 mon.smithi061 (mon.0) 347 : audit [INF] from='osd.3 [v2:172.21.15.61:6826/2924456645,v1:172.21.15.61:6827/2924456645]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]: dispatch 2022-03-17T15:23:28.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:27.763585+0000 mgr.smithi061.kxplwz (mgr.14164) 119 : audit [DBG] from='client.24147 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:23:28.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:27.764422+0000 mon.smithi061 (mon.0) 348 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-03-17T15:23:28.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:23:27.765931+0000 mgr.smithi061.kxplwz (mgr.14164) 120 : cephadm [INF] Applying service osd.None on host smithi067... 2022-03-17T15:23:28.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:27.766176+0000 mon.smithi061 (mon.0) 349 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-03-17T15:23:28.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:27.766851+0000 mon.smithi061 (mon.0) 350 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:23:29.052 INFO:journalctl@ceph.osd.3.smithi061.stdout:Mar 17 15:23:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.3[51873]: debug 2022-03-17T15:23:28.649+0000 7fd8f58b4700 -1 osd.3 0 waiting for initial osdmap 2022-03-17T15:23:29.052 INFO:journalctl@ceph.osd.3.smithi061.stdout:Mar 17 15:23:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.3[51873]: debug 2022-03-17T15:23:28.654+0000 7fd8ee028700 -1 osd.3 26 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2022-03-17T15:23:29.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:27.521876+0000 mgr.smithi061.kxplwz (mgr.14164) 118 : cluster [DBG] pgmap v83: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:29.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:27.647002+0000 mon.smithi061 (mon.0) 344 : audit [INF] from='osd.3 [v2:172.21.15.61:6826/2924456645,v1:172.21.15.61:6827/2924456645]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2022-03-17T15:23:29.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:27.647088+0000 mon.smithi061 (mon.0) 345 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2022-03-17T15:23:29.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:27.647341+0000 mon.smithi061 (mon.0) 346 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:23:29.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:27.647691+0000 mon.smithi061 (mon.0) 347 : audit [INF] from='osd.3 [v2:172.21.15.61:6826/2924456645,v1:172.21.15.61:6827/2924456645]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]: dispatch 2022-03-17T15:23:29.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:27.763585+0000 mgr.smithi061.kxplwz (mgr.14164) 119 : audit [DBG] from='client.24147 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:23:29.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:27.764422+0000 mon.smithi061 (mon.0) 348 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-03-17T15:23:29.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:23:27.765931+0000 mgr.smithi061.kxplwz (mgr.14164) 120 : cephadm [INF] Applying service osd.None on host smithi067... 2022-03-17T15:23:29.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:27.766176+0000 mon.smithi061 (mon.0) 349 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-03-17T15:23:29.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:27.766851+0000 mon.smithi061 (mon.0) 350 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:23:29.742 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:28.646902+0000 mon.smithi061 (mon.0) 351 : audit [INF] from='osd.3 [v2:172.21.15.61:6826/2924456645,v1:172.21.15.61:6827/2924456645]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]': finished 2022-03-17T15:23:29.742 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:28.646984+0000 mon.smithi061 (mon.0) 352 : cluster [DBG] osdmap e26: 4 total, 3 up, 4 in 2022-03-17T15:23:29.743 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:28.647588+0000 mon.smithi061 (mon.0) 353 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:23:29.743 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:28.651073+0000 mon.smithi061 (mon.0) 354 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:23:29.743 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:29.001874+0000 mon.smithi061 (mon.0) 355 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:29.743 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:29.614847+0000 mon.smithi067 (mon.1) 2 : audit [INF] from='client.? 172.21.15.67:0/2149788276' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0f8bb6b-02e3-40d7-962b-f785dafc8fb1"}]: dispatch 2022-03-17T15:23:29.744 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:29.615266+0000 mon.smithi061 (mon.0) 356 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0f8bb6b-02e3-40d7-962b-f785dafc8fb1"}]: dispatch 2022-03-17T15:23:29.744 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:29.619115+0000 mon.smithi061 (mon.0) 357 : cluster [INF] osd.3 [v2:172.21.15.61:6826/2924456645,v1:172.21.15.61:6827/2924456645] boot 2022-03-17T15:23:29.744 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:29.619170+0000 mon.smithi061 (mon.0) 358 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0f8bb6b-02e3-40d7-962b-f785dafc8fb1"}]': finished 2022-03-17T15:23:29.744 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:29.619226+0000 mon.smithi061 (mon.0) 359 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2022-03-17T15:23:29.744 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:29.619409+0000 mon.smithi061 (mon.0) 360 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:23:29.745 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:29.619852+0000 mon.smithi061 (mon.0) 361 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:23:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:28.646902+0000 mon.smithi061 (mon.0) 351 : audit [INF] from='osd.3 [v2:172.21.15.61:6826/2924456645,v1:172.21.15.61:6827/2924456645]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]': finished 2022-03-17T15:23:30.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:28.646984+0000 mon.smithi061 (mon.0) 352 : cluster [DBG] osdmap e26: 4 total, 3 up, 4 in 2022-03-17T15:23:30.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:28.647588+0000 mon.smithi061 (mon.0) 353 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:23:30.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:28.651073+0000 mon.smithi061 (mon.0) 354 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:23:30.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:29.001874+0000 mon.smithi061 (mon.0) 355 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:30.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:29.614847+0000 mon.smithi067 (mon.1) 2 : audit [INF] from='client.? 172.21.15.67:0/2149788276' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0f8bb6b-02e3-40d7-962b-f785dafc8fb1"}]: dispatch 2022-03-17T15:23:30.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:29.615266+0000 mon.smithi061 (mon.0) 356 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c0f8bb6b-02e3-40d7-962b-f785dafc8fb1"}]: dispatch 2022-03-17T15:23:30.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:29.619115+0000 mon.smithi061 (mon.0) 357 : cluster [INF] osd.3 [v2:172.21.15.61:6826/2924456645,v1:172.21.15.61:6827/2924456645] boot 2022-03-17T15:23:30.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:29.619170+0000 mon.smithi061 (mon.0) 358 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c0f8bb6b-02e3-40d7-962b-f785dafc8fb1"}]': finished 2022-03-17T15:23:30.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:29.619226+0000 mon.smithi061 (mon.0) 359 : cluster [DBG] osdmap e27: 5 total, 4 up, 5 in 2022-03-17T15:23:30.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:29.619409+0000 mon.smithi061 (mon.0) 360 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:23:30.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:29.619852+0000 mon.smithi061 (mon.0) 361 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:23:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:27.675121+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2022-03-17T15:23:31.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:27.675206+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2022-03-17T15:23:31.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:29.522217+0000 mgr.smithi061.kxplwz (mgr.14164) 121 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:31.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:30.040457+0000 mon.smithi067 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.67:0/1250528613' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-03-17T15:23:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:27.675121+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2022-03-17T15:23:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:27.675206+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2022-03-17T15:23:31.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:29.522217+0000 mgr.smithi061.kxplwz (mgr.14164) 121 : cluster [DBG] pgmap v86: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2022-03-17T15:23:31.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:30.040457+0000 mon.smithi067 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.67:0/1250528613' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-03-17T15:23:32.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:30.653602+0000 mon.smithi061 (mon.0) 362 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2022-03-17T15:23:32.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:30.653950+0000 mon.smithi061 (mon.0) 363 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:23:32.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:30.653602+0000 mon.smithi061 (mon.0) 362 : cluster [DBG] osdmap e28: 5 total, 4 up, 5 in 2022-03-17T15:23:32.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:30.653950+0000 mon.smithi061 (mon.0) 363 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:23:33.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:31.522527+0000 mgr.smithi061.kxplwz (mgr.14164) 122 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-03-17T15:23:33.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:32.046461+0000 mon.smithi061 (mon.0) 364 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:33.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:32.049546+0000 mon.smithi061 (mon.0) 365 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:33.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:32.052501+0000 mon.smithi061 (mon.0) 366 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:23:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:31.522527+0000 mgr.smithi061.kxplwz (mgr.14164) 122 : cluster [DBG] pgmap v89: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-03-17T15:23:33.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:32.046461+0000 mon.smithi061 (mon.0) 364 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:33.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:32.049546+0000 mon.smithi061 (mon.0) 365 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:33.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:32.052501+0000 mon.smithi061 (mon.0) 366 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:23:35.198 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:33.522981+0000 mgr.smithi061.kxplwz (mgr.14164) 123 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-03-17T15:23:35.198 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:34.587007+0000 mon.smithi061 (mon.0) 367 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2022-03-17T15:23:35.199 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:34.587751+0000 mon.smithi061 (mon.0) 368 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:23:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:33.522981+0000 mgr.smithi061.kxplwz (mgr.14164) 123 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-03-17T15:23:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:34.587007+0000 mon.smithi061 (mon.0) 367 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2022-03-17T15:23:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:34.587751+0000 mon.smithi061 (mon.0) 368 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:23:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:23:34.588349+0000 mgr.smithi061.kxplwz (mgr.14164) 124 : cephadm [INF] Deploying daemon osd.4 on smithi067 2022-03-17T15:23:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:23:34.588349+0000 mgr.smithi061.kxplwz (mgr.14164) 124 : cephadm [INF] Deploying daemon osd.4 on smithi067 2022-03-17T15:23:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:35.523344+0000 mgr.smithi061.kxplwz (mgr.14164) 125 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-03-17T15:23:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:36.747379+0000 mon.smithi061 (mon.0) 369 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:36.752658+0000 mon.smithi061 (mon.0) 370 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:37.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:35.523344+0000 mgr.smithi061.kxplwz (mgr.14164) 125 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-03-17T15:23:37.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:36.747379+0000 mon.smithi061 (mon.0) 369 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:37.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:36.752658+0000 mon.smithi061 (mon.0) 370 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:37.532 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 4 on host 'smithi067' 2022-03-17T15:23:37.924 DEBUG:teuthology.orchestra.run.smithi067:osd.4> sudo journalctl -f -n 0 -u ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.4.service 2022-03-17T15:23:37.926 INFO:tasks.cephadm:Deploying osd.5 on smithi067 with /dev/vg_nvme/lv_3... 2022-03-17T15:23:37.927 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2022-03-17T15:23:37.958 INFO:journalctl@ceph.osd.4.smithi067.stdout:-- Logs begin at Thu 2022-03-17 15:13:37 UTC. -- 2022-03-17T15:23:38.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:37.517442+0000 mon.smithi061 (mon.0) 371 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:23:38.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:37.521656+0000 mon.smithi061 (mon.0) 372 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:38.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:37.526740+0000 mon.smithi061 (mon.0) 373 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:37.517442+0000 mon.smithi061 (mon.0) 371 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:23:38.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:37.521656+0000 mon.smithi061 (mon.0) 372 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:38.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:37.526740+0000 mon.smithi061 (mon.0) 373 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:37.523675+0000 mgr.smithi061.kxplwz (mgr.14164) 126 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-03-17T15:23:39.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:37.523675+0000 mgr.smithi061.kxplwz (mgr.14164) 126 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-03-17T15:23:39.726 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping: /dev/vg_nvme/lv_3 2022-03-17T15:23:39.727 INFO:teuthology.orchestra.run.smithi067.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2022-03-17T15:23:39.727 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10+0 records in 2022-03-17T15:23:39.727 INFO:teuthology.orchestra.run.smithi067.stderr:10+0 records out 2022-03-17T15:23:39.727 INFO:teuthology.orchestra.run.smithi067.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0121473 s, 863 MB/s 2022-03-17T15:23:39.728 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping successful for: 2022-03-17T15:23:40.248 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi067:vg_nvme/lv_3 2022-03-17T15:23:40.892 INFO:journalctl@ceph.osd.4.smithi067.stdout:Mar 17 15:23:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.4[36792]: debug 2022-03-17T15:23:40.670+0000 7fdd3cbbf080 -1 osd.4 0 log_to_monitors {default=true} 2022-03-17T15:23:41.177 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:39.524064+0000 mgr.smithi061.kxplwz (mgr.14164) 127 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-03-17T15:23:41.178 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:40.403379+0000 mon.smithi061 (mon.0) 374 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:41.178 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:40.675569+0000 mon.smithi067 (mon.1) 4 : audit [INF] from='osd.4 [v2:172.21.15.67:6800/3073415180,v1:172.21.15.67:6801/3073415180]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-03-17T15:23:41.179 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:40.676011+0000 mon.smithi061 (mon.0) 375 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-03-17T15:23:41.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:39.524064+0000 mgr.smithi061.kxplwz (mgr.14164) 127 : cluster [DBG] pgmap v93: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-03-17T15:23:41.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:40.403379+0000 mon.smithi061 (mon.0) 374 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:41.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:40.675569+0000 mon.smithi067 (mon.1) 4 : audit [INF] from='osd.4 [v2:172.21.15.67:6800/3073415180,v1:172.21.15.67:6801/3073415180]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-03-17T15:23:41.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:40.676011+0000 mon.smithi061 (mon.0) 375 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2022-03-17T15:23:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:41.405401+0000 mon.smithi061 (mon.0) 376 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2022-03-17T15:23:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:41.405498+0000 mon.smithi061 (mon.0) 377 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2022-03-17T15:23:42.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:41.405610+0000 mon.smithi061 (mon.0) 378 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:23:42.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:41.407760+0000 mon.smithi067 (mon.1) 5 : audit [INF] from='osd.4 [v2:172.21.15.67:6800/3073415180,v1:172.21.15.67:6801/3073415180]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2022-03-17T15:23:42.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:41.408339+0000 mon.smithi061 (mon.0) 379 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2022-03-17T15:23:42.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:41.524433+0000 mgr.smithi061.kxplwz (mgr.14164) 128 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-03-17T15:23:42.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:41.761816+0000 mgr.smithi061.kxplwz (mgr.14164) 129 : audit [DBG] from='client.24165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:23:42.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:41.762833+0000 mon.smithi061 (mon.0) 380 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-03-17T15:23:42.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:23:41.764080+0000 mgr.smithi061.kxplwz (mgr.14164) 130 : cephadm [INF] Applying service osd.None on host smithi067... 2022-03-17T15:23:42.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:41.764308+0000 mon.smithi061 (mon.0) 381 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-03-17T15:23:42.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:41.764999+0000 mon.smithi061 (mon.0) 382 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:23:42.570 INFO:journalctl@ceph.osd.4.smithi067.stdout:Mar 17 15:23:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.4[36792]: debug 2022-03-17T15:23:42.408+0000 7fdd33130700 -1 osd.4 0 waiting for initial osdmap 2022-03-17T15:23:42.570 INFO:journalctl@ceph.osd.4.smithi067.stdout:Mar 17 15:23:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.4[36792]: debug 2022-03-17T15:23:42.414+0000 7fdd2d8a8700 -1 osd.4 30 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2022-03-17T15:23:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:41.405401+0000 mon.smithi061 (mon.0) 376 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2022-03-17T15:23:42.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:41.405498+0000 mon.smithi061 (mon.0) 377 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2022-03-17T15:23:42.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:41.405610+0000 mon.smithi061 (mon.0) 378 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:23:42.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:41.407760+0000 mon.smithi067 (mon.1) 5 : audit [INF] from='osd.4 [v2:172.21.15.67:6800/3073415180,v1:172.21.15.67:6801/3073415180]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2022-03-17T15:23:42.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:41.408339+0000 mon.smithi061 (mon.0) 379 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2022-03-17T15:23:42.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:41.524433+0000 mgr.smithi061.kxplwz (mgr.14164) 128 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2022-03-17T15:23:42.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:41.761816+0000 mgr.smithi061.kxplwz (mgr.14164) 129 : audit [DBG] from='client.24165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:23:42.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:41.762833+0000 mon.smithi061 (mon.0) 380 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-03-17T15:23:42.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:23:41.764080+0000 mgr.smithi061.kxplwz (mgr.14164) 130 : cephadm [INF] Applying service osd.None on host smithi067... 2022-03-17T15:23:42.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:41.764308+0000 mon.smithi061 (mon.0) 381 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-03-17T15:23:42.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:41.764999+0000 mon.smithi061 (mon.0) 382 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:23:43.499 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:42.407631+0000 mon.smithi061 (mon.0) 383 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2022-03-17T15:23:43.500 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:42.407723+0000 mon.smithi061 (mon.0) 384 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2022-03-17T15:23:43.500 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:42.408297+0000 mon.smithi061 (mon.0) 385 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:23:43.500 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:42.412332+0000 mon.smithi061 (mon.0) 386 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:23:43.500 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:42.530970+0000 mon.smithi061 (mon.0) 387 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:43.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:42.407631+0000 mon.smithi061 (mon.0) 383 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2022-03-17T15:23:43.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:42.407723+0000 mon.smithi061 (mon.0) 384 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2022-03-17T15:23:43.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:42.408297+0000 mon.smithi061 (mon.0) 385 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:23:43.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:42.412332+0000 mon.smithi061 (mon.0) 386 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:23:43.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:42.530970+0000 mon.smithi061 (mon.0) 387 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:41.643953+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2022-03-17T15:23:44.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:41.644049+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2022-03-17T15:23:44.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:43.409770+0000 mon.smithi061 (mon.0) 388 : cluster [INF] osd.4 [v2:172.21.15.67:6800/3073415180,v1:172.21.15.67:6801/3073415180] boot 2022-03-17T15:23:44.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:43.409862+0000 mon.smithi061 (mon.0) 389 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2022-03-17T15:23:44.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:43.410056+0000 mon.smithi061 (mon.0) 390 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:23:44.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:43.524936+0000 mgr.smithi061.kxplwz (mgr.14164) 131 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-03-17T15:23:44.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:23:43.607399+0000 mgr.smithi061.kxplwz (mgr.14164) 132 : cephadm [INF] Detected new or changed devices on smithi067 2022-03-17T15:23:44.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:43.612341+0000 mon.smithi061 (mon.0) 391 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:44.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:43.616003+0000 mon.smithi061 (mon.0) 392 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:44.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:43.619762+0000 mon.smithi061 (mon.0) 393 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:23:44.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:44.178726+0000 mon.smithi067 (mon.1) 6 : audit [INF] from='client.? 172.21.15.67:0/2326016647' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47cdbc39-ac2d-4efa-b4b0-09208dafcb53"}]: dispatch 2022-03-17T15:23:44.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:44.179338+0000 mon.smithi061 (mon.0) 394 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47cdbc39-ac2d-4efa-b4b0-09208dafcb53"}]: dispatch 2022-03-17T15:23:44.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:44.183264+0000 mon.smithi061 (mon.0) 395 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47cdbc39-ac2d-4efa-b4b0-09208dafcb53"}]': finished 2022-03-17T15:23:44.806 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:44.183355+0000 mon.smithi061 (mon.0) 396 : cluster [DBG] osdmap e32: 6 total, 5 up, 6 in 2022-03-17T15:23:44.806 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:44.183467+0000 mon.smithi061 (mon.0) 397 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:23:44.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:41.643953+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2022-03-17T15:23:44.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:41.644049+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2022-03-17T15:23:44.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:43.409770+0000 mon.smithi061 (mon.0) 388 : cluster [INF] osd.4 [v2:172.21.15.67:6800/3073415180,v1:172.21.15.67:6801/3073415180] boot 2022-03-17T15:23:44.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:43.409862+0000 mon.smithi061 (mon.0) 389 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2022-03-17T15:23:44.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:43.410056+0000 mon.smithi061 (mon.0) 390 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:23:44.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:43.524936+0000 mgr.smithi061.kxplwz (mgr.14164) 131 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-03-17T15:23:44.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:23:43.607399+0000 mgr.smithi061.kxplwz (mgr.14164) 132 : cephadm [INF] Detected new or changed devices on smithi067 2022-03-17T15:23:44.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:43.612341+0000 mon.smithi061 (mon.0) 391 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:44.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:43.616003+0000 mon.smithi061 (mon.0) 392 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:44.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:43.619762+0000 mon.smithi061 (mon.0) 393 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:23:44.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:44.178726+0000 mon.smithi067 (mon.1) 6 : audit [INF] from='client.? 172.21.15.67:0/2326016647' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47cdbc39-ac2d-4efa-b4b0-09208dafcb53"}]: dispatch 2022-03-17T15:23:44.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:44.179338+0000 mon.smithi061 (mon.0) 394 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47cdbc39-ac2d-4efa-b4b0-09208dafcb53"}]: dispatch 2022-03-17T15:23:44.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:44.183264+0000 mon.smithi061 (mon.0) 395 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47cdbc39-ac2d-4efa-b4b0-09208dafcb53"}]': finished 2022-03-17T15:23:44.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:44.183355+0000 mon.smithi061 (mon.0) 396 : cluster [DBG] osdmap e32: 6 total, 5 up, 6 in 2022-03-17T15:23:44.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:44.183467+0000 mon.smithi061 (mon.0) 397 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:23:45.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:44.606825+0000 mon.smithi067 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.67:0/64685535' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-03-17T15:23:45.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:45.184948+0000 mon.smithi061 (mon.0) 398 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2022-03-17T15:23:45.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:45.185073+0000 mon.smithi061 (mon.0) 399 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:23:45.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:44.606825+0000 mon.smithi067 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.67:0/64685535' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-03-17T15:23:45.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:45.184948+0000 mon.smithi061 (mon.0) 398 : cluster [DBG] osdmap e33: 6 total, 5 up, 6 in 2022-03-17T15:23:45.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:45.185073+0000 mon.smithi061 (mon.0) 399 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:23:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:45.525279+0000 mgr.smithi061.kxplwz (mgr.14164) 133 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-03-17T15:23:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:45.525279+0000 mgr.smithi061.kxplwz (mgr.14164) 133 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-03-17T15:23:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:47.525760+0000 mgr.smithi061.kxplwz (mgr.14164) 134 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-03-17T15:23:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:48.423415+0000 mon.smithi061 (mon.0) 400 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:48.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:48.426376+0000 mon.smithi061 (mon.0) 401 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:47.525760+0000 mgr.smithi061.kxplwz (mgr.14164) 134 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-03-17T15:23:48.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:48.423415+0000 mon.smithi061 (mon.0) 400 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:48.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:48.426376+0000 mon.smithi061 (mon.0) 401 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:49.213098+0000 mon.smithi061 (mon.0) 402 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2022-03-17T15:23:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:49.214044+0000 mon.smithi061 (mon.0) 403 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:23:49.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:23:49.214788+0000 mgr.smithi061.kxplwz (mgr.14164) 135 : cephadm [INF] Deploying daemon osd.5 on smithi067 2022-03-17T15:23:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:49.213098+0000 mon.smithi061 (mon.0) 402 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2022-03-17T15:23:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:49.214044+0000 mon.smithi061 (mon.0) 403 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:23:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:23:49.214788+0000 mgr.smithi061.kxplwz (mgr.14164) 135 : cephadm [INF] Deploying daemon osd.5 on smithi067 2022-03-17T15:23:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:49.526366+0000 mgr.smithi061.kxplwz (mgr.14164) 136 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-03-17T15:23:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:49.526366+0000 mgr.smithi061.kxplwz (mgr.14164) 136 : cluster [DBG] pgmap v103: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-03-17T15:23:52.057 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 5 on host 'smithi067' 2022-03-17T15:23:52.440 DEBUG:teuthology.orchestra.run.smithi067:osd.5> sudo journalctl -f -n 0 -u ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.5.service 2022-03-17T15:23:52.443 INFO:tasks.cephadm:Deploying osd.6 on smithi067 with /dev/vg_nvme/lv_2... 2022-03-17T15:23:52.444 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2022-03-17T15:23:52.475 INFO:journalctl@ceph.osd.5.smithi067.stdout:-- Logs begin at Thu 2022-03-17 15:13:37 UTC. -- 2022-03-17T15:23:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:51.526756+0000 mgr.smithi061.kxplwz (mgr.14164) 137 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-03-17T15:23:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:52.040239+0000 mon.smithi061 (mon.0) 404 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:23:52.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:52.045290+0000 mon.smithi061 (mon.0) 405 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:52.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:52.053099+0000 mon.smithi061 (mon.0) 406 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:51.526756+0000 mgr.smithi061.kxplwz (mgr.14164) 137 : cluster [DBG] pgmap v104: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-03-17T15:23:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:52.040239+0000 mon.smithi061 (mon.0) 404 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:23:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:52.045290+0000 mon.smithi061 (mon.0) 405 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:52.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:52.053099+0000 mon.smithi061 (mon.0) 406 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:54.310 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping: /dev/vg_nvme/lv_2 2022-03-17T15:23:54.310 INFO:teuthology.orchestra.run.smithi067.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2022-03-17T15:23:54.310 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10+0 records in 2022-03-17T15:23:54.311 INFO:teuthology.orchestra.run.smithi067.stderr:10+0 records out 2022-03-17T15:23:54.311 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0152993 s, 685 MB/s 2022-03-17T15:23:54.311 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping successful for: 2022-03-17T15:23:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:53.527275+0000 mgr.smithi061.kxplwz (mgr.14164) 138 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-03-17T15:23:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:53.527275+0000 mgr.smithi061.kxplwz (mgr.14164) 138 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-03-17T15:23:54.870 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi067:vg_nvme/lv_2 2022-03-17T15:23:55.519 INFO:journalctl@ceph.osd.5.smithi067.stdout:Mar 17 15:23:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.5[39690]: debug 2022-03-17T15:23:55.184+0000 7fa91a081080 -1 osd.5 0 log_to_monitors {default=true} 2022-03-17T15:23:56.519 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:55.133331+0000 mon.smithi061 (mon.0) 407 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:56.520 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:55.189486+0000 mon.smithi067 (mon.1) 8 : audit [INF] from='osd.5 [v2:172.21.15.67:6808/2120095062,v1:172.21.15.67:6809/2120095062]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-03-17T15:23:56.520 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:55.190271+0000 mon.smithi061 (mon.0) 408 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-03-17T15:23:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:55.133331+0000 mon.smithi061 (mon.0) 407 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:55.189486+0000 mon.smithi067 (mon.1) 8 : audit [INF] from='osd.5 [v2:172.21.15.67:6808/2120095062,v1:172.21.15.67:6809/2120095062]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-03-17T15:23:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:55.190271+0000 mon.smithi061 (mon.0) 408 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2022-03-17T15:23:57.426 INFO:journalctl@ceph.osd.5.smithi067.stdout:Mar 17 15:23:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.5[39690]: debug 2022-03-17T15:23:57.151+0000 7fa9105f2700 -1 osd.5 0 waiting for initial osdmap 2022-03-17T15:23:57.427 INFO:journalctl@ceph.osd.5.smithi067.stdout:Mar 17 15:23:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.5[39690]: debug 2022-03-17T15:23:57.157+0000 7fa908d66700 -1 osd.5 35 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2022-03-17T15:23:57.427 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:55.527592+0000 mgr.smithi061.kxplwz (mgr.14164) 139 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-03-17T15:23:57.427 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:56.140234+0000 mon.smithi061 (mon.0) 409 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2022-03-17T15:23:57.428 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:56.140320+0000 mon.smithi061 (mon.0) 410 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2022-03-17T15:23:57.428 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:56.140429+0000 mon.smithi061 (mon.0) 411 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:23:57.428 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:56.140807+0000 mon.smithi067 (mon.1) 9 : audit [INF] from='osd.5 [v2:172.21.15.67:6808/2120095062,v1:172.21.15.67:6809/2120095062]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2022-03-17T15:23:57.428 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:56.141106+0000 mon.smithi061 (mon.0) 412 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2022-03-17T15:23:57.429 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:56.618755+0000 mon.smithi061 (mon.0) 413 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-03-17T15:23:57.429 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:56.620153+0000 mon.smithi061 (mon.0) 414 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-03-17T15:23:57.429 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:56.621577+0000 mon.smithi061 (mon.0) 415 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:23:57.429 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:56.943979+0000 mon.smithi061 (mon.0) 416 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:57.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:55.527592+0000 mgr.smithi061.kxplwz (mgr.14164) 139 : cluster [DBG] pgmap v106: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-03-17T15:23:57.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:56.140234+0000 mon.smithi061 (mon.0) 409 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2022-03-17T15:23:57.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:56.140320+0000 mon.smithi061 (mon.0) 410 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2022-03-17T15:23:57.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:56.140429+0000 mon.smithi061 (mon.0) 411 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:23:57.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:56.140807+0000 mon.smithi067 (mon.1) 9 : audit [INF] from='osd.5 [v2:172.21.15.67:6808/2120095062,v1:172.21.15.67:6809/2120095062]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2022-03-17T15:23:57.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:56.141106+0000 mon.smithi061 (mon.0) 412 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2022-03-17T15:23:57.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:56.618755+0000 mon.smithi061 (mon.0) 413 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-03-17T15:23:57.476 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:56.620153+0000 mon.smithi061 (mon.0) 414 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-03-17T15:23:57.476 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:56.621577+0000 mon.smithi061 (mon.0) 415 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:23:57.476 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:56.943979+0000 mon.smithi061 (mon.0) 416 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:58.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:56.617919+0000 mgr.smithi061.kxplwz (mgr.14164) 140 : audit [DBG] from='client.24183 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:23:58.260 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:23:56.619939+0000 mgr.smithi061.kxplwz (mgr.14164) 141 : cephadm [INF] Applying service osd.None on host smithi067... 2022-03-17T15:23:58.260 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:57.141260+0000 mon.smithi061 (mon.0) 417 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2022-03-17T15:23:58.260 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:57.141326+0000 mon.smithi061 (mon.0) 418 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2022-03-17T15:23:58.260 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:57.141638+0000 mon.smithi061 (mon.0) 419 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:23:58.261 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:57.150367+0000 mon.smithi061 (mon.0) 420 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:23:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:56.617919+0000 mgr.smithi061.kxplwz (mgr.14164) 140 : audit [DBG] from='client.24183 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:23:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:23:56.619939+0000 mgr.smithi061.kxplwz (mgr.14164) 141 : cephadm [INF] Applying service osd.None on host smithi067... 2022-03-17T15:23:58.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:57.141260+0000 mon.smithi061 (mon.0) 417 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2022-03-17T15:23:58.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:57.141326+0000 mon.smithi061 (mon.0) 418 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2022-03-17T15:23:58.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:57.141638+0000 mon.smithi061 (mon.0) 419 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:23:58.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:57.150367+0000 mon.smithi061 (mon.0) 420 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:23:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:56.170279+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2022-03-17T15:23:59.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:56.170496+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2022-03-17T15:23:59.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:57.528137+0000 mgr.smithi061.kxplwz (mgr.14164) 142 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-03-17T15:23:59.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:58.151824+0000 mon.smithi061 (mon.0) 421 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:23:59.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:58.157794+0000 mon.smithi061 (mon.0) 422 : cluster [INF] osd.5 [v2:172.21.15.67:6808/2120095062,v1:172.21.15.67:6809/2120095062] boot 2022-03-17T15:23:59.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:58.157894+0000 mon.smithi061 (mon.0) 423 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2022-03-17T15:23:59.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:58.158364+0000 mon.smithi061 (mon.0) 424 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:23:59.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:58.651200+0000 mon.smithi061 (mon.0) 425 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:59.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:59.035331+0000 mon.smithi061 (mon.0) 426 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:59.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:23:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:59.039109+0000 mon.smithi061 (mon.0) 427 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:23:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:56.170279+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2022-03-17T15:23:59.676 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:56.170496+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2022-03-17T15:23:59.677 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:57.528137+0000 mgr.smithi061.kxplwz (mgr.14164) 142 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2022-03-17T15:23:59.677 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:58.151824+0000 mon.smithi061 (mon.0) 421 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:23:59.677 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:58.157794+0000 mon.smithi061 (mon.0) 422 : cluster [INF] osd.5 [v2:172.21.15.67:6808/2120095062,v1:172.21.15.67:6809/2120095062] boot 2022-03-17T15:23:59.677 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:58.157894+0000 mon.smithi061 (mon.0) 423 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2022-03-17T15:23:59.678 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:58.158364+0000 mon.smithi061 (mon.0) 424 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:23:59.678 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:58.651200+0000 mon.smithi061 (mon.0) 425 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:59.678 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:59.035331+0000 mon.smithi061 (mon.0) 426 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:23:59.678 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:23:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:59.039109+0000 mon.smithi061 (mon.0) 427 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:24:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:23:58.645647+0000 mgr.smithi061.kxplwz (mgr.14164) 143 : cephadm [INF] Detected new or changed devices on smithi067 2022-03-17T15:24:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:59.160742+0000 mon.smithi061 (mon.0) 428 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2022-03-17T15:24:00.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:59.239431+0000 mon.smithi067 (mon.1) 10 : audit [INF] from='client.? 172.21.15.67:0/2516714977' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be197266-9c3f-4805-a415-051b83b8928d"}]: dispatch 2022-03-17T15:24:00.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:59.239866+0000 mon.smithi061 (mon.0) 429 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be197266-9c3f-4805-a415-051b83b8928d"}]: dispatch 2022-03-17T15:24:00.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:59.248215+0000 mon.smithi061 (mon.0) 430 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "be197266-9c3f-4805-a415-051b83b8928d"}]': finished 2022-03-17T15:24:00.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:59.248274+0000 mon.smithi061 (mon.0) 431 : cluster [DBG] osdmap e38: 7 total, 6 up, 7 in 2022-03-17T15:24:00.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:59.248363+0000 mon.smithi061 (mon.0) 432 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:24:00.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:23:59.674792+0000 mon.smithi067 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.67:0/3472274352' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-03-17T15:24:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:23:58.645647+0000 mgr.smithi061.kxplwz (mgr.14164) 143 : cephadm [INF] Detected new or changed devices on smithi067 2022-03-17T15:24:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:59.160742+0000 mon.smithi061 (mon.0) 428 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2022-03-17T15:24:00.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:59.239431+0000 mon.smithi067 (mon.1) 10 : audit [INF] from='client.? 172.21.15.67:0/2516714977' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be197266-9c3f-4805-a415-051b83b8928d"}]: dispatch 2022-03-17T15:24:00.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:59.239866+0000 mon.smithi061 (mon.0) 429 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "be197266-9c3f-4805-a415-051b83b8928d"}]: dispatch 2022-03-17T15:24:00.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:59.248215+0000 mon.smithi061 (mon.0) 430 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "be197266-9c3f-4805-a415-051b83b8928d"}]': finished 2022-03-17T15:24:00.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:59.248274+0000 mon.smithi061 (mon.0) 431 : cluster [DBG] osdmap e38: 7 total, 6 up, 7 in 2022-03-17T15:24:00.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:59.248363+0000 mon.smithi061 (mon.0) 432 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:24:00.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:23:59.674792+0000 mon.smithi067 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.67:0/3472274352' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-03-17T15:24:01.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:23:59.528465+0000 mgr.smithi061.kxplwz (mgr.14164) 144 : cluster [DBG] pgmap v113: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-03-17T15:24:01.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:23:59.528465+0000 mgr.smithi061.kxplwz (mgr.14164) 144 : cluster [DBG] pgmap v113: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-03-17T15:24:03.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:01.528785+0000 mgr.smithi061.kxplwz (mgr.14164) 145 : cluster [DBG] pgmap v114: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-03-17T15:24:03.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:01.528785+0000 mgr.smithi061.kxplwz (mgr.14164) 145 : cluster [DBG] pgmap v114: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-03-17T15:24:05.094 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:03.529123+0000 mgr.smithi061.kxplwz (mgr.14164) 146 : cluster [DBG] pgmap v115: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-03-17T15:24:05.095 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:03.942380+0000 mon.smithi061 (mon.0) 433 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:05.095 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:03.947556+0000 mon.smithi061 (mon.0) 434 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:05.095 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:04.430704+0000 mon.smithi061 (mon.0) 435 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2022-03-17T15:24:05.095 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:04.431552+0000 mon.smithi061 (mon.0) 436 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:24:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:03.529123+0000 mgr.smithi061.kxplwz (mgr.14164) 146 : cluster [DBG] pgmap v115: 1 pgs: 1 remapped+peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-03-17T15:24:05.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:03.942380+0000 mon.smithi061 (mon.0) 433 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:05.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:03.947556+0000 mon.smithi061 (mon.0) 434 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:05.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:04.430704+0000 mon.smithi061 (mon.0) 435 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2022-03-17T15:24:05.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:04.431552+0000 mon.smithi061 (mon.0) 436 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:24:06.230 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:24:04.432241+0000 mgr.smithi061.kxplwz (mgr.14164) 147 : cephadm [INF] Deploying daemon osd.6 on smithi067 2022-03-17T15:24:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:24:04.432241+0000 mgr.smithi061.kxplwz (mgr.14164) 147 : cephadm [INF] Deploying daemon osd.6 on smithi067 2022-03-17T15:24:07.245 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:05.529574+0000 mgr.smithi061.kxplwz (mgr.14164) 148 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-03-17T15:24:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:05.529574+0000 mgr.smithi061.kxplwz (mgr.14164) 148 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-03-17T15:24:07.387 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 6 on host 'smithi067' 2022-03-17T15:24:07.784 DEBUG:teuthology.orchestra.run.smithi067:osd.6> sudo journalctl -f -n 0 -u ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.6.service 2022-03-17T15:24:07.787 INFO:tasks.cephadm:Deploying osd.7 on smithi067 with /dev/vg_nvme/lv_1... 2022-03-17T15:24:07.787 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2022-03-17T15:24:07.819 INFO:journalctl@ceph.osd.6.smithi067.stdout:-- Logs begin at Thu 2022-03-17 15:13:37 UTC. -- 2022-03-17T15:24:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:07.371859+0000 mon.smithi061 (mon.0) 437 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:24:08.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:07.378185+0000 mon.smithi061 (mon.0) 438 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:08.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:07.382985+0000 mon.smithi061 (mon.0) 439 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:08.067 INFO:journalctl@ceph.osd.6.smithi067.stdout:Mar 17 15:24:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.6[42628]: debug 2022-03-17T15:24:07.824+0000 7f1040cf4080 -1 Falling back to public interface 2022-03-17T15:24:08.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:07.371859+0000 mon.smithi061 (mon.0) 437 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:24:08.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:07.378185+0000 mon.smithi061 (mon.0) 438 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:08.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:07.382985+0000 mon.smithi061 (mon.0) 439 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:09.169 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:07.529852+0000 mgr.smithi061.kxplwz (mgr.14164) 149 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-03-17T15:24:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:07.529852+0000 mgr.smithi061.kxplwz (mgr.14164) 149 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-03-17T15:24:09.600 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping: /dev/vg_nvme/lv_1 2022-03-17T15:24:09.601 INFO:teuthology.orchestra.run.smithi067.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2022-03-17T15:24:09.601 INFO:teuthology.orchestra.run.smithi067.stderr: stderr: 10+0 records in 2022-03-17T15:24:09.601 INFO:teuthology.orchestra.run.smithi067.stderr:10+0 records out 2022-03-17T15:24:09.601 INFO:teuthology.orchestra.run.smithi067.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0119959 s, 874 MB/s 2022-03-17T15:24:09.602 INFO:teuthology.orchestra.run.smithi067.stderr:--> Zapping successful for: 2022-03-17T15:24:09.909 DEBUG:teuthology.orchestra.run.smithi067:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph orch daemon add osd smithi067:vg_nvme/lv_1 2022-03-17T15:24:10.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:09.184938+0000 mon.smithi061 (mon.0) 440 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:24:10.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:09.185146+0000 mon.smithi061 (mon.0) 441 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:24:10.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:09.184938+0000 mon.smithi061 (mon.0) 440 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:24:10.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:09.185146+0000 mon.smithi061 (mon.0) 441 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:24:10.797 INFO:journalctl@ceph.osd.6.smithi067.stdout:Mar 17 15:24:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.6[42628]: debug 2022-03-17T15:24:10.584+0000 7f1040cf4080 -1 osd.6 0 log_to_monitors {default=true} 2022-03-17T15:24:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:09.530157+0000 mgr.smithi061.kxplwz (mgr.14164) 150 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-03-17T15:24:11.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:10.588679+0000 mon.smithi067 (mon.1) 12 : audit [INF] from='osd.6 [v2:172.21.15.67:6816/1690107995,v1:172.21.15.67:6817/1690107995]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2022-03-17T15:24:11.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:10.589084+0000 mon.smithi061 (mon.0) 442 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2022-03-17T15:24:11.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:10.849015+0000 mon.smithi061 (mon.0) 443 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:09.530157+0000 mgr.smithi061.kxplwz (mgr.14164) 150 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-03-17T15:24:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:10.588679+0000 mon.smithi067 (mon.1) 12 : audit [INF] from='osd.6 [v2:172.21.15.67:6816/1690107995,v1:172.21.15.67:6817/1690107995]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2022-03-17T15:24:11.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:10.589084+0000 mon.smithi061 (mon.0) 442 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2022-03-17T15:24:11.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:10.849015+0000 mon.smithi061 (mon.0) 443 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:12.188 INFO:journalctl@ceph.osd.6.smithi067.stdout:Mar 17 15:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.6[42628]: debug 2022-03-17T15:24:11.968+0000 7f1037265700 -1 osd.6 0 waiting for initial osdmap 2022-03-17T15:24:12.188 INFO:journalctl@ceph.osd.6.smithi067.stdout:Mar 17 15:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.6[42628]: debug 2022-03-17T15:24:11.973+0000 7f102f9d9700 -1 osd.6 40 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2022-03-17T15:24:12.188 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:10.959740+0000 mon.smithi061 (mon.0) 444 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2022-03-17T15:24:12.189 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:10.959838+0000 mon.smithi061 (mon.0) 445 : cluster [DBG] osdmap e39: 7 total, 6 up, 7 in 2022-03-17T15:24:12.189 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:10.960240+0000 mon.smithi061 (mon.0) 446 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:24:12.189 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:10.960599+0000 mon.smithi067 (mon.1) 13 : audit [INF] from='osd.6 [v2:172.21.15.67:6816/1690107995,v1:172.21.15.67:6817/1690107995]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2022-03-17T15:24:12.189 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:10.963880+0000 mon.smithi061 (mon.0) 447 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2022-03-17T15:24:12.190 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:11.600468+0000 mon.smithi061 (mon.0) 448 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-03-17T15:24:12.190 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:11.601848+0000 mon.smithi061 (mon.0) 449 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-03-17T15:24:12.190 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:11.602435+0000 mon.smithi061 (mon.0) 450 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:24:12.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:10.959740+0000 mon.smithi061 (mon.0) 444 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2022-03-17T15:24:12.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:10.959838+0000 mon.smithi061 (mon.0) 445 : cluster [DBG] osdmap e39: 7 total, 6 up, 7 in 2022-03-17T15:24:12.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:10.960240+0000 mon.smithi061 (mon.0) 446 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:24:12.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:10.960599+0000 mon.smithi067 (mon.1) 13 : audit [INF] from='osd.6 [v2:172.21.15.67:6816/1690107995,v1:172.21.15.67:6817/1690107995]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2022-03-17T15:24:12.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:10.963880+0000 mon.smithi061 (mon.0) 447 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2022-03-17T15:24:12.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:11.600468+0000 mon.smithi061 (mon.0) 448 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2022-03-17T15:24:12.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:11.601848+0000 mon.smithi061 (mon.0) 449 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2022-03-17T15:24:12.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:11.602435+0000 mon.smithi061 (mon.0) 450 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:24:13.256 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:11.530575+0000 mgr.smithi061.kxplwz (mgr.14164) 151 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-03-17T15:24:13.256 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:11.599723+0000 mgr.smithi061.kxplwz (mgr.14164) 152 : audit [DBG] from='client.24201 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:24:13.257 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:24:11.601634+0000 mgr.smithi061.kxplwz (mgr.14164) 153 : cephadm [INF] Applying service osd.None on host smithi067... 2022-03-17T15:24:13.257 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:11.964532+0000 mon.smithi061 (mon.0) 451 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2022-03-17T15:24:13.257 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:11.964602+0000 mon.smithi061 (mon.0) 452 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2022-03-17T15:24:13.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:11.964943+0000 mon.smithi061 (mon.0) 453 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:24:13.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:11.969103+0000 mon.smithi061 (mon.0) 454 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:24:13.258 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:12.286434+0000 mon.smithi061 (mon.0) 455 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:11.530575+0000 mgr.smithi061.kxplwz (mgr.14164) 151 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2022-03-17T15:24:13.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:11.599723+0000 mgr.smithi061.kxplwz (mgr.14164) 152 : audit [DBG] from='client.24201 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi067:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:24:13.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:24:11.601634+0000 mgr.smithi061.kxplwz (mgr.14164) 153 : cephadm [INF] Applying service osd.None on host smithi067... 2022-03-17T15:24:13.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:11.964532+0000 mon.smithi061 (mon.0) 451 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2022-03-17T15:24:13.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:11.964602+0000 mon.smithi061 (mon.0) 452 : cluster [DBG] osdmap e40: 7 total, 6 up, 7 in 2022-03-17T15:24:13.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:11.964943+0000 mon.smithi061 (mon.0) 453 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:24:13.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:11.969103+0000 mon.smithi061 (mon.0) 454 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:24:13.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:12.286434+0000 mon.smithi061 (mon.0) 455 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:14.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:11.584616+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2022-03-17T15:24:14.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:11.584713+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2022-03-17T15:24:14.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:12.970414+0000 mon.smithi061 (mon.0) 456 : cluster [INF] osd.6 [v2:172.21.15.67:6816/1690107995,v1:172.21.15.67:6817/1690107995] boot 2022-03-17T15:24:14.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:12.970472+0000 mon.smithi061 (mon.0) 457 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2022-03-17T15:24:14.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:12.970884+0000 mon.smithi061 (mon.0) 458 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:24:14.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:13.651448+0000 mon.smithi061 (mon.0) 459 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:14.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:13.655404+0000 mon.smithi061 (mon.0) 460 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:14.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:13.659228+0000 mon.smithi061 (mon.0) 461 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:24:14.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:13.663521+0000 mon.smithi061 (mon.0) 462 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:14.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:11.584616+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2022-03-17T15:24:14.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:11.584713+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2022-03-17T15:24:14.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:12.970414+0000 mon.smithi061 (mon.0) 456 : cluster [INF] osd.6 [v2:172.21.15.67:6816/1690107995,v1:172.21.15.67:6817/1690107995] boot 2022-03-17T15:24:14.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:12.970472+0000 mon.smithi061 (mon.0) 457 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2022-03-17T15:24:14.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:12.970884+0000 mon.smithi061 (mon.0) 458 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:24:14.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:13.651448+0000 mon.smithi061 (mon.0) 459 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:14.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:13.655404+0000 mon.smithi061 (mon.0) 460 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:14.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:13.659228+0000 mon.smithi061 (mon.0) 461 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:24:14.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:13.663521+0000 mon.smithi061 (mon.0) 462 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:13.531066+0000 mgr.smithi061.kxplwz (mgr.14164) 154 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-03-17T15:24:15.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:24:13.645919+0000 mgr.smithi061.kxplwz (mgr.14164) 155 : cephadm [INF] Detected new or changed devices on smithi067 2022-03-17T15:24:15.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:13.979047+0000 mon.smithi061 (mon.0) 463 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2022-03-17T15:24:15.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:14.221151+0000 mon.smithi067 (mon.1) 14 : audit [INF] from='client.? 172.21.15.67:0/446983284' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d18023ab-67f4-450c-88f8-778377dbc8cc"}]: dispatch 2022-03-17T15:24:15.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:14.221689+0000 mon.smithi061 (mon.0) 464 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d18023ab-67f4-450c-88f8-778377dbc8cc"}]: dispatch 2022-03-17T15:24:15.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:14.226331+0000 mon.smithi061 (mon.0) 465 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d18023ab-67f4-450c-88f8-778377dbc8cc"}]': finished 2022-03-17T15:24:15.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:14.226395+0000 mon.smithi061 (mon.0) 466 : cluster [DBG] osdmap e43: 8 total, 7 up, 8 in 2022-03-17T15:24:15.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:14.226526+0000 mon.smithi061 (mon.0) 467 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:24:15.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:14.645815+0000 mon.smithi067 (mon.1) 15 : audit [DBG] from='client.? 172.21.15.67:0/2932117778' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-03-17T15:24:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:13.531066+0000 mgr.smithi061.kxplwz (mgr.14164) 154 : cluster [DBG] pgmap v123: 1 pgs: 1 active+clean; 0 B data, 31 MiB used, 536 GiB / 536 GiB avail 2022-03-17T15:24:15.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:24:13.645919+0000 mgr.smithi061.kxplwz (mgr.14164) 155 : cephadm [INF] Detected new or changed devices on smithi067 2022-03-17T15:24:15.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:13.979047+0000 mon.smithi061 (mon.0) 463 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2022-03-17T15:24:15.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:14.221151+0000 mon.smithi067 (mon.1) 14 : audit [INF] from='client.? 172.21.15.67:0/446983284' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d18023ab-67f4-450c-88f8-778377dbc8cc"}]: dispatch 2022-03-17T15:24:15.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:14.221689+0000 mon.smithi061 (mon.0) 464 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d18023ab-67f4-450c-88f8-778377dbc8cc"}]: dispatch 2022-03-17T15:24:15.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:14.226331+0000 mon.smithi061 (mon.0) 465 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d18023ab-67f4-450c-88f8-778377dbc8cc"}]': finished 2022-03-17T15:24:15.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:14.226395+0000 mon.smithi061 (mon.0) 466 : cluster [DBG] osdmap e43: 8 total, 7 up, 8 in 2022-03-17T15:24:15.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:14.226526+0000 mon.smithi061 (mon.0) 467 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:24:15.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:14.645815+0000 mon.smithi067 (mon.1) 15 : audit [DBG] from='client.? 172.21.15.67:0/2932117778' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2022-03-17T15:24:17.283 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:15.531507+0000 mgr.smithi061.kxplwz (mgr.14164) 156 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-03-17T15:24:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:15.531507+0000 mgr.smithi061.kxplwz (mgr.14164) 156 : cluster [DBG] pgmap v126: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-03-17T15:24:19.132 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:17.531918+0000 mgr.smithi061.kxplwz (mgr.14164) 157 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-03-17T15:24:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:17.531918+0000 mgr.smithi061.kxplwz (mgr.14164) 157 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-03-17T15:24:20.129 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:19.209515+0000 mon.smithi061 (mon.0) 468 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2022-03-17T15:24:20.129 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:19.210396+0000 mon.smithi061 (mon.0) 469 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:24:20.129 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:24:19.211099+0000 mgr.smithi061.kxplwz (mgr.14164) 158 : cephadm [INF] Deploying daemon osd.7 on smithi067 2022-03-17T15:24:20.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:19.209515+0000 mon.smithi061 (mon.0) 468 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2022-03-17T15:24:20.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:19.210396+0000 mon.smithi061 (mon.0) 469 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:24:20.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:24:19.211099+0000 mgr.smithi061.kxplwz (mgr.14164) 158 : cephadm [INF] Deploying daemon osd.7 on smithi067 2022-03-17T15:24:21.252 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:19.532399+0000 mgr.smithi061.kxplwz (mgr.14164) 159 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-03-17T15:24:21.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:19.532399+0000 mgr.smithi061.kxplwz (mgr.14164) 159 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-03-17T15:24:22.095 INFO:teuthology.orchestra.run.smithi067.stdout:Created osd(s) 7 on host 'smithi067' 2022-03-17T15:24:22.491 DEBUG:teuthology.orchestra.run.smithi067:osd.7> sudo journalctl -f -n 0 -u ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.7.service 2022-03-17T15:24:22.493 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2022-03-17T15:24:22.494 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph osd stat -f json 2022-03-17T15:24:22.529 INFO:journalctl@ceph.osd.7.smithi067.stdout:-- Logs begin at Thu 2022-03-17 15:13:37 UTC. -- 2022-03-17T15:24:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:21.532918+0000 mgr.smithi061.kxplwz (mgr.14164) 160 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-03-17T15:24:23.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:22.073320+0000 mon.smithi061 (mon.0) 470 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:24:23.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:22.079688+0000 mon.smithi061 (mon.0) 471 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:23.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:22.090699+0000 mon.smithi061 (mon.0) 472 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:21.532918+0000 mgr.smithi061.kxplwz (mgr.14164) 160 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-03-17T15:24:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:22.073320+0000 mon.smithi061 (mon.0) 470 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:24:23.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:22.079688+0000 mon.smithi061 (mon.0) 471 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:23.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:22.090699+0000 mon.smithi061 (mon.0) 472 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:24.247 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:24:24.637 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":43,"num_osds":8,"num_up_osds":7,"osd_up_since":1647530652,"num_in_osds":8,"osd_in_since":1647530654,"num_remapped_pgs":0} 2022-03-17T15:24:25.259 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:23.533406+0000 mgr.smithi061.kxplwz (mgr.14164) 161 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-03-17T15:24:25.260 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:24.245484+0000 mon.smithi061 (mon.0) 473 : audit [DBG] from='client.? 172.21.15.61:0/724107553' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-03-17T15:24:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:23.533406+0000 mgr.smithi061.kxplwz (mgr.14164) 161 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-03-17T15:24:25.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:24.245484+0000 mon.smithi061 (mon.0) 473 : audit [DBG] from='client.? 172.21.15.61:0/724107553' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-03-17T15:24:25.526 INFO:journalctl@ceph.osd.7.smithi067.stdout:Mar 17 15:24:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.7[45564]: debug 2022-03-17T15:24:25.256+0000 7f71f8af2080 -1 osd.7 0 log_to_monitors {default=true} 2022-03-17T15:24:25.639 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph osd stat -f json 2022-03-17T15:24:26.218 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:25.012050+0000 mon.smithi061 (mon.0) 474 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:26.219 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:25.261104+0000 mon.smithi067 (mon.1) 16 : audit [INF] from='osd.7 [v2:172.21.15.67:6824/1884004110,v1:172.21.15.67:6825/1884004110]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2022-03-17T15:24:26.220 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:25.261579+0000 mon.smithi061 (mon.0) 475 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2022-03-17T15:24:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:25.012050+0000 mon.smithi061 (mon.0) 474 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:26.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:25.261104+0000 mon.smithi067 (mon.1) 16 : audit [INF] from='osd.7 [v2:172.21.15.67:6824/1884004110,v1:172.21.15.67:6825/1884004110]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2022-03-17T15:24:26.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:25.261579+0000 mon.smithi061 (mon.0) 475 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2022-03-17T15:24:27.297 INFO:journalctl@ceph.osd.7.smithi067.stdout:Mar 17 15:24:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.7[45564]: debug 2022-03-17T15:24:27.026+0000 7f71f0866700 -1 osd.7 0 waiting for initial osdmap 2022-03-17T15:24:27.298 INFO:journalctl@ceph.osd.7.smithi067.stdout:Mar 17 15:24:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.7[45564]: debug 2022-03-17T15:24:27.033+0000 7f71e97db700 -1 osd.7 45 set_numa_affinity unable to identify public interface 'enp3s0f1' numa node: (0) Success 2022-03-17T15:24:27.298 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:25.533944+0000 mgr.smithi061.kxplwz (mgr.14164) 162 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-03-17T15:24:27.299 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:26.021219+0000 mon.smithi061 (mon.0) 476 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2022-03-17T15:24:27.299 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:26.021314+0000 mon.smithi061 (mon.0) 477 : cluster [DBG] osdmap e44: 8 total, 7 up, 8 in 2022-03-17T15:24:27.299 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:26.021559+0000 mon.smithi061 (mon.0) 478 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:24:27.299 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:26.022577+0000 mon.smithi067 (mon.1) 17 : audit [INF] from='osd.7 [v2:172.21.15.67:6824/1884004110,v1:172.21.15.67:6825/1884004110]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2022-03-17T15:24:27.300 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:26.022871+0000 mon.smithi061 (mon.0) 479 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2022-03-17T15:24:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:25.533944+0000 mgr.smithi061.kxplwz (mgr.14164) 162 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-03-17T15:24:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:26.021219+0000 mon.smithi061 (mon.0) 476 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2022-03-17T15:24:27.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:26.021314+0000 mon.smithi061 (mon.0) 477 : cluster [DBG] osdmap e44: 8 total, 7 up, 8 in 2022-03-17T15:24:27.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:26.021559+0000 mon.smithi061 (mon.0) 478 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:24:27.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:26.022577+0000 mon.smithi067 (mon.1) 17 : audit [INF] from='osd.7 [v2:172.21.15.67:6824/1884004110,v1:172.21.15.67:6825/1884004110]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2022-03-17T15:24:27.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:26.022871+0000 mon.smithi061 (mon.0) 479 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]: dispatch 2022-03-17T15:24:27.316 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:24:27.785 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":45,"num_osds":8,"num_up_osds":7,"osd_up_since":1647530652,"num_in_osds":8,"osd_in_since":1647530654,"num_remapped_pgs":0} 2022-03-17T15:24:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:27.021336+0000 mon.smithi061 (mon.0) 480 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2022-03-17T15:24:28.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:27.021400+0000 mon.smithi061 (mon.0) 481 : cluster [DBG] osdmap e45: 8 total, 7 up, 8 in 2022-03-17T15:24:28.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:27.021857+0000 mon.smithi061 (mon.0) 482 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:24:28.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:27.028518+0000 mon.smithi061 (mon.0) 483 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:24:28.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:27.314829+0000 mon.smithi061 (mon.0) 484 : audit [DBG] from='client.? 172.21.15.61:0/356548803' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-03-17T15:24:28.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:27.555447+0000 mon.smithi061 (mon.0) 485 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:28.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:27.558686+0000 mon.smithi061 (mon.0) 486 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:28.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:27.562085+0000 mon.smithi061 (mon.0) 487 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:24:28.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:27.565947+0000 mon.smithi061 (mon.0) 488 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:28.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:28.022594+0000 mon.smithi061 (mon.0) 489 : cluster [INF] osd.7 [v2:172.21.15.67:6824/1884004110,v1:172.21.15.67:6825/1884004110] boot 2022-03-17T15:24:28.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:28.022644+0000 mon.smithi061 (mon.0) 490 : cluster [DBG] osdmap e46: 8 total, 8 up, 8 in 2022-03-17T15:24:28.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:28.022815+0000 mon.smithi061 (mon.0) 491 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:24:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:27.021336+0000 mon.smithi061 (mon.0) 480 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi067", "root=default"]}]': finished 2022-03-17T15:24:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:27.021400+0000 mon.smithi061 (mon.0) 481 : cluster [DBG] osdmap e45: 8 total, 7 up, 8 in 2022-03-17T15:24:28.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:27.021857+0000 mon.smithi061 (mon.0) 482 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:24:28.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:27.028518+0000 mon.smithi061 (mon.0) 483 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:24:28.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:27.314829+0000 mon.smithi061 (mon.0) 484 : audit [DBG] from='client.? 172.21.15.61:0/356548803' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-03-17T15:24:28.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:27.555447+0000 mon.smithi061 (mon.0) 485 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:28.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:27.558686+0000 mon.smithi061 (mon.0) 486 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:28.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:27.562085+0000 mon.smithi061 (mon.0) 487 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:24:28.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:27.565947+0000 mon.smithi061 (mon.0) 488 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:24:28.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:28.022594+0000 mon.smithi061 (mon.0) 489 : cluster [INF] osd.7 [v2:172.21.15.67:6824/1884004110,v1:172.21.15.67:6825/1884004110] boot 2022-03-17T15:24:28.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:28.022644+0000 mon.smithi061 (mon.0) 490 : cluster [DBG] osdmap e46: 8 total, 8 up, 8 in 2022-03-17T15:24:28.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:28.022815+0000 mon.smithi061 (mon.0) 491 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:24:28.786 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph osd stat -f json 2022-03-17T15:24:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:26.222745+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2022-03-17T15:24:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:26.222883+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2022-03-17T15:24:29.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:27.534262+0000 mgr.smithi061.kxplwz (mgr.14164) 163 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-03-17T15:24:29.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:24:27.550946+0000 mgr.smithi061.kxplwz (mgr.14164) 164 : cephadm [INF] Detected new or changed devices on smithi067 2022-03-17T15:24:29.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:29.024210+0000 mon.smithi061 (mon.0) 492 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2022-03-17T15:24:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:26.222745+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2022-03-17T15:24:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:26.222883+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2022-03-17T15:24:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:27.534262+0000 mgr.smithi061.kxplwz (mgr.14164) 163 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2022-03-17T15:24:29.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:24:27.550946+0000 mgr.smithi061.kxplwz (mgr.14164) 164 : cephadm [INF] Detected new or changed devices on smithi067 2022-03-17T15:24:29.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:29.024210+0000 mon.smithi061 (mon.0) 492 : cluster [DBG] osdmap e47: 8 total, 8 up, 8 in 2022-03-17T15:24:30.393 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:24:30.833 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":48,"num_osds":8,"num_up_osds":8,"osd_up_since":1647530668,"num_in_osds":8,"osd_in_since":1647530654,"num_remapped_pgs":0} 2022-03-17T15:24:30.834 INFO:tasks.cephadm:Setting up client nodes... 2022-03-17T15:24:30.835 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2022-03-17T15:24:31.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:29.534565+0000 mgr.smithi061.kxplwz (mgr.14164) 165 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 41 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:31.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:30.025811+0000 mon.smithi061 (mon.0) 493 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2022-03-17T15:24:31.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:30.390171+0000 mon.smithi061 (mon.0) 494 : audit [DBG] from='client.? 172.21.15.61:0/2489343086' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-03-17T15:24:31.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:29.534565+0000 mgr.smithi061.kxplwz (mgr.14164) 165 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 41 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:31.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:30.025811+0000 mon.smithi061 (mon.0) 493 : cluster [DBG] osdmap e48: 8 total, 8 up, 8 in 2022-03-17T15:24:31.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:30.390171+0000 mon.smithi061 (mon.0) 494 : audit [DBG] from='client.? 172.21.15.61:0/2489343086' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2022-03-17T15:24:32.497 INFO:teuthology.orchestra.run.smithi061.stdout:[client.0] 2022-03-17T15:24:32.498 INFO:teuthology.orchestra.run.smithi061.stdout: key = AQCwUjNi71M0HRAAqyy60XpkfnzSgtAb53Ml+g== 2022-03-17T15:24:32.867 DEBUG:teuthology.orchestra.run.smithi061:> set -ex 2022-03-17T15:24:32.867 DEBUG:teuthology.orchestra.run.smithi061:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2022-03-17T15:24:32.868 DEBUG:teuthology.orchestra.run.smithi061:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2022-03-17T15:24:32.909 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph osd dump --format=json 2022-03-17T15:24:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:31.535190+0000 mgr.smithi061.kxplwz (mgr.14164) 166 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:32.489809+0000 mon.smithi061 (mon.0) 495 : audit [INF] from='client.? 172.21.15.61:0/2505382825' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-03-17T15:24:33.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:32.495226+0000 mon.smithi061 (mon.0) 496 : audit [INF] from='client.? 172.21.15.61:0/2505382825' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2022-03-17T15:24:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:31.535190+0000 mgr.smithi061.kxplwz (mgr.14164) 166 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:32.489809+0000 mon.smithi061 (mon.0) 495 : audit [INF] from='client.? 172.21.15.61:0/2505382825' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2022-03-17T15:24:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:32.495226+0000 mon.smithi061 (mon.0) 496 : audit [INF] from='client.? 172.21.15.61:0/2505382825' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2022-03-17T15:24:33.404 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:24:34.707 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:24:34.708 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":48,"fsid":"ae1b9b88-a605-11ec-8c35-001a4aab830c","created":"2022-03-17T15:20:07.690648+0000","modified":"2022-03-17T15:24:30.021802+0000","last_up_change":"2022-03-17T15:24:28.018490+0000","last_in_change":"2022-03-17T15:24:14.222445+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-03-17T15:23:24.090007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"9b8effeb-5d87-4a98-8050-a3f7147dbab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":1147946424},{"type":"v1","addr":"172.21.15.61:6803","nonce":1147946424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":1147946424},{"type":"v1","addr":"172.21.15.61:6805","nonce":1147946424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":1147946424},{"type":"v1","addr":"172.21.15.61:6809","nonce":1147946424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":1147946424},{"type":"v1","addr":"172.21.15.61:6807","nonce":1147946424}]},"public_addr":"172.21.15.61:6803/1147946424","cluster_addr":"172.21.15.61:6805/1147946424","heartbeat_back_addr":"172.21.15.61:6809/1147946424","heartbeat_front_addr":"172.21.15.61:6807/1147946424","state":["exists","up"]},{"osd":1,"uuid":"91b2c37f-7a12-403d-8e52-790abd3686e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":2253612076},{"type":"v1","addr":"172.21.15.61:6811","nonce":2253612076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":2253612076},{"type":"v1","addr":"172.21.15.61:6813","nonce":2253612076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":2253612076},{"type":"v1","addr":"172.21.15.61:6817","nonce":2253612076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":2253612076},{"type":"v1","addr":"172.21.15.61:6815","nonce":2253612076}]},"public_addr":"172.21.15.61:6811/2253612076","cluster_addr":"172.21.15.61:6813/2253612076","heartbeat_back_addr":"172.21.15.61:6817/2253612076","heartbeat_front_addr":"172.21.15.61:6815/2253612076","state":["exists","up"]},{"osd":2,"uuid":"d702a33b-2b25-424d-89ef-92f8352e2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":202284814},{"type":"v1","addr":"172.21.15.61:6819","nonce":202284814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":202284814},{"type":"v1","addr":"172.21.15.61:6821","nonce":202284814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":202284814},{"type":"v1","addr":"172.21.15.61:6825","nonce":202284814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":202284814},{"type":"v1","addr":"172.21.15.61:6823","nonce":202284814}]},"public_addr":"172.21.15.61:6819/202284814","cluster_addr":"172.21.15.61:6821/202284814","heartbeat_back_addr":"172.21.15.61:6825/202284814","heartbeat_front_addr":"172.21.15.61:6823/202284814","state":["exists","up"]},{"osd":3,"uuid":"4c9531e9-302c-4bc3-a901-5a59968e1555","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":2924456645},{"type":"v1","addr":"172.21.15.61:6827","nonce":2924456645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":2924456645},{"type":"v1","addr":"172.21.15.61:6829","nonce":2924456645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2924456645},{"type":"v1","addr":"172.21.15.61:6833","nonce":2924456645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":2924456645},{"type":"v1","addr":"172.21.15.61:6831","nonce":2924456645}]},"public_addr":"172.21.15.61:6827/2924456645","cluster_addr":"172.21.15.61:6829/2924456645","heartbeat_back_addr":"172.21.15.61:6833/2924456645","heartbeat_front_addr":"172.21.15.61:6831/2924456645","state":["exists","up"]},{"osd":4,"uuid":"c0f8bb6b-02e3-40d7-962b-f785dafc8fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3073415180},{"type":"v1","addr":"172.21.15.67:6801","nonce":3073415180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3073415180},{"type":"v1","addr":"172.21.15.67:6803","nonce":3073415180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3073415180},{"type":"v1","addr":"172.21.15.67:6807","nonce":3073415180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3073415180},{"type":"v1","addr":"172.21.15.67:6805","nonce":3073415180}]},"public_addr":"172.21.15.67:6801/3073415180","cluster_addr":"172.21.15.67:6803/3073415180","heartbeat_back_addr":"172.21.15.67:6807/3073415180","heartbeat_front_addr":"172.21.15.67:6805/3073415180","state":["exists","up"]},{"osd":5,"uuid":"47cdbc39-ac2d-4efa-b4b0-09208dafcb53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2120095062},{"type":"v1","addr":"172.21.15.67:6809","nonce":2120095062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":2120095062},{"type":"v1","addr":"172.21.15.67:6811","nonce":2120095062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":2120095062},{"type":"v1","addr":"172.21.15.67:6815","nonce":2120095062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2120095062},{"type":"v1","addr":"172.21.15.67:6813","nonce":2120095062}]},"public_addr":"172.21.15.67:6809/2120095062","cluster_addr":"172.21.15.67:6811/2120095062","heartbeat_back_addr":"172.21.15.67:6815/2120095062","heartbeat_front_addr":"172.21.15.67:6813/2120095062","state":["exists","up"]},{"osd":6,"uuid":"be197266-9c3f-4805-a415-051b83b8928d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1690107995},{"type":"v1","addr":"172.21.15.67:6817","nonce":1690107995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1690107995},{"type":"v1","addr":"172.21.15.67:6819","nonce":1690107995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1690107995},{"type":"v1","addr":"172.21.15.67:6823","nonce":1690107995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1690107995},{"type":"v1","addr":"172.21.15.67:6821","nonce":1690107995}]},"public_addr":"172.21.15.67:6817/1690107995","cluster_addr":"172.21.15.67:6819/1690107995","heartbeat_back_addr":"172.21.15.67:6823/1690107995","heartbeat_front_addr":"172.21.15.67:6821/1690107995","state":["exists","up"]},{"osd":7,"uuid":"d18023ab-67f4-450c-88f8-778377dbc8cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":1884004110},{"type":"v1","addr":"172.21.15.67:6825","nonce":1884004110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":1884004110},{"type":"v1","addr":"172.21.15.67:6827","nonce":1884004110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":1884004110},{"type":"v1","addr":"172.21.15.67:6831","nonce":1884004110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":1884004110},{"type":"v1","addr":"172.21.15.67:6829","nonce":1884004110}]},"public_addr":"172.21.15.67:6825/1884004110","cluster_addr":"172.21.15.67:6827/1884004110","heartbeat_back_addr":"172.21.15.67:6831/1884004110","heartbeat_front_addr":"172.21.15.67:6829/1884004110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:22:36.232772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:22:53.476636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:23:10.401044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:23:27.675208+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:23:41.644052+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:23:56.170503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:24:11.584716+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:24:26.222885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.61:0/1359368918":"2022-03-18T15:21:07.191133+0000","172.21.15.61:6801/3738782809":"2022-03-18T15:21:07.191133+0000","172.21.15.61:0/2650733340":"2022-03-18T15:21:07.191133+0000","172.21.15.61:0/285700093":"2022-03-18T15:20:52.995106+0000","172.21.15.61:6800/3738782809":"2022-03-18T15:21:07.191133+0000","172.21.15.61:0/1412253848":"2022-03-18T15:20:52.995106+0000","172.21.15.61:6801/4166619409":"2022-03-18T15:20:52.995106+0000","172.21.15.61:6800/4166619409":"2022-03-18T15:20:52.995106+0000","172.21.15.61:0/1276352873":"2022-03-18T15:20:30.277220+0000","172.21.15.61:0/3536037008":"2022-03-18T15:20:30.277220+0000","172.21.15.61:6800/2797168280":"2022-03-18T15:20:30.277220+0000","172.21.15.61:6801/2797168280":"2022-03-18T15:20:30.277220+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-17T15:24:35.117 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2022-03-17T15:23:24.090007+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2022-03-17T15:24:35.118 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2022-03-17T15:24:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:33.535507+0000 mgr.smithi061.kxplwz (mgr.14164) 167 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:34.704369+0000 mon.smithi061 (mon.0) 497 : audit [DBG] from='client.? 172.21.15.61:0/1347949354' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-03-17T15:24:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:33.535507+0000 mgr.smithi061.kxplwz (mgr.14164) 167 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:34.704369+0000 mon.smithi061 (mon.0) 497 : audit [DBG] from='client.? 172.21.15.61:0/1347949354' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-03-17T15:24:35.573 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:24:36.875 INFO:teuthology.orchestra.run.smithi061.stdout:pg_num: 1 2022-03-17T15:24:37.255 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:35.536042+0000 mgr.smithi061.kxplwz (mgr.14164) 168 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:37.255 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:36.873616+0000 mon.smithi061 (mon.0) 498 : audit [DBG] from='client.? 172.21.15.61:0/3865068047' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2022-03-17T15:24:37.297 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2022-03-17T15:24:37.298 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2022-03-17T15:24:37.298 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph mgr dump --format=json 2022-03-17T15:24:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:35.536042+0000 mgr.smithi061.kxplwz (mgr.14164) 168 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:36.873616+0000 mon.smithi061 (mon.0) 498 : audit [DBG] from='client.? 172.21.15.61:0/3865068047' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2022-03-17T15:24:37.756 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:24:39.093 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:24:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:37.536421+0000 mgr.smithi061.kxplwz (mgr.14164) 169 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:37.536421+0000 mgr.smithi061.kxplwz (mgr.14164) 169 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:39.467 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":18,"active_gid":14164,"active_name":"smithi061.kxplwz","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6800","nonce":3671810201},{"type":"v1","addr":"172.21.15.61:6801","nonce":3671810201}]},"active_addr":"172.21.15.61:6801/3671810201","active_change":"2022-03-17T15:21:07.191456+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":14200,"name":"smithi067.rdualw","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi061.front.sepia.ceph.com:8443/","prometheus":"http://smithi061.front.sepia.ceph.com:9283/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":4,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.61:0","nonce":3273245056}]},{"addrvec":[{"type":"v2","addr":"172.21.15.61:0","nonce":3192651684}]}]}} 2022-03-17T15:24:39.474 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2022-03-17T15:24:39.474 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2022-03-17T15:24:39.475 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph osd dump --format=json 2022-03-17T15:24:39.930 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:24:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:39.085661+0000 mon.smithi061 (mon.0) 499 : audit [DBG] from='client.? 172.21.15.61:0/1885267683' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2022-03-17T15:24:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:39.085661+0000 mon.smithi061 (mon.0) 499 : audit [DBG] from='client.? 172.21.15.61:0/1885267683' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2022-03-17T15:24:41.289 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:24:41.289 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":48,"fsid":"ae1b9b88-a605-11ec-8c35-001a4aab830c","created":"2022-03-17T15:20:07.690648+0000","modified":"2022-03-17T15:24:30.021802+0000","last_up_change":"2022-03-17T15:24:28.018490+0000","last_in_change":"2022-03-17T15:24:14.222445+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-03-17T15:23:24.090007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"9b8effeb-5d87-4a98-8050-a3f7147dbab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":1147946424},{"type":"v1","addr":"172.21.15.61:6803","nonce":1147946424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":1147946424},{"type":"v1","addr":"172.21.15.61:6805","nonce":1147946424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":1147946424},{"type":"v1","addr":"172.21.15.61:6809","nonce":1147946424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":1147946424},{"type":"v1","addr":"172.21.15.61:6807","nonce":1147946424}]},"public_addr":"172.21.15.61:6803/1147946424","cluster_addr":"172.21.15.61:6805/1147946424","heartbeat_back_addr":"172.21.15.61:6809/1147946424","heartbeat_front_addr":"172.21.15.61:6807/1147946424","state":["exists","up"]},{"osd":1,"uuid":"91b2c37f-7a12-403d-8e52-790abd3686e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":2253612076},{"type":"v1","addr":"172.21.15.61:6811","nonce":2253612076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":2253612076},{"type":"v1","addr":"172.21.15.61:6813","nonce":2253612076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":2253612076},{"type":"v1","addr":"172.21.15.61:6817","nonce":2253612076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":2253612076},{"type":"v1","addr":"172.21.15.61:6815","nonce":2253612076}]},"public_addr":"172.21.15.61:6811/2253612076","cluster_addr":"172.21.15.61:6813/2253612076","heartbeat_back_addr":"172.21.15.61:6817/2253612076","heartbeat_front_addr":"172.21.15.61:6815/2253612076","state":["exists","up"]},{"osd":2,"uuid":"d702a33b-2b25-424d-89ef-92f8352e2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":202284814},{"type":"v1","addr":"172.21.15.61:6819","nonce":202284814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":202284814},{"type":"v1","addr":"172.21.15.61:6821","nonce":202284814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":202284814},{"type":"v1","addr":"172.21.15.61:6825","nonce":202284814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":202284814},{"type":"v1","addr":"172.21.15.61:6823","nonce":202284814}]},"public_addr":"172.21.15.61:6819/202284814","cluster_addr":"172.21.15.61:6821/202284814","heartbeat_back_addr":"172.21.15.61:6825/202284814","heartbeat_front_addr":"172.21.15.61:6823/202284814","state":["exists","up"]},{"osd":3,"uuid":"4c9531e9-302c-4bc3-a901-5a59968e1555","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":2924456645},{"type":"v1","addr":"172.21.15.61:6827","nonce":2924456645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":2924456645},{"type":"v1","addr":"172.21.15.61:6829","nonce":2924456645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2924456645},{"type":"v1","addr":"172.21.15.61:6833","nonce":2924456645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":2924456645},{"type":"v1","addr":"172.21.15.61:6831","nonce":2924456645}]},"public_addr":"172.21.15.61:6827/2924456645","cluster_addr":"172.21.15.61:6829/2924456645","heartbeat_back_addr":"172.21.15.61:6833/2924456645","heartbeat_front_addr":"172.21.15.61:6831/2924456645","state":["exists","up"]},{"osd":4,"uuid":"c0f8bb6b-02e3-40d7-962b-f785dafc8fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3073415180},{"type":"v1","addr":"172.21.15.67:6801","nonce":3073415180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3073415180},{"type":"v1","addr":"172.21.15.67:6803","nonce":3073415180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3073415180},{"type":"v1","addr":"172.21.15.67:6807","nonce":3073415180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3073415180},{"type":"v1","addr":"172.21.15.67:6805","nonce":3073415180}]},"public_addr":"172.21.15.67:6801/3073415180","cluster_addr":"172.21.15.67:6803/3073415180","heartbeat_back_addr":"172.21.15.67:6807/3073415180","heartbeat_front_addr":"172.21.15.67:6805/3073415180","state":["exists","up"]},{"osd":5,"uuid":"47cdbc39-ac2d-4efa-b4b0-09208dafcb53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2120095062},{"type":"v1","addr":"172.21.15.67:6809","nonce":2120095062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":2120095062},{"type":"v1","addr":"172.21.15.67:6811","nonce":2120095062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":2120095062},{"type":"v1","addr":"172.21.15.67:6815","nonce":2120095062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2120095062},{"type":"v1","addr":"172.21.15.67:6813","nonce":2120095062}]},"public_addr":"172.21.15.67:6809/2120095062","cluster_addr":"172.21.15.67:6811/2120095062","heartbeat_back_addr":"172.21.15.67:6815/2120095062","heartbeat_front_addr":"172.21.15.67:6813/2120095062","state":["exists","up"]},{"osd":6,"uuid":"be197266-9c3f-4805-a415-051b83b8928d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1690107995},{"type":"v1","addr":"172.21.15.67:6817","nonce":1690107995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1690107995},{"type":"v1","addr":"172.21.15.67:6819","nonce":1690107995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1690107995},{"type":"v1","addr":"172.21.15.67:6823","nonce":1690107995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1690107995},{"type":"v1","addr":"172.21.15.67:6821","nonce":1690107995}]},"public_addr":"172.21.15.67:6817/1690107995","cluster_addr":"172.21.15.67:6819/1690107995","heartbeat_back_addr":"172.21.15.67:6823/1690107995","heartbeat_front_addr":"172.21.15.67:6821/1690107995","state":["exists","up"]},{"osd":7,"uuid":"d18023ab-67f4-450c-88f8-778377dbc8cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":1884004110},{"type":"v1","addr":"172.21.15.67:6825","nonce":1884004110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":1884004110},{"type":"v1","addr":"172.21.15.67:6827","nonce":1884004110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":1884004110},{"type":"v1","addr":"172.21.15.67:6831","nonce":1884004110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":1884004110},{"type":"v1","addr":"172.21.15.67:6829","nonce":1884004110}]},"public_addr":"172.21.15.67:6825/1884004110","cluster_addr":"172.21.15.67:6827/1884004110","heartbeat_back_addr":"172.21.15.67:6831/1884004110","heartbeat_front_addr":"172.21.15.67:6829/1884004110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:22:36.232772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:22:53.476636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:23:10.401044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:23:27.675208+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:23:41.644052+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:23:56.170503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:24:11.584716+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:24:26.222885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.61:0/1359368918":"2022-03-18T15:21:07.191133+0000","172.21.15.61:6801/3738782809":"2022-03-18T15:21:07.191133+0000","172.21.15.61:0/2650733340":"2022-03-18T15:21:07.191133+0000","172.21.15.61:0/285700093":"2022-03-18T15:20:52.995106+0000","172.21.15.61:6800/3738782809":"2022-03-18T15:21:07.191133+0000","172.21.15.61:0/1412253848":"2022-03-18T15:20:52.995106+0000","172.21.15.61:6801/4166619409":"2022-03-18T15:20:52.995106+0000","172.21.15.61:6800/4166619409":"2022-03-18T15:20:52.995106+0000","172.21.15.61:0/1276352873":"2022-03-18T15:20:30.277220+0000","172.21.15.61:0/3536037008":"2022-03-18T15:20:30.277220+0000","172.21.15.61:6800/2797168280":"2022-03-18T15:20:30.277220+0000","172.21.15.61:6801/2797168280":"2022-03-18T15:20:30.277220+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-17T15:24:41.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:39.536729+0000 mgr.smithi061.kxplwz (mgr.14164) 170 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:39.536729+0000 mgr.smithi061.kxplwz (mgr.14164) 170 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:41.656 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2022-03-17T15:24:41.657 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph osd dump --format=json 2022-03-17T15:24:42.114 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:24:42.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:41.284831+0000 mon.smithi061 (mon.0) 500 : audit [DBG] from='client.? 172.21.15.61:0/1288397846' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-03-17T15:24:42.318 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:41.284831+0000 mon.smithi061 (mon.0) 500 : audit [DBG] from='client.? 172.21.15.61:0/1288397846' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-03-17T15:24:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:41.537137+0000 mgr.smithi061.kxplwz (mgr.14164) 171 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:41.537137+0000 mgr.smithi061.kxplwz (mgr.14164) 171 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:43.398 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:24:43.399 INFO:teuthology.orchestra.run.smithi061.stdout:{"epoch":48,"fsid":"ae1b9b88-a605-11ec-8c35-001a4aab830c","created":"2022-03-17T15:20:07.690648+0000","modified":"2022-03-17T15:24:30.021802+0000","last_up_change":"2022-03-17T15:24:28.018490+0000","last_in_change":"2022-03-17T15:24:14.222445+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2022-03-17T15:23:24.090007+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"9b8effeb-5d87-4a98-8050-a3f7147dbab5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6802","nonce":1147946424},{"type":"v1","addr":"172.21.15.61:6803","nonce":1147946424}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6804","nonce":1147946424},{"type":"v1","addr":"172.21.15.61:6805","nonce":1147946424}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6808","nonce":1147946424},{"type":"v1","addr":"172.21.15.61:6809","nonce":1147946424}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6806","nonce":1147946424},{"type":"v1","addr":"172.21.15.61:6807","nonce":1147946424}]},"public_addr":"172.21.15.61:6803/1147946424","cluster_addr":"172.21.15.61:6805/1147946424","heartbeat_back_addr":"172.21.15.61:6809/1147946424","heartbeat_front_addr":"172.21.15.61:6807/1147946424","state":["exists","up"]},{"osd":1,"uuid":"91b2c37f-7a12-403d-8e52-790abd3686e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6810","nonce":2253612076},{"type":"v1","addr":"172.21.15.61:6811","nonce":2253612076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6812","nonce":2253612076},{"type":"v1","addr":"172.21.15.61:6813","nonce":2253612076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6816","nonce":2253612076},{"type":"v1","addr":"172.21.15.61:6817","nonce":2253612076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6814","nonce":2253612076},{"type":"v1","addr":"172.21.15.61:6815","nonce":2253612076}]},"public_addr":"172.21.15.61:6811/2253612076","cluster_addr":"172.21.15.61:6813/2253612076","heartbeat_back_addr":"172.21.15.61:6817/2253612076","heartbeat_front_addr":"172.21.15.61:6815/2253612076","state":["exists","up"]},{"osd":2,"uuid":"d702a33b-2b25-424d-89ef-92f8352e2d83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6818","nonce":202284814},{"type":"v1","addr":"172.21.15.61:6819","nonce":202284814}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6820","nonce":202284814},{"type":"v1","addr":"172.21.15.61:6821","nonce":202284814}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6824","nonce":202284814},{"type":"v1","addr":"172.21.15.61:6825","nonce":202284814}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6822","nonce":202284814},{"type":"v1","addr":"172.21.15.61:6823","nonce":202284814}]},"public_addr":"172.21.15.61:6819/202284814","cluster_addr":"172.21.15.61:6821/202284814","heartbeat_back_addr":"172.21.15.61:6825/202284814","heartbeat_front_addr":"172.21.15.61:6823/202284814","state":["exists","up"]},{"osd":3,"uuid":"4c9531e9-302c-4bc3-a901-5a59968e1555","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6826","nonce":2924456645},{"type":"v1","addr":"172.21.15.61:6827","nonce":2924456645}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6828","nonce":2924456645},{"type":"v1","addr":"172.21.15.61:6829","nonce":2924456645}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6832","nonce":2924456645},{"type":"v1","addr":"172.21.15.61:6833","nonce":2924456645}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.61:6830","nonce":2924456645},{"type":"v1","addr":"172.21.15.61:6831","nonce":2924456645}]},"public_addr":"172.21.15.61:6827/2924456645","cluster_addr":"172.21.15.61:6829/2924456645","heartbeat_back_addr":"172.21.15.61:6833/2924456645","heartbeat_front_addr":"172.21.15.61:6831/2924456645","state":["exists","up"]},{"osd":4,"uuid":"c0f8bb6b-02e3-40d7-962b-f785dafc8fb1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":3073415180},{"type":"v1","addr":"172.21.15.67:6801","nonce":3073415180}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":3073415180},{"type":"v1","addr":"172.21.15.67:6803","nonce":3073415180}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":3073415180},{"type":"v1","addr":"172.21.15.67:6807","nonce":3073415180}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":3073415180},{"type":"v1","addr":"172.21.15.67:6805","nonce":3073415180}]},"public_addr":"172.21.15.67:6801/3073415180","cluster_addr":"172.21.15.67:6803/3073415180","heartbeat_back_addr":"172.21.15.67:6807/3073415180","heartbeat_front_addr":"172.21.15.67:6805/3073415180","state":["exists","up"]},{"osd":5,"uuid":"47cdbc39-ac2d-4efa-b4b0-09208dafcb53","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":2120095062},{"type":"v1","addr":"172.21.15.67:6809","nonce":2120095062}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":2120095062},{"type":"v1","addr":"172.21.15.67:6811","nonce":2120095062}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":2120095062},{"type":"v1","addr":"172.21.15.67:6815","nonce":2120095062}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":2120095062},{"type":"v1","addr":"172.21.15.67:6813","nonce":2120095062}]},"public_addr":"172.21.15.67:6809/2120095062","cluster_addr":"172.21.15.67:6811/2120095062","heartbeat_back_addr":"172.21.15.67:6815/2120095062","heartbeat_front_addr":"172.21.15.67:6813/2120095062","state":["exists","up"]},{"osd":6,"uuid":"be197266-9c3f-4805-a415-051b83b8928d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":1690107995},{"type":"v1","addr":"172.21.15.67:6817","nonce":1690107995}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":1690107995},{"type":"v1","addr":"172.21.15.67:6819","nonce":1690107995}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":1690107995},{"type":"v1","addr":"172.21.15.67:6823","nonce":1690107995}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":1690107995},{"type":"v1","addr":"172.21.15.67:6821","nonce":1690107995}]},"public_addr":"172.21.15.67:6817/1690107995","cluster_addr":"172.21.15.67:6819/1690107995","heartbeat_back_addr":"172.21.15.67:6823/1690107995","heartbeat_front_addr":"172.21.15.67:6821/1690107995","state":["exists","up"]},{"osd":7,"uuid":"d18023ab-67f4-450c-88f8-778377dbc8cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":47,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":1884004110},{"type":"v1","addr":"172.21.15.67:6825","nonce":1884004110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6826","nonce":1884004110},{"type":"v1","addr":"172.21.15.67:6827","nonce":1884004110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6830","nonce":1884004110},{"type":"v1","addr":"172.21.15.67:6831","nonce":1884004110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6828","nonce":1884004110},{"type":"v1","addr":"172.21.15.67:6829","nonce":1884004110}]},"public_addr":"172.21.15.67:6825/1884004110","cluster_addr":"172.21.15.67:6827/1884004110","heartbeat_back_addr":"172.21.15.67:6831/1884004110","heartbeat_front_addr":"172.21.15.67:6829/1884004110","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:22:36.232772+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:22:53.476636+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:23:10.401044+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:23:27.675208+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:23:41.644052+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:23:56.170503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:24:11.584716+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2022-03-17T15:24:26.222885+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.61:0/1359368918":"2022-03-18T15:21:07.191133+0000","172.21.15.61:6801/3738782809":"2022-03-18T15:21:07.191133+0000","172.21.15.61:0/2650733340":"2022-03-18T15:21:07.191133+0000","172.21.15.61:0/285700093":"2022-03-18T15:20:52.995106+0000","172.21.15.61:6800/3738782809":"2022-03-18T15:21:07.191133+0000","172.21.15.61:0/1412253848":"2022-03-18T15:20:52.995106+0000","172.21.15.61:6801/4166619409":"2022-03-18T15:20:52.995106+0000","172.21.15.61:6800/4166619409":"2022-03-18T15:20:52.995106+0000","172.21.15.61:0/1276352873":"2022-03-18T15:20:30.277220+0000","172.21.15.61:0/3536037008":"2022-03-18T15:20:30.277220+0000","172.21.15.61:6800/2797168280":"2022-03-18T15:20:30.277220+0000","172.21.15.61:6801/2797168280":"2022-03-18T15:20:30.277220+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2022-03-17T15:24:43.741 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2022-03-17T15:24:44.194 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:24:44.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:24:43.395967+0000 mon.smithi061 (mon.0) 501 : audit [DBG] from='client.? 172.21.15.61:0/3522166727' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-03-17T15:24:44.388 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:24:43.395967+0000 mon.smithi061 (mon.0) 501 : audit [DBG] from='client.? 172.21.15.61:0/3522166727' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2022-03-17T15:24:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:43.537494+0000 mgr.smithi061.kxplwz (mgr.14164) 172 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:45.403 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:43.537494+0000 mgr.smithi061.kxplwz (mgr.14164) 172 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:45.819 INFO:teuthology.orchestra.run.smithi061.stdout:38654705693 2022-03-17T15:24:45.820 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2022-03-17T15:24:46.277 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:24:47.239 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:45.537883+0000 mgr.smithi061.kxplwz (mgr.14164) 173 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:45.537883+0000 mgr.smithi061.kxplwz (mgr.14164) 173 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:47.899 INFO:teuthology.orchestra.run.smithi061.stdout:60129542168 2022-03-17T15:24:47.900 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2022-03-17T15:24:48.357 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:24:49.281 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:47.538232+0000 mgr.smithi061.kxplwz (mgr.14164) 174 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:47.538232+0000 mgr.smithi061.kxplwz (mgr.14164) 174 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:49.969 INFO:teuthology.orchestra.run.smithi061.stdout:81604378645 2022-03-17T15:24:49.969 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2022-03-17T15:24:50.427 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:24:51.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:49.538813+0000 mgr.smithi061.kxplwz (mgr.14164) 175 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:51.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:49.538813+0000 mgr.smithi061.kxplwz (mgr.14164) 175 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:52.151 INFO:teuthology.orchestra.run.smithi061.stdout:115964117011 2022-03-17T15:24:52.151 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2022-03-17T15:24:52.609 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:24:53.336 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:51.539138+0000 mgr.smithi061.kxplwz (mgr.14164) 176 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:53.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:51.539138+0000 mgr.smithi061.kxplwz (mgr.14164) 176 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:54.231 INFO:teuthology.orchestra.run.smithi061.stdout:133143986193 2022-03-17T15:24:54.232 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2022-03-17T15:24:54.689 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:24:55.196 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:53.539563+0000 mgr.smithi061.kxplwz (mgr.14164) 177 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:53.539563+0000 mgr.smithi061.kxplwz (mgr.14164) 177 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:56.210 INFO:teuthology.orchestra.run.smithi061.stdout:154618822671 2022-03-17T15:24:56.212 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2022-03-17T15:24:56.670 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:24:57.163 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:55.539889+0000 mgr.smithi061.kxplwz (mgr.14164) 178 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:57.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:55.539889+0000 mgr.smithi061.kxplwz (mgr.14164) 178 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:58.281 INFO:teuthology.orchestra.run.smithi061.stdout:176093659147 2022-03-17T15:24:58.282 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2022-03-17T15:24:58.739 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:24:59.229 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:24:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:57.540292+0000 mgr.smithi061.kxplwz (mgr.14164) 179 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:24:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:24:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:57.540292+0000 mgr.smithi061.kxplwz (mgr.14164) 179 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:00.363 INFO:teuthology.orchestra.run.smithi061.stdout:197568495625 2022-03-17T15:25:00.363 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.0 2022-03-17T15:25:00.820 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:25:01.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:24:59.540626+0000 mgr.smithi061.kxplwz (mgr.14164) 180 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:01.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:24:59.540626+0000 mgr.smithi061.kxplwz (mgr.14164) 180 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:02.103 INFO:teuthology.orchestra.run.smithi061.stdout:38654705696 2022-03-17T15:25:02.543 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705693 got 38654705696 for osd.0 2022-03-17T15:25:02.543 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.1 2022-03-17T15:25:03.000 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:25:03.386 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:01.540973+0000 mgr.smithi061.kxplwz (mgr.14164) 181 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:03.386 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:02.101508+0000 mon.smithi061 (mon.0) 502 : audit [DBG] from='client.? 172.21.15.61:0/3192631864' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2022-03-17T15:25:03.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:01.540973+0000 mgr.smithi061.kxplwz (mgr.14164) 181 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:03.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:02.101508+0000 mon.smithi061 (mon.0) 502 : audit [DBG] from='client.? 172.21.15.61:0/3192631864' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2022-03-17T15:25:04.446 INFO:teuthology.orchestra.run.smithi061.stdout:60129542171 2022-03-17T15:25:04.830 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542168 got 60129542171 for osd.1 2022-03-17T15:25:04.830 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.2 2022-03-17T15:25:05.285 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:25:05.499 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:03.541532+0000 mgr.smithi061.kxplwz (mgr.14164) 182 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:05.500 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:04.444124+0000 mon.smithi061 (mon.0) 503 : audit [DBG] from='client.? 172.21.15.61:0/2994601228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2022-03-17T15:25:05.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:03.541532+0000 mgr.smithi061.kxplwz (mgr.14164) 182 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:05.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:04.444124+0000 mon.smithi061 (mon.0) 503 : audit [DBG] from='client.? 172.21.15.61:0/2994601228' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2022-03-17T15:25:06.594 INFO:teuthology.orchestra.run.smithi061.stdout:81604378648 2022-03-17T15:25:07.010 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378645 got 81604378648 for osd.2 2022-03-17T15:25:07.011 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.3 2022-03-17T15:25:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:05.541832+0000 mgr.smithi061.kxplwz (mgr.14164) 183 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:06.592791+0000 mon.smithi061 (mon.0) 504 : audit [DBG] from='client.? 172.21.15.61:0/3627530123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2022-03-17T15:25:07.468 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:25:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:05.541832+0000 mgr.smithi061.kxplwz (mgr.14164) 183 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:07.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:06.592791+0000 mon.smithi061 (mon.0) 504 : audit [DBG] from='client.? 172.21.15.61:0/3627530123' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2022-03-17T15:25:08.803 INFO:teuthology.orchestra.run.smithi061.stdout:115964117014 2022-03-17T15:25:09.194 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117011 got 115964117014 for osd.3 2022-03-17T15:25:09.195 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.4 2022-03-17T15:25:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:07.542100+0000 mgr.smithi061.kxplwz (mgr.14164) 184 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:08.801181+0000 mon.smithi061 (mon.0) 505 : audit [DBG] from='client.? 172.21.15.61:0/3022800054' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2022-03-17T15:25:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:07.542100+0000 mgr.smithi061.kxplwz (mgr.14164) 184 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:08.801181+0000 mon.smithi061 (mon.0) 505 : audit [DBG] from='client.? 172.21.15.61:0/3022800054' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2022-03-17T15:25:09.649 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:25:10.186 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:09.186377+0000 mon.smithi061 (mon.0) 506 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:25:10.187 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:09.186702+0000 mon.smithi061 (mon.0) 507 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:25:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:09.186377+0000 mon.smithi061 (mon.0) 506 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:25:10.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:09.186702+0000 mon.smithi061 (mon.0) 507 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:25:11.047 INFO:teuthology.orchestra.run.smithi061.stdout:133143986196 2022-03-17T15:25:11.404 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:09.542420+0000 mgr.smithi061.kxplwz (mgr.14164) 185 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:11.405 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:11.044893+0000 mon.smithi061 (mon.0) 508 : audit [DBG] from='client.? 172.21.15.61:0/3548836927' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2022-03-17T15:25:11.461 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986193 got 133143986196 for osd.4 2022-03-17T15:25:11.462 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.5 2022-03-17T15:25:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:09.542420+0000 mgr.smithi061.kxplwz (mgr.14164) 185 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:11.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:11.044893+0000 mon.smithi061 (mon.0) 508 : audit [DBG] from='client.? 172.21.15.61:0/3548836927' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2022-03-17T15:25:11.920 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:25:13.264 INFO:teuthology.orchestra.run.smithi061.stdout:154618822674 2022-03-17T15:25:13.285 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:11.542766+0000 mgr.smithi061.kxplwz (mgr.14164) 186 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:13.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:11.542766+0000 mgr.smithi061.kxplwz (mgr.14164) 186 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:13.633 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822671 got 154618822674 for osd.5 2022-03-17T15:25:13.634 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.6 2022-03-17T15:25:13.988 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:25:14.386 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:13.261794+0000 mon.smithi061 (mon.0) 509 : audit [DBG] from='client.? 172.21.15.61:0/2411664711' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2022-03-17T15:25:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:13.261794+0000 mon.smithi061 (mon.0) 509 : audit [DBG] from='client.? 172.21.15.61:0/2411664711' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2022-03-17T15:25:15.295 INFO:teuthology.orchestra.run.smithi061.stdout:176093659150 2022-03-17T15:25:15.435 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:13.543080+0000 mgr.smithi061.kxplwz (mgr.14164) 187 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:15.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:13.543080+0000 mgr.smithi061.kxplwz (mgr.14164) 187 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:15.702 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659147 got 176093659150 for osd.6 2022-03-17T15:25:15.703 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph osd last-stat-seq osd.7 2022-03-17T15:25:16.159 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:25:16.397 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:15.293100+0000 mon.smithi061 (mon.0) 510 : audit [DBG] from='client.? 172.21.15.61:0/968107221' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2022-03-17T15:25:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:15.293100+0000 mon.smithi061 (mon.0) 510 : audit [DBG] from='client.? 172.21.15.61:0/968107221' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2022-03-17T15:25:17.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:15.543675+0000 mgr.smithi061.kxplwz (mgr.14164) 188 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:17.518 INFO:teuthology.orchestra.run.smithi061.stdout:197568495628 2022-03-17T15:25:17.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:15.543675+0000 mgr.smithi061.kxplwz (mgr.14164) 188 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:17.881 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495625 got 197568495628 for osd.7 2022-03-17T15:25:17.882 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2022-03-17T15:25:17.882 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph pg dump --format=json 2022-03-17T15:25:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:17.514411+0000 mon.smithi061 (mon.0) 511 : audit [DBG] from='client.? 172.21.15.61:0/1808775790' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2022-03-17T15:25:18.338 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:25:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:17.514411+0000 mon.smithi061 (mon.0) 511 : audit [DBG] from='client.? 172.21.15.61:0/1808775790' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2022-03-17T15:25:19.536 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:25:19.537 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2022-03-17T15:25:19.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:17.544094+0000 mgr.smithi061.kxplwz (mgr.14164) 189 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:17.544094+0000 mgr.smithi061.kxplwz (mgr.14164) 189 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:19.950 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2022-03-17T15:25:17.543932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":42792,"kb_used_data":3688,"kb_used_omap":0,"kb_used_meta":39040,"kb_avail":749918424,"statfs":{"total":767960285184,"available":767916466176,"internally_reserved":0,"allocated":3776512,"data_stored":1482271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39976960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"48","state":"active+clean","last_fresh":"2022-03-17T15:24:30.341341+0000","last_change":"2022-03-17T15:24:30.341341+0000","last_active":"2022-03-17T15:24:30.341341+0000","last_peered":"2022-03-17T15:24:30.341341+0000","last_clean":"2022-03-17T15:24:30.341341+0000","last_became_active":"2022-03-17T15:24:30.340908+0000","last_became_peered":"2022-03-17T15:24:30.340908+0000","last_unstale":"2022-03-17T15:24:30.341341+0000","last_undegraded":"2022-03-17T15:24:30.341341+0000","last_fullsized":"2022-03-17T15:24:30.341341+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-17T15:23:24.624528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-17T15:23:24.624528+0000","last_clean_scrub_stamp":"2022-03-17T15:23:24.624528+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":46,"seq":197568495628,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5204,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93739948,"statfs":{"total":95995035648,"available":95989706752,"internally_reserved":0,"allocated":471040,"data_stored":185192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]}]},{"osd":6,"up_from":41,"seq":176093659151,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5264,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93739888,"statfs":{"total":95995035648,"available":95989645312,"internally_reserved":0,"allocated":466944,"data_stored":184912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 17 15:25:13 2022","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.56000000000000005}]},{"osd":1,"last update":"Thu Mar 17 15:25:13 2022","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Mar 17 15:25:13 2022","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.56799999999999995}]},{"osd":3,"last update":"Thu Mar 17 15:25:13 2022","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.746}]},{"osd":4,"last update":"Thu Mar 17 15:25:13 2022","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.438},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.42099999999999999}]},{"osd":5,"last update":"Thu Mar 17 15:25:13 2022","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.5},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54100000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542174,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5460,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739692,"statfs":{"total":95995035648,"available":95989444608,"internally_reserved":0,"allocated":471040,"data_stored":185192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 17 15:24:55 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.32500000000000001},"min":{"1min":0.247,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.34200000000000003,"15min":0.33500000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Mar 17 15:24:17 2022","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.45500000000000002}]},{"osd":3,"last update":"Thu Mar 17 15:24:31 2022","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.496}]},{"osd":4,"last update":"Thu Mar 17 15:24:44 2022","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.55000000000000004}]},{"osd":5,"last update":"Thu Mar 17 15:25:01 2022","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53900000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705699,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5524,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739628,"statfs":{"total":95995035648,"available":95989379072,"internally_reserved":0,"allocated":471040,"data_stored":185227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 17 15:25:01 2022","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.315,"15min":0.311},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.33400000000000002,"15min":0.33200000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.47299999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.30599999999999999}]},{"osd":2,"last update":"Thu Mar 17 15:24:16 2022","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"min":{"1min":0.26300000000000001,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.35899999999999999}]},{"osd":3,"last update":"Thu Mar 17 15:24:29 2022","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.377}]},{"osd":4,"last update":"Thu Mar 17 15:24:43 2022","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.64400000000000002}]},{"osd":5,"last update":"Thu Mar 17 15:25:01 2022","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Mar 17 15:25:13 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.5},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56299999999999994}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378650,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5396,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739756,"statfs":{"total":95995035648,"available":95989510144,"internally_reserved":0,"allocated":471040,"data_stored":185227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 17 15:24:13 2022","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.31}]},{"osd":1,"last update":"Thu Mar 17 15:24:13 2022","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Mar 17 15:24:33 2022","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Mar 17 15:24:44 2022","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Mar 17 15:24:59 2022","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":3,"up_from":27,"seq":115964117016,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5336,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739816,"statfs":{"total":95995035648,"available":95989571584,"internally_reserved":0,"allocated":475136,"data_stored":185507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 17 15:24:31 2022","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.443},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Mar 17 15:24:31 2022","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.45400000000000001}]},{"osd":2,"last update":"Thu Mar 17 15:24:31 2022","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.48499999999999999}]},{"osd":4,"last update":"Thu Mar 17 15:24:46 2022","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.67600000000000005}]},{"osd":5,"last update":"Thu Mar 17 15:24:59 2022","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.624},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.72699999999999998}]},{"osd":6,"last update":"Thu Mar 17 15:25:13 2022","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.59499999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]}]},{"osd":4,"up_from":31,"seq":133143986197,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5336,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739816,"statfs":{"total":95995035648,"available":95989571584,"internally_reserved":0,"allocated":475136,"data_stored":185507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 17 15:24:45 2022","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.54700000000000004}]},{"osd":1,"last update":"Thu Mar 17 15:24:45 2022","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.42199999999999999}]},{"osd":2,"last update":"Thu Mar 17 15:24:45 2022","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.37},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.60099999999999998}]},{"osd":3,"last update":"Thu Mar 17 15:24:45 2022","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.438},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.46999999999999997}]},{"osd":5,"last update":"Thu Mar 17 15:25:00 2022","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.495}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65400000000000003}]}]},{"osd":5,"up_from":36,"seq":154618822675,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5272,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93739880,"statfs":{"total":95995035648,"available":95989637120,"internally_reserved":0,"allocated":475136,"data_stored":185507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 17 15:25:00 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.45100000000000001}]},{"osd":1,"last update":"Thu Mar 17 15:25:00 2022","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Mar 17 15:25:00 2022","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.376},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.55000000000000004}]},{"osd":3,"last update":"Thu Mar 17 15:25:00 2022","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Mar 17 15:25:00 2022","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.43099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-03-17T15:25:19.952 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph pg dump --format=json 2022-03-17T15:25:20.410 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:25:21.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:19.529776+0000 mgr.smithi061.kxplwz (mgr.14164) 190 : audit [DBG] from='client.14456 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-03-17T15:25:21.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:19.544586+0000 mgr.smithi061.kxplwz (mgr.14164) 191 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:21.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:19.529776+0000 mgr.smithi061.kxplwz (mgr.14164) 190 : audit [DBG] from='client.14456 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-03-17T15:25:21.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:19.544586+0000 mgr.smithi061.kxplwz (mgr.14164) 191 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:21.756 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:25:21.758 INFO:teuthology.orchestra.run.smithi061.stderr:dumped all 2022-03-17T15:25:22.138 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2022-03-17T15:25:21.544760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":42792,"kb_used_data":3688,"kb_used_omap":0,"kb_used_meta":39040,"kb_avail":749918424,"statfs":{"total":767960285184,"available":767916466176,"internally_reserved":0,"allocated":3776512,"data_stored":1482271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39976960},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"48","state":"active+clean","last_fresh":"2022-03-17T15:24:30.341341+0000","last_change":"2022-03-17T15:24:30.341341+0000","last_active":"2022-03-17T15:24:30.341341+0000","last_peered":"2022-03-17T15:24:30.341341+0000","last_clean":"2022-03-17T15:24:30.341341+0000","last_became_active":"2022-03-17T15:24:30.340908+0000","last_became_peered":"2022-03-17T15:24:30.340908+0000","last_unstale":"2022-03-17T15:24:30.341341+0000","last_undegraded":"2022-03-17T15:24:30.341341+0000","last_fullsized":"2022-03-17T15:24:30.341341+0000","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-03-17T15:23:24.624528+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-03-17T15:23:24.624528+0000","last_clean_scrub_stamp":"2022-03-17T15:23:24.624528+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":46,"seq":197568495629,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5204,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":4736,"kb_avail":93739948,"statfs":{"total":95995035648,"available":95989706752,"internally_reserved":0,"allocated":471040,"data_stored":185192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4849664},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":6,"up_from":41,"seq":176093659152,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5264,"kb_used_data":456,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93739888,"statfs":{"total":95995035648,"available":95989645312,"internally_reserved":0,"allocated":466944,"data_stored":184912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 17 15:25:13 2022","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.371}]},{"osd":1,"last update":"Thu Mar 17 15:25:13 2022","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.314},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.47399999999999998}]},{"osd":2,"last update":"Thu Mar 17 15:25:13 2022","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.443}]},{"osd":3,"last update":"Thu Mar 17 15:25:13 2022","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.49199999999999999}]},{"osd":4,"last update":"Thu Mar 17 15:25:13 2022","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Mar 17 15:25:13 2022","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.66000000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59999999999999998}]}]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5460,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739692,"statfs":{"total":95995035648,"available":95989444608,"internally_reserved":0,"allocated":471040,"data_stored":185192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 17 15:24:55 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.33300000000000002,"15min":0.32500000000000001},"min":{"1min":0.247,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.34200000000000003,"15min":0.33500000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.25600000000000001}]},{"osd":2,"last update":"Thu Mar 17 15:24:17 2022","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Mar 17 15:24:31 2022","interfaces":[{"interface":"back","average":{"1min":0.435,"5min":0.435,"15min":0.435},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.36399999999999999}]},{"osd":4,"last update":"Thu Mar 17 15:24:44 2022","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.61099999999999999}]},{"osd":5,"last update":"Thu Mar 17 15:25:01 2022","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Mar 17 15:25:16 2022","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.878,"5min":0.878,"15min":0.878},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705700,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":5524,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93739628,"statfs":{"total":95995035648,"available":95989379072,"internally_reserved":0,"allocated":471040,"data_stored":185227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Mar 17 15:25:01 2022","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.315,"15min":0.311},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"last":0.435},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.33400000000000002,"15min":0.33200000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.47299999999999998,"5min":0.51900000000000002,"15min":0.51900000000000002},"last":0.496}]},{"osd":2,"last update":"Thu Mar 17 15:25:18 2022","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35699999999999998,"15min":0.35499999999999998},"min":{"1min":0.26900000000000002,"5min":0.26300000000000001,"15min":0.26300000000000001},"max":{"1min":0.47499999999999998,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.377,"15min":0.375},"min":{"1min":0.30399999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"last":0.53500000000000003}]},{"osd":3,"last update":"Thu Mar 17 15:24:29 2022","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.38,"15min":0.38},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Mar 17 15:24:43 2022","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"last":0.63600000000000001}]},{"osd":5,"last update":"Thu Mar 17 15:25:01 2022","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.68500000000000005}]},{"osd":6,"last update":"Thu Mar 17 15:25:13 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.58499999999999996},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72599999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378651,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5396,"kb_used_data":460,"kb_used_omap":0,"kb_used_meta":4928,"kb_avail":93739756,"statfs":{"total":95995035648,"available":95989510144,"internally_reserved":0,"allocated":471040,"data_stored":185227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5046272},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 17 15:24:13 2022","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"last":0.31}]},{"osd":1,"last update":"Thu Mar 17 15:24:13 2022","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.376,"15min":0.376},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.39900000000000002}]},{"osd":3,"last update":"Thu Mar 17 15:24:33 2022","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.42899999999999999}]},{"osd":4,"last update":"Thu Mar 17 15:24:44 2022","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Mar 17 15:24:59 2022","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.64600000000000002,"5min":0.64600000000000002,"15min":0.64600000000000002},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.67700000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]}]},{"osd":3,"up_from":27,"seq":115964117017,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5336,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739816,"statfs":{"total":95995035648,"available":95989571584,"internally_reserved":0,"allocated":475136,"data_stored":185507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 17 15:24:31 2022","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.21299999999999999,"5min":0.21299999999999999,"15min":0.21299999999999999},"max":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.45600000000000002}]},{"osd":1,"last update":"Thu Mar 17 15:24:31 2022","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.378,"15min":0.378},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27100000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.36099999999999999}]},{"osd":2,"last update":"Thu Mar 17 15:24:31 2022","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.433},{"interface":"front","average":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.376}]},{"osd":4,"last update":"Thu Mar 17 15:24:46 2022","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"last":0.79800000000000004}]},{"osd":5,"last update":"Thu Mar 17 15:24:59 2022","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.64700000000000002}]},{"osd":6,"last update":"Thu Mar 17 15:25:13 2022","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.76500000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]}]},{"osd":4,"up_from":31,"seq":133143986198,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5336,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":93739816,"statfs":{"total":95995035648,"available":95989571584,"internally_reserved":0,"allocated":475136,"data_stored":185507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 17 15:24:45 2022","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.53900000000000003}]},{"osd":1,"last update":"Thu Mar 17 15:24:45 2022","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.23,"5min":1.23,"15min":1.23},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.48099999999999998}]},{"osd":2,"last update":"Thu Mar 17 15:24:45 2022","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.45900000000000002}]},{"osd":3,"last update":"Thu Mar 17 15:24:45 2022","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.248,"5min":1.248,"15min":1.248},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.1890000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Mar 17 15:25:00 2022","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.44},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.63}]},{"osd":6,"last update":"Thu Mar 17 15:25:15 2022","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61199999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]}]},{"osd":5,"up_from":36,"seq":154618822676,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5272,"kb_used_data":464,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":93739880,"statfs":{"total":95995035648,"available":95989637120,"internally_reserved":0,"allocated":475136,"data_stored":185507,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Mar 17 15:25:00 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.47399999999999998}]},{"osd":1,"last update":"Thu Mar 17 15:25:00 2022","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.497},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.58299999999999996}]},{"osd":2,"last update":"Thu Mar 17 15:25:00 2022","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Mar 17 15:25:00 2022","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"last":0.626},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.65000000000000002}]},{"osd":4,"last update":"Thu Mar 17 15:25:00 2022","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.66200000000000003}]},{"osd":6,"last update":"Thu Mar 17 15:25:18 2022","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.71199999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"last":0.372}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-03-17T15:25:22.139 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2022-03-17T15:25:22.140 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2022-03-17T15:25:22.140 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2022-03-17T15:25:22.140 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph health --format=json 2022-03-17T15:25:22.598 INFO:teuthology.orchestra.run.smithi061.stderr:Inferring config /var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/mon.smithi061/config 2022-03-17T15:25:23.535 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:21.544901+0000 mgr.smithi061.kxplwz (mgr.14164) 192 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:23.535 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:21.751885+0000 mgr.smithi061.kxplwz (mgr.14164) 193 : audit [DBG] from='client.14460 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-03-17T15:25:23.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:21.544901+0000 mgr.smithi061.kxplwz (mgr.14164) 192 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:23.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:21.751885+0000 mgr.smithi061.kxplwz (mgr.14164) 193 : audit [DBG] from='client.14460 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-03-17T15:25:23.940 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:25:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:23.938996+0000 mon.smithi061 (mon.0) 512 : audit [DBG] from='client.? 172.21.15.61:0/3841985767' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2022-03-17T15:25:24.410 INFO:teuthology.orchestra.run.smithi061.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2022-03-17T15:25:24.411 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2022-03-17T15:25:24.411 INFO:tasks.cephadm:Setup complete, yielding 2022-03-17T15:25:24.412 INFO:teuthology.run_tasks:Running task cephadm.shell... 2022-03-17T15:25:24.422 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi061.front.sepia.ceph.com 2022-03-17T15:25:24.423 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- bash -c 'ceph orch status' 2022-03-17T15:25:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:23.938996+0000 mon.smithi061 (mon.0) 512 : audit [DBG] from='client.? 172.21.15.61:0/3841985767' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2022-03-17T15:25:25.268 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:23.545234+0000 mgr.smithi061.kxplwz (mgr.14164) 194 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:25.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:23.545234+0000 mgr.smithi061.kxplwz (mgr.14164) 194 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:26.199 INFO:teuthology.orchestra.run.smithi061.stdout:Backend: cephadm 2022-03-17T15:25:26.199 INFO:teuthology.orchestra.run.smithi061.stdout:Available: Yes 2022-03-17T15:25:26.200 INFO:teuthology.orchestra.run.smithi061.stdout:Paused: No 2022-03-17T15:25:26.566 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- bash -c 'ceph orch ps' 2022-03-17T15:25:27.442 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:25.545576+0000 mgr.smithi061.kxplwz (mgr.14164) 195 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:27.443 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:26.196327+0000 mgr.smithi061.kxplwz (mgr.14164) 196 : audit [DBG] from='client.14468 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:27.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:25.545576+0000 mgr.smithi061.kxplwz (mgr.14164) 195 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:27.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:26.196327+0000 mgr.smithi061.kxplwz (mgr.14164) 196 : audit [DBG] from='client.14468 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:27.569192+0000 mon.smithi061 (mon.0) 513 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:25:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:27.961237+0000 mon.smithi061 (mon.0) 514 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:28.349 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2022-03-17T15:25:28.349 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2m) 76s ago 4m 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:25:28.349 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4m) 76s ago 4m 16.2.4 8d91d370c2b8 35aa99cfae95 2022-03-17T15:25:28.350 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3m) 63s ago 3m 16.2.4 8d91d370c2b8 056e5956721e 2022-03-17T15:25:28.350 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2m) 76s ago 3m 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:25:28.350 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:9283 running (5m) 76s ago 5m 16.2.4 8d91d370c2b8 f30655c578ce 2022-03-17T15:25:28.350 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3m) 63s ago 3m 16.2.4 8d91d370c2b8 4aeaa4c7a497 2022-03-17T15:25:28.351 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5m) 76s ago 5m 16.2.4 8d91d370c2b8 e511ef468147 2022-03-17T15:25:28.351 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3m) 63s ago 3m 16.2.4 8d91d370c2b8 6ba46ec348ed 2022-03-17T15:25:28.351 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3m) 76s ago 3m 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:25:28.351 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3m) 63s ago 3m 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:25:28.351 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2m) 76s ago 2m 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:25:28.352 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2m) 76s ago 2m 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:25:28.352 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2m) 76s ago 2m 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:25:28.352 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2m) 76s ago 2m 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:25:28.352 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (111s) 63s ago 110s 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:25:28.353 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (96s) 63s ago 96s 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:25:28.353 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (81s) 63s ago 81s 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:25:28.353 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (66s) 63s ago 66s 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:25:28.353 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2m) 76s ago 3m 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:25:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:27.569192+0000 mon.smithi061 (mon.0) 513 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:25:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:27.961237+0000 mon.smithi061 (mon.0) 514 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:28.709 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- bash -c 'ceph orch ls' 2022-03-17T15:25:29.517 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:27.546071+0000 mgr.smithi061.kxplwz (mgr.14164) 197 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:29.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:27.546071+0000 mgr.smithi061.kxplwz (mgr.14164) 197 : cluster [DBG] pgmap v167: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:28.336964+0000 mgr.smithi061.kxplwz (mgr.14164) 198 : audit [DBG] from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:30.357 INFO:teuthology.orchestra.run.smithi061.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2022-03-17T15:25:30.358 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager 1/1 78s ago 4m count:1 2022-03-17T15:25:30.359 INFO:teuthology.orchestra.run.smithi061.stdout:crash 2/2 78s ago 4m * 2022-03-17T15:25:30.359 INFO:teuthology.orchestra.run.smithi061.stdout:grafana 1/1 78s ago 4m count:1 2022-03-17T15:25:30.360 INFO:teuthology.orchestra.run.smithi061.stdout:mgr 2/2 78s ago 4m count:2 2022-03-17T15:25:30.360 INFO:teuthology.orchestra.run.smithi061.stdout:mon 2/2 78s ago 3m smithi061:172.21.15.61=smithi061;smithi067:172.21.15.67=smithi067;count:2 2022-03-17T15:25:30.361 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter 2/2 78s ago 4m * 2022-03-17T15:25:30.361 INFO:teuthology.orchestra.run.smithi061.stdout:osd.unmanaged 8/8 78s ago - 2022-03-17T15:25:30.362 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus 1/1 78s ago 4m count:1 2022-03-17T15:25:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:28.336964+0000 mgr.smithi061.kxplwz (mgr.14164) 198 : audit [DBG] from='client.14472 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:30.751 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- bash -c 'ceph orch host ls' 2022-03-17T15:25:31.452 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:29.546535+0000 mgr.smithi061.kxplwz (mgr.14164) 199 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:31.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:29.546535+0000 mgr.smithi061.kxplwz (mgr.14164) 199 : cluster [DBG] pgmap v168: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:32.393 INFO:teuthology.orchestra.run.smithi061.stdout:HOST ADDR LABELS STATUS 2022-03-17T15:25:32.394 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061 172.21.15.61 2022-03-17T15:25:32.394 INFO:teuthology.orchestra.run.smithi061.stdout:smithi067 smithi067 2022-03-17T15:25:32.422 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:30.350888+0000 mgr.smithi061.kxplwz (mgr.14164) 200 : audit [DBG] from='client.14476 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:30.350888+0000 mgr.smithi061.kxplwz (mgr.14164) 200 : audit [DBG] from='client.14476 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:32.781 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- bash -c 'ceph orch device ls' 2022-03-17T15:25:33.472 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:31.547172+0000 mgr.smithi061.kxplwz (mgr.14164) 201 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:33.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:31.547172+0000 mgr.smithi061.kxplwz (mgr.14164) 201 : cluster [DBG] pgmap v169: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:34.195 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:32.390643+0000 mgr.smithi061.kxplwz (mgr.14164) 202 : audit [DBG] from='client.14480 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:34.511 INFO:teuthology.orchestra.run.smithi061.stdout:Hostname Path Type Serial Size Health Ident Fault Available 2022-03-17T15:25:34.512 INFO:teuthology.orchestra.run.smithi061.stdout:smithi061 /dev/nvme0n1 ssd CVFT534300NV400BGN 400G Unknown N/A N/A No 2022-03-17T15:25:34.512 INFO:teuthology.orchestra.run.smithi061.stdout:smithi067 /dev/nvme0n1 ssd CVFT53440042400BGN 400G Unknown N/A N/A No 2022-03-17T15:25:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:32.390643+0000 mgr.smithi061.kxplwz (mgr.14164) 202 : audit [DBG] from='client.14480 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:34.911 INFO:teuthology.run_tasks:Running task vip.exec... 2022-03-17T15:25:34.927 INFO:tasks.vip:Running commands on role host.a host ubuntu@smithi061.front.sepia.ceph.com 2022-03-17T15:25:34.928 DEBUG:teuthology.orchestra.run.smithi061:> sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'systemctl stop nfs-server' 2022-03-17T15:25:34.957 INFO:teuthology.orchestra.run.smithi061.stderr:+ systemctl stop nfs-server 2022-03-17T15:25:34.965 INFO:tasks.vip:Running commands on role host.b host ubuntu@smithi067.front.sepia.ceph.com 2022-03-17T15:25:34.965 DEBUG:teuthology.orchestra.run.smithi067:> sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'systemctl stop nfs-server' 2022-03-17T15:25:35.003 INFO:teuthology.orchestra.run.smithi067.stderr:+ systemctl stop nfs-server 2022-03-17T15:25:35.012 INFO:teuthology.run_tasks:Running task cephadm.shell... 2022-03-17T15:25:35.023 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi061.front.sepia.ceph.com 2022-03-17T15:25:35.024 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- bash -c 'ceph fs volume create foofs' 2022-03-17T15:25:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:33.547476+0000 mgr.smithi061.kxplwz (mgr.14164) 203 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:33.547476+0000 mgr.smithi061.kxplwz (mgr.14164) 203 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:36.437 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:34.508393+0000 mgr.smithi061.kxplwz (mgr.14164) 204 : audit [DBG] from='client.14484 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:34.508393+0000 mgr.smithi061.kxplwz (mgr.14164) 204 : audit [DBG] from='client.14484 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:35.547797+0000 mgr.smithi061.kxplwz (mgr.14164) 205 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:35.547797+0000 mgr.smithi061.kxplwz (mgr.14164) 205 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:36.793401+0000 mgr.smithi061.kxplwz (mgr.14164) 206 : audit [DBG] from='client.14488 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "foofs", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:36.793944+0000 mon.smithi061 (mon.0) 515 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool create", "pool": "cephfs.foofs.meta"}]: dispatch 2022-03-17T15:25:38.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:37.560522+0000 mon.smithi061 (mon.0) 516 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pool create", "pool": "cephfs.foofs.meta"}]': finished 2022-03-17T15:25:38.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:37.560576+0000 mon.smithi061 (mon.0) 517 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2022-03-17T15:25:38.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:37.561514+0000 mon.smithi061 (mon.0) 518 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool create", "pool": "cephfs.foofs.data"}]: dispatch 2022-03-17T15:25:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:36.793401+0000 mgr.smithi061.kxplwz (mgr.14164) 206 : audit [DBG] from='client.14488 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "foofs", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:36.793944+0000 mon.smithi061 (mon.0) 515 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool create", "pool": "cephfs.foofs.meta"}]: dispatch 2022-03-17T15:25:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:37.560522+0000 mon.smithi061 (mon.0) 516 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pool create", "pool": "cephfs.foofs.meta"}]': finished 2022-03-17T15:25:38.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:37.560576+0000 mon.smithi061 (mon.0) 517 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2022-03-17T15:25:38.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:37.561514+0000 mon.smithi061 (mon.0) 518 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool create", "pool": "cephfs.foofs.data"}]: dispatch 2022-03-17T15:25:38.972 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:25:38.576+0000 7f71aa064700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-03-17T15:25:39.068 INFO:teuthology.run_tasks:Running task cephadm.wait_for_service... 2022-03-17T15:25:39.079 INFO:tasks.cephadm:Waiting for ceph service mds.foofs to start (timeout 300)... 2022-03-17T15:25:39.080 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph orch ls -f json 2022-03-17T15:25:39.500 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:37.548297+0000 mgr.smithi061.kxplwz (mgr.14164) 207 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:39.500 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:38.570459+0000 mon.smithi061 (mon.0) 519 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pool create", "pool": "cephfs.foofs.data"}]': finished 2022-03-17T15:25:39.500 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:38.570715+0000 mon.smithi061 (mon.0) 520 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2022-03-17T15:25:39.501 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:38.575805+0000 mon.smithi061 (mon.0) 521 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "fs new", "fs_name": "foofs", "metadata": "cephfs.foofs.meta", "data": "cephfs.foofs.data"}]: dispatch 2022-03-17T15:25:39.501 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:38.576684+0000 mon.smithi061 (mon.0) 522 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-03-17T15:25:39.501 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:38.576717+0000 mon.smithi061 (mon.0) 523 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2022-03-17T15:25:39.501 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:38.588976+0000 mon.smithi061 (mon.0) 524 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2022-03-17T15:25:39.501 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:38.589169+0000 mon.smithi061 (mon.0) 525 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "fs new", "fs_name": "foofs", "metadata": "cephfs.foofs.meta", "data": "cephfs.foofs.data"}]': finished 2022-03-17T15:25:39.502 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:38.589225+0000 mon.smithi061 (mon.0) 526 : cluster [DBG] fsmap foofs:0 2022-03-17T15:25:39.502 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:38.595617+0000 mon.smithi061 (mon.0) 527 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:39.502 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:38.596363+0000 mon.smithi061 (mon.0) 528 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:25:39.502 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:38.608713+0000 mon.smithi061 (mon.0) 529 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:39.503 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:38.615012+0000 mon.smithi061 (mon.0) 530 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:39.503 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:38.615837+0000 mon.smithi061 (mon.0) 531 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.foofs.smithi061.atvhsa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-03-17T15:25:39.503 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:38.619038+0000 mon.smithi061 (mon.0) 532 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foofs.smithi061.atvhsa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-03-17T15:25:39.503 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:38.619691+0000 mon.smithi061 (mon.0) 533 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:25:39.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:37.548297+0000 mgr.smithi061.kxplwz (mgr.14164) 207 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:39.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:38.570459+0000 mon.smithi061 (mon.0) 519 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pool create", "pool": "cephfs.foofs.data"}]': finished 2022-03-17T15:25:39.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:38.570715+0000 mon.smithi061 (mon.0) 520 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2022-03-17T15:25:39.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:38.575805+0000 mon.smithi061 (mon.0) 521 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "fs new", "fs_name": "foofs", "metadata": "cephfs.foofs.meta", "data": "cephfs.foofs.data"}]: dispatch 2022-03-17T15:25:39.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:38.576684+0000 mon.smithi061 (mon.0) 522 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-03-17T15:25:39.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:38.576717+0000 mon.smithi061 (mon.0) 523 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2022-03-17T15:25:39.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:38.588976+0000 mon.smithi061 (mon.0) 524 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2022-03-17T15:25:39.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:38.589169+0000 mon.smithi061 (mon.0) 525 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "fs new", "fs_name": "foofs", "metadata": "cephfs.foofs.meta", "data": "cephfs.foofs.data"}]': finished 2022-03-17T15:25:39.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:38.589225+0000 mon.smithi061 (mon.0) 526 : cluster [DBG] fsmap foofs:0 2022-03-17T15:25:39.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:38.595617+0000 mon.smithi061 (mon.0) 527 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:39.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:38.596363+0000 mon.smithi061 (mon.0) 528 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:25:39.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:38.608713+0000 mon.smithi061 (mon.0) 529 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:39.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:38.615012+0000 mon.smithi061 (mon.0) 530 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:39.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:38.615837+0000 mon.smithi061 (mon.0) 531 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.foofs.smithi061.atvhsa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-03-17T15:25:39.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:38.619038+0000 mon.smithi061 (mon.0) 532 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foofs.smithi061.atvhsa", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-03-17T15:25:39.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:38.619691+0000 mon.smithi061 (mon.0) 533 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:25:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:25:38.591302+0000 mgr.smithi061.kxplwz (mgr.14164) 208 : cephadm [INF] Saving service mds.foofs spec with placement count:2 2022-03-17T15:25:40.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:25:38.620344+0000 mgr.smithi061.kxplwz (mgr.14164) 209 : cephadm [INF] Deploying daemon mds.foofs.smithi061.atvhsa on smithi061 2022-03-17T15:25:40.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:39.589045+0000 mon.smithi061 (mon.0) 534 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2022-03-17T15:25:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:25:38.591302+0000 mgr.smithi061.kxplwz (mgr.14164) 208 : cephadm [INF] Saving service mds.foofs spec with placement count:2 2022-03-17T15:25:40.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:25:38.620344+0000 mgr.smithi061.kxplwz (mgr.14164) 209 : cephadm [INF] Deploying daemon mds.foofs.smithi061.atvhsa on smithi061 2022-03-17T15:25:40.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:39.589045+0000 mon.smithi061 (mon.0) 534 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2022-03-17T15:25:41.117 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:25:41.117 INFO:teuthology.orchestra.run.smithi061.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2022-03-17T15:20:57.890581Z", "last_refresh": "2022-03-17T15:24:12.280483Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2022-03-17T15:20:44.971287Z", "last_refresh": "2022-03-17T15:24:12.280567Z", "running": 2, "size": 2}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "status": {"created": "2022-03-17T15:20:55.396750Z", "last_refresh": "2022-03-17T15:24:12.280650Z", "running": 1, "size": 1}}, {"events": ["2022-03-17T15:25:38.595795Z service:mds.foofs [INFO] \"service was created\""], "placement": {"count": 2}, "service_id": "foofs", "service_name": "mds.foofs", "service_type": "mds", "status": {"created": "2022-03-17T15:25:38.591326Z", "running": 1, "size": 2}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2022-03-17T15:20:43.753361Z", "last_refresh": "2022-03-17T15:24:12.280393Z", "running": 2, "size": 2}}, {"events": ["2022-03-17T15:21:38.595528Z service:mon [INFO] \"service was created\""], "placement": {"count": 2, "hosts": ["smithi061:172.21.15.61=smithi061", "smithi067:172.21.15.67=smithi067"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2022-03-17T15:21:38.593114Z", "last_refresh": "2022-03-17T15:24:12.280235Z", "running": 2, "size": 2}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2022-03-17T15:20:56.787817Z", "last_refresh": "2022-03-17T15:24:12.280731Z", "running": 2, "size": 2}}, {"placement": {}, "service_id": "unmanaged", "service_name": "osd.unmanaged", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29", "container_image_name": "docker.io/ceph/ceph@sha256:54e95ae1e11404157d7b329d0bef866ebbb214b195a009e87aae4eba9d282949", "last_refresh": "2022-03-17T15:24:12.280893Z", "running": 8, "size": 8}, "unmanaged": true}, {"placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2022-03-17T15:20:54.051577Z", "last_refresh": "2022-03-17T15:24:12.280811Z", "running": 1, "size": 1}}] 2022-03-17T15:25:41.499 INFO:tasks.cephadm:mds.foofs has 1/2 2022-03-17T15:25:41.527 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:39.548704+0000 mgr.smithi061.kxplwz (mgr.14164) 210 : cluster [DBG] pgmap v176: 65 pgs: 18 creating+peering, 28 unknown, 19 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:41.527 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:40.592827+0000 mon.smithi061 (mon.0) 535 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2022-03-17T15:25:41.527 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:41.029586+0000 mon.smithi061 (mon.0) 536 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:41.528 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:41.030502+0000 mon.smithi061 (mon.0) 537 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.foofs.smithi067.osftcx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-03-17T15:25:41.528 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:41.035631+0000 mon.smithi061 (mon.0) 538 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foofs.smithi067.osftcx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-03-17T15:25:41.528 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:41.036349+0000 mon.smithi061 (mon.0) 539 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:25:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:39.548704+0000 mgr.smithi061.kxplwz (mgr.14164) 210 : cluster [DBG] pgmap v176: 65 pgs: 18 creating+peering, 28 unknown, 19 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:40.592827+0000 mon.smithi061 (mon.0) 535 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2022-03-17T15:25:41.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:41.029586+0000 mon.smithi061 (mon.0) 536 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:41.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:41.030502+0000 mon.smithi061 (mon.0) 537 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "mds.foofs.smithi067.osftcx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2022-03-17T15:25:41.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:41.035631+0000 mon.smithi061 (mon.0) 538 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "auth get-or-create", "entity": "mds.foofs.smithi067.osftcx", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2022-03-17T15:25:41.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:41.036349+0000 mon.smithi061 (mon.0) 539 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:25:42.500 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- ceph orch ls -f json 2022-03-17T15:25:42.535 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:25:41.036978+0000 mgr.smithi061.kxplwz (mgr.14164) 211 : cephadm [INF] Deploying daemon mds.foofs.smithi067.osftcx on smithi067 2022-03-17T15:25:42.535 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:41.111543+0000 mgr.smithi061.kxplwz (mgr.14164) 212 : audit [DBG] from='client.14492 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-03-17T15:25:42.535 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:41.555962+0000 mon.smithi061 (mon.0) 540 : cluster [INF] daemon mds.foofs.smithi061.atvhsa assigned to filesystem foofs as rank 0 (now has 1 ranks) 2022-03-17T15:25:42.536 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:41.556071+0000 mon.smithi061 (mon.0) 541 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-03-17T15:25:42.536 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:41.556091+0000 mon.smithi061 (mon.0) 542 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2022-03-17T15:25:42.536 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:41.556106+0000 mon.smithi061 (mon.0) 543 : cluster [INF] Cluster is now healthy 2022-03-17T15:25:42.536 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:41.559957+0000 mon.smithi061 (mon.0) 544 : cluster [DBG] mds.? [v2:172.21.15.61:6834/326071404,v1:172.21.15.61:6835/326071404] up:boot 2022-03-17T15:25:42.537 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:41.560019+0000 mon.smithi061 (mon.0) 545 : cluster [DBG] fsmap foofs:1 {0=foofs.smithi061.atvhsa=up:creating} 2022-03-17T15:25:42.537 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:41.560795+0000 mon.smithi061 (mon.0) 546 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi061.atvhsa"}]: dispatch 2022-03-17T15:25:42.537 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:41.574068+0000 mon.smithi061 (mon.0) 547 : cluster [INF] daemon mds.foofs.smithi061.atvhsa is now active in filesystem foofs as rank 0 2022-03-17T15:25:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:25:41.036978+0000 mgr.smithi061.kxplwz (mgr.14164) 211 : cephadm [INF] Deploying daemon mds.foofs.smithi067.osftcx on smithi067 2022-03-17T15:25:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:41.111543+0000 mgr.smithi061.kxplwz (mgr.14164) 212 : audit [DBG] from='client.14492 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-03-17T15:25:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:41.555962+0000 mon.smithi061 (mon.0) 540 : cluster [INF] daemon mds.foofs.smithi061.atvhsa assigned to filesystem foofs as rank 0 (now has 1 ranks) 2022-03-17T15:25:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:41.556071+0000 mon.smithi061 (mon.0) 541 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-03-17T15:25:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:41.556091+0000 mon.smithi061 (mon.0) 542 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2022-03-17T15:25:42.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:41.556106+0000 mon.smithi061 (mon.0) 543 : cluster [INF] Cluster is now healthy 2022-03-17T15:25:42.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:41.559957+0000 mon.smithi061 (mon.0) 544 : cluster [DBG] mds.? [v2:172.21.15.61:6834/326071404,v1:172.21.15.61:6835/326071404] up:boot 2022-03-17T15:25:42.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:41.560019+0000 mon.smithi061 (mon.0) 545 : cluster [DBG] fsmap foofs:1 {0=foofs.smithi061.atvhsa=up:creating} 2022-03-17T15:25:42.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:41.560795+0000 mon.smithi061 (mon.0) 546 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi061.atvhsa"}]: dispatch 2022-03-17T15:25:42.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:41.574068+0000 mon.smithi061 (mon.0) 547 : cluster [INF] daemon mds.foofs.smithi061.atvhsa is now active in filesystem foofs as rank 0 2022-03-17T15:25:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:41.549080+0000 mgr.smithi061.kxplwz (mgr.14164) 213 : cluster [DBG] pgmap v179: 65 pgs: 5 creating+activating, 18 creating+peering, 10 unknown, 32 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:43.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:42.564638+0000 mon.smithi061 (mon.0) 548 : cluster [DBG] mds.? [v2:172.21.15.61:6834/326071404,v1:172.21.15.61:6835/326071404] up:active 2022-03-17T15:25:43.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:42.564713+0000 mon.smithi061 (mon.0) 549 : cluster [DBG] fsmap foofs:1 {0=foofs.smithi061.atvhsa=up:active} 2022-03-17T15:25:43.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:43.063274+0000 mon.smithi061 (mon.0) 550 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:43.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:43.064016+0000 mon.smithi061 (mon.0) 551 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:25:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:41.549080+0000 mgr.smithi061.kxplwz (mgr.14164) 213 : cluster [DBG] pgmap v179: 65 pgs: 5 creating+activating, 18 creating+peering, 10 unknown, 32 active+clean; 0 B data, 42 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:42.564638+0000 mon.smithi061 (mon.0) 548 : cluster [DBG] mds.? [v2:172.21.15.61:6834/326071404,v1:172.21.15.61:6835/326071404] up:active 2022-03-17T15:25:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:42.564713+0000 mon.smithi061 (mon.0) 549 : cluster [DBG] fsmap foofs:1 {0=foofs.smithi061.atvhsa=up:active} 2022-03-17T15:25:43.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:43.063274+0000 mon.smithi061 (mon.0) 550 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:43.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:43.064016+0000 mon.smithi061 (mon.0) 551 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:25:44.258 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:25:44.258 INFO:teuthology.orchestra.run.smithi061.stdout:[{"placement": {"count": 1}, "service_name": "alertmanager", "service_type": "alertmanager", "status": {"created": "2022-03-17T15:20:57.890581Z", "last_refresh": "2022-03-17T15:24:12.280483Z", "running": 1, "size": 1}}, {"placement": {"host_pattern": "*"}, "service_name": "crash", "service_type": "crash", "status": {"created": "2022-03-17T15:20:44.971287Z", "last_refresh": "2022-03-17T15:24:12.280567Z", "running": 2, "size": 2}}, {"placement": {"count": 1}, "service_name": "grafana", "service_type": "grafana", "status": {"created": "2022-03-17T15:20:55.396750Z", "last_refresh": "2022-03-17T15:24:12.280650Z", "running": 1, "size": 1}}, {"events": ["2022-03-17T15:25:38.595795Z service:mds.foofs [INFO] \"service was created\""], "placement": {"count": 2}, "service_id": "foofs", "service_name": "mds.foofs", "service_type": "mds", "status": {"created": "2022-03-17T15:25:38.591326Z", "running": 2, "size": 2}}, {"placement": {"count": 2}, "service_name": "mgr", "service_type": "mgr", "status": {"created": "2022-03-17T15:20:43.753361Z", "last_refresh": "2022-03-17T15:24:12.280393Z", "running": 2, "size": 2}}, {"events": ["2022-03-17T15:21:38.595528Z service:mon [INFO] \"service was created\""], "placement": {"count": 2, "hosts": ["smithi061:172.21.15.61=smithi061", "smithi067:172.21.15.67=smithi067"]}, "service_name": "mon", "service_type": "mon", "status": {"created": "2022-03-17T15:21:38.593114Z", "last_refresh": "2022-03-17T15:24:12.280235Z", "running": 2, "size": 2}}, {"placement": {"host_pattern": "*"}, "service_name": "node-exporter", "service_type": "node-exporter", "status": {"created": "2022-03-17T15:20:56.787817Z", "last_refresh": "2022-03-17T15:24:12.280731Z", "running": 2, "size": 2}}, {"placement": {}, "service_id": "unmanaged", "service_name": "osd.unmanaged", "service_type": "osd", "spec": {"filter_logic": "AND", "objectstore": "bluestore"}, "status": {"container_image_id": "8d91d370c2b86c07de46146aba8d36718eaefa69b1880c77fa312fda6efd7d29", "container_image_name": "docker.io/ceph/ceph@sha256:54e95ae1e11404157d7b329d0bef866ebbb214b195a009e87aae4eba9d282949", "last_refresh": "2022-03-17T15:24:12.280893Z", "running": 8, "size": 8}, "unmanaged": true}, {"placement": {"count": 1}, "service_name": "prometheus", "service_type": "prometheus", "status": {"created": "2022-03-17T15:20:54.051577Z", "last_refresh": "2022-03-17T15:24:12.280811Z", "running": 1, "size": 1}}] 2022-03-17T15:25:44.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:43.549560+0000 mgr.smithi061.kxplwz (mgr.14164) 214 : cluster [DBG] pgmap v180: 65 pgs: 5 creating+activating, 7 creating+peering, 53 active+clean; 22 B data, 43 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:44.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:43.567195+0000 mon.smithi061 (mon.0) 552 : cluster [DBG] mds.? [v2:172.21.15.67:6832/120748127,v1:172.21.15.67:6833/120748127] up:boot 2022-03-17T15:25:44.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:43.568009+0000 mon.smithi061 (mon.0) 553 : cluster [DBG] fsmap foofs:1 {0=foofs.smithi061.atvhsa=up:active} 1 up:standby 2022-03-17T15:25:44.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:43.568106+0000 mon.smithi061 (mon.0) 554 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi067.osftcx"}]: dispatch 2022-03-17T15:25:44.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:43.572223+0000 mon.smithi061 (mon.0) 555 : cluster [DBG] fsmap foofs:1 {0=foofs.smithi061.atvhsa=up:active} 1 up:standby 2022-03-17T15:25:44.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:44.251166+0000 mgr.smithi061.kxplwz (mgr.14164) 215 : audit [DBG] from='client.14502 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-03-17T15:25:44.865 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:43.549560+0000 mgr.smithi061.kxplwz (mgr.14164) 214 : cluster [DBG] pgmap v180: 65 pgs: 5 creating+activating, 7 creating+peering, 53 active+clean; 22 B data, 43 MiB used, 715 GiB / 715 GiB avail 2022-03-17T15:25:44.865 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:43.567195+0000 mon.smithi061 (mon.0) 552 : cluster [DBG] mds.? [v2:172.21.15.67:6832/120748127,v1:172.21.15.67:6833/120748127] up:boot 2022-03-17T15:25:44.866 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:43.568009+0000 mon.smithi061 (mon.0) 553 : cluster [DBG] fsmap foofs:1 {0=foofs.smithi061.atvhsa=up:active} 1 up:standby 2022-03-17T15:25:44.866 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:43.568106+0000 mon.smithi061 (mon.0) 554 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi067.osftcx"}]: dispatch 2022-03-17T15:25:44.866 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:43.572223+0000 mon.smithi061 (mon.0) 555 : cluster [DBG] fsmap foofs:1 {0=foofs.smithi061.atvhsa=up:active} 1 up:standby 2022-03-17T15:25:44.866 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:44.251166+0000 mgr.smithi061.kxplwz (mgr.14164) 215 : audit [DBG] from='client.14502 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2022-03-17T15:25:44.868 INFO:tasks.cephadm:mds.foofs has 2/2 2022-03-17T15:25:44.868 INFO:teuthology.run_tasks:Running task cephadm.shell... 2022-03-17T15:25:44.878 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi061.front.sepia.ceph.com 2022-03-17T15:25:44.878 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- bash -c 'ceph nfs cluster create foo --placement=2 || ceph nfs cluster create cephfs foo --placement=2' 2022-03-17T15:25:46.927 INFO:teuthology.orchestra.run.smithi061.stderr:Invalid command: missing required parameter clusterid() 2022-03-17T15:25:46.928 INFO:teuthology.orchestra.run.smithi061.stderr:nfs cluster create [] : Create an NFS Cluster 2022-03-17T15:25:46.928 INFO:teuthology.orchestra.run.smithi061.stderr:Error EINVAL: invalid command 2022-03-17T15:25:47.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:45.549992+0000 mgr.smithi061.kxplwz (mgr.14164) 216 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 2.1 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s wr, 6 op/s 2022-03-17T15:25:47.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:45.839568+0000 mon.smithi061 (mon.0) 556 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:45.549992+0000 mgr.smithi061.kxplwz (mgr.14164) 216 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 2.1 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 5.0 KiB/s wr, 6 op/s 2022-03-17T15:25:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:45.839568+0000 mon.smithi061 (mon.0) 556 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:47.275523+0000 mon.smithi061 (mon.0) 557 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool create", "pool": "nfs-ganesha"}]: dispatch 2022-03-17T15:25:48.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:47.275523+0000 mon.smithi061 (mon.0) 557 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool create", "pool": "nfs-ganesha"}]: dispatch 2022-03-17T15:25:48.875 INFO:teuthology.orchestra.run.smithi061.stdout:NFS Cluster Created Successfully 2022-03-17T15:25:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:47.274475+0000 mgr.smithi061.kxplwz (mgr.14164) 217 : audit [DBG] from='client.14510 -' entity='client.admin' cmd=[{"prefix": "nfs cluster create", "type": "cephfs", "clusterid": "foo", "placement": "2", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:47.550371+0000 mgr.smithi061.kxplwz (mgr.14164) 218 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 2.3 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s wr, 4 op/s 2022-03-17T15:25:49.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:47.848002+0000 mon.smithi061 (mon.0) 558 : cluster [DBG] mds.? [v2:172.21.15.67:6832/120748127,v1:172.21.15.67:6833/120748127] up:standby 2022-03-17T15:25:49.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:47.848078+0000 mon.smithi061 (mon.0) 559 : cluster [DBG] fsmap foofs:1 {0=foofs.smithi061.atvhsa=up:active} 1 up:standby 2022-03-17T15:25:49.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:47.848155+0000 mon.smithi061 (mon.0) 560 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pool create", "pool": "nfs-ganesha"}]': finished 2022-03-17T15:25:49.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:47.848225+0000 mon.smithi061 (mon.0) 561 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2022-03-17T15:25:49.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:47.849618+0000 mon.smithi061 (mon.0) 562 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool application enable", "pool": "nfs-ganesha", "app": "nfs"}]: dispatch 2022-03-17T15:25:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:47.274475+0000 mgr.smithi061.kxplwz (mgr.14164) 217 : audit [DBG] from='client.14510 -' entity='client.admin' cmd=[{"prefix": "nfs cluster create", "type": "cephfs", "clusterid": "foo", "placement": "2", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:47.550371+0000 mgr.smithi061.kxplwz (mgr.14164) 218 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 2.3 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 3.0 KiB/s wr, 4 op/s 2022-03-17T15:25:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:47.848002+0000 mon.smithi061 (mon.0) 558 : cluster [DBG] mds.? [v2:172.21.15.67:6832/120748127,v1:172.21.15.67:6833/120748127] up:standby 2022-03-17T15:25:49.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:47.848078+0000 mon.smithi061 (mon.0) 559 : cluster [DBG] fsmap foofs:1 {0=foofs.smithi061.atvhsa=up:active} 1 up:standby 2022-03-17T15:25:49.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:47.848155+0000 mon.smithi061 (mon.0) 560 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pool create", "pool": "nfs-ganesha"}]': finished 2022-03-17T15:25:49.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:47.848225+0000 mon.smithi061 (mon.0) 561 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2022-03-17T15:25:49.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:47.849618+0000 mon.smithi061 (mon.0) 562 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool application enable", "pool": "nfs-ganesha", "app": "nfs"}]: dispatch 2022-03-17T15:25:49.365 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- bash -c 'ceph nfs export create cephfs --fsname foofs --clusterid foo --binding /fake || ceph nfs export create cephfs --fsname foofs --cluster-id foo --pseudo-path /fake' 2022-03-17T15:25:50.154 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:48.848514+0000 mon.smithi061 (mon.0) 563 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pool application enable", "pool": "nfs-ganesha", "app": "nfs"}]': finished 2022-03-17T15:25:50.155 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:48.848663+0000 mon.smithi061 (mon.0) 564 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2022-03-17T15:25:50.155 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:25:48.870518+0000 mgr.smithi061.kxplwz (mgr.14164) 219 : cephadm [INF] Saving service nfs.foo spec with placement count:2 2022-03-17T15:25:50.155 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:48.873650+0000 mon.smithi061 (mon.0) 565 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:50.156 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:49.368922+0000 mon.smithi061 (mon.0) 566 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:50.156 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:49.375369+0000 mon.smithi061 (mon.0) 567 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:50.156 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:49.384973+0000 mon.smithi061 (mon.0) 568 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.smithi061", "caps": ["mon", "allow r", "osd", "allow rw pool=nfs-ganesha namespace=foo"]}]: dispatch 2022-03-17T15:25:50.156 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:49.391023+0000 mon.smithi061 (mon.0) 569 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.smithi061", "caps": ["mon", "allow r", "osd", "allow rw pool=nfs-ganesha namespace=foo"]}]': finished 2022-03-17T15:25:50.156 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:49.392878+0000 mon.smithi061 (mon.0) 570 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.smithi061-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2022-03-17T15:25:50.157 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:49.398476+0000 mon.smithi061 (mon.0) 571 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.smithi061-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]': finished 2022-03-17T15:25:50.157 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:49.401744+0000 mon.smithi061 (mon.0) 572 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:25:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:48.848514+0000 mon.smithi061 (mon.0) 563 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pool application enable", "pool": "nfs-ganesha", "app": "nfs"}]': finished 2022-03-17T15:25:50.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:48.848663+0000 mon.smithi061 (mon.0) 564 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2022-03-17T15:25:50.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:25:48.870518+0000 mgr.smithi061.kxplwz (mgr.14164) 219 : cephadm [INF] Saving service nfs.foo spec with placement count:2 2022-03-17T15:25:50.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:48.873650+0000 mon.smithi061 (mon.0) 565 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:50.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:49.368922+0000 mon.smithi061 (mon.0) 566 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:50.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:49.375369+0000 mon.smithi061 (mon.0) 567 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:50.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:49.384973+0000 mon.smithi061 (mon.0) 568 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.smithi061", "caps": ["mon", "allow r", "osd", "allow rw pool=nfs-ganesha namespace=foo"]}]: dispatch 2022-03-17T15:25:50.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:49.391023+0000 mon.smithi061 (mon.0) 569 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.smithi061", "caps": ["mon", "allow r", "osd", "allow rw pool=nfs-ganesha namespace=foo"]}]': finished 2022-03-17T15:25:50.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:49.392878+0000 mon.smithi061 (mon.0) 570 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.smithi061-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2022-03-17T15:25:50.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:49.398476+0000 mon.smithi061 (mon.0) 571 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.smithi061-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]': finished 2022-03-17T15:25:50.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:49.401744+0000 mon.smithi061 (mon.0) 572 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:25:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:25:49.378070+0000 mgr.smithi061.kxplwz (mgr.14164) 220 : cephadm [INF] Checking pool "nfs-ganesha" exists for service nfs.foo 2022-03-17T15:25:51.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:25:49.384663+0000 mgr.smithi061.kxplwz (mgr.14164) 221 : cephadm [INF] Creating key for client.nfs.foo.smithi061 2022-03-17T15:25:51.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:25:49.392577+0000 mgr.smithi061.kxplwz (mgr.14164) 222 : cephadm [INF] Rados config object exists: conf-nfs.foo 2022-03-17T15:25:51.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:25:49.392658+0000 mgr.smithi061.kxplwz (mgr.14164) 223 : cephadm [INF] Creating key for client.nfs.foo.smithi061-rgw 2022-03-17T15:25:51.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:25:49.402648+0000 mgr.smithi061.kxplwz (mgr.14164) 224 : cephadm [INF] Deploying daemon nfs.foo.smithi061 on smithi061 2022-03-17T15:25:51.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:49.550830+0000 mgr.smithi061.kxplwz (mgr.14164) 225 : cluster [DBG] pgmap v185: 97 pgs: 9 creating+peering, 13 unknown, 75 active+clean; 2.3 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s wr, 3 op/s 2022-03-17T15:25:51.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:49.860229+0000 mon.smithi061 (mon.0) 573 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2022-03-17T15:25:51.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:25:49.378070+0000 mgr.smithi061.kxplwz (mgr.14164) 220 : cephadm [INF] Checking pool "nfs-ganesha" exists for service nfs.foo 2022-03-17T15:25:51.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:25:49.384663+0000 mgr.smithi061.kxplwz (mgr.14164) 221 : cephadm [INF] Creating key for client.nfs.foo.smithi061 2022-03-17T15:25:51.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:25:49.392577+0000 mgr.smithi061.kxplwz (mgr.14164) 222 : cephadm [INF] Rados config object exists: conf-nfs.foo 2022-03-17T15:25:51.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:25:49.392658+0000 mgr.smithi061.kxplwz (mgr.14164) 223 : cephadm [INF] Creating key for client.nfs.foo.smithi061-rgw 2022-03-17T15:25:51.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:25:49.402648+0000 mgr.smithi061.kxplwz (mgr.14164) 224 : cephadm [INF] Deploying daemon nfs.foo.smithi061 on smithi061 2022-03-17T15:25:51.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:49.550830+0000 mgr.smithi061.kxplwz (mgr.14164) 225 : cluster [DBG] pgmap v185: 97 pgs: 9 creating+peering, 13 unknown, 75 active+clean; 2.3 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s wr, 3 op/s 2022-03-17T15:25:51.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:49.860229+0000 mon.smithi061 (mon.0) 573 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2022-03-17T15:25:51.828 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:25:51.828 INFO:teuthology.orchestra.run.smithi061.stdout: "bind": "/fake", 2022-03-17T15:25:51.829 INFO:teuthology.orchestra.run.smithi061.stdout: "fs": "foofs", 2022-03-17T15:25:51.829 INFO:teuthology.orchestra.run.smithi061.stdout: "path": "/", 2022-03-17T15:25:51.829 INFO:teuthology.orchestra.run.smithi061.stdout: "cluster": "foo", 2022-03-17T15:25:51.829 INFO:teuthology.orchestra.run.smithi061.stdout: "mode": "RW" 2022-03-17T15:25:51.829 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:25:52.639 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -- bash -c 'while ! ceph orch ls | grep nfs | grep 2/2 ; do sleep 1 ; done' 2022-03-17T15:25:52.670 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:51.405895+0000 mon.smithi061 (mon.0) 574 : cluster [DBG] mgrmap e19: smithi061.kxplwz(active, since 4m), standbys: smithi067.rdualw 2022-03-17T15:25:52.670 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:51.551229+0000 mgr.smithi061.kxplwz (mgr.14164) 226 : cluster [DBG] pgmap v187: 97 pgs: 9 creating+peering, 1 unknown, 87 active+clean; 2.3 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 341 B/s wr, 1 op/s 2022-03-17T15:25:52.671 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:51.793220+0000 mgr.smithi061.kxplwz (mgr.14164) 227 : audit [DBG] from='client.14518 -' entity='client.admin' cmd=[{"prefix": "nfs export create cephfs", "fsname": "foofs", "clusterid": "foo", "binding": "/fake", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:52.671 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:51.816913+0000 mon.smithi061 (mon.0) 575 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "client.foo1", "caps": ["mon", "allow r", "osd", "allow rw pool=nfs-ganesha namespace=foo, allow rw tag cephfs data=foofs", "mds", "allow rw path=/"], "format": "json"}]: dispatch 2022-03-17T15:25:52.671 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:51.820834+0000 mon.smithi061 (mon.0) 576 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "auth get-or-create", "entity": "client.foo1", "caps": ["mon", "allow r", "osd", "allow rw pool=nfs-ganesha namespace=foo, allow rw tag cephfs data=foofs", "mds", "allow rw path=/"], "format": "json"}]': finished 2022-03-17T15:25:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:51.405895+0000 mon.smithi061 (mon.0) 574 : cluster [DBG] mgrmap e19: smithi061.kxplwz(active, since 4m), standbys: smithi067.rdualw 2022-03-17T15:25:52.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:51.551229+0000 mgr.smithi061.kxplwz (mgr.14164) 226 : cluster [DBG] pgmap v187: 97 pgs: 9 creating+peering, 1 unknown, 87 active+clean; 2.3 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 341 B/s wr, 1 op/s 2022-03-17T15:25:52.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:51.793220+0000 mgr.smithi061.kxplwz (mgr.14164) 227 : audit [DBG] from='client.14518 -' entity='client.admin' cmd=[{"prefix": "nfs export create cephfs", "fsname": "foofs", "clusterid": "foo", "binding": "/fake", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:52.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:51.816913+0000 mon.smithi061 (mon.0) 575 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "client.foo1", "caps": ["mon", "allow r", "osd", "allow rw pool=nfs-ganesha namespace=foo, allow rw tag cephfs data=foofs", "mds", "allow rw path=/"], "format": "json"}]: dispatch 2022-03-17T15:25:52.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:51.820834+0000 mon.smithi061 (mon.0) 576 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "auth get-or-create", "entity": "client.foo1", "caps": ["mon", "allow r", "osd", "allow rw pool=nfs-ganesha namespace=foo, allow rw tag cephfs data=foofs", "mds", "allow rw path=/"], "format": "json"}]': finished 2022-03-17T15:25:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:53.141180+0000 mon.smithi061 (mon.0) 577 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:54.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:25:53.141903+0000 mgr.smithi061.kxplwz (mgr.14164) 228 : cephadm [INF] Creating key for client.nfs.foo.smithi067 2022-03-17T15:25:54.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:53.142128+0000 mon.smithi061 (mon.0) 578 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.smithi067", "caps": ["mon", "allow r", "osd", "allow rw pool=nfs-ganesha namespace=foo"]}]: dispatch 2022-03-17T15:25:54.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:53.145016+0000 mon.smithi061 (mon.0) 579 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.smithi067", "caps": ["mon", "allow r", "osd", "allow rw pool=nfs-ganesha namespace=foo"]}]': finished 2022-03-17T15:25:54.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:25:53.146211+0000 mgr.smithi061.kxplwz (mgr.14164) 229 : cephadm [INF] Rados config object exists: conf-nfs.foo 2022-03-17T15:25:54.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:25:53.146299+0000 mgr.smithi061.kxplwz (mgr.14164) 230 : cephadm [INF] Creating key for client.nfs.foo.smithi067-rgw 2022-03-17T15:25:54.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:53.146492+0000 mon.smithi061 (mon.0) 580 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.smithi067-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2022-03-17T15:25:54.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:53.149391+0000 mon.smithi061 (mon.0) 581 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.smithi067-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]': finished 2022-03-17T15:25:54.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:53.150315+0000 mon.smithi061 (mon.0) 582 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:25:54.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:25:53.150920+0000 mgr.smithi061.kxplwz (mgr.14164) 231 : cephadm [INF] Deploying daemon nfs.foo.smithi067 on smithi067 2022-03-17T15:25:54.360 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:53.141180+0000 mon.smithi061 (mon.0) 577 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:54.361 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:25:53.141903+0000 mgr.smithi061.kxplwz (mgr.14164) 228 : cephadm [INF] Creating key for client.nfs.foo.smithi067 2022-03-17T15:25:54.361 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:53.142128+0000 mon.smithi061 (mon.0) 578 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.smithi067", "caps": ["mon", "allow r", "osd", "allow rw pool=nfs-ganesha namespace=foo"]}]: dispatch 2022-03-17T15:25:54.361 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:53.145016+0000 mon.smithi061 (mon.0) 579 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.smithi067", "caps": ["mon", "allow r", "osd", "allow rw pool=nfs-ganesha namespace=foo"]}]': finished 2022-03-17T15:25:54.361 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:25:53.146211+0000 mgr.smithi061.kxplwz (mgr.14164) 229 : cephadm [INF] Rados config object exists: conf-nfs.foo 2022-03-17T15:25:54.362 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:25:53.146299+0000 mgr.smithi061.kxplwz (mgr.14164) 230 : cephadm [INF] Creating key for client.nfs.foo.smithi067-rgw 2022-03-17T15:25:54.362 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:53.146492+0000 mon.smithi061 (mon.0) 580 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.smithi067-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2022-03-17T15:25:54.362 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:53.149391+0000 mon.smithi061 (mon.0) 581 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.smithi067-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]': finished 2022-03-17T15:25:54.362 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:53.150315+0000 mon.smithi061 (mon.0) 582 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:25:54.363 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:25:53.150920+0000 mgr.smithi061.kxplwz (mgr.14164) 231 : cephadm [INF] Deploying daemon nfs.foo.smithi067 on smithi067 2022-03-17T15:25:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:53.551872+0000 mgr.smithi061.kxplwz (mgr.14164) 232 : cluster [DBG] pgmap v188: 97 pgs: 97 active+clean; 2.3 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2022-03-17T15:25:55.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:53.551872+0000 mgr.smithi061.kxplwz (mgr.14164) 232 : cluster [DBG] pgmap v188: 97 pgs: 97 active+clean; 2.3 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 0 B/s rd, 0 B/s wr, 0 op/s 2022-03-17T15:25:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:54.424609+0000 mgr.smithi061.kxplwz (mgr.14164) 233 : audit [DBG] from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:54.424609+0000 mgr.smithi061.kxplwz (mgr.14164) 233 : audit [DBG] from='client.14534 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:57.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:55.552471+0000 mgr.smithi061.kxplwz (mgr.14164) 234 : cluster [DBG] pgmap v189: 97 pgs: 97 active+clean; 2.7 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2022-03-17T15:25:57.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:55.741504+0000 mgr.smithi061.kxplwz (mgr.14164) 235 : audit [DBG] from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:57.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:55.552471+0000 mgr.smithi061.kxplwz (mgr.14164) 234 : cluster [DBG] pgmap v189: 97 pgs: 97 active+clean; 2.7 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 1.6 KiB/s rd, 1.3 KiB/s wr, 3 op/s 2022-03-17T15:25:57.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:55.741504+0000 mgr.smithi061.kxplwz (mgr.14164) 235 : audit [DBG] from='client.14542 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:58.408 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo 2/2 - 9s count:2 2022-03-17T15:25:58.538 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:57.057491+0000 mgr.smithi061.kxplwz (mgr.14164) 236 : audit [DBG] from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:58.539 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:57.208842+0000 mon.smithi061 (mon.0) 583 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:58.540 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:57.209492+0000 mon.smithi061 (mon.0) 584 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:25:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:57.057491+0000 mgr.smithi061.kxplwz (mgr.14164) 236 : audit [DBG] from='client.24365 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:25:58.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:57.208842+0000 mon.smithi061 (mon.0) 583 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:25:58.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:57.209492+0000 mon.smithi061 (mon.0) 584 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:25:58.804 INFO:teuthology.run_tasks:Running task vip.exec... 2022-03-17T15:25:58.815 INFO:tasks.vip:Running commands on role host.a host ubuntu@smithi061.front.sepia.ceph.com 2022-03-17T15:25:58.815 DEBUG:teuthology.orchestra.run.smithi061:> sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'mkdir /mnt/foo' 2022-03-17T15:25:58.873 INFO:teuthology.orchestra.run.smithi061.stderr:+ mkdir /mnt/foo 2022-03-17T15:25:58.882 DEBUG:teuthology.orchestra.run.smithi061:> sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'while ! mount -t nfs $(hostname):/fake /mnt/foo -o sync ; do sleep 5 ; done' 2022-03-17T15:25:58.949 INFO:teuthology.orchestra.run.smithi061.stderr:++ hostname 2022-03-17T15:25:58.950 INFO:teuthology.orchestra.run.smithi061.stderr:+ mount -t nfs smithi061:/fake /mnt/foo -o sync 2022-03-17T15:25:59.381 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:25:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:57.552917+0000 mgr.smithi061.kxplwz (mgr.14164) 237 : cluster [DBG] pgmap v190: 97 pgs: 97 active+clean; 2.7 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2022-03-17T15:25:59.439 DEBUG:teuthology.orchestra.run.smithi061:> sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'echo test > /mnt/foo/testfile' 2022-03-17T15:25:59.510 INFO:teuthology.orchestra.run.smithi061.stderr:+ echo test 2022-03-17T15:25:59.520 DEBUG:teuthology.orchestra.run.smithi061:> sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c sync 2022-03-17T15:25:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:25:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:57.552917+0000 mgr.smithi061.kxplwz (mgr.14164) 237 : cluster [DBG] pgmap v190: 97 pgs: 97 active+clean; 2.7 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1.1 KiB/s wr, 3 op/s 2022-03-17T15:25:59.587 INFO:teuthology.orchestra.run.smithi061.stderr:+ sync 2022-03-17T15:25:59.913 INFO:teuthology.run_tasks:Running task parallel... 2022-03-17T15:25:59.928 INFO:teuthology.task.parallel:starting parallel... 2022-03-17T15:25:59.929 INFO:teuthology.task.parallel:In parallel, running task sequential... 2022-03-17T15:25:59.929 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2022-03-17T15:25:59.930 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi061.front.sepia.ceph.com 2022-03-17T15:25:59.931 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -e sha1=b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2022-03-17T15:25:59.931 INFO:teuthology.task.parallel:In parallel, running task sequential... 2022-03-17T15:25:59.931 INFO:teuthology.task.sequential:In sequential, running task exec... 2022-03-17T15:25:59.932 INFO:teuthology.task.exec:Executing custom commands... 2022-03-17T15:25:59.933 INFO:teuthology.task.exec:Running commands on role host.a host ubuntu@smithi061.front.sepia.ceph.com 2022-03-17T15:25:59.933 DEBUG:teuthology.orchestra.run.smithi061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'cd /mnt/foo && dbench 5 -t 600 || true' 2022-03-17T15:26:00.011 INFO:teuthology.orchestra.run.smithi061.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2022-03-17T15:26:00.012 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:26:00.012 INFO:teuthology.orchestra.run.smithi061.stdout:Running for 600 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 120 secs 2022-03-17T15:26:00.017 INFO:teuthology.orchestra.run.smithi061.stdout:3 of 5 processes prepared for launch 0 sec 2022-03-17T15:26:00.117 INFO:teuthology.orchestra.run.smithi061.stdout:5 of 5 processes prepared for launch 0 sec 2022-03-17T15:26:00.118 INFO:teuthology.orchestra.run.smithi061.stdout:releasing clients 2022-03-17T15:26:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:25:58.388995+0000 mgr.smithi061.kxplwz (mgr.14164) 238 : audit [DBG] from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:26:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:25:58.388995+0000 mgr.smithi061.kxplwz (mgr.14164) 238 : audit [DBG] from='client.14564 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:26:01.118 INFO:teuthology.orchestra.run.smithi061.stdout: 5 260 49.11 MB/sec warmup 1 sec latency 16.870 ms 2022-03-17T15:26:01.227 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:25:59.553562+0000 mgr.smithi061.kxplwz (mgr.14164) 239 : cluster [DBG] pgmap v191: 97 pgs: 97 active+clean; 4.1 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2022-03-17T15:26:01.227 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:00.484640+0000 mon.smithi061 (mon.0) 585 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:01.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:25:59.553562+0000 mgr.smithi061.kxplwz (mgr.14164) 239 : cluster [DBG] pgmap v191: 97 pgs: 97 active+clean; 4.1 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1.7 KiB/s wr, 3 op/s 2022-03-17T15:26:01.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:00.484640+0000 mon.smithi061 (mon.0) 585 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:02.118 INFO:teuthology.orchestra.run.smithi061.stdout: 5 523 45.17 MB/sec warmup 2 sec latency 14.734 ms 2022-03-17T15:26:03.026 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -e sha1=b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2022-03-17T15:26:03.117 INFO:teuthology.orchestra.run.smithi061.stdout: 5 1161 38.35 MB/sec warmup 3 sec latency 11.152 ms 2022-03-17T15:26:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:01.554121+0000 mgr.smithi061.kxplwz (mgr.14164) 240 : cluster [DBG] pgmap v192: 97 pgs: 97 active+clean; 5.7 MiB data, 57 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 510 KiB/s wr, 15 op/s 2022-03-17T15:26:03.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:01.554121+0000 mgr.smithi061.kxplwz (mgr.14164) 240 : cluster [DBG] pgmap v192: 97 pgs: 97 active+clean; 5.7 MiB data, 57 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 510 KiB/s wr, 15 op/s 2022-03-17T15:26:04.118 INFO:teuthology.orchestra.run.smithi061.stdout: 5 2430 35.13 MB/sec warmup 4 sec latency 11.620 ms 2022-03-17T15:26:05.118 INFO:teuthology.orchestra.run.smithi061.stdout: 5 3697 38.75 MB/sec warmup 5 sec latency 11.817 ms 2022-03-17T15:26:05.522 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:03.554672+0000 mgr.smithi061.kxplwz (mgr.14164) 241 : cluster [DBG] pgmap v193: 97 pgs: 97 active+clean; 40 MiB data, 202 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 3.6 MiB/s wr, 83 op/s 2022-03-17T15:26:05.522 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:04.969512+0000 mon.smithi061 (mon.0) 586 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:05.522 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:04.975130+0000 mon.smithi061 (mon.0) 587 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:05.522 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:04.981363+0000 mon.smithi061 (mon.0) 588 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:26:05.523 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:04.988623+0000 mon.smithi061 (mon.0) 589 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:05.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:03.554672+0000 mgr.smithi061.kxplwz (mgr.14164) 241 : cluster [DBG] pgmap v193: 97 pgs: 97 active+clean; 40 MiB data, 202 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 3.6 MiB/s wr, 83 op/s 2022-03-17T15:26:05.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:04.969512+0000 mon.smithi061 (mon.0) 586 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:05.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:04.975130+0000 mon.smithi061 (mon.0) 587 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:05.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:04.981363+0000 mon.smithi061 (mon.0) 588 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:26:05.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:04.988623+0000 mon.smithi061 (mon.0) 589 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:05.835 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -e sha1=b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6 -- bash -c 'ceph config set global log_to_journald false --force' 2022-03-17T15:26:06.119 INFO:teuthology.orchestra.run.smithi061.stdout: 5 4516 34.12 MB/sec warmup 6 sec latency 20.358 ms 2022-03-17T15:26:07.119 INFO:teuthology.orchestra.run.smithi061.stdout: 5 5867 33.20 MB/sec warmup 7 sec latency 13.498 ms 2022-03-17T15:26:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:05.555268+0000 mgr.smithi061.kxplwz (mgr.14164) 242 : cluster [DBG] pgmap v194: 97 pgs: 97 active+clean; 110 MiB data, 449 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 10 MiB/s wr, 474 op/s 2022-03-17T15:26:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:05.555268+0000 mgr.smithi061.kxplwz (mgr.14164) 242 : cluster [DBG] pgmap v194: 97 pgs: 97 active+clean; 110 MiB data, 449 MiB used, 715 GiB / 715 GiB avail; 3.2 KiB/s rd, 10 MiB/s wr, 474 op/s 2022-03-17T15:26:08.119 INFO:teuthology.orchestra.run.smithi061.stdout: 5 6707 33.41 MB/sec warmup 8 sec latency 69.936 ms 2022-03-17T15:26:08.241 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:07.526451+0000 mon.smithi061 (mon.0) 590 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2022-03-17T15:26:08.242 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:07.526748+0000 mon.smithi061 (mon.0) 591 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2022-03-17T15:26:08.242 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:07.526919+0000 mon.smithi061 (mon.0) 592 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2022-03-17T15:26:08.242 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:07.527138+0000 mon.smithi061 (mon.0) 593 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2022-03-17T15:26:08.243 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:07.913506+0000 mon.smithi061 (mon.0) 594 : audit [INF] from='client.? 172.21.15.61:0/1063078588' entity='client.admin' 2022-03-17T15:26:08.244 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:07.919533+0000 mon.smithi061 (mon.0) 595 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:26:08.244 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:07.930554+0000 mon.smithi061 (mon.0) 596 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:08.320 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -e sha1=b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6 -- bash -c 'ceph mgr module enable nfs --force' 2022-03-17T15:26:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:07.526451+0000 mon.smithi061 (mon.0) 590 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]: dispatch 2022-03-17T15:26:08.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:07.526748+0000 mon.smithi061 (mon.0) 591 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]: dispatch 2022-03-17T15:26:08.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:07.526919+0000 mon.smithi061 (mon.0) 592 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]: dispatch 2022-03-17T15:26:08.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:07.527138+0000 mon.smithi061 (mon.0) 593 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]: dispatch 2022-03-17T15:26:08.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:07.913506+0000 mon.smithi061 (mon.0) 594 : audit [INF] from='client.? 172.21.15.61:0/1063078588' entity='client.admin' 2022-03-17T15:26:08.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:07.919533+0000 mon.smithi061 (mon.0) 595 : audit [DBG] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:26:08.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:07.930554+0000 mon.smithi061 (mon.0) 596 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:09.119 INFO:teuthology.orchestra.run.smithi061.stdout: 5 7648 32.91 MB/sec warmup 9 sec latency 18.919 ms 2022-03-17T15:26:09.265 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:07.555748+0000 mgr.smithi061.kxplwz (mgr.14164) 243 : cluster [DBG] pgmap v195: 97 pgs: 97 active+clean; 115 MiB data, 480 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 11 MiB/s wr, 492 op/s 2022-03-17T15:26:09.265 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:08.252225+0000 mon.smithi061 (mon.0) 597 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]': finished 2022-03-17T15:26:09.265 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:08.252310+0000 mon.smithi061 (mon.0) 598 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]': finished 2022-03-17T15:26:09.266 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:08.252378+0000 mon.smithi061 (mon.0) 599 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2022-03-17T15:26:09.266 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:08.252537+0000 mon.smithi061 (mon.0) 600 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]': finished 2022-03-17T15:26:09.266 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:08.252616+0000 mon.smithi061 (mon.0) 601 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2022-03-17T15:26:09.267 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:09.188163+0000 mon.smithi061 (mon.0) 602 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:26:09.267 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:09.189309+0000 mon.smithi061 (mon.0) 603 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:26:09.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:07.555748+0000 mgr.smithi061.kxplwz (mgr.14164) 243 : cluster [DBG] pgmap v195: 97 pgs: 97 active+clean; 115 MiB data, 480 MiB used, 715 GiB / 715 GiB avail; 2.2 KiB/s rd, 11 MiB/s wr, 492 op/s 2022-03-17T15:26:09.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:08.252225+0000 mon.smithi061 (mon.0) 597 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.12", "id": [7, 2]}]': finished 2022-03-17T15:26:09.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:08.252310+0000 mon.smithi061 (mon.0) 598 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [1, 2]}]': finished 2022-03-17T15:26:09.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:08.252378+0000 mon.smithi061 (mon.0) 599 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.17", "id": [1, 2]}]': finished 2022-03-17T15:26:09.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:08.252537+0000 mon.smithi061 (mon.0) 600 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1d", "id": [1, 5]}]': finished 2022-03-17T15:26:09.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:08.252616+0000 mon.smithi061 (mon.0) 601 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2022-03-17T15:26:09.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:09.188163+0000 mon.smithi061 (mon.0) 602 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:26:09.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:09.189309+0000 mon.smithi061 (mon.0) 603 : audit [INF] from='mgr.14164 172.21.15.61:0/398124894' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:26:10.119 INFO:teuthology.orchestra.run.smithi061.stdout: 5 8665 32.17 MB/sec warmup 10 sec latency 14.708 ms 2022-03-17T15:26:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:09.253943+0000 mon.smithi061 (mon.0) 604 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2022-03-17T15:26:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:09.253943+0000 mon.smithi061 (mon.0) 604 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2022-03-17T15:26:11.119 INFO:teuthology.orchestra.run.smithi061.stdout: 5 9825 31.26 MB/sec warmup 11 sec latency 17.042 ms 2022-03-17T15:26:11.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:09.556162+0000 mgr.smithi061.kxplwz (mgr.14164) 244 : cluster [DBG] pgmap v198: 97 pgs: 1 peering, 96 active+clean; 134 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 8.7 KiB/s rd, 22 MiB/s wr, 1.36k op/s 2022-03-17T15:26:11.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:10.510664+0000 mon.smithi061 (mon.0) 605 : audit [INF] from='client.? 172.21.15.61:0/251320108' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "nfs", "force": "--force"}]: dispatch 2022-03-17T15:26:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:09.556162+0000 mgr.smithi061.kxplwz (mgr.14164) 244 : cluster [DBG] pgmap v198: 97 pgs: 1 peering, 96 active+clean; 134 MiB data, 653 MiB used, 715 GiB / 715 GiB avail; 8.7 KiB/s rd, 22 MiB/s wr, 1.36k op/s 2022-03-17T15:26:11.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:10.510664+0000 mon.smithi061 (mon.0) 605 : audit [INF] from='client.? 172.21.15.61:0/251320108' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "nfs", "force": "--force"}]: dispatch 2022-03-17T15:26:11.842 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -e sha1=b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2022-03-17T15:26:12.119 INFO:teuthology.orchestra.run.smithi061.stdout: 5 10861 32.38 MB/sec warmup 12 sec latency 17.117 ms 2022-03-17T15:26:12.540 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:11.273982+0000 mon.smithi061 (mon.0) 606 : audit [INF] from='client.? 172.21.15.61:0/251320108' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "nfs", "force": "--force"}]': finished 2022-03-17T15:26:12.541 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:11.274052+0000 mon.smithi061 (mon.0) 607 : cluster [DBG] mgrmap e20: smithi061.kxplwz(active, since 5m), standbys: smithi067.rdualw 2022-03-17T15:26:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:11.273982+0000 mon.smithi061 (mon.0) 606 : audit [INF] from='client.? 172.21.15.61:0/251320108' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "nfs", "force": "--force"}]': finished 2022-03-17T15:26:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:11.274052+0000 mon.smithi061 (mon.0) 607 : cluster [DBG] mgrmap e20: smithi061.kxplwz(active, since 5m), standbys: smithi067.rdualw 2022-03-17T15:26:13.119 INFO:teuthology.orchestra.run.smithi061.stdout: 5 11525 30.37 MB/sec warmup 13 sec latency 25.247 ms 2022-03-17T15:26:14.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 12520 29.91 MB/sec warmup 14 sec latency 42.670 ms 2022-03-17T15:26:15.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 13590 30.08 MB/sec warmup 15 sec latency 23.171 ms 2022-03-17T15:26:16.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 14458 30.35 MB/sec warmup 16 sec latency 25.866 ms 2022-03-17T15:26:17.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 15115 28.91 MB/sec warmup 17 sec latency 15.836 ms 2022-03-17T15:26:18.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 16017 28.56 MB/sec warmup 18 sec latency 78.348 ms 2022-03-17T15:26:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:18.373488+0000 mon.smithi061 (mon.0) 608 : cluster [DBG] Standby manager daemon smithi067.rdualw restarted 2022-03-17T15:26:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:18.373595+0000 mon.smithi061 (mon.0) 609 : cluster [DBG] Standby manager daemon smithi067.rdualw started 2022-03-17T15:26:18.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:18.376199+0000 mon.smithi067 (mon.1) 18 : audit [DBG] from='mgr.? 172.21.15.67:0/3042897736' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/crt"}]: dispatch 2022-03-17T15:26:18.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:18.377110+0000 mon.smithi067 (mon.1) 19 : audit [DBG] from='mgr.? 172.21.15.67:0/3042897736' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-03-17T15:26:18.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:18.382293+0000 mon.smithi067 (mon.1) 20 : audit [DBG] from='mgr.? 172.21.15.67:0/3042897736' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/key"}]: dispatch 2022-03-17T15:26:18.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:18.383236+0000 mon.smithi067 (mon.1) 21 : audit [DBG] from='mgr.? 172.21.15.67:0/3042897736' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-03-17T15:26:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:18.373488+0000 mon.smithi061 (mon.0) 608 : cluster [DBG] Standby manager daemon smithi067.rdualw restarted 2022-03-17T15:26:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:18.373595+0000 mon.smithi061 (mon.0) 609 : cluster [DBG] Standby manager daemon smithi067.rdualw started 2022-03-17T15:26:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:18.376199+0000 mon.smithi067 (mon.1) 18 : audit [DBG] from='mgr.? 172.21.15.67:0/3042897736' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/crt"}]: dispatch 2022-03-17T15:26:18.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:18.377110+0000 mon.smithi067 (mon.1) 19 : audit [DBG] from='mgr.? 172.21.15.67:0/3042897736' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-03-17T15:26:18.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:18.382293+0000 mon.smithi067 (mon.1) 20 : audit [DBG] from='mgr.? 172.21.15.67:0/3042897736' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/key"}]: dispatch 2022-03-17T15:26:18.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:18.383236+0000 mon.smithi067 (mon.1) 21 : audit [DBG] from='mgr.? 172.21.15.67:0/3042897736' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-03-17T15:26:19.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 17223 28.95 MB/sec warmup 19 sec latency 21.113 ms 2022-03-17T15:26:19.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:18.431701+0000 mon.smithi061 (mon.0) 610 : cluster [DBG] mgrmap e21: smithi061.kxplwz(active, since 5m), standbys: smithi067.rdualw 2022-03-17T15:26:19.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:18.431701+0000 mon.smithi061 (mon.0) 610 : cluster [DBG] mgrmap e21: smithi061.kxplwz(active, since 5m), standbys: smithi067.rdualw 2022-03-17T15:26:20.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 18165 29.13 MB/sec warmup 20 sec latency 15.128 ms 2022-03-17T15:26:21.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 19006 28.52 MB/sec warmup 21 sec latency 16.205 ms 2022-03-17T15:26:21.464 INFO:teuthology.orchestra.run.smithi061.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6 2022-03-17T15:26:21.497 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:20.230490+0000 mon.smithi061 (mon.0) 611 : cluster [INF] Active manager daemon smithi061.kxplwz restarted 2022-03-17T15:26:21.497 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:20.231263+0000 mon.smithi061 (mon.0) 612 : cluster [INF] Activating manager daemon smithi061.kxplwz 2022-03-17T15:26:21.497 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:20.234563+0000 mon.smithi061 (mon.0) 613 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2022-03-17T15:26:21.498 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:20.444314+0000 mon.smithi061 (mon.0) 614 : cluster [DBG] mgrmap e22: smithi061.kxplwz(active, starting, since 0.213208s), standbys: smithi067.rdualw 2022-03-17T15:26:21.498 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.447895+0000 mon.smithi061 (mon.0) 615 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi061"}]: dispatch 2022-03-17T15:26:21.498 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.448038+0000 mon.smithi061 (mon.0) 616 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:26:21.498 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.448162+0000 mon.smithi061 (mon.0) 617 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi061.atvhsa"}]: dispatch 2022-03-17T15:26:21.499 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.448420+0000 mon.smithi061 (mon.0) 618 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi067.osftcx"}]: dispatch 2022-03-17T15:26:21.499 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.450204+0000 mon.smithi061 (mon.0) 619 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr metadata", "who": "smithi061.kxplwz", "id": "smithi061.kxplwz"}]: dispatch 2022-03-17T15:26:21.499 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.450481+0000 mon.smithi061 (mon.0) 620 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr metadata", "who": "smithi067.rdualw", "id": "smithi067.rdualw"}]: dispatch 2022-03-17T15:26:21.499 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.450726+0000 mon.smithi061 (mon.0) 621 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:26:21.500 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.451042+0000 mon.smithi061 (mon.0) 622 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:26:21.500 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.451259+0000 mon.smithi061 (mon.0) 623 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:26:21.500 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.451613+0000 mon.smithi061 (mon.0) 624 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:26:21.500 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.451947+0000 mon.smithi061 (mon.0) 625 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:26:21.500 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.452234+0000 mon.smithi061 (mon.0) 626 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:26:21.501 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.452804+0000 mon.smithi061 (mon.0) 627 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:26:21.501 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.453035+0000 mon.smithi061 (mon.0) 628 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:26:21.501 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.453394+0000 mon.smithi061 (mon.0) 629 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-03-17T15:26:21.501 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.453620+0000 mon.smithi061 (mon.0) 630 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-03-17T15:26:21.502 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.454396+0000 mon.smithi061 (mon.0) 631 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-03-17T15:26:21.502 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:20.460108+0000 mon.smithi061 (mon.0) 632 : cluster [INF] Manager daemon smithi061.kxplwz is now available 2022-03-17T15:26:21.502 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.679394+0000 mon.smithi061 (mon.0) 633 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:26:21.502 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.682970+0000 mon.smithi061 (mon.0) 634 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:26:21.503 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.728220+0000 mon.smithi061 (mon.0) 635 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:26:21.503 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:20.763290+0000 mon.smithi061 (mon.0) 636 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:26:21.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:20.230490+0000 mon.smithi061 (mon.0) 611 : cluster [INF] Active manager daemon smithi061.kxplwz restarted 2022-03-17T15:26:21.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:20.231263+0000 mon.smithi061 (mon.0) 612 : cluster [INF] Activating manager daemon smithi061.kxplwz 2022-03-17T15:26:21.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:20.234563+0000 mon.smithi061 (mon.0) 613 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2022-03-17T15:26:21.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:20.444314+0000 mon.smithi061 (mon.0) 614 : cluster [DBG] mgrmap e22: smithi061.kxplwz(active, starting, since 0.213208s), standbys: smithi067.rdualw 2022-03-17T15:26:21.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.447895+0000 mon.smithi061 (mon.0) 615 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi061"}]: dispatch 2022-03-17T15:26:21.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.448038+0000 mon.smithi061 (mon.0) 616 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:26:21.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.448162+0000 mon.smithi061 (mon.0) 617 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi061.atvhsa"}]: dispatch 2022-03-17T15:26:21.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.448420+0000 mon.smithi061 (mon.0) 618 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi067.osftcx"}]: dispatch 2022-03-17T15:26:21.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.450204+0000 mon.smithi061 (mon.0) 619 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr metadata", "who": "smithi061.kxplwz", "id": "smithi061.kxplwz"}]: dispatch 2022-03-17T15:26:21.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.450481+0000 mon.smithi061 (mon.0) 620 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr metadata", "who": "smithi067.rdualw", "id": "smithi067.rdualw"}]: dispatch 2022-03-17T15:26:21.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.450726+0000 mon.smithi061 (mon.0) 621 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:26:21.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.451042+0000 mon.smithi061 (mon.0) 622 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:26:21.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.451259+0000 mon.smithi061 (mon.0) 623 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:26:21.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.451613+0000 mon.smithi061 (mon.0) 624 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:26:21.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.451947+0000 mon.smithi061 (mon.0) 625 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:26:21.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.452234+0000 mon.smithi061 (mon.0) 626 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:26:21.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.452804+0000 mon.smithi061 (mon.0) 627 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:26:21.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.453035+0000 mon.smithi061 (mon.0) 628 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:26:21.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.453394+0000 mon.smithi061 (mon.0) 629 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-03-17T15:26:21.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.453620+0000 mon.smithi061 (mon.0) 630 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-03-17T15:26:21.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.454396+0000 mon.smithi061 (mon.0) 631 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-03-17T15:26:21.572 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:20.460108+0000 mon.smithi061 (mon.0) 632 : cluster [INF] Manager daemon smithi061.kxplwz is now available 2022-03-17T15:26:21.572 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.679394+0000 mon.smithi061 (mon.0) 633 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:26:21.572 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.682970+0000 mon.smithi061 (mon.0) 634 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:26:21.572 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.728220+0000 mon.smithi061 (mon.0) 635 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:26:21.572 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:20.763290+0000 mon.smithi061 (mon.0) 636 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:26:22.011 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2022-03-17T15:26:22.013 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi061.front.sepia.ceph.com 2022-03-17T15:26:22.013 DEBUG:teuthology.orchestra.run.smithi061:> sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae1b9b88-a605-11ec-8c35-001a4aab830c -e sha1=b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true ; do ceph orch ps ; ceph versions ; sleep 30 ; done' 2022-03-17T15:26:22.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 20128 28.03 MB/sec warmup 22 sec latency 23.787 ms 2022-03-17T15:26:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:21.449340+0000 mon.smithi061 (mon.0) 637 : cluster [DBG] mgrmap e23: smithi061.kxplwz(active, since 1.21823s), standbys: smithi067.rdualw 2022-03-17T15:26:22.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:26:21.455465+0000 mgr.smithi061.kxplwz (mgr.14588) 2 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6 2022-03-17T15:26:22.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:21.456465+0000 mgr.smithi061.kxplwz (mgr.14588) 3 : cluster [DBG] pgmap v3: 97 pgs: 97 active+clean; 181 MiB data, 986 MiB used, 714 GiB / 715 GiB avail 2022-03-17T15:26:22.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:21.460441+0000 mon.smithi061 (mon.0) 638 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:21.449340+0000 mon.smithi061 (mon.0) 637 : cluster [DBG] mgrmap e23: smithi061.kxplwz(active, since 1.21823s), standbys: smithi067.rdualw 2022-03-17T15:26:22.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:26:21.455465+0000 mgr.smithi061.kxplwz (mgr.14588) 2 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6 2022-03-17T15:26:22.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:21.456465+0000 mgr.smithi061.kxplwz (mgr.14588) 3 : cluster [DBG] pgmap v3: 97 pgs: 97 active+clean; 181 MiB data, 986 MiB used, 714 GiB / 715 GiB avail 2022-03-17T15:26:22.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:21.460441+0000 mon.smithi061 (mon.0) 638 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:23.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 20980 28.29 MB/sec warmup 23 sec latency 14.762 ms 2022-03-17T15:26:23.766 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:22.452457+0000 mgr.smithi061.kxplwz (mgr.14588) 4 : cluster [DBG] pgmap v4: 97 pgs: 97 active+clean; 181 MiB data, 986 MiB used, 714 GiB / 715 GiB avail 2022-03-17T15:26:23.766 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:22.579638+0000 mon.smithi061 (mon.0) 639 : cluster [DBG] mgrmap e24: smithi061.kxplwz(active, since 2s), standbys: smithi067.rdualw 2022-03-17T15:26:24.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:22.452457+0000 mgr.smithi061.kxplwz (mgr.14588) 4 : cluster [DBG] pgmap v4: 97 pgs: 97 active+clean; 181 MiB data, 986 MiB used, 714 GiB / 715 GiB avail 2022-03-17T15:26:24.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:22.579638+0000 mon.smithi061 (mon.0) 639 : cluster [DBG] mgrmap e24: smithi061.kxplwz(active, since 2s), standbys: smithi067.rdualw 2022-03-17T15:26:24.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 21718 28.26 MB/sec warmup 24 sec latency 27.116 ms 2022-03-17T15:26:24.334 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:26:24.840 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:24.317433+0000 mgr.smithi061.kxplwz (mgr.14588) 5 : audit [DBG] from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:26:24.863 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2022-03-17T15:26:24.864 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3m) 19s ago 5m 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:26:24.864 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5m) 19s ago 5m 16.2.4 8d91d370c2b8 35aa99cfae95 2022-03-17T15:26:24.864 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4m) 24s ago 4m 16.2.4 8d91d370c2b8 056e5956721e 2022-03-17T15:26:24.865 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3m) 19s ago 4m 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:26:24.865 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (44s) 19s ago 43s 16.2.4 8d91d370c2b8 fc2d986f2f76 2022-03-17T15:26:24.865 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (42s) 24s ago 41s 16.2.4 8d91d370c2b8 7e2d207c71fd 2022-03-17T15:26:24.865 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:9283 running (6m) 19s ago 6m 16.2.4 8d91d370c2b8 f30655c578ce 2022-03-17T15:26:24.865 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4m) 24s ago 4m 16.2.4 8d91d370c2b8 4aeaa4c7a497 2022-03-17T15:26:24.866 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6m) 19s ago 6m 16.2.4 8d91d370c2b8 e511ef468147 2022-03-17T15:26:24.866 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4m) 24s ago 4m 16.2.4 8d91d370c2b8 6ba46ec348ed 2022-03-17T15:26:24.866 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.smithi061 smithi061 *:2049 running (32s) 19s ago 31s 3.5 8d91d370c2b8 c2d69628e8c7 2022-03-17T15:26:24.866 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.smithi067 smithi067 *:2049 running (28s) 24s ago 27s 3.5 8d91d370c2b8 0747e3abc197 2022-03-17T15:26:24.867 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4m) 19s ago 4m 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:26:24.867 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4m) 24s ago 4m 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:26:24.867 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3m) 19s ago 3m 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:26:24.867 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3m) 19s ago 3m 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:26:24.868 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3m) 19s ago 3m 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:26:24.868 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3m) 19s ago 3m 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:26:24.868 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2m) 24s ago 2m 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:26:24.868 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2m) 24s ago 2m 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:26:24.869 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2m) 24s ago 2m 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:26:24.869 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2m) 24s ago 2m 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:26:24.869 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3m) 19s ago 4m 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:26:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:24.317433+0000 mgr.smithi061.kxplwz (mgr.14588) 5 : audit [DBG] from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:26:25.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 22442 27.52 MB/sec warmup 25 sec latency 19.850 ms 2022-03-17T15:26:25.501 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:26:25.501 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:26:25.501 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:26:25.502 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:26:25.502 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:26:25.502 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:26:25.502 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:26:25.503 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:26:25.503 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 8 2022-03-17T15:26:25.503 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:26:25.503 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:26:25.504 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:26:25.504 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:26:25.504 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:26:25.504 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2022-03-17T15:26:25.505 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:26:25.505 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:26:26.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 23496 27.28 MB/sec warmup 26 sec latency 16.658 ms 2022-03-17T15:26:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:24.452835+0000 mgr.smithi061.kxplwz (mgr.14588) 6 : cluster [DBG] pgmap v5: 97 pgs: 97 active+clean; 181 MiB data, 986 MiB used, 714 GiB / 715 GiB avail 2022-03-17T15:26:26.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:24.842436+0000 mgr.smithi061.kxplwz (mgr.14588) 7 : audit [DBG] from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:26:26.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:24.922827+0000 mon.smithi061 (mon.0) 640 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:26.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:25.498800+0000 mon.smithi067 (mon.1) 22 : audit [DBG] from='client.? 172.21.15.61:0/295358038' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:26:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:24.452835+0000 mgr.smithi061.kxplwz (mgr.14588) 6 : cluster [DBG] pgmap v5: 97 pgs: 97 active+clean; 181 MiB data, 986 MiB used, 714 GiB / 715 GiB avail 2022-03-17T15:26:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:24.842436+0000 mgr.smithi061.kxplwz (mgr.14588) 7 : audit [DBG] from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:26:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:24.922827+0000 mon.smithi061 (mon.0) 640 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:25.498800+0000 mon.smithi067 (mon.1) 22 : audit [DBG] from='client.? 172.21.15.61:0/295358038' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:26:27.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 24576 27.70 MB/sec warmup 27 sec latency 15.862 ms 2022-03-17T15:26:28.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 25408 27.66 MB/sec warmup 28 sec latency 27.740 ms 2022-03-17T15:26:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:26.454514+0000 mgr.smithi061.kxplwz (mgr.14588) 8 : cluster [DBG] pgmap v6: 97 pgs: 97 active+clean; 194 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 18 KiB/s rd, 11 MiB/s wr, 1.07k op/s 2022-03-17T15:26:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:27.805146+0000 mon.smithi061 (mon.0) 641 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:26.454514+0000 mgr.smithi061.kxplwz (mgr.14588) 8 : cluster [DBG] pgmap v6: 97 pgs: 97 active+clean; 194 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 18 KiB/s rd, 11 MiB/s wr, 1.07k op/s 2022-03-17T15:26:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:27.805146+0000 mon.smithi061 (mon.0) 641 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:29.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 26288 27.47 MB/sec warmup 29 sec latency 13.701 ms 2022-03-17T15:26:29.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:28.303926+0000 mon.smithi061 (mon.0) 642 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:29.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:26:28.309776+0000 mgr.smithi061.kxplwz (mgr.14588) 9 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6 2022-03-17T15:26:29.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:28.303926+0000 mon.smithi061 (mon.0) 642 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:29.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:26:28.309776+0000 mgr.smithi061.kxplwz (mgr.14588) 9 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6 2022-03-17T15:26:30.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 27338 27.04 MB/sec warmup 30 sec latency 21.739 ms 2022-03-17T15:26:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:28.454926+0000 mgr.smithi061.kxplwz (mgr.14588) 10 : cluster [DBG] pgmap v7: 97 pgs: 97 active+clean; 196 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 13 KiB/s rd, 8.6 MiB/s wr, 820 op/s 2022-03-17T15:26:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:28.454926+0000 mgr.smithi061.kxplwz (mgr.14588) 10 : cluster [DBG] pgmap v7: 97 pgs: 97 active+clean; 196 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 13 KiB/s rd, 8.6 MiB/s wr, 820 op/s 2022-03-17T15:26:31.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 28289 27.47 MB/sec warmup 31 sec latency 27.729 ms 2022-03-17T15:26:32.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 28921 27.18 MB/sec warmup 32 sec latency 21.232 ms 2022-03-17T15:26:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:30.458587+0000 mgr.smithi061.kxplwz (mgr.14588) 11 : cluster [DBG] pgmap v8: 97 pgs: 97 active+clean; 196 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 9.8 KiB/s rd, 6.7 MiB/s wr, 637 op/s 2022-03-17T15:26:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:30.458587+0000 mgr.smithi061.kxplwz (mgr.14588) 11 : cluster [DBG] pgmap v8: 97 pgs: 97 active+clean; 196 MiB data, 1.1 GiB used, 714 GiB / 715 GiB avail; 9.8 KiB/s rd, 6.7 MiB/s wr, 637 op/s 2022-03-17T15:26:33.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 29727 26.86 MB/sec warmup 33 sec latency 49.436 ms 2022-03-17T15:26:34.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 30773 26.58 MB/sec warmup 34 sec latency 24.053 ms 2022-03-17T15:26:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:32.459394+0000 mgr.smithi061.kxplwz (mgr.14588) 12 : cluster [DBG] pgmap v9: 97 pgs: 97 active+clean; 205 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 17 KiB/s rd, 12 MiB/s wr, 1.10k op/s 2022-03-17T15:26:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:32.459394+0000 mgr.smithi061.kxplwz (mgr.14588) 12 : cluster [DBG] pgmap v9: 97 pgs: 97 active+clean; 205 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 17 KiB/s rd, 12 MiB/s wr, 1.10k op/s 2022-03-17T15:26:35.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 31493 26.70 MB/sec warmup 35 sec latency 24.421 ms 2022-03-17T15:26:36.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 32186 26.74 MB/sec warmup 36 sec latency 36.213 ms 2022-03-17T15:26:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:34.459786+0000 mgr.smithi061.kxplwz (mgr.14588) 13 : cluster [DBG] pgmap v10: 97 pgs: 97 active+clean; 205 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.00k op/s 2022-03-17T15:26:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:34.459786+0000 mgr.smithi061.kxplwz (mgr.14588) 13 : cluster [DBG] pgmap v10: 97 pgs: 97 active+clean; 205 MiB data, 1.2 GiB used, 714 GiB / 715 GiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.00k op/s 2022-03-17T15:26:37.120 INFO:teuthology.orchestra.run.smithi061.stdout: 5 32790 26.16 MB/sec warmup 37 sec latency 19.829 ms 2022-03-17T15:26:38.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 33361 25.92 MB/sec warmup 38 sec latency 41.126 ms 2022-03-17T15:26:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:36.460414+0000 mgr.smithi061.kxplwz (mgr.14588) 14 : cluster [DBG] pgmap v11: 97 pgs: 97 active+clean; 219 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 22 KiB/s rd, 16 MiB/s wr, 1.44k op/s 2022-03-17T15:26:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:36.460414+0000 mgr.smithi061.kxplwz (mgr.14588) 14 : cluster [DBG] pgmap v11: 97 pgs: 97 active+clean; 219 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 22 KiB/s rd, 16 MiB/s wr, 1.44k op/s 2022-03-17T15:26:39.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 34385 25.68 MB/sec warmup 39 sec latency 29.734 ms 2022-03-17T15:26:40.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 35585 26.30 MB/sec warmup 40 sec latency 18.830 ms 2022-03-17T15:26:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:38.463087+0000 mgr.smithi061.kxplwz (mgr.14588) 15 : cluster [DBG] pgmap v12: 97 pgs: 97 active+clean; 219 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 990 op/s 2022-03-17T15:26:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:38.463087+0000 mgr.smithi061.kxplwz (mgr.14588) 15 : cluster [DBG] pgmap v12: 97 pgs: 97 active+clean; 219 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 990 op/s 2022-03-17T15:26:41.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 36391 25.98 MB/sec warmup 41 sec latency 16.538 ms 2022-03-17T15:26:42.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 37255 25.90 MB/sec warmup 42 sec latency 23.515 ms 2022-03-17T15:26:42.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:40.463512+0000 mgr.smithi061.kxplwz (mgr.14588) 16 : cluster [DBG] pgmap v13: 97 pgs: 97 active+clean; 219 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 959 op/s 2022-03-17T15:26:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:40.463512+0000 mgr.smithi061.kxplwz (mgr.14588) 16 : cluster [DBG] pgmap v13: 97 pgs: 97 active+clean; 219 MiB data, 1.3 GiB used, 714 GiB / 715 GiB avail; 14 KiB/s rd, 11 MiB/s wr, 959 op/s 2022-03-17T15:26:43.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 38068 25.65 MB/sec warmup 43 sec latency 33.980 ms 2022-03-17T15:26:44.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 38979 25.92 MB/sec warmup 44 sec latency 19.347 ms 2022-03-17T15:26:44.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:42.464232+0000 mgr.smithi061.kxplwz (mgr.14588) 17 : cluster [DBG] pgmap v14: 97 pgs: 97 active+clean; 235 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 20 KiB/s rd, 16 MiB/s wr, 1.44k op/s 2022-03-17T15:26:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:42.464232+0000 mgr.smithi061.kxplwz (mgr.14588) 17 : cluster [DBG] pgmap v14: 97 pgs: 97 active+clean; 235 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 20 KiB/s rd, 16 MiB/s wr, 1.44k op/s 2022-03-17T15:26:45.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 39624 25.72 MB/sec warmup 45 sec latency 21.532 ms 2022-03-17T15:26:45.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:44.464716+0000 mgr.smithi061.kxplwz (mgr.14588) 18 : cluster [DBG] pgmap v15: 97 pgs: 97 active+clean; 235 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 12 KiB/s rd, 9.7 MiB/s wr, 911 op/s 2022-03-17T15:26:45.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:44.464716+0000 mgr.smithi061.kxplwz (mgr.14588) 18 : cluster [DBG] pgmap v15: 97 pgs: 97 active+clean; 235 MiB data, 1.4 GiB used, 714 GiB / 715 GiB avail; 12 KiB/s rd, 9.7 MiB/s wr, 911 op/s 2022-03-17T15:26:46.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 40370 25.50 MB/sec warmup 46 sec latency 27.503 ms 2022-03-17T15:26:47.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 41330 25.29 MB/sec warmup 47 sec latency 29.788 ms 2022-03-17T15:26:47.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:46.465478+0000 mgr.smithi061.kxplwz (mgr.14588) 19 : cluster [DBG] pgmap v16: 97 pgs: 97 active+clean; 247 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 19 KiB/s rd, 14 MiB/s wr, 1.36k op/s 2022-03-17T15:26:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:46.465478+0000 mgr.smithi061.kxplwz (mgr.14588) 19 : cluster [DBG] pgmap v16: 97 pgs: 97 active+clean; 247 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 19 KiB/s rd, 14 MiB/s wr, 1.36k op/s 2022-03-17T15:26:48.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 42120 25.44 MB/sec warmup 48 sec latency 14.353 ms 2022-03-17T15:26:49.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 42836 25.50 MB/sec warmup 49 sec latency 24.759 ms 2022-03-17T15:26:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:48.465887+0000 mgr.smithi061.kxplwz (mgr.14588) 20 : cluster [DBG] pgmap v17: 97 pgs: 97 active+clean; 247 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 12 KiB/s rd, 9.6 MiB/s wr, 929 op/s 2022-03-17T15:26:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:48.465887+0000 mgr.smithi061.kxplwz (mgr.14588) 20 : cluster [DBG] pgmap v17: 97 pgs: 97 active+clean; 247 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 12 KiB/s rd, 9.6 MiB/s wr, 929 op/s 2022-03-17T15:26:50.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 43496 25.13 MB/sec warmup 50 sec latency 22.886 ms 2022-03-17T15:26:51.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 44534 25.11 MB/sec warmup 51 sec latency 16.936 ms 2022-03-17T15:26:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:50.466518+0000 mgr.smithi061.kxplwz (mgr.14588) 21 : cluster [DBG] pgmap v18: 97 pgs: 97 active+clean; 247 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 12 KiB/s rd, 9.6 MiB/s wr, 929 op/s 2022-03-17T15:26:52.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:50.466518+0000 mgr.smithi061.kxplwz (mgr.14588) 21 : cluster [DBG] pgmap v18: 97 pgs: 97 active+clean; 247 MiB data, 1.5 GiB used, 714 GiB / 715 GiB avail; 12 KiB/s rd, 9.6 MiB/s wr, 929 op/s 2022-03-17T15:26:52.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 45275 24.98 MB/sec warmup 52 sec latency 31.262 ms 2022-03-17T15:26:53.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 46248 25.31 MB/sec warmup 53 sec latency 21.916 ms 2022-03-17T15:26:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:52.467201+0000 mgr.smithi061.kxplwz (mgr.14588) 22 : cluster [DBG] pgmap v19: 97 pgs: 97 active+clean; 260 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 19 KiB/s rd, 14 MiB/s wr, 1.38k op/s 2022-03-17T15:26:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:52.467201+0000 mgr.smithi061.kxplwz (mgr.14588) 22 : cluster [DBG] pgmap v19: 97 pgs: 97 active+clean; 260 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 19 KiB/s rd, 14 MiB/s wr, 1.38k op/s 2022-03-17T15:26:54.121 INFO:teuthology.orchestra.run.smithi061.stdout: 5 46737 24.97 MB/sec warmup 54 sec latency 17.800 ms 2022-03-17T15:26:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: 5 47381 24.75 MB/sec warmup 55 sec latency 27.243 ms 2022-03-17T15:26:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:54.467695+0000 mgr.smithi061.kxplwz (mgr.14588) 23 : cluster [DBG] pgmap v20: 97 pgs: 97 active+clean; 260 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 13 KiB/s rd, 9.2 MiB/s wr, 897 op/s 2022-03-17T15:26:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:54.467695+0000 mgr.smithi061.kxplwz (mgr.14588) 23 : cluster [DBG] pgmap v20: 97 pgs: 97 active+clean; 260 MiB data, 1.6 GiB used, 714 GiB / 715 GiB avail; 13 KiB/s rd, 9.2 MiB/s wr, 897 op/s 2022-03-17T15:26:56.122 INFO:teuthology.orchestra.run.smithi061.stdout: 5 48253 24.59 MB/sec warmup 56 sec latency 46.965 ms 2022-03-17T15:26:56.130 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:26:56.697 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2022-03-17T15:26:56.697 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4m) 28s ago 5m 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:26:56.697 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5m) 28s ago 5m 16.2.4 8d91d370c2b8 35aa99cfae95 2022-03-17T15:26:56.698 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5m) 31s ago 5m 16.2.4 8d91d370c2b8 056e5956721e 2022-03-17T15:26:56.698 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4m) 28s ago 5m 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:26:56.698 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (76s) 28s ago 75s 16.2.4 8d91d370c2b8 fc2d986f2f76 2022-03-17T15:26:56.698 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (74s) 31s ago 73s 16.2.4 8d91d370c2b8 7e2d207c71fd 2022-03-17T15:26:56.699 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:9283 running (6m) 28s ago 6m 16.2.4 8d91d370c2b8 f30655c578ce 2022-03-17T15:26:56.699 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5m) 31s ago 4m 16.2.4 8d91d370c2b8 4aeaa4c7a497 2022-03-17T15:26:56.699 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6m) 28s ago 6m 16.2.4 8d91d370c2b8 e511ef468147 2022-03-17T15:26:56.699 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4m) 31s ago 4m 16.2.4 8d91d370c2b8 6ba46ec348ed 2022-03-17T15:26:56.700 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.smithi061 smithi061 *:2049 running (64s) 28s ago 63s 3.5 8d91d370c2b8 c2d69628e8c7 2022-03-17T15:26:56.700 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.smithi067 smithi067 *:2049 running (59s) 31s ago 59s 3.5 8d91d370c2b8 0747e3abc197 2022-03-17T15:26:56.700 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5m) 28s ago 5m 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:26:56.700 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4m) 31s ago 4m 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:26:56.701 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4m) 28s ago 4m 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:26:56.701 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4m) 28s ago 4m 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:26:56.701 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3m) 28s ago 3m 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:26:56.701 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3m) 28s ago 3m 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:26:56.702 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3m) 31s ago 3m 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:26:56.702 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3m) 31s ago 3m 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:26:56.702 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2m) 31s ago 2m 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:26:56.702 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2m) 31s ago 2m 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:26:56.702 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4m) 28s ago 5m 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:26:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:56.105500+0000 mgr.smithi061.kxplwz (mgr.14588) 24 : audit [DBG] from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:26:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:56.105500+0000 mgr.smithi061.kxplwz (mgr.14588) 24 : audit [DBG] from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:26:57.122 INFO:teuthology.orchestra.run.smithi061.stdout: 5 49293 24.84 MB/sec warmup 57 sec latency 17.164 ms 2022-03-17T15:26:57.302 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:26:57.303 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:26:57.303 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:26:57.303 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:26:57.303 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:26:57.304 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:26:57.304 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:26:57.304 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:26:57.304 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 8 2022-03-17T15:26:57.305 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:26:57.305 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:26:57.305 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:26:57.305 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:26:57.305 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:26:57.306 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2022-03-17T15:26:57.306 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:26:57.306 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:26:57.725 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:56.469887+0000 mgr.smithi061.kxplwz (mgr.14588) 25 : cluster [DBG] pgmap v21: 97 pgs: 97 active+clean; 264 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 20 KiB/s rd, 14 MiB/s wr, 1.31k op/s 2022-03-17T15:26:57.725 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:56.674440+0000 mgr.smithi061.kxplwz (mgr.14588) 26 : audit [DBG] from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:26:57.726 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:57.300275+0000 mon.smithi061 (mon.0) 643 : audit [DBG] from='client.? 172.21.15.61:0/2231157576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:26:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:56.469887+0000 mgr.smithi061.kxplwz (mgr.14588) 25 : cluster [DBG] pgmap v21: 97 pgs: 97 active+clean; 264 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 20 KiB/s rd, 14 MiB/s wr, 1.31k op/s 2022-03-17T15:26:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:56.674440+0000 mgr.smithi061.kxplwz (mgr.14588) 26 : audit [DBG] from='client.14620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:26:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:57.300275+0000 mon.smithi061 (mon.0) 643 : audit [DBG] from='client.? 172.21.15.61:0/2231157576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:26:58.122 INFO:teuthology.orchestra.run.smithi061.stdout: 5 50127 24.88 MB/sec warmup 58 sec latency 16.942 ms 2022-03-17T15:26:59.122 INFO:teuthology.orchestra.run.smithi061.stdout: 5 50988 24.74 MB/sec warmup 59 sec latency 16.486 ms 2022-03-17T15:26:59.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:26:58.470387+0000 mgr.smithi061.kxplwz (mgr.14588) 27 : cluster [DBG] pgmap v22: 97 pgs: 97 active+clean; 264 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 14 KiB/s rd, 9.0 MiB/s wr, 860 op/s 2022-03-17T15:26:59.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:58.490313+0000 mon.smithi061 (mon.0) 644 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:59.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:26:58.491002+0000 mgr.smithi061.kxplwz (mgr.14588) 28 : cephadm [INF] Upgrade: Target is version 16.2.7-635-gb5b991d4 (pacific) 2022-03-17T15:26:59.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:26:58.491336+0000 mgr.smithi061.kxplwz (mgr.14588) 29 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ec07434c1cf95883a4d3832957990181201c162ba6ead90caf9eb6be3e9da07c, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ec07434c1cf95883a4d3832957990181201c162ba6ead90caf9eb6be3e9da07c'] 2022-03-17T15:26:59.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:26:58.492502+0000 mon.smithi061 (mon.0) 645 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:26:59.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:26:58.493826+0000 mgr.smithi061.kxplwz (mgr.14588) 30 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi061.kxplwz) 2022-03-17T15:26:59.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:26:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:26:58.953370+0000 mgr.smithi061.kxplwz (mgr.14588) 31 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:ec07434c1cf95883a4d3832957990181201c162ba6ead90caf9eb6be3e9da07c on smithi067 2022-03-17T15:26:59.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:26:58.470387+0000 mgr.smithi061.kxplwz (mgr.14588) 27 : cluster [DBG] pgmap v22: 97 pgs: 97 active+clean; 264 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 14 KiB/s rd, 9.0 MiB/s wr, 860 op/s 2022-03-17T15:26:59.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:58.490313+0000 mon.smithi061 (mon.0) 644 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:26:59.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:26:58.491002+0000 mgr.smithi061.kxplwz (mgr.14588) 28 : cephadm [INF] Upgrade: Target is version 16.2.7-635-gb5b991d4 (pacific) 2022-03-17T15:26:59.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:26:58.491336+0000 mgr.smithi061.kxplwz (mgr.14588) 29 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:ec07434c1cf95883a4d3832957990181201c162ba6ead90caf9eb6be3e9da07c, digests ['quay.ceph.io/ceph-ci/ceph@sha256:ec07434c1cf95883a4d3832957990181201c162ba6ead90caf9eb6be3e9da07c'] 2022-03-17T15:26:59.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:26:58.492502+0000 mon.smithi061 (mon.0) 645 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:26:59.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:26:58.493826+0000 mgr.smithi061.kxplwz (mgr.14588) 30 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi061.kxplwz) 2022-03-17T15:26:59.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:26:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:26:58.953370+0000 mgr.smithi061.kxplwz (mgr.14588) 31 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:ec07434c1cf95883a4d3832957990181201c162ba6ead90caf9eb6be3e9da07c on smithi067 2022-03-17T15:27:00.122 INFO:teuthology.orchestra.run.smithi061.stdout: 5 52058 24.63 MB/sec warmup 60 sec latency 21.312 ms 2022-03-17T15:27:01.122 INFO:teuthology.orchestra.run.smithi061.stdout: 5 52762 24.72 MB/sec warmup 61 sec latency 39.185 ms 2022-03-17T15:27:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:00.470786+0000 mgr.smithi061.kxplwz (mgr.14588) 32 : cluster [DBG] pgmap v23: 97 pgs: 97 active+clean; 264 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 14 KiB/s rd, 9.0 MiB/s wr, 860 op/s 2022-03-17T15:27:01.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:00.470786+0000 mgr.smithi061.kxplwz (mgr.14588) 32 : cluster [DBG] pgmap v23: 97 pgs: 97 active+clean; 264 MiB data, 1.7 GiB used, 714 GiB / 715 GiB avail; 14 KiB/s rd, 9.0 MiB/s wr, 860 op/s 2022-03-17T15:27:02.122 INFO:teuthology.orchestra.run.smithi061.stdout: 5 53453 24.77 MB/sec warmup 62 sec latency 23.983 ms 2022-03-17T15:27:03.122 INFO:teuthology.orchestra.run.smithi061.stdout: 5 54231 24.52 MB/sec warmup 63 sec latency 24.109 ms 2022-03-17T15:27:04.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:02.471855+0000 mgr.smithi061.kxplwz (mgr.14588) 33 : cluster [DBG] pgmap v24: 97 pgs: 97 active+clean; 281 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 21 KiB/s rd, 15 MiB/s wr, 1.36k op/s 2022-03-17T15:27:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:02.471855+0000 mgr.smithi061.kxplwz (mgr.14588) 33 : cluster [DBG] pgmap v24: 97 pgs: 97 active+clean; 281 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 21 KiB/s rd, 15 MiB/s wr, 1.36k op/s 2022-03-17T15:27:04.122 INFO:teuthology.orchestra.run.smithi061.stdout: 5 55050 24.47 MB/sec warmup 64 sec latency 26.503 ms 2022-03-17T15:27:05.122 INFO:teuthology.orchestra.run.smithi061.stdout: 5 55656 24.23 MB/sec warmup 65 sec latency 61.249 ms 2022-03-17T15:27:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:04.472344+0000 mgr.smithi061.kxplwz (mgr.14588) 34 : cluster [DBG] pgmap v25: 97 pgs: 97 active+clean; 281 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 14 KiB/s rd, 10 MiB/s wr, 916 op/s 2022-03-17T15:27:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:04.472344+0000 mgr.smithi061.kxplwz (mgr.14588) 34 : cluster [DBG] pgmap v25: 97 pgs: 97 active+clean; 281 MiB data, 1.8 GiB used, 713 GiB / 715 GiB avail; 14 KiB/s rd, 10 MiB/s wr, 916 op/s 2022-03-17T15:27:06.122 INFO:teuthology.orchestra.run.smithi061.stdout: 5 56597 24.44 MB/sec warmup 66 sec latency 17.308 ms 2022-03-17T15:27:07.122 INFO:teuthology.orchestra.run.smithi061.stdout: 5 57295 24.40 MB/sec warmup 67 sec latency 26.750 ms 2022-03-17T15:27:07.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:06.472984+0000 mgr.smithi061.kxplwz (mgr.14588) 35 : cluster [DBG] pgmap v26: 97 pgs: 97 active+clean; 294 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 20 KiB/s rd, 15 MiB/s wr, 1.35k op/s 2022-03-17T15:27:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:06.472984+0000 mgr.smithi061.kxplwz (mgr.14588) 35 : cluster [DBG] pgmap v26: 97 pgs: 97 active+clean; 294 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 20 KiB/s rd, 15 MiB/s wr, 1.35k op/s 2022-03-17T15:27:08.122 INFO:teuthology.orchestra.run.smithi061.stdout: 5 58032 24.23 MB/sec warmup 68 sec latency 16.418 ms 2022-03-17T15:27:09.122 INFO:teuthology.orchestra.run.smithi061.stdout: 5 58773 24.11 MB/sec warmup 69 sec latency 40.649 ms 2022-03-17T15:27:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:08.473376+0000 mgr.smithi061.kxplwz (mgr.14588) 36 : cluster [DBG] pgmap v27: 97 pgs: 97 active+clean; 294 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 935 op/s 2022-03-17T15:27:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:08.473376+0000 mgr.smithi061.kxplwz (mgr.14588) 36 : cluster [DBG] pgmap v27: 97 pgs: 97 active+clean; 294 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 935 op/s 2022-03-17T15:27:10.122 INFO:teuthology.orchestra.run.smithi061.stdout: 5 59350 23.95 MB/sec warmup 70 sec latency 24.551 ms 2022-03-17T15:27:11.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 60151 24.07 MB/sec warmup 71 sec latency 28.404 ms 2022-03-17T15:27:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:10.473785+0000 mgr.smithi061.kxplwz (mgr.14588) 37 : cluster [DBG] pgmap v28: 97 pgs: 97 active+clean; 294 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 935 op/s 2022-03-17T15:27:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:10.473785+0000 mgr.smithi061.kxplwz (mgr.14588) 37 : cluster [DBG] pgmap v28: 97 pgs: 97 active+clean; 294 MiB data, 1.9 GiB used, 713 GiB / 715 GiB avail; 13 KiB/s rd, 10 MiB/s wr, 935 op/s 2022-03-17T15:27:12.122 INFO:teuthology.orchestra.run.smithi061.stdout: 5 60922 24.04 MB/sec warmup 72 sec latency 21.212 ms 2022-03-17T15:27:13.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 61465 23.86 MB/sec warmup 73 sec latency 21.472 ms 2022-03-17T15:27:14.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:12.474488+0000 mgr.smithi061.kxplwz (mgr.14588) 38 : cluster [DBG] pgmap v29: 97 pgs: 97 active+clean; 305 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 19 KiB/s rd, 15 MiB/s wr, 1.34k op/s 2022-03-17T15:27:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:12.474488+0000 mgr.smithi061.kxplwz (mgr.14588) 38 : cluster [DBG] pgmap v29: 97 pgs: 97 active+clean; 305 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 19 KiB/s rd, 15 MiB/s wr, 1.34k op/s 2022-03-17T15:27:14.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 62006 23.74 MB/sec warmup 74 sec latency 35.962 ms 2022-03-17T15:27:15.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 62919 23.64 MB/sec warmup 75 sec latency 16.745 ms 2022-03-17T15:27:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:14.474904+0000 mgr.smithi061.kxplwz (mgr.14588) 39 : cluster [DBG] pgmap v30: 97 pgs: 97 active+clean; 305 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 12 KiB/s rd, 9.0 MiB/s wr, 833 op/s 2022-03-17T15:27:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:14.474904+0000 mgr.smithi061.kxplwz (mgr.14588) 39 : cluster [DBG] pgmap v30: 97 pgs: 97 active+clean; 305 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 12 KiB/s rd, 9.0 MiB/s wr, 833 op/s 2022-03-17T15:27:16.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 63817 23.84 MB/sec warmup 76 sec latency 22.198 ms 2022-03-17T15:27:17.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 64387 23.72 MB/sec warmup 77 sec latency 30.460 ms 2022-03-17T15:27:17.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:16.475541+0000 mgr.smithi061.kxplwz (mgr.14588) 40 : cluster [DBG] pgmap v31: 97 pgs: 97 active+clean; 316 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 13 MiB/s wr, 1.23k op/s 2022-03-17T15:27:18.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:16.475541+0000 mgr.smithi061.kxplwz (mgr.14588) 40 : cluster [DBG] pgmap v31: 97 pgs: 97 active+clean; 316 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 13 MiB/s wr, 1.23k op/s 2022-03-17T15:27:18.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 65041 23.56 MB/sec warmup 78 sec latency 19.814 ms 2022-03-17T15:27:19.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 65849 23.48 MB/sec warmup 79 sec latency 34.308 ms 2022-03-17T15:27:20.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:18.475970+0000 mgr.smithi061.kxplwz (mgr.14588) 41 : cluster [DBG] pgmap v32: 97 pgs: 97 active+clean; 316 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 11 KiB/s rd, 8.6 MiB/s wr, 802 op/s 2022-03-17T15:27:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:18.475970+0000 mgr.smithi061.kxplwz (mgr.14588) 41 : cluster [DBG] pgmap v32: 97 pgs: 97 active+clean; 316 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 11 KiB/s rd, 8.6 MiB/s wr, 802 op/s 2022-03-17T15:27:20.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 66602 23.45 MB/sec warmup 80 sec latency 17.360 ms 2022-03-17T15:27:21.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 67360 23.54 MB/sec warmup 81 sec latency 80.032 ms 2022-03-17T15:27:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:20.476416+0000 mgr.smithi061.kxplwz (mgr.14588) 42 : cluster [DBG] pgmap v33: 97 pgs: 97 active+clean; 316 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 11 KiB/s rd, 8.6 MiB/s wr, 802 op/s 2022-03-17T15:27:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:20.759475+0000 mon.smithi061 (mon.0) 646 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:27:22.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:20.768961+0000 mon.smithi061 (mon.0) 647 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:27:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:20.476416+0000 mgr.smithi061.kxplwz (mgr.14588) 42 : cluster [DBG] pgmap v33: 97 pgs: 97 active+clean; 316 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 11 KiB/s rd, 8.6 MiB/s wr, 802 op/s 2022-03-17T15:27:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:20.759475+0000 mon.smithi061 (mon.0) 646 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:27:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:20.768961+0000 mon.smithi061 (mon.0) 647 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:27:22.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 67849 23.43 MB/sec warmup 82 sec latency 34.122 ms 2022-03-17T15:27:23.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 68299 23.20 MB/sec warmup 83 sec latency 33.333 ms 2022-03-17T15:27:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:22.477010+0000 mgr.smithi061.kxplwz (mgr.14588) 43 : cluster [DBG] pgmap v34: 97 pgs: 97 active+clean; 327 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 13 MiB/s wr, 1.27k op/s 2022-03-17T15:27:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:22.477010+0000 mgr.smithi061.kxplwz (mgr.14588) 43 : cluster [DBG] pgmap v34: 97 pgs: 97 active+clean; 327 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 13 MiB/s wr, 1.27k op/s 2022-03-17T15:27:24.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 68943 23.15 MB/sec warmup 84 sec latency 23.721 ms 2022-03-17T15:27:25.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 69796 23.01 MB/sec warmup 85 sec latency 19.775 ms 2022-03-17T15:27:26.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:24.477421+0000 mgr.smithi061.kxplwz (mgr.14588) 44 : cluster [DBG] pgmap v35: 97 pgs: 97 active+clean; 327 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 11 KiB/s rd, 8.5 MiB/s wr, 867 op/s 2022-03-17T15:27:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:24.477421+0000 mgr.smithi061.kxplwz (mgr.14588) 44 : cluster [DBG] pgmap v35: 97 pgs: 97 active+clean; 327 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 11 KiB/s rd, 8.5 MiB/s wr, 867 op/s 2022-03-17T15:27:26.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 70520 23.09 MB/sec warmup 86 sec latency 23.782 ms 2022-03-17T15:27:27.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 71154 23.14 MB/sec warmup 87 sec latency 42.368 ms 2022-03-17T15:27:27.680 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:27:27.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:26.478117+0000 mgr.smithi061.kxplwz (mgr.14588) 45 : cluster [DBG] pgmap v36: 97 pgs: 97 active+clean; 333 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 12 MiB/s wr, 1.23k op/s 2022-03-17T15:27:28.042 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE VERSION IMAGE ID CONTAINER ID 2022-03-17T15:27:28.042 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4m) 60s ago 6m 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:27:28.043 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6m) 60s ago 6m 16.2.4 8d91d370c2b8 35aa99cfae95 2022-03-17T15:27:28.043 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5m) 63s ago 5m 16.2.4 8d91d370c2b8 056e5956721e 2022-03-17T15:27:28.043 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4m) 60s ago 5m 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:27:28.043 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (107s) 60s ago 107s 16.2.4 8d91d370c2b8 fc2d986f2f76 2022-03-17T15:27:28.044 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (105s) 63s ago 105s 16.2.4 8d91d370c2b8 7e2d207c71fd 2022-03-17T15:27:28.044 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:9283 running (7m) 60s ago 7m 16.2.4 8d91d370c2b8 f30655c578ce 2022-03-17T15:27:28.044 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5m) 63s ago 5m 16.2.4 8d91d370c2b8 4aeaa4c7a497 2022-03-17T15:27:28.044 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (7m) 60s ago 7m 16.2.4 8d91d370c2b8 e511ef468147 2022-03-17T15:27:28.044 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5m) 63s ago 5m 16.2.4 8d91d370c2b8 6ba46ec348ed 2022-03-17T15:27:28.045 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.smithi061 smithi061 *:2049 running (95s) 60s ago 94s 3.5 8d91d370c2b8 c2d69628e8c7 2022-03-17T15:27:28.045 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.smithi067 smithi067 *:2049 running (91s) 63s ago 90s 3.5 8d91d370c2b8 0747e3abc197 2022-03-17T15:27:28.045 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5m) 60s ago 5m 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:27:28.045 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5m) 63s ago 5m 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:27:28.046 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4m) 60s ago 4m 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:27:28.046 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4m) 60s ago 4m 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:27:28.046 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4m) 60s ago 4m 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:27:28.046 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4m) 60s ago 4m 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:27:28.046 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3m) 63s ago 3m 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:27:28.047 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3m) 63s ago 3m 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:27:28.047 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3m) 63s ago 3m 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:27:28.047 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3m) 63s ago 3m 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:27:28.047 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4m) 60s ago 5m 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:27:28.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:26.478117+0000 mgr.smithi061.kxplwz (mgr.14588) 45 : cluster [DBG] pgmap v36: 97 pgs: 97 active+clean; 333 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 17 KiB/s rd, 12 MiB/s wr, 1.23k op/s 2022-03-17T15:27:28.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 71448 22.92 MB/sec warmup 88 sec latency 40.268 ms 2022-03-17T15:27:28.446 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:27:28.447 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:27:28.447 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:27:28.447 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:27:28.447 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:27:28.447 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:27:28.448 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:27:28.448 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:27:28.448 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 8 2022-03-17T15:27:28.448 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:27:28.448 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:27:28.449 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:27:28.449 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:27:28.449 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:27:28.449 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 14 2022-03-17T15:27:28.449 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:27:28.450 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:27:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:27.665980+0000 mgr.smithi061.kxplwz (mgr.14588) 46 : audit [DBG] from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:27:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:28.026793+0000 mgr.smithi061.kxplwz (mgr.14588) 47 : audit [DBG] from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:27:29.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:28.444413+0000 mon.smithi061 (mon.0) 648 : audit [DBG] from='client.? 172.21.15.61:0/2638291251' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:27:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:27.665980+0000 mgr.smithi061.kxplwz (mgr.14588) 46 : audit [DBG] from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:27:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:28.026793+0000 mgr.smithi061.kxplwz (mgr.14588) 47 : audit [DBG] from='client.14632 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:27:29.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:28.444413+0000 mon.smithi061 (mon.0) 648 : audit [DBG] from='client.? 172.21.15.61:0/2638291251' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:27:29.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 71844 22.71 MB/sec warmup 89 sec latency 43.650 ms 2022-03-17T15:27:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:28.478513+0000 mgr.smithi061.kxplwz (mgr.14588) 48 : cluster [DBG] pgmap v37: 97 pgs: 97 active+clean; 333 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 11 KiB/s rd, 7.9 MiB/s wr, 833 op/s 2022-03-17T15:27:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:28.478513+0000 mgr.smithi061.kxplwz (mgr.14588) 48 : cluster [DBG] pgmap v37: 97 pgs: 97 active+clean; 333 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 11 KiB/s rd, 7.9 MiB/s wr, 833 op/s 2022-03-17T15:27:30.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 72497 22.67 MB/sec warmup 90 sec latency 22.928 ms 2022-03-17T15:27:31.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 73302 22.53 MB/sec warmup 91 sec latency 48.957 ms 2022-03-17T15:27:32.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:30.478888+0000 mgr.smithi061.kxplwz (mgr.14588) 49 : cluster [DBG] pgmap v38: 97 pgs: 97 active+clean; 333 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 11 KiB/s rd, 7.9 MiB/s wr, 833 op/s 2022-03-17T15:27:32.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:30.478888+0000 mgr.smithi061.kxplwz (mgr.14588) 49 : cluster [DBG] pgmap v38: 97 pgs: 97 active+clean; 333 MiB data, 2.2 GiB used, 713 GiB / 715 GiB avail; 11 KiB/s rd, 7.9 MiB/s wr, 833 op/s 2022-03-17T15:27:32.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 74067 22.63 MB/sec warmup 92 sec latency 21.538 ms 2022-03-17T15:27:33.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 74819 22.71 MB/sec warmup 93 sec latency 25.819 ms 2022-03-17T15:27:34.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 75496 22.53 MB/sec warmup 94 sec latency 20.926 ms 2022-03-17T15:27:34.217 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:32.479601+0000 mgr.smithi061.kxplwz (mgr.14588) 50 : cluster [DBG] pgmap v39: 97 pgs: 97 active+clean; 321 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.16k op/s 2022-03-17T15:27:34.217 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:27:33.079192+0000 mgr.smithi061.kxplwz (mgr.14588) 51 : cephadm [INF] Upgrade: Updating mgr.smithi067.rdualw 2022-03-17T15:27:34.217 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:33.085373+0000 mon.smithi061 (mon.0) 649 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:27:34.218 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:33.087500+0000 mon.smithi061 (mon.0) 650 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.rdualw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-03-17T15:27:34.218 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:33.088720+0000 mon.smithi061 (mon.0) 651 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr services"}]: dispatch 2022-03-17T15:27:34.218 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:33.089728+0000 mon.smithi061 (mon.0) 652 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:27:34.218 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:27:33.090675+0000 mgr.smithi061.kxplwz (mgr.14588) 52 : cephadm [INF] Deploying daemon mgr.smithi067.rdualw on smithi067 2022-03-17T15:27:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:32.479601+0000 mgr.smithi061.kxplwz (mgr.14588) 50 : cluster [DBG] pgmap v39: 97 pgs: 97 active+clean; 321 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.16k op/s 2022-03-17T15:27:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:27:33.079192+0000 mgr.smithi061.kxplwz (mgr.14588) 51 : cephadm [INF] Upgrade: Updating mgr.smithi067.rdualw 2022-03-17T15:27:34.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:33.085373+0000 mon.smithi061 (mon.0) 649 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:27:34.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:33.087500+0000 mon.smithi061 (mon.0) 650 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.rdualw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-03-17T15:27:34.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:33.088720+0000 mon.smithi061 (mon.0) 651 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr services"}]: dispatch 2022-03-17T15:27:34.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:33.089728+0000 mon.smithi061 (mon.0) 652 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:27:34.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:27:33.090675+0000 mgr.smithi061.kxplwz (mgr.14588) 52 : cephadm [INF] Deploying daemon mgr.smithi067.rdualw on smithi067 2022-03-17T15:27:35.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 75967 22.45 MB/sec warmup 95 sec latency 51.642 ms 2022-03-17T15:27:36.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 76556 22.31 MB/sec warmup 96 sec latency 49.329 ms 2022-03-17T15:27:36.403 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:34.479982+0000 mgr.smithi061.kxplwz (mgr.14588) 53 : cluster [DBG] pgmap v40: 97 pgs: 97 active+clean; 321 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 10 KiB/s rd, 6.6 MiB/s wr, 690 op/s 2022-03-17T15:27:36.403 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:35.538077+0000 mon.smithi061 (mon.0) 653 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:27:36.404 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:35.539021+0000 mon.smithi061 (mon.0) 654 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:27:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:34.479982+0000 mgr.smithi061.kxplwz (mgr.14588) 53 : cluster [DBG] pgmap v40: 97 pgs: 97 active+clean; 321 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 10 KiB/s rd, 6.6 MiB/s wr, 690 op/s 2022-03-17T15:27:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:35.538077+0000 mon.smithi061 (mon.0) 653 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:27:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:35.539021+0000 mon.smithi061 (mon.0) 654 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:27:37.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 76984 22.16 MB/sec warmup 97 sec latency 33.477 ms 2022-03-17T15:27:38.123 INFO:teuthology.orchestra.run.smithi061.stdout: 5 77388 22.11 MB/sec warmup 98 sec latency 41.494 ms 2022-03-17T15:27:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:36.480819+0000 mgr.smithi061.kxplwz (mgr.14588) 54 : cluster [DBG] pgmap v41: 97 pgs: 97 active+clean; 314 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.07k op/s 2022-03-17T15:27:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:36.480819+0000 mgr.smithi061.kxplwz (mgr.14588) 54 : cluster [DBG] pgmap v41: 97 pgs: 97 active+clean; 314 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.07k op/s 2022-03-17T15:27:39.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 77921 22.09 MB/sec warmup 99 sec latency 35.472 ms 2022-03-17T15:27:40.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 78291 22.05 MB/sec warmup 100 sec latency 37.193 ms 2022-03-17T15:27:40.402 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:38.481169+0000 mgr.smithi061.kxplwz (mgr.14588) 55 : cluster [DBG] pgmap v42: 97 pgs: 97 active+clean; 314 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 709 op/s 2022-03-17T15:27:40.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:38.481169+0000 mgr.smithi061.kxplwz (mgr.14588) 55 : cluster [DBG] pgmap v42: 97 pgs: 97 active+clean; 314 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 709 op/s 2022-03-17T15:27:41.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 78921 21.90 MB/sec warmup 101 sec latency 27.700 ms 2022-03-17T15:27:41.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:40.272580+0000 mon.smithi061 (mon.0) 655 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:27:41.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:40.666786+0000 mon.smithi061 (mon.0) 656 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:27:41.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:40.674019+0000 mon.smithi061 (mon.0) 657 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:27:41.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:40.679592+0000 mon.smithi061 (mon.0) 658 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr fail", "who": "smithi061.kxplwz"}]: dispatch 2022-03-17T15:27:41.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:40.686854+0000 mon.smithi061 (mon.0) 659 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2022-03-17T15:27:41.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:40.691913+0000 mon.smithi061 (mon.0) 660 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-03-17T15:27:41.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:40.694816+0000 mon.smithi061 (mon.0) 661 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-03-17T15:27:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:40.272580+0000 mon.smithi061 (mon.0) 655 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:27:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:40.666786+0000 mon.smithi061 (mon.0) 656 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' 2022-03-17T15:27:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:40.674019+0000 mon.smithi061 (mon.0) 657 : audit [DBG] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:27:41.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:40.679592+0000 mon.smithi061 (mon.0) 658 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr fail", "who": "smithi061.kxplwz"}]: dispatch 2022-03-17T15:27:41.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:40.686854+0000 mon.smithi061 (mon.0) 659 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2022-03-17T15:27:41.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:40.691913+0000 mon.smithi061 (mon.0) 660 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-03-17T15:27:41.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:40.694816+0000 mon.smithi061 (mon.0) 661 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-03-17T15:27:42.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 79352 21.81 MB/sec warmup 102 sec latency 40.107 ms 2022-03-17T15:27:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:40.481734+0000 mgr.smithi061.kxplwz (mgr.14588) 56 : cluster [DBG] pgmap v43: 97 pgs: 97 active+clean; 314 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 709 op/s 2022-03-17T15:27:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:27:40.675390+0000 mgr.smithi061.kxplwz (mgr.14588) 57 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi061.kxplwz) 2022-03-17T15:27:42.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:27:40.679104+0000 mgr.smithi061.kxplwz (mgr.14588) 58 : cephadm [INF] Failing over to other MGR 2022-03-17T15:27:42.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:41.669551+0000 mon.smithi061 (mon.0) 662 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "mgr fail", "who": "smithi061.kxplwz"}]': finished 2022-03-17T15:27:42.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:41.669602+0000 mon.smithi061 (mon.0) 663 : cluster [DBG] mgrmap e25: smithi067.rdualw(active, starting, since 0.988471s) 2022-03-17T15:27:42.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:41.687428+0000 mon.smithi061 (mon.0) 664 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2022-03-17T15:27:42.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:41.687502+0000 mon.smithi061 (mon.0) 665 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2022-03-17T15:27:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:40.481734+0000 mgr.smithi061.kxplwz (mgr.14588) 56 : cluster [DBG] pgmap v43: 97 pgs: 97 active+clean; 314 MiB data, 2.3 GiB used, 713 GiB / 715 GiB avail; 11 KiB/s rd, 6.8 MiB/s wr, 709 op/s 2022-03-17T15:27:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:27:40.675390+0000 mgr.smithi061.kxplwz (mgr.14588) 57 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi061.kxplwz) 2022-03-17T15:27:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:27:40.679104+0000 mgr.smithi061.kxplwz (mgr.14588) 58 : cephadm [INF] Failing over to other MGR 2022-03-17T15:27:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:41.669551+0000 mon.smithi061 (mon.0) 662 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "mgr fail", "who": "smithi061.kxplwz"}]': finished 2022-03-17T15:27:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:41.669602+0000 mon.smithi061 (mon.0) 663 : cluster [DBG] mgrmap e25: smithi067.rdualw(active, starting, since 0.988471s) 2022-03-17T15:27:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:41.687428+0000 mon.smithi061 (mon.0) 664 : audit [INF] from='mgr.14588 172.21.15.61:0/1174465630' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2022-03-17T15:27:42.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:41.687502+0000 mon.smithi061 (mon.0) 665 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2022-03-17T15:27:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 79878 21.70 MB/sec warmup 103 sec latency 47.214 ms 2022-03-17T15:27:43.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:43.666334+0000 mon.smithi061 (mon.0) 666 : cluster [INF] Active manager daemon smithi067.rdualw restarted 2022-03-17T15:27:43.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:43.667189+0000 mon.smithi061 (mon.0) 667 : cluster [INF] Activating manager daemon smithi067.rdualw 2022-03-17T15:27:43.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.667413+0000 mon.smithi061 (mon.0) 668 : audit [DBG] from='mgr.? 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/crt"}]: dispatch 2022-03-17T15:27:43.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.668773+0000 mon.smithi061 (mon.0) 669 : audit [DBG] from='mgr.? 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-03-17T15:27:43.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:43.671465+0000 mon.smithi061 (mon.0) 670 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2022-03-17T15:27:43.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.673628+0000 mon.smithi061 (mon.0) 671 : audit [DBG] from='mgr.? 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/key"}]: dispatch 2022-03-17T15:27:43.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.674193+0000 mon.smithi061 (mon.0) 672 : audit [DBG] from='mgr.? 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-03-17T15:27:44.039 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:43.666334+0000 mon.smithi061 (mon.0) 666 : cluster [INF] Active manager daemon smithi067.rdualw restarted 2022-03-17T15:27:44.039 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:43.667189+0000 mon.smithi061 (mon.0) 667 : cluster [INF] Activating manager daemon smithi067.rdualw 2022-03-17T15:27:44.039 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.667413+0000 mon.smithi061 (mon.0) 668 : audit [DBG] from='mgr.? 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/crt"}]: dispatch 2022-03-17T15:27:44.040 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.668773+0000 mon.smithi061 (mon.0) 669 : audit [DBG] from='mgr.? 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-03-17T15:27:44.040 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:43.671465+0000 mon.smithi061 (mon.0) 670 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2022-03-17T15:27:44.040 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.673628+0000 mon.smithi061 (mon.0) 671 : audit [DBG] from='mgr.? 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/key"}]: dispatch 2022-03-17T15:27:44.040 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.674193+0000 mon.smithi061 (mon.0) 672 : audit [DBG] from='mgr.? 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-03-17T15:27:44.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 80354 21.55 MB/sec warmup 104 sec latency 55.579 ms 2022-03-17T15:27:45.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:43.724190+0000 mon.smithi061 (mon.0) 673 : cluster [DBG] mgrmap e26: smithi067.rdualw(active, starting, since 0.0573002s) 2022-03-17T15:27:45.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.733706+0000 mon.smithi067 (mon.1) 23 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mon metadata", "id": "smithi061"}]: dispatch 2022-03-17T15:27:45.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.733925+0000 mon.smithi067 (mon.1) 24 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:27:45.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.734241+0000 mon.smithi067 (mon.1) 25 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi061.atvhsa"}]: dispatch 2022-03-17T15:27:45.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.734364+0000 mon.smithi067 (mon.1) 26 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi067.osftcx"}]: dispatch 2022-03-17T15:27:45.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.738511+0000 mon.smithi067 (mon.1) 27 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mgr metadata", "who": "smithi067.rdualw", "id": "smithi067.rdualw"}]: dispatch 2022-03-17T15:27:45.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.738881+0000 mon.smithi067 (mon.1) 28 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:27:45.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.739234+0000 mon.smithi067 (mon.1) 29 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:27:45.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.739492+0000 mon.smithi067 (mon.1) 30 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:27:45.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.739830+0000 mon.smithi067 (mon.1) 31 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:27:45.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.740084+0000 mon.smithi067 (mon.1) 32 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:27:45.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.740457+0000 mon.smithi067 (mon.1) 33 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:27:45.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.740686+0000 mon.smithi067 (mon.1) 34 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:27:45.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.740870+0000 mon.smithi067 (mon.1) 35 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:27:45.058 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.743357+0000 mon.smithi067 (mon.1) 36 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-03-17T15:27:45.058 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.743757+0000 mon.smithi067 (mon.1) 37 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-03-17T15:27:45.058 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.744529+0000 mon.smithi067 (mon.1) 38 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-03-17T15:27:45.058 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:43.838684+0000 mon.smithi061 (mon.0) 674 : cluster [INF] Manager daemon smithi067.rdualw is now available 2022-03-17T15:27:45.059 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.860368+0000 mon.smithi061 (mon.0) 675 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:27:45.059 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:27:43.860908+0000 mgr.smithi067.rdualw (mgr.14640) 1 : cephadm [INF] Queued nfs.foo for migration 2022-03-17T15:27:45.059 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.991226+0000 mon.smithi067 (mon.1) 39 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:27:45.059 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:43.993631+0000 mon.smithi067 (mon.1) 40 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:27:45.059 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:44.022573+0000 mon.smithi061 (mon.0) 676 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:27:45.060 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:44.052149+0000 mon.smithi067 (mon.1) 41 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:27:45.060 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:44.056587+0000 mon.smithi061 (mon.0) 677 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:27:45.060 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:44.060843+0000 mon.smithi067 (mon.1) 42 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:27:45.060 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:44.061238+0000 mon.smithi061 (mon.0) 678 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:27:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:43.724190+0000 mon.smithi061 (mon.0) 673 : cluster [DBG] mgrmap e26: smithi067.rdualw(active, starting, since 0.0573002s) 2022-03-17T15:27:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.733706+0000 mon.smithi067 (mon.1) 23 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mon metadata", "id": "smithi061"}]: dispatch 2022-03-17T15:27:45.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.733925+0000 mon.smithi067 (mon.1) 24 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:27:45.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.734241+0000 mon.smithi067 (mon.1) 25 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi061.atvhsa"}]: dispatch 2022-03-17T15:27:45.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.734364+0000 mon.smithi067 (mon.1) 26 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi067.osftcx"}]: dispatch 2022-03-17T15:27:45.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.738511+0000 mon.smithi067 (mon.1) 27 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mgr metadata", "who": "smithi067.rdualw", "id": "smithi067.rdualw"}]: dispatch 2022-03-17T15:27:45.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.738881+0000 mon.smithi067 (mon.1) 28 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:27:45.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.739234+0000 mon.smithi067 (mon.1) 29 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:27:45.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.739492+0000 mon.smithi067 (mon.1) 30 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:27:45.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.739830+0000 mon.smithi067 (mon.1) 31 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:27:45.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.740084+0000 mon.smithi067 (mon.1) 32 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:27:45.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.740457+0000 mon.smithi067 (mon.1) 33 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:27:45.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.740686+0000 mon.smithi067 (mon.1) 34 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:27:45.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.740870+0000 mon.smithi067 (mon.1) 35 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:27:45.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.743357+0000 mon.smithi067 (mon.1) 36 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-03-17T15:27:45.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.743757+0000 mon.smithi067 (mon.1) 37 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-03-17T15:27:45.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.744529+0000 mon.smithi067 (mon.1) 38 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-03-17T15:27:45.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:43.838684+0000 mon.smithi061 (mon.0) 674 : cluster [INF] Manager daemon smithi067.rdualw is now available 2022-03-17T15:27:45.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.860368+0000 mon.smithi061 (mon.0) 675 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:27:45.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:27:43.860908+0000 mgr.smithi067.rdualw (mgr.14640) 1 : cephadm [INF] Queued nfs.foo for migration 2022-03-17T15:27:45.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.991226+0000 mon.smithi067 (mon.1) 39 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:27:45.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:43.993631+0000 mon.smithi067 (mon.1) 40 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:27:45.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:44.022573+0000 mon.smithi061 (mon.0) 676 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:27:45.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:44.052149+0000 mon.smithi067 (mon.1) 41 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:27:45.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:44.056587+0000 mon.smithi061 (mon.0) 677 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:27:45.072 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:44.060843+0000 mon.smithi067 (mon.1) 42 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:27:45.072 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:44.061238+0000 mon.smithi061 (mon.0) 678 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:27:45.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 81025 21.61 MB/sec warmup 105 sec latency 26.439 ms 2022-03-17T15:27:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:44.751804+0000 mon.smithi061 (mon.0) 679 : cluster [DBG] mgrmap e27: smithi067.rdualw(active, since 1.08491s) 2022-03-17T15:27:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:44.771077+0000 mgr.smithi067.rdualw (mgr.14640) 2 : cluster [DBG] pgmap v3: 97 pgs: 97 active+clean; 328 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:27:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:44.751804+0000 mon.smithi061 (mon.0) 679 : cluster [DBG] mgrmap e27: smithi067.rdualw(active, since 1.08491s) 2022-03-17T15:27:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:44.771077+0000 mgr.smithi067.rdualw (mgr.14640) 2 : cluster [DBG] pgmap v3: 97 pgs: 97 active+clean; 328 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:27:46.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 81726 21.68 MB/sec warmup 106 sec latency 28.093 ms 2022-03-17T15:27:46.761 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:45.743487+0000 mgr.smithi067.rdualw (mgr.14640) 3 : cluster [DBG] pgmap v4: 97 pgs: 97 active+clean; 328 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:27:46.761 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:45.758169+0000 mon.smithi061 (mon.0) 680 : cluster [DBG] mgrmap e28: smithi067.rdualw(active, since 2s) 2022-03-17T15:27:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:45.743487+0000 mgr.smithi067.rdualw (mgr.14640) 3 : cluster [DBG] pgmap v4: 97 pgs: 97 active+clean; 328 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:27:47.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:45.758169+0000 mon.smithi061 (mon.0) 680 : cluster [DBG] mgrmap e28: smithi067.rdualw(active, since 2s) 2022-03-17T15:27:47.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 82280 21.54 MB/sec warmup 107 sec latency 24.556 ms 2022-03-17T15:27:48.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 82709 21.40 MB/sec warmup 108 sec latency 40.322 ms 2022-03-17T15:27:49.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:47.743949+0000 mgr.smithi067.rdualw (mgr.14640) 4 : cluster [DBG] pgmap v5: 97 pgs: 97 active+clean; 328 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:27:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:47.743949+0000 mgr.smithi067.rdualw (mgr.14640) 4 : cluster [DBG] pgmap v5: 97 pgs: 97 active+clean; 328 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:27:49.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 83307 21.38 MB/sec warmup 109 sec latency 32.834 ms 2022-03-17T15:27:50.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 83936 21.25 MB/sec warmup 110 sec latency 26.817 ms 2022-03-17T15:27:50.787 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:49.744527+0000 mgr.smithi067.rdualw (mgr.14640) 5 : cluster [DBG] pgmap v6: 97 pgs: 97 active+clean; 328 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:27:50.788 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:50.326805+0000 mon.smithi061 (mon.0) 681 : cluster [DBG] Standby manager daemon smithi061.kxplwz started 2022-03-17T15:27:50.788 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:50.329076+0000 mon.smithi061 (mon.0) 682 : audit [DBG] from='mgr.? 172.21.15.61:0/2804784926' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi061.kxplwz/crt"}]: dispatch 2022-03-17T15:27:50.788 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:50.330144+0000 mon.smithi061 (mon.0) 683 : audit [DBG] from='mgr.? 172.21.15.61:0/2804784926' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-03-17T15:27:50.789 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:50.333213+0000 mon.smithi061 (mon.0) 684 : audit [DBG] from='mgr.? 172.21.15.61:0/2804784926' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi061.kxplwz/key"}]: dispatch 2022-03-17T15:27:50.789 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:50.334168+0000 mon.smithi061 (mon.0) 685 : audit [DBG] from='mgr.? 172.21.15.61:0/2804784926' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-03-17T15:27:51.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:49.744527+0000 mgr.smithi067.rdualw (mgr.14640) 5 : cluster [DBG] pgmap v6: 97 pgs: 97 active+clean; 328 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:27:51.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:50.326805+0000 mon.smithi061 (mon.0) 681 : cluster [DBG] Standby manager daemon smithi061.kxplwz started 2022-03-17T15:27:51.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:50.329076+0000 mon.smithi061 (mon.0) 682 : audit [DBG] from='mgr.? 172.21.15.61:0/2804784926' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi061.kxplwz/crt"}]: dispatch 2022-03-17T15:27:51.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:50.330144+0000 mon.smithi061 (mon.0) 683 : audit [DBG] from='mgr.? 172.21.15.61:0/2804784926' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-03-17T15:27:51.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:50.333213+0000 mon.smithi061 (mon.0) 684 : audit [DBG] from='mgr.? 172.21.15.61:0/2804784926' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi061.kxplwz/key"}]: dispatch 2022-03-17T15:27:51.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:50.334168+0000 mon.smithi061 (mon.0) 685 : audit [DBG] from='mgr.? 172.21.15.61:0/2804784926' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-03-17T15:27:51.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 84358 21.22 MB/sec warmup 111 sec latency 38.383 ms 2022-03-17T15:27:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:50.794934+0000 mon.smithi061 (mon.0) 686 : cluster [DBG] mgrmap e29: smithi067.rdualw(active, since 7s), standbys: smithi061.kxplwz 2022-03-17T15:27:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:50.799232+0000 mon.smithi067 (mon.1) 43 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mgr metadata", "who": "smithi061.kxplwz", "id": "smithi061.kxplwz"}]: dispatch 2022-03-17T15:27:52.072 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:50.794934+0000 mon.smithi061 (mon.0) 686 : cluster [DBG] mgrmap e29: smithi067.rdualw(active, since 7s), standbys: smithi061.kxplwz 2022-03-17T15:27:52.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:50.799232+0000 mon.smithi067 (mon.1) 43 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mgr metadata", "who": "smithi061.kxplwz", "id": "smithi061.kxplwz"}]: dispatch 2022-03-17T15:27:52.124 INFO:teuthology.orchestra.run.smithi061.stdout: 5 84890 21.21 MB/sec warmup 112 sec latency 41.486 ms 2022-03-17T15:27:53.125 INFO:teuthology.orchestra.run.smithi061.stdout: 5 85355 21.20 MB/sec warmup 113 sec latency 39.398 ms 2022-03-17T15:27:53.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:51.745260+0000 mgr.smithi067.rdualw (mgr.14640) 6 : cluster [DBG] pgmap v7: 97 pgs: 97 active+clean; 319 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.9 KiB/s rd, 6.1 MiB/s wr, 603 op/s 2022-03-17T15:27:53.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:52.056158+0000 mon.smithi061 (mon.0) 687 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:27:53.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:52.579177+0000 mon.smithi067 (mon.1) 44 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:27:53.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:52.579604+0000 mon.smithi061 (mon.0) 688 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:27:53.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:51.745260+0000 mgr.smithi067.rdualw (mgr.14640) 6 : cluster [DBG] pgmap v7: 97 pgs: 97 active+clean; 319 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 8.9 KiB/s rd, 6.1 MiB/s wr, 603 op/s 2022-03-17T15:27:53.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:52.056158+0000 mon.smithi061 (mon.0) 687 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:27:53.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:52.579177+0000 mon.smithi067 (mon.1) 44 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:27:53.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:52.579604+0000 mon.smithi061 (mon.0) 688 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:27:54.125 INFO:teuthology.orchestra.run.smithi061.stdout: 5 85634 21.05 MB/sec warmup 114 sec latency 407.124 ms 2022-03-17T15:27:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:53.142747+0000 mon.smithi061 (mon.0) 689 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:27:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:53.662366+0000 mon.smithi067 (mon.1) 45 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:27:54.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:53.664267+0000 mon.smithi061 (mon.0) 690 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:27:54.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:53.668965+0000 mon.smithi061 (mon.0) 691 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:27:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:53.142747+0000 mon.smithi061 (mon.0) 689 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:27:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:53.662366+0000 mon.smithi067 (mon.1) 45 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:27:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:53.664267+0000 mon.smithi061 (mon.0) 690 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:27:54.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:53.668965+0000 mon.smithi061 (mon.0) 691 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:27:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86125 20.92 MB/sec warmup 115 sec latency 431.892 ms 2022-03-17T15:27:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:53.694153+0000 mon.smithi067 (mon.1) 46 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool create", "pool": ".nfs"}]: dispatch 2022-03-17T15:27:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:53.694547+0000 mon.smithi061 (mon.0) 692 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool create", "pool": ".nfs"}]: dispatch 2022-03-17T15:27:55.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:53.745710+0000 mgr.smithi067.rdualw (mgr.14640) 7 : cluster [DBG] pgmap v8: 97 pgs: 97 active+clean; 319 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 468 op/s 2022-03-17T15:27:55.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:54.674866+0000 mon.smithi061 (mon.0) 693 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "osd pool create", "pool": ".nfs"}]': finished 2022-03-17T15:27:55.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:54.674956+0000 mon.smithi061 (mon.0) 694 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2022-03-17T15:27:55.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:54.674968+0000 mon.smithi067 (mon.1) 47 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-03-17T15:27:55.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:54.676707+0000 mon.smithi061 (mon.0) 695 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-03-17T15:27:55.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:54.680865+0000 mon.smithi067 (mon.1) 48 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-03-17T15:27:55.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:54.681138+0000 mon.smithi067 (mon.1) 49 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool application enable", "pool": ".nfs", "app": "nfs"}]: dispatch 2022-03-17T15:27:55.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:54.681700+0000 mon.smithi061 (mon.0) 696 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-03-17T15:27:55.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:54.682074+0000 mon.smithi061 (mon.0) 697 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool application enable", "pool": ".nfs", "app": "nfs"}]: dispatch 2022-03-17T15:27:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:53.694153+0000 mon.smithi067 (mon.1) 46 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool create", "pool": ".nfs"}]: dispatch 2022-03-17T15:27:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:53.694547+0000 mon.smithi061 (mon.0) 692 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool create", "pool": ".nfs"}]: dispatch 2022-03-17T15:27:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:53.745710+0000 mgr.smithi067.rdualw (mgr.14640) 7 : cluster [DBG] pgmap v8: 97 pgs: 97 active+clean; 319 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 6.9 KiB/s rd, 4.7 MiB/s wr, 468 op/s 2022-03-17T15:27:55.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:54.674866+0000 mon.smithi061 (mon.0) 693 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "osd pool create", "pool": ".nfs"}]': finished 2022-03-17T15:27:55.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:54.674956+0000 mon.smithi061 (mon.0) 694 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2022-03-17T15:27:55.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:54.674968+0000 mon.smithi067 (mon.1) 47 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-03-17T15:27:55.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:54.676707+0000 mon.smithi061 (mon.0) 695 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-03-17T15:27:55.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:54.680865+0000 mon.smithi067 (mon.1) 48 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-03-17T15:27:55.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:54.681138+0000 mon.smithi067 (mon.1) 49 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool application enable", "pool": ".nfs", "app": "nfs"}]: dispatch 2022-03-17T15:27:55.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:54.681700+0000 mon.smithi061 (mon.0) 696 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-03-17T15:27:55.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:54.682074+0000 mon.smithi061 (mon.0) 697 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool application enable", "pool": ".nfs", "app": "nfs"}]: dispatch 2022-03-17T15:27:56.125 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86580 20.86 MB/sec warmup 116 sec latency 39.666 ms 2022-03-17T15:27:57.006 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:55.679145+0000 mon.smithi061 (mon.0) 698 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2022-03-17T15:27:57.007 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:55.679300+0000 mon.smithi061 (mon.0) 699 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "osd pool application enable", "pool": ".nfs", "app": "nfs"}]': finished 2022-03-17T15:27:57.007 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:55.679385+0000 mon.smithi061 (mon.0) 700 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2022-03-17T15:27:57.007 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:27:55.682592+0000 mgr.smithi067.rdualw (mgr.14640) 8 : cephadm [INF] Migrating nfs.foo from legacy pool nfs-ganesha namespace foo 2022-03-17T15:27:57.007 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:27:55.717230+0000 mgr.smithi067.rdualw (mgr.14640) 9 : cephadm [INF] Found 1 exports for legacy nfs.foo 2022-03-17T15:27:57.008 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:27:55.717345+0000 mgr.smithi067.rdualw (mgr.14640) 10 : cephadm [INF] Removing old nfs.foo daemons ['nfs.foo.smithi061', 'nfs.foo.smithi067'] 2022-03-17T15:27:57.008 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:27:55.717426+0000 mgr.smithi067.rdualw (mgr.14640) 11 : cephadm [INF] Remove daemons nfs.foo.smithi061 nfs.foo.smithi067 2022-03-17T15:27:57.008 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:27:55.717858+0000 mgr.smithi067.rdualw (mgr.14640) 12 : cephadm [INF] Removing daemon nfs.foo.smithi061 from smithi061 2022-03-17T15:27:57.008 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:27:55.718269+0000 mgr.smithi067.rdualw (mgr.14640) 13 : cephadm [INF] Removing daemon nfs.foo.smithi067 from smithi067 2022-03-17T15:27:57.009 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:55.746196+0000 mgr.smithi067.rdualw (mgr.14640) 14 : cluster [DBG] pgmap v11: 129 pgs: 32 creating+peering, 97 active+clean; 333 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 14 KiB/s rd, 10 MiB/s wr, 927 op/s 2022-03-17T15:27:57.011 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:55.679145+0000 mon.smithi061 (mon.0) 698 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2022-03-17T15:27:57.011 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:55.679300+0000 mon.smithi061 (mon.0) 699 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "osd pool application enable", "pool": ".nfs", "app": "nfs"}]': finished 2022-03-17T15:27:57.011 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:55.679385+0000 mon.smithi061 (mon.0) 700 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2022-03-17T15:27:57.011 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:27:55.682592+0000 mgr.smithi067.rdualw (mgr.14640) 8 : cephadm [INF] Migrating nfs.foo from legacy pool nfs-ganesha namespace foo 2022-03-17T15:27:57.012 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:27:55.717230+0000 mgr.smithi067.rdualw (mgr.14640) 9 : cephadm [INF] Found 1 exports for legacy nfs.foo 2022-03-17T15:27:57.012 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:27:55.717345+0000 mgr.smithi067.rdualw (mgr.14640) 10 : cephadm [INF] Removing old nfs.foo daemons ['nfs.foo.smithi061', 'nfs.foo.smithi067'] 2022-03-17T15:27:57.012 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:27:55.717426+0000 mgr.smithi067.rdualw (mgr.14640) 11 : cephadm [INF] Remove daemons nfs.foo.smithi061 nfs.foo.smithi067 2022-03-17T15:27:57.012 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:27:55.717858+0000 mgr.smithi067.rdualw (mgr.14640) 12 : cephadm [INF] Removing daemon nfs.foo.smithi061 from smithi061 2022-03-17T15:27:57.012 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:27:55.718269+0000 mgr.smithi067.rdualw (mgr.14640) 13 : cephadm [INF] Removing daemon nfs.foo.smithi067 from smithi067 2022-03-17T15:27:57.013 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:55.746196+0000 mgr.smithi067.rdualw (mgr.14640) 14 : cluster [DBG] pgmap v11: 129 pgs: 32 creating+peering, 97 active+clean; 333 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 14 KiB/s rd, 10 MiB/s wr, 927 op/s 2022-03-17T15:27:57.125 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 20.68 MB/sec warmup 117 sec latency 806.113 ms 2022-03-17T15:27:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:56.689951+0000 mon.smithi061 (mon.0) 701 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2022-03-17T15:27:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:56.690483+0000 mon.smithi061 (mon.0) 702 : cluster [DBG] mgrmap e30: smithi067.rdualw(active, since 13s), standbys: smithi061.kxplwz 2022-03-17T15:27:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:56.689951+0000 mon.smithi061 (mon.0) 701 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2022-03-17T15:27:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:56.690483+0000 mon.smithi061 (mon.0) 702 : cluster [DBG] mgrmap e30: smithi067.rdualw(active, since 13s), standbys: smithi061.kxplwz 2022-03-17T15:27:58.125 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 20.51 MB/sec warmup 118 sec latency 1806.197 ms 2022-03-17T15:27:58.771 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:27:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:27:57.714183+0000 mgr.smithi067.rdualw (mgr.14640) 15 : cephadm [INF] Removing key for client.nfs.foo.smithi061 2022-03-17T15:27:58.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:57.714583+0000 mon.smithi067 (mon.1) 50 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi061"}]: dispatch 2022-03-17T15:27:58.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:57.715094+0000 mon.smithi061 (mon.0) 703 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi061"}]: dispatch 2022-03-17T15:27:58.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:57.718354+0000 mon.smithi061 (mon.0) 704 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi061"}]': finished 2022-03-17T15:27:58.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:27:57.719943+0000 mgr.smithi067.rdualw (mgr.14640) 16 : cephadm [INF] Removing key for client.nfs.foo.smithi061-rgw 2022-03-17T15:27:58.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:57.720244+0000 mon.smithi067 (mon.1) 51 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi061-rgw"}]: dispatch 2022-03-17T15:27:58.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:57.720554+0000 mon.smithi061 (mon.0) 705 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi061-rgw"}]: dispatch 2022-03-17T15:27:58.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:57.725667+0000 mon.smithi061 (mon.0) 706 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi061-rgw"}]': finished 2022-03-17T15:27:58.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:57.746897+0000 mgr.smithi067.rdualw (mgr.14640) 17 : cluster [DBG] pgmap v13: 129 pgs: 32 creating+peering, 97 active+clean; 333 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.0 KiB/s rd, 6.4 MiB/s wr, 536 op/s 2022-03-17T15:27:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:27:57.714183+0000 mgr.smithi067.rdualw (mgr.14640) 15 : cephadm [INF] Removing key for client.nfs.foo.smithi061 2022-03-17T15:27:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:57.714583+0000 mon.smithi067 (mon.1) 50 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi061"}]: dispatch 2022-03-17T15:27:59.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:57.715094+0000 mon.smithi061 (mon.0) 703 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi061"}]: dispatch 2022-03-17T15:27:59.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:57.718354+0000 mon.smithi061 (mon.0) 704 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi061"}]': finished 2022-03-17T15:27:59.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:27:57.719943+0000 mgr.smithi067.rdualw (mgr.14640) 16 : cephadm [INF] Removing key for client.nfs.foo.smithi061-rgw 2022-03-17T15:27:59.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:57.720244+0000 mon.smithi067 (mon.1) 51 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi061-rgw"}]: dispatch 2022-03-17T15:27:59.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:57.720554+0000 mon.smithi061 (mon.0) 705 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi061-rgw"}]: dispatch 2022-03-17T15:27:59.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:57.725667+0000 mon.smithi061 (mon.0) 706 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi061-rgw"}]': finished 2022-03-17T15:27:59.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:57.746897+0000 mgr.smithi067.rdualw (mgr.14640) 17 : cluster [DBG] pgmap v13: 129 pgs: 32 creating+peering, 97 active+clean; 333 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.0 KiB/s rd, 6.4 MiB/s wr, 536 op/s 2022-03-17T15:27:59.063 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:27:59.063 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5m) 5s ago 6m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:27:59.063 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6m) 5s ago 6m 7033k - 16.2.4 8d91d370c2b8 35aa99cfae95 2022-03-17T15:27:59.064 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6m) 7s ago 6m 7147k - 16.2.4 8d91d370c2b8 056e5956721e 2022-03-17T15:27:59.064 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5m) 5s ago 6m 38.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:27:59.064 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2m) 5s ago 2m 41.0M - 16.2.4 8d91d370c2b8 fc2d986f2f76 2022-03-17T15:27:59.064 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2m) 7s ago 2m 13.8M - 16.2.4 8d91d370c2b8 7e2d207c71fd 2022-03-17T15:27:59.065 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:9283 running (7m) 5s ago 7m 182M - 16.2.4 8d91d370c2b8 f30655c578ce 2022-03-17T15:27:59.065 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (23s) 7s ago 6m 419M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 2afaad7a07b7 2022-03-17T15:27:59.065 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (7m) 5s ago 7m 114M 2048M 16.2.4 8d91d370c2b8 e511ef468147 2022-03-17T15:27:59.065 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5m) 7s ago 5m 78.4M 2048M 16.2.4 8d91d370c2b8 6ba46ec348ed 2022-03-17T15:27:59.066 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.smithi067 smithi067 *:2049 running (2m) 7s ago 2m 79.9M - 3.5 8d91d370c2b8 0747e3abc197 2022-03-17T15:27:59.066 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6m) 5s ago 6m 18.2M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:27:59.066 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5m) 7s ago 5m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:27:59.066 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5m) 5s ago 5m 1115M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:27:59.066 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5m) 5s ago 5m 965M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:27:59.067 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4m) 5s ago 4m 598M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:27:59.067 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4m) 5s ago 4m 1044M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:27:59.067 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4m) 7s ago 4m 962M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:27:59.068 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4m) 7s ago 4m 1291M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:27:59.068 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3m) 7s ago 3m 995M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:27:59.068 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3m) 7s ago 3m 1657M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:27:59.068 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5m) 5s ago 6m 37.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:27:59.125 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 20.33 MB/sec warmup 119 sec latency 2806.245 ms 2022-03-17T15:27:59.400 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:27:59.401 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:27:59.401 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:27:59.401 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:27:59.402 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:27:59.402 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 1, 2022-03-17T15:27:59.402 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:27:59.402 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:27:59.402 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:27:59.403 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 8 2022-03-17T15:27:59.403 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:27:59.403 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:27:59.403 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:27:59.403 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:27:59.404 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:27:59.404 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 13, 2022-03-17T15:27:59.404 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:27:59.404 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:27:59.405 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:28:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:58.755555+0000 mgr.smithi067.rdualw (mgr.14640) 18 : audit [DBG] from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:28:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:59.040419+0000 mgr.smithi067.rdualw (mgr.14640) 19 : audit [DBG] from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:28:00.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:27:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:27:59.398878+0000 mon.smithi061 (mon.0) 707 : audit [DBG] from='client.? 172.21.15.61:0/2348603034' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:28:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:58.755555+0000 mgr.smithi067.rdualw (mgr.14640) 18 : audit [DBG] from='client.14668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:28:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:59.040419+0000 mgr.smithi067.rdualw (mgr.14640) 19 : audit [DBG] from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:28:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:27:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:27:59.398878+0000 mon.smithi061 (mon.0) 707 : audit [DBG] from='client.? 172.21.15.61:0/2348603034' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:28:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:27:59.747286+0000 mgr.smithi067.rdualw (mgr.14640) 20 : cluster [DBG] pgmap v14: 129 pgs: 32 creating+peering, 97 active+clean; 333 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.0 KiB/s rd, 6.4 MiB/s wr, 536 op/s 2022-03-17T15:28:01.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:00.387575+0000 mgr.smithi067.rdualw (mgr.14640) 21 : cephadm [INF] Removing key for client.nfs.foo.smithi067 2022-03-17T15:28:01.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.387892+0000 mon.smithi067 (mon.1) 52 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi067"}]: dispatch 2022-03-17T15:28:01.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.388404+0000 mon.smithi061 (mon.0) 708 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi067"}]: dispatch 2022-03-17T15:28:01.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.392337+0000 mon.smithi061 (mon.0) 709 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi067"}]': finished 2022-03-17T15:28:01.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:00.393058+0000 mgr.smithi067.rdualw (mgr.14640) 22 : cephadm [INF] Removing key for client.nfs.foo.smithi067-rgw 2022-03-17T15:28:01.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.393310+0000 mon.smithi067 (mon.1) 53 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi067-rgw"}]: dispatch 2022-03-17T15:28:01.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.393654+0000 mon.smithi061 (mon.0) 710 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi067-rgw"}]: dispatch 2022-03-17T15:28:01.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.396815+0000 mon.smithi061 (mon.0) 711 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi067-rgw"}]': finished 2022-03-17T15:28:01.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.400860+0000 mon.smithi061 (mon.0) 712 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:01.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.401866+0000 mon.smithi067 (mon.1) 54 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "nfs export apply", "cluster_id": "foo"}]: dispatch 2022-03-17T15:28:01.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.402490+0000 mgr.smithi067.rdualw (mgr.14640) 23 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "nfs export apply", "cluster_id": "foo"}]: dispatch 2022-03-17T15:28:01.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.433519+0000 mon.smithi067 (mon.1) 55 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo, allow rw tag cephfs data=foofs", "mds", "allow rw path=/"], "format": "json"}]: dispatch 2022-03-17T15:28:01.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.433919+0000 mon.smithi061 (mon.0) 713 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo, allow rw tag cephfs data=foofs", "mds", "allow rw path=/"], "format": "json"}]: dispatch 2022-03-17T15:28:01.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.437336+0000 mon.smithi061 (mon.0) 714 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo, allow rw tag cephfs data=foofs", "mds", "allow rw path=/"], "format": "json"}]': finished 2022-03-17T15:28:01.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.447109+0000 mon.smithi061 (mon.0) 715 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:01.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.452513+0000 mon.smithi061 (mon.0) 716 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:01.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.456725+0000 mon.smithi061 (mon.0) 717 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:01.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.462675+0000 mon.smithi061 (mon.0) 718 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:01.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.470954+0000 mon.smithi061 (mon.0) 719 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:01.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.472938+0000 mon.smithi067 (mon.1) 56 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi061.vliecs", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo"]}]: dispatch 2022-03-17T15:28:01.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.473449+0000 mon.smithi061 (mon.0) 720 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi061.vliecs", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo"]}]: dispatch 2022-03-17T15:28:01.058 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.476292+0000 mon.smithi061 (mon.0) 721 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi061.vliecs", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo"]}]': finished 2022-03-17T15:28:01.058 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.480562+0000 mon.smithi067 (mon.1) 57 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.mgr.nfs.grace.nfs.foo", "caps": ["mon", "allow r", "osd", "allow rwx pool .nfs"]}]: dispatch 2022-03-17T15:28:01.058 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.481063+0000 mon.smithi061 (mon.0) 722 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.mgr.nfs.grace.nfs.foo", "caps": ["mon", "allow r", "osd", "allow rwx pool .nfs"]}]: dispatch 2022-03-17T15:28:01.058 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.483870+0000 mon.smithi061 (mon.0) 723 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth get-or-create", "entity": "client.mgr.nfs.grace.nfs.foo", "caps": ["mon", "allow r", "osd", "allow rwx pool .nfs"]}]': finished 2022-03-17T15:28:01.058 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.487429+0000 mon.smithi067 (mon.1) 58 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:01.059 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.528901+0000 mon.smithi067 (mon.1) 59 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.mgr.nfs.grace.nfs.foo"}]: dispatch 2022-03-17T15:28:01.059 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.529226+0000 mon.smithi061 (mon.0) 724 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.mgr.nfs.grace.nfs.foo"}]: dispatch 2022-03-17T15:28:01.059 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.532319+0000 mon.smithi061 (mon.0) 725 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth rm", "entity": "client.mgr.nfs.grace.nfs.foo"}]': finished 2022-03-17T15:28:01.059 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.582325+0000 mon.smithi067 (mon.1) 60 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi061.vliecs-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2022-03-17T15:28:01.060 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.582833+0000 mon.smithi061 (mon.0) 726 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi061.vliecs-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2022-03-17T15:28:01.060 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.585942+0000 mon.smithi061 (mon.0) 727 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi061.vliecs-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]': finished 2022-03-17T15:28:01.060 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:00.596683+0000 mon.smithi067 (mon.1) 61 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:27:59.747286+0000 mgr.smithi067.rdualw (mgr.14640) 20 : cluster [DBG] pgmap v14: 129 pgs: 32 creating+peering, 97 active+clean; 333 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 8.0 KiB/s rd, 6.4 MiB/s wr, 536 op/s 2022-03-17T15:28:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:00.387575+0000 mgr.smithi067.rdualw (mgr.14640) 21 : cephadm [INF] Removing key for client.nfs.foo.smithi067 2022-03-17T15:28:01.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.387892+0000 mon.smithi067 (mon.1) 52 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi067"}]: dispatch 2022-03-17T15:28:01.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.388404+0000 mon.smithi061 (mon.0) 708 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi067"}]: dispatch 2022-03-17T15:28:01.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.392337+0000 mon.smithi061 (mon.0) 709 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi067"}]': finished 2022-03-17T15:28:01.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:00.393058+0000 mgr.smithi067.rdualw (mgr.14640) 22 : cephadm [INF] Removing key for client.nfs.foo.smithi067-rgw 2022-03-17T15:28:01.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.393310+0000 mon.smithi067 (mon.1) 53 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi067-rgw"}]: dispatch 2022-03-17T15:28:01.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.393654+0000 mon.smithi061 (mon.0) 710 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi067-rgw"}]: dispatch 2022-03-17T15:28:01.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.396815+0000 mon.smithi061 (mon.0) 711 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth rm", "entity": "client.nfs.foo.smithi067-rgw"}]': finished 2022-03-17T15:28:01.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.400860+0000 mon.smithi061 (mon.0) 712 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:01.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.401866+0000 mon.smithi067 (mon.1) 54 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "nfs export apply", "cluster_id": "foo"}]: dispatch 2022-03-17T15:28:01.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.402490+0000 mgr.smithi067.rdualw (mgr.14640) 23 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "nfs export apply", "cluster_id": "foo"}]: dispatch 2022-03-17T15:28:01.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.433519+0000 mon.smithi067 (mon.1) 55 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo, allow rw tag cephfs data=foofs", "mds", "allow rw path=/"], "format": "json"}]: dispatch 2022-03-17T15:28:01.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.433919+0000 mon.smithi061 (mon.0) 713 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo, allow rw tag cephfs data=foofs", "mds", "allow rw path=/"], "format": "json"}]: dispatch 2022-03-17T15:28:01.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.437336+0000 mon.smithi061 (mon.0) 714 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo, allow rw tag cephfs data=foofs", "mds", "allow rw path=/"], "format": "json"}]': finished 2022-03-17T15:28:01.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.447109+0000 mon.smithi061 (mon.0) 715 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:01.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.452513+0000 mon.smithi061 (mon.0) 716 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:01.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.456725+0000 mon.smithi061 (mon.0) 717 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:01.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.462675+0000 mon.smithi061 (mon.0) 718 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:01.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.470954+0000 mon.smithi061 (mon.0) 719 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:01.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.472938+0000 mon.smithi067 (mon.1) 56 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi061.vliecs", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo"]}]: dispatch 2022-03-17T15:28:01.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.473449+0000 mon.smithi061 (mon.0) 720 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi061.vliecs", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo"]}]: dispatch 2022-03-17T15:28:01.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.476292+0000 mon.smithi061 (mon.0) 721 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi061.vliecs", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo"]}]': finished 2022-03-17T15:28:01.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.480562+0000 mon.smithi067 (mon.1) 57 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.mgr.nfs.grace.nfs.foo", "caps": ["mon", "allow r", "osd", "allow rwx pool .nfs"]}]: dispatch 2022-03-17T15:28:01.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.481063+0000 mon.smithi061 (mon.0) 722 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.mgr.nfs.grace.nfs.foo", "caps": ["mon", "allow r", "osd", "allow rwx pool .nfs"]}]: dispatch 2022-03-17T15:28:01.072 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.483870+0000 mon.smithi061 (mon.0) 723 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth get-or-create", "entity": "client.mgr.nfs.grace.nfs.foo", "caps": ["mon", "allow r", "osd", "allow rwx pool .nfs"]}]': finished 2022-03-17T15:28:01.072 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.487429+0000 mon.smithi067 (mon.1) 58 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:01.072 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.528901+0000 mon.smithi067 (mon.1) 59 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.mgr.nfs.grace.nfs.foo"}]: dispatch 2022-03-17T15:28:01.072 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.529226+0000 mon.smithi061 (mon.0) 724 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.mgr.nfs.grace.nfs.foo"}]: dispatch 2022-03-17T15:28:01.072 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.532319+0000 mon.smithi061 (mon.0) 725 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth rm", "entity": "client.mgr.nfs.grace.nfs.foo"}]': finished 2022-03-17T15:28:01.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.582325+0000 mon.smithi067 (mon.1) 60 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi061.vliecs-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2022-03-17T15:28:01.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.582833+0000 mon.smithi061 (mon.0) 726 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi061.vliecs-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2022-03-17T15:28:01.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.585942+0000 mon.smithi061 (mon.0) 727 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.0.0.smithi061.vliecs-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]': finished 2022-03-17T15:28:01.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:00.596683+0000 mon.smithi067 (mon.1) 61 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:01.125 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 1 sec latency 4806.397 ms 2022-03-17T15:28:01.864 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:00.443334+0000 mgr.smithi067.rdualw (mgr.14640) 24 : cephadm [INF] Done migrating nfs.foo 2022-03-17T15:28:01.864 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:00.443413+0000 mgr.smithi067.rdualw (mgr.14640) 25 : cephadm [INF] Done migrating all NFS services 2022-03-17T15:28:01.864 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:00.472622+0000 mgr.smithi067.rdualw (mgr.14640) 26 : cephadm [INF] Creating key for client.nfs.foo.0.0.smithi061.vliecs 2022-03-17T15:28:01.865 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:00.480302+0000 mgr.smithi067.rdualw (mgr.14640) 27 : cephadm [INF] Ensuring nfs.foo.0 is in the ganesha grace table 2022-03-17T15:28:01.865 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:00.581843+0000 mgr.smithi067.rdualw (mgr.14640) 28 : cephadm [INF] Rados config object exists: conf-nfs.foo 2022-03-17T15:28:01.865 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:00.581949+0000 mgr.smithi067.rdualw (mgr.14640) 29 : cephadm [INF] Creating key for client.nfs.foo.0.0.smithi061.vliecs-rgw 2022-03-17T15:28:01.865 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:00.597644+0000 mgr.smithi067.rdualw (mgr.14640) 30 : cephadm [INF] Deploying daemon nfs.foo.0.0.smithi061.vliecs on smithi061 2022-03-17T15:28:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:00.443334+0000 mgr.smithi067.rdualw (mgr.14640) 24 : cephadm [INF] Done migrating nfs.foo 2022-03-17T15:28:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:00.443413+0000 mgr.smithi067.rdualw (mgr.14640) 25 : cephadm [INF] Done migrating all NFS services 2022-03-17T15:28:02.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:00.472622+0000 mgr.smithi067.rdualw (mgr.14640) 26 : cephadm [INF] Creating key for client.nfs.foo.0.0.smithi061.vliecs 2022-03-17T15:28:02.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:00.480302+0000 mgr.smithi067.rdualw (mgr.14640) 27 : cephadm [INF] Ensuring nfs.foo.0 is in the ganesha grace table 2022-03-17T15:28:02.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:00.581843+0000 mgr.smithi067.rdualw (mgr.14640) 28 : cephadm [INF] Rados config object exists: conf-nfs.foo 2022-03-17T15:28:02.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:00.581949+0000 mgr.smithi067.rdualw (mgr.14640) 29 : cephadm [INF] Creating key for client.nfs.foo.0.0.smithi061.vliecs-rgw 2022-03-17T15:28:02.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:00.597644+0000 mgr.smithi067.rdualw (mgr.14640) 30 : cephadm [INF] Deploying daemon nfs.foo.0.0.smithi061.vliecs on smithi061 2022-03-17T15:28:02.125 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 2 sec latency 5806.428 ms 2022-03-17T15:28:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:01.748152+0000 mgr.smithi067.rdualw (mgr.14640) 31 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 640 op/s 2022-03-17T15:28:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:01.748152+0000 mgr.smithi067.rdualw (mgr.14640) 31 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 12 KiB/s rd, 6.8 MiB/s wr, 640 op/s 2022-03-17T15:28:03.125 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 3 sec latency 6806.520 ms 2022-03-17T15:28:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:02.745996+0000 mon.smithi061 (mon.0) 728 : cluster [DBG] mgrmap e31: smithi067.rdualw(active, since 19s), standbys: smithi061.kxplwz 2022-03-17T15:28:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:02.779734+0000 mon.smithi061 (mon.0) 729 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:04.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:02.781811+0000 mgr.smithi067.rdualw (mgr.14640) 32 : cephadm [INF] Creating key for client.nfs.foo.1.0.smithi067.ycbiqg 2022-03-17T15:28:04.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:02.782127+0000 mon.smithi067 (mon.1) 62 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1.0.smithi067.ycbiqg", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo"]}]: dispatch 2022-03-17T15:28:04.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:02.782457+0000 mon.smithi061 (mon.0) 730 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1.0.smithi067.ycbiqg", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo"]}]: dispatch 2022-03-17T15:28:04.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:02.785438+0000 mon.smithi061 (mon.0) 731 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1.0.smithi067.ycbiqg", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo"]}]': finished 2022-03-17T15:28:04.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:02.786786+0000 mgr.smithi067.rdualw (mgr.14640) 33 : cephadm [INF] Ensuring nfs.foo.1 is in the ganesha grace table 2022-03-17T15:28:04.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:02.787061+0000 mon.smithi067 (mon.1) 63 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.mgr.nfs.grace.nfs.foo", "caps": ["mon", "allow r", "osd", "allow rwx pool .nfs"]}]: dispatch 2022-03-17T15:28:04.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:02.787346+0000 mon.smithi061 (mon.0) 732 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.mgr.nfs.grace.nfs.foo", "caps": ["mon", "allow r", "osd", "allow rwx pool .nfs"]}]: dispatch 2022-03-17T15:28:04.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:02.790411+0000 mon.smithi061 (mon.0) 733 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth get-or-create", "entity": "client.mgr.nfs.grace.nfs.foo", "caps": ["mon", "allow r", "osd", "allow rwx pool .nfs"]}]': finished 2022-03-17T15:28:04.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:02.792686+0000 mon.smithi067 (mon.1) 64 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:02.745996+0000 mon.smithi061 (mon.0) 728 : cluster [DBG] mgrmap e31: smithi067.rdualw(active, since 19s), standbys: smithi061.kxplwz 2022-03-17T15:28:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:02.779734+0000 mon.smithi061 (mon.0) 729 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:02.781811+0000 mgr.smithi067.rdualw (mgr.14640) 32 : cephadm [INF] Creating key for client.nfs.foo.1.0.smithi067.ycbiqg 2022-03-17T15:28:04.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:02.782127+0000 mon.smithi067 (mon.1) 62 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1.0.smithi067.ycbiqg", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo"]}]: dispatch 2022-03-17T15:28:04.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:02.782457+0000 mon.smithi061 (mon.0) 730 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1.0.smithi067.ycbiqg", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo"]}]: dispatch 2022-03-17T15:28:04.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:02.785438+0000 mon.smithi061 (mon.0) 731 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1.0.smithi067.ycbiqg", "caps": ["mon", "allow r", "osd", "allow rw pool=.nfs namespace=foo"]}]': finished 2022-03-17T15:28:04.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:02.786786+0000 mgr.smithi067.rdualw (mgr.14640) 33 : cephadm [INF] Ensuring nfs.foo.1 is in the ganesha grace table 2022-03-17T15:28:04.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:02.787061+0000 mon.smithi067 (mon.1) 63 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.mgr.nfs.grace.nfs.foo", "caps": ["mon", "allow r", "osd", "allow rwx pool .nfs"]}]: dispatch 2022-03-17T15:28:04.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:02.787346+0000 mon.smithi061 (mon.0) 732 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.mgr.nfs.grace.nfs.foo", "caps": ["mon", "allow r", "osd", "allow rwx pool .nfs"]}]: dispatch 2022-03-17T15:28:04.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:02.790411+0000 mon.smithi061 (mon.0) 733 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth get-or-create", "entity": "client.mgr.nfs.grace.nfs.foo", "caps": ["mon", "allow r", "osd", "allow rwx pool .nfs"]}]': finished 2022-03-17T15:28:04.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:02.792686+0000 mon.smithi067 (mon.1) 64 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:04.125 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 4 sec latency 7806.644 ms 2022-03-17T15:28:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:03.748613+0000 mgr.smithi067.rdualw (mgr.14640) 34 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.2 MiB/s wr, 162 op/s 2022-03-17T15:28:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:03.748613+0000 mgr.smithi067.rdualw (mgr.14640) 34 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.3 KiB/s rd, 1.2 MiB/s wr, 162 op/s 2022-03-17T15:28:05.126 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 5 sec latency 8806.775 ms 2022-03-17T15:28:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:05.676927+0000 mon.smithi067 (mon.1) 65 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.mgr.nfs.grace.nfs.foo"}]: dispatch 2022-03-17T15:28:06.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:05.677414+0000 mon.smithi061 (mon.0) 734 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.mgr.nfs.grace.nfs.foo"}]: dispatch 2022-03-17T15:28:06.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:05.682322+0000 mon.smithi061 (mon.0) 735 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth rm", "entity": "client.mgr.nfs.grace.nfs.foo"}]': finished 2022-03-17T15:28:06.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:05.738170+0000 mon.smithi067 (mon.1) 66 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1.0.smithi067.ycbiqg-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2022-03-17T15:28:06.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:05.738557+0000 mon.smithi061 (mon.0) 736 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1.0.smithi067.ycbiqg-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2022-03-17T15:28:06.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:05.742158+0000 mon.smithi061 (mon.0) 737 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1.0.smithi067.ycbiqg-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]': finished 2022-03-17T15:28:06.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:05.743723+0000 mon.smithi067 (mon.1) 67 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:05.676927+0000 mon.smithi067 (mon.1) 65 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.mgr.nfs.grace.nfs.foo"}]: dispatch 2022-03-17T15:28:06.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:05.677414+0000 mon.smithi061 (mon.0) 734 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth rm", "entity": "client.mgr.nfs.grace.nfs.foo"}]: dispatch 2022-03-17T15:28:06.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:05.682322+0000 mon.smithi061 (mon.0) 735 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth rm", "entity": "client.mgr.nfs.grace.nfs.foo"}]': finished 2022-03-17T15:28:06.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:05.738170+0000 mon.smithi067 (mon.1) 66 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1.0.smithi067.ycbiqg-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2022-03-17T15:28:06.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:05.738557+0000 mon.smithi061 (mon.0) 736 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1.0.smithi067.ycbiqg-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2022-03-17T15:28:06.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:05.742158+0000 mon.smithi061 (mon.0) 737 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "auth get-or-create", "entity": "client.nfs.foo.1.0.smithi067.ycbiqg-rgw", "caps": ["mon", "allow r", "osd", "allow rwx tag rgw *=*"]}]': finished 2022-03-17T15:28:06.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:05.743723+0000 mon.smithi067 (mon.1) 67 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:06.126 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 6 sec latency 9806.860 ms 2022-03-17T15:28:06.899 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:05.737612+0000 mgr.smithi067.rdualw (mgr.14640) 35 : cephadm [INF] Rados config object exists: conf-nfs.foo 2022-03-17T15:28:06.900 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:05.737740+0000 mgr.smithi067.rdualw (mgr.14640) 36 : cephadm [INF] Creating key for client.nfs.foo.1.0.smithi067.ycbiqg-rgw 2022-03-17T15:28:06.900 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:05.744683+0000 mgr.smithi067.rdualw (mgr.14640) 37 : cephadm [INF] Deploying daemon nfs.foo.1.0.smithi067.ycbiqg on smithi067 2022-03-17T15:28:06.900 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:05.749474+0000 mgr.smithi067.rdualw (mgr.14640) 38 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.1 KiB/s rd, 1.0 MiB/s wr, 134 op/s 2022-03-17T15:28:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:05.737612+0000 mgr.smithi067.rdualw (mgr.14640) 35 : cephadm [INF] Rados config object exists: conf-nfs.foo 2022-03-17T15:28:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:05.737740+0000 mgr.smithi067.rdualw (mgr.14640) 36 : cephadm [INF] Creating key for client.nfs.foo.1.0.smithi067.ycbiqg-rgw 2022-03-17T15:28:07.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:05.744683+0000 mgr.smithi067.rdualw (mgr.14640) 37 : cephadm [INF] Deploying daemon nfs.foo.1.0.smithi067.ycbiqg on smithi067 2022-03-17T15:28:07.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:05.749474+0000 mgr.smithi067.rdualw (mgr.14640) 38 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 5.1 KiB/s rd, 1.0 MiB/s wr, 134 op/s 2022-03-17T15:28:07.126 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 7 sec latency 10806.977 ms 2022-03-17T15:28:08.126 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 8 sec latency 11807.068 ms 2022-03-17T15:28:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:07.690957+0000 mon.smithi061 (mon.0) 738 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:09.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:07.693627+0000 mon.smithi067 (mon.1) 68 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:09.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:07.694560+0000 mon.smithi067 (mon.1) 69 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:09.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:07.695178+0000 mon.smithi067 (mon.1) 70 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:28:09.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:07.695775+0000 mgr.smithi067.rdualw (mgr.14640) 39 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:28:09.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:07.749935+0000 mgr.smithi067.rdualw (mgr.14640) 40 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.6 KiB/s rd, 935 KiB/s wr, 122 op/s 2022-03-17T15:28:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:07.690957+0000 mon.smithi061 (mon.0) 738 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:09.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:07.693627+0000 mon.smithi067 (mon.1) 68 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:09.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:07.694560+0000 mon.smithi067 (mon.1) 69 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:09.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:07.695178+0000 mon.smithi067 (mon.1) 70 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:28:09.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:07.695775+0000 mgr.smithi067.rdualw (mgr.14640) 39 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:28:09.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:07.749935+0000 mgr.smithi067.rdualw (mgr.14640) 40 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.6 KiB/s rd, 935 KiB/s wr, 122 op/s 2022-03-17T15:28:09.126 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 9 sec latency 12807.139 ms 2022-03-17T15:28:10.126 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 10 sec latency 13807.252 ms 2022-03-17T15:28:10.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:09.051076+0000 mon.smithi061 (mon.0) 739 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:09.051076+0000 mon.smithi061 (mon.0) 739 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:11.126 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 11 sec latency 14807.348 ms 2022-03-17T15:28:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:09.750343+0000 mgr.smithi067.rdualw (mgr.14640) 41 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.2 KiB/s rd, 862 KiB/s wr, 112 op/s 2022-03-17T15:28:11.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:09.750343+0000 mgr.smithi067.rdualw (mgr.14640) 41 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.2 KiB/s rd, 862 KiB/s wr, 112 op/s 2022-03-17T15:28:12.126 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 12 sec latency 15807.393 ms 2022-03-17T15:28:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:11.751135+0000 mgr.smithi067.rdualw (mgr.14640) 42 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 867 KiB/s wr, 116 op/s 2022-03-17T15:28:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:11.751135+0000 mgr.smithi067.rdualw (mgr.14640) 42 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 5.8 KiB/s rd, 867 KiB/s wr, 116 op/s 2022-03-17T15:28:13.126 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 13 sec latency 16807.434 ms 2022-03-17T15:28:14.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:12.658513+0000 mon.smithi061 (mon.0) 740 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:12.658513+0000 mon.smithi061 (mon.0) 740 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:14.126 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 14 sec latency 17807.516 ms 2022-03-17T15:28:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:13.751572+0000 mgr.smithi067.rdualw (mgr.14640) 43 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.9 KiB/s rd, 30 KiB/s wr, 7 op/s 2022-03-17T15:28:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:14.457389+0000 mon.smithi061 (mon.0) 741 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:15.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:14.462608+0000 mon.smithi061 (mon.0) 742 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:15.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:14.470839+0000 mon.smithi061 (mon.0) 743 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:15.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:14.476410+0000 mon.smithi067 (mon.1) 71 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:15.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:14.480697+0000 mon.smithi061 (mon.0) 744 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:13.751572+0000 mgr.smithi067.rdualw (mgr.14640) 43 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 2.9 KiB/s rd, 30 KiB/s wr, 7 op/s 2022-03-17T15:28:15.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:14.457389+0000 mon.smithi061 (mon.0) 741 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:15.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:14.462608+0000 mon.smithi061 (mon.0) 742 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:15.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:14.470839+0000 mon.smithi061 (mon.0) 743 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:15.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:14.476410+0000 mon.smithi067 (mon.1) 71 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:15.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:14.480697+0000 mon.smithi061 (mon.0) 744 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:15.127 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 15 sec latency 18807.634 ms 2022-03-17T15:28:15.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:14.482525+0000 mgr.smithi067.rdualw (mgr.14640) 44 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi067.rdualw) 2022-03-17T15:28:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:14.482525+0000 mgr.smithi067.rdualw (mgr.14640) 44 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi067.rdualw) 2022-03-17T15:28:16.127 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 16 sec latency 19807.743 ms 2022-03-17T15:28:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:15.752468+0000 mgr.smithi067.rdualw (mgr.14640) 45 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 30 KiB/s wr, 8 op/s 2022-03-17T15:28:17.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:15.881648+0000 mgr.smithi067.rdualw (mgr.14640) 46 : cephadm [INF] Upgrade: Updating mgr.smithi061.kxplwz 2022-03-17T15:28:17.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:15.886498+0000 mon.smithi061 (mon.0) 745 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:17.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:15.888271+0000 mon.smithi067 (mon.1) 72 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi061.kxplwz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-03-17T15:28:17.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:15.888597+0000 mon.smithi061 (mon.0) 746 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi061.kxplwz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-03-17T15:28:17.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:15.889760+0000 mon.smithi067 (mon.1) 73 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mgr services"}]: dispatch 2022-03-17T15:28:17.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:15.890818+0000 mon.smithi067 (mon.1) 74 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:17.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:15.891625+0000 mgr.smithi067.rdualw (mgr.14640) 47 : cephadm [INF] Deploying daemon mgr.smithi061.kxplwz on smithi061 2022-03-17T15:28:17.127 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 17 sec latency 20807.794 ms 2022-03-17T15:28:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:15.752468+0000 mgr.smithi067.rdualw (mgr.14640) 45 : cluster [DBG] pgmap v22: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 3.2 KiB/s rd, 30 KiB/s wr, 8 op/s 2022-03-17T15:28:17.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:15.881648+0000 mgr.smithi067.rdualw (mgr.14640) 46 : cephadm [INF] Upgrade: Updating mgr.smithi061.kxplwz 2022-03-17T15:28:17.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:15.886498+0000 mon.smithi061 (mon.0) 745 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:17.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:15.888271+0000 mon.smithi067 (mon.1) 72 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi061.kxplwz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-03-17T15:28:17.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:15.888597+0000 mon.smithi061 (mon.0) 746 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi061.kxplwz", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-03-17T15:28:17.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:15.889760+0000 mon.smithi067 (mon.1) 73 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mgr services"}]: dispatch 2022-03-17T15:28:17.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:15.890818+0000 mon.smithi067 (mon.1) 74 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:17.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:15.891625+0000 mgr.smithi067.rdualw (mgr.14640) 47 : cephadm [INF] Deploying daemon mgr.smithi061.kxplwz on smithi061 2022-03-17T15:28:18.127 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 18 sec latency 21807.912 ms 2022-03-17T15:28:19.127 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 19 sec latency 22807.976 ms 2022-03-17T15:28:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:17.752962+0000 mgr.smithi067.rdualw (mgr.14640) 48 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.8 KiB/s rd, 5.1 KiB/s wr, 5 op/s 2022-03-17T15:28:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:17.752962+0000 mgr.smithi067.rdualw (mgr.14640) 48 : cluster [DBG] pgmap v23: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.8 KiB/s rd, 5.1 KiB/s wr, 5 op/s 2022-03-17T15:28:20.127 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 20 sec latency 23808.038 ms 2022-03-17T15:28:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:19.753500+0000 mgr.smithi067.rdualw (mgr.14640) 49 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.8 KiB/s rd, 5.1 KiB/s wr, 5 op/s 2022-03-17T15:28:21.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:19.782283+0000 mon.smithi061 (mon.0) 747 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:21.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:19.783885+0000 mon.smithi067 (mon.1) 75 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:21.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:19.785178+0000 mon.smithi067 (mon.1) 76 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:21.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:19.786057+0000 mon.smithi067 (mon.1) 77 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:28:21.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:19.786834+0000 mgr.smithi067.rdualw (mgr.14640) 50 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:28:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:19.753500+0000 mgr.smithi067.rdualw (mgr.14640) 49 : cluster [DBG] pgmap v24: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.8 KiB/s rd, 5.1 KiB/s wr, 5 op/s 2022-03-17T15:28:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:19.782283+0000 mon.smithi061 (mon.0) 747 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:19.783885+0000 mon.smithi067 (mon.1) 75 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:21.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:19.785178+0000 mon.smithi067 (mon.1) 76 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:21.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:19.786057+0000 mon.smithi067 (mon.1) 77 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:28:21.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:19.786834+0000 mgr.smithi067.rdualw (mgr.14640) 50 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:28:21.127 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 21 sec latency 24808.064 ms 2022-03-17T15:28:22.127 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 22 sec latency 25808.093 ms 2022-03-17T15:28:22.980 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:21.754366+0000 mgr.smithi067.rdualw (mgr.14640) 51 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.8 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2022-03-17T15:28:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:21.754366+0000 mgr.smithi067.rdualw (mgr.14640) 51 : cluster [DBG] pgmap v25: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 1.8 KiB/s rd, 5.8 KiB/s wr, 5 op/s 2022-03-17T15:28:23.127 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 23 sec latency 26808.148 ms 2022-03-17T15:28:24.127 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 24 sec latency 27808.201 ms 2022-03-17T15:28:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:23.754742+0000 mgr.smithi067.rdualw (mgr.14640) 52 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 1.2 KiB/s wr, 0 op/s 2022-03-17T15:28:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:24.734687+0000 mon.smithi061 (mon.0) 748 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:25.127 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 25 sec latency 28808.250 ms 2022-03-17T15:28:25.132 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:23.754742+0000 mgr.smithi067.rdualw (mgr.14640) 52 : cluster [DBG] pgmap v26: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 1.2 KiB/s wr, 0 op/s 2022-03-17T15:28:25.133 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:24.734687+0000 mon.smithi061 (mon.0) 748 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:26.127 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 26 sec latency 29808.297 ms 2022-03-17T15:28:27.127 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 27 sec latency 30808.381 ms 2022-03-17T15:28:27.222 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:25.755715+0000 mgr.smithi067.rdualw (mgr.14640) 53 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 426 B/s rd, 1.2 KiB/s wr, 1 op/s 2022-03-17T15:28:27.222 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:26.496234+0000 mon.smithi061 (mon.0) 749 : cluster [DBG] Standby manager daemon smithi061.kxplwz restarted 2022-03-17T15:28:27.223 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:26.496328+0000 mon.smithi061 (mon.0) 750 : cluster [DBG] Standby manager daemon smithi061.kxplwz started 2022-03-17T15:28:27.223 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:26.498913+0000 mon.smithi061 (mon.0) 751 : audit [DBG] from='mgr.? 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi061.kxplwz/crt"}]: dispatch 2022-03-17T15:28:27.223 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:26.499359+0000 mon.smithi061 (mon.0) 752 : audit [DBG] from='mgr.? 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-03-17T15:28:27.223 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:26.501860+0000 mon.smithi061 (mon.0) 753 : audit [DBG] from='mgr.? 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi061.kxplwz/key"}]: dispatch 2022-03-17T15:28:27.223 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:26.502951+0000 mon.smithi061 (mon.0) 754 : audit [DBG] from='mgr.? 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-03-17T15:28:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:25.755715+0000 mgr.smithi067.rdualw (mgr.14640) 53 : cluster [DBG] pgmap v27: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 426 B/s rd, 1.2 KiB/s wr, 1 op/s 2022-03-17T15:28:27.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:26.496234+0000 mon.smithi061 (mon.0) 749 : cluster [DBG] Standby manager daemon smithi061.kxplwz restarted 2022-03-17T15:28:27.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:26.496328+0000 mon.smithi061 (mon.0) 750 : cluster [DBG] Standby manager daemon smithi061.kxplwz started 2022-03-17T15:28:27.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:26.498913+0000 mon.smithi061 (mon.0) 751 : audit [DBG] from='mgr.? 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi061.kxplwz/crt"}]: dispatch 2022-03-17T15:28:27.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:26.499359+0000 mon.smithi061 (mon.0) 752 : audit [DBG] from='mgr.? 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-03-17T15:28:27.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:26.501860+0000 mon.smithi061 (mon.0) 753 : audit [DBG] from='mgr.? 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi061.kxplwz/key"}]: dispatch 2022-03-17T15:28:27.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:26.502951+0000 mon.smithi061 (mon.0) 754 : audit [DBG] from='mgr.? 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-03-17T15:28:28.127 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 28 sec latency 31808.498 ms 2022-03-17T15:28:28.204 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:26.817073+0000 mon.smithi061 (mon.0) 755 : cluster [DBG] mgrmap e32: smithi067.rdualw(active, since 43s), standbys: smithi061.kxplwz 2022-03-17T15:28:28.205 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:27.179400+0000 mon.smithi061 (mon.0) 756 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:28.205 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:27.184349+0000 mon.smithi061 (mon.0) 757 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:28.205 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:27.194101+0000 mon.smithi061 (mon.0) 758 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:28.206 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:27.200837+0000 mon.smithi067 (mon.1) 78 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:28.206 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:27.203233+0000 mgr.smithi067.rdualw (mgr.14640) 54 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi067.rdualw) 2022-03-17T15:28:28.206 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:27.205792+0000 mgr.smithi067.rdualw (mgr.14640) 55 : cephadm [INF] Failing over to other MGR 2022-03-17T15:28:28.206 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:27.206101+0000 mon.smithi067 (mon.1) 79 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mgr fail", "who": "smithi067.rdualw"}]: dispatch 2022-03-17T15:28:28.206 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:27.206482+0000 mon.smithi061 (mon.0) 759 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mgr fail", "who": "smithi067.rdualw"}]: dispatch 2022-03-17T15:28:28.207 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:27.209210+0000 mon.smithi061 (mon.0) 760 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2022-03-17T15:28:28.216 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:26.817073+0000 mon.smithi061 (mon.0) 755 : cluster [DBG] mgrmap e32: smithi067.rdualw(active, since 43s), standbys: smithi061.kxplwz 2022-03-17T15:28:28.216 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:27.179400+0000 mon.smithi061 (mon.0) 756 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:28.216 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:27.184349+0000 mon.smithi061 (mon.0) 757 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:28.217 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:27.194101+0000 mon.smithi061 (mon.0) 758 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:28:28.217 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:27.200837+0000 mon.smithi067 (mon.1) 78 : audit [DBG] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:28.217 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:27.203233+0000 mgr.smithi067.rdualw (mgr.14640) 54 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi067.rdualw) 2022-03-17T15:28:28.217 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:27.205792+0000 mgr.smithi067.rdualw (mgr.14640) 55 : cephadm [INF] Failing over to other MGR 2022-03-17T15:28:28.217 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:27.206101+0000 mon.smithi067 (mon.1) 79 : audit [INF] from='mgr.14640 172.21.15.67:0/1698794275' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mgr fail", "who": "smithi067.rdualw"}]: dispatch 2022-03-17T15:28:28.218 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:27.206482+0000 mon.smithi061 (mon.0) 759 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mgr fail", "who": "smithi067.rdualw"}]: dispatch 2022-03-17T15:28:28.218 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:27.209210+0000 mon.smithi061 (mon.0) 760 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2022-03-17T15:28:29.127 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 29 sec latency 32808.572 ms 2022-03-17T15:28:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:27.881495+0000 mon.smithi061 (mon.0) 761 : cluster [DBG] Standby manager daemon smithi067.rdualw started 2022-03-17T15:28:29.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.203402+0000 mon.smithi061 (mon.0) 762 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "mgr fail", "who": "smithi067.rdualw"}]': finished 2022-03-17T15:28:29.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:28.203470+0000 mon.smithi061 (mon.0) 763 : cluster [DBG] mgrmap e33: smithi061.kxplwz(active, starting, since 0.99639s), standbys: smithi067.rdualw 2022-03-17T15:28:29.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.204825+0000 mon.smithi061 (mon.0) 764 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi061"}]: dispatch 2022-03-17T15:28:29.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.205001+0000 mon.smithi061 (mon.0) 765 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:28:29.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.205847+0000 mon.smithi061 (mon.0) 766 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi061.atvhsa"}]: dispatch 2022-03-17T15:28:29.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.206129+0000 mon.smithi061 (mon.0) 767 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi067.osftcx"}]: dispatch 2022-03-17T15:28:29.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.206710+0000 mon.smithi061 (mon.0) 768 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr metadata", "who": "smithi061.kxplwz", "id": "smithi061.kxplwz"}]: dispatch 2022-03-17T15:28:29.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.206906+0000 mon.smithi061 (mon.0) 769 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr metadata", "who": "smithi067.rdualw", "id": "smithi067.rdualw"}]: dispatch 2022-03-17T15:28:29.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.207086+0000 mon.smithi061 (mon.0) 770 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:28:29.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.207320+0000 mon.smithi061 (mon.0) 771 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:28:29.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.207543+0000 mon.smithi061 (mon.0) 772 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:28:29.306 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.208131+0000 mon.smithi061 (mon.0) 773 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:28:29.306 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.208480+0000 mon.smithi061 (mon.0) 774 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:28:29.306 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.208909+0000 mon.smithi061 (mon.0) 775 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:28:29.306 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.211427+0000 mon.smithi061 (mon.0) 776 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:28:29.307 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.211732+0000 mon.smithi061 (mon.0) 777 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:28:29.307 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.212005+0000 mon.smithi061 (mon.0) 778 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-03-17T15:28:29.307 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.212297+0000 mon.smithi061 (mon.0) 779 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-03-17T15:28:29.307 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.212750+0000 mon.smithi061 (mon.0) 780 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-03-17T15:28:29.307 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:28.240324+0000 mon.smithi061 (mon.0) 781 : cluster [INF] Manager daemon smithi061.kxplwz is now available 2022-03-17T15:28:29.308 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:28.256744+0000 mgr.smithi061.kxplwz (mgr.14724) 1 : cephadm [INF] inventory: adjusted host smithi067 addr 'smithi067' -> '172.21.15.67' 2022-03-17T15:28:29.308 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.260084+0000 mon.smithi061 (mon.0) 782 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:29.308 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.388497+0000 mon.smithi061 (mon.0) 783 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:29.308 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.390819+0000 mon.smithi061 (mon.0) 784 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:29.309 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.392201+0000 mon.smithi061 (mon.0) 785 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:29.309 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.393645+0000 mon.smithi061 (mon.0) 786 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:28:29.309 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:28.394950+0000 mgr.smithi061.kxplwz (mgr.14724) 2 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:28:29.309 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.435011+0000 mon.smithi061 (mon.0) 787 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:28:29.309 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:28.448025+0000 mon.smithi061 (mon.0) 788 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:28:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:27.881495+0000 mon.smithi061 (mon.0) 761 : cluster [DBG] Standby manager daemon smithi067.rdualw started 2022-03-17T15:28:29.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.203402+0000 mon.smithi061 (mon.0) 762 : audit [INF] from='mgr.14640 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "mgr fail", "who": "smithi067.rdualw"}]': finished 2022-03-17T15:28:29.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:28.203470+0000 mon.smithi061 (mon.0) 763 : cluster [DBG] mgrmap e33: smithi061.kxplwz(active, starting, since 0.99639s), standbys: smithi067.rdualw 2022-03-17T15:28:29.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.204825+0000 mon.smithi061 (mon.0) 764 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi061"}]: dispatch 2022-03-17T15:28:29.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.205001+0000 mon.smithi061 (mon.0) 765 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:28:29.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.205847+0000 mon.smithi061 (mon.0) 766 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi061.atvhsa"}]: dispatch 2022-03-17T15:28:29.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.206129+0000 mon.smithi061 (mon.0) 767 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi067.osftcx"}]: dispatch 2022-03-17T15:28:29.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.206710+0000 mon.smithi061 (mon.0) 768 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr metadata", "who": "smithi061.kxplwz", "id": "smithi061.kxplwz"}]: dispatch 2022-03-17T15:28:29.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.206906+0000 mon.smithi061 (mon.0) 769 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr metadata", "who": "smithi067.rdualw", "id": "smithi067.rdualw"}]: dispatch 2022-03-17T15:28:29.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.207086+0000 mon.smithi061 (mon.0) 770 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:28:29.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.207320+0000 mon.smithi061 (mon.0) 771 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:28:29.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.207543+0000 mon.smithi061 (mon.0) 772 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:28:29.320 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.208131+0000 mon.smithi061 (mon.0) 773 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:28:29.320 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.208480+0000 mon.smithi061 (mon.0) 774 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:28:29.320 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.208909+0000 mon.smithi061 (mon.0) 775 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:28:29.320 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.211427+0000 mon.smithi061 (mon.0) 776 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:28:29.320 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.211732+0000 mon.smithi061 (mon.0) 777 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:28:29.321 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.212005+0000 mon.smithi061 (mon.0) 778 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-03-17T15:28:29.321 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.212297+0000 mon.smithi061 (mon.0) 779 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-03-17T15:28:29.321 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.212750+0000 mon.smithi061 (mon.0) 780 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-03-17T15:28:29.321 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:28.240324+0000 mon.smithi061 (mon.0) 781 : cluster [INF] Manager daemon smithi061.kxplwz is now available 2022-03-17T15:28:29.322 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:28.256744+0000 mgr.smithi061.kxplwz (mgr.14724) 1 : cephadm [INF] inventory: adjusted host smithi067 addr 'smithi067' -> '172.21.15.67' 2022-03-17T15:28:29.322 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.260084+0000 mon.smithi061 (mon.0) 782 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:29.322 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.388497+0000 mon.smithi061 (mon.0) 783 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:29.323 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.390819+0000 mon.smithi061 (mon.0) 784 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:29.323 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.392201+0000 mon.smithi061 (mon.0) 785 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:29.323 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.393645+0000 mon.smithi061 (mon.0) 786 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:28:29.323 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:28.394950+0000 mgr.smithi061.kxplwz (mgr.14724) 2 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:28:29.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.435011+0000 mon.smithi061 (mon.0) 787 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:28:29.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:28.448025+0000 mon.smithi061 (mon.0) 788 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi061.kxplwz/trash_purge_schedule"}]: dispatch 2022-03-17T15:28:29.722 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:28:30.020 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:28:30.021 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6m) 2s ago 7m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:28:30.021 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (7m) 2s ago 7m 7033k - 16.2.4 8d91d370c2b8 35aa99cfae95 2022-03-17T15:28:30.021 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6m) 5s ago 6m 7142k - 16.2.4 8d91d370c2b8 056e5956721e 2022-03-17T15:28:30.022 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5m) 2s ago 6m 38.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:28:30.022 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2m) 2s ago 2m 39.7M - 16.2.4 8d91d370c2b8 fc2d986f2f76 2022-03-17T15:28:30.022 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2m) 5s ago 2m 14.1M - 16.2.4 8d91d370c2b8 7e2d207c71fd 2022-03-17T15:28:30.022 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (12s) 2s ago 8m 47.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:28:30.023 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (54s) 5s ago 6m 436M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 2afaad7a07b7 2022-03-17T15:28:30.023 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (8m) 2s ago 8m 125M 2048M 16.2.4 8d91d370c2b8 e511ef468147 2022-03-17T15:28:30.023 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6m) 5s ago 6m 90.2M 2048M 16.2.4 8d91d370c2b8 6ba46ec348ed 2022-03-17T15:28:30.024 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (27s) 2s ago 27s 55.4M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:28:30.024 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (22s) 5s ago 22s 58.0M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:28:30.024 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6m) 2s ago 6m 18.2M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:28:30.024 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6m) 5s ago 6m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:28:30.024 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5m) 2s ago 5m 1208M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:28:30.025 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5m) 2s ago 5m 1058M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:28:30.025 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5m) 2s ago 5m 611M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:28:30.025 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5m) 2s ago 5m 1137M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:28:30.025 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4m) 5s ago 4m 1125M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:28:30.026 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4m) 5s ago 4m 1358M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:28:30.026 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4m) 5s ago 4m 1037M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:28:30.026 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4m) 5s ago 4m 1812M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:28:30.026 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5m) 2s ago 6m 45.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:28:30.127 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 30 sec latency 33808.623 ms 2022-03-17T15:28:30.370 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:28:30.370 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:28:30.370 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:28:30.371 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:28:30.371 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:28:30.371 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:28:30.371 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:28:30.372 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:28:30.372 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 8 2022-03-17T15:28:30.372 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:28:30.372 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:28:30.373 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:28:30.373 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:28:30.373 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:28:30.373 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 12, 2022-03-17T15:28:30.373 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:28:30.374 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:28:30.374 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:28:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:29.219778+0000 mon.smithi061 (mon.0) 789 : cluster [DBG] mgrmap e34: smithi061.kxplwz(active, since 2s), standbys: smithi067.rdualw 2022-03-17T15:28:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:29.229584+0000 mgr.smithi061.kxplwz (mgr.14724) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:28:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:29.219778+0000 mon.smithi061 (mon.0) 789 : cluster [DBG] mgrmap e34: smithi061.kxplwz(active, since 2s), standbys: smithi067.rdualw 2022-03-17T15:28:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:29.229584+0000 mgr.smithi061.kxplwz (mgr.14724) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:28:31.127 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 31 sec latency 34808.660 ms 2022-03-17T15:28:31.502 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:29.707381+0000 mgr.smithi061.kxplwz (mgr.14724) 4 : audit [DBG] from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:28:31.503 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:29.998930+0000 mgr.smithi061.kxplwz (mgr.14724) 5 : audit [DBG] from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:28:31.503 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:30.208765+0000 mgr.smithi061.kxplwz (mgr.14724) 6 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:28:31.503 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:30.368103+0000 mon.smithi061 (mon.0) 790 : audit [DBG] from='client.? 172.21.15.61:0/1917910819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:28:31.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:29.707381+0000 mgr.smithi061.kxplwz (mgr.14724) 4 : audit [DBG] from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:28:31.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:29.998930+0000 mgr.smithi061.kxplwz (mgr.14724) 5 : audit [DBG] from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:28:31.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:30.208765+0000 mgr.smithi061.kxplwz (mgr.14724) 6 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:28:31.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:30.368103+0000 mon.smithi061 (mon.0) 790 : audit [DBG] from='client.? 172.21.15.61:0/1917910819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:28:32.128 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 32 sec latency 35808.728 ms 2022-03-17T15:28:33.128 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 33 sec latency 36808.756 ms 2022-03-17T15:28:33.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:32.209141+0000 mgr.smithi061.kxplwz (mgr.14724) 7 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:28:34.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:32.209141+0000 mgr.smithi061.kxplwz (mgr.14724) 7 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:28:34.128 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 34 sec latency 37808.784 ms 2022-03-17T15:28:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:33.781159+0000 mon.smithi061 (mon.0) 791 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:34.198253+0000 mon.smithi061 (mon.0) 792 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:28:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:34.209651+0000 mgr.smithi061.kxplwz (mgr.14724) 8 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:28:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:33.781159+0000 mon.smithi061 (mon.0) 791 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:34.198253+0000 mon.smithi061 (mon.0) 792 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:28:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:34.209651+0000 mgr.smithi061.kxplwz (mgr.14724) 8 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:28:35.128 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 35 sec latency 38808.813 ms 2022-03-17T15:28:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:34.976740+0000 mon.smithi061 (mon.0) 793 : cluster [DBG] Standby manager daemon smithi067.rdualw restarted 2022-03-17T15:28:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:34.976792+0000 mon.smithi067 (mon.1) 80 : audit [DBG] from='mgr.? 172.21.15.67:0/3408689534' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/crt"}]: dispatch 2022-03-17T15:28:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:34.976843+0000 mon.smithi061 (mon.0) 794 : cluster [DBG] Standby manager daemon smithi067.rdualw started 2022-03-17T15:28:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:34.978568+0000 mon.smithi067 (mon.1) 81 : audit [DBG] from='mgr.? 172.21.15.67:0/3408689534' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-03-17T15:28:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:34.981449+0000 mon.smithi067 (mon.1) 82 : audit [DBG] from='mgr.? 172.21.15.67:0/3408689534' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/key"}]: dispatch 2022-03-17T15:28:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:34.981921+0000 mon.smithi067 (mon.1) 83 : audit [DBG] from='mgr.? 172.21.15.67:0/3408689534' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-03-17T15:28:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:34.976740+0000 mon.smithi061 (mon.0) 793 : cluster [DBG] Standby manager daemon smithi067.rdualw restarted 2022-03-17T15:28:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:34.976792+0000 mon.smithi067 (mon.1) 80 : audit [DBG] from='mgr.? 172.21.15.67:0/3408689534' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/crt"}]: dispatch 2022-03-17T15:28:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:34.976843+0000 mon.smithi061 (mon.0) 794 : cluster [DBG] Standby manager daemon smithi067.rdualw started 2022-03-17T15:28:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:34.978568+0000 mon.smithi067 (mon.1) 81 : audit [DBG] from='mgr.? 172.21.15.67:0/3408689534' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-03-17T15:28:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:34.981449+0000 mon.smithi067 (mon.1) 82 : audit [DBG] from='mgr.? 172.21.15.67:0/3408689534' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/key"}]: dispatch 2022-03-17T15:28:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:34.981921+0000 mon.smithi067 (mon.1) 83 : audit [DBG] from='mgr.? 172.21.15.67:0/3408689534' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-03-17T15:28:36.128 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 36 sec latency 39808.841 ms 2022-03-17T15:28:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:35.794591+0000 mon.smithi061 (mon.0) 795 : cluster [DBG] mgrmap e35: smithi061.kxplwz(active, since 8s), standbys: smithi067.rdualw 2022-03-17T15:28:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:35.938096+0000 mon.smithi061 (mon.0) 796 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:36.210345+0000 mgr.smithi061.kxplwz (mgr.14724) 9 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 293 B/s rd, 0 op/s 2022-03-17T15:28:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:36.328616+0000 mon.smithi061 (mon.0) 797 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:28:37.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:36.332835+0000 mon.smithi061 (mon.0) 798 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:37.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:36.338454+0000 mon.smithi061 (mon.0) 799 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:37.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:36.341767+0000 mon.smithi061 (mon.0) 800 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:35.794591+0000 mon.smithi061 (mon.0) 795 : cluster [DBG] mgrmap e35: smithi061.kxplwz(active, since 8s), standbys: smithi067.rdualw 2022-03-17T15:28:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:35.938096+0000 mon.smithi061 (mon.0) 796 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:36.210345+0000 mgr.smithi061.kxplwz (mgr.14724) 9 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 293 B/s rd, 0 op/s 2022-03-17T15:28:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:36.328616+0000 mon.smithi061 (mon.0) 797 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:28:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:36.332835+0000 mon.smithi061 (mon.0) 798 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:36.338454+0000 mon.smithi061 (mon.0) 799 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:36.341767+0000 mon.smithi061 (mon.0) 800 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:37.128 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 37 sec latency 40808.944 ms 2022-03-17T15:28:38.128 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 38 sec latency 41809.071 ms 2022-03-17T15:28:38.253 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:37.555363+0000 mgr.smithi061.kxplwz (mgr.14724) 10 : cephadm [INF] Upgrade: Updating mgr.smithi067.rdualw 2022-03-17T15:28:38.254 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:37.555838+0000 mon.smithi061 (mon.0) 801 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.rdualw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-03-17T15:28:38.254 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:37.556900+0000 mon.smithi061 (mon.0) 802 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr services"}]: dispatch 2022-03-17T15:28:38.254 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:37.557900+0000 mon.smithi061 (mon.0) 803 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:38.255 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:37.558772+0000 mgr.smithi061.kxplwz (mgr.14724) 11 : cephadm [INF] Deploying daemon mgr.smithi067.rdualw on smithi067 2022-03-17T15:28:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:37.555363+0000 mgr.smithi061.kxplwz (mgr.14724) 10 : cephadm [INF] Upgrade: Updating mgr.smithi067.rdualw 2022-03-17T15:28:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:37.555838+0000 mon.smithi061 (mon.0) 801 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi067.rdualw", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2022-03-17T15:28:38.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:37.556900+0000 mon.smithi061 (mon.0) 802 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mgr services"}]: dispatch 2022-03-17T15:28:38.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:37.557900+0000 mon.smithi061 (mon.0) 803 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:38.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:37.558772+0000 mgr.smithi061.kxplwz (mgr.14724) 11 : cephadm [INF] Deploying daemon mgr.smithi067.rdualw on smithi067 2022-03-17T15:28:39.128 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 39 sec latency 42809.112 ms 2022-03-17T15:28:39.152 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:38.210859+0000 mgr.smithi061.kxplwz (mgr.14724) 12 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 228 B/s rd, 0 op/s 2022-03-17T15:28:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:38.210859+0000 mgr.smithi061.kxplwz (mgr.14724) 12 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 228 B/s rd, 0 op/s 2022-03-17T15:28:40.128 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 40 sec latency 43809.209 ms 2022-03-17T15:28:41.128 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 41 sec latency 44809.288 ms 2022-03-17T15:28:41.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:39.918127+0000 mon.smithi061 (mon.0) 804 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:41.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:39.919013+0000 mon.smithi061 (mon.0) 805 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:41.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:39.920340+0000 mon.smithi061 (mon.0) 806 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:41.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:39.921264+0000 mon.smithi061 (mon.0) 807 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:28:41.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:39.922103+0000 mgr.smithi061.kxplwz (mgr.14724) 13 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:28:41.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:40.211674+0000 mgr.smithi061.kxplwz (mgr.14724) 14 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 186 B/s rd, 0 op/s 2022-03-17T15:28:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:39.918127+0000 mon.smithi061 (mon.0) 804 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:39.919013+0000 mon.smithi061 (mon.0) 805 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:41.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:39.920340+0000 mon.smithi061 (mon.0) 806 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:41.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:39.921264+0000 mon.smithi061 (mon.0) 807 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:28:41.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:39.922103+0000 mgr.smithi061.kxplwz (mgr.14724) 13 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:28:41.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:40.211674+0000 mgr.smithi061.kxplwz (mgr.14724) 14 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 186 B/s rd, 0 op/s 2022-03-17T15:28:42.128 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 42 sec latency 45809.397 ms 2022-03-17T15:28:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:40.953588+0000 mds.foofs.smithi061.atvhsa (mds.0) 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.344428 secs 2022-03-17T15:28:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:40.953598+0000 mds.foofs.smithi061.atvhsa (mds.0) 2 : cluster [WRN] slow request 30.344427 seconds old, received at 2022-03-17T15:28:10.609087+0000: client_request(client.14706:4 getattr pAsLsXsFs #0x10000003de2 2022-03-17T15:28:10.609057+0000 caller_uid=0, caller_gid=0{0,}) currently failed to rdlock, waiting 2022-03-17T15:28:42.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:40.953588+0000 mds.foofs.smithi061.atvhsa (mds.0) 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.344428 secs 2022-03-17T15:28:42.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:40.953598+0000 mds.foofs.smithi061.atvhsa (mds.0) 2 : cluster [WRN] slow request 30.344427 seconds old, received at 2022-03-17T15:28:10.609087+0000: client_request(client.14706:4 getattr pAsLsXsFs #0x10000003de2 2022-03-17T15:28:10.609057+0000 caller_uid=0, caller_gid=0{0,}) currently failed to rdlock, waiting 2022-03-17T15:28:43.128 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 43 sec latency 46809.525 ms 2022-03-17T15:28:43.253 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:41.920394+0000 mon.smithi061 (mon.0) 808 : cluster [WRN] Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2022-03-17T15:28:43.253 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:41.924230+0000 mon.smithi061 (mon.0) 809 : cluster [DBG] mds.? [v2:172.21.15.61:6834/326071404,v1:172.21.15.61:6835/326071404] up:active 2022-03-17T15:28:43.254 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:41.924308+0000 mon.smithi061 (mon.0) 810 : cluster [DBG] fsmap foofs:1 {0=foofs.smithi061.atvhsa=up:active} 1 up:standby 2022-03-17T15:28:43.254 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:42.212262+0000 mgr.smithi061.kxplwz (mgr.14724) 15 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:28:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:41.920394+0000 mon.smithi061 (mon.0) 808 : cluster [WRN] Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST) 2022-03-17T15:28:43.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:41.924230+0000 mon.smithi061 (mon.0) 809 : cluster [DBG] mds.? [v2:172.21.15.61:6834/326071404,v1:172.21.15.61:6835/326071404] up:active 2022-03-17T15:28:43.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:41.924308+0000 mon.smithi061 (mon.0) 810 : cluster [DBG] fsmap foofs:1 {0=foofs.smithi061.atvhsa=up:active} 1 up:standby 2022-03-17T15:28:43.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:42.212262+0000 mgr.smithi061.kxplwz (mgr.14724) 15 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:28:44.128 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 44 sec latency 47809.657 ms 2022-03-17T15:28:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:43.416598+0000 mon.smithi061 (mon.0) 811 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:43.416598+0000 mon.smithi061 (mon.0) 811 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:45.128 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 45 sec latency 48809.720 ms 2022-03-17T15:28:45.755 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:44.212820+0000 mgr.smithi061.kxplwz (mgr.14724) 16 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:28:45.756 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:45.099542+0000 mon.smithi061 (mon.0) 812 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:45.756 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:45.103993+0000 mon.smithi061 (mon.0) 813 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:45.756 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:45.110898+0000 mon.smithi061 (mon.0) 814 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:45.756 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:45.114876+0000 mon.smithi061 (mon.0) 815 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:45.757 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:45.116972+0000 mon.smithi061 (mon.0) 816 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:28:45.757 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:45.121685+0000 mon.smithi061 (mon.0) 817 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:45.757 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:45.122582+0000 mon.smithi061 (mon.0) 818 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi061.kxplwz"}]: dispatch 2022-03-17T15:28:45.757 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:45.126020+0000 mon.smithi061 (mon.0) 819 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi061.kxplwz"}]': finished 2022-03-17T15:28:45.758 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:45.126782+0000 mon.smithi061 (mon.0) 820 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi067.rdualw"}]: dispatch 2022-03-17T15:28:45.758 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:45.132432+0000 mon.smithi061 (mon.0) 821 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi067.rdualw"}]': finished 2022-03-17T15:28:45.758 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:45.133361+0000 mon.smithi061 (mon.0) 822 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "quorum_status"}]: dispatch 2022-03-17T15:28:45.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:44.212820+0000 mgr.smithi061.kxplwz (mgr.14724) 16 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:28:45.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:45.099542+0000 mon.smithi061 (mon.0) 812 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:45.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:45.103993+0000 mon.smithi061 (mon.0) 813 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:45.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:45.110898+0000 mon.smithi061 (mon.0) 814 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:45.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:45.114876+0000 mon.smithi061 (mon.0) 815 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:45.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:45.116972+0000 mon.smithi061 (mon.0) 816 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:28:45.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:45.121685+0000 mon.smithi061 (mon.0) 817 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:45.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:45.122582+0000 mon.smithi061 (mon.0) 818 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi061.kxplwz"}]: dispatch 2022-03-17T15:28:45.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:45.126020+0000 mon.smithi061 (mon.0) 819 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi061.kxplwz"}]': finished 2022-03-17T15:28:45.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:45.126782+0000 mon.smithi061 (mon.0) 820 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi067.rdualw"}]: dispatch 2022-03-17T15:28:45.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:45.132432+0000 mon.smithi061 (mon.0) 821 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi067.rdualw"}]': finished 2022-03-17T15:28:45.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:45.133361+0000 mon.smithi061 (mon.0) 822 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "quorum_status"}]: dispatch 2022-03-17T15:28:46.129 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 46 sec latency 49809.759 ms 2022-03-17T15:28:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:45.117720+0000 mgr.smithi061.kxplwz (mgr.14724) 17 : cephadm [INF] Upgrade: Setting container_image for all mgr 2022-03-17T15:28:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:45.953603+0000 mds.foofs.smithi061.atvhsa (mds.0) 3 : cluster [WRN] 1 slow requests, 0 included below; oldest blocked for > 35.344489 secs 2022-03-17T15:28:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:45.117720+0000 mgr.smithi061.kxplwz (mgr.14724) 17 : cephadm [INF] Upgrade: Setting container_image for all mgr 2022-03-17T15:28:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:45.953603+0000 mds.foofs.smithi061.atvhsa (mds.0) 3 : cluster [WRN] 1 slow requests, 0 included below; oldest blocked for > 35.344489 secs 2022-03-17T15:28:47.129 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 47 sec latency 50810.083 ms 2022-03-17T15:28:47.615 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:46.213482+0000 mgr.smithi061.kxplwz (mgr.14724) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:28:47.616 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:46.523521+0000 mon.smithi061 (mon.0) 823 : cluster [DBG] Standby manager daemon smithi067.rdualw restarted 2022-03-17T15:28:47.616 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cluster 2022-03-17T15:28:46.523624+0000 mon.smithi061 (mon.0) 824 : cluster [DBG] Standby manager daemon smithi067.rdualw started 2022-03-17T15:28:47.616 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:46.525300+0000 mon.smithi067 (mon.1) 84 : audit [DBG] from='mgr.? 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/crt"}]: dispatch 2022-03-17T15:28:47.616 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:46.525965+0000 mon.smithi067 (mon.1) 85 : audit [DBG] from='mgr.? 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-03-17T15:28:47.617 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:46.538814+0000 mgr.smithi061.kxplwz (mgr.14724) 19 : cephadm [INF] Upgrade: Updating mon.smithi061 2022-03-17T15:28:47.617 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:46.542996+0000 mon.smithi061 (mon.0) 825 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:47.617 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:46.543640+0000 mon.smithi061 (mon.0) 826 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-03-17T15:28:47.617 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:46.544156+0000 mon.smithi061 (mon.0) 827 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-03-17T15:28:47.618 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:46.544725+0000 mon.smithi061 (mon.0) 828 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:47.618 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: cephadm 2022-03-17T15:28:46.545272+0000 mgr.smithi061.kxplwz (mgr.14724) 20 : cephadm [INF] Deploying daemon mon.smithi061 on smithi061 2022-03-17T15:28:47.618 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:46.547924+0000 mon.smithi067 (mon.1) 86 : audit [DBG] from='mgr.? 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/key"}]: dispatch 2022-03-17T15:28:47.618 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: audit 2022-03-17T15:28:46.548248+0000 mon.smithi067 (mon.1) 87 : audit [DBG] from='mgr.? 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-03-17T15:28:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:46.213482+0000 mgr.smithi061.kxplwz (mgr.14724) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:28:47.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:46.523521+0000 mon.smithi061 (mon.0) 823 : cluster [DBG] Standby manager daemon smithi067.rdualw restarted 2022-03-17T15:28:47.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:46.523624+0000 mon.smithi061 (mon.0) 824 : cluster [DBG] Standby manager daemon smithi067.rdualw started 2022-03-17T15:28:47.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:46.525300+0000 mon.smithi067 (mon.1) 84 : audit [DBG] from='mgr.? 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/crt"}]: dispatch 2022-03-17T15:28:47.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:46.525965+0000 mon.smithi067 (mon.1) 85 : audit [DBG] from='mgr.? 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-03-17T15:28:47.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:46.538814+0000 mgr.smithi061.kxplwz (mgr.14724) 19 : cephadm [INF] Upgrade: Updating mon.smithi061 2022-03-17T15:28:47.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:46.542996+0000 mon.smithi061 (mon.0) 825 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:47.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:46.543640+0000 mon.smithi061 (mon.0) 826 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-03-17T15:28:47.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:46.544156+0000 mon.smithi061 (mon.0) 827 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-03-17T15:28:47.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:46.544725+0000 mon.smithi061 (mon.0) 828 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:47.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:46.545272+0000 mgr.smithi061.kxplwz (mgr.14724) 20 : cephadm [INF] Deploying daemon mon.smithi061 on smithi061 2022-03-17T15:28:47.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:46.547924+0000 mon.smithi067 (mon.1) 86 : audit [DBG] from='mgr.? 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/key"}]: dispatch 2022-03-17T15:28:47.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:46.548248+0000 mon.smithi067 (mon.1) 87 : audit [DBG] from='mgr.? 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-03-17T15:28:48.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:47 smithi061 systemd[1]: Stopping Ceph mon.smithi061 for ae1b9b88-a605-11ec-8c35-001a4aab830c... 2022-03-17T15:28:48.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:28:47.830+0000 7f71b0871700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.smithi061 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2022-03-17T15:28:48.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061[31186]: debug 2022-03-17T15:28:47.830+0000 7f71b0871700 -1 mon.smithi061@0(leader) e2 *** Got Signal Terminated *** 2022-03-17T15:28:48.129 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 48 sec latency 51810.171 ms 2022-03-17T15:28:48.511 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:48 smithi061 bash[74445]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061 2022-03-17T15:28:48.511 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:48 smithi061 bash[74487]: Error: no container with name or ID "ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061" found: no such container 2022-03-17T15:28:48.512 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:48 smithi061 bash[74501]: Error: no container with name or ID "ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi061" found: no such container 2022-03-17T15:28:48.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:48 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mon.smithi061.service: Succeeded. 2022-03-17T15:28:48.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:48 smithi061 systemd[1]: Stopped Ceph mon.smithi061 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:28:48.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:48 smithi061 systemd[1]: Starting Ceph mon.smithi061 for ae1b9b88-a605-11ec-8c35-001a4aab830c... 2022-03-17T15:28:49.129 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 49 sec latency 52810.200 ms 2022-03-17T15:28:49.187 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:48 smithi061 podman[74603]: 2022-03-17T15:28:49.188 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.157+0000 7f74770cb880 0 set uid:gid to 167:167 (ceph:ceph) 2022-03-17T15:28:49.188 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.157+0000 7f74770cb880 0 ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable), process ceph-mon, pid 7 2022-03-17T15:28:49.188 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.157+0000 7f74770cb880 0 pidfile_write: ignore empty --pid-file 2022-03-17T15:28:49.188 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 0 load: jerasure load: lrc load: isa 2022-03-17T15:28:49.189 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: RocksDB version: 6.8.1 2022-03-17T15:28:49.189 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.189 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-03-17T15:28:49.189 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Compile date Mar 16 2022 2022-03-17T15:28:49.190 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: DB SUMMARY 2022-03-17T15:28:49.190 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.190 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: CURRENT file: CURRENT 2022-03-17T15:28:49.190 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.191 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: IDENTITY file: IDENTITY 2022-03-17T15:28:49.191 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.191 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: MANIFEST file: MANIFEST-000008 size: 392 Bytes 2022-03-17T15:28:49.191 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.192 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi061/store.db dir, Total Num: 1, files: 000014.sst 2022-03-17T15:28:49.192 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.192 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi061/store.db: 000012.log size: 9148052 ; 2022-03-17T15:28:49.192 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.192 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.error_if_exists: 0 2022-03-17T15:28:49.193 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.create_if_missing: 0 2022-03-17T15:28:49.193 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.paranoid_checks: 1 2022-03-17T15:28:49.193 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.env: 0x55c251d27000 2022-03-17T15:28:49.193 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.fs: Posix File System 2022-03-17T15:28:49.194 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.info_log: 0x55c2533767e0 2022-03-17T15:28:49.194 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.max_file_opening_threads: 16 2022-03-17T15:28:49.194 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.statistics: (nil) 2022-03-17T15:28:49.194 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.use_fsync: 0 2022-03-17T15:28:49.195 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.max_log_file_size: 0 2022-03-17T15:28:49.198 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2022-03-17T15:28:49.198 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.log_file_time_to_roll: 0 2022-03-17T15:28:49.198 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.keep_log_file_num: 1000 2022-03-17T15:28:49.199 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.recycle_log_file_num: 0 2022-03-17T15:28:49.199 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.allow_fallocate: 1 2022-03-17T15:28:49.199 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.allow_mmap_reads: 0 2022-03-17T15:28:49.199 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.allow_mmap_writes: 0 2022-03-17T15:28:49.200 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.use_direct_reads: 0 2022-03-17T15:28:49.200 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-03-17T15:28:49.200 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.create_missing_column_families: 0 2022-03-17T15:28:49.200 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.db_log_dir: 2022-03-17T15:28:49.200 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi061/store.db 2022-03-17T15:28:49.201 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.table_cache_numshardbits: 6 2022-03-17T15:28:49.201 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.max_subcompactions: 1 2022-03-17T15:28:49.203 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.max_background_flushes: -1 2022-03-17T15:28:49.203 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.WAL_ttl_seconds: 0 2022-03-17T15:28:49.204 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.WAL_size_limit_MB: 0 2022-03-17T15:28:49.204 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-03-17T15:28:49.204 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2022-03-17T15:28:49.204 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.is_fd_close_on_exec: 1 2022-03-17T15:28:49.204 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.advise_random_on_open: 1 2022-03-17T15:28:49.205 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.db_write_buffer_size: 0 2022-03-17T15:28:49.205 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.write_buffer_manager: 0x55c254072150 2022-03-17T15:28:49.205 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2022-03-17T15:28:49.205 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-03-17T15:28:49.206 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2022-03-17T15:28:49.206 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.use_adaptive_mutex: 0 2022-03-17T15:28:49.206 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.rate_limiter: (nil) 2022-03-17T15:28:49.206 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-03-17T15:28:49.206 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.wal_recovery_mode: 2 2022-03-17T15:28:49.207 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.enable_thread_tracking: 0 2022-03-17T15:28:49.207 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.enable_pipelined_write: 0 2022-03-17T15:28:49.207 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.unordered_write: 0 2022-03-17T15:28:49.207 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2022-03-17T15:28:49.208 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-03-17T15:28:49.208 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2022-03-17T15:28:49.208 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2022-03-17T15:28:49.208 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.row_cache: None 2022-03-17T15:28:49.208 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.wal_filter: None 2022-03-17T15:28:49.209 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2022-03-17T15:28:49.209 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.allow_ingest_behind: 0 2022-03-17T15:28:49.209 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.preserve_deletes: 0 2022-03-17T15:28:49.209 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.two_write_queues: 0 2022-03-17T15:28:49.209 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.manual_wal_flush: 0 2022-03-17T15:28:49.210 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.atomic_flush: 0 2022-03-17T15:28:49.210 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-03-17T15:28:49.210 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.persist_stats_to_disk: 0 2022-03-17T15:28:49.210 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.write_dbid_to_manifest: 0 2022-03-17T15:28:49.211 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.log_readahead_size: 0 2022-03-17T15:28:49.211 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2022-03-17T15:28:49.211 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.max_background_jobs: 2 2022-03-17T15:28:49.211 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.max_background_compactions: -1 2022-03-17T15:28:49.212 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2022-03-17T15:28:49.212 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-03-17T15:28:49.212 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.delayed_write_rate : 16777216 2022-03-17T15:28:49.212 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.max_total_wal_size: 0 2022-03-17T15:28:49.212 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-03-17T15:28:49.213 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.stats_dump_period_sec: 600 2022-03-17T15:28:49.213 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.stats_persist_period_sec: 600 2022-03-17T15:28:49.213 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2022-03-17T15:28:49.213 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.max_open_files: -1 2022-03-17T15:28:49.214 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.bytes_per_sync: 0 2022-03-17T15:28:49.214 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.wal_bytes_per_sync: 0 2022-03-17T15:28:49.214 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.strict_bytes_per_sync: 0 2022-03-17T15:28:49.215 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Options.compaction_readahead_size: 0 2022-03-17T15:28:49.215 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Compression algorithms supported: 2022-03-17T15:28:49.215 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2022-03-17T15:28:49.216 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: kZSTD supported: 0 2022-03-17T15:28:49.216 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: kXpressCompression supported: 0 2022-03-17T15:28:49.216 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: kLZ4HCCompression supported: 1 2022-03-17T15:28:49.217 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: kLZ4Compression supported: 1 2022-03-17T15:28:49.217 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: kBZip2Compression supported: 0 2022-03-17T15:28:49.217 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: kZlibCompression supported: 1 2022-03-17T15:28:49.218 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: kSnappyCompression supported: 1 2022-03-17T15:28:49.218 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: Fast CRC32 supported: Supported on x86 2022-03-17T15:28:49.218 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.162+0000 7f74770cb880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi061/store.db/MANIFEST-000008 2022-03-17T15:28:49.218 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.219 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2022-03-17T15:28:49.219 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.219 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-03-17T15:28:49.220 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.merge_operator: 2022-03-17T15:28:49.220 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compaction_filter: None 2022-03-17T15:28:49.220 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compaction_filter_factory: None 2022-03-17T15:28:49.221 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.memtable_factory: SkipListFactory 2022-03-17T15:28:49.221 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.table_factory: BlockBasedTable 2022-03-17T15:28:49.221 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c253315d08) 2022-03-17T15:28:49.222 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cache_index_and_filter_blocks: 1 2022-03-17T15:28:49.222 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cache_index_and_filter_blocks_with_high_priority: 0 2022-03-17T15:28:49.222 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: pin_l0_filter_and_index_blocks_in_cache: 0 2022-03-17T15:28:49.222 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: pin_top_level_index_and_filter: 1 2022-03-17T15:28:49.222 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: index_type: 0 2022-03-17T15:28:49.223 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: data_block_index_type: 0 2022-03-17T15:28:49.223 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: index_shortening: 1 2022-03-17T15:28:49.223 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: data_block_hash_table_util_ratio: 0.750000 2022-03-17T15:28:49.224 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: hash_index_allow_collision: 1 2022-03-17T15:28:49.224 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: checksum: 1 2022-03-17T15:28:49.224 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: no_block_cache: 0 2022-03-17T15:28:49.224 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: block_cache: 0x55c25334f010 2022-03-17T15:28:49.224 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: block_cache_name: BinnedLRUCache 2022-03-17T15:28:49.225 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: block_cache_options: 2022-03-17T15:28:49.225 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: capacity : 536870912 2022-03-17T15:28:49.225 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: num_shard_bits : 4 2022-03-17T15:28:49.225 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: strict_capacity_limit : 0 2022-03-17T15:28:49.226 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: high_pri_pool_ratio: 0.000 2022-03-17T15:28:49.226 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: block_cache_compressed: (nil) 2022-03-17T15:28:49.226 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: persistent_cache: (nil) 2022-03-17T15:28:49.226 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: block_size: 4096 2022-03-17T15:28:49.226 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: block_size_deviation: 10 2022-03-17T15:28:49.227 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: block_restart_interval: 16 2022-03-17T15:28:49.227 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: index_block_restart_interval: 1 2022-03-17T15:28:49.227 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: metadata_block_size: 4096 2022-03-17T15:28:49.227 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: partition_filters: 0 2022-03-17T15:28:49.228 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: use_delta_encoding: 1 2022-03-17T15:28:49.228 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: filter_policy: rocksdb.BuiltinBloomFilter 2022-03-17T15:28:49.228 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: whole_key_filtering: 1 2022-03-17T15:28:49.228 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: verify_compression: 0 2022-03-17T15:28:49.229 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: read_amp_bytes_per_bit: 0 2022-03-17T15:28:49.229 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: format_version: 2 2022-03-17T15:28:49.229 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: enable_index_compression: 1 2022-03-17T15:28:49.229 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: block_align: 0 2022-03-17T15:28:49.229 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.230 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.write_buffer_size: 33554432 2022-03-17T15:28:49.230 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.max_write_buffer_number: 2 2022-03-17T15:28:49.230 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compression: NoCompression 2022-03-17T15:28:49.230 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.bottommost_compression: Disabled 2022-03-17T15:28:49.231 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.prefix_extractor: nullptr 2022-03-17T15:28:49.231 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-03-17T15:28:49.231 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.num_levels: 7 2022-03-17T15:28:49.231 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-03-17T15:28:49.231 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-03-17T15:28:49.232 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-03-17T15:28:49.232 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-03-17T15:28:49.232 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2022-03-17T15:28:49.232 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-03-17T15:28:49.233 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-03-17T15:28:49.233 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-03-17T15:28:49.233 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2022-03-17T15:28:49.233 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compression_opts.window_bits: -14 2022-03-17T15:28:49.233 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compression_opts.level: 32767 2022-03-17T15:28:49.234 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compression_opts.strategy: 0 2022-03-17T15:28:49.234 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-03-17T15:28:49.234 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-03-17T15:28:49.234 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compression_opts.enabled: false 2022-03-17T15:28:49.235 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-03-17T15:28:49.235 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-03-17T15:28:49.235 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2022-03-17T15:28:49.235 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.target_file_size_base: 67108864 2022-03-17T15:28:49.235 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.target_file_size_multiplier: 1 2022-03-17T15:28:49.236 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2022-03-17T15:28:49.236 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-03-17T15:28:49.236 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-03-17T15:28:49.236 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-03-17T15:28:49.237 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-03-17T15:28:49.237 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-03-17T15:28:49.237 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-03-17T15:28:49.237 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-03-17T15:28:49.237 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-03-17T15:28:49.238 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-03-17T15:28:49.238 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-03-17T15:28:49.238 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2022-03-17T15:28:49.238 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.arena_block_size: 4194304 2022-03-17T15:28:49.239 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-03-17T15:28:49.239 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-03-17T15:28:49.239 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-03-17T15:28:49.239 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.disable_auto_compactions: 0 2022-03-17T15:28:49.240 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 bash[74603]: 220bb5209e2a0597d302f6225fabe37ecf07c3902f80f11eb053ec1d55a63777 2022-03-17T15:28:49.240 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-03-17T15:28:49.240 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-03-17T15:28:49.240 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-03-17T15:28:49.240 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-03-17T15:28:49.241 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-03-17T15:28:49.241 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-03-17T15:28:49.241 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-03-17T15:28:49.241 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-03-17T15:28:49.241 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-03-17T15:28:49.242 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-03-17T15:28:49.242 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.table_properties_collectors: 2022-03-17T15:28:49.242 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.inplace_update_support: 0 2022-03-17T15:28:49.242 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.inplace_update_num_locks: 10000 2022-03-17T15:28:49.243 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-03-17T15:28:49.243 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2022-03-17T15:28:49.243 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.memtable_huge_page_size: 0 2022-03-17T15:28:49.243 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.bloom_locality: 0 2022-03-17T15:28:49.243 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.max_successive_merges: 0 2022-03-17T15:28:49.244 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.optimize_filters_for_hits: 0 2022-03-17T15:28:49.244 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.paranoid_file_checks: 0 2022-03-17T15:28:49.244 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.force_consistency_checks: 0 2022-03-17T15:28:49.244 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.report_bg_io_stats: 0 2022-03-17T15:28:49.245 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.ttl: 2592000 2022-03-17T15:28:49.245 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: Options.periodic_compaction_seconds: 0 2022-03-17T15:28:49.245 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2022-03-17T15:28:49.245 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi061/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 16, last_sequence is 6551, log_number is 12,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-03-17T15:28:49.246 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.246 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 12 2022-03-17T15:28:49.246 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.247 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1647530929165093, "job": 1, "event": "recovery_started", "log_files": [12]} 2022-03-17T15:28:49.247 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.163+0000 7f74770cb880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #12 mode 2 2022-03-17T15:28:49.247 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.171+0000 7f74770cb880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2022-03-17T15:28:49.247 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.183+0000 7f74770cb880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1647530929184949, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 16, "file_size": 8864426, "table_properties": {"data_size": 8850782, "index_size": 11220, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 1605, "raw_key_size": 12261, "raw_average_key_size": 20, "raw_value_size": 8833729, "raw_average_value_size": 14673, "num_data_blocks": 358, "num_entries": 602, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1647530929, "oldest_key_time": 3, "file_creation_time": 0}} 2022-03-17T15:28:49.247 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.183+0000 7f74770cb880 4 rocksdb: [version_set.cc:3826] Creating manifest 17 2022-03-17T15:28:49.248 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.248 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.183+0000 7f74770cb880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2022-03-17T15:28:49.248 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.184+0000 7f74770cb880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1647530929185447, "job": 1, "event": "recovery_finished"} 2022-03-17T15:28:49.248 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.185+0000 7f74770cb880 4 rocksdb: DB pointer 0x55c253419800 2022-03-17T15:28:49.249 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.185+0000 7f745e0fe700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2022-03-17T15:28:49.249 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.185+0000 7f745e0fe700 4 rocksdb: [db_impl/db_impl.cc:851] 2022-03-17T15:28:49.249 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: ** DB Stats ** 2022-03-17T15:28:49.249 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Uptime(secs): 0.0 total, 0.0 interval 2022-03-17T15:28:49.250 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-03-17T15:28:49.250 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-03-17T15:28:49.250 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-03-17T15:28:49.250 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-03-17T15:28:49.250 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-03-17T15:28:49.251 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-03-17T15:28:49.251 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.251 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: ** Compaction Stats [default] ** 2022-03-17T15:28:49.251 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:28:49.252 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:28:49.252 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: L0 1/0 8.45 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 681.2 0.01 0.00 1 0.012 0 0 2022-03-17T15:28:49.252 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: L6 1/0 18.28 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-03-17T15:28:49.252 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Sum 2/0 26.73 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 681.2 0.01 0.00 1 0.012 0 0 2022-03-17T15:28:49.253 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 681.2 0.01 0.00 1 0.012 0 0 2022-03-17T15:28:49.253 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.253 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: ** Compaction Stats [default] ** 2022-03-17T15:28:49.253 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:28:49.254 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:28:49.254 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 681.2 0.01 0.00 1 0.012 0 0 2022-03-17T15:28:49.254 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Uptime(secs): 0.0 total, 0.0 interval 2022-03-17T15:28:49.254 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Flush(GB): cumulative 0.008, interval 0.008 2022-03-17T15:28:49.255 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: AddFile(GB): cumulative 0.000, interval 0.000 2022-03-17T15:28:49.255 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: AddFile(Total Files): cumulative 0, interval 0 2022-03-17T15:28:49.255 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: AddFile(L0 Files): cumulative 0, interval 0 2022-03-17T15:28:49.256 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: AddFile(Keys): cumulative 0, interval 0 2022-03-17T15:28:49.256 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Cumulative compaction: 0.01 GB write, 373.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:28:49.256 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Interval compaction: 0.01 GB write, 373.43 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:28:49.256 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-03-17T15:28:49.257 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.257 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: ** File Read Latency Histogram By Level [default] ** 2022-03-17T15:28:49.257 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.258 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: ** Compaction Stats [default] ** 2022-03-17T15:28:49.258 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:28:49.258 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:28:49.258 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: L0 1/0 8.45 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 681.2 0.01 0.00 1 0.012 0 0 2022-03-17T15:28:49.259 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: L6 1/0 18.28 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-03-17T15:28:49.259 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Sum 2/0 26.73 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 681.2 0.01 0.00 1 0.012 0 0 2022-03-17T15:28:49.259 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-03-17T15:28:49.259 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.260 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: ** Compaction Stats [default] ** 2022-03-17T15:28:49.260 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:28:49.260 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:28:49.260 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 681.2 0.01 0.00 1 0.012 0 0 2022-03-17T15:28:49.261 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Uptime(secs): 0.0 total, 0.0 interval 2022-03-17T15:28:49.261 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Flush(GB): cumulative 0.008, interval 0.000 2022-03-17T15:28:49.261 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: AddFile(GB): cumulative 0.000, interval 0.000 2022-03-17T15:28:49.262 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: AddFile(Total Files): cumulative 0, interval 0 2022-03-17T15:28:49.262 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: AddFile(L0 Files): cumulative 0, interval 0 2022-03-17T15:28:49.262 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: AddFile(Keys): cumulative 0, interval 0 2022-03-17T15:28:49.262 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Cumulative compaction: 0.01 GB write, 372.56 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:28:49.263 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:28:49.263 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-03-17T15:28:49.263 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.264 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: ** File Read Latency Histogram By Level [default] ** 2022-03-17T15:28:49.264 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.264 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.186+0000 7f74770cb880 0 starting mon.smithi061 rank 0 at public addrs [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] at bind addrs [v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi061 fsid ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:28:49.264 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.187+0000 7f74770cb880 1 mon.smithi061@-1(???) e2 preinit fsid ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:28:49.265 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.187+0000 7f74770cb880 0 mon.smithi061@-1(???).mds e8 new map 2022-03-17T15:28:49.265 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.187+0000 7f74770cb880 0 mon.smithi061@-1(???).mds e8 print_map 2022-03-17T15:28:49.462 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: e8 2022-03-17T15:28:49.462 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: enable_multiple, ever_enabled_multiple: 1,1 2022-03-17T15:28:49.462 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-03-17T15:28:49.463 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: legacy client fscid: 1 2022-03-17T15:28:49.463 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.463 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Filesystem 'foofs' (1) 2022-03-17T15:28:49.463 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: fs_name foofs 2022-03-17T15:28:49.464 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: epoch 8 2022-03-17T15:28:49.464 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: flags 12 2022-03-17T15:28:49.464 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: created 2022-03-17T15:25:38.576463+0000 2022-03-17T15:28:49.464 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: modified 2022-03-17T15:28:41.920297+0000 2022-03-17T15:28:49.464 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: tableserver 0 2022-03-17T15:28:49.465 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: root 0 2022-03-17T15:28:49.465 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: session_timeout 60 2022-03-17T15:28:49.465 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: session_autoclose 300 2022-03-17T15:28:49.465 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: max_file_size 1099511627776 2022-03-17T15:28:49.466 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: required_client_features {} 2022-03-17T15:28:49.466 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: last_failure 0 2022-03-17T15:28:49.466 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: last_failure_osd_epoch 0 2022-03-17T15:28:49.466 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-03-17T15:28:49.467 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: max_mds 1 2022-03-17T15:28:49.467 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: in 0 2022-03-17T15:28:49.467 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: up {0=14496} 2022-03-17T15:28:49.467 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: failed 2022-03-17T15:28:49.467 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: damaged 2022-03-17T15:28:49.468 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: stopped 2022-03-17T15:28:49.468 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: data_pools [3] 2022-03-17T15:28:49.468 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: metadata_pool 2 2022-03-17T15:28:49.469 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: inline_data disabled 2022-03-17T15:28:49.469 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: balancer 2022-03-17T15:28:49.469 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: standby_count_wanted 1 2022-03-17T15:28:49.469 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: [mds.foofs.smithi061.atvhsa{0:14496} state up:active seq 47 join_fscid=1 addr [v2:172.21.15.61:6834/326071404,v1:172.21.15.61:6835/326071404] compat {c=[1],r=[1],i=[7ff]}] 2022-03-17T15:28:49.470 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.470 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.470 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Standby daemons: 2022-03-17T15:28:49.470 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.470 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: [mds.foofs.smithi067.osftcx{-1:24319} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.67:6832/120748127,v1:172.21.15.67:6833/120748127] compat {c=[1],r=[1],i=[7ff]}] 2022-03-17T15:28:49.471 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:28:49.471 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.188+0000 7f74770cb880 0 mon.smithi061@-1(???).osd e66 crush map has features 3314933000854323200, adjusting msgr requires 2022-03-17T15:28:49.471 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.188+0000 7f74770cb880 0 mon.smithi061@-1(???).osd e66 crush map has features 432629239337189376, adjusting msgr requires 2022-03-17T15:28:49.471 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.188+0000 7f74770cb880 0 mon.smithi061@-1(???).osd e66 crush map has features 432629239337189376, adjusting msgr requires 2022-03-17T15:28:49.472 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.188+0000 7f74770cb880 0 mon.smithi061@-1(???).osd e66 crush map has features 432629239337189376, adjusting msgr requires 2022-03-17T15:28:49.472 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:46.213482+0000 mgr.smithi061.kxplwz (mgr.14724) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:28:49.472 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:46.523521+0000 mon.smithi061 (mon.0) 823 : cluster [DBG] Standby manager daemon smithi067.rdualw restarted 2022-03-17T15:28:49.472 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:46.523624+0000 mon.smithi061 (mon.0) 824 : cluster [DBG] Standby manager daemon smithi067.rdualw started 2022-03-17T15:28:49.473 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:46.525300+0000 mon.smithi067 (mon.1) 84 : audit [DBG] from='mgr.? 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/crt"}]: dispatch 2022-03-17T15:28:49.473 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:46.525965+0000 mon.smithi067 (mon.1) 85 : audit [DBG] from='mgr.? 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2022-03-17T15:28:49.473 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:28:46.538814+0000 mgr.smithi061.kxplwz (mgr.14724) 19 : cephadm [INF] Upgrade: Updating mon.smithi061 2022-03-17T15:28:49.473 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:46.542996+0000 mon.smithi061 (mon.0) 825 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:49.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:46.543640+0000 mon.smithi061 (mon.0) 826 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-03-17T15:28:49.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:46.544156+0000 mon.smithi061 (mon.0) 827 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-03-17T15:28:49.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:46.544725+0000 mon.smithi061 (mon.0) 828 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:49.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:28:46.545272+0000 mgr.smithi061.kxplwz (mgr.14724) 20 : cephadm [INF] Deploying daemon mon.smithi061 on smithi061 2022-03-17T15:28:49.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:46.547924+0000 mon.smithi067 (mon.1) 86 : audit [DBG] from='mgr.? 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi067.rdualw/key"}]: dispatch 2022-03-17T15:28:49.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:46.548248+0000 mon.smithi067 (mon.1) 87 : audit [DBG] from='mgr.? 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2022-03-17T15:28:49.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:49.188+0000 7f74770cb880 1 mon.smithi061@-1(???).paxosservice(auth 1..38) refresh upgraded, format 0 -> 3 2022-03-17T15:28:49.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 systemd[1]: Started Ceph mon.smithi061 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:28:49.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:47.840256+0000 mon.smithi067 (mon.1) 88 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi061"}]: dispatch 2022-03-17T15:28:49.476 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:47.840514+0000 mon.smithi067 (mon.1) 89 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:28:49.476 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:48.213847+0000 mgr.smithi061.kxplwz (mgr.14724) 21 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:28:49.476 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:49.400036+0000 mon.smithi061 (mon.0) 1 : cluster [INF] mon.smithi061 calling monitor election 2022-03-17T15:28:49.476 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:49.401796+0000 mon.smithi061 (mon.0) 2 : cluster [INF] mon.smithi061 is new leader, mons smithi061,smithi067 in quorum (ranks 0,1) 2022-03-17T15:28:49.477 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:49.406341+0000 mon.smithi061 (mon.0) 3 : cluster [DBG] monmap e2: 2 mons at {smithi061=[v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0],smithi067=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0]} 2022-03-17T15:28:49.477 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:49.406417+0000 mon.smithi061 (mon.0) 4 : cluster [DBG] fsmap foofs:1 {0=foofs.smithi061.atvhsa=up:active} 1 up:standby 2022-03-17T15:28:49.477 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:49.406448+0000 mon.smithi061 (mon.0) 5 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2022-03-17T15:28:49.477 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:49.407331+0000 mon.smithi061 (mon.0) 6 : cluster [DBG] mgrmap e36: smithi061.kxplwz(active, since 22s), standbys: smithi067.rdualw 2022-03-17T15:28:49.477 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:49.416208+0000 mon.smithi061 (mon.0) 7 : cluster [WRN] Health detail: HEALTH_WARN 1 MDSs report slow requests 2022-03-17T15:28:49.478 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:49.416224+0000 mon.smithi061 (mon.0) 8 : cluster [WRN] [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2022-03-17T15:28:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:49.416241+0000 mon.smithi061 (mon.0) 9 : cluster [WRN] mds.foofs.smithi061.atvhsa(mds.0): 1 slow requests are blocked > 30 secs 2022-03-17T15:28:49.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:49.416386+0000 mon.smithi061 (mon.0) 10 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:49.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:49.418276+0000 mon.smithi067 (mon.1) 90 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:49.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:49.419317+0000 mon.smithi061 (mon.0) 11 : audit [INF] from='mgr.14724 ' entity='' 2022-03-17T15:28:49.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:49.421633+0000 mon.smithi067 (mon.1) 91 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:49.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:49.422689+0000 mon.smithi067 (mon.1) 92 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:28:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:47.840256+0000 mon.smithi067 (mon.1) 88 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi061"}]: dispatch 2022-03-17T15:28:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:47.840514+0000 mon.smithi067 (mon.1) 89 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:28:49.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:48.213847+0000 mgr.smithi061.kxplwz (mgr.14724) 21 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:28:49.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:49.400036+0000 mon.smithi061 (mon.0) 1 : cluster [INF] mon.smithi061 calling monitor election 2022-03-17T15:28:49.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:49.401796+0000 mon.smithi061 (mon.0) 2 : cluster [INF] mon.smithi061 is new leader, mons smithi061,smithi067 in quorum (ranks 0,1) 2022-03-17T15:28:49.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:49.406341+0000 mon.smithi061 (mon.0) 3 : cluster [DBG] monmap e2: 2 mons at {smithi061=[v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0],smithi067=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0]} 2022-03-17T15:28:49.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:49.406417+0000 mon.smithi061 (mon.0) 4 : cluster [DBG] fsmap foofs:1 {0=foofs.smithi061.atvhsa=up:active} 1 up:standby 2022-03-17T15:28:49.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:49.406448+0000 mon.smithi061 (mon.0) 5 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2022-03-17T15:28:49.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:49.407331+0000 mon.smithi061 (mon.0) 6 : cluster [DBG] mgrmap e36: smithi061.kxplwz(active, since 22s), standbys: smithi067.rdualw 2022-03-17T15:28:49.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:49.416208+0000 mon.smithi061 (mon.0) 7 : cluster [WRN] Health detail: HEALTH_WARN 1 MDSs report slow requests 2022-03-17T15:28:49.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:49.416224+0000 mon.smithi061 (mon.0) 8 : cluster [WRN] [WRN] MDS_SLOW_REQUEST: 1 MDSs report slow requests 2022-03-17T15:28:49.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:49.416241+0000 mon.smithi061 (mon.0) 9 : cluster [WRN] mds.foofs.smithi061.atvhsa(mds.0): 1 slow requests are blocked > 30 secs 2022-03-17T15:28:49.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:49.416386+0000 mon.smithi061 (mon.0) 10 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:49.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:49.418276+0000 mon.smithi067 (mon.1) 90 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:49.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:49.419317+0000 mon.smithi061 (mon.0) 11 : audit [INF] from='mgr.14724 ' entity='' 2022-03-17T15:28:49.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:49.421633+0000 mon.smithi067 (mon.1) 91 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:49.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:49.422689+0000 mon.smithi067 (mon.1) 92 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:28:50.129 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 50 sec latency 53810.282 ms 2022-03-17T15:28:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:28:50.464+0000 7f7463108700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-03-17T15:28:50.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:28:49.423526+0000 mgr.smithi061.kxplwz (mgr.14724) 22 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:28:50.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:49.580782+0000 mon.smithi061 (mon.0) 12 : cluster [WRN] daemon mds.foofs.smithi061.atvhsa compat changed unexpectedly 2022-03-17T15:28:50.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:49.587882+0000 mon.smithi061 (mon.0) 13 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2022-03-17T15:28:50.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:49.590320+0000 mon.smithi061 (mon.0) 14 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-03-17T15:28:50.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:49.591701+0000 mon.smithi067 (mon.1) 93 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-03-17T15:28:50.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:49.592200+0000 mon.smithi061 (mon.0) 15 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-03-17T15:28:50.816 INFO:journalctl@ceph.osd.5.smithi067.stdout:Mar 17 15:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.5[39690]: debug 2022-03-17T15:28:50.500+0000 7fa8ec5a3700 -1 bdev(0x55f5c1fd4800 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 4 2022-03-17T15:28:50.816 INFO:journalctl@ceph.osd.7.smithi067.stdout:Mar 17 15:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.7[45564]: debug 2022-03-17T15:28:50.493+0000 7f71ce01a700 -1 bdev(0x562e228cc800 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 7 2022-03-17T15:28:50.817 INFO:journalctl@ceph.osd.7.smithi067.stdout:Mar 17 15:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.7[45564]: debug 2022-03-17T15:28:50.495+0000 7f71d1821700 -1 bdev(0x562e228cc800 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 8 2022-03-17T15:28:50.817 INFO:journalctl@ceph.osd.7.smithi067.stdout:Mar 17 15:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.7[45564]: debug 2022-03-17T15:28:50.495+0000 7f71d2823700 -1 bdev(0x562e228cc800 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 8 2022-03-17T15:28:50.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:49.423526+0000 mgr.smithi061.kxplwz (mgr.14724) 22 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:28:50.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:49.580782+0000 mon.smithi061 (mon.0) 12 : cluster [WRN] daemon mds.foofs.smithi061.atvhsa compat changed unexpectedly 2022-03-17T15:28:50.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:49.587882+0000 mon.smithi061 (mon.0) 13 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2022-03-17T15:28:50.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:49.590320+0000 mon.smithi061 (mon.0) 14 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-03-17T15:28:50.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:49.591701+0000 mon.smithi067 (mon.1) 93 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-03-17T15:28:50.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:49.592200+0000 mon.smithi061 (mon.0) 15 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-03-17T15:28:51.129 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 51 sec latency 54810.340 ms 2022-03-17T15:28:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:50.214197+0000 mgr.smithi061.kxplwz (mgr.14724) 23 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 0 op/s 2022-03-17T15:28:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:50.465817+0000 mon.smithi061 (mon.0) 16 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2022-03-17T15:28:51.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:50.465846+0000 mon.smithi061 (mon.0) 17 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-03-17T15:28:51.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:50.465858+0000 mon.smithi061 (mon.0) 18 : cluster [INF] Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2022-03-17T15:28:51.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:50.472152+0000 mon.smithi061 (mon.0) 19 : cluster [INF] Standby daemon mds.foofs.smithi067.osftcx assigned to filesystem foofs as rank 0 2022-03-17T15:28:51.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:50.472266+0000 mon.smithi061 (mon.0) 20 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2022-03-17T15:28:51.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:50.472284+0000 mon.smithi061 (mon.0) 21 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-03-17T15:28:51.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:50.472479+0000 mon.smithi061 (mon.0) 22 : cluster [DBG] fsmap foofs:0/1 1 up:standby, 1 failed 2022-03-17T15:28:51.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:50.474857+0000 mon.smithi061 (mon.0) 23 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi067.osftcx=up:replay} 2022-03-17T15:28:51.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:50.589087+0000 mon.smithi061 (mon.0) 24 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2022-03-17T15:28:51.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:50.589197+0000 mon.smithi061 (mon.0) 25 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2022-03-17T15:28:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:50.214197+0000 mgr.smithi061.kxplwz (mgr.14724) 23 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 0 op/s 2022-03-17T15:28:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:50.465817+0000 mon.smithi061 (mon.0) 16 : cluster [WRN] Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2022-03-17T15:28:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:50.465846+0000 mon.smithi061 (mon.0) 17 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-03-17T15:28:51.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:50.465858+0000 mon.smithi061 (mon.0) 18 : cluster [INF] Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests) 2022-03-17T15:28:51.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:50.472152+0000 mon.smithi061 (mon.0) 19 : cluster [INF] Standby daemon mds.foofs.smithi067.osftcx assigned to filesystem foofs as rank 0 2022-03-17T15:28:51.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:50.472266+0000 mon.smithi061 (mon.0) 20 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2022-03-17T15:28:51.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:50.472284+0000 mon.smithi061 (mon.0) 21 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-03-17T15:28:51.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:50.472479+0000 mon.smithi061 (mon.0) 22 : cluster [DBG] fsmap foofs:0/1 1 up:standby, 1 failed 2022-03-17T15:28:51.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:50.474857+0000 mon.smithi061 (mon.0) 23 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi067.osftcx=up:replay} 2022-03-17T15:28:51.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:50.589087+0000 mon.smithi061 (mon.0) 24 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2022-03-17T15:28:51.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:50.589197+0000 mon.smithi061 (mon.0) 25 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2022-03-17T15:28:52.129 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 52 sec latency 55810.386 ms 2022-03-17T15:28:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:51.473352+0000 mon.smithi061 (mon.0) 26 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2022-03-17T15:28:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:51.476154+0000 mon.smithi061 (mon.0) 27 : cluster [DBG] mds.? [v2:172.21.15.61:6834/1851308444,v1:172.21.15.61:6835/1851308444] up:boot 2022-03-17T15:28:52.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:51.476199+0000 mon.smithi061 (mon.0) 28 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi067.osftcx=up:replay} 1 up:standby 2022-03-17T15:28:52.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:51.477094+0000 mon.smithi067 (mon.1) 94 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi061.atvhsa"}]: dispatch 2022-03-17T15:28:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:51.473352+0000 mon.smithi061 (mon.0) 26 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2022-03-17T15:28:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:51.476154+0000 mon.smithi061 (mon.0) 27 : cluster [DBG] mds.? [v2:172.21.15.61:6834/1851308444,v1:172.21.15.61:6835/1851308444] up:boot 2022-03-17T15:28:52.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:51.476199+0000 mon.smithi061 (mon.0) 28 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi067.osftcx=up:replay} 1 up:standby 2022-03-17T15:28:52.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:51.477094+0000 mon.smithi067 (mon.1) 94 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi061.atvhsa"}]: dispatch 2022-03-17T15:28:53.129 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 53 sec latency 56810.418 ms 2022-03-17T15:28:53.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:52.214571+0000 mgr.smithi061.kxplwz (mgr.14724) 24 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T15:28:53.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:52.479588+0000 mon.smithi061 (mon.0) 29 : cluster [DBG] mds.? [v2:172.21.15.67:6832/120748127,v1:172.21.15.67:6833/120748127] up:reconnect 2022-03-17T15:28:53.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:52.479672+0000 mon.smithi061 (mon.0) 30 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi067.osftcx=up:reconnect} 1 up:standby 2022-03-17T15:28:53.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:52.214571+0000 mgr.smithi061.kxplwz (mgr.14724) 24 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T15:28:53.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:52.479588+0000 mon.smithi061 (mon.0) 29 : cluster [DBG] mds.? [v2:172.21.15.67:6832/120748127,v1:172.21.15.67:6833/120748127] up:reconnect 2022-03-17T15:28:53.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:52.479672+0000 mon.smithi061 (mon.0) 30 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi067.osftcx=up:reconnect} 1 up:standby 2022-03-17T15:28:54.129 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 54 sec latency 57810.502 ms 2022-03-17T15:28:55.130 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 55 sec latency 58810.559 ms 2022-03-17T15:28:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:54.215137+0000 mgr.smithi061.kxplwz (mgr.14724) 25 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:28:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:54.215137+0000 mgr.smithi061.kxplwz (mgr.14724) 25 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:28:56.129 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 56 sec latency 59810.592 ms 2022-03-17T15:28:57.130 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 57 sec latency 60810.669 ms 2022-03-17T15:28:57.534 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:56.215989+0000 mgr.smithi061.kxplwz (mgr.14724) 26 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 26 MiB/s rd, 8 op/s 2022-03-17T15:28:57.535 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:56.878010+0000 mon.smithi061 (mon.0) 31 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:57.535 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:56.882673+0000 mon.smithi061 (mon.0) 32 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:57.535 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:56.891241+0000 mon.smithi061 (mon.0) 33 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:57.535 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:56.897480+0000 mon.smithi067 (mon.1) 95 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:57.536 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:56.899887+0000 mon.smithi067 (mon.1) 96 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:28:57.536 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:56.900967+0000 mon.smithi067 (mon.1) 97 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "quorum_status"}]: dispatch 2022-03-17T15:28:57.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:56.215989+0000 mgr.smithi061.kxplwz (mgr.14724) 26 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 26 MiB/s rd, 8 op/s 2022-03-17T15:28:57.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:56.878010+0000 mon.smithi061 (mon.0) 31 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:57.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:56.882673+0000 mon.smithi061 (mon.0) 32 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:57.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:56.891241+0000 mon.smithi061 (mon.0) 33 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:57.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:56.897480+0000 mon.smithi067 (mon.1) 95 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:28:57.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:56.899887+0000 mon.smithi067 (mon.1) 96 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:28:57.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:56.900967+0000 mon.smithi067 (mon.1) 97 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "quorum_status"}]: dispatch 2022-03-17T15:28:58.130 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 58 sec latency 61810.814 ms 2022-03-17T15:28:59.130 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 59 sec latency 62810.916 ms 2022-03-17T15:28:59.309 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:58.214277+0000 mgr.smithi061.kxplwz (mgr.14724) 27 : cephadm [INF] Upgrade: Updating mon.smithi067 2022-03-17T15:28:59.310 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cluster 2022-03-17T15:28:58.216387+0000 mgr.smithi061.kxplwz (mgr.14724) 28 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 25 MiB/s rd, 7 op/s 2022-03-17T15:28:59.310 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:58.218980+0000 mon.smithi061 (mon.0) 34 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:59.310 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:58.220313+0000 mon.smithi067 (mon.1) 98 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-03-17T15:28:59.311 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:58.221109+0000 mon.smithi067 (mon.1) 99 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-03-17T15:28:59.311 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:58.221896+0000 mon.smithi067 (mon.1) 100 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:59.311 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: cephadm 2022-03-17T15:28:58.222617+0000 mgr.smithi061.kxplwz (mgr.14724) 29 : cephadm [INF] Deploying daemon mon.smithi067 on smithi067 2022-03-17T15:28:59.311 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: audit 2022-03-17T15:28:58.417255+0000 mon.smithi061 (mon.0) 35 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:59.312 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:59 smithi067 systemd[1]: Stopping Ceph mon.smithi067 for ae1b9b88-a605-11ec-8c35-001a4aab830c... 2022-03-17T15:28:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:28:58.214277+0000 mgr.smithi061.kxplwz (mgr.14724) 27 : cephadm [INF] Upgrade: Updating mon.smithi067 2022-03-17T15:28:59.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:28:58.216387+0000 mgr.smithi061.kxplwz (mgr.14724) 28 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 25 MiB/s rd, 7 op/s 2022-03-17T15:28:59.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:58.218980+0000 mon.smithi061 (mon.0) 34 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:59.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:58.220313+0000 mon.smithi067 (mon.1) 98 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-03-17T15:28:59.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:58.221109+0000 mon.smithi067 (mon.1) 99 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-03-17T15:28:59.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:58.221896+0000 mon.smithi067 (mon.1) 100 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:28:59.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:28:58.222617+0000 mgr.smithi061.kxplwz (mgr.14724) 29 : cephadm [INF] Deploying daemon mon.smithi067 on smithi067 2022-03-17T15:28:59.556 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:28:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:28:58.417255+0000 mon.smithi061 (mon.0) 35 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' 2022-03-17T15:28:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:28:59.400+0000 7eff0d662700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.smithi067 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2022-03-17T15:28:59.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067[32997]: debug 2022-03-17T15:28:59.400+0000 7eff0d662700 -1 mon.smithi067@1(peon) e2 *** Got Signal Terminated *** 2022-03-17T15:28:59.930 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:59 smithi067 bash[54354]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067 2022-03-17T15:28:59.931 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:59 smithi067 bash[54396]: Error: no container with name or ID "ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067" found: no such container 2022-03-17T15:29:00.130 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 60 sec latency 63810.981 ms 2022-03-17T15:29:00.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:59 smithi067 bash[54409]: Error: no container with name or ID "ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon.smithi067" found: no such container 2022-03-17T15:29:00.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:59 smithi067 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@mon.smithi067.service: Succeeded. 2022-03-17T15:29:00.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:28:59 smithi067 systemd[1]: Stopped Ceph mon.smithi067 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:29:00.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 systemd[1]: Starting Ceph mon.smithi067 for ae1b9b88-a605-11ec-8c35-001a4aab830c... 2022-03-17T15:29:00.680 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 podman[54509]: 2022-03-17T15:29:00.680 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.552+0000 7faa561e9880 0 set uid:gid to 167:167 (ceph:ceph) 2022-03-17T15:29:00.680 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.552+0000 7faa561e9880 0 ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable), process ceph-mon, pid 7 2022-03-17T15:29:00.681 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.552+0000 7faa561e9880 0 pidfile_write: ignore empty --pid-file 2022-03-17T15:29:00.681 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 bash[54509]: 0c4131715971792febfb99e67a3bf0b4fe367a0e246a77fb939a30158819165c 2022-03-17T15:29:00.681 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 0 load: jerasure load: lrc load: isa 2022-03-17T15:29:00.681 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: RocksDB version: 6.8.1 2022-03-17T15:29:00.682 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.682 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2022-03-17T15:29:00.682 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Compile date Mar 16 2022 2022-03-17T15:29:00.682 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: DB SUMMARY 2022-03-17T15:29:00.683 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.683 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: CURRENT file: CURRENT 2022-03-17T15:29:00.683 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.683 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: IDENTITY file: IDENTITY 2022-03-17T15:29:00.684 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.684 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 604 Bytes 2022-03-17T15:29:00.684 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.684 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi067/store.db dir, Total Num: 1, files: 000016.sst 2022-03-17T15:29:00.684 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.685 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi067/store.db: 000014.log size: 479523 ; 2022-03-17T15:29:00.685 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.685 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.error_if_exists: 0 2022-03-17T15:29:00.685 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.create_if_missing: 0 2022-03-17T15:29:00.685 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.paranoid_checks: 1 2022-03-17T15:29:00.686 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.env: 0x56517870b000 2022-03-17T15:29:00.686 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.fs: Posix File System 2022-03-17T15:29:00.686 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.info_log: 0x56517960e7e0 2022-03-17T15:29:00.686 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_file_opening_threads: 16 2022-03-17T15:29:00.687 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.statistics: (nil) 2022-03-17T15:29:00.687 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.use_fsync: 0 2022-03-17T15:29:00.687 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_log_file_size: 0 2022-03-17T15:29:00.688 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2022-03-17T15:29:00.688 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.log_file_time_to_roll: 0 2022-03-17T15:29:00.688 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.keep_log_file_num: 1000 2022-03-17T15:29:00.688 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.recycle_log_file_num: 0 2022-03-17T15:29:00.689 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.allow_fallocate: 1 2022-03-17T15:29:00.689 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.allow_mmap_reads: 0 2022-03-17T15:29:00.689 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.allow_mmap_writes: 0 2022-03-17T15:29:00.689 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.use_direct_reads: 0 2022-03-17T15:29:00.689 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2022-03-17T15:29:00.690 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.create_missing_column_families: 0 2022-03-17T15:29:00.690 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.db_log_dir: 2022-03-17T15:29:00.690 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi067/store.db 2022-03-17T15:29:00.690 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.table_cache_numshardbits: 6 2022-03-17T15:29:00.691 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_subcompactions: 1 2022-03-17T15:29:00.691 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_background_flushes: -1 2022-03-17T15:29:00.691 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.WAL_ttl_seconds: 0 2022-03-17T15:29:00.691 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.WAL_size_limit_MB: 0 2022-03-17T15:29:00.692 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2022-03-17T15:29:00.692 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2022-03-17T15:29:00.692 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.is_fd_close_on_exec: 1 2022-03-17T15:29:00.692 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.advise_random_on_open: 1 2022-03-17T15:29:00.692 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.db_write_buffer_size: 0 2022-03-17T15:29:00.693 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.write_buffer_manager: 0x56517a30a150 2022-03-17T15:29:00.693 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2022-03-17T15:29:00.693 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2022-03-17T15:29:00.693 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2022-03-17T15:29:00.693 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.use_adaptive_mutex: 0 2022-03-17T15:29:00.694 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.rate_limiter: (nil) 2022-03-17T15:29:00.694 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2022-03-17T15:29:00.694 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.wal_recovery_mode: 2 2022-03-17T15:29:00.694 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.enable_thread_tracking: 0 2022-03-17T15:29:00.695 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.enable_pipelined_write: 0 2022-03-17T15:29:00.695 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.unordered_write: 0 2022-03-17T15:29:00.695 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2022-03-17T15:29:00.695 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2022-03-17T15:29:00.696 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2022-03-17T15:29:00.696 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2022-03-17T15:29:00.696 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.row_cache: None 2022-03-17T15:29:00.696 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.wal_filter: None 2022-03-17T15:29:00.696 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2022-03-17T15:29:00.697 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.allow_ingest_behind: 0 2022-03-17T15:29:00.697 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.preserve_deletes: 0 2022-03-17T15:29:00.697 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.two_write_queues: 0 2022-03-17T15:29:00.698 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.manual_wal_flush: 0 2022-03-17T15:29:00.698 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.atomic_flush: 0 2022-03-17T15:29:00.698 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2022-03-17T15:29:00.698 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.persist_stats_to_disk: 0 2022-03-17T15:29:00.698 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.write_dbid_to_manifest: 0 2022-03-17T15:29:00.699 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.log_readahead_size: 0 2022-03-17T15:29:00.699 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2022-03-17T15:29:00.699 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_background_jobs: 2 2022-03-17T15:29:00.699 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_background_compactions: -1 2022-03-17T15:29:00.700 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2022-03-17T15:29:00.700 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2022-03-17T15:29:00.700 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.delayed_write_rate : 16777216 2022-03-17T15:29:00.700 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_total_wal_size: 0 2022-03-17T15:29:00.701 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2022-03-17T15:29:00.701 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.stats_dump_period_sec: 600 2022-03-17T15:29:00.701 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.stats_persist_period_sec: 600 2022-03-17T15:29:00.701 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2022-03-17T15:29:00.702 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_open_files: -1 2022-03-17T15:29:00.702 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.bytes_per_sync: 0 2022-03-17T15:29:00.702 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.wal_bytes_per_sync: 0 2022-03-17T15:29:00.702 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.strict_bytes_per_sync: 0 2022-03-17T15:29:00.702 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compaction_readahead_size: 0 2022-03-17T15:29:00.703 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Compression algorithms supported: 2022-03-17T15:29:00.703 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2022-03-17T15:29:00.703 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: kZSTD supported: 0 2022-03-17T15:29:00.703 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: kXpressCompression supported: 0 2022-03-17T15:29:00.704 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: kLZ4HCCompression supported: 1 2022-03-17T15:29:00.704 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: kLZ4Compression supported: 1 2022-03-17T15:29:00.704 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: kBZip2Compression supported: 0 2022-03-17T15:29:00.704 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: kZlibCompression supported: 1 2022-03-17T15:29:00.704 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: kSnappyCompression supported: 1 2022-03-17T15:29:00.705 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Fast CRC32 supported: Supported on x86 2022-03-17T15:29:00.705 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi067/store.db/MANIFEST-000005 2022-03-17T15:29:00.705 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.705 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2022-03-17T15:29:00.705 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.706 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2022-03-17T15:29:00.706 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.merge_operator: 2022-03-17T15:29:00.706 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compaction_filter: None 2022-03-17T15:29:00.706 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compaction_filter_factory: None 2022-03-17T15:29:00.707 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.memtable_factory: SkipListFactory 2022-03-17T15:29:00.707 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.table_factory: BlockBasedTable 2022-03-17T15:29:00.707 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5651795add08) 2022-03-17T15:29:00.707 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cache_index_and_filter_blocks: 1 2022-03-17T15:29:00.707 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cache_index_and_filter_blocks_with_high_priority: 0 2022-03-17T15:29:00.708 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: pin_l0_filter_and_index_blocks_in_cache: 0 2022-03-17T15:29:00.708 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: pin_top_level_index_and_filter: 1 2022-03-17T15:29:00.708 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: index_type: 0 2022-03-17T15:29:00.709 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: data_block_index_type: 0 2022-03-17T15:29:00.709 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: index_shortening: 1 2022-03-17T15:29:00.709 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: data_block_hash_table_util_ratio: 0.750000 2022-03-17T15:29:00.709 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: hash_index_allow_collision: 1 2022-03-17T15:29:00.709 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: checksum: 1 2022-03-17T15:29:00.710 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: no_block_cache: 0 2022-03-17T15:29:00.710 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: block_cache: 0x5651795e7010 2022-03-17T15:29:00.710 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: block_cache_name: BinnedLRUCache 2022-03-17T15:29:00.710 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: block_cache_options: 2022-03-17T15:29:00.711 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: capacity : 536870912 2022-03-17T15:29:00.711 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: num_shard_bits : 4 2022-03-17T15:29:00.711 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: strict_capacity_limit : 0 2022-03-17T15:29:00.711 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: high_pri_pool_ratio: 0.000 2022-03-17T15:29:00.711 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: block_cache_compressed: (nil) 2022-03-17T15:29:00.712 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: persistent_cache: (nil) 2022-03-17T15:29:00.712 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: block_size: 4096 2022-03-17T15:29:00.712 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: block_size_deviation: 10 2022-03-17T15:29:00.712 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: block_restart_interval: 16 2022-03-17T15:29:00.713 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: index_block_restart_interval: 1 2022-03-17T15:29:00.713 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: metadata_block_size: 4096 2022-03-17T15:29:00.713 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: partition_filters: 0 2022-03-17T15:29:00.713 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: use_delta_encoding: 1 2022-03-17T15:29:00.713 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: filter_policy: rocksdb.BuiltinBloomFilter 2022-03-17T15:29:00.714 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: whole_key_filtering: 1 2022-03-17T15:29:00.714 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: verify_compression: 0 2022-03-17T15:29:00.714 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: read_amp_bytes_per_bit: 0 2022-03-17T15:29:00.715 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: format_version: 2 2022-03-17T15:29:00.715 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: enable_index_compression: 1 2022-03-17T15:29:00.715 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: block_align: 0 2022-03-17T15:29:00.715 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.715 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.write_buffer_size: 33554432 2022-03-17T15:29:00.716 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_write_buffer_number: 2 2022-03-17T15:29:00.716 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compression: NoCompression 2022-03-17T15:29:00.716 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.bottommost_compression: Disabled 2022-03-17T15:29:00.716 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.prefix_extractor: nullptr 2022-03-17T15:29:00.716 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2022-03-17T15:29:00.717 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.num_levels: 7 2022-03-17T15:29:00.717 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2022-03-17T15:29:00.717 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2022-03-17T15:29:00.717 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2022-03-17T15:29:00.720 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2022-03-17T15:29:00.720 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2022-03-17T15:29:00.720 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2022-03-17T15:29:00.720 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2022-03-17T15:29:00.720 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2022-03-17T15:29:00.721 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2022-03-17T15:29:00.721 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compression_opts.window_bits: -14 2022-03-17T15:29:00.721 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compression_opts.level: 32767 2022-03-17T15:29:00.721 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compression_opts.strategy: 0 2022-03-17T15:29:00.722 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2022-03-17T15:29:00.722 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2022-03-17T15:29:00.722 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compression_opts.enabled: false 2022-03-17T15:29:00.722 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2022-03-17T15:29:00.723 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2022-03-17T15:29:00.723 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2022-03-17T15:29:00.723 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.target_file_size_base: 67108864 2022-03-17T15:29:00.723 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.target_file_size_multiplier: 1 2022-03-17T15:29:00.724 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2022-03-17T15:29:00.724 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2022-03-17T15:29:00.724 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2022-03-17T15:29:00.724 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2022-03-17T15:29:00.724 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2022-03-17T15:29:00.725 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2022-03-17T15:29:00.725 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2022-03-17T15:29:00.725 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2022-03-17T15:29:00.725 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2022-03-17T15:29:00.726 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2022-03-17T15:29:00.726 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2022-03-17T15:29:00.726 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2022-03-17T15:29:00.726 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.arena_block_size: 4194304 2022-03-17T15:29:00.726 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2022-03-17T15:29:00.727 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2022-03-17T15:29:00.727 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2022-03-17T15:29:00.727 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.disable_auto_compactions: 0 2022-03-17T15:29:00.728 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2022-03-17T15:29:00.728 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2022-03-17T15:29:00.728 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2022-03-17T15:29:00.729 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2022-03-17T15:29:00.729 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2022-03-17T15:29:00.729 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2022-03-17T15:29:00.729 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2022-03-17T15:29:00.729 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2022-03-17T15:29:00.730 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2022-03-17T15:29:00.730 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2022-03-17T15:29:00.730 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.table_properties_collectors: 2022-03-17T15:29:00.730 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.inplace_update_support: 0 2022-03-17T15:29:00.731 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.inplace_update_num_locks: 10000 2022-03-17T15:29:00.731 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2022-03-17T15:29:00.731 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2022-03-17T15:29:00.731 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.memtable_huge_page_size: 0 2022-03-17T15:29:00.732 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.bloom_locality: 0 2022-03-17T15:29:00.732 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.max_successive_merges: 0 2022-03-17T15:29:00.733 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.optimize_filters_for_hits: 0 2022-03-17T15:29:00.733 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.paranoid_file_checks: 0 2022-03-17T15:29:00.733 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.force_consistency_checks: 0 2022-03-17T15:29:00.733 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.report_bg_io_stats: 0 2022-03-17T15:29:00.734 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.ttl: 2592000 2022-03-17T15:29:00.734 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.557+0000 7faa561e9880 4 rocksdb: Options.periodic_compaction_seconds: 0 2022-03-17T15:29:00.734 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.558+0000 7faa561e9880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2022-03-17T15:29:00.734 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.558+0000 7faa561e9880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi067/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 18, last_sequence is 9040, log_number is 14,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2022-03-17T15:29:00.734 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.735 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.558+0000 7faa561e9880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 14 2022-03-17T15:29:00.735 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.735 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.558+0000 7faa561e9880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1647530940560119, "job": 1, "event": "recovery_started", "log_files": [14]} 2022-03-17T15:29:00.735 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.558+0000 7faa561e9880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #14 mode 2 2022-03-17T15:29:00.736 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.559+0000 7faa561e9880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2022-03-17T15:29:00.736 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.560+0000 7faa561e9880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1647530940561747, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 18, "file_size": 319646, "table_properties": {"data_size": 318096, "index_size": 540, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 197, "raw_key_size": 1221, "raw_average_key_size": 24, "raw_value_size": 316737, "raw_average_value_size": 6464, "num_data_blocks": 17, "num_entries": 49, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1647530940, "oldest_key_time": 3, "file_creation_time": 0}} 2022-03-17T15:29:00.736 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.560+0000 7faa561e9880 4 rocksdb: [version_set.cc:3826] Creating manifest 19 2022-03-17T15:29:00.736 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.737 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.560+0000 7faa561e9880 4 rocksdb: [version_set.cc:3291] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2022-03-17T15:29:00.737 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.562+0000 7faa561e9880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1647530940564476, "job": 1, "event": "recovery_finished"} 2022-03-17T15:29:00.737 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.563+0000 7faa561e9880 4 rocksdb: DB pointer 0x5651796b1800 2022-03-17T15:29:00.737 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.563+0000 7faa3d21c700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2022-03-17T15:29:00.738 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.563+0000 7faa3d21c700 4 rocksdb: [db_impl/db_impl.cc:851] 2022-03-17T15:29:00.738 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: ** DB Stats ** 2022-03-17T15:29:00.738 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Uptime(secs): 0.0 total, 0.0 interval 2022-03-17T15:29:00.739 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2022-03-17T15:29:00.739 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2022-03-17T15:29:00.739 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2022-03-17T15:29:00.739 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2022-03-17T15:29:00.740 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2022-03-17T15:29:00.740 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2022-03-17T15:29:00.740 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.740 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: ** Compaction Stats [default] ** 2022-03-17T15:29:00.740 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:29:00.741 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:29:00.741 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: L0 1/0 312.15 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 303.3 0.00 0.00 1 0.001 0 0 2022-03-17T15:29:00.741 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: L6 1/0 23.42 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-03-17T15:29:00.742 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Sum 2/0 23.72 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 303.3 0.00 0.00 1 0.001 0 0 2022-03-17T15:29:00.742 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 303.3 0.00 0.00 1 0.001 0 0 2022-03-17T15:29:00.742 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.742 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: ** Compaction Stats [default] ** 2022-03-17T15:29:00.742 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:29:00.743 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:29:00.743 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 303.3 0.00 0.00 1 0.001 0 0 2022-03-17T15:29:00.743 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Uptime(secs): 0.0 total, 0.0 interval 2022-03-17T15:29:00.743 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Flush(GB): cumulative 0.000, interval 0.000 2022-03-17T15:29:00.744 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: AddFile(GB): cumulative 0.000, interval 0.000 2022-03-17T15:29:00.744 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: AddFile(Total Files): cumulative 0, interval 0 2022-03-17T15:29:00.744 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: AddFile(L0 Files): cumulative 0, interval 0 2022-03-17T15:29:00.744 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: AddFile(Keys): cumulative 0, interval 0 2022-03-17T15:29:00.744 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Cumulative compaction: 0.00 GB write, 51.99 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:29:00.745 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Interval compaction: 0.00 GB write, 51.99 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:29:00.745 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-03-17T15:29:00.745 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.745 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: ** File Read Latency Histogram By Level [default] ** 2022-03-17T15:29:00.746 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.746 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: ** Compaction Stats [default] ** 2022-03-17T15:29:00.746 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:29:00.746 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:29:00.747 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: L0 1/0 312.15 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 303.3 0.00 0.00 1 0.001 0 0 2022-03-17T15:29:00.747 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: L6 1/0 23.42 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-03-17T15:29:00.747 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Sum 2/0 23.72 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 303.3 0.00 0.00 1 0.001 0 0 2022-03-17T15:29:00.747 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2022-03-17T15:29:00.747 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.748 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: ** Compaction Stats [default] ** 2022-03-17T15:29:00.748 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2022-03-17T15:29:00.748 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2022-03-17T15:29:00.748 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 303.3 0.00 0.00 1 0.001 0 0 2022-03-17T15:29:00.748 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Uptime(secs): 0.0 total, 0.0 interval 2022-03-17T15:29:00.749 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Flush(GB): cumulative 0.000, interval 0.000 2022-03-17T15:29:00.749 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: AddFile(GB): cumulative 0.000, interval 0.000 2022-03-17T15:29:00.749 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: AddFile(Total Files): cumulative 0, interval 0 2022-03-17T15:29:00.750 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: AddFile(L0 Files): cumulative 0, interval 0 2022-03-17T15:29:00.750 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: AddFile(Keys): cumulative 0, interval 0 2022-03-17T15:29:00.750 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Cumulative compaction: 0.00 GB write, 51.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:29:00.750 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2022-03-17T15:29:00.751 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2022-03-17T15:29:00.751 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.751 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: ** File Read Latency Histogram By Level [default] ** 2022-03-17T15:29:00.751 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.751 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.564+0000 7faa561e9880 0 starting mon.smithi067 rank 1 at public addrs [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] at bind addrs [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi067 fsid ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:29:00.752 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.565+0000 7faa561e9880 1 mon.smithi067@-1(???) e2 preinit fsid ae1b9b88-a605-11ec-8c35-001a4aab830c 2022-03-17T15:29:00.752 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.565+0000 7faa561e9880 0 mon.smithi067@-1(???).mds e12 new map 2022-03-17T15:29:00.752 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.565+0000 7faa561e9880 0 mon.smithi067@-1(???).mds e12 print_map 2022-03-17T15:29:00.752 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: e12 2022-03-17T15:29:00.753 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: enable_multiple, ever_enabled_multiple: 1,1 2022-03-17T15:29:00.753 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-03-17T15:29:00.753 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: legacy client fscid: 1 2022-03-17T15:29:00.753 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.753 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Filesystem 'foofs' (1) 2022-03-17T15:29:00.754 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: fs_name foofs 2022-03-17T15:29:00.754 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: epoch 12 2022-03-17T15:29:00.754 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: flags 12 2022-03-17T15:29:00.754 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: created 2022-03-17T15:25:38.576463+0000 2022-03-17T15:29:00.754 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: modified 2022-03-17T15:28:52.474709+0000 2022-03-17T15:29:00.755 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: tableserver 0 2022-03-17T15:29:00.755 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: root 0 2022-03-17T15:29:00.755 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: session_timeout 60 2022-03-17T15:29:00.755 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: session_autoclose 300 2022-03-17T15:29:00.756 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: max_file_size 1099511627776 2022-03-17T15:29:00.756 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: required_client_features {} 2022-03-17T15:29:00.756 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: last_failure 0 2022-03-17T15:29:00.756 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: last_failure_osd_epoch 67 2022-03-17T15:29:00.756 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2022-03-17T15:29:00.757 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: max_mds 1 2022-03-17T15:29:00.757 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: in 0 2022-03-17T15:29:00.757 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: up {0=24319} 2022-03-17T15:29:00.757 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: failed 2022-03-17T15:29:00.757 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: damaged 2022-03-17T15:29:00.758 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: stopped 2022-03-17T15:29:00.758 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: data_pools [3] 2022-03-17T15:29:00.758 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: metadata_pool 2 2022-03-17T15:29:00.758 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: inline_data disabled 2022-03-17T15:29:00.759 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: balancer 2022-03-17T15:29:00.759 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: standby_count_wanted 1 2022-03-17T15:29:00.759 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: [mds.foofs.smithi067.osftcx{0:24319} state up:reconnect seq 49 join_fscid=1 addr [v2:172.21.15.67:6832/120748127,v1:172.21.15.67:6833/120748127] compat {c=[1],r=[1],i=[7ff]}] 2022-03-17T15:29:00.759 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.760 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.760 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Standby daemons: 2022-03-17T15:29:00.760 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.760 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: [mds.foofs.smithi061.atvhsa{-1:34100} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.61:6834/1851308444,v1:172.21.15.61:6835/1851308444] compat {c=[1],r=[1],i=[7ff]}] 2022-03-17T15:29:00.761 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:29:00.761 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.565+0000 7faa561e9880 0 mon.smithi067@-1(???).osd e68 crush map has features 3314933000854323200, adjusting msgr requires 2022-03-17T15:29:00.761 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.565+0000 7faa561e9880 0 mon.smithi067@-1(???).osd e68 crush map has features 432629239337189376, adjusting msgr requires 2022-03-17T15:29:00.761 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.565+0000 7faa561e9880 0 mon.smithi067@-1(???).osd e68 crush map has features 432629239337189376, adjusting msgr requires 2022-03-17T15:29:00.762 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.565+0000 7faa561e9880 0 mon.smithi067@-1(???).osd e68 crush map has features 432629239337189376, adjusting msgr requires 2022-03-17T15:29:00.762 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:28:58.214277+0000 mgr.smithi061.kxplwz (mgr.14724) 27 : cephadm [INF] Upgrade: Updating mon.smithi067 2022-03-17T15:29:00.762 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:28:58.216387+0000 mgr.smithi061.kxplwz (mgr.14724) 28 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 25 MiB/s rd, 7 op/s 2022-03-17T15:29:00.762 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:28:58.218980+0000 mon.smithi061 (mon.0) 34 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' 2022-03-17T15:29:00.763 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:28:58.220313+0000 mon.smithi067 (mon.1) 98 : audit [INF] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2022-03-17T15:29:00.763 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:28:58.221109+0000 mon.smithi067 (mon.1) 99 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2022-03-17T15:29:00.763 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:28:58.221896+0000 mon.smithi067 (mon.1) 100 : audit [DBG] from='mgr.14724 172.21.15.61:0/3771561786' entity='mgr.smithi061.kxplwz' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:29:00.763 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:28:58.222617+0000 mgr.smithi061.kxplwz (mgr.14724) 29 : cephadm [INF] Deploying daemon mon.smithi067 on smithi067 2022-03-17T15:29:00.763 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:28:58.417255+0000 mon.smithi061 (mon.0) 35 : audit [INF] from='mgr.14724 ' entity='mgr.smithi061.kxplwz' 2022-03-17T15:29:00.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: debug 2022-03-17T15:29:00.566+0000 7faa561e9880 1 mon.smithi067@-1(???).paxosservice(auth 1..39) refresh upgraded, format 0 -> 3 2022-03-17T15:29:00.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 systemd[1]: Started Ceph mon.smithi067 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:29:00.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:00.603235+0000 mon.smithi067 (mon.1) 1 : cluster [INF] mon.smithi067 calling monitor election 2022-03-17T15:29:00.764 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:00.603753+0000 mon.smithi061 (mon.0) 36 : cluster [INF] mon.smithi061 calling monitor election 2022-03-17T15:29:00.765 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:00.617058+0000 mon.smithi061 (mon.0) 37 : cluster [INF] mon.smithi061 is new leader, mons smithi061,smithi067 in quorum (ranks 0,1) 2022-03-17T15:29:00.765 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:00.622050+0000 mon.smithi061 (mon.0) 38 : cluster [DBG] monmap e2: 2 mons at {smithi061=[v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0],smithi067=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0]} 2022-03-17T15:29:00.765 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:00.622124+0000 mon.smithi061 (mon.0) 39 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi067.osftcx=up:reconnect} 1 up:standby 2022-03-17T15:29:00.765 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:00.622154+0000 mon.smithi061 (mon.0) 40 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2022-03-17T15:29:00.765 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:00.622453+0000 mon.smithi061 (mon.0) 41 : cluster [DBG] mgrmap e36: smithi061.kxplwz(active, since 33s), standbys: smithi067.rdualw 2022-03-17T15:29:00.766 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:00.624755+0000 mon.smithi061 (mon.0) 42 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem is degraded 2022-03-17T15:29:00.766 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:00.624772+0000 mon.smithi061 (mon.0) 43 : cluster [WRN] [WRN] FS_DEGRADED: 1 filesystem is degraded 2022-03-17T15:29:00.766 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:00.624784+0000 mon.smithi061 (mon.0) 44 : cluster [WRN] fs foofs is degraded 2022-03-17T15:29:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:00.603235+0000 mon.smithi067 (mon.1) 1 : cluster [INF] mon.smithi067 calling monitor election 2022-03-17T15:29:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:00.603753+0000 mon.smithi061 (mon.0) 36 : cluster [INF] mon.smithi061 calling monitor election 2022-03-17T15:29:01.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:00.617058+0000 mon.smithi061 (mon.0) 37 : cluster [INF] mon.smithi061 is new leader, mons smithi061,smithi067 in quorum (ranks 0,1) 2022-03-17T15:29:01.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:00.622050+0000 mon.smithi061 (mon.0) 38 : cluster [DBG] monmap e2: 2 mons at {smithi061=[v2:172.21.15.61:3300/0,v1:172.21.15.61:6789/0],smithi067=[v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0]} 2022-03-17T15:29:01.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:00.622124+0000 mon.smithi061 (mon.0) 39 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi067.osftcx=up:reconnect} 1 up:standby 2022-03-17T15:29:01.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:00.622154+0000 mon.smithi061 (mon.0) 40 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2022-03-17T15:29:01.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:00.622453+0000 mon.smithi061 (mon.0) 41 : cluster [DBG] mgrmap e36: smithi061.kxplwz(active, since 33s), standbys: smithi067.rdualw 2022-03-17T15:29:01.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:00.624755+0000 mon.smithi061 (mon.0) 42 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem is degraded 2022-03-17T15:29:01.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:00.624772+0000 mon.smithi061 (mon.0) 43 : cluster [WRN] [WRN] FS_DEGRADED: 1 filesystem is degraded 2022-03-17T15:29:01.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:00.624784+0000 mon.smithi061 (mon.0) 44 : cluster [WRN] fs foofs is degraded 2022-03-17T15:29:01.130 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 61 sec latency 64811.080 ms 2022-03-17T15:29:02.130 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 62 sec latency 65811.180 ms 2022-03-17T15:29:03.130 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 63 sec latency 66811.297 ms 2022-03-17T15:29:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:29:03.542+0000 7f7463108700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-03-17T15:29:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:03.493280+0000 mon.smithi061 (mon.0) 45 : cluster [INF] daemon mds.foofs.smithi067.osftcx restarted 2022-03-17T15:29:03.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:03.496945+0000 mon.smithi061 (mon.0) 46 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2022-03-17T15:29:03.816 INFO:journalctl@ceph.osd.5.smithi067.stdout:Mar 17 15:29:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.5[39690]: debug 2022-03-17T15:29:03.577+0000 7fa8ec5a3700 -1 bdev(0x55f5c1fd4800 /var/lib/ceph/osd/ceph-5/block) aio_submit retries 15 2022-03-17T15:29:03.816 INFO:journalctl@ceph.osd.6.smithi067.stdout:Mar 17 15:29:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.6[42628]: debug 2022-03-17T15:29:03.569+0000 7f1014218700 -1 bdev(0x5612384da800 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2022-03-17T15:29:03.817 INFO:journalctl@ceph.osd.7.smithi067.stdout:Mar 17 15:29:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.7[45564]: debug 2022-03-17T15:29:03.572+0000 7f71d2022700 -1 bdev(0x562e228cc800 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 14 2022-03-17T15:29:03.817 INFO:journalctl@ceph.osd.7.smithi067.stdout:Mar 17 15:29:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.7[45564]: debug 2022-03-17T15:29:03.572+0000 7f71ce81b700 -1 bdev(0x562e228cc800 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 15 2022-03-17T15:29:03.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:03.493280+0000 mon.smithi061 (mon.0) 45 : cluster [INF] daemon mds.foofs.smithi067.osftcx restarted 2022-03-17T15:29:03.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:03.496945+0000 mon.smithi061 (mon.0) 46 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2022-03-17T15:29:04.130 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 64 sec latency 67811.362 ms 2022-03-17T15:29:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:03.544104+0000 mon.smithi061 (mon.0) 47 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-03-17T15:29:04.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:03.547159+0000 mon.smithi061 (mon.0) 48 : cluster [DBG] mds.? [v2:172.21.15.67:6832/1011138242,v1:172.21.15.67:6833/1011138242] up:boot 2022-03-17T15:29:04.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:03.547234+0000 mon.smithi061 (mon.0) 49 : cluster [INF] Standby daemon mds.foofs.smithi061.atvhsa assigned to filesystem foofs as rank 0 2022-03-17T15:29:04.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:03.547358+0000 mon.smithi061 (mon.0) 50 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-03-17T15:29:04.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:03.547687+0000 mon.smithi061 (mon.0) 51 : cluster [DBG] fsmap foofs:0/1 2 up:standby, 1 failed 2022-03-17T15:29:04.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:03.551611+0000 mon.smithi061 (mon.0) 52 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi061.atvhsa=up:replay} 1 up:standby 2022-03-17T15:29:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:03.544104+0000 mon.smithi061 (mon.0) 47 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-03-17T15:29:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:03.547159+0000 mon.smithi061 (mon.0) 48 : cluster [DBG] mds.? [v2:172.21.15.67:6832/1011138242,v1:172.21.15.67:6833/1011138242] up:boot 2022-03-17T15:29:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:03.547234+0000 mon.smithi061 (mon.0) 49 : cluster [INF] Standby daemon mds.foofs.smithi061.atvhsa assigned to filesystem foofs as rank 0 2022-03-17T15:29:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:03.547358+0000 mon.smithi061 (mon.0) 50 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-03-17T15:29:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:03.547687+0000 mon.smithi061 (mon.0) 51 : cluster [DBG] fsmap foofs:0/1 2 up:standby, 1 failed 2022-03-17T15:29:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:03.551611+0000 mon.smithi061 (mon.0) 52 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi061.atvhsa=up:replay} 1 up:standby 2022-03-17T15:29:05.130 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 65 sec latency 68811.478 ms 2022-03-17T15:29:06.131 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 66 sec latency 69811.609 ms 2022-03-17T15:29:06.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:05.555470+0000 mon.smithi061 (mon.0) 53 : cluster [DBG] mds.? [v2:172.21.15.61:6834/1851308444,v1:172.21.15.61:6835/1851308444] up:reconnect 2022-03-17T15:29:06.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:05.555565+0000 mon.smithi061 (mon.0) 54 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi061.atvhsa=up:reconnect} 1 up:standby 2022-03-17T15:29:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:05.555470+0000 mon.smithi061 (mon.0) 53 : cluster [DBG] mds.? [v2:172.21.15.61:6834/1851308444,v1:172.21.15.61:6835/1851308444] up:reconnect 2022-03-17T15:29:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:05.555565+0000 mon.smithi061 (mon.0) 54 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi061.atvhsa=up:reconnect} 1 up:standby 2022-03-17T15:29:07.131 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 67 sec latency 70811.723 ms 2022-03-17T15:29:08.131 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 68 sec latency 71811.828 ms 2022-03-17T15:29:09.131 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 69 sec latency 72811.939 ms 2022-03-17T15:29:10.131 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 70 sec latency 73812.004 ms 2022-03-17T15:29:11.131 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 71 sec latency 74812.121 ms 2022-03-17T15:29:12.131 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 72 sec latency 75812.180 ms 2022-03-17T15:29:13.131 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 73 sec latency 76812.303 ms 2022-03-17T15:29:14.131 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 74 sec latency 77812.432 ms 2022-03-17T15:29:15.132 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 75 sec latency 78812.552 ms 2022-03-17T15:29:16.131 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 76 sec latency 79812.661 ms 2022-03-17T15:29:17.132 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 77 sec latency 80812.716 ms 2022-03-17T15:29:18.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:29:17.632+0000 7f7463108700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-03-17T15:29:18.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:17.581583+0000 mon.smithi061 (mon.0) 55 : cluster [INF] daemon mds.foofs.smithi061.atvhsa restarted 2022-03-17T15:29:18.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:17.587366+0000 mon.smithi061 (mon.0) 56 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2022-03-17T15:29:18.066 INFO:journalctl@ceph.osd.6.smithi067.stdout:Mar 17 15:29:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.6[42628]: debug 2022-03-17T15:29:17.653+0000 7f1019222700 -1 bdev(0x5612384da800 /var/lib/ceph/osd/ceph-6/block) aio_submit retries 1 2022-03-17T15:29:18.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:17.581583+0000 mon.smithi061 (mon.0) 55 : cluster [INF] daemon mds.foofs.smithi061.atvhsa restarted 2022-03-17T15:29:18.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:17.587366+0000 mon.smithi061 (mon.0) 56 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2022-03-17T15:29:18.067 INFO:journalctl@ceph.osd.7.smithi067.stdout:Mar 17 15:29:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.7[45564]: debug 2022-03-17T15:29:17.653+0000 7f71cd819700 -1 bdev(0x562e228cc800 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 6 2022-03-17T15:29:18.068 INFO:journalctl@ceph.osd.7.smithi067.stdout:Mar 17 15:29:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.7[45564]: debug 2022-03-17T15:29:17.653+0000 7f71ce81b700 -1 bdev(0x562e228cc800 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 7 2022-03-17T15:29:18.068 INFO:journalctl@ceph.osd.7.smithi067.stdout:Mar 17 15:29:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.7[45564]: debug 2022-03-17T15:29:17.655+0000 7f71ce01a700 -1 bdev(0x562e228cc800 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 12 2022-03-17T15:29:18.132 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 78 sec latency 81812.810 ms 2022-03-17T15:29:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:17.632397+0000 mon.smithi061 (mon.0) 57 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-03-17T15:29:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:17.635507+0000 mon.smithi061 (mon.0) 58 : cluster [DBG] mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680] up:boot 2022-03-17T15:29:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:17.635561+0000 mon.smithi061 (mon.0) 59 : cluster [INF] Standby daemon mds.foofs.smithi067.osftcx assigned to filesystem foofs as rank 0 2022-03-17T15:29:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:17.635663+0000 mon.smithi061 (mon.0) 60 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-03-17T15:29:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:17.636199+0000 mon.smithi061 (mon.0) 61 : cluster [DBG] fsmap foofs:0/1 2 up:standby, 1 failed 2022-03-17T15:29:19.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:17.639182+0000 mon.smithi061 (mon.0) 62 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi067.osftcx=up:replay} 1 up:standby 2022-03-17T15:29:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:17.632397+0000 mon.smithi061 (mon.0) 57 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-03-17T15:29:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:17.635507+0000 mon.smithi061 (mon.0) 58 : cluster [DBG] mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680] up:boot 2022-03-17T15:29:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:17.635561+0000 mon.smithi061 (mon.0) 59 : cluster [INF] Standby daemon mds.foofs.smithi067.osftcx assigned to filesystem foofs as rank 0 2022-03-17T15:29:19.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:17.635663+0000 mon.smithi061 (mon.0) 60 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-03-17T15:29:19.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:17.636199+0000 mon.smithi061 (mon.0) 61 : cluster [DBG] fsmap foofs:0/1 2 up:standby, 1 failed 2022-03-17T15:29:19.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:17.639182+0000 mon.smithi061 (mon.0) 62 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi067.osftcx=up:replay} 1 up:standby 2022-03-17T15:29:19.132 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 79 sec latency 82812.920 ms 2022-03-17T15:29:20.132 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 80 sec latency 83813.041 ms 2022-03-17T15:29:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:19.644562+0000 mon.smithi061 (mon.0) 63 : cluster [DBG] mds.? [v2:172.21.15.67:6832/1011138242,v1:172.21.15.67:6833/1011138242] up:reconnect 2022-03-17T15:29:20.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:19.644661+0000 mon.smithi061 (mon.0) 64 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi067.osftcx=up:reconnect} 1 up:standby 2022-03-17T15:29:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:19.644562+0000 mon.smithi061 (mon.0) 63 : cluster [DBG] mds.? [v2:172.21.15.67:6832/1011138242,v1:172.21.15.67:6833/1011138242] up:reconnect 2022-03-17T15:29:21.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:19.644661+0000 mon.smithi061 (mon.0) 64 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi067.osftcx=up:reconnect} 1 up:standby 2022-03-17T15:29:21.132 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 81 sec latency 84813.092 ms 2022-03-17T15:29:22.132 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 82 sec latency 85813.208 ms 2022-03-17T15:29:23.132 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 83 sec latency 86813.246 ms 2022-03-17T15:29:24.132 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 84 sec latency 87813.350 ms 2022-03-17T15:29:25.132 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 85 sec latency 88813.462 ms 2022-03-17T15:29:26.132 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 86 sec latency 89813.518 ms 2022-03-17T15:29:27.132 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 87 sec latency 90813.624 ms 2022-03-17T15:29:28.132 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 88 sec latency 91813.752 ms 2022-03-17T15:29:29.132 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 89 sec latency 92813.804 ms 2022-03-17T15:29:30.133 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 90 sec latency 93813.843 ms 2022-03-17T15:29:31.133 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 91 sec latency 94813.911 ms 2022-03-17T15:29:31.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:31.527300+0000 mon.smithi061 (mon.0) 65 : cluster [INF] daemon mds.foofs.smithi067.osftcx restarted 2022-03-17T15:29:31.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:31.533361+0000 mon.smithi061 (mon.0) 66 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2022-03-17T15:29:31.817 INFO:journalctl@ceph.osd.7.smithi067.stdout:Mar 17 15:29:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.7[45564]: debug 2022-03-17T15:29:31.606+0000 7f71d2022700 -1 bdev(0x562e228cc800 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 8 2022-03-17T15:29:31.818 INFO:journalctl@ceph.osd.7.smithi067.stdout:Mar 17 15:29:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.7[45564]: debug 2022-03-17T15:29:31.607+0000 7f71d1821700 -1 bdev(0x562e228cc800 /var/lib/ceph/osd/ceph-7/block) aio_submit retries 1 2022-03-17T15:29:32.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: debug 2022-03-17T15:29:31.576+0000 7f7463108700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-03-17T15:29:32.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:31.527300+0000 mon.smithi061 (mon.0) 65 : cluster [INF] daemon mds.foofs.smithi067.osftcx restarted 2022-03-17T15:29:32.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:31.533361+0000 mon.smithi061 (mon.0) 66 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2022-03-17T15:29:32.133 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 92 sec latency 95813.949 ms 2022-03-17T15:29:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:31.577995+0000 mon.smithi061 (mon.0) 67 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-03-17T15:29:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:31.583217+0000 mon.smithi061 (mon.0) 68 : cluster [DBG] mds.? [v2:172.21.15.67:6832/1247773404,v1:172.21.15.67:6833/1247773404] up:boot 2022-03-17T15:29:33.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:31.583281+0000 mon.smithi061 (mon.0) 69 : cluster [INF] Standby daemon mds.foofs.smithi061.atvhsa assigned to filesystem foofs as rank 0 2022-03-17T15:29:33.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:31.583419+0000 mon.smithi061 (mon.0) 70 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-03-17T15:29:33.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:31.583776+0000 mon.smithi061 (mon.0) 71 : cluster [DBG] fsmap foofs:0/1 2 up:standby, 1 failed 2022-03-17T15:29:33.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:31.588078+0000 mon.smithi061 (mon.0) 72 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi061.atvhsa=up:replay} 1 up:standby 2022-03-17T15:29:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:31.577995+0000 mon.smithi061 (mon.0) 67 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2022-03-17T15:29:33.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:31.583217+0000 mon.smithi061 (mon.0) 68 : cluster [DBG] mds.? [v2:172.21.15.67:6832/1247773404,v1:172.21.15.67:6833/1247773404] up:boot 2022-03-17T15:29:33.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:31.583281+0000 mon.smithi061 (mon.0) 69 : cluster [INF] Standby daemon mds.foofs.smithi061.atvhsa assigned to filesystem foofs as rank 0 2022-03-17T15:29:33.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:31.583419+0000 mon.smithi061 (mon.0) 70 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2022-03-17T15:29:33.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:31.583776+0000 mon.smithi061 (mon.0) 71 : cluster [DBG] fsmap foofs:0/1 2 up:standby, 1 failed 2022-03-17T15:29:33.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:31.588078+0000 mon.smithi061 (mon.0) 72 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi061.atvhsa=up:replay} 1 up:standby 2022-03-17T15:29:33.133 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 93 sec latency 96813.998 ms 2022-03-17T15:29:34.133 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 94 sec latency 97814.042 ms 2022-03-17T15:29:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:33.588535+0000 mds.foofs.smithi061.atvhsa (mds.0) 1 : cluster [DBG] reconnect by client.24553 172.21.15.61:0/3625318894 after 0.000999982 2022-03-17T15:29:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:33.588605+0000 mds.foofs.smithi061.atvhsa (mds.0) 2 : cluster [DBG] reconnect by client.14706 172.21.15.61:0/2217830410 after 0.000999982 2022-03-17T15:29:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:33.588652+0000 mds.foofs.smithi061.atvhsa (mds.0) 3 : cluster [DBG] reconnect by client.24555 172.21.15.61:0/207441986 after 0.000999982 2022-03-17T15:29:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:33.588683+0000 mds.foofs.smithi061.atvhsa (mds.0) 4 : cluster [DBG] reconnect by client.24531 172.21.15.67:0/3470380950 after 0.000999982 2022-03-17T15:29:34.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:33.589862+0000 mon.smithi061 (mon.0) 73 : cluster [DBG] mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680] up:reconnect 2022-03-17T15:29:34.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:33.589928+0000 mon.smithi061 (mon.0) 74 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi061.atvhsa=up:reconnect} 1 up:standby 2022-03-17T15:29:34.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:34.204296+0000 mon.smithi061 (mon.0) 75 : cluster [INF] Manager daemon smithi061.kxplwz is unresponsive, replacing it with standby daemon smithi067.rdualw 2022-03-17T15:29:34.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:34.208576+0000 mon.smithi061 (mon.0) 76 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2022-03-17T15:29:34.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:34.214723+0000 mon.smithi061 (mon.0) 77 : cluster [DBG] mgrmap e37: smithi067.rdualw(active, starting, since 0.010457s) 2022-03-17T15:29:34.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.219273+0000 mon.smithi067 (mon.1) 2 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mon metadata", "id": "smithi061"}]: dispatch 2022-03-17T15:29:34.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.219602+0000 mon.smithi067 (mon.1) 3 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:29:34.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.220676+0000 mon.smithi067 (mon.1) 4 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi061.atvhsa"}]: dispatch 2022-03-17T15:29:34.806 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.221037+0000 mon.smithi067 (mon.1) 5 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi067.osftcx"}]: dispatch 2022-03-17T15:29:34.806 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.221346+0000 mon.smithi067 (mon.1) 6 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mgr metadata", "who": "smithi067.rdualw", "id": "smithi067.rdualw"}]: dispatch 2022-03-17T15:29:34.806 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.221654+0000 mon.smithi067 (mon.1) 7 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:29:34.806 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.221939+0000 mon.smithi067 (mon.1) 8 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:29:34.807 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.222213+0000 mon.smithi067 (mon.1) 9 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:29:34.807 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.222496+0000 mon.smithi067 (mon.1) 10 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:29:34.807 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.222784+0000 mon.smithi067 (mon.1) 11 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:29:34.807 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.223070+0000 mon.smithi067 (mon.1) 12 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:29:34.808 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.223351+0000 mon.smithi067 (mon.1) 13 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:29:34.808 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.223654+0000 mon.smithi067 (mon.1) 14 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:29:34.808 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.224224+0000 mon.smithi067 (mon.1) 15 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-03-17T15:29:34.808 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.224639+0000 mon.smithi067 (mon.1) 16 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-03-17T15:29:34.809 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.225264+0000 mon.smithi067 (mon.1) 17 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-03-17T15:29:34.809 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:34.254603+0000 mon.smithi061 (mon.0) 78 : cluster [INF] Manager daemon smithi067.rdualw is now available 2022-03-17T15:29:34.809 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.396868+0000 mon.smithi067 (mon.1) 18 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:29:34.809 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.399526+0000 mon.smithi067 (mon.1) 19 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:29:34.809 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.400724+0000 mon.smithi067 (mon.1) 20 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:29:34.810 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.401983+0000 mon.smithi067 (mon.1) 21 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:29:34.810 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.444854+0000 mon.smithi067 (mon.1) 22 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:29:34.810 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.445331+0000 mon.smithi061 (mon.0) 79 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:29:34.810 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.453749+0000 mon.smithi067 (mon.1) 23 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:29:34.811 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:34.454117+0000 mon.smithi061 (mon.0) 80 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:29:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:33.588535+0000 mds.foofs.smithi061.atvhsa (mds.0) 1 : cluster [DBG] reconnect by client.24553 172.21.15.61:0/3625318894 after 0.000999982 2022-03-17T15:29:34.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:33.588605+0000 mds.foofs.smithi061.atvhsa (mds.0) 2 : cluster [DBG] reconnect by client.14706 172.21.15.61:0/2217830410 after 0.000999982 2022-03-17T15:29:34.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:33.588652+0000 mds.foofs.smithi061.atvhsa (mds.0) 3 : cluster [DBG] reconnect by client.24555 172.21.15.61:0/207441986 after 0.000999982 2022-03-17T15:29:34.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:33.588683+0000 mds.foofs.smithi061.atvhsa (mds.0) 4 : cluster [DBG] reconnect by client.24531 172.21.15.67:0/3470380950 after 0.000999982 2022-03-17T15:29:34.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:33.589862+0000 mon.smithi061 (mon.0) 73 : cluster [DBG] mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680] up:reconnect 2022-03-17T15:29:34.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:33.589928+0000 mon.smithi061 (mon.0) 74 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi061.atvhsa=up:reconnect} 1 up:standby 2022-03-17T15:29:34.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:34.204296+0000 mon.smithi061 (mon.0) 75 : cluster [INF] Manager daemon smithi061.kxplwz is unresponsive, replacing it with standby daemon smithi067.rdualw 2022-03-17T15:29:34.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:34.208576+0000 mon.smithi061 (mon.0) 76 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2022-03-17T15:29:34.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:34.214723+0000 mon.smithi061 (mon.0) 77 : cluster [DBG] mgrmap e37: smithi067.rdualw(active, starting, since 0.010457s) 2022-03-17T15:29:34.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.219273+0000 mon.smithi067 (mon.1) 2 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mon metadata", "id": "smithi061"}]: dispatch 2022-03-17T15:29:34.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.219602+0000 mon.smithi067 (mon.1) 3 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mon metadata", "id": "smithi067"}]: dispatch 2022-03-17T15:29:34.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.220676+0000 mon.smithi067 (mon.1) 4 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi061.atvhsa"}]: dispatch 2022-03-17T15:29:34.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.221037+0000 mon.smithi067 (mon.1) 5 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mds metadata", "who": "foofs.smithi067.osftcx"}]: dispatch 2022-03-17T15:29:34.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.221346+0000 mon.smithi067 (mon.1) 6 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mgr metadata", "who": "smithi067.rdualw", "id": "smithi067.rdualw"}]: dispatch 2022-03-17T15:29:34.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.221654+0000 mon.smithi067 (mon.1) 7 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:29:34.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.221939+0000 mon.smithi067 (mon.1) 8 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2022-03-17T15:29:34.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.222213+0000 mon.smithi067 (mon.1) 9 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2022-03-17T15:29:34.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.222496+0000 mon.smithi067 (mon.1) 10 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2022-03-17T15:29:34.821 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.222784+0000 mon.smithi067 (mon.1) 11 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2022-03-17T15:29:34.821 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.223070+0000 mon.smithi067 (mon.1) 12 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2022-03-17T15:29:34.821 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.223351+0000 mon.smithi067 (mon.1) 13 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2022-03-17T15:29:34.821 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.223654+0000 mon.smithi067 (mon.1) 14 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2022-03-17T15:29:34.821 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.224224+0000 mon.smithi067 (mon.1) 15 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mds metadata"}]: dispatch 2022-03-17T15:29:34.822 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.224639+0000 mon.smithi067 (mon.1) 16 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata"}]: dispatch 2022-03-17T15:29:34.822 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.225264+0000 mon.smithi067 (mon.1) 17 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "mon metadata"}]: dispatch 2022-03-17T15:29:34.822 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:34.254603+0000 mon.smithi061 (mon.0) 78 : cluster [INF] Manager daemon smithi067.rdualw is now available 2022-03-17T15:29:34.822 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.396868+0000 mon.smithi067 (mon.1) 18 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:29:34.822 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.399526+0000 mon.smithi067 (mon.1) 19 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:29:34.823 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.400724+0000 mon.smithi067 (mon.1) 20 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:29:34.823 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.401983+0000 mon.smithi067 (mon.1) 21 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:29:34.823 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.444854+0000 mon.smithi067 (mon.1) 22 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:29:34.823 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.445331+0000 mon.smithi061 (mon.0) 79 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:29:34.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.453749+0000 mon.smithi067 (mon.1) 23 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:29:34.824 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:34.454117+0000 mon.smithi061 (mon.0) 80 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:29:35.133 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 95 sec latency 98814.083 ms 2022-03-17T15:29:35.245 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:29:35.543 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:29:35.544 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (7m) 38s ago 8m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:29:35.544 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (8m) 38s ago 8m 7033k - 16.2.4 8d91d370c2b8 35aa99cfae95 2022-03-17T15:29:35.544 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (7m) 50s ago 7m 7142k - 16.2.4 8d91d370c2b8 056e5956721e 2022-03-17T15:29:35.544 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6m) 38s ago 8m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:29:35.545 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3m) 38s ago 3m 40.0M - 16.2.4 8d91d370c2b8 fc2d986f2f76 2022-03-17T15:29:35.545 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3m) 50s ago 3m 14.2M - 16.2.4 8d91d370c2b8 7e2d207c71fd 2022-03-17T15:29:35.545 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (77s) 38s ago 9m 430M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:29:35.545 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (56s) 50s ago 7m 43.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:29:35.546 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (46s) 38s ago 9m 37.5M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:29:35.546 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (7m) 50s ago 7m 98.9M 2048M 16.2.4 8d91d370c2b8 6ba46ec348ed 2022-03-17T15:29:35.546 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (93s) 38s ago 92s 56.3M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:29:35.546 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (88s) 50s ago 87s 58.3M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:29:35.547 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (7m) 38s ago 7m 18.2M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:29:35.547 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (7m) 50s ago 7m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:29:35.547 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (7m) 38s ago 7m 1210M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:29:35.547 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6m) 38s ago 6m 1060M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:29:35.548 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6m) 38s ago 6m 613M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:29:35.548 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6m) 38s ago 6m 1138M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:29:35.548 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5m) 50s ago 5m 1126M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:29:35.548 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5m) 50s ago 5m 1358M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:29:35.549 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5m) 50s ago 5m 1038M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:29:35.549 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5m) 50s ago 5m 1814M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:29:35.549 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6m) 38s ago 7m 47.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:29:35.897 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:29:35.897 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:29:35.898 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:29:35.898 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:29:35.898 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:29:35.898 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:29:35.899 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:29:35.899 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:29:35.899 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 8 2022-03-17T15:29:35.900 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:29:35.900 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:29:35.900 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:29:35.900 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:29:35.901 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:29:35.901 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 10, 2022-03-17T15:29:35.901 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:29:35.901 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:29:35.902 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:29:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:29:34.407720+0000 mgr.smithi067.rdualw (mgr.24569) 1 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:29:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:35.217260+0000 mon.smithi061 (mon.0) 81 : cluster [DBG] mgrmap e38: smithi067.rdualw(active, since 1.01298s) 2022-03-17T15:29:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:29:34.407720+0000 mgr.smithi067.rdualw (mgr.24569) 1 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:29:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:35.217260+0000 mon.smithi061 (mon.0) 81 : cluster [DBG] mgrmap e38: smithi067.rdualw(active, since 1.01298s) 2022-03-17T15:29:36.133 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 96 sec latency 99814.118 ms 2022-03-17T15:29:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:35.228962+0000 mgr.smithi067.rdualw (mgr.24569) 2 : audit [DBG] from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:29:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:35.232202+0000 mgr.smithi067.rdualw (mgr.24569) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:29:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:35.524773+0000 mgr.smithi067.rdualw (mgr.24569) 4 : audit [DBG] from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:29:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:35.894873+0000 mon.smithi061 (mon.0) 82 : audit [DBG] from='client.? 172.21.15.61:0/2682475708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:29:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:35.228962+0000 mgr.smithi067.rdualw (mgr.24569) 2 : audit [DBG] from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:29:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:35.232202+0000 mgr.smithi067.rdualw (mgr.24569) 3 : cluster [DBG] pgmap v3: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:29:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:35.524773+0000 mgr.smithi067.rdualw (mgr.24569) 4 : audit [DBG] from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:29:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:35.894873+0000 mon.smithi061 (mon.0) 82 : audit [DBG] from='client.? 172.21.15.61:0/2682475708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:29:37.133 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 97 sec latency 100814.159 ms 2022-03-17T15:29:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:36.224512+0000 mgr.smithi067.rdualw (mgr.24569) 5 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:29:38.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:36.224512+0000 mgr.smithi067.rdualw (mgr.24569) 5 : cluster [DBG] pgmap v4: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:29:38.133 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 98 sec latency 101814.259 ms 2022-03-17T15:29:39.133 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 99 sec latency 102814.300 ms 2022-03-17T15:29:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:38.224862+0000 mgr.smithi067.rdualw (mgr.24569) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:29:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:39.564912+0000 mon.smithi061 (mon.0) 83 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:38.224862+0000 mgr.smithi067.rdualw (mgr.24569) 6 : cluster [DBG] pgmap v5: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:29:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:39.564912+0000 mon.smithi061 (mon.0) 83 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:40.133 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 100 sec latency 103814.329 ms 2022-03-17T15:29:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:39.969824+0000 mon.smithi067 (mon.1) 24 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:29:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:39.970253+0000 mon.smithi061 (mon.0) 84 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:29:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:39.969824+0000 mon.smithi067 (mon.1) 24 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:29:41.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:39.970253+0000 mon.smithi061 (mon.0) 84 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:29:41.133 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 101 sec latency 104814.442 ms 2022-03-17T15:29:42.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:40.225497+0000 mgr.smithi067.rdualw (mgr.24569) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:29:42.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:40.225497+0000 mgr.smithi067.rdualw (mgr.24569) 7 : cluster [DBG] pgmap v6: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:29:42.133 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 102 sec latency 105814.496 ms 2022-03-17T15:29:43.133 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 103 sec latency 106814.586 ms 2022-03-17T15:29:43.489 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:42.143096+0000 mon.smithi061 (mon.0) 85 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:43.489 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:42.226307+0000 mgr.smithi067.rdualw (mgr.24569) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:29:43.489 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:42.540577+0000 mon.smithi067 (mon.1) 25 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:29:43.490 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:42.541084+0000 mon.smithi061 (mon.0) 86 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:29:43.490 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:42.545604+0000 mon.smithi061 (mon.0) 87 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:43.490 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:42.553003+0000 mon.smithi061 (mon.0) 88 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:43.490 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:42.557767+0000 mon.smithi067 (mon.1) 26 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:29:43.491 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:42.560718+0000 mon.smithi067 (mon.1) 27 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:29:43.491 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:42.561875+0000 mon.smithi067 (mon.1) 28 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:29:43.491 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:29:42.562659+0000 mgr.smithi067.rdualw (mgr.24569) 9 : cephadm [INF] Upgrade: Setting container_image for all mon 2022-03-17T15:29:43.491 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:42.566079+0000 mon.smithi061 (mon.0) 89 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:43.491 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:42.567430+0000 mon.smithi067 (mon.1) 29 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi061"}]: dispatch 2022-03-17T15:29:43.492 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:42.567968+0000 mon.smithi061 (mon.0) 90 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi061"}]: dispatch 2022-03-17T15:29:43.492 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:42.570802+0000 mon.smithi061 (mon.0) 91 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi061"}]': finished 2022-03-17T15:29:43.492 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:42.571815+0000 mon.smithi067 (mon.1) 30 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi067"}]: dispatch 2022-03-17T15:29:43.492 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:42.572090+0000 mon.smithi061 (mon.0) 92 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi067"}]: dispatch 2022-03-17T15:29:43.493 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:42.574592+0000 mon.smithi061 (mon.0) 93 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi067"}]': finished 2022-03-17T15:29:43.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:42.143096+0000 mon.smithi061 (mon.0) 85 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:43.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:42.226307+0000 mgr.smithi067.rdualw (mgr.24569) 8 : cluster [DBG] pgmap v7: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:29:43.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:42.540577+0000 mon.smithi067 (mon.1) 25 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:29:43.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:42.541084+0000 mon.smithi061 (mon.0) 86 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:29:43.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:42.545604+0000 mon.smithi061 (mon.0) 87 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:43.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:42.553003+0000 mon.smithi061 (mon.0) 88 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:43.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:42.557767+0000 mon.smithi067 (mon.1) 26 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:29:43.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:42.560718+0000 mon.smithi067 (mon.1) 27 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:29:43.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:42.561875+0000 mon.smithi067 (mon.1) 28 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:29:43.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:29:42.562659+0000 mgr.smithi067.rdualw (mgr.24569) 9 : cephadm [INF] Upgrade: Setting container_image for all mon 2022-03-17T15:29:43.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:42.566079+0000 mon.smithi061 (mon.0) 89 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:43.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:42.567430+0000 mon.smithi067 (mon.1) 29 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi061"}]: dispatch 2022-03-17T15:29:43.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:42.567968+0000 mon.smithi061 (mon.0) 90 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi061"}]: dispatch 2022-03-17T15:29:43.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:42.570802+0000 mon.smithi061 (mon.0) 91 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi061"}]': finished 2022-03-17T15:29:43.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:42.571815+0000 mon.smithi067 (mon.1) 30 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi067"}]: dispatch 2022-03-17T15:29:43.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:42.572090+0000 mon.smithi061 (mon.0) 92 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi067"}]: dispatch 2022-03-17T15:29:43.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:42.574592+0000 mon.smithi061 (mon.0) 93 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi067"}]': finished 2022-03-17T15:29:44.133 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 104 sec latency 107814.666 ms 2022-03-17T15:29:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:29:43.876380+0000 mgr.smithi067.rdualw (mgr.24569) 10 : cephadm [INF] Upgrade: Updating crash.smithi061 2022-03-17T15:29:45.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:43.880972+0000 mon.smithi061 (mon.0) 94 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:45.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:43.882867+0000 mon.smithi067 (mon.1) 31 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi061", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-03-17T15:29:45.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:43.883224+0000 mon.smithi061 (mon.0) 95 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi061", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-03-17T15:29:45.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:43.884343+0000 mon.smithi067 (mon.1) 32 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:29:45.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:29:43.885152+0000 mgr.smithi067.rdualw (mgr.24569) 11 : cephadm [INF] Deploying daemon crash.smithi061 on smithi061 2022-03-17T15:29:45.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:44.226919+0000 mgr.smithi067.rdualw (mgr.24569) 12 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:29:45.134 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 105 sec latency 108814.694 ms 2022-03-17T15:29:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:29:43.876380+0000 mgr.smithi067.rdualw (mgr.24569) 10 : cephadm [INF] Upgrade: Updating crash.smithi061 2022-03-17T15:29:45.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:43.880972+0000 mon.smithi061 (mon.0) 94 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:45.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:43.882867+0000 mon.smithi067 (mon.1) 31 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi061", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-03-17T15:29:45.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:43.883224+0000 mon.smithi061 (mon.0) 95 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi061", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-03-17T15:29:45.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:43.884343+0000 mon.smithi067 (mon.1) 32 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:29:45.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:29:43.885152+0000 mgr.smithi067.rdualw (mgr.24569) 11 : cephadm [INF] Deploying daemon crash.smithi061 on smithi061 2022-03-17T15:29:45.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:44.226919+0000 mgr.smithi067.rdualw (mgr.24569) 12 : cluster [DBG] pgmap v8: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail 2022-03-17T15:29:46.134 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 106 sec latency 109814.785 ms 2022-03-17T15:29:47.134 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 107 sec latency 110815.116 ms 2022-03-17T15:29:47.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:46.227839+0000 mgr.smithi067.rdualw (mgr.24569) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 186 B/s rd, 0 op/s 2022-03-17T15:29:47.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:46.369492+0000 mon.smithi061 (mon.0) 96 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:47.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:46.371408+0000 mon.smithi067 (mon.1) 33 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:29:47.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:46.372696+0000 mon.smithi067 (mon.1) 34 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:29:47.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:46.373594+0000 mon.smithi067 (mon.1) 35 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:29:47.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:29:46.374424+0000 mgr.smithi067.rdualw (mgr.24569) 14 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:29:47.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:46.724832+0000 mgr.smithi067.rdualw (mgr.24569) 15 : audit [DBG] from='client.34140 -' entity='client.crash.smithi061' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:29:47.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:46.730925+0000 mon.smithi061 (mon.0) 97 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:47.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:46.732696+0000 mgr.smithi067.rdualw (mgr.24569) 16 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 194 B/s rd, 0 op/s 2022-03-17T15:29:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:46.227839+0000 mgr.smithi067.rdualw (mgr.24569) 13 : cluster [DBG] pgmap v9: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 186 B/s rd, 0 op/s 2022-03-17T15:29:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:46.369492+0000 mon.smithi061 (mon.0) 96 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:47.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:46.371408+0000 mon.smithi067 (mon.1) 33 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:29:47.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:46.372696+0000 mon.smithi067 (mon.1) 34 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:29:47.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:46.373594+0000 mon.smithi067 (mon.1) 35 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:29:47.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:29:46.374424+0000 mgr.smithi067.rdualw (mgr.24569) 14 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:29:47.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:46.724832+0000 mgr.smithi067.rdualw (mgr.24569) 15 : audit [DBG] from='client.34140 -' entity='client.crash.smithi061' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:29:47.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:46.730925+0000 mon.smithi061 (mon.0) 97 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:47.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:46.732696+0000 mgr.smithi067.rdualw (mgr.24569) 16 : cluster [DBG] pgmap v10: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 194 B/s rd, 0 op/s 2022-03-17T15:29:48.134 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 108 sec latency 111815.189 ms 2022-03-17T15:29:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:47.729537+0000 mon.smithi061 (mon.0) 98 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH) 2022-03-17T15:29:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:47.729537+0000 mon.smithi061 (mon.0) 98 : cluster [WRN] Health check failed: 1 daemons have recently crashed (RECENT_CRASH) 2022-03-17T15:29:49.134 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 109 sec latency 112815.242 ms 2022-03-17T15:29:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:48.733178+0000 mgr.smithi067.rdualw (mgr.24569) 17 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 194 B/s rd, 0 op/s 2022-03-17T15:29:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:48.733178+0000 mgr.smithi067.rdualw (mgr.24569) 17 : cluster [DBG] pgmap v11: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 194 B/s rd, 0 op/s 2022-03-17T15:29:50.134 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 110 sec latency 113815.331 ms 2022-03-17T15:29:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:49.425141+0000 mon.smithi061 (mon.0) 99 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:49.425141+0000 mon.smithi061 (mon.0) 99 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:51.134 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 111 sec latency 114815.415 ms 2022-03-17T15:29:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:50.734120+0000 mgr.smithi067.rdualw (mgr.24569) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 194 B/s rd, 0 op/s 2022-03-17T15:29:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:50.734120+0000 mgr.smithi067.rdualw (mgr.24569) 18 : cluster [DBG] pgmap v12: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 194 B/s rd, 0 op/s 2022-03-17T15:29:52.134 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 112 sec latency 115815.518 ms 2022-03-17T15:29:53.134 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 113 sec latency 116815.563 ms 2022-03-17T15:29:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:52.734817+0000 mgr.smithi067.rdualw (mgr.24569) 19 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 194 B/s rd, 0 op/s 2022-03-17T15:29:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:53.749536+0000 mon.smithi061 (mon.0) 100 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:54.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:53.754458+0000 mon.smithi061 (mon.0) 101 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:54.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:53.763771+0000 mon.smithi061 (mon.0) 102 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:54.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:53.768562+0000 mon.smithi067 (mon.1) 36 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:29:54.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:53.771477+0000 mon.smithi067 (mon.1) 37 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:29:54.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:53.772651+0000 mon.smithi067 (mon.1) 38 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:29:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:52.734817+0000 mgr.smithi067.rdualw (mgr.24569) 19 : cluster [DBG] pgmap v13: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 194 B/s rd, 0 op/s 2022-03-17T15:29:54.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:53.749536+0000 mon.smithi061 (mon.0) 100 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:54.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:53.754458+0000 mon.smithi061 (mon.0) 101 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:54.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:53.763771+0000 mon.smithi061 (mon.0) 102 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:54.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:53.768562+0000 mon.smithi067 (mon.1) 36 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:29:54.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:53.771477+0000 mon.smithi067 (mon.1) 37 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:29:54.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:53.772651+0000 mon.smithi067 (mon.1) 38 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:29:54.134 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 114 sec latency 117815.637 ms 2022-03-17T15:29:55.135 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 115 sec latency 118815.731 ms 2022-03-17T15:29:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:54.735149+0000 mgr.smithi067.rdualw (mgr.24569) 20 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 194 B/s rd, 0 op/s 2022-03-17T15:29:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:55.085060+0000 mon.smithi061 (mon.0) 103 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:55.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:55.085941+0000 mon.smithi067 (mon.1) 39 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-03-17T15:29:55.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:55.086369+0000 mon.smithi061 (mon.0) 104 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-03-17T15:29:55.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:55.087241+0000 mon.smithi067 (mon.1) 40 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:29:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:54.735149+0000 mgr.smithi067.rdualw (mgr.24569) 20 : cluster [DBG] pgmap v14: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 194 B/s rd, 0 op/s 2022-03-17T15:29:55.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:55.085060+0000 mon.smithi061 (mon.0) 103 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:55.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:55.085941+0000 mon.smithi067 (mon.1) 39 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-03-17T15:29:55.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:55.086369+0000 mon.smithi061 (mon.0) 104 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi067", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2022-03-17T15:29:55.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:55.087241+0000 mon.smithi067 (mon.1) 40 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:29:56.135 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 116 sec latency 119815.854 ms 2022-03-17T15:29:56.504 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:29:55.080086+0000 mgr.smithi067.rdualw (mgr.24569) 21 : cephadm [INF] Upgrade: Updating crash.smithi067 2022-03-17T15:29:56.504 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:29:55.087821+0000 mgr.smithi067.rdualw (mgr.24569) 22 : cephadm [INF] Deploying daemon crash.smithi067 on smithi067 2022-03-17T15:29:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:29:55.080086+0000 mgr.smithi067.rdualw (mgr.24569) 21 : cephadm [INF] Upgrade: Updating crash.smithi067 2022-03-17T15:29:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:29:55.087821+0000 mgr.smithi067.rdualw (mgr.24569) 22 : cephadm [INF] Deploying daemon crash.smithi067 on smithi067 2022-03-17T15:29:57.135 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 117 sec latency 120815.965 ms 2022-03-17T15:29:57.255 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:56.735974+0000 mgr.smithi067.rdualw (mgr.24569) 23 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 194 B/s rd, 0 op/s 2022-03-17T15:29:57.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:56.735974+0000 mgr.smithi067.rdualw (mgr.24569) 23 : cluster [DBG] pgmap v15: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 194 B/s rd, 0 op/s 2022-03-17T15:29:58.135 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 118 sec latency 121816.077 ms 2022-03-17T15:29:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:57.352226+0000 mon.smithi061 (mon.0) 105 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:58.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:57.353429+0000 mon.smithi067 (mon.1) 41 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:29:58.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:57.354405+0000 mon.smithi067 (mon.1) 42 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:29:58.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:57.355019+0000 mon.smithi067 (mon.1) 43 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:29:58.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:29:57.355617+0000 mgr.smithi067.rdualw (mgr.24569) 24 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:29:58.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:57.700910+0000 mgr.smithi067.rdualw (mgr.24569) 25 : audit [DBG] from='client.44137 -' entity='client.crash.smithi067' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:29:58.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:57.705651+0000 mon.smithi061 (mon.0) 106 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:58.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:57.708876+0000 mgr.smithi067.rdualw (mgr.24569) 26 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 186 B/s rd, 0 op/s 2022-03-17T15:29:58.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:58.161919+0000 mon.smithi061 (mon.0) 107 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:57.352226+0000 mon.smithi061 (mon.0) 105 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:57.353429+0000 mon.smithi067 (mon.1) 41 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:29:58.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:57.354405+0000 mon.smithi067 (mon.1) 42 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:29:58.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:57.355019+0000 mon.smithi067 (mon.1) 43 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:29:58.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:29:57.355617+0000 mgr.smithi067.rdualw (mgr.24569) 24 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:29:58.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:57.700910+0000 mgr.smithi067.rdualw (mgr.24569) 25 : audit [DBG] from='client.44137 -' entity='client.crash.smithi067' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:29:58.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:57.705651+0000 mon.smithi061 (mon.0) 106 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:58.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:57.708876+0000 mgr.smithi067.rdualw (mgr.24569) 26 : cluster [DBG] pgmap v16: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 186 B/s rd, 0 op/s 2022-03-17T15:29:58.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:58.161919+0000 mon.smithi061 (mon.0) 107 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:29:59.135 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 119 sec latency 122816.183 ms 2022-03-17T15:29:59.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:29:58.158284+0000 mgr.smithi067.rdualw (mgr.24569) 27 : audit [DBG] from='client.44141 -' entity='client.crash.smithi067' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:29:59.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:58.165008+0000 mgr.smithi067.rdualw (mgr.24569) 28 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 217 B/s rd, 0 op/s 2022-03-17T15:29:59.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:29:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:29:58.704005+0000 mon.smithi061 (mon.0) 108 : cluster [WRN] Health check update: 3 daemons have recently crashed (RECENT_CRASH) 2022-03-17T15:29:59.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:29:58.158284+0000 mgr.smithi067.rdualw (mgr.24569) 27 : audit [DBG] from='client.44141 -' entity='client.crash.smithi067' cmd=[{"prefix": "crash post", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:29:59.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:58.165008+0000 mgr.smithi067.rdualw (mgr.24569) 28 : cluster [DBG] pgmap v17: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 217 B/s rd, 0 op/s 2022-03-17T15:29:59.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:29:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:29:58.704005+0000 mon.smithi061 (mon.0) 108 : cluster [WRN] Health check update: 3 daemons have recently crashed (RECENT_CRASH) 2022-03-17T15:30:00.135 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 120 sec latency 123816.282 ms 2022-03-17T15:30:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:00.000197+0000 mon.smithi061 (mon.0) 109 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem is degraded; 3 daemons have recently crashed 2022-03-17T15:30:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:00.000308+0000 mon.smithi061 (mon.0) 110 : cluster [WRN] [WRN] FS_DEGRADED: 1 filesystem is degraded 2022-03-17T15:30:00.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:00.000389+0000 mon.smithi061 (mon.0) 111 : cluster [WRN] fs foofs is degraded 2022-03-17T15:30:00.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:00.000407+0000 mon.smithi061 (mon.0) 112 : cluster [WRN] [WRN] RECENT_CRASH: 3 daemons have recently crashed 2022-03-17T15:30:00.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:00.000427+0000 mon.smithi061 (mon.0) 113 : cluster [WRN] mds.foofs.smithi061.atvhsa crashed on host smithi061 at 2022-03-17T15:29:06.488220Z 2022-03-17T15:30:00.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:00.000445+0000 mon.smithi061 (mon.0) 114 : cluster [WRN] mds.foofs.smithi067.osftcx crashed on host smithi067 at 2022-03-17T15:28:52.485939Z 2022-03-17T15:30:00.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:00.000464+0000 mon.smithi061 (mon.0) 115 : cluster [WRN] mds.foofs.smithi067.osftcx crashed on host smithi067 at 2022-03-17T15:29:20.491125Z 2022-03-17T15:30:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:00.000197+0000 mon.smithi061 (mon.0) 109 : cluster [WRN] Health detail: HEALTH_WARN 1 filesystem is degraded; 3 daemons have recently crashed 2022-03-17T15:30:00.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:00.000308+0000 mon.smithi061 (mon.0) 110 : cluster [WRN] [WRN] FS_DEGRADED: 1 filesystem is degraded 2022-03-17T15:30:00.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:00.000389+0000 mon.smithi061 (mon.0) 111 : cluster [WRN] fs foofs is degraded 2022-03-17T15:30:00.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:00.000407+0000 mon.smithi061 (mon.0) 112 : cluster [WRN] [WRN] RECENT_CRASH: 3 daemons have recently crashed 2022-03-17T15:30:00.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:00.000427+0000 mon.smithi061 (mon.0) 113 : cluster [WRN] mds.foofs.smithi061.atvhsa crashed on host smithi061 at 2022-03-17T15:29:06.488220Z 2022-03-17T15:30:00.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:00.000445+0000 mon.smithi061 (mon.0) 114 : cluster [WRN] mds.foofs.smithi067.osftcx crashed on host smithi067 at 2022-03-17T15:28:52.485939Z 2022-03-17T15:30:00.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:00.000464+0000 mon.smithi061 (mon.0) 115 : cluster [WRN] mds.foofs.smithi067.osftcx crashed on host smithi067 at 2022-03-17T15:29:20.491125Z 2022-03-17T15:30:01.136 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 121 sec latency 124816.376 ms 2022-03-17T15:30:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:00.165634+0000 mgr.smithi067.rdualw (mgr.24569) 29 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 217 B/s rd, 0 op/s 2022-03-17T15:30:01.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:00.165634+0000 mgr.smithi067.rdualw (mgr.24569) 29 : cluster [DBG] pgmap v18: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 217 B/s rd, 0 op/s 2022-03-17T15:30:02.135 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 122 sec latency 125816.427 ms 2022-03-17T15:30:03.135 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 123 sec latency 126816.501 ms 2022-03-17T15:30:03.442 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:02.067483+0000 mon.smithi061 (mon.0) 116 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:30:03.442 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:02.071708+0000 mon.smithi061 (mon.0) 117 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:30:03.442 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:02.079444+0000 mon.smithi061 (mon.0) 118 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:30:03.443 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:02.082903+0000 mon.smithi067 (mon.1) 44 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:30:03.443 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:02.085207+0000 mon.smithi067 (mon.1) 45 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:30:03.443 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:02.086077+0000 mon.smithi067 (mon.1) 46 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:30:03.444 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:02.086913+0000 mon.smithi067 (mon.1) 47 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:30:03.444 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:30:02.087483+0000 mgr.smithi067.rdualw (mgr.24569) 30 : cephadm [INF] Upgrade: Setting container_image for all crash 2022-03-17T15:30:03.444 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:02.091278+0000 mon.smithi061 (mon.0) 119 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:30:03.444 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:02.092054+0000 mon.smithi067 (mon.1) 48 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi061"}]: dispatch 2022-03-17T15:30:03.444 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:02.092337+0000 mon.smithi061 (mon.0) 120 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi061"}]: dispatch 2022-03-17T15:30:03.445 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:02.095138+0000 mon.smithi061 (mon.0) 121 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi061"}]': finished 2022-03-17T15:30:03.445 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:02.095871+0000 mon.smithi067 (mon.1) 49 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi067"}]: dispatch 2022-03-17T15:30:03.445 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:02.096156+0000 mon.smithi061 (mon.0) 122 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi067"}]: dispatch 2022-03-17T15:30:03.445 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:02.098998+0000 mon.smithi061 (mon.0) 123 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi067"}]': finished 2022-03-17T15:30:03.446 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:02.100084+0000 mon.smithi067 (mon.1) 50 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2022-03-17T15:30:03.446 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:02.100224+0000 mgr.smithi067.rdualw (mgr.24569) 31 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2022-03-17T15:30:03.446 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:30:02.101045+0000 mgr.smithi067.rdualw (mgr.24569) 32 : cephadm [INF] Upgrade: osd.0 is safe to restart 2022-03-17T15:30:03.446 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:02.166300+0000 mgr.smithi067.rdualw (mgr.24569) 33 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 217 B/s rd, 0 op/s 2022-03-17T15:30:03.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:02.067483+0000 mon.smithi061 (mon.0) 116 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:30:03.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:02.071708+0000 mon.smithi061 (mon.0) 117 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:30:03.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:02.079444+0000 mon.smithi061 (mon.0) 118 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:30:03.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:02.082903+0000 mon.smithi067 (mon.1) 44 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:30:03.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:02.085207+0000 mon.smithi067 (mon.1) 45 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:30:03.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:02.086077+0000 mon.smithi067 (mon.1) 46 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:30:03.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:02.086913+0000 mon.smithi067 (mon.1) 47 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:30:03.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:30:02.087483+0000 mgr.smithi067.rdualw (mgr.24569) 30 : cephadm [INF] Upgrade: Setting container_image for all crash 2022-03-17T15:30:03.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:02.091278+0000 mon.smithi061 (mon.0) 119 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:30:03.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:02.092054+0000 mon.smithi067 (mon.1) 48 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi061"}]: dispatch 2022-03-17T15:30:03.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:02.092337+0000 mon.smithi061 (mon.0) 120 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi061"}]: dispatch 2022-03-17T15:30:03.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:02.095138+0000 mon.smithi061 (mon.0) 121 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi061"}]': finished 2022-03-17T15:30:03.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:02.095871+0000 mon.smithi067 (mon.1) 49 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi067"}]: dispatch 2022-03-17T15:30:03.572 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:02.096156+0000 mon.smithi061 (mon.0) 122 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi067"}]: dispatch 2022-03-17T15:30:03.572 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:02.098998+0000 mon.smithi061 (mon.0) 123 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi067"}]': finished 2022-03-17T15:30:03.572 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:02.100084+0000 mon.smithi067 (mon.1) 50 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2022-03-17T15:30:03.573 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:02.100224+0000 mgr.smithi067.rdualw (mgr.24569) 31 : audit [DBG] from='mon.1 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2022-03-17T15:30:03.573 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:30:02.101045+0000 mgr.smithi067.rdualw (mgr.24569) 32 : cephadm [INF] Upgrade: osd.0 is safe to restart 2022-03-17T15:30:03.573 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:02.166300+0000 mgr.smithi067.rdualw (mgr.24569) 33 : cluster [DBG] pgmap v19: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 217 B/s rd, 0 op/s 2022-03-17T15:30:04.135 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 124 sec latency 127816.585 ms 2022-03-17T15:30:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:30:03.512943+0000 mgr.smithi067.rdualw (mgr.24569) 34 : cephadm [INF] Upgrade: Updating osd.0 2022-03-17T15:30:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:03.519408+0000 mon.smithi061 (mon.0) 124 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:30:04.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:30:03.521489+0000 mgr.smithi067.rdualw (mgr.24569) 35 : cephadm [INF] Deploying daemon osd.0 on smithi061 2022-03-17T15:30:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:30:03.512943+0000 mgr.smithi067.rdualw (mgr.24569) 34 : cephadm [INF] Upgrade: Updating osd.0 2022-03-17T15:30:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:03.519408+0000 mon.smithi061 (mon.0) 124 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:30:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:30:03.521489+0000 mgr.smithi067.rdualw (mgr.24569) 35 : cephadm [INF] Deploying daemon osd.0 on smithi061 2022-03-17T15:30:05.136 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 125 sec latency 128816.653 ms 2022-03-17T15:30:05.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:04.166729+0000 mgr.smithi067.rdualw (mgr.24569) 36 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 217 B/s rd, 0 op/s 2022-03-17T15:30:05.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:04.166729+0000 mgr.smithi067.rdualw (mgr.24569) 36 : cluster [DBG] pgmap v20: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 217 B/s rd, 0 op/s 2022-03-17T15:30:06.136 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 126 sec latency 129816.683 ms 2022-03-17T15:30:06.166 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:30:05 smithi061 systemd[1]: Stopping Ceph osd.0 for ae1b9b88-a605-11ec-8c35-001a4aab830c... 2022-03-17T15:30:06.166 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:30:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.0[41623]: debug 2022-03-17T15:30:05.911+0000 7fafc85a8700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2022-03-17T15:30:06.166 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:30:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.0[41623]: debug 2022-03-17T15:30:05.911+0000 7fafc85a8700 -1 osd.0 72 *** Got signal Terminated *** 2022-03-17T15:30:06.167 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:30:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.0[41623]: debug 2022-03-17T15:30:05.911+0000 7fafc85a8700 -1 osd.0 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2022-03-17T15:30:06.219 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:30:06.456 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:30:06 smithi061 bash[78374]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.0 2022-03-17T15:30:06.456 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:30:06 smithi061 bash[78444]: Error: no container with name or ID "ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd-0" found: no such container 2022-03-17T15:30:06.556 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:30:06.557 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (7m) 12s ago 8m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:30:06.557 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (20s) 12s ago 8m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:30:06.557 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (9s) 4s ago 8m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:30:06.557 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (7m) 12s ago 8m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:30:06.558 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (49s) 12s ago 4m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:30:06.558 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (35s) 4s ago 4m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:30:06.558 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (108s) 12s ago 9m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:30:06.558 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (87s) 4s ago 8m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:30:06.559 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (77s) 12s ago 9m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:30:06.559 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (66s) 4s ago 8m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:30:06.559 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2m) 12s ago 2m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:30:06.559 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (119s) 4s ago 118s 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:30:06.559 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (8m) 12s ago 8m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:30:06.560 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (7m) 4s ago 7m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:30:06.560 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (7m) 12s ago 7m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:30:06.560 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (7m) 12s ago 7m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:30:06.560 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (7m) 12s ago 7m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:30:06.561 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6m) 12s ago 6m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:30:06.561 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6m) 4s ago 6m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:30:06.561 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6m) 4s ago 6m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:30:06.561 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5m) 4s ago 5m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:30:06.561 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5m) 4s ago 5m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:30:06.562 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (7m) 12s ago 8m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:30:06.802 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:30:06 smithi061 bash[78476]: Error: no container with name or ID "ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd.0" found: no such container 2022-03-17T15:30:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.185645+0000 mon.smithi061 (mon.0) 125 : cluster [DBG] osd.0 reported immediately failed by osd.3 2022-03-17T15:30:06.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.185687+0000 mon.smithi061 (mon.0) 126 : cluster [INF] osd.0 failed (root=default,host=smithi061) (connection refused reported by osd.3) 2022-03-17T15:30:06.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.185928+0000 mon.smithi061 (mon.0) 127 : cluster [DBG] osd.0 reported immediately failed by osd.1 2022-03-17T15:30:06.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.186072+0000 mon.smithi061 (mon.0) 128 : cluster [DBG] osd.0 reported immediately failed by osd.4 2022-03-17T15:30:06.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.186207+0000 mon.smithi061 (mon.0) 129 : cluster [DBG] osd.0 reported immediately failed by osd.7 2022-03-17T15:30:06.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.186365+0000 mon.smithi061 (mon.0) 130 : cluster [DBG] osd.0 reported immediately failed by osd.2 2022-03-17T15:30:06.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.186504+0000 mon.smithi061 (mon.0) 131 : cluster [DBG] osd.0 reported immediately failed by osd.6 2022-03-17T15:30:06.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.186639+0000 mon.smithi061 (mon.0) 132 : cluster [DBG] osd.0 reported immediately failed by osd.5 2022-03-17T15:30:06.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.186774+0000 mon.smithi061 (mon.0) 133 : cluster [DBG] osd.0 reported immediately failed by osd.3 2022-03-17T15:30:06.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.186908+0000 mon.smithi061 (mon.0) 134 : cluster [DBG] osd.0 reported immediately failed by osd.1 2022-03-17T15:30:06.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.187042+0000 mon.smithi061 (mon.0) 135 : cluster [DBG] osd.0 reported immediately failed by osd.4 2022-03-17T15:30:06.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.187177+0000 mon.smithi061 (mon.0) 136 : cluster [DBG] osd.0 reported immediately failed by osd.7 2022-03-17T15:30:06.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.187325+0000 mon.smithi061 (mon.0) 137 : cluster [DBG] osd.0 reported immediately failed by osd.2 2022-03-17T15:30:06.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.187457+0000 mon.smithi061 (mon.0) 138 : cluster [DBG] osd.0 reported immediately failed by osd.6 2022-03-17T15:30:06.806 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.187597+0000 mon.smithi061 (mon.0) 139 : cluster [DBG] osd.0 reported immediately failed by osd.5 2022-03-17T15:30:06.806 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.351870+0000 mon.smithi061 (mon.0) 140 : cluster [DBG] osd.0 reported immediately failed by osd.7 2022-03-17T15:30:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.185645+0000 mon.smithi061 (mon.0) 125 : cluster [DBG] osd.0 reported immediately failed by osd.3 2022-03-17T15:30:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.185687+0000 mon.smithi061 (mon.0) 126 : cluster [INF] osd.0 failed (root=default,host=smithi061) (connection refused reported by osd.3) 2022-03-17T15:30:06.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.185928+0000 mon.smithi061 (mon.0) 127 : cluster [DBG] osd.0 reported immediately failed by osd.1 2022-03-17T15:30:06.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.186072+0000 mon.smithi061 (mon.0) 128 : cluster [DBG] osd.0 reported immediately failed by osd.4 2022-03-17T15:30:06.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.186207+0000 mon.smithi061 (mon.0) 129 : cluster [DBG] osd.0 reported immediately failed by osd.7 2022-03-17T15:30:06.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.186365+0000 mon.smithi061 (mon.0) 130 : cluster [DBG] osd.0 reported immediately failed by osd.2 2022-03-17T15:30:06.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.186504+0000 mon.smithi061 (mon.0) 131 : cluster [DBG] osd.0 reported immediately failed by osd.6 2022-03-17T15:30:06.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.186639+0000 mon.smithi061 (mon.0) 132 : cluster [DBG] osd.0 reported immediately failed by osd.5 2022-03-17T15:30:06.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.186774+0000 mon.smithi061 (mon.0) 133 : cluster [DBG] osd.0 reported immediately failed by osd.3 2022-03-17T15:30:06.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.186908+0000 mon.smithi061 (mon.0) 134 : cluster [DBG] osd.0 reported immediately failed by osd.1 2022-03-17T15:30:06.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.187042+0000 mon.smithi061 (mon.0) 135 : cluster [DBG] osd.0 reported immediately failed by osd.4 2022-03-17T15:30:06.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.187177+0000 mon.smithi061 (mon.0) 136 : cluster [DBG] osd.0 reported immediately failed by osd.7 2022-03-17T15:30:06.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.187325+0000 mon.smithi061 (mon.0) 137 : cluster [DBG] osd.0 reported immediately failed by osd.2 2022-03-17T15:30:06.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.187457+0000 mon.smithi061 (mon.0) 138 : cluster [DBG] osd.0 reported immediately failed by osd.6 2022-03-17T15:30:06.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.187597+0000 mon.smithi061 (mon.0) 139 : cluster [DBG] osd.0 reported immediately failed by osd.5 2022-03-17T15:30:06.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.351870+0000 mon.smithi061 (mon.0) 140 : cluster [DBG] osd.0 reported immediately failed by osd.7 2022-03-17T15:30:06.917 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:30:06.917 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:30:06.918 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:30:06.918 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:30:06.918 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:30:06.919 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:30:06.919 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:30:06.919 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:30:06.919 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:30:06.920 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:30:06.920 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:30:06.920 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:30:06.920 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:30:06.920 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:30:06.921 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:30:06.921 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:30:06.921 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:30:06.921 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:30:07.136 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 127 sec latency 130817.079 ms 2022-03-17T15:30:07.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.167527+0000 mgr.smithi067.rdualw (mgr.24569) 37 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 217 B/s rd, 0 op/s 2022-03-17T15:30:07.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:06.203852+0000 mgr.smithi067.rdualw (mgr.24569) 38 : audit [DBG] from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:30:07.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:06.528584+0000 mgr.smithi067.rdualw (mgr.24569) 39 : audit [DBG] from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:30:07.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.528912+0000 mon.smithi061 (mon.0) 141 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2022-03-17T15:30:07.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:06.537455+0000 mon.smithi061 (mon.0) 142 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2022-03-17T15:30:07.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:06.556754+0000 mon.smithi067 (mon.1) 51 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-03-17T15:30:07.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:06.557400+0000 mon.smithi061 (mon.0) 143 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-03-17T15:30:07.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:06.558412+0000 mon.smithi067 (mon.1) 52 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-03-17T15:30:07.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:06.558745+0000 mon.smithi061 (mon.0) 144 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-03-17T15:30:07.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:06.914966+0000 mon.smithi061 (mon.0) 145 : audit [DBG] from='client.? 172.21.15.61:0/2889624413' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:30:07.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.167527+0000 mgr.smithi067.rdualw (mgr.24569) 37 : cluster [DBG] pgmap v21: 129 pgs: 129 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 217 B/s rd, 0 op/s 2022-03-17T15:30:07.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:06.203852+0000 mgr.smithi067.rdualw (mgr.24569) 38 : audit [DBG] from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:30:07.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:06.528584+0000 mgr.smithi067.rdualw (mgr.24569) 39 : audit [DBG] from='client.34154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:30:07.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.528912+0000 mon.smithi061 (mon.0) 141 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2022-03-17T15:30:07.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:06.537455+0000 mon.smithi061 (mon.0) 142 : cluster [DBG] osdmap e73: 8 total, 7 up, 8 in 2022-03-17T15:30:07.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:06.556754+0000 mon.smithi067 (mon.1) 51 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-03-17T15:30:07.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:06.557400+0000 mon.smithi061 (mon.0) 143 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2022-03-17T15:30:07.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:06.558412+0000 mon.smithi067 (mon.1) 52 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-03-17T15:30:07.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:06.558745+0000 mon.smithi061 (mon.0) 144 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2022-03-17T15:30:07.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:06.914966+0000 mon.smithi061 (mon.0) 145 : audit [DBG] from='client.? 172.21.15.61:0/2889624413' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:30:08.052 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:30:07 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Succeeded. 2022-03-17T15:30:08.053 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:30:07 smithi061 systemd[1]: Stopped Ceph osd.0 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:30:08.053 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:30:07 smithi061 systemd[1]: Starting Ceph osd.0 for ae1b9b88-a605-11ec-8c35-001a4aab830c... 2022-03-17T15:30:08.136 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 128 sec latency 131817.129 ms 2022-03-17T15:30:08.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:07.539950+0000 mon.smithi061 (mon.0) 146 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2022-03-17T15:30:08.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:07.540056+0000 mon.smithi061 (mon.0) 147 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2022-03-17T15:30:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:07.539950+0000 mon.smithi061 (mon.0) 146 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2022-03-17T15:30:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:07.540056+0000 mon.smithi061 (mon.0) 147 : cluster [DBG] osdmap e74: 8 total, 7 up, 8 in 2022-03-17T15:30:09.136 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 129 sec latency 132817.258 ms 2022-03-17T15:30:09.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:08.168108+0000 mgr.smithi067.rdualw (mgr.24569) 40 : cluster [DBG] pgmap v24: 129 pgs: 16 stale+active+clean, 113 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T15:30:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:08.168108+0000 mgr.smithi067.rdualw (mgr.24569) 40 : cluster [DBG] pgmap v24: 129 pgs: 16 stale+active+clean, 113 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T15:30:10.138 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 130 sec latency 133817.370 ms 2022-03-17T15:30:11.136 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 131 sec latency 134817.491 ms 2022-03-17T15:30:11.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:10.168746+0000 mgr.smithi067.rdualw (mgr.24569) 41 : cluster [DBG] pgmap v25: 129 pgs: 16 stale+active+clean, 113 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T15:30:11.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:10.168746+0000 mgr.smithi067.rdualw (mgr.24569) 41 : cluster [DBG] pgmap v25: 129 pgs: 16 stale+active+clean, 113 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T15:30:12.136 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 132 sec latency 135817.612 ms 2022-03-17T15:30:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:12.548070+0000 mon.smithi061 (mon.0) 148 : cluster [WRN] Health check failed: Degraded data redundancy: 202/1479 objects degraded (13.658%), 28 pgs degraded (PG_DEGRADED) 2022-03-17T15:30:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:12.548070+0000 mon.smithi061 (mon.0) 148 : cluster [WRN] Health check failed: Degraded data redundancy: 202/1479 objects degraded (13.658%), 28 pgs degraded (PG_DEGRADED) 2022-03-17T15:30:13.136 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 133 sec latency 136817.715 ms 2022-03-17T15:30:14.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:12.169710+0000 mgr.smithi067.rdualw (mgr.24569) 42 : cluster [DBG] pgmap v26: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 202/1479 objects degraded (13.658%) 2022-03-17T15:30:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:12.169710+0000 mgr.smithi067.rdualw (mgr.24569) 42 : cluster [DBG] pgmap v26: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 202/1479 objects degraded (13.658%) 2022-03-17T15:30:14.137 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 134 sec latency 137817.830 ms 2022-03-17T15:30:15.137 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 135 sec latency 138817.919 ms 2022-03-17T15:30:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:14.170293+0000 mgr.smithi067.rdualw (mgr.24569) 43 : cluster [DBG] pgmap v27: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 202/1479 objects degraded (13.658%) 2022-03-17T15:30:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:14.170293+0000 mgr.smithi067.rdualw (mgr.24569) 43 : cluster [DBG] pgmap v27: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 202/1479 objects degraded (13.658%) 2022-03-17T15:30:16.137 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 136 sec latency 139818.045 ms 2022-03-17T15:30:17.137 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 137 sec latency 140818.146 ms 2022-03-17T15:30:18.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:16.171452+0000 mgr.smithi067.rdualw (mgr.24569) 44 : cluster [DBG] pgmap v28: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 202/1479 objects degraded (13.658%) 2022-03-17T15:30:18.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:16.171452+0000 mgr.smithi067.rdualw (mgr.24569) 44 : cluster [DBG] pgmap v28: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 202/1479 objects degraded (13.658%) 2022-03-17T15:30:18.137 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 138 sec latency 141818.266 ms 2022-03-17T15:30:19.137 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 139 sec latency 142818.394 ms 2022-03-17T15:30:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:18.172015+0000 mgr.smithi067.rdualw (mgr.24569) 45 : cluster [DBG] pgmap v29: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 202/1479 objects degraded (13.658%) 2022-03-17T15:30:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:19.426992+0000 mon.smithi061 (mon.0) 149 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:30:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:18.172015+0000 mgr.smithi067.rdualw (mgr.24569) 45 : cluster [DBG] pgmap v29: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 202/1479 objects degraded (13.658%) 2022-03-17T15:30:20.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:19.426992+0000 mon.smithi061 (mon.0) 149 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:30:20.137 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 140 sec latency 143818.514 ms 2022-03-17T15:30:21.137 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 141 sec latency 144818.620 ms 2022-03-17T15:30:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:20.172795+0000 mgr.smithi067.rdualw (mgr.24569) 46 : cluster [DBG] pgmap v30: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 202/1479 objects degraded (13.658%) 2022-03-17T15:30:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:20.172795+0000 mgr.smithi067.rdualw (mgr.24569) 46 : cluster [DBG] pgmap v30: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 202/1479 objects degraded (13.658%) 2022-03-17T15:30:22.137 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 142 sec latency 145818.733 ms 2022-03-17T15:30:23.138 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 143 sec latency 146818.839 ms 2022-03-17T15:30:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:22.173685+0000 mgr.smithi067.rdualw (mgr.24569) 47 : cluster [DBG] pgmap v31: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 202/1479 objects degraded (13.658%) 2022-03-17T15:30:24.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:22.623879+0000 mon.smithi061 (mon.0) 150 : cluster [DBG] mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680] up:rejoin 2022-03-17T15:30:24.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:22.623976+0000 mon.smithi061 (mon.0) 151 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi061.atvhsa=up:rejoin} 1 up:standby 2022-03-17T15:30:24.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:22.173685+0000 mgr.smithi067.rdualw (mgr.24569) 47 : cluster [DBG] pgmap v31: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 202/1479 objects degraded (13.658%) 2022-03-17T15:30:24.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:22.623879+0000 mon.smithi061 (mon.0) 150 : cluster [DBG] mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680] up:rejoin 2022-03-17T15:30:24.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:22.623976+0000 mon.smithi061 (mon.0) 151 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi061.atvhsa=up:rejoin} 1 up:standby 2022-03-17T15:30:24.138 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 144 sec latency 147818.913 ms 2022-03-17T15:30:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:23.631654+0000 mon.smithi061 (mon.0) 152 : cluster [DBG] mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680] up:clientreplay 2022-03-17T15:30:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:23.631735+0000 mon.smithi061 (mon.0) 153 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi061.atvhsa=up:clientreplay} 1 up:standby 2022-03-17T15:30:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:23.631654+0000 mon.smithi061 (mon.0) 152 : cluster [DBG] mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680] up:clientreplay 2022-03-17T15:30:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:23.631735+0000 mon.smithi061 (mon.0) 153 : cluster [DBG] fsmap foofs:1/1 {0=foofs.smithi061.atvhsa=up:clientreplay} 1 up:standby 2022-03-17T15:30:25.138 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 145 sec latency 148818.984 ms 2022-03-17T15:30:26.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:24.174249+0000 mgr.smithi067.rdualw (mgr.24569) 48 : cluster [DBG] pgmap v32: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 202/1479 objects degraded (13.658%) 2022-03-17T15:30:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:24.174249+0000 mgr.smithi067.rdualw (mgr.24569) 48 : cluster [DBG] pgmap v32: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 202/1479 objects degraded (13.658%) 2022-03-17T15:30:26.138 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 146 sec latency 149819.110 ms 2022-03-17T15:30:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:26.636859+0000 mon.smithi061 (mon.0) 154 : cluster [WRN] Health check update: Degraded data redundancy: 188/1377 objects degraded (13.653%), 28 pgs degraded (PG_DEGRADED) 2022-03-17T15:30:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:26.636859+0000 mon.smithi061 (mon.0) 154 : cluster [WRN] Health check update: Degraded data redundancy: 188/1377 objects degraded (13.653%), 28 pgs degraded (PG_DEGRADED) 2022-03-17T15:30:27.138 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 147 sec latency 150819.220 ms 2022-03-17T15:30:28.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:26.175344+0000 mgr.smithi067.rdualw (mgr.24569) 49 : cluster [DBG] pgmap v33: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 38 KiB/s rd, 853 B/s wr, 24 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:28.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:26.175344+0000 mgr.smithi067.rdualw (mgr.24569) 49 : cluster [DBG] pgmap v33: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 38 KiB/s rd, 853 B/s wr, 24 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:28.138 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 148 sec latency 151819.320 ms 2022-03-17T15:30:29.138 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 149 sec latency 152819.445 ms 2022-03-17T15:30:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:28.176017+0000 mgr.smithi067.rdualw (mgr.24569) 50 : cluster [DBG] pgmap v34: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 37 KiB/s rd, 852 B/s wr, 24 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:28.176017+0000 mgr.smithi067.rdualw (mgr.24569) 50 : cluster [DBG] pgmap v34: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 37 KiB/s rd, 852 B/s wr, 24 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:30.138 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 150 sec latency 153819.556 ms 2022-03-17T15:30:31.138 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 151 sec latency 154819.640 ms 2022-03-17T15:30:32.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:30.176788+0000 mgr.smithi067.rdualw (mgr.24569) 51 : cluster [DBG] pgmap v35: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 37 KiB/s rd, 853 B/s wr, 24 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:32.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:30.176788+0000 mgr.smithi067.rdualw (mgr.24569) 51 : cluster [DBG] pgmap v35: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 37 KiB/s rd, 853 B/s wr, 24 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:32.139 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 152 sec latency 155819.759 ms 2022-03-17T15:30:33.139 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 153 sec latency 156819.821 ms 2022-03-17T15:30:34.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:32.177813+0000 mgr.smithi067.rdualw (mgr.24569) 52 : cluster [DBG] pgmap v36: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 37 KiB/s rd, 18 KiB/s wr, 27 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:34.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:32.177813+0000 mgr.smithi067.rdualw (mgr.24569) 52 : cluster [DBG] pgmap v36: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 37 KiB/s rd, 18 KiB/s wr, 27 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:34.139 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 154 sec latency 157819.954 ms 2022-03-17T15:30:35.139 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 155 sec latency 158820.077 ms 2022-03-17T15:30:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:34.178549+0000 mgr.smithi067.rdualw (mgr.24569) 53 : cluster [DBG] pgmap v37: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 37 KiB/s rd, 18 KiB/s wr, 27 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:34.452389+0000 mon.smithi067 (mon.1) 53 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:30:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:34.453047+0000 mon.smithi061 (mon.0) 155 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:30:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:34.457369+0000 mon.smithi067 (mon.1) 54 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:30:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:34.457740+0000 mon.smithi061 (mon.0) 156 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:30:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:34.178549+0000 mgr.smithi067.rdualw (mgr.24569) 53 : cluster [DBG] pgmap v37: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 37 KiB/s rd, 18 KiB/s wr, 27 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:34.452389+0000 mon.smithi067 (mon.1) 53 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:30:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:34.453047+0000 mon.smithi061 (mon.0) 155 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:30:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:34.457369+0000 mon.smithi067 (mon.1) 54 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:30:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:34.457740+0000 mon.smithi061 (mon.0) 156 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:30:36.139 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 156 sec latency 159820.182 ms 2022-03-17T15:30:37.139 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 157 sec latency 160820.230 ms 2022-03-17T15:30:37.242 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:30:37.533 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:30:37.533 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (8m) 43s ago 9m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:30:37.534 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (51s) 43s ago 9m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:30:37.534 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (40s) 35s ago 8m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:30:37.534 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (8m) 43s ago 9m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:30:37.534 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (80s) 43s ago 4m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:30:37.534 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (66s) 35s ago 4m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:30:37.535 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2m) 43s ago 10m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:30:37.535 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (118s) 35s ago 8m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:30:37.535 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (108s) 43s ago 10m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:30:37.535 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (97s) 35s ago 8m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:30:37.536 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2m) 43s ago 2m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:30:37.536 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2m) 35s ago 2m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:30:37.536 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (9m) 43s ago 8m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:30:37.537 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (8m) 35s ago 8m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:30:37.537 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (8m) 43s ago 8m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:30:37.538 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (7m) 43s ago 7m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:30:37.538 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (7m) 43s ago 7m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:30:37.538 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (7m) 43s ago 7m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:30:37.539 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (7m) 35s ago 7m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:30:37.539 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6m) 35s ago 6m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:30:37.539 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6m) 35s ago 6m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:30:37.539 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6m) 35s ago 6m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:30:37.540 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (7m) 43s ago 8m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:30:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:36.179731+0000 mgr.smithi067.rdualw (mgr.24569) 54 : cluster [DBG] pgmap v38: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 38 KiB/s rd, 22 KiB/s wr, 28 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:36.179731+0000 mgr.smithi067.rdualw (mgr.24569) 54 : cluster [DBG] pgmap v38: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 38 KiB/s rd, 22 KiB/s wr, 28 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:37.875 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:30:37.875 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:30:37.876 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:30:37.876 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:30:37.876 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:30:37.876 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:30:37.877 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:30:37.877 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:30:37.877 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:30:37.877 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:30:37.878 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:30:37.878 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:30:37.878 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:30:37.878 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:30:37.879 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:30:37.879 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:30:37.879 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:30:37.879 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:30:38.139 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 158 sec latency 161820.311 ms 2022-03-17T15:30:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:37.226357+0000 mgr.smithi067.rdualw (mgr.24569) 55 : audit [DBG] from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:30:38.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:37.515361+0000 mgr.smithi067.rdualw (mgr.24569) 56 : audit [DBG] from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:30:38.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:30:37.873212+0000 mon.smithi061 (mon.0) 157 : audit [DBG] from='client.? 172.21.15.61:0/3624985037' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:30:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:37.226357+0000 mgr.smithi067.rdualw (mgr.24569) 55 : audit [DBG] from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:30:38.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:37.515361+0000 mgr.smithi067.rdualw (mgr.24569) 56 : audit [DBG] from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:30:38.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:30:37.873212+0000 mon.smithi061 (mon.0) 157 : audit [DBG] from='client.? 172.21.15.61:0/3624985037' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:30:39.139 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 159 sec latency 162820.404 ms 2022-03-17T15:30:39.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:38.180297+0000 mgr.smithi067.rdualw (mgr.24569) 57 : cluster [DBG] pgmap v39: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 21 KiB/s wr, 3 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:39.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:38.180297+0000 mgr.smithi067.rdualw (mgr.24569) 57 : cluster [DBG] pgmap v39: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 21 KiB/s wr, 3 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:40.139 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 160 sec latency 163820.514 ms 2022-03-17T15:30:41.139 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 161 sec latency 164820.571 ms 2022-03-17T15:30:41.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:40.181065+0000 mgr.smithi067.rdualw (mgr.24569) 58 : cluster [DBG] pgmap v40: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 21 KiB/s wr, 3 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:40.181065+0000 mgr.smithi067.rdualw (mgr.24569) 58 : cluster [DBG] pgmap v40: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 21 KiB/s wr, 3 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:42.140 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 162 sec latency 165820.662 ms 2022-03-17T15:30:43.140 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 163 sec latency 166820.835 ms 2022-03-17T15:30:43.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:42.182045+0000 mgr.smithi067.rdualw (mgr.24569) 59 : cluster [DBG] pgmap v41: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 22 KiB/s wr, 3 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:43.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:42.182045+0000 mgr.smithi067.rdualw (mgr.24569) 59 : cluster [DBG] pgmap v41: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 22 KiB/s wr, 3 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:44.140 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 164 sec latency 167820.982 ms 2022-03-17T15:30:45.140 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 165 sec latency 168821.131 ms 2022-03-17T15:30:45.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:44.182729+0000 mgr.smithi067.rdualw (mgr.24569) 60 : cluster [DBG] pgmap v42: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 5.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:45.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:44.182729+0000 mgr.smithi067.rdualw (mgr.24569) 60 : cluster [DBG] pgmap v42: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 5.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:46.140 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 166 sec latency 169821.235 ms 2022-03-17T15:30:47.140 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 167 sec latency 170821.365 ms 2022-03-17T15:30:47.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:46.183705+0000 mgr.smithi067.rdualw (mgr.24569) 61 : cluster [DBG] pgmap v43: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 5.2 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:47.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:46.183705+0000 mgr.smithi067.rdualw (mgr.24569) 61 : cluster [DBG] pgmap v43: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 5.2 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:48.140 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 168 sec latency 171821.486 ms 2022-03-17T15:30:49.140 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 169 sec latency 172821.620 ms 2022-03-17T15:30:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:48.184331+0000 mgr.smithi067.rdualw (mgr.24569) 62 : cluster [DBG] pgmap v44: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:49.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:48.184331+0000 mgr.smithi067.rdualw (mgr.24569) 62 : cluster [DBG] pgmap v44: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:50.141 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 170 sec latency 173821.736 ms 2022-03-17T15:30:51.141 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 171 sec latency 174821.877 ms 2022-03-17T15:30:51.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:50.184889+0000 mgr.smithi067.rdualw (mgr.24569) 63 : cluster [DBG] pgmap v45: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:51.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:50.184889+0000 mgr.smithi067.rdualw (mgr.24569) 63 : cluster [DBG] pgmap v45: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:52.141 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 172 sec latency 175821.982 ms 2022-03-17T15:30:53.141 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 173 sec latency 176822.055 ms 2022-03-17T15:30:53.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:52.186003+0000 mgr.smithi067.rdualw (mgr.24569) 64 : cluster [DBG] pgmap v46: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:53.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:52.186003+0000 mgr.smithi067.rdualw (mgr.24569) 64 : cluster [DBG] pgmap v46: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:54.141 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 174 sec latency 177822.192 ms 2022-03-17T15:30:55.141 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 175 sec latency 178822.255 ms 2022-03-17T15:30:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:54.186591+0000 mgr.smithi067.rdualw (mgr.24569) 65 : cluster [DBG] pgmap v47: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:54.186591+0000 mgr.smithi067.rdualw (mgr.24569) 65 : cluster [DBG] pgmap v47: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:56.141 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 176 sec latency 179822.340 ms 2022-03-17T15:30:57.141 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 177 sec latency 180822.432 ms 2022-03-17T15:30:57.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:56.187499+0000 mgr.smithi067.rdualw (mgr.24569) 66 : cluster [DBG] pgmap v48: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:57.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:56.187499+0000 mgr.smithi067.rdualw (mgr.24569) 66 : cluster [DBG] pgmap v48: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:58.141 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 178 sec latency 181822.544 ms 2022-03-17T15:30:59.141 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 179 sec latency 182822.675 ms 2022-03-17T15:30:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:30:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:30:58.188144+0000 mgr.smithi067.rdualw (mgr.24569) 67 : cluster [DBG] pgmap v49: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:30:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:30:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:30:58.188144+0000 mgr.smithi067.rdualw (mgr.24569) 67 : cluster [DBG] pgmap v49: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:00.141 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 180 sec latency 183822.774 ms 2022-03-17T15:31:01.142 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 181 sec latency 184822.853 ms 2022-03-17T15:31:01.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:00.188723+0000 mgr.smithi067.rdualw (mgr.24569) 68 : cluster [DBG] pgmap v50: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:01.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:00.188723+0000 mgr.smithi067.rdualw (mgr.24569) 68 : cluster [DBG] pgmap v50: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:02.142 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 182 sec latency 185822.951 ms 2022-03-17T15:31:03.142 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 183 sec latency 186823.036 ms 2022-03-17T15:31:03.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:02.189657+0000 mgr.smithi067.rdualw (mgr.24569) 69 : cluster [DBG] pgmap v51: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:03.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:02.189657+0000 mgr.smithi067.rdualw (mgr.24569) 69 : cluster [DBG] pgmap v51: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:04.142 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 184 sec latency 187823.145 ms 2022-03-17T15:31:05.142 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 185 sec latency 188823.275 ms 2022-03-17T15:31:05.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:04.190259+0000 mgr.smithi067.rdualw (mgr.24569) 70 : cluster [DBG] pgmap v52: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:05.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:04.190259+0000 mgr.smithi067.rdualw (mgr.24569) 70 : cluster [DBG] pgmap v52: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:06.142 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 186 sec latency 189823.407 ms 2022-03-17T15:31:07.142 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 187 sec latency 190823.520 ms 2022-03-17T15:31:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:06.191249+0000 mgr.smithi067.rdualw (mgr.24569) 71 : cluster [DBG] pgmap v53: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:06.191249+0000 mgr.smithi067.rdualw (mgr.24569) 71 : cluster [DBG] pgmap v53: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:08.142 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 188 sec latency 191823.564 ms 2022-03-17T15:31:08.196 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:31:08.486 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:31:08.486 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (8m) 74s ago 9m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:31:08.487 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (82s) 74s ago 9m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:31:08.487 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (71s) 66s ago 9m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:31:08.487 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (8m) 74s ago 9m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:31:08.487 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (111s) 74s ago 5m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:31:08.488 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (97s) 66s ago 5m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:31:08.488 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2m) 74s ago 10m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:31:08.488 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2m) 66s ago 9m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:31:08.488 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2m) 74s ago 11m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:31:08.489 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2m) 66s ago 9m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:31:08.489 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3m) 74s ago 3m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:31:08.489 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3m) 66s ago 3m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:31:08.489 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (9m) 74s ago 9m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:31:08.489 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (8m) 66s ago 8m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:31:08.490 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (8m) 74s ago 8m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:31:08.490 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (8m) 74s ago 8m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:31:08.490 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (8m) 74s ago 8m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:31:08.490 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (7m) 74s ago 7m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:31:08.491 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (7m) 66s ago 7m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:31:08.491 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (7m) 66s ago 7m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:31:08.491 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (7m) 66s ago 7m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:31:08.491 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6m) 66s ago 6m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:31:08.492 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (8m) 74s ago 9m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:31:08.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:08.274047+0000 mon.smithi061 (mon.0) 158 : cluster [WRN] Health check update: Degraded data redundancy: 188/1377 objects degraded (13.653%), 28 pgs degraded, 49 pgs undersized (PG_DEGRADED) 2022-03-17T15:31:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:08.274047+0000 mon.smithi061 (mon.0) 158 : cluster [WRN] Health check update: Degraded data redundancy: 188/1377 objects degraded (13.653%), 28 pgs degraded, 49 pgs undersized (PG_DEGRADED) 2022-03-17T15:31:08.827 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:31:08.827 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:31:08.828 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:31:08.828 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:31:08.828 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:31:08.828 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:31:08.829 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:31:08.829 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:31:08.829 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:31:08.829 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:31:08.829 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:31:08.830 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:31:08.830 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:31:08.830 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:31:08.831 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:31:08.831 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:31:08.831 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:31:08.831 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:31:09.142 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 189 sec latency 192823.660 ms 2022-03-17T15:31:09.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:31:08.181041+0000 mgr.smithi067.rdualw (mgr.24569) 72 : audit [DBG] from='client.34174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:31:09.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:08.192149+0000 mgr.smithi067.rdualw (mgr.24569) 73 : cluster [DBG] pgmap v54: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:09.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:31:08.468235+0000 mgr.smithi067.rdualw (mgr.24569) 74 : audit [DBG] from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:31:09.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:31:08.825683+0000 mon.smithi061 (mon.0) 159 : audit [DBG] from='client.? 172.21.15.61:0/239224635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:31:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:31:08.181041+0000 mgr.smithi067.rdualw (mgr.24569) 72 : audit [DBG] from='client.34174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:31:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:08.192149+0000 mgr.smithi067.rdualw (mgr.24569) 73 : cluster [DBG] pgmap v54: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:09.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:31:08.468235+0000 mgr.smithi067.rdualw (mgr.24569) 74 : audit [DBG] from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:31:09.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:31:08.825683+0000 mon.smithi061 (mon.0) 159 : audit [DBG] from='client.? 172.21.15.61:0/239224635' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:31:10.142 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 190 sec latency 193823.736 ms 2022-03-17T15:31:11.143 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 191 sec latency 194823.829 ms 2022-03-17T15:31:11.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:10.192858+0000 mgr.smithi067.rdualw (mgr.24569) 75 : cluster [DBG] pgmap v55: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:11.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:10.192858+0000 mgr.smithi067.rdualw (mgr.24569) 75 : cluster [DBG] pgmap v55: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:12.143 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 192 sec latency 195823.950 ms 2022-03-17T15:31:13.143 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 193 sec latency 196824.084 ms 2022-03-17T15:31:13.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:12.193972+0000 mgr.smithi067.rdualw (mgr.24569) 76 : cluster [DBG] pgmap v56: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:13.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:12.193972+0000 mgr.smithi067.rdualw (mgr.24569) 76 : cluster [DBG] pgmap v56: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:14.143 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 194 sec latency 197824.226 ms 2022-03-17T15:31:15.143 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 195 sec latency 198824.339 ms 2022-03-17T15:31:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:14.194863+0000 mgr.smithi067.rdualw (mgr.24569) 77 : cluster [DBG] pgmap v57: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:15.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:14.194863+0000 mgr.smithi067.rdualw (mgr.24569) 77 : cluster [DBG] pgmap v57: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:16.143 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 196 sec latency 199824.472 ms 2022-03-17T15:31:17.143 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 197 sec latency 200824.602 ms 2022-03-17T15:31:17.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:16.196075+0000 mgr.smithi067.rdualw (mgr.24569) 78 : cluster [DBG] pgmap v58: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:17.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:16.196075+0000 mgr.smithi067.rdualw (mgr.24569) 78 : cluster [DBG] pgmap v58: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:18.143 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 198 sec latency 201824.655 ms 2022-03-17T15:31:19.144 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 199 sec latency 202824.774 ms 2022-03-17T15:31:19.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:18.196849+0000 mgr.smithi067.rdualw (mgr.24569) 79 : cluster [DBG] pgmap v59: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:19.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:18.196849+0000 mgr.smithi067.rdualw (mgr.24569) 79 : cluster [DBG] pgmap v59: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:20.143 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 200 sec latency 203824.868 ms 2022-03-17T15:31:21.144 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 201 sec latency 204824.907 ms 2022-03-17T15:31:21.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:20.197766+0000 mgr.smithi067.rdualw (mgr.24569) 80 : cluster [DBG] pgmap v60: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:20.197766+0000 mgr.smithi067.rdualw (mgr.24569) 80 : cluster [DBG] pgmap v60: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:22.144 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 202 sec latency 205824.978 ms 2022-03-17T15:31:23.144 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 203 sec latency 206825.088 ms 2022-03-17T15:31:23.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:22.198970+0000 mgr.smithi067.rdualw (mgr.24569) 81 : cluster [DBG] pgmap v61: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:23.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:22.198970+0000 mgr.smithi067.rdualw (mgr.24569) 81 : cluster [DBG] pgmap v61: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:24.144 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 204 sec latency 207825.191 ms 2022-03-17T15:31:25.144 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 205 sec latency 208825.309 ms 2022-03-17T15:31:25.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:24.199764+0000 mgr.smithi067.rdualw (mgr.24569) 82 : cluster [DBG] pgmap v62: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:25.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:24.199764+0000 mgr.smithi067.rdualw (mgr.24569) 82 : cluster [DBG] pgmap v62: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:26.144 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 206 sec latency 209825.424 ms 2022-03-17T15:31:27.144 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 207 sec latency 210825.481 ms 2022-03-17T15:31:27.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:26.200860+0000 mgr.smithi067.rdualw (mgr.24569) 83 : cluster [DBG] pgmap v63: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:27.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:26.200860+0000 mgr.smithi067.rdualw (mgr.24569) 83 : cluster [DBG] pgmap v63: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:28.144 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 208 sec latency 211825.580 ms 2022-03-17T15:31:29.144 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 209 sec latency 212825.656 ms 2022-03-17T15:31:29.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:28.201655+0000 mgr.smithi067.rdualw (mgr.24569) 84 : cluster [DBG] pgmap v64: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:29.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:28.201655+0000 mgr.smithi067.rdualw (mgr.24569) 84 : cluster [DBG] pgmap v64: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:30.144 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 210 sec latency 213825.751 ms 2022-03-17T15:31:31.145 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 211 sec latency 214825.840 ms 2022-03-17T15:31:31.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:30.202561+0000 mgr.smithi067.rdualw (mgr.24569) 85 : cluster [DBG] pgmap v65: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:31.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:30.202561+0000 mgr.smithi067.rdualw (mgr.24569) 85 : cluster [DBG] pgmap v65: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:32.145 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 212 sec latency 215825.978 ms 2022-03-17T15:31:33.145 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 213 sec latency 216826.046 ms 2022-03-17T15:31:33.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:32.203673+0000 mgr.smithi067.rdualw (mgr.24569) 86 : cluster [DBG] pgmap v66: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:33.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:32.203673+0000 mgr.smithi067.rdualw (mgr.24569) 86 : cluster [DBG] pgmap v66: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:34.145 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 214 sec latency 217826.151 ms 2022-03-17T15:31:35.145 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 215 sec latency 218826.275 ms 2022-03-17T15:31:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:34.204503+0000 mgr.smithi067.rdualw (mgr.24569) 87 : cluster [DBG] pgmap v67: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:31:34.459298+0000 mon.smithi067 (mon.1) 55 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:31:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:31:34.459783+0000 mon.smithi061 (mon.0) 160 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:31:35.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:31:34.459884+0000 mon.smithi067 (mon.1) 56 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:31:35.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:31:34.460281+0000 mon.smithi061 (mon.0) 161 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:31:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:34.204503+0000 mgr.smithi067.rdualw (mgr.24569) 87 : cluster [DBG] pgmap v67: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:31:34.459298+0000 mon.smithi067 (mon.1) 55 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:31:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:31:34.459783+0000 mon.smithi061 (mon.0) 160 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:31:35.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:31:34.459884+0000 mon.smithi067 (mon.1) 56 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:31:35.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:31:34.460281+0000 mon.smithi061 (mon.0) 161 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:31:36.145 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 216 sec latency 219826.398 ms 2022-03-17T15:31:37.145 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 217 sec latency 220826.515 ms 2022-03-17T15:31:37.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:36.205645+0000 mgr.smithi067.rdualw (mgr.24569) 88 : cluster [DBG] pgmap v68: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:37.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:36.205645+0000 mgr.smithi067.rdualw (mgr.24569) 88 : cluster [DBG] pgmap v68: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:38.145 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 218 sec latency 221826.612 ms 2022-03-17T15:31:39.145 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 219 sec latency 222826.698 ms 2022-03-17T15:31:39.149 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:31:39.442 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:31:39.443 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (9m) 105s ago 10m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:31:39.443 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (113s) 105s ago 10m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:31:39.443 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (102s) 97s ago 9m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:31:39.444 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (9m) 105s ago 10m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:31:39.444 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2m) 105s ago 5m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:31:39.444 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2m) 97s ago 5m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:31:39.444 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3m) 105s ago 11m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:31:39.444 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2m) 97s ago 9m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:31:39.445 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2m) 105s ago 11m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:31:39.445 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2m) 97s ago 9m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:31:39.445 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3m) 105s ago 3m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:31:39.445 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3m) 97s ago 3m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:31:39.446 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (10m) 105s ago 10m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:31:39.446 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (9m) 97s ago 9m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:31:39.446 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (9m) 105s ago 9m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:31:39.446 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (8m) 105s ago 8m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:31:39.446 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (8m) 105s ago 8m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:31:39.447 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (8m) 105s ago 8m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:31:39.447 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (8m) 97s ago 8m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:31:39.447 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (7m) 97s ago 7m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:31:39.447 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (7m) 97s ago 7m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:31:39.448 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (7m) 97s ago 7m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:31:39.448 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (8m) 105s ago 9m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:31:39.784 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:31:39.784 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:31:39.784 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:31:39.784 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:31:39.785 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:31:39.785 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:31:39.785 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:31:39.785 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:31:39.785 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:31:39.786 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:31:39.786 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:31:39.786 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:31:39.786 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:31:39.787 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:31:39.787 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:31:39.787 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:31:39.787 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:31:39.788 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:31:39.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:38.206441+0000 mgr.smithi067.rdualw (mgr.24569) 89 : cluster [DBG] pgmap v69: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:39.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:38.206441+0000 mgr.smithi067.rdualw (mgr.24569) 89 : cluster [DBG] pgmap v69: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:40.145 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 220 sec latency 223826.797 ms 2022-03-17T15:31:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:31:39.134618+0000 mgr.smithi067.rdualw (mgr.24569) 90 : audit [DBG] from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:31:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:31:39.424221+0000 mgr.smithi067.rdualw (mgr.24569) 91 : audit [DBG] from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:31:40.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:31:39.781928+0000 mon.smithi061 (mon.0) 162 : audit [DBG] from='client.? 172.21.15.61:0/276141476' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:31:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:31:39.134618+0000 mgr.smithi067.rdualw (mgr.24569) 90 : audit [DBG] from='client.34186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:31:40.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:31:39.424221+0000 mgr.smithi067.rdualw (mgr.24569) 91 : audit [DBG] from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:31:40.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:31:39.781928+0000 mon.smithi061 (mon.0) 162 : audit [DBG] from='client.? 172.21.15.61:0/276141476' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:31:41.147 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 221 sec latency 224826.912 ms 2022-03-17T15:31:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:40.207258+0000 mgr.smithi067.rdualw (mgr.24569) 92 : cluster [DBG] pgmap v70: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:41.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:40.207258+0000 mgr.smithi067.rdualw (mgr.24569) 92 : cluster [DBG] pgmap v70: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:42.146 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 222 sec latency 225827.000 ms 2022-03-17T15:31:43.147 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 223 sec latency 226827.050 ms 2022-03-17T15:31:43.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:42.208612+0000 mgr.smithi067.rdualw (mgr.24569) 93 : cluster [DBG] pgmap v71: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:43.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:42.208612+0000 mgr.smithi067.rdualw (mgr.24569) 93 : cluster [DBG] pgmap v71: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:44.146 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 224 sec latency 227827.161 ms 2022-03-17T15:31:45.146 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 225 sec latency 228827.273 ms 2022-03-17T15:31:45.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:44.209440+0000 mgr.smithi067.rdualw (mgr.24569) 94 : cluster [DBG] pgmap v72: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:45.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:44.209440+0000 mgr.smithi067.rdualw (mgr.24569) 94 : cluster [DBG] pgmap v72: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:46.146 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 226 sec latency 229827.411 ms 2022-03-17T15:31:47.146 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 227 sec latency 230827.519 ms 2022-03-17T15:31:47.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:46.210511+0000 mgr.smithi067.rdualw (mgr.24569) 95 : cluster [DBG] pgmap v73: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:46.210511+0000 mgr.smithi067.rdualw (mgr.24569) 95 : cluster [DBG] pgmap v73: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:48.146 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 228 sec latency 231827.571 ms 2022-03-17T15:31:49.147 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 229 sec latency 232827.684 ms 2022-03-17T15:31:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:48.211480+0000 mgr.smithi067.rdualw (mgr.24569) 96 : cluster [DBG] pgmap v74: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:48.211480+0000 mgr.smithi067.rdualw (mgr.24569) 96 : cluster [DBG] pgmap v74: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:50.147 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 230 sec latency 233827.783 ms 2022-03-17T15:31:51.147 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 231 sec latency 234827.847 ms 2022-03-17T15:31:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:50.212338+0000 mgr.smithi067.rdualw (mgr.24569) 97 : cluster [DBG] pgmap v75: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:50.212338+0000 mgr.smithi067.rdualw (mgr.24569) 97 : cluster [DBG] pgmap v75: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:52.147 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 232 sec latency 235827.973 ms 2022-03-17T15:31:53.147 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 233 sec latency 236828.093 ms 2022-03-17T15:31:53.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:52.213652+0000 mgr.smithi067.rdualw (mgr.24569) 98 : cluster [DBG] pgmap v76: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:53.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:52.213652+0000 mgr.smithi067.rdualw (mgr.24569) 98 : cluster [DBG] pgmap v76: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:54.147 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 234 sec latency 237828.179 ms 2022-03-17T15:31:55.147 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 235 sec latency 238828.280 ms 2022-03-17T15:31:55.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:54.214438+0000 mgr.smithi067.rdualw (mgr.24569) 99 : cluster [DBG] pgmap v77: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:55.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:54.214438+0000 mgr.smithi067.rdualw (mgr.24569) 99 : cluster [DBG] pgmap v77: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:56.147 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 236 sec latency 239828.376 ms 2022-03-17T15:31:57.147 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 237 sec latency 240828.484 ms 2022-03-17T15:31:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:56.215564+0000 mgr.smithi067.rdualw (mgr.24569) 100 : cluster [DBG] pgmap v78: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:56.215564+0000 mgr.smithi067.rdualw (mgr.24569) 100 : cluster [DBG] pgmap v78: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:58.147 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 238 sec latency 241828.617 ms 2022-03-17T15:31:59.148 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 239 sec latency 242828.741 ms 2022-03-17T15:31:59.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:31:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:31:58.216576+0000 mgr.smithi067.rdualw (mgr.24569) 101 : cluster [DBG] pgmap v79: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:31:59.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:31:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:31:58.216576+0000 mgr.smithi067.rdualw (mgr.24569) 101 : cluster [DBG] pgmap v79: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:00.148 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 240 sec latency 243828.851 ms 2022-03-17T15:32:01.148 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 241 sec latency 244828.990 ms 2022-03-17T15:32:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:00.217394+0000 mgr.smithi067.rdualw (mgr.24569) 102 : cluster [DBG] pgmap v80: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:01.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:00.217394+0000 mgr.smithi067.rdualw (mgr.24569) 102 : cluster [DBG] pgmap v80: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:02.148 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 242 sec latency 245829.089 ms 2022-03-17T15:32:03.148 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 243 sec latency 246829.199 ms 2022-03-17T15:32:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:02.218614+0000 mgr.smithi067.rdualw (mgr.24569) 103 : cluster [DBG] pgmap v81: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:03.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:02.218614+0000 mgr.smithi067.rdualw (mgr.24569) 103 : cluster [DBG] pgmap v81: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:04.148 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 244 sec latency 247829.332 ms 2022-03-17T15:32:05.148 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 245 sec latency 248829.437 ms 2022-03-17T15:32:05.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:04.219434+0000 mgr.smithi067.rdualw (mgr.24569) 104 : cluster [DBG] pgmap v82: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:05.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:04.219434+0000 mgr.smithi067.rdualw (mgr.24569) 104 : cluster [DBG] pgmap v82: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:06.148 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 246 sec latency 249829.566 ms 2022-03-17T15:32:07.148 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 247 sec latency 250829.677 ms 2022-03-17T15:32:07.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:06.220574+0000 mgr.smithi067.rdualw (mgr.24569) 105 : cluster [DBG] pgmap v83: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:07.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:06.220574+0000 mgr.smithi067.rdualw (mgr.24569) 105 : cluster [DBG] pgmap v83: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:08.148 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 248 sec latency 251829.748 ms 2022-03-17T15:32:08.481 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:08 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: start operation timed out. Terminating. 2022-03-17T15:32:09.148 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 249 sec latency 252829.835 ms 2022-03-17T15:32:09.802 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:09 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Failed with result 'timeout'. 2022-03-17T15:32:09.802 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:09 smithi061 systemd[1]: Failed to start Ceph osd.0 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:32:09.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:08.221499+0000 mgr.smithi067.rdualw (mgr.24569) 106 : cluster [DBG] pgmap v84: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:09.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:09.395031+0000 mon.smithi061 (mon.0) 163 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:32:09.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:09.396172+0000 mon.smithi067 (mon.1) 57 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:32:09.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:09.397640+0000 mon.smithi067 (mon.1) 58 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:32:09.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:09.398530+0000 mon.smithi067 (mon.1) 59 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:32:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:08.221499+0000 mgr.smithi067.rdualw (mgr.24569) 106 : cluster [DBG] pgmap v84: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:09.395031+0000 mon.smithi061 (mon.0) 163 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:32:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:09.396172+0000 mon.smithi067 (mon.1) 57 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:32:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:09.397640+0000 mon.smithi067 (mon.1) 58 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:32:09.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:09.398530+0000 mon.smithi067 (mon.1) 59 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:32:10.104 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:32:10.148 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 250 sec latency 253829.869 ms 2022-03-17T15:32:10.404 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:32:10.404 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (9m) 2m ago 10m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:32:10.404 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2m) 2m ago 10m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:32:10.405 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2m) 2m ago 10m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:32:10.405 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (9m) 2m ago 10m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:32:10.405 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2m) 2m ago 6m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:32:10.405 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2m) 2m ago 6m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:32:10.406 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3m) 2m ago 11m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:32:10.406 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3m) 2m ago 10m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:32:10.406 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3m) 2m ago 12m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:32:10.406 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3m) 2m ago 10m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:32:10.407 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4m) 2m ago 4m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:32:10.407 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4m) 2m ago 4m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:32:10.408 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (10m) 2m ago 10m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:32:10.408 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (9m) 2m ago 9m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:32:10.408 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (9m) 2m ago 9m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:32:10.408 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (9m) 2m ago 9m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:32:10.409 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (9m) 2m ago 9m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:32:10.409 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (8m) 2m ago 8m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:32:10.409 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (8m) 2m ago 8m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:32:10.409 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (8m) 2m ago 8m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:32:10.410 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (8m) 2m ago 8m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:32:10.410 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (7m) 2m ago 7m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:32:10.410 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (9m) 2m ago 10m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:32:10.747 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:32:10.747 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:32:10.747 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:32:10.748 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:32:10.748 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:32:10.748 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:32:10.748 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:32:10.749 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:32:10.749 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:32:10.749 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:32:10.749 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:32:10.750 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:32:10.750 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:32:10.750 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:32:10.750 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:32:10.751 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:32:10.751 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:32:10.751 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:32:11.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:32:09.391295+0000 mgr.smithi067.rdualw (mgr.24569) 107 : cephadm [ERR] cephadm exited with an error code: 1, stderr:Redeploy daemon osd.0 ... 2022-03-17T15:32:11.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Non-zero exit code 1 from systemctl start ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0 2022-03-17T15:32:11.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: systemctl: stderr Job for ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-03-17T15:32:11.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: systemctl: stderr See "systemctl status ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-03-17T15:32:11.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Traceback (most recent call last): 2022-03-17T15:32:11.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 8876, in 2022-03-17T15:32:11.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: main() 2022-03-17T15:32:11.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 8864, in main 2022-03-17T15:32:11.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: r = ctx.func(ctx) 2022-03-17T15:32:11.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 1940, in _default_image 2022-03-17T15:32:11.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: return func(ctx) 2022-03-17T15:32:11.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 4806, in command_deploy 2022-03-17T15:32:11.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: ports=daemon_ports) 2022-03-17T15:32:11.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 2886, in deploy_daemon 2022-03-17T15:32:11.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: c, osd_fsid=osd_fsid, ports=ports) 2022-03-17T15:32:11.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 3131, in deploy_daemon_units 2022-03-17T15:32:11.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: call_throws(ctx, ['systemctl', 'start', unit_name]) 2022-03-17T15:32:11.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 1617, in call_throws 2022-03-17T15:32:11.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: raise RuntimeError(f'Failed command: {" ".join(command)}: {s}') 2022-03-17T15:32:11.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: RuntimeError: Failed command: systemctl start ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0: Job for ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-03-17T15:32:11.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: See "systemctl status ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-03-17T15:32:11.058 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Traceback (most recent call last): 2022-03-17T15:32:11.058 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1419, in _remote_connection 2022-03-17T15:32:11.058 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: yield (conn, connr) 2022-03-17T15:32:11.058 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1316, in _run_cephadm 2022-03-17T15:32:11.059 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: code, '\n'.join(err))) 2022-03-17T15:32:11.059 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr:Redeploy daemon osd.0 ... 2022-03-17T15:32:11.059 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Non-zero exit code 1 from systemctl start ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0 2022-03-17T15:32:11.059 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: systemctl: stderr Job for ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-03-17T15:32:11.060 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: systemctl: stderr See "systemctl status ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-03-17T15:32:11.060 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: Traceback (most recent call last): 2022-03-17T15:32:11.060 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 8876, in 2022-03-17T15:32:11.060 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: main() 2022-03-17T15:32:11.060 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 8864, in main 2022-03-17T15:32:11.061 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: r = ctx.func(ctx) 2022-03-17T15:32:11.061 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 1940, in _default_image 2022-03-17T15:32:11.061 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: return func(ctx) 2022-03-17T15:32:11.061 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 4806, in command_deploy 2022-03-17T15:32:11.061 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: ports=daemon_ports) 2022-03-17T15:32:11.062 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 2886, in deploy_daemon 2022-03-17T15:32:11.062 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: c, osd_fsid=osd_fsid, ports=ports) 2022-03-17T15:32:11.062 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 3131, in deploy_daemon_units 2022-03-17T15:32:11.062 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: call_throws(ctx, ['systemctl', 'start', unit_name]) 2022-03-17T15:32:11.063 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 1617, in call_throws 2022-03-17T15:32:11.063 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: raise RuntimeError(f'Failed command: {" ".join(command)}: {s}') 2022-03-17T15:32:11.063 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: RuntimeError: Failed command: systemctl start ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0: Job for ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-03-17T15:32:11.063 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: See "systemctl status ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-03-17T15:32:11.064 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: 2022-03-17T15:32:11.064 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:32:09.391486+0000 mgr.smithi067.rdualw (mgr.24569) 108 : cephadm [ERR] Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T15:32:11.064 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:09.396560+0000 mgr.smithi067.rdualw (mgr.24569) 109 : cluster [DBG] pgmap v85: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 183 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:11.064 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:32:09.399358+0000 mgr.smithi067.rdualw (mgr.24569) 110 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:32:11.064 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:09.767633+0000 mon.smithi061 (mon.0) 164 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:32:11.065 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:09.770686+0000 mon.smithi061 (mon.0) 165 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:32:11.065 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:10.205985+0000 mon.smithi061 (mon.0) 166 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:32:11.065 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:10.215036+0000 mon.smithi061 (mon.0) 167 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:32:11.065 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:10.218950+0000 mon.smithi067 (mon.1) 60 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:32:11.065 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:10.220003+0000 mon.smithi067 (mon.1) 61 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:32:11.066 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:10.220678+0000 mon.smithi067 (mon.1) 62 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:32:11.066 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:10.227613+0000 mon.smithi061 (mon.0) 168 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:32:11.066 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:10.236106+0000 mon.smithi061 (mon.0) 169 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:32:11.066 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:10.393672+0000 mon.smithi061 (mon.0) 170 : cluster [WRN] Health check failed: Upgrading daemon osd.0 on host smithi061 failed. (UPGRADE_REDEPLOY_DAEMON) 2022-03-17T15:32:11.067 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:10.745086+0000 mon.smithi061 (mon.0) 171 : audit [DBG] from='client.? 172.21.15.61:0/3033654614' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:32:11.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:32:09.391295+0000 mgr.smithi067.rdualw (mgr.24569) 107 : cephadm [ERR] cephadm exited with an error code: 1, stderr:Redeploy daemon osd.0 ... 2022-03-17T15:32:11.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Non-zero exit code 1 from systemctl start ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0 2022-03-17T15:32:11.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: systemctl: stderr Job for ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-03-17T15:32:11.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: systemctl: stderr See "systemctl status ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-03-17T15:32:11.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Traceback (most recent call last): 2022-03-17T15:32:11.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 8876, in 2022-03-17T15:32:11.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: main() 2022-03-17T15:32:11.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 8864, in main 2022-03-17T15:32:11.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: r = ctx.func(ctx) 2022-03-17T15:32:11.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 1940, in _default_image 2022-03-17T15:32:11.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: return func(ctx) 2022-03-17T15:32:11.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 4806, in command_deploy 2022-03-17T15:32:11.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: ports=daemon_ports) 2022-03-17T15:32:11.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 2886, in deploy_daemon 2022-03-17T15:32:11.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: c, osd_fsid=osd_fsid, ports=ports) 2022-03-17T15:32:11.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 3131, in deploy_daemon_units 2022-03-17T15:32:11.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: call_throws(ctx, ['systemctl', 'start', unit_name]) 2022-03-17T15:32:11.072 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 1617, in call_throws 2022-03-17T15:32:11.072 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: raise RuntimeError(f'Failed command: {" ".join(command)}: {s}') 2022-03-17T15:32:11.072 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: RuntimeError: Failed command: systemctl start ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0: Job for ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-03-17T15:32:11.072 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: See "systemctl status ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-03-17T15:32:11.072 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Traceback (most recent call last): 2022-03-17T15:32:11.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1419, in _remote_connection 2022-03-17T15:32:11.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: yield (conn, connr) 2022-03-17T15:32:11.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1316, in _run_cephadm 2022-03-17T15:32:11.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: code, '\n'.join(err))) 2022-03-17T15:32:11.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr:Redeploy daemon osd.0 ... 2022-03-17T15:32:11.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Non-zero exit code 1 from systemctl start ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0 2022-03-17T15:32:11.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: systemctl: stderr Job for ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-03-17T15:32:11.074 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: systemctl: stderr See "systemctl status ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-03-17T15:32:11.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: Traceback (most recent call last): 2022-03-17T15:32:11.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 8876, in 2022-03-17T15:32:11.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: main() 2022-03-17T15:32:11.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 8864, in main 2022-03-17T15:32:11.075 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: r = ctx.func(ctx) 2022-03-17T15:32:11.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 1940, in _default_image 2022-03-17T15:32:11.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: return func(ctx) 2022-03-17T15:32:11.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 4806, in command_deploy 2022-03-17T15:32:11.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: ports=daemon_ports) 2022-03-17T15:32:11.076 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 2886, in deploy_daemon 2022-03-17T15:32:11.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: c, osd_fsid=osd_fsid, ports=ports) 2022-03-17T15:32:11.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 3131, in deploy_daemon_units 2022-03-17T15:32:11.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: call_throws(ctx, ['systemctl', 'start', unit_name]) 2022-03-17T15:32:11.077 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 1617, in call_throws 2022-03-17T15:32:11.078 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: raise RuntimeError(f'Failed command: {" ".join(command)}: {s}') 2022-03-17T15:32:11.078 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: RuntimeError: Failed command: systemctl start ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0: Job for ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-03-17T15:32:11.078 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: See "systemctl status ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-03-17T15:32:11.078 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: 2022-03-17T15:32:11.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:32:09.391486+0000 mgr.smithi067.rdualw (mgr.24569) 108 : cephadm [ERR] Upgrade: Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T15:32:11.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:09.396560+0000 mgr.smithi067.rdualw (mgr.24569) 109 : cluster [DBG] pgmap v85: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 183 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:11.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:32:09.399358+0000 mgr.smithi067.rdualw (mgr.24569) 110 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:32:11.079 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:09.767633+0000 mon.smithi061 (mon.0) 164 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:32:11.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:09.770686+0000 mon.smithi061 (mon.0) 165 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:32:11.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:10.205985+0000 mon.smithi061 (mon.0) 166 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:32:11.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:10.215036+0000 mon.smithi061 (mon.0) 167 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:32:11.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:10.218950+0000 mon.smithi067 (mon.1) 60 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:32:11.080 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:10.220003+0000 mon.smithi067 (mon.1) 61 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:32:11.081 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:10.220678+0000 mon.smithi067 (mon.1) 62 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:32:11.081 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:10.227613+0000 mon.smithi061 (mon.0) 168 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:32:11.081 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:10.236106+0000 mon.smithi061 (mon.0) 169 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:32:11.081 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:10.393672+0000 mon.smithi061 (mon.0) 170 : cluster [WRN] Health check failed: Upgrading daemon osd.0 on host smithi061 failed. (UPGRADE_REDEPLOY_DAEMON) 2022-03-17T15:32:11.082 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:10.745086+0000 mon.smithi061 (mon.0) 171 : audit [DBG] from='client.? 172.21.15.61:0/3033654614' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:32:11.149 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 251 sec latency 254829.981 ms 2022-03-17T15:32:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:10.088599+0000 mgr.smithi067.rdualw (mgr.24569) 111 : audit [DBG] from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:32:12.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:32:10.221266+0000 mgr.smithi067.rdualw (mgr.24569) 112 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:32:12.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:10.386501+0000 mgr.smithi067.rdualw (mgr.24569) 113 : audit [DBG] from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:32:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:10.088599+0000 mgr.smithi067.rdualw (mgr.24569) 111 : audit [DBG] from='client.34198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:32:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:32:10.221266+0000 mgr.smithi067.rdualw (mgr.24569) 112 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:32:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:10.386501+0000 mgr.smithi067.rdualw (mgr.24569) 113 : audit [DBG] from='client.34202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:32:12.149 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 252 sec latency 255830.027 ms 2022-03-17T15:32:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:11.397743+0000 mgr.smithi067.rdualw (mgr.24569) 114 : cluster [DBG] pgmap v86: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 183 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:11.397743+0000 mgr.smithi067.rdualw (mgr.24569) 114 : cluster [DBG] pgmap v86: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 183 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:13.149 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 253 sec latency 256830.154 ms 2022-03-17T15:32:14.149 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 254 sec latency 257830.204 ms 2022-03-17T15:32:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:13.398607+0000 mgr.smithi067.rdualw (mgr.24569) 115 : cluster [DBG] pgmap v87: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 183 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:13.398607+0000 mgr.smithi067.rdualw (mgr.24569) 115 : cluster [DBG] pgmap v87: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 183 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:15.149 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 255 sec latency 258830.311 ms 2022-03-17T15:32:16.149 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 256 sec latency 259830.440 ms 2022-03-17T15:32:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:15.399797+0000 mgr.smithi067.rdualw (mgr.24569) 116 : cluster [DBG] pgmap v88: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 366 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:15.399797+0000 mgr.smithi067.rdualw (mgr.24569) 116 : cluster [DBG] pgmap v88: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 366 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:17.149 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 257 sec latency 260830.512 ms 2022-03-17T15:32:18.149 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 258 sec latency 261830.615 ms 2022-03-17T15:32:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:17.400621+0000 mgr.smithi067.rdualw (mgr.24569) 117 : cluster [DBG] pgmap v89: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 183 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:17.400621+0000 mgr.smithi067.rdualw (mgr.24569) 117 : cluster [DBG] pgmap v89: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 183 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:19.149 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 259 sec latency 262830.745 ms 2022-03-17T15:32:19.977 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:19 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Service RestartSec=10s expired, scheduling restart. 2022-03-17T15:32:19.977 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:19 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 1. 2022-03-17T15:32:19.978 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:19 smithi061 systemd[1]: Stopped Ceph osd.0 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:32:19.978 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:19 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 78668 (bash) in control group while starting unit. Ignoring. 2022-03-17T15:32:19.978 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:19 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:32:19.978 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:19 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 78725 (podman) in control group while starting unit. Ignoring. 2022-03-17T15:32:19.979 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:19 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:32:19.979 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:19 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 78741 (conmon) in control group while starting unit. Ignoring. 2022-03-17T15:32:19.979 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:19 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:32:19.979 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:19 smithi061 systemd[1]: Starting Ceph osd.0 for ae1b9b88-a605-11ec-8c35-001a4aab830c... 2022-03-17T15:32:19.980 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:19 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 78668 (bash) in control group while starting unit. Ignoring. 2022-03-17T15:32:19.980 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:19 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:32:19.980 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:19 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 78725 (podman) in control group while starting unit. Ignoring. 2022-03-17T15:32:19.980 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:19 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:32:19.980 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:19 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 78741 (conmon) in control group while starting unit. Ignoring. 2022-03-17T15:32:19.981 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:19 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:32:20.149 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 260 sec latency 263830.791 ms 2022-03-17T15:32:20.302 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:19 smithi061 bash[79283]: fe22b76f85cf4144fd07955a6906a1c012083545f472893cbad7cba6e0339556 2022-03-17T15:32:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:19.401597+0000 mgr.smithi067.rdualw (mgr.24569) 118 : cluster [DBG] pgmap v90: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 183 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:20.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:19.431024+0000 mon.smithi061 (mon.0) 172 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:32:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:19.401597+0000 mgr.smithi067.rdualw (mgr.24569) 118 : cluster [DBG] pgmap v90: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 183 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:19.431024+0000 mon.smithi061 (mon.0) 172 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:32:21.150 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 261 sec latency 264830.902 ms 2022-03-17T15:32:21.552 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:32:21 smithi061 bash[78725]: time="2022-03-17T15:32:21Z" level=error msg="Could not retrieve exit code from event: died not found: unable to find event" 2022-03-17T15:32:22.150 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 262 sec latency 265831.014 ms 2022-03-17T15:32:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:21.403072+0000 mgr.smithi067.rdualw (mgr.24569) 119 : cluster [DBG] pgmap v91: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:21.403072+0000 mgr.smithi067.rdualw (mgr.24569) 119 : cluster [DBG] pgmap v91: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:23.150 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 263 sec latency 266831.098 ms 2022-03-17T15:32:24.150 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 264 sec latency 267831.138 ms 2022-03-17T15:32:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:23.404009+0000 mgr.smithi067.rdualw (mgr.24569) 120 : cluster [DBG] pgmap v92: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:23.404009+0000 mgr.smithi067.rdualw (mgr.24569) 120 : cluster [DBG] pgmap v92: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:25.150 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 265 sec latency 268831.264 ms 2022-03-17T15:32:26.150 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 266 sec latency 269831.387 ms 2022-03-17T15:32:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:25.405146+0000 mgr.smithi067.rdualw (mgr.24569) 121 : cluster [DBG] pgmap v93: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:25.405146+0000 mgr.smithi067.rdualw (mgr.24569) 121 : cluster [DBG] pgmap v93: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:27.150 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 267 sec latency 270831.505 ms 2022-03-17T15:32:28.150 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 268 sec latency 271831.569 ms 2022-03-17T15:32:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:27.406064+0000 mgr.smithi067.rdualw (mgr.24569) 122 : cluster [DBG] pgmap v94: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:27.406064+0000 mgr.smithi067.rdualw (mgr.24569) 122 : cluster [DBG] pgmap v94: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:29.151 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 269 sec latency 272831.686 ms 2022-03-17T15:32:30.151 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 270 sec latency 273831.829 ms 2022-03-17T15:32:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:29.407037+0000 mgr.smithi067.rdualw (mgr.24569) 123 : cluster [DBG] pgmap v95: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:29.407037+0000 mgr.smithi067.rdualw (mgr.24569) 123 : cluster [DBG] pgmap v95: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:31.151 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 271 sec latency 274831.888 ms 2022-03-17T15:32:32.151 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 272 sec latency 275832.002 ms 2022-03-17T15:32:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:31.408333+0000 mgr.smithi067.rdualw (mgr.24569) 124 : cluster [DBG] pgmap v96: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:31.408333+0000 mgr.smithi067.rdualw (mgr.24569) 124 : cluster [DBG] pgmap v96: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:33.151 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 273 sec latency 276832.105 ms 2022-03-17T15:32:34.151 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 274 sec latency 277832.219 ms 2022-03-17T15:32:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:33.409376+0000 mgr.smithi067.rdualw (mgr.24569) 125 : cluster [DBG] pgmap v97: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:34.464444+0000 mon.smithi067 (mon.1) 63 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:32:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:33.409376+0000 mgr.smithi067.rdualw (mgr.24569) 125 : cluster [DBG] pgmap v97: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:34.464444+0000 mon.smithi067 (mon.1) 63 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:32:35.151 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 275 sec latency 278832.345 ms 2022-03-17T15:32:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:34.464691+0000 mon.smithi067 (mon.1) 64 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:32:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:34.465103+0000 mon.smithi061 (mon.0) 173 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:32:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:34.466149+0000 mon.smithi061 (mon.0) 174 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:32:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:34.464691+0000 mon.smithi067 (mon.1) 64 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:32:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:34.465103+0000 mon.smithi061 (mon.0) 173 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:32:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:34.466149+0000 mon.smithi061 (mon.0) 174 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:32:36.151 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 276 sec latency 279832.442 ms 2022-03-17T15:32:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:35.410635+0000 mgr.smithi067.rdualw (mgr.24569) 126 : cluster [DBG] pgmap v98: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:35.410635+0000 mgr.smithi067.rdualw (mgr.24569) 126 : cluster [DBG] pgmap v98: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:37.152 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 277 sec latency 280832.549 ms 2022-03-17T15:32:38.151 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 278 sec latency 281832.658 ms 2022-03-17T15:32:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:37.411694+0000 mgr.smithi067.rdualw (mgr.24569) 127 : cluster [DBG] pgmap v99: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:37.411694+0000 mgr.smithi067.rdualw (mgr.24569) 127 : cluster [DBG] pgmap v99: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:39.151 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 279 sec latency 282832.747 ms 2022-03-17T15:32:40.152 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 280 sec latency 283832.783 ms 2022-03-17T15:32:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:39.412746+0000 mgr.smithi067.rdualw (mgr.24569) 128 : cluster [DBG] pgmap v100: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:39.412746+0000 mgr.smithi067.rdualw (mgr.24569) 128 : cluster [DBG] pgmap v100: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:41.070 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:32:41.151 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 281 sec latency 284832.823 ms 2022-03-17T15:32:41.362 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:32:41.362 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (10m) 2m ago 11m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:32:41.362 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2m) 2m ago 11m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:32:41.363 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2m) 2m ago 10m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:32:41.363 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (10m) 2m ago 11m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:32:41.363 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3m) 2m ago 7m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:32:41.363 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3m) 2m ago 6m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:32:41.364 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4m) 2m ago 12m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:32:41.364 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4m) 2m ago 10m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:32:41.364 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3m) 2m ago 12m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:32:41.364 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3m) 2m ago 10m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:32:41.364 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4m) 2m ago 4m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:32:41.365 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4m) 2m ago 4m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:32:41.365 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (11m) 2m ago 11m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:32:41.365 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (10m) 2m ago 10m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:32:41.365 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (10m) 2m ago 10m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:32:41.366 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (9m) 2m ago 9m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:32:41.366 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (9m) 2m ago 9m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:32:41.366 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (9m) 2m ago 9m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:32:41.366 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (9m) 2m ago 9m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:32:41.367 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (8m) 2m ago 8m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:32:41.367 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (8m) 2m ago 8m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:32:41.367 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (8m) 2m ago 8m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:32:41.367 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (10m) 2m ago 10m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:32:41.702 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:32:41.702 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:32:41.702 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:32:41.703 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:32:41.703 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:32:41.703 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:32:41.703 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:32:41.704 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:32:41.704 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:32:41.704 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:32:41.704 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:32:41.705 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:32:41.705 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:32:41.705 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:32:41.705 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:32:41.705 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:32:41.706 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:32:41.706 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:32:42.152 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 282 sec latency 285832.918 ms 2022-03-17T15:32:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:41.055363+0000 mgr.smithi067.rdualw (mgr.24569) 129 : audit [DBG] from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:32:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:41.343127+0000 mgr.smithi067.rdualw (mgr.24569) 130 : audit [DBG] from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:32:42.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:41.413870+0000 mgr.smithi067.rdualw (mgr.24569) 131 : cluster [DBG] pgmap v101: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:42.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:32:41.700079+0000 mon.smithi061 (mon.0) 175 : audit [DBG] from='client.? 172.21.15.61:0/541332265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:32:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:41.055363+0000 mgr.smithi067.rdualw (mgr.24569) 129 : audit [DBG] from='client.34210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:32:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:41.343127+0000 mgr.smithi067.rdualw (mgr.24569) 130 : audit [DBG] from='client.34214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:32:42.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:41.413870+0000 mgr.smithi067.rdualw (mgr.24569) 131 : cluster [DBG] pgmap v101: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:42.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:32:41.700079+0000 mon.smithi061 (mon.0) 175 : audit [DBG] from='client.? 172.21.15.61:0/541332265' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:32:43.152 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 283 sec latency 286833.059 ms 2022-03-17T15:32:44.152 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 284 sec latency 287833.190 ms 2022-03-17T15:32:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:43.414692+0000 mgr.smithi067.rdualw (mgr.24569) 132 : cluster [DBG] pgmap v102: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:43.414692+0000 mgr.smithi067.rdualw (mgr.24569) 132 : cluster [DBG] pgmap v102: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:45.152 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 285 sec latency 288833.309 ms 2022-03-17T15:32:46.152 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 286 sec latency 289833.451 ms 2022-03-17T15:32:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:45.415808+0000 mgr.smithi067.rdualw (mgr.24569) 133 : cluster [DBG] pgmap v103: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:45.415808+0000 mgr.smithi067.rdualw (mgr.24569) 133 : cluster [DBG] pgmap v103: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:47.152 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 287 sec latency 290833.560 ms 2022-03-17T15:32:48.152 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 288 sec latency 291833.687 ms 2022-03-17T15:32:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:47.416669+0000 mgr.smithi067.rdualw (mgr.24569) 134 : cluster [DBG] pgmap v104: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:47.416669+0000 mgr.smithi067.rdualw (mgr.24569) 134 : cluster [DBG] pgmap v104: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:49.153 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 289 sec latency 292833.855 ms 2022-03-17T15:32:50.153 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 290 sec latency 293833.985 ms 2022-03-17T15:32:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:49.417513+0000 mgr.smithi067.rdualw (mgr.24569) 135 : cluster [DBG] pgmap v105: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:49.417513+0000 mgr.smithi067.rdualw (mgr.24569) 135 : cluster [DBG] pgmap v105: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:51.153 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 291 sec latency 294834.108 ms 2022-03-17T15:32:52.155 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 292 sec latency 295834.204 ms 2022-03-17T15:32:52.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:51.418757+0000 mgr.smithi067.rdualw (mgr.24569) 136 : cluster [DBG] pgmap v106: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:51.418757+0000 mgr.smithi067.rdualw (mgr.24569) 136 : cluster [DBG] pgmap v106: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:53.153 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 293 sec latency 296834.334 ms 2022-03-17T15:32:54.153 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 294 sec latency 297834.462 ms 2022-03-17T15:32:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:53.419681+0000 mgr.smithi067.rdualw (mgr.24569) 137 : cluster [DBG] pgmap v107: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:53.419681+0000 mgr.smithi067.rdualw (mgr.24569) 137 : cluster [DBG] pgmap v107: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:55.155 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 295 sec latency 298834.577 ms 2022-03-17T15:32:56.153 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 296 sec latency 299834.720 ms 2022-03-17T15:32:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:55.420793+0000 mgr.smithi067.rdualw (mgr.24569) 138 : cluster [DBG] pgmap v108: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:55.420793+0000 mgr.smithi067.rdualw (mgr.24569) 138 : cluster [DBG] pgmap v108: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:57.153 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 297 sec latency 300834.800 ms 2022-03-17T15:32:58.154 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 298 sec latency 301834.896 ms 2022-03-17T15:32:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:32:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:57.421661+0000 mgr.smithi067.rdualw (mgr.24569) 139 : cluster [DBG] pgmap v109: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:32:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:57.421661+0000 mgr.smithi067.rdualw (mgr.24569) 139 : cluster [DBG] pgmap v109: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:32:59.154 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 299 sec latency 302834.998 ms 2022-03-17T15:33:00.154 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 300 sec latency 303835.117 ms 2022-03-17T15:33:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:32:59.422616+0000 mgr.smithi067.rdualw (mgr.24569) 140 : cluster [DBG] pgmap v110: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:32:59.422616+0000 mgr.smithi067.rdualw (mgr.24569) 140 : cluster [DBG] pgmap v110: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:01.154 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 301 sec latency 304835.244 ms 2022-03-17T15:33:02.154 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 302 sec latency 305835.363 ms 2022-03-17T15:33:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:01.423918+0000 mgr.smithi067.rdualw (mgr.24569) 141 : cluster [DBG] pgmap v111: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:01.423918+0000 mgr.smithi067.rdualw (mgr.24569) 141 : cluster [DBG] pgmap v111: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:03.154 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 303 sec latency 306835.475 ms 2022-03-17T15:33:04.154 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 304 sec latency 307835.527 ms 2022-03-17T15:33:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:03.424756+0000 mgr.smithi067.rdualw (mgr.24569) 142 : cluster [DBG] pgmap v112: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:03.424756+0000 mgr.smithi067.rdualw (mgr.24569) 142 : cluster [DBG] pgmap v112: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:05.154 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 305 sec latency 308835.640 ms 2022-03-17T15:33:06.155 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 306 sec latency 309835.741 ms 2022-03-17T15:33:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:05.425782+0000 mgr.smithi067.rdualw (mgr.24569) 143 : cluster [DBG] pgmap v113: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:05.425782+0000 mgr.smithi067.rdualw (mgr.24569) 143 : cluster [DBG] pgmap v113: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:07.155 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 307 sec latency 310835.872 ms 2022-03-17T15:33:08.155 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 308 sec latency 311835.982 ms 2022-03-17T15:33:08.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:07.426679+0000 mgr.smithi067.rdualw (mgr.24569) 144 : cluster [DBG] pgmap v114: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:07.426679+0000 mgr.smithi067.rdualw (mgr.24569) 144 : cluster [DBG] pgmap v114: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:09.155 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 309 sec latency 312836.088 ms 2022-03-17T15:33:10.155 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 310 sec latency 313836.193 ms 2022-03-17T15:33:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:09.427590+0000 mgr.smithi067.rdualw (mgr.24569) 145 : cluster [DBG] pgmap v115: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:10.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:33:10.239212+0000 mon.smithi067 (mon.1) 65 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:33:10.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:33:10.240640+0000 mon.smithi067 (mon.1) 66 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:33:10.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:33:10.241587+0000 mon.smithi067 (mon.1) 67 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:33:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:09.427590+0000 mgr.smithi067.rdualw (mgr.24569) 145 : cluster [DBG] pgmap v115: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:33:10.239212+0000 mon.smithi067 (mon.1) 65 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:33:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:33:10.240640+0000 mon.smithi067 (mon.1) 66 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:33:10.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:33:10.241587+0000 mon.smithi067 (mon.1) 67 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:33:11.155 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 311 sec latency 314836.299 ms 2022-03-17T15:33:12.028 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:33:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:33:10.242435+0000 mgr.smithi067.rdualw (mgr.24569) 146 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:33:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:33:10.674044+0000 mon.smithi061 (mon.0) 176 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:33:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:33:10.681970+0000 mon.smithi061 (mon.0) 177 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:33:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:33:10.242435+0000 mgr.smithi067.rdualw (mgr.24569) 146 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:33:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:33:10.674044+0000 mon.smithi061 (mon.0) 176 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:33:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:33:10.681970+0000 mon.smithi061 (mon.0) 177 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:33:12.155 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 312 sec latency 315836.351 ms 2022-03-17T15:33:12.318 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:33:12.319 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (10m) 3m ago 11m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:33:12.319 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3m) 3m ago 11m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:33:12.319 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3m) 3m ago 11m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:33:12.319 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (10m) 3m ago 11m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:33:12.320 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3m) 3m ago 7m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:33:12.320 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3m) 3m ago 7m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:33:12.320 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4m) 3m ago 12m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:33:12.320 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4m) 3m ago 11m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:33:12.320 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4m) 3m ago 13m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:33:12.321 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4m) 3m ago 11m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:33:12.321 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5m) 3m ago 5m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:33:12.321 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5m) 3m ago 5m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:33:12.322 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (11m) 3m ago 11m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:33:12.322 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (11m) 3m ago 11m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:33:12.322 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (10m) 3m ago 10m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:33:12.322 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (10m) 3m ago 10m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:33:12.322 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (10m) 3m ago 10m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:33:12.323 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (9m) 3m ago 9m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:33:12.323 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (9m) 3m ago 9m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:33:12.323 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (9m) 3m ago 9m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:33:12.323 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (9m) 3m ago 9m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:33:12.324 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (8m) 3m ago 8m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:33:12.324 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (10m) 3m ago 11m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:33:12.664 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:33:12.664 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:33:12.664 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:33:12.665 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:33:12.665 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:33:12.665 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:33:12.665 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:33:12.665 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:33:12.666 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:33:12.666 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:33:12.666 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:33:12.666 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:33:12.667 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:33:12.667 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:33:12.667 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:33:12.667 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:33:12.668 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:33:12.668 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:33:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:11.428849+0000 mgr.smithi067.rdualw (mgr.24569) 147 : cluster [DBG] pgmap v116: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:33:12.662050+0000 mon.smithi061 (mon.0) 178 : audit [DBG] from='client.? 172.21.15.61:0/128077814' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:33:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:11.428849+0000 mgr.smithi067.rdualw (mgr.24569) 147 : cluster [DBG] pgmap v116: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:33:12.662050+0000 mon.smithi061 (mon.0) 178 : audit [DBG] from='client.? 172.21.15.61:0/128077814' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:33:13.155 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 313 sec latency 316836.439 ms 2022-03-17T15:33:14.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:33:12.013188+0000 mgr.smithi067.rdualw (mgr.24569) 148 : audit [DBG] from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:33:14.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:33:12.300007+0000 mgr.smithi067.rdualw (mgr.24569) 149 : audit [DBG] from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:33:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:33:12.013188+0000 mgr.smithi067.rdualw (mgr.24569) 148 : audit [DBG] from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:33:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:33:12.300007+0000 mgr.smithi067.rdualw (mgr.24569) 149 : audit [DBG] from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:33:14.155 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 314 sec latency 317836.520 ms 2022-03-17T15:33:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:13.429702+0000 mgr.smithi067.rdualw (mgr.24569) 150 : cluster [DBG] pgmap v117: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:13.429702+0000 mgr.smithi067.rdualw (mgr.24569) 150 : cluster [DBG] pgmap v117: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:15.155 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 315 sec latency 318836.623 ms 2022-03-17T15:33:16.156 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 316 sec latency 319836.765 ms 2022-03-17T15:33:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:15.430810+0000 mgr.smithi067.rdualw (mgr.24569) 151 : cluster [DBG] pgmap v118: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:15.430810+0000 mgr.smithi067.rdualw (mgr.24569) 151 : cluster [DBG] pgmap v118: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:17.156 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 317 sec latency 320836.892 ms 2022-03-17T15:33:18.156 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 318 sec latency 321836.989 ms 2022-03-17T15:33:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:17.431730+0000 mgr.smithi067.rdualw (mgr.24569) 152 : cluster [DBG] pgmap v119: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:17.431730+0000 mgr.smithi067.rdualw (mgr.24569) 152 : cluster [DBG] pgmap v119: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:19.156 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 319 sec latency 322837.043 ms 2022-03-17T15:33:20.156 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 320 sec latency 323837.168 ms 2022-03-17T15:33:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:19.432523+0000 mgr.smithi067.rdualw (mgr.24569) 153 : cluster [DBG] pgmap v120: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:19.432523+0000 mgr.smithi067.rdualw (mgr.24569) 153 : cluster [DBG] pgmap v120: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:21.156 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 321 sec latency 324837.299 ms 2022-03-17T15:33:22.156 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 322 sec latency 325837.398 ms 2022-03-17T15:33:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:21.433829+0000 mgr.smithi067.rdualw (mgr.24569) 154 : cluster [DBG] pgmap v121: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:21.433829+0000 mgr.smithi067.rdualw (mgr.24569) 154 : cluster [DBG] pgmap v121: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:23.156 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 323 sec latency 326837.510 ms 2022-03-17T15:33:24.156 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 324 sec latency 327837.561 ms 2022-03-17T15:33:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:23.434719+0000 mgr.smithi067.rdualw (mgr.24569) 155 : cluster [DBG] pgmap v122: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:23.434719+0000 mgr.smithi067.rdualw (mgr.24569) 155 : cluster [DBG] pgmap v122: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:25.156 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 325 sec latency 328837.655 ms 2022-03-17T15:33:26.156 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 326 sec latency 329837.757 ms 2022-03-17T15:33:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:25.435769+0000 mgr.smithi067.rdualw (mgr.24569) 156 : cluster [DBG] pgmap v123: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:25.435769+0000 mgr.smithi067.rdualw (mgr.24569) 156 : cluster [DBG] pgmap v123: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:27.157 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 327 sec latency 330837.834 ms 2022-03-17T15:33:28.157 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 328 sec latency 331837.959 ms 2022-03-17T15:33:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:27.436599+0000 mgr.smithi067.rdualw (mgr.24569) 157 : cluster [DBG] pgmap v124: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:27.436599+0000 mgr.smithi067.rdualw (mgr.24569) 157 : cluster [DBG] pgmap v124: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:29.157 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 329 sec latency 332838.014 ms 2022-03-17T15:33:30.157 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 330 sec latency 333838.119 ms 2022-03-17T15:33:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:29.437602+0000 mgr.smithi067.rdualw (mgr.24569) 158 : cluster [DBG] pgmap v125: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:29.437602+0000 mgr.smithi067.rdualw (mgr.24569) 158 : cluster [DBG] pgmap v125: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:31.157 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 331 sec latency 334838.226 ms 2022-03-17T15:33:32.157 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 332 sec latency 335838.354 ms 2022-03-17T15:33:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:31.438895+0000 mgr.smithi067.rdualw (mgr.24569) 159 : cluster [DBG] pgmap v126: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:31.438895+0000 mgr.smithi067.rdualw (mgr.24569) 159 : cluster [DBG] pgmap v126: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:33.157 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 333 sec latency 336838.430 ms 2022-03-17T15:33:34.157 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 334 sec latency 337838.537 ms 2022-03-17T15:33:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:33.439780+0000 mgr.smithi067.rdualw (mgr.24569) 160 : cluster [DBG] pgmap v127: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:33:34.466974+0000 mon.smithi067 (mon.1) 68 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:33:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:33:34.467619+0000 mon.smithi061 (mon.0) 179 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:33:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:33:34.469367+0000 mon.smithi067 (mon.1) 69 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:33:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:33:34.469922+0000 mon.smithi061 (mon.0) 180 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:33:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:33.439780+0000 mgr.smithi067.rdualw (mgr.24569) 160 : cluster [DBG] pgmap v127: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:33:34.466974+0000 mon.smithi067 (mon.1) 68 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:33:34.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:33:34.467619+0000 mon.smithi061 (mon.0) 179 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:33:34.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:33:34.469367+0000 mon.smithi067 (mon.1) 69 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:33:34.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:33:34.469922+0000 mon.smithi061 (mon.0) 180 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:33:35.158 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 335 sec latency 338838.656 ms 2022-03-17T15:33:36.158 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 336 sec latency 339838.786 ms 2022-03-17T15:33:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:35.441018+0000 mgr.smithi067.rdualw (mgr.24569) 161 : cluster [DBG] pgmap v128: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:35.441018+0000 mgr.smithi067.rdualw (mgr.24569) 161 : cluster [DBG] pgmap v128: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:37.158 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 337 sec latency 340838.894 ms 2022-03-17T15:33:38.158 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 338 sec latency 341838.965 ms 2022-03-17T15:33:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:37.441989+0000 mgr.smithi067.rdualw (mgr.24569) 162 : cluster [DBG] pgmap v129: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:37.441989+0000 mgr.smithi067.rdualw (mgr.24569) 162 : cluster [DBG] pgmap v129: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:39.158 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 339 sec latency 342839.072 ms 2022-03-17T15:33:40.158 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 340 sec latency 343839.197 ms 2022-03-17T15:33:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:39.442921+0000 mgr.smithi067.rdualw (mgr.24569) 163 : cluster [DBG] pgmap v130: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:39.442921+0000 mgr.smithi067.rdualw (mgr.24569) 163 : cluster [DBG] pgmap v130: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:41.158 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 341 sec latency 344839.315 ms 2022-03-17T15:33:42.158 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 342 sec latency 345839.423 ms 2022-03-17T15:33:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:41.444120+0000 mgr.smithi067.rdualw (mgr.24569) 164 : cluster [DBG] pgmap v131: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:41.444120+0000 mgr.smithi067.rdualw (mgr.24569) 164 : cluster [DBG] pgmap v131: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:42.983 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:33:43.158 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 343 sec latency 346839.495 ms 2022-03-17T15:33:43.276 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:33:43.276 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (11m) 3m ago 12m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:33:43.277 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3m) 3m ago 12m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:33:43.277 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3m) 3m ago 11m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:33:43.277 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (11m) 3m ago 12m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:33:43.277 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4m) 3m ago 8m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:33:43.277 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4m) 3m ago 8m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:33:43.278 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5m) 3m ago 13m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:33:43.278 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5m) 3m ago 11m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:33:43.278 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4m) 3m ago 13m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:33:43.278 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4m) 3m ago 11m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:33:43.279 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5m) 3m ago 5m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:33:43.279 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5m) 3m ago 5m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:33:43.279 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (12m) 3m ago 12m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:33:43.279 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (11m) 3m ago 11m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:33:43.279 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (11m) 3m ago 11m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:33:43.280 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (10m) 3m ago 10m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:33:43.280 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (10m) 3m ago 10m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:33:43.280 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (10m) 3m ago 10m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:33:43.280 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (10m) 3m ago 10m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:33:43.280 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (9m) 3m ago 9m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:33:43.281 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (9m) 3m ago 9m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:33:43.281 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (9m) 3m ago 9m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:33:43.281 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (11m) 3m ago 11m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:33:43.620 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:33:43.620 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:33:43.621 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:33:43.621 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:33:43.621 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:33:43.621 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:33:43.622 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:33:43.622 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:33:43.622 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:33:43.622 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:33:43.623 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:33:43.623 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:33:43.623 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:33:43.623 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:33:43.624 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:33:43.624 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:33:43.624 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:33:43.624 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:33:44.158 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 344 sec latency 347839.585 ms 2022-03-17T15:33:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:33:42.969281+0000 mgr.smithi067.rdualw (mgr.24569) 165 : audit [DBG] from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:33:44.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:33:43.257720+0000 mgr.smithi067.rdualw (mgr.24569) 166 : audit [DBG] from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:33:44.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:43.444996+0000 mgr.smithi067.rdualw (mgr.24569) 167 : cluster [DBG] pgmap v132: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:44.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:33:43.618352+0000 mon.smithi061 (mon.0) 181 : audit [DBG] from='client.? 172.21.15.61:0/309252135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:33:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:33:42.969281+0000 mgr.smithi067.rdualw (mgr.24569) 165 : audit [DBG] from='client.34234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:33:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:33:43.257720+0000 mgr.smithi067.rdualw (mgr.24569) 166 : audit [DBG] from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:33:44.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:43.444996+0000 mgr.smithi067.rdualw (mgr.24569) 167 : cluster [DBG] pgmap v132: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:44.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:33:43.618352+0000 mon.smithi061 (mon.0) 181 : audit [DBG] from='client.? 172.21.15.61:0/309252135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:33:45.158 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 345 sec latency 348839.690 ms 2022-03-17T15:33:46.159 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 346 sec latency 349839.800 ms 2022-03-17T15:33:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:45.446064+0000 mgr.smithi067.rdualw (mgr.24569) 168 : cluster [DBG] pgmap v133: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:45.446064+0000 mgr.smithi067.rdualw (mgr.24569) 168 : cluster [DBG] pgmap v133: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:47.159 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 347 sec latency 350839.909 ms 2022-03-17T15:33:48.159 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 348 sec latency 351840.025 ms 2022-03-17T15:33:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:47.446910+0000 mgr.smithi067.rdualw (mgr.24569) 169 : cluster [DBG] pgmap v134: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:47.446910+0000 mgr.smithi067.rdualw (mgr.24569) 169 : cluster [DBG] pgmap v134: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 349 sec latency 352840.143 ms 2022-03-17T15:33:50.159 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 350 sec latency 353840.229 ms 2022-03-17T15:33:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:49.447932+0000 mgr.smithi067.rdualw (mgr.24569) 170 : cluster [DBG] pgmap v135: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:49.447932+0000 mgr.smithi067.rdualw (mgr.24569) 170 : cluster [DBG] pgmap v135: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:51.159 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 351 sec latency 354840.334 ms 2022-03-17T15:33:52.159 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 352 sec latency 355840.440 ms 2022-03-17T15:33:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:51.449295+0000 mgr.smithi067.rdualw (mgr.24569) 171 : cluster [DBG] pgmap v136: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:51.449295+0000 mgr.smithi067.rdualw (mgr.24569) 171 : cluster [DBG] pgmap v136: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:53.159 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 353 sec latency 356840.569 ms 2022-03-17T15:33:54.159 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 354 sec latency 357840.694 ms 2022-03-17T15:33:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:53.450171+0000 mgr.smithi067.rdualw (mgr.24569) 172 : cluster [DBG] pgmap v137: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:53.450171+0000 mgr.smithi067.rdualw (mgr.24569) 172 : cluster [DBG] pgmap v137: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:55.159 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 355 sec latency 358840.793 ms 2022-03-17T15:33:56.160 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 356 sec latency 359840.901 ms 2022-03-17T15:33:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:55.451462+0000 mgr.smithi067.rdualw (mgr.24569) 173 : cluster [DBG] pgmap v138: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:55.451462+0000 mgr.smithi067.rdualw (mgr.24569) 173 : cluster [DBG] pgmap v138: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:57.160 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 357 sec latency 360841.026 ms 2022-03-17T15:33:58.160 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 358 sec latency 361841.114 ms 2022-03-17T15:33:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:33:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:57.452462+0000 mgr.smithi067.rdualw (mgr.24569) 174 : cluster [DBG] pgmap v139: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:33:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:57.452462+0000 mgr.smithi067.rdualw (mgr.24569) 174 : cluster [DBG] pgmap v139: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:33:59.160 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 359 sec latency 362841.242 ms 2022-03-17T15:34:00.160 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 360 sec latency 363841.365 ms 2022-03-17T15:34:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:33:59.453393+0000 mgr.smithi067.rdualw (mgr.24569) 175 : cluster [DBG] pgmap v140: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:33:59.453393+0000 mgr.smithi067.rdualw (mgr.24569) 175 : cluster [DBG] pgmap v140: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:01.160 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 361 sec latency 364841.496 ms 2022-03-17T15:34:02.161 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 362 sec latency 365841.595 ms 2022-03-17T15:34:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:01.454723+0000 mgr.smithi067.rdualw (mgr.24569) 176 : cluster [DBG] pgmap v141: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:01.454723+0000 mgr.smithi067.rdualw (mgr.24569) 176 : cluster [DBG] pgmap v141: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:03.160 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 363 sec latency 366841.726 ms 2022-03-17T15:34:04.161 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 364 sec latency 367841.790 ms 2022-03-17T15:34:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:03.455637+0000 mgr.smithi067.rdualw (mgr.24569) 177 : cluster [DBG] pgmap v142: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:03.455637+0000 mgr.smithi067.rdualw (mgr.24569) 177 : cluster [DBG] pgmap v142: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:05.160 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 365 sec latency 368841.830 ms 2022-03-17T15:34:06.161 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 366 sec latency 369841.939 ms 2022-03-17T15:34:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:05.456811+0000 mgr.smithi067.rdualw (mgr.24569) 178 : cluster [DBG] pgmap v143: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:05.456811+0000 mgr.smithi067.rdualw (mgr.24569) 178 : cluster [DBG] pgmap v143: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:07.161 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 367 sec latency 370841.993 ms 2022-03-17T15:34:08.161 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 368 sec latency 371842.061 ms 2022-03-17T15:34:08.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:07.457761+0000 mgr.smithi067.rdualw (mgr.24569) 179 : cluster [DBG] pgmap v144: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:07.457761+0000 mgr.smithi067.rdualw (mgr.24569) 179 : cluster [DBG] pgmap v144: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:09.161 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 369 sec latency 372842.173 ms 2022-03-17T15:34:10.161 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 370 sec latency 373842.287 ms 2022-03-17T15:34:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:09.458602+0000 mgr.smithi067.rdualw (mgr.24569) 180 : cluster [DBG] pgmap v145: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:09.458602+0000 mgr.smithi067.rdualw (mgr.24569) 180 : cluster [DBG] pgmap v145: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:11.161 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 371 sec latency 374842.375 ms 2022-03-17T15:34:11.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:10.685581+0000 mon.smithi067 (mon.1) 70 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:34:11.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:10.687059+0000 mon.smithi067 (mon.1) 71 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:34:11.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:10.687968+0000 mon.smithi067 (mon.1) 72 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:34:11.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:34:10.688793+0000 mgr.smithi067.rdualw (mgr.24569) 181 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:34:11.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:11.115013+0000 mon.smithi061 (mon.0) 182 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:34:11.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:11.121131+0000 mon.smithi061 (mon.0) 183 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:34:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:10.685581+0000 mon.smithi067 (mon.1) 70 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:34:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:10.687059+0000 mon.smithi067 (mon.1) 71 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:34:11.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:10.687968+0000 mon.smithi067 (mon.1) 72 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:34:11.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:34:10.688793+0000 mgr.smithi067.rdualw (mgr.24569) 181 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:34:11.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:11.115013+0000 mon.smithi061 (mon.0) 182 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:34:11.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:11.121131+0000 mon.smithi061 (mon.0) 183 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:34:12.161 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 372 sec latency 375842.506 ms 2022-03-17T15:34:12.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:11.459625+0000 mgr.smithi067.rdualw (mgr.24569) 182 : cluster [DBG] pgmap v146: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:11.459625+0000 mgr.smithi067.rdualw (mgr.24569) 182 : cluster [DBG] pgmap v146: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:13.161 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 373 sec latency 376842.644 ms 2022-03-17T15:34:13.945 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:34:14.161 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 374 sec latency 377842.719 ms 2022-03-17T15:34:14.234 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:34:14.235 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (11m) 4m ago 12m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:34:14.235 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4m) 4m ago 12m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:34:14.235 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4m) 4m ago 12m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:34:14.235 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (11m) 4m ago 12m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:34:14.236 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4m) 4m ago 8m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:34:14.236 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4m) 4m ago 8m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:34:14.236 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5m) 4m ago 14m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:34:14.236 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5m) 4m ago 12m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:34:14.237 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5m) 4m ago 14m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:34:14.237 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5m) 4m ago 12m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:34:14.237 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6m) 4m ago 6m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:34:14.237 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6m) 4m ago 6m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:34:14.237 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (12m) 4m ago 12m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:34:14.238 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (12m) 4m ago 12m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:34:14.238 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (11m) 4m ago 11m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:34:14.238 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (11m) 4m ago 11m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:34:14.238 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (11m) 4m ago 11m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:34:14.238 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (10m) 4m ago 10m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:34:14.239 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (10m) 4m ago 10m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:34:14.239 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (10m) 4m ago 10m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:34:14.239 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (10m) 4m ago 10m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:34:14.239 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (9m) 4m ago 9m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:34:14.240 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (11m) 4m ago 12m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:34:14.577 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:34:14.578 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:34:14.578 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:34:14.578 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:34:14.578 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:34:14.579 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:34:14.579 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:34:14.579 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:34:14.579 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:34:14.580 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:34:14.580 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:34:14.580 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:34:14.580 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:34:14.580 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:34:14.581 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:34:14.581 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:34:14.581 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:34:14.581 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:34:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:13.460456+0000 mgr.smithi067.rdualw (mgr.24569) 183 : cluster [DBG] pgmap v147: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:14.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:13.460456+0000 mgr.smithi067.rdualw (mgr.24569) 183 : cluster [DBG] pgmap v147: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:15.161 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 375 sec latency 378842.826 ms 2022-03-17T15:34:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:13.930411+0000 mgr.smithi067.rdualw (mgr.24569) 184 : audit [DBG] from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:34:15.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:14.216556+0000 mgr.smithi067.rdualw (mgr.24569) 185 : audit [DBG] from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:34:15.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:14.575779+0000 mon.smithi061 (mon.0) 184 : audit [DBG] from='client.? 172.21.15.61:0/2022987783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:34:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:13.930411+0000 mgr.smithi067.rdualw (mgr.24569) 184 : audit [DBG] from='client.34246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:34:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:14.216556+0000 mgr.smithi067.rdualw (mgr.24569) 185 : audit [DBG] from='client.34250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:34:15.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:14.575779+0000 mon.smithi061 (mon.0) 184 : audit [DBG] from='client.? 172.21.15.61:0/2022987783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:34:16.161 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 376 sec latency 379842.878 ms 2022-03-17T15:34:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:15.461747+0000 mgr.smithi067.rdualw (mgr.24569) 186 : cluster [DBG] pgmap v148: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:15.461747+0000 mgr.smithi067.rdualw (mgr.24569) 186 : cluster [DBG] pgmap v148: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:17.161 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 377 sec latency 380842.913 ms 2022-03-17T15:34:18.162 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 378 sec latency 381843.027 ms 2022-03-17T15:34:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:17.462645+0000 mgr.smithi067.rdualw (mgr.24569) 187 : cluster [DBG] pgmap v149: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:17.462645+0000 mgr.smithi067.rdualw (mgr.24569) 187 : cluster [DBG] pgmap v149: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:19.162 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 379 sec latency 382843.114 ms 2022-03-17T15:34:20.162 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 380 sec latency 383843.197 ms 2022-03-17T15:34:20.213 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:19 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: start operation timed out. Terminating. 2022-03-17T15:34:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:19.463371+0000 mgr.smithi067.rdualw (mgr.24569) 188 : cluster [DBG] pgmap v150: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:20.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:19.463371+0000 mgr.smithi067.rdualw (mgr.24569) 188 : cluster [DBG] pgmap v150: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:21.162 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 381 sec latency 384843.656 ms 2022-03-17T15:34:21.302 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:21 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Failed with result 'timeout'. 2022-03-17T15:34:21.302 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:21 smithi061 systemd[1]: Failed to start Ceph osd.0 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:34:22.163 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 382 sec latency 385843.763 ms 2022-03-17T15:34:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:21.464692+0000 mgr.smithi067.rdualw (mgr.24569) 189 : cluster [DBG] pgmap v151: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:21.464692+0000 mgr.smithi067.rdualw (mgr.24569) 189 : cluster [DBG] pgmap v151: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:23.163 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 383 sec latency 386843.831 ms 2022-03-17T15:34:24.163 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 384 sec latency 387843.958 ms 2022-03-17T15:34:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:23.465661+0000 mgr.smithi067.rdualw (mgr.24569) 190 : cluster [DBG] pgmap v152: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:23.465661+0000 mgr.smithi067.rdualw (mgr.24569) 190 : cluster [DBG] pgmap v152: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:25.163 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 385 sec latency 388844.084 ms 2022-03-17T15:34:26.163 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 386 sec latency 389844.149 ms 2022-03-17T15:34:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:25.466895+0000 mgr.smithi067.rdualw (mgr.24569) 191 : cluster [DBG] pgmap v153: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:25.466895+0000 mgr.smithi067.rdualw (mgr.24569) 191 : cluster [DBG] pgmap v153: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:27.164 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 387 sec latency 390844.282 ms 2022-03-17T15:34:28.163 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 388 sec latency 391844.324 ms 2022-03-17T15:34:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:27.467740+0000 mgr.smithi067.rdualw (mgr.24569) 192 : cluster [DBG] pgmap v154: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:27.467740+0000 mgr.smithi067.rdualw (mgr.24569) 192 : cluster [DBG] pgmap v154: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:29.163 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 389 sec latency 392844.421 ms 2022-03-17T15:34:30.163 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 390 sec latency 393844.521 ms 2022-03-17T15:34:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:29.468783+0000 mgr.smithi067.rdualw (mgr.24569) 193 : cluster [DBG] pgmap v155: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:29.468783+0000 mgr.smithi067.rdualw (mgr.24569) 193 : cluster [DBG] pgmap v155: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:31.163 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 391 sec latency 394844.611 ms 2022-03-17T15:34:31.496 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:31 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Service RestartSec=10s expired, scheduling restart. 2022-03-17T15:34:31.497 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:31 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 2. 2022-03-17T15:34:31.497 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:31 smithi061 systemd[1]: Stopped Ceph osd.0 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:34:31.497 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:31 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 79267 (bash) in control group while starting unit. Ignoring. 2022-03-17T15:34:31.497 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:31 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:34:31.497 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:31 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 79348 (podman) in control group while starting unit. Ignoring. 2022-03-17T15:34:31.498 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:31 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:34:31.498 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:31 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 79365 (conmon) in control group while starting unit. Ignoring. 2022-03-17T15:34:31.498 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:31 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:34:31.498 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:31 smithi061 systemd[1]: Starting Ceph osd.0 for ae1b9b88-a605-11ec-8c35-001a4aab830c... 2022-03-17T15:34:31.499 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:31 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 79267 (bash) in control group while starting unit. Ignoring. 2022-03-17T15:34:31.499 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:31 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:34:31.499 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:31 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 79348 (podman) in control group while starting unit. Ignoring. 2022-03-17T15:34:31.499 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:31 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:34:31.500 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:31 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 79365 (conmon) in control group while starting unit. Ignoring. 2022-03-17T15:34:31.500 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:31 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:34:31.802 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:31 smithi061 bash[79921]: e96710c0268178a2cad8f4876038ed7a8ffee39e44441cd76c1119ecc9c27d7e 2022-03-17T15:34:32.164 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 392 sec latency 395844.661 ms 2022-03-17T15:34:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:31.470022+0000 mgr.smithi067.rdualw (mgr.24569) 194 : cluster [DBG] pgmap v156: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:32.803 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:34:32 smithi061 bash[79348]: time="2022-03-17T15:34:32Z" level=error msg="Could not retrieve exit code from event: died not found: unable to find event" 2022-03-17T15:34:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:31.470022+0000 mgr.smithi067.rdualw (mgr.24569) 194 : cluster [DBG] pgmap v156: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:33.164 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 393 sec latency 396845.158 ms 2022-03-17T15:34:34.164 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 394 sec latency 397845.233 ms 2022-03-17T15:34:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:33.470858+0000 mgr.smithi067.rdualw (mgr.24569) 195 : cluster [DBG] pgmap v157: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:34.469524+0000 mon.smithi067 (mon.1) 73 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:34:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:34.470100+0000 mon.smithi061 (mon.0) 185 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:34:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:34.472343+0000 mon.smithi067 (mon.1) 74 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:34:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:34.472782+0000 mon.smithi061 (mon.0) 186 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:34:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:33.470858+0000 mgr.smithi067.rdualw (mgr.24569) 195 : cluster [DBG] pgmap v157: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:34.469524+0000 mon.smithi067 (mon.1) 73 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:34:34.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:34.470100+0000 mon.smithi061 (mon.0) 185 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:34:34.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:34.472343+0000 mon.smithi067 (mon.1) 74 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:34:34.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:34.472782+0000 mon.smithi061 (mon.0) 186 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:34:35.165 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 395 sec latency 398845.347 ms 2022-03-17T15:34:36.164 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 396 sec latency 399845.426 ms 2022-03-17T15:34:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:35.472002+0000 mgr.smithi067.rdualw (mgr.24569) 196 : cluster [DBG] pgmap v158: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:35.472002+0000 mgr.smithi067.rdualw (mgr.24569) 196 : cluster [DBG] pgmap v158: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:37.164 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 397 sec latency 400845.543 ms 2022-03-17T15:34:38.164 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 398 sec latency 401845.667 ms 2022-03-17T15:34:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:37.472846+0000 mgr.smithi067.rdualw (mgr.24569) 197 : cluster [DBG] pgmap v159: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:37.576826+0000 mds.foofs.smithi061.atvhsa (mds.0) 5 : cluster [WRN] evicting unresponsive client smithi067:foo1 (24377), after 303.989 seconds 2022-03-17T15:34:38.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:37.576866+0000 mds.foofs.smithi061.atvhsa (mds.0) 6 : cluster [INF] Evicting (and blocklisting) client session 24377 (172.21.15.67:0/3617437279) 2022-03-17T15:34:38.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:37.576916+0000 mds.foofs.smithi061.atvhsa (mds.0) 7 : cluster [WRN] evicting unresponsive client smithi061:foo1 (14546), after 303.989 seconds 2022-03-17T15:34:38.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:37.576923+0000 mds.foofs.smithi061.atvhsa (mds.0) 8 : cluster [INF] Evicting (and blocklisting) client session 14546 (172.21.15.61:0/2505406626) 2022-03-17T15:34:38.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:37.577177+0000 mon.smithi061 (mon.0) 187 : audit [INF] from='mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680]' entity='mds.foofs.smithi061.atvhsa' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.67:0/3617437279"}]: dispatch 2022-03-17T15:34:38.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:37.577440+0000 mon.smithi061 (mon.0) 188 : audit [INF] from='mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680]' entity='mds.foofs.smithi061.atvhsa' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.61:0/2505406626"}]: dispatch 2022-03-17T15:34:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:37.472846+0000 mgr.smithi067.rdualw (mgr.24569) 197 : cluster [DBG] pgmap v159: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:37.576826+0000 mds.foofs.smithi061.atvhsa (mds.0) 5 : cluster [WRN] evicting unresponsive client smithi067:foo1 (24377), after 303.989 seconds 2022-03-17T15:34:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:37.576866+0000 mds.foofs.smithi061.atvhsa (mds.0) 6 : cluster [INF] Evicting (and blocklisting) client session 24377 (172.21.15.67:0/3617437279) 2022-03-17T15:34:38.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:37.576916+0000 mds.foofs.smithi061.atvhsa (mds.0) 7 : cluster [WRN] evicting unresponsive client smithi061:foo1 (14546), after 303.989 seconds 2022-03-17T15:34:38.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:37.576923+0000 mds.foofs.smithi061.atvhsa (mds.0) 8 : cluster [INF] Evicting (and blocklisting) client session 14546 (172.21.15.61:0/2505406626) 2022-03-17T15:34:38.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:37.577177+0000 mon.smithi061 (mon.0) 187 : audit [INF] from='mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680]' entity='mds.foofs.smithi061.atvhsa' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.67:0/3617437279"}]: dispatch 2022-03-17T15:34:38.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:37.577440+0000 mon.smithi061 (mon.0) 188 : audit [INF] from='mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680]' entity='mds.foofs.smithi061.atvhsa' cmd=[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.61:0/2505406626"}]: dispatch 2022-03-17T15:34:39.165 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 399 sec latency 402845.799 ms 2022-03-17T15:34:39.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:38.545506+0000 mon.smithi061 (mon.0) 189 : audit [INF] from='mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680]' entity='mds.foofs.smithi061.atvhsa' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.67:0/3617437279"}]': finished 2022-03-17T15:34:39.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:38.545630+0000 mon.smithi061 (mon.0) 190 : audit [INF] from='mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680]' entity='mds.foofs.smithi061.atvhsa' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.61:0/2505406626"}]': finished 2022-03-17T15:34:39.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:38.545726+0000 mon.smithi061 (mon.0) 191 : cluster [DBG] osdmap e75: 8 total, 7 up, 8 in 2022-03-17T15:34:39.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:38.556066+0000 mon.smithi061 (mon.0) 192 : cluster [INF] daemon mds.foofs.smithi061.atvhsa is now active in filesystem foofs as rank 0 2022-03-17T15:34:39.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:38.545506+0000 mon.smithi061 (mon.0) 189 : audit [INF] from='mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680]' entity='mds.foofs.smithi061.atvhsa' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.67:0/3617437279"}]': finished 2022-03-17T15:34:39.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:38.545630+0000 mon.smithi061 (mon.0) 190 : audit [INF] from='mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680]' entity='mds.foofs.smithi061.atvhsa' cmd='[{"prefix":"osd blocklist", "blocklistop":"add","addr":"172.21.15.61:0/2505406626"}]': finished 2022-03-17T15:34:39.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:38.545726+0000 mon.smithi061 (mon.0) 191 : cluster [DBG] osdmap e75: 8 total, 7 up, 8 in 2022-03-17T15:34:39.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:38.556066+0000 mon.smithi061 (mon.0) 192 : cluster [INF] daemon mds.foofs.smithi061.atvhsa is now active in filesystem foofs as rank 0 2022-03-17T15:34:40.165 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 400 sec latency 403845.876 ms 2022-03-17T15:34:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:39.473817+0000 mgr.smithi067.rdualw (mgr.24569) 198 : cluster [DBG] pgmap v161: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:39.541600+0000 mon.smithi061 (mon.0) 193 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2022-03-17T15:34:40.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:39.547972+0000 mon.smithi061 (mon.0) 194 : cluster [DBG] mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680] up:active 2022-03-17T15:34:40.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:39.548042+0000 mon.smithi061 (mon.0) 195 : cluster [DBG] fsmap foofs:1 {0=foofs.smithi061.atvhsa=up:active} 1 up:standby 2022-03-17T15:34:40.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:39.473817+0000 mgr.smithi067.rdualw (mgr.24569) 198 : cluster [DBG] pgmap v161: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:40.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:39.541600+0000 mon.smithi061 (mon.0) 193 : cluster [INF] Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2022-03-17T15:34:40.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:39.547972+0000 mon.smithi061 (mon.0) 194 : cluster [DBG] mds.? [v2:172.21.15.61:6834/2663754680,v1:172.21.15.61:6835/2663754680] up:active 2022-03-17T15:34:40.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:39.548042+0000 mon.smithi061 (mon.0) 195 : cluster [DBG] fsmap foofs:1 {0=foofs.smithi061.atvhsa=up:active} 1 up:standby 2022-03-17T15:34:41.165 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 401 sec latency 404845.943 ms 2022-03-17T15:34:42.165 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 402 sec latency 405846.051 ms 2022-03-17T15:34:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:41.270556+0000 mon.smithi061 (mon.0) 196 : cluster [DBG] mgrmap e39: smithi067.rdualw(active, since 5m) 2022-03-17T15:34:42.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:41.474991+0000 mgr.smithi067.rdualw (mgr.24569) 199 : cluster [DBG] pgmap v162: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 1.6 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:41.270556+0000 mon.smithi061 (mon.0) 196 : cluster [DBG] mgrmap e39: smithi067.rdualw(active, since 5m) 2022-03-17T15:34:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:41.474991+0000 mgr.smithi067.rdualw (mgr.24569) 199 : cluster [DBG] pgmap v162: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 1.6 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:43.165 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 403 sec latency 406846.125 ms 2022-03-17T15:34:44.165 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 404 sec latency 407846.234 ms 2022-03-17T15:34:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:43.476068+0000 mgr.smithi067.rdualw (mgr.24569) 200 : cluster [DBG] pgmap v163: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 1.6 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:43.476068+0000 mgr.smithi067.rdualw (mgr.24569) 200 : cluster [DBG] pgmap v163: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 1.6 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:44.903 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:34:45.165 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 405 sec latency 408846.288 ms 2022-03-17T15:34:45.193 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:34:45.193 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (12m) 4m ago 13m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:34:45.194 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4m) 4m ago 13m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:34:45.194 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4m) 4m ago 12m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:34:45.194 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (12m) 4m ago 13m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:34:45.194 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5m) 4m ago 9m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:34:45.195 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5m) 4m ago 9m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:34:45.195 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6m) 4m ago 14m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:34:45.195 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6m) 4m ago 12m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:34:45.195 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5m) 4m ago 14m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:34:45.196 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5m) 4m ago 12m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:34:45.196 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6m) 4m ago 6m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:34:45.196 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6m) 4m ago 6m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:34:45.196 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (13m) 4m ago 13m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:34:45.197 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (12m) 4m ago 12m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:34:45.197 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (12m) 4m ago 12m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:34:45.197 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (11m) 4m ago 11m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:34:45.198 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (11m) 4m ago 11m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:34:45.198 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (11m) 4m ago 11m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:34:45.198 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (11m) 4m ago 11m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:34:45.199 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (10m) 4m ago 10m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:34:45.199 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (10m) 4m ago 10m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:34:45.200 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (10m) 4m ago 10m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:34:45.200 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (12m) 4m ago 13m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:34:45.536 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:34:45.536 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:34:45.536 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:34:45.536 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:34:45.537 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:34:45.537 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:34:45.537 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:34:45.537 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:34:45.538 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:34:45.538 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:34:45.538 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:34:45.538 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:34:45.539 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:34:45.539 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:34:45.539 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:34:45.539 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:34:45.539 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:34:45.540 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:34:46.165 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 406 sec latency 409846.379 ms 2022-03-17T15:34:46.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:44.887894+0000 mgr.smithi067.rdualw (mgr.24569) 201 : audit [DBG] from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:34:46.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:45.173992+0000 mgr.smithi067.rdualw (mgr.24569) 202 : audit [DBG] from='client.34270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:34:46.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:45.477172+0000 mgr.smithi067.rdualw (mgr.24569) 203 : cluster [DBG] pgmap v164: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 5.3 KiB/s wr, 3 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:46.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:45.534173+0000 mon.smithi061 (mon.0) 197 : audit [DBG] from='client.? 172.21.15.61:0/1430772483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:34:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:44.887894+0000 mgr.smithi067.rdualw (mgr.24569) 201 : audit [DBG] from='client.34266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:34:46.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:45.173992+0000 mgr.smithi067.rdualw (mgr.24569) 202 : audit [DBG] from='client.34270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:34:46.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:45.477172+0000 mgr.smithi067.rdualw (mgr.24569) 203 : cluster [DBG] pgmap v164: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 5.3 KiB/s wr, 3 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:46.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:45.534173+0000 mon.smithi061 (mon.0) 197 : audit [DBG] from='client.? 172.21.15.61:0/1430772483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:34:47.165 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 407 sec latency 410846.474 ms 2022-03-17T15:34:48.166 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 408 sec latency 411846.584 ms 2022-03-17T15:34:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:47.477953+0000 mgr.smithi067.rdualw (mgr.24569) 204 : cluster [DBG] pgmap v165: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 5.3 KiB/s wr, 3 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:47.477953+0000 mgr.smithi067.rdualw (mgr.24569) 204 : cluster [DBG] pgmap v165: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 5.3 KiB/s wr, 3 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 409 sec latency 412846.691 ms 2022-03-17T15:34:50.170 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 410 sec latency 413846.777 ms 2022-03-17T15:34:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:34:49.434991+0000 mon.smithi061 (mon.0) 198 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:34:50.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:49.478866+0000 mgr.smithi067.rdualw (mgr.24569) 205 : cluster [DBG] pgmap v166: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 187 B/s rd, 4.8 KiB/s wr, 2 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:34:49.434991+0000 mon.smithi061 (mon.0) 198 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:34:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:49.478866+0000 mgr.smithi067.rdualw (mgr.24569) 205 : cluster [DBG] pgmap v166: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 187 B/s rd, 4.8 KiB/s wr, 2 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:51.166 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 411 sec latency 414846.827 ms 2022-03-17T15:34:52.166 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 412 sec latency 415846.893 ms 2022-03-17T15:34:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:51.480031+0000 mgr.smithi067.rdualw (mgr.24569) 206 : cluster [DBG] pgmap v167: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 5.2 KiB/s wr, 2 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:51.480031+0000 mgr.smithi067.rdualw (mgr.24569) 206 : cluster [DBG] pgmap v167: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 5.2 KiB/s wr, 2 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:53.166 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 413 sec latency 416846.970 ms 2022-03-17T15:34:54.166 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 414 sec latency 417847.071 ms 2022-03-17T15:34:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:53.480995+0000 mgr.smithi067.rdualw (mgr.24569) 207 : cluster [DBG] pgmap v168: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 3.9 KiB/s wr, 2 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:53.480995+0000 mgr.smithi067.rdualw (mgr.24569) 207 : cluster [DBG] pgmap v168: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 3.9 KiB/s wr, 2 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:55.166 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 415 sec latency 418847.154 ms 2022-03-17T15:34:56.166 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 416 sec latency 419847.273 ms 2022-03-17T15:34:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:55.482167+0000 mgr.smithi067.rdualw (mgr.24569) 208 : cluster [DBG] pgmap v169: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 4.5 KiB/s wr, 2 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:55.482167+0000 mgr.smithi067.rdualw (mgr.24569) 208 : cluster [DBG] pgmap v169: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 4.5 KiB/s wr, 2 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:57.166 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 417 sec latency 420847.367 ms 2022-03-17T15:34:58.166 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 418 sec latency 421847.474 ms 2022-03-17T15:34:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:34:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:57.483074+0000 mgr.smithi067.rdualw (mgr.24569) 209 : cluster [DBG] pgmap v170: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.4 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:34:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:57.483074+0000 mgr.smithi067.rdualw (mgr.24569) 209 : cluster [DBG] pgmap v170: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.4 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:34:59.166 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 419 sec latency 422847.599 ms 2022-03-17T15:35:00.166 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 420 sec latency 423847.637 ms 2022-03-17T15:35:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:34:59.484117+0000 mgr.smithi067.rdualw (mgr.24569) 210 : cluster [DBG] pgmap v171: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.4 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:34:59.484117+0000 mgr.smithi067.rdualw (mgr.24569) 210 : cluster [DBG] pgmap v171: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.4 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:01.167 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 421 sec latency 424847.758 ms 2022-03-17T15:35:02.167 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 422 sec latency 425847.884 ms 2022-03-17T15:35:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:01.485448+0000 mgr.smithi067.rdualw (mgr.24569) 211 : cluster [DBG] pgmap v172: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 2.0 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:01.485448+0000 mgr.smithi067.rdualw (mgr.24569) 211 : cluster [DBG] pgmap v172: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 2.0 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:03.167 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 423 sec latency 426847.933 ms 2022-03-17T15:35:04.167 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 424 sec latency 427848.029 ms 2022-03-17T15:35:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:03.486350+0000 mgr.smithi067.rdualw (mgr.24569) 212 : cluster [DBG] pgmap v173: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:03.486350+0000 mgr.smithi067.rdualw (mgr.24569) 212 : cluster [DBG] pgmap v173: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:05.168 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 425 sec latency 428848.104 ms 2022-03-17T15:35:06.167 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 426 sec latency 429848.199 ms 2022-03-17T15:35:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:05.487727+0000 mgr.smithi067.rdualw (mgr.24569) 213 : cluster [DBG] pgmap v174: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:05.487727+0000 mgr.smithi067.rdualw (mgr.24569) 213 : cluster [DBG] pgmap v174: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:07.167 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 427 sec latency 430848.320 ms 2022-03-17T15:35:08.167 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 428 sec latency 431848.403 ms 2022-03-17T15:35:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:07.488623+0000 mgr.smithi067.rdualw (mgr.24569) 214 : cluster [DBG] pgmap v175: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 682 B/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:07.488623+0000 mgr.smithi067.rdualw (mgr.24569) 214 : cluster [DBG] pgmap v175: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 682 B/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:09.167 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 429 sec latency 432848.506 ms 2022-03-17T15:35:10.167 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 430 sec latency 433848.630 ms 2022-03-17T15:35:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:09.489680+0000 mgr.smithi067.rdualw (mgr.24569) 215 : cluster [DBG] pgmap v176: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 682 B/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:09.489680+0000 mgr.smithi067.rdualw (mgr.24569) 215 : cluster [DBG] pgmap v176: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 682 B/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:11.167 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 431 sec latency 434848.686 ms 2022-03-17T15:35:11.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:35:11.125342+0000 mon.smithi067 (mon.1) 75 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:35:11.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:35:11.126852+0000 mon.smithi067 (mon.1) 76 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:35:11.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:35:11.127767+0000 mon.smithi067 (mon.1) 77 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:35:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:35:11.125342+0000 mon.smithi067 (mon.1) 75 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:35:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:35:11.126852+0000 mon.smithi067 (mon.1) 76 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:35:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:35:11.127767+0000 mon.smithi067 (mon.1) 77 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:35:12.167 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 432 sec latency 435848.736 ms 2022-03-17T15:35:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:35:11.128633+0000 mgr.smithi067.rdualw (mgr.24569) 216 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:35:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:11.490695+0000 mgr.smithi067.rdualw (mgr.24569) 217 : cluster [DBG] pgmap v177: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.3 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:12.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:35:11.562221+0000 mon.smithi061 (mon.0) 199 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:35:12.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:35:11.568291+0000 mon.smithi061 (mon.0) 200 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:35:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:35:11.128633+0000 mgr.smithi067.rdualw (mgr.24569) 216 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:35:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:11.490695+0000 mgr.smithi067.rdualw (mgr.24569) 217 : cluster [DBG] pgmap v177: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.3 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:35:11.562221+0000 mon.smithi061 (mon.0) 199 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:35:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:35:11.568291+0000 mon.smithi061 (mon.0) 200 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:35:13.167 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 433 sec latency 436848.827 ms 2022-03-17T15:35:14.168 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 434 sec latency 437848.911 ms 2022-03-17T15:35:14.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:13.491541+0000 mgr.smithi067.rdualw (mgr.24569) 218 : cluster [DBG] pgmap v178: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 767 B/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:13.491541+0000 mgr.smithi067.rdualw (mgr.24569) 218 : cluster [DBG] pgmap v178: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 767 B/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:15.169 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 435 sec latency 438849.006 ms 2022-03-17T15:35:15.864 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:35:16.155 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:35:16.155 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (12m) 5m ago 13m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:35:16.155 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5m) 5m ago 13m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:35:16.156 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5m) 5m ago 13m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:35:16.156 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (12m) 5m ago 13m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:35:16.156 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5m) 5m ago 9m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:35:16.156 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5m) 5m ago 9m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:35:16.157 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6m) 5m ago 15m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:35:16.157 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6m) 5m ago 13m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:35:16.157 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6m) 5m ago 15m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:35:16.157 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6m) 5m ago 13m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:35:16.157 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (7m) 5m ago 7m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:35:16.158 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (7m) 5m ago 7m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:35:16.158 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (13m) 5m ago 13m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:35:16.158 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (13m) 5m ago 13m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:35:16.158 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (12m) 5m ago 12m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:35:16.159 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (12m) 5m ago 12m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:35:16.159 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (12m) 5m ago 12m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:35:16.160 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (11m) 5m ago 11m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:35:16.160 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (11m) 5m ago 11m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:35:16.160 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (11m) 5m ago 11m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:35:16.161 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (11m) 5m ago 11m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:35:16.161 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (10m) 5m ago 10m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:35:16.161 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (12m) 5m ago 13m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:35:16.168 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 436 sec latency 439849.065 ms 2022-03-17T15:35:16.495 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:35:16.496 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:35:16.496 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:35:16.497 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:35:16.497 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:35:16.498 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:35:16.498 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:35:16.498 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:35:16.498 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:35:16.499 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:35:16.499 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:35:16.499 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:35:16.499 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:35:16.499 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:35:16.500 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:35:16.500 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:35:16.501 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:35:16.501 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:35:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:15.492723+0000 mgr.smithi067.rdualw (mgr.24569) 219 : cluster [DBG] pgmap v179: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.3 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:35:15.849139+0000 mgr.smithi067.rdualw (mgr.24569) 220 : audit [DBG] from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:35:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:35:16.493573+0000 mon.smithi061 (mon.0) 201 : audit [DBG] from='client.? 172.21.15.61:0/830875758' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:35:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:15.492723+0000 mgr.smithi067.rdualw (mgr.24569) 219 : cluster [DBG] pgmap v179: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.3 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:35:15.849139+0000 mgr.smithi067.rdualw (mgr.24569) 220 : audit [DBG] from='client.34278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:35:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:35:16.493573+0000 mon.smithi061 (mon.0) 201 : audit [DBG] from='client.? 172.21.15.61:0/830875758' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:35:17.168 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 437 sec latency 440849.165 ms 2022-03-17T15:35:18.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:35:16.136769+0000 mgr.smithi067.rdualw (mgr.24569) 221 : audit [DBG] from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:35:18.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:35:16.136769+0000 mgr.smithi067.rdualw (mgr.24569) 221 : audit [DBG] from='client.34282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:35:18.168 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 438 sec latency 441849.301 ms 2022-03-17T15:35:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:17.493576+0000 mgr.smithi067.rdualw (mgr.24569) 222 : cluster [DBG] pgmap v180: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:17.493576+0000 mgr.smithi067.rdualw (mgr.24569) 222 : cluster [DBG] pgmap v180: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:19.168 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 439 sec latency 442849.393 ms 2022-03-17T15:35:20.168 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 440 sec latency 443849.483 ms 2022-03-17T15:35:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:19.494418+0000 mgr.smithi067.rdualw (mgr.24569) 223 : cluster [DBG] pgmap v181: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:19.494418+0000 mgr.smithi067.rdualw (mgr.24569) 223 : cluster [DBG] pgmap v181: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:21.168 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 441 sec latency 444849.580 ms 2022-03-17T15:35:22.168 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 442 sec latency 445849.727 ms 2022-03-17T15:35:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:21.495667+0000 mgr.smithi067.rdualw (mgr.24569) 224 : cluster [DBG] pgmap v182: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:21.495667+0000 mgr.smithi067.rdualw (mgr.24569) 224 : cluster [DBG] pgmap v182: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:23.169 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 443 sec latency 446849.792 ms 2022-03-17T15:35:24.169 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 444 sec latency 447849.907 ms 2022-03-17T15:35:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:23.496514+0000 mgr.smithi067.rdualw (mgr.24569) 225 : cluster [DBG] pgmap v183: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:23.496514+0000 mgr.smithi067.rdualw (mgr.24569) 225 : cluster [DBG] pgmap v183: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:25.169 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 445 sec latency 448850.032 ms 2022-03-17T15:35:26.169 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 446 sec latency 449850.139 ms 2022-03-17T15:35:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:25.497729+0000 mgr.smithi067.rdualw (mgr.24569) 226 : cluster [DBG] pgmap v184: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:25.497729+0000 mgr.smithi067.rdualw (mgr.24569) 226 : cluster [DBG] pgmap v184: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:27.169 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 447 sec latency 450850.251 ms 2022-03-17T15:35:28.169 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 448 sec latency 451850.329 ms 2022-03-17T15:35:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:27.498636+0000 mgr.smithi067.rdualw (mgr.24569) 227 : cluster [DBG] pgmap v185: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:27.498636+0000 mgr.smithi067.rdualw (mgr.24569) 227 : cluster [DBG] pgmap v185: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:29.169 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 449 sec latency 452850.412 ms 2022-03-17T15:35:30.169 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 450 sec latency 453850.521 ms 2022-03-17T15:35:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:29.499575+0000 mgr.smithi067.rdualw (mgr.24569) 228 : cluster [DBG] pgmap v186: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:29.499575+0000 mgr.smithi067.rdualw (mgr.24569) 228 : cluster [DBG] pgmap v186: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:31.169 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 451 sec latency 454850.618 ms 2022-03-17T15:35:32.169 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 452 sec latency 455850.748 ms 2022-03-17T15:35:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:31.500997+0000 mgr.smithi067.rdualw (mgr.24569) 229 : cluster [DBG] pgmap v187: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:31.500997+0000 mgr.smithi067.rdualw (mgr.24569) 229 : cluster [DBG] pgmap v187: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:33.171 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 453 sec latency 456850.863 ms 2022-03-17T15:35:34.170 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 454 sec latency 457850.924 ms 2022-03-17T15:35:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:33.501900+0000 mgr.smithi067.rdualw (mgr.24569) 230 : cluster [DBG] pgmap v188: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:34.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:35:34.472123+0000 mon.smithi067 (mon.1) 78 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:35:34.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:35:34.472830+0000 mon.smithi061 (mon.0) 202 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:35:34.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:35:34.475071+0000 mon.smithi067 (mon.1) 79 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:35:34.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:35:34.475657+0000 mon.smithi061 (mon.0) 203 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:35:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:33.501900+0000 mgr.smithi067.rdualw (mgr.24569) 230 : cluster [DBG] pgmap v188: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:35:34.472123+0000 mon.smithi067 (mon.1) 78 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:35:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:35:34.472830+0000 mon.smithi061 (mon.0) 202 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:35:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:35:34.475071+0000 mon.smithi067 (mon.1) 79 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:35:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:35:34.475657+0000 mon.smithi061 (mon.0) 203 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:35:35.170 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 455 sec latency 458851.053 ms 2022-03-17T15:35:36.171 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 456 sec latency 459851.168 ms 2022-03-17T15:35:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:35.503279+0000 mgr.smithi067.rdualw (mgr.24569) 231 : cluster [DBG] pgmap v189: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:35.503279+0000 mgr.smithi067.rdualw (mgr.24569) 231 : cluster [DBG] pgmap v189: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:37.170 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 457 sec latency 460851.272 ms 2022-03-17T15:35:38.170 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 458 sec latency 461851.406 ms 2022-03-17T15:35:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:37.504306+0000 mgr.smithi067.rdualw (mgr.24569) 232 : cluster [DBG] pgmap v190: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:37.504306+0000 mgr.smithi067.rdualw (mgr.24569) 232 : cluster [DBG] pgmap v190: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:39.170 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 459 sec latency 462851.533 ms 2022-03-17T15:35:40.170 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 460 sec latency 463851.632 ms 2022-03-17T15:35:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:39.505124+0000 mgr.smithi067.rdualw (mgr.24569) 233 : cluster [DBG] pgmap v191: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:39.505124+0000 mgr.smithi067.rdualw (mgr.24569) 233 : cluster [DBG] pgmap v191: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:41.170 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 461 sec latency 464851.767 ms 2022-03-17T15:35:42.171 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 462 sec latency 465851.810 ms 2022-03-17T15:35:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:41.506330+0000 mgr.smithi067.rdualw (mgr.24569) 234 : cluster [DBG] pgmap v192: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:41.506330+0000 mgr.smithi067.rdualw (mgr.24569) 234 : cluster [DBG] pgmap v192: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:43.170 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 463 sec latency 466851.887 ms 2022-03-17T15:35:44.171 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 464 sec latency 467852.015 ms 2022-03-17T15:35:44.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:43.507177+0000 mgr.smithi067.rdualw (mgr.24569) 235 : cluster [DBG] pgmap v193: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:43.507177+0000 mgr.smithi067.rdualw (mgr.24569) 235 : cluster [DBG] pgmap v193: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:45.171 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 465 sec latency 468852.142 ms 2022-03-17T15:35:46.173 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 466 sec latency 469852.194 ms 2022-03-17T15:35:46.818 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:35:47.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:45.508388+0000 mgr.smithi067.rdualw (mgr.24569) 236 : cluster [DBG] pgmap v194: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:45.508388+0000 mgr.smithi067.rdualw (mgr.24569) 236 : cluster [DBG] pgmap v194: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:47.110 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:35:47.111 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (13m) 5m ago 14m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:35:47.112 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6m) 5m ago 14m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:35:47.112 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5m) 5m ago 13m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:35:47.113 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (13m) 5m ago 14m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:35:47.113 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6m) 5m ago 10m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:35:47.114 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6m) 5m ago 10m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:35:47.116 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (7m) 5m ago 15m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:35:47.116 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (7m) 5m ago 13m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:35:47.116 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6m) 5m ago 15m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:35:47.117 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6m) 5m ago 13m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:35:47.118 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (7m) 5m ago 7m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:35:47.118 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (7m) 5m ago 7m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:35:47.119 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (14m) 5m ago 14m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:35:47.119 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (13m) 5m ago 13m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:35:47.120 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (13m) 5m ago 13m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:35:47.120 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (12m) 5m ago 12m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:35:47.121 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (12m) 5m ago 12m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:35:47.121 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (12m) 5m ago 12m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:35:47.122 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (12m) 5m ago 12m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:35:47.122 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (11m) 5m ago 11m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:35:47.122 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (11m) 5m ago 11m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:35:47.123 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (11m) 5m ago 11m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:35:47.123 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (13m) 5m ago 14m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:35:47.171 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 467 sec latency 470852.231 ms 2022-03-17T15:35:47.449 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:35:47.450 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:35:47.451 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:35:47.451 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:35:47.451 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:35:47.451 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:35:47.452 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:35:47.452 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:35:47.452 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:35:47.452 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:35:47.452 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:35:47.453 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:35:47.453 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:35:47.453 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:35:47.453 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:35:47.454 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:35:47.454 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:35:47.454 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:35:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:35:46.803471+0000 mgr.smithi067.rdualw (mgr.24569) 237 : audit [DBG] from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:35:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:35:47.447472+0000 mon.smithi061 (mon.0) 204 : audit [DBG] from='client.? 172.21.15.61:0/3454142194' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:35:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:35:46.803471+0000 mgr.smithi067.rdualw (mgr.24569) 237 : audit [DBG] from='client.34290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:35:48.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:35:47.447472+0000 mon.smithi061 (mon.0) 204 : audit [DBG] from='client.? 172.21.15.61:0/3454142194' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:35:48.171 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 468 sec latency 471852.320 ms 2022-03-17T15:35:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:35:47.091686+0000 mgr.smithi067.rdualw (mgr.24569) 238 : audit [DBG] from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:35:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:47.509161+0000 mgr.smithi067.rdualw (mgr.24569) 239 : cluster [DBG] pgmap v195: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:35:47.091686+0000 mgr.smithi067.rdualw (mgr.24569) 238 : audit [DBG] from='client.34294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:35:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:47.509161+0000 mgr.smithi067.rdualw (mgr.24569) 239 : cluster [DBG] pgmap v195: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:49.171 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 469 sec latency 472852.435 ms 2022-03-17T15:35:50.171 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 470 sec latency 473852.541 ms 2022-03-17T15:35:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:49.510248+0000 mgr.smithi067.rdualw (mgr.24569) 240 : cluster [DBG] pgmap v196: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:49.510248+0000 mgr.smithi067.rdualw (mgr.24569) 240 : cluster [DBG] pgmap v196: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:51.171 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 471 sec latency 474852.644 ms 2022-03-17T15:35:52.172 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 472 sec latency 475852.756 ms 2022-03-17T15:35:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:51.511710+0000 mgr.smithi067.rdualw (mgr.24569) 241 : cluster [DBG] pgmap v197: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:51.511710+0000 mgr.smithi067.rdualw (mgr.24569) 241 : cluster [DBG] pgmap v197: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:53.172 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 473 sec latency 476852.888 ms 2022-03-17T15:35:54.172 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 474 sec latency 477852.939 ms 2022-03-17T15:35:54.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:53.512638+0000 mgr.smithi067.rdualw (mgr.24569) 242 : cluster [DBG] pgmap v198: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:53.512638+0000 mgr.smithi067.rdualw (mgr.24569) 242 : cluster [DBG] pgmap v198: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:55.172 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 475 sec latency 478852.997 ms 2022-03-17T15:35:56.172 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 476 sec latency 479853.113 ms 2022-03-17T15:35:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:55.513754+0000 mgr.smithi067.rdualw (mgr.24569) 243 : cluster [DBG] pgmap v199: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:55.513754+0000 mgr.smithi067.rdualw (mgr.24569) 243 : cluster [DBG] pgmap v199: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:57.172 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 477 sec latency 480853.227 ms 2022-03-17T15:35:58.172 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 478 sec latency 481853.340 ms 2022-03-17T15:35:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:35:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:57.514641+0000 mgr.smithi067.rdualw (mgr.24569) 244 : cluster [DBG] pgmap v200: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:35:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:57.514641+0000 mgr.smithi067.rdualw (mgr.24569) 244 : cluster [DBG] pgmap v200: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:35:59.172 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 479 sec latency 482853.412 ms 2022-03-17T15:36:00.172 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 480 sec latency 483853.520 ms 2022-03-17T15:36:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:35:59.515527+0000 mgr.smithi067.rdualw (mgr.24569) 245 : cluster [DBG] pgmap v201: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:00.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:35:59.515527+0000 mgr.smithi067.rdualw (mgr.24569) 245 : cluster [DBG] pgmap v201: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:01.173 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 481 sec latency 484853.627 ms 2022-03-17T15:36:02.172 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 482 sec latency 485853.680 ms 2022-03-17T15:36:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:01.516855+0000 mgr.smithi067.rdualw (mgr.24569) 246 : cluster [DBG] pgmap v202: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:01.516855+0000 mgr.smithi067.rdualw (mgr.24569) 246 : cluster [DBG] pgmap v202: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:03.172 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 483 sec latency 486853.775 ms 2022-03-17T15:36:04.173 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 484 sec latency 487853.868 ms 2022-03-17T15:36:04.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:03.517826+0000 mgr.smithi067.rdualw (mgr.24569) 247 : cluster [DBG] pgmap v203: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:03.517826+0000 mgr.smithi067.rdualw (mgr.24569) 247 : cluster [DBG] pgmap v203: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:05.173 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 485 sec latency 488853.986 ms 2022-03-17T15:36:06.173 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 486 sec latency 489854.082 ms 2022-03-17T15:36:07.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:05.518940+0000 mgr.smithi067.rdualw (mgr.24569) 248 : cluster [DBG] pgmap v204: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 2.0 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:07.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:05.586615+0000 mon.smithi061 (mon.0) 205 : cluster [DBG] mgrmap e40: smithi067.rdualw(active, since 6m) 2022-03-17T15:36:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:05.518940+0000 mgr.smithi067.rdualw (mgr.24569) 248 : cluster [DBG] pgmap v204: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 2.0 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:05.586615+0000 mon.smithi061 (mon.0) 205 : cluster [DBG] mgrmap e40: smithi067.rdualw(active, since 6m) 2022-03-17T15:36:07.173 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 487 sec latency 490854.211 ms 2022-03-17T15:36:08.173 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 488 sec latency 491854.276 ms 2022-03-17T15:36:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:07.519836+0000 mgr.smithi067.rdualw (mgr.24569) 249 : cluster [DBG] pgmap v205: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.3 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:07.519836+0000 mgr.smithi067.rdualw (mgr.24569) 249 : cluster [DBG] pgmap v205: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.3 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:09.173 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 489 sec latency 492854.390 ms 2022-03-17T15:36:10.173 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 490 sec latency 493854.513 ms 2022-03-17T15:36:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:09.520876+0000 mgr.smithi067.rdualw (mgr.24569) 250 : cluster [DBG] pgmap v206: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.3 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:09.520876+0000 mgr.smithi067.rdualw (mgr.24569) 250 : cluster [DBG] pgmap v206: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.4 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.3 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:11.173 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 491 sec latency 494854.631 ms 2022-03-17T15:36:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:36:11.572223+0000 mon.smithi067 (mon.1) 80 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:36:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:36:11.573719+0000 mon.smithi067 (mon.1) 81 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:36:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:36:11.574722+0000 mon.smithi067 (mon.1) 82 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:36:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:36:11.572223+0000 mon.smithi067 (mon.1) 80 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:36:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:36:11.573719+0000 mon.smithi067 (mon.1) 81 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:36:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:36:11.574722+0000 mon.smithi067 (mon.1) 82 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:36:12.173 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 492 sec latency 495854.736 ms 2022-03-17T15:36:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:11.522267+0000 mgr.smithi067.rdualw (mgr.24569) 251 : cluster [DBG] pgmap v207: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 2.0 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:36:11.578247+0000 mgr.smithi067.rdualw (mgr.24569) 252 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:36:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:36:11.985989+0000 mon.smithi061 (mon.0) 206 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:36:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:36:11.993752+0000 mon.smithi061 (mon.0) 207 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:36:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:11.522267+0000 mgr.smithi067.rdualw (mgr.24569) 251 : cluster [DBG] pgmap v207: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 2.0 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:36:11.578247+0000 mgr.smithi067.rdualw (mgr.24569) 252 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:36:13.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:36:11.985989+0000 mon.smithi061 (mon.0) 206 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:36:13.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:36:11.993752+0000 mon.smithi061 (mon.0) 207 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:36:13.173 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 493 sec latency 496854.838 ms 2022-03-17T15:36:14.173 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 494 sec latency 497854.897 ms 2022-03-17T15:36:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:13.523134+0000 mgr.smithi067.rdualw (mgr.24569) 253 : cluster [DBG] pgmap v208: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.4 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:13.523134+0000 mgr.smithi067.rdualw (mgr.24569) 253 : cluster [DBG] pgmap v208: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.4 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:15.173 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 495 sec latency 498854.947 ms 2022-03-17T15:36:16.174 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 496 sec latency 499855.055 ms 2022-03-17T15:36:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:15.524265+0000 mgr.smithi067.rdualw (mgr.24569) 254 : cluster [DBG] pgmap v209: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 2.0 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:15.524265+0000 mgr.smithi067.rdualw (mgr.24569) 254 : cluster [DBG] pgmap v209: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 2.0 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:17.174 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 497 sec latency 500855.199 ms 2022-03-17T15:36:17.773 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:36:18.062 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:36:18.062 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (13m) 6m ago 14m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:36:18.062 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6m) 6m ago 14m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:36:18.063 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6m) 6m ago 14m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:36:18.063 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (13m) 6m ago 14m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:36:18.063 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (7m) 6m ago 10m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:36:18.063 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6m) 6m ago 10m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:36:18.064 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (8m) 6m ago 16m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:36:18.064 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (7m) 6m ago 14m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:36:18.064 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (7m) 6m ago 16m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:36:18.064 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (7m) 6m ago 14m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:36:18.064 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (8m) 6m ago 8m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:36:18.065 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (8m) 6m ago 8m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:36:18.065 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (14m) 6m ago 14m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:36:18.065 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (14m) 6m ago 14m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:36:18.065 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (13m) 6m ago 13m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:36:18.066 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (13m) 6m ago 13m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:36:18.066 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (13m) 6m ago 13m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:36:18.066 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (12m) 6m ago 12m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:36:18.066 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (12m) 6m ago 12m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:36:18.066 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (12m) 6m ago 12m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:36:18.067 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (12m) 6m ago 12m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:36:18.067 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (11m) 6m ago 11m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:36:18.067 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (13m) 6m ago 14m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:36:18.174 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 498 sec latency 501855.260 ms 2022-03-17T15:36:18.405 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:36:18.405 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:36:18.406 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:36:18.406 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:36:18.407 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:36:18.407 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:36:18.407 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:36:18.408 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:36:18.408 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:36:18.409 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:36:18.409 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:36:18.410 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:36:18.410 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:36:18.411 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:36:18.411 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:36:18.413 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:36:18.414 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:36:18.415 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:36:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:17.525081+0000 mgr.smithi067.rdualw (mgr.24569) 255 : cluster [DBG] pgmap v210: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:36:17.758601+0000 mgr.smithi067.rdualw (mgr.24569) 256 : audit [DBG] from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:36:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:36:18.402881+0000 mon.smithi061 (mon.0) 208 : audit [DBG] from='client.? 172.21.15.61:0/1419224077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:36:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:17.525081+0000 mgr.smithi067.rdualw (mgr.24569) 255 : cluster [DBG] pgmap v210: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:19.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:36:17.758601+0000 mgr.smithi067.rdualw (mgr.24569) 256 : audit [DBG] from='client.34302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:36:19.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:36:18.402881+0000 mon.smithi061 (mon.0) 208 : audit [DBG] from='client.? 172.21.15.61:0/1419224077' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:36:19.174 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 499 sec latency 502855.348 ms 2022-03-17T15:36:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:36:18.043916+0000 mgr.smithi067.rdualw (mgr.24569) 257 : audit [DBG] from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:36:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:36:18.043916+0000 mgr.smithi067.rdualw (mgr.24569) 257 : audit [DBG] from='client.34306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:36:20.174 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 500 sec latency 503855.420 ms 2022-03-17T15:36:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:19.525866+0000 mgr.smithi067.rdualw (mgr.24569) 258 : cluster [DBG] pgmap v211: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:19.525866+0000 mgr.smithi067.rdualw (mgr.24569) 258 : cluster [DBG] pgmap v211: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:21.174 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 501 sec latency 504855.527 ms 2022-03-17T15:36:22.174 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 502 sec latency 505855.578 ms 2022-03-17T15:36:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:21.527253+0000 mgr.smithi067.rdualw (mgr.24569) 259 : cluster [DBG] pgmap v212: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:21.527253+0000 mgr.smithi067.rdualw (mgr.24569) 259 : cluster [DBG] pgmap v212: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:23.174 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 503 sec latency 506855.618 ms 2022-03-17T15:36:24.174 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 504 sec latency 507855.730 ms 2022-03-17T15:36:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:23.528085+0000 mgr.smithi067.rdualw (mgr.24569) 260 : cluster [DBG] pgmap v213: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:23.528085+0000 mgr.smithi067.rdualw (mgr.24569) 260 : cluster [DBG] pgmap v213: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:25.175 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 505 sec latency 508855.828 ms 2022-03-17T15:36:26.175 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 506 sec latency 509855.888 ms 2022-03-17T15:36:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:25.529206+0000 mgr.smithi067.rdualw (mgr.24569) 261 : cluster [DBG] pgmap v214: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:25.529206+0000 mgr.smithi067.rdualw (mgr.24569) 261 : cluster [DBG] pgmap v214: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:27.174 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 507 sec latency 510855.963 ms 2022-03-17T15:36:28.175 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 508 sec latency 511856.057 ms 2022-03-17T15:36:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:27.530161+0000 mgr.smithi067.rdualw (mgr.24569) 262 : cluster [DBG] pgmap v215: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:27.530161+0000 mgr.smithi067.rdualw (mgr.24569) 262 : cluster [DBG] pgmap v215: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:29.175 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 509 sec latency 512856.171 ms 2022-03-17T15:36:30.175 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 510 sec latency 513856.285 ms 2022-03-17T15:36:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:29.531089+0000 mgr.smithi067.rdualw (mgr.24569) 263 : cluster [DBG] pgmap v216: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:29.531089+0000 mgr.smithi067.rdualw (mgr.24569) 263 : cluster [DBG] pgmap v216: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:31.175 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 511 sec latency 514856.390 ms 2022-03-17T15:36:31.680 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:31 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: start operation timed out. Terminating. 2022-03-17T15:36:32.175 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 512 sec latency 515856.490 ms 2022-03-17T15:36:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:31.532436+0000 mgr.smithi067.rdualw (mgr.24569) 264 : cluster [DBG] pgmap v217: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:32.803 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:32 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Failed with result 'timeout'. 2022-03-17T15:36:32.803 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:32 smithi061 systemd[1]: Failed to start Ceph osd.0 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:36:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:31.532436+0000 mgr.smithi067.rdualw (mgr.24569) 264 : cluster [DBG] pgmap v217: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:33.175 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 513 sec latency 516856.601 ms 2022-03-17T15:36:34.175 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 514 sec latency 517856.735 ms 2022-03-17T15:36:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:33.533295+0000 mgr.smithi067.rdualw (mgr.24569) 265 : cluster [DBG] pgmap v218: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:36:34.474612+0000 mon.smithi067 (mon.1) 83 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:36:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:36:34.475324+0000 mon.smithi061 (mon.0) 209 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:36:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:36:34.478071+0000 mon.smithi067 (mon.1) 84 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:36:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:36:34.478645+0000 mon.smithi061 (mon.0) 210 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:36:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:33.533295+0000 mgr.smithi067.rdualw (mgr.24569) 265 : cluster [DBG] pgmap v218: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:36:34.474612+0000 mon.smithi067 (mon.1) 83 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:36:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:36:34.475324+0000 mon.smithi061 (mon.0) 209 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:36:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:36:34.478071+0000 mon.smithi067 (mon.1) 84 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:36:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:36:34.478645+0000 mon.smithi061 (mon.0) 210 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:36:35.175 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 515 sec latency 518856.789 ms 2022-03-17T15:36:36.176 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 516 sec latency 519856.858 ms 2022-03-17T15:36:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:35.534447+0000 mgr.smithi067.rdualw (mgr.24569) 266 : cluster [DBG] pgmap v219: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:35.534447+0000 mgr.smithi067.rdualw (mgr.24569) 266 : cluster [DBG] pgmap v219: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:37.176 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 517 sec latency 520856.957 ms 2022-03-17T15:36:38.176 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 518 sec latency 521857.055 ms 2022-03-17T15:36:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:37.535431+0000 mgr.smithi067.rdualw (mgr.24569) 267 : cluster [DBG] pgmap v220: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:37.535431+0000 mgr.smithi067.rdualw (mgr.24569) 267 : cluster [DBG] pgmap v220: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:39.176 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 519 sec latency 522857.173 ms 2022-03-17T15:36:40.176 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 520 sec latency 523857.289 ms 2022-03-17T15:36:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:39.536523+0000 mgr.smithi067.rdualw (mgr.24569) 268 : cluster [DBG] pgmap v221: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:39.536523+0000 mgr.smithi067.rdualw (mgr.24569) 268 : cluster [DBG] pgmap v221: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:41.176 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 521 sec latency 524857.411 ms 2022-03-17T15:36:42.177 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 522 sec latency 525857.523 ms 2022-03-17T15:36:42.953 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:41.537733+0000 mgr.smithi067.rdualw (mgr.24569) 269 : cluster [DBG] pgmap v222: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:42.954 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:42 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Service RestartSec=10s expired, scheduling restart. 2022-03-17T15:36:42.954 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:42 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 3. 2022-03-17T15:36:42.955 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:42 smithi061 systemd[1]: Stopped Ceph osd.0 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:36:42.955 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:42 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 79905 (bash) in control group while starting unit. Ignoring. 2022-03-17T15:36:42.955 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:42 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:36:42.955 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:42 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 79983 (podman) in control group while starting unit. Ignoring. 2022-03-17T15:36:42.956 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:42 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:36:42.956 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:42 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 79999 (conmon) in control group while starting unit. Ignoring. 2022-03-17T15:36:42.956 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:42 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:36:42.956 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:42 smithi061 systemd[1]: Starting Ceph osd.0 for ae1b9b88-a605-11ec-8c35-001a4aab830c... 2022-03-17T15:36:42.956 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:42 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 79905 (bash) in control group while starting unit. Ignoring. 2022-03-17T15:36:42.957 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:42 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:36:42.957 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:42 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 79983 (podman) in control group while starting unit. Ignoring. 2022-03-17T15:36:42.957 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:42 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:36:42.958 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:42 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 79999 (conmon) in control group while starting unit. Ignoring. 2022-03-17T15:36:42.958 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:42 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:36:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:41.537733+0000 mgr.smithi067.rdualw (mgr.24569) 269 : cluster [DBG] pgmap v222: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:43.177 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 523 sec latency 526858.093 ms 2022-03-17T15:36:43.302 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:42 smithi061 bash[80563]: 26fc40fc6ad90567f4bf4ad2477af5c817e0587170e333150f041f0f3ec84b30 2022-03-17T15:36:44.177 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 524 sec latency 527858.215 ms 2022-03-17T15:36:44.552 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:36:44 smithi061 bash[79983]: time="2022-03-17T15:36:44Z" level=error msg="Could not retrieve exit code from event: died not found: unable to find event" 2022-03-17T15:36:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:43.538784+0000 mgr.smithi067.rdualw (mgr.24569) 270 : cluster [DBG] pgmap v223: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:45.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:43.538784+0000 mgr.smithi067.rdualw (mgr.24569) 270 : cluster [DBG] pgmap v223: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:45.177 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 525 sec latency 528858.296 ms 2022-03-17T15:36:46.177 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 526 sec latency 529858.412 ms 2022-03-17T15:36:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:45.540243+0000 mgr.smithi067.rdualw (mgr.24569) 271 : cluster [DBG] pgmap v224: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:45.540243+0000 mgr.smithi067.rdualw (mgr.24569) 271 : cluster [DBG] pgmap v224: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:47.177 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 527 sec latency 530858.501 ms 2022-03-17T15:36:48.177 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 528 sec latency 531858.606 ms 2022-03-17T15:36:48.735 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:36:49.023 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:36:49.023 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (14m) 6m ago 15m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:36:49.024 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (7m) 6m ago 15m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:36:49.024 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6m) 6m ago 14m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:36:49.024 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (14m) 6m ago 15m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:36:49.024 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (7m) 6m ago 11m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:36:49.025 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (7m) 6m ago 11m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:36:49.025 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (8m) 6m ago 16m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:36:49.025 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (8m) 6m ago 14m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:36:49.025 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (8m) 6m ago 16m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:36:49.025 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (7m) 6m ago 14m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:36:49.026 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (8m) 6m ago 8m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:36:49.026 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (8m) 6m ago 8m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:36:49.026 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (15m) 6m ago 15m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:36:49.026 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (14m) 6m ago 14m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:36:49.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (14m) 6m ago 14m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:36:49.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (14m) 6m ago 13m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:36:49.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (13m) 6m ago 13m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:36:49.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (13m) 6m ago 13m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:36:49.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (13m) 6m ago 13m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:36:49.028 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (12m) 6m ago 12m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:36:49.028 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (12m) 6m ago 12m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:36:49.028 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (12m) 6m ago 12m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:36:49.028 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (14m) 6m ago 15m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:36:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:47.541278+0000 mgr.smithi067.rdualw (mgr.24569) 272 : cluster [DBG] pgmap v225: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:47.541278+0000 mgr.smithi067.rdualw (mgr.24569) 272 : cluster [DBG] pgmap v225: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:49.177 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 529 sec latency 532858.675 ms 2022-03-17T15:36:49.363 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:36:49.363 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:36:49.363 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:36:49.364 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:36:49.364 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:36:49.364 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:36:49.364 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:36:49.365 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:36:49.365 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:36:49.365 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:36:49.365 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:36:49.366 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:36:49.366 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:36:49.366 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:36:49.366 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:36:49.367 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:36:49.367 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:36:49.367 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:36:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:36:48.719221+0000 mgr.smithi067.rdualw (mgr.24569) 273 : audit [DBG] from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:36:50.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:36:49.361059+0000 mon.smithi061 (mon.0) 211 : audit [DBG] from='client.? 172.21.15.61:0/4001326199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:36:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:36:48.719221+0000 mgr.smithi067.rdualw (mgr.24569) 273 : audit [DBG] from='client.34314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:36:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:36:49.361059+0000 mon.smithi061 (mon.0) 211 : audit [DBG] from='client.? 172.21.15.61:0/4001326199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:36:50.177 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 530 sec latency 533858.766 ms 2022-03-17T15:36:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:36:49.004732+0000 mgr.smithi067.rdualw (mgr.24569) 274 : audit [DBG] from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:36:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:49.542154+0000 mgr.smithi067.rdualw (mgr.24569) 275 : cluster [DBG] pgmap v226: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:36:49.004732+0000 mgr.smithi067.rdualw (mgr.24569) 274 : audit [DBG] from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:36:51.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:49.542154+0000 mgr.smithi067.rdualw (mgr.24569) 275 : cluster [DBG] pgmap v226: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:51.178 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 531 sec latency 534858.881 ms 2022-03-17T15:36:52.178 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 532 sec latency 535858.979 ms 2022-03-17T15:36:53.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:51.543504+0000 mgr.smithi067.rdualw (mgr.24569) 276 : cluster [DBG] pgmap v227: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.7 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:53.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:51.543504+0000 mgr.smithi067.rdualw (mgr.24569) 276 : cluster [DBG] pgmap v227: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.7 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:53.179 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 533 sec latency 536859.104 ms 2022-03-17T15:36:54.178 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 534 sec latency 537859.229 ms 2022-03-17T15:36:55.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:53.544380+0000 mgr.smithi067.rdualw (mgr.24569) 277 : cluster [DBG] pgmap v228: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.1 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:53.544380+0000 mgr.smithi067.rdualw (mgr.24569) 277 : cluster [DBG] pgmap v228: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.1 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:55.178 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 535 sec latency 538859.359 ms 2022-03-17T15:36:56.178 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 536 sec latency 539859.497 ms 2022-03-17T15:36:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:55.545509+0000 mgr.smithi067.rdualw (mgr.24569) 278 : cluster [DBG] pgmap v229: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.7 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:55.545509+0000 mgr.smithi067.rdualw (mgr.24569) 278 : cluster [DBG] pgmap v229: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.7 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:57.178 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 537 sec latency 540859.608 ms 2022-03-17T15:36:58.178 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 538 sec latency 541859.723 ms 2022-03-17T15:36:59.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:36:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:57.546374+0000 mgr.smithi067.rdualw (mgr.24569) 279 : cluster [DBG] pgmap v230: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:36:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:57.546374+0000 mgr.smithi067.rdualw (mgr.24569) 279 : cluster [DBG] pgmap v230: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:36:59.179 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 539 sec latency 542859.824 ms 2022-03-17T15:37:00.179 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 540 sec latency 543859.968 ms 2022-03-17T15:37:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:36:59.547299+0000 mgr.smithi067.rdualw (mgr.24569) 280 : cluster [DBG] pgmap v231: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:36:59.547299+0000 mgr.smithi067.rdualw (mgr.24569) 280 : cluster [DBG] pgmap v231: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:01.179 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 541 sec latency 544860.026 ms 2022-03-17T15:37:02.179 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 542 sec latency 545860.122 ms 2022-03-17T15:37:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:01.548658+0000 mgr.smithi067.rdualw (mgr.24569) 281 : cluster [DBG] pgmap v232: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.7 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:01.548658+0000 mgr.smithi067.rdualw (mgr.24569) 281 : cluster [DBG] pgmap v232: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.7 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:03.179 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 543 sec latency 546860.236 ms 2022-03-17T15:37:04.179 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 544 sec latency 547860.332 ms 2022-03-17T15:37:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:03.549685+0000 mgr.smithi067.rdualw (mgr.24569) 282 : cluster [DBG] pgmap v233: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:03.549685+0000 mgr.smithi067.rdualw (mgr.24569) 282 : cluster [DBG] pgmap v233: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:05.179 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 545 sec latency 548860.412 ms 2022-03-17T15:37:06.179 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 546 sec latency 549860.503 ms 2022-03-17T15:37:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:05.550848+0000 mgr.smithi067.rdualw (mgr.24569) 283 : cluster [DBG] pgmap v234: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:05.550848+0000 mgr.smithi067.rdualw (mgr.24569) 283 : cluster [DBG] pgmap v234: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:07.179 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 547 sec latency 550860.603 ms 2022-03-17T15:37:08.179 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 548 sec latency 551860.735 ms 2022-03-17T15:37:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:07.551666+0000 mgr.smithi067.rdualw (mgr.24569) 284 : cluster [DBG] pgmap v235: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:07.551666+0000 mgr.smithi067.rdualw (mgr.24569) 284 : cluster [DBG] pgmap v235: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:09.179 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 549 sec latency 552860.854 ms 2022-03-17T15:37:10.179 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 550 sec latency 553860.918 ms 2022-03-17T15:37:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:09.552431+0000 mgr.smithi067.rdualw (mgr.24569) 285 : cluster [DBG] pgmap v236: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:09.552431+0000 mgr.smithi067.rdualw (mgr.24569) 285 : cluster [DBG] pgmap v236: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:11.180 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 551 sec latency 554861.035 ms 2022-03-17T15:37:12.180 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 552 sec latency 555861.087 ms 2022-03-17T15:37:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:11.553800+0000 mgr.smithi067.rdualw (mgr.24569) 286 : cluster [DBG] pgmap v237: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:37:11.997138+0000 mon.smithi067 (mon.1) 85 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:37:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:37:11.998609+0000 mon.smithi067 (mon.1) 86 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:37:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:37:11.999554+0000 mon.smithi067 (mon.1) 87 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:37:13.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:37:12.422880+0000 mon.smithi061 (mon.0) 212 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:37:13.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:37:12.429131+0000 mon.smithi061 (mon.0) 213 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:37:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:11.553800+0000 mgr.smithi067.rdualw (mgr.24569) 286 : cluster [DBG] pgmap v237: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:37:11.997138+0000 mon.smithi067 (mon.1) 85 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:37:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:37:11.998609+0000 mon.smithi067 (mon.1) 86 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:37:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:37:11.999554+0000 mon.smithi067 (mon.1) 87 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:37:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:37:12.422880+0000 mon.smithi061 (mon.0) 212 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:37:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:37:12.429131+0000 mon.smithi061 (mon.0) 213 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:37:13.181 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 553 sec latency 556861.197 ms 2022-03-17T15:37:14.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:37:12.000403+0000 mgr.smithi067.rdualw (mgr.24569) 287 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:37:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:37:12.000403+0000 mgr.smithi067.rdualw (mgr.24569) 287 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:37:14.180 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 554 sec latency 557861.304 ms 2022-03-17T15:37:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:13.554756+0000 mgr.smithi067.rdualw (mgr.24569) 288 : cluster [DBG] pgmap v238: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:13.554756+0000 mgr.smithi067.rdualw (mgr.24569) 288 : cluster [DBG] pgmap v238: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:15.184 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 555 sec latency 558861.368 ms 2022-03-17T15:37:16.180 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 556 sec latency 559861.476 ms 2022-03-17T15:37:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:15.555865+0000 mgr.smithi067.rdualw (mgr.24569) 289 : cluster [DBG] pgmap v239: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:15.555865+0000 mgr.smithi067.rdualw (mgr.24569) 289 : cluster [DBG] pgmap v239: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:17.180 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 557 sec latency 560861.575 ms 2022-03-17T15:37:18.180 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 558 sec latency 561861.683 ms 2022-03-17T15:37:19.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:17.556918+0000 mgr.smithi067.rdualw (mgr.24569) 290 : cluster [DBG] pgmap v240: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:19.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:17.556918+0000 mgr.smithi067.rdualw (mgr.24569) 290 : cluster [DBG] pgmap v240: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:19.180 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 559 sec latency 562861.831 ms 2022-03-17T15:37:19.690 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:37:19.980 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:37:19.980 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (14m) 7m ago 15m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:37:19.980 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (7m) 7m ago 15m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:37:19.981 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (7m) 7m ago 15m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:37:19.981 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (14m) 7m ago 15m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:37:19.981 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (8m) 7m ago 11m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:37:19.981 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (7m) 7m ago 11m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:37:19.982 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (9m) 7m ago 17m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:37:19.982 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (8m) 7m ago 15m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:37:19.982 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (8m) 7m ago 17m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:37:19.983 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (8m) 7m ago 15m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:37:19.983 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (9m) 7m ago 9m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:37:19.983 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (9m) 7m ago 9m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:37:19.984 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (15m) 7m ago 15m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:37:19.984 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (15m) 7m ago 15m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:37:19.984 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (14m) 7m ago 14m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:37:19.984 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (14m) 7m ago 14m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:37:19.984 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (14m) 7m ago 14m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:37:19.985 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (13m) 7m ago 13m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:37:19.985 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (13m) 7m ago 13m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:37:19.985 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (13m) 7m ago 13m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:37:19.985 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (13m) 7m ago 13m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:37:19.986 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (12m) 7m ago 12m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:37:19.986 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (14m) 7m ago 15m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:37:20.180 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 560 sec latency 563861.887 ms 2022-03-17T15:37:20.324 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:37:20.324 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:37:20.325 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:37:20.325 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:37:20.325 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:37:20.325 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:37:20.326 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:37:20.326 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:37:20.326 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:37:20.326 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:37:20.327 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:37:20.327 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:37:20.327 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:37:20.327 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:37:20.328 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:37:20.328 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:37:20.328 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:37:20.328 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:37:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:19.557892+0000 mgr.smithi067.rdualw (mgr.24569) 291 : cluster [DBG] pgmap v241: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:37:19.675333+0000 mgr.smithi067.rdualw (mgr.24569) 292 : audit [DBG] from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:37:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:19.557892+0000 mgr.smithi067.rdualw (mgr.24569) 291 : cluster [DBG] pgmap v241: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:37:19.675333+0000 mgr.smithi067.rdualw (mgr.24569) 292 : audit [DBG] from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:37:21.181 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 561 sec latency 564861.991 ms 2022-03-17T15:37:21.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:37:19.961823+0000 mgr.smithi067.rdualw (mgr.24569) 293 : audit [DBG] from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:37:21.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:37:20.322524+0000 mon.smithi061 (mon.0) 214 : audit [DBG] from='client.? 172.21.15.61:0/532785168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:37:21.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:37:19.961823+0000 mgr.smithi067.rdualw (mgr.24569) 293 : audit [DBG] from='client.34330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:37:21.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:37:20.322524+0000 mon.smithi061 (mon.0) 214 : audit [DBG] from='client.? 172.21.15.61:0/532785168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:37:22.181 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 562 sec latency 565862.125 ms 2022-03-17T15:37:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:21.559104+0000 mgr.smithi067.rdualw (mgr.24569) 294 : cluster [DBG] pgmap v242: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:21.559104+0000 mgr.smithi067.rdualw (mgr.24569) 294 : cluster [DBG] pgmap v242: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:23.181 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 563 sec latency 566862.236 ms 2022-03-17T15:37:24.181 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 564 sec latency 567862.320 ms 2022-03-17T15:37:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:23.559958+0000 mgr.smithi067.rdualw (mgr.24569) 295 : cluster [DBG] pgmap v243: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:23.559958+0000 mgr.smithi067.rdualw (mgr.24569) 295 : cluster [DBG] pgmap v243: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:25.181 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 565 sec latency 568862.450 ms 2022-03-17T15:37:26.181 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 566 sec latency 569862.547 ms 2022-03-17T15:37:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:25.561292+0000 mgr.smithi067.rdualw (mgr.24569) 296 : cluster [DBG] pgmap v244: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:25.561292+0000 mgr.smithi067.rdualw (mgr.24569) 296 : cluster [DBG] pgmap v244: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:27.181 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 567 sec latency 570862.643 ms 2022-03-17T15:37:28.181 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 568 sec latency 571862.764 ms 2022-03-17T15:37:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:27.562145+0000 mgr.smithi067.rdualw (mgr.24569) 297 : cluster [DBG] pgmap v245: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:27.562145+0000 mgr.smithi067.rdualw (mgr.24569) 297 : cluster [DBG] pgmap v245: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:29.181 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 569 sec latency 572862.890 ms 2022-03-17T15:37:30.182 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 570 sec latency 573863.005 ms 2022-03-17T15:37:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:29.563096+0000 mgr.smithi067.rdualw (mgr.24569) 298 : cluster [DBG] pgmap v246: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:29.563096+0000 mgr.smithi067.rdualw (mgr.24569) 298 : cluster [DBG] pgmap v246: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:31.182 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 571 sec latency 574863.090 ms 2022-03-17T15:37:32.182 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 572 sec latency 575863.159 ms 2022-03-17T15:37:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:31.564377+0000 mgr.smithi067.rdualw (mgr.24569) 299 : cluster [DBG] pgmap v247: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:31.564377+0000 mgr.smithi067.rdualw (mgr.24569) 299 : cluster [DBG] pgmap v247: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:33.182 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 573 sec latency 576863.248 ms 2022-03-17T15:37:34.182 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 574 sec latency 577863.318 ms 2022-03-17T15:37:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:33.565180+0000 mgr.smithi067.rdualw (mgr.24569) 300 : cluster [DBG] pgmap v248: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:37:34.477055+0000 mon.smithi067 (mon.1) 88 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:37:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:37:34.477899+0000 mon.smithi061 (mon.0) 215 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:37:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:37:34.480782+0000 mon.smithi067 (mon.1) 89 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:37:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:37:34.481222+0000 mon.smithi061 (mon.0) 216 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:37:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:33.565180+0000 mgr.smithi067.rdualw (mgr.24569) 300 : cluster [DBG] pgmap v248: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:37:34.477055+0000 mon.smithi067 (mon.1) 88 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:37:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:37:34.477899+0000 mon.smithi061 (mon.0) 215 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:37:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:37:34.480782+0000 mon.smithi067 (mon.1) 89 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:37:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:37:34.481222+0000 mon.smithi061 (mon.0) 216 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:37:35.182 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 575 sec latency 578863.445 ms 2022-03-17T15:37:36.182 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 576 sec latency 579863.551 ms 2022-03-17T15:37:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:35.566705+0000 mgr.smithi067.rdualw (mgr.24569) 301 : cluster [DBG] pgmap v249: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:35.566705+0000 mgr.smithi067.rdualw (mgr.24569) 301 : cluster [DBG] pgmap v249: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:37.182 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 577 sec latency 580863.636 ms 2022-03-17T15:37:38.183 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 578 sec latency 581863.725 ms 2022-03-17T15:37:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:37.567505+0000 mgr.smithi067.rdualw (mgr.24569) 302 : cluster [DBG] pgmap v250: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:37.567505+0000 mgr.smithi067.rdualw (mgr.24569) 302 : cluster [DBG] pgmap v250: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:39.182 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 579 sec latency 582863.841 ms 2022-03-17T15:37:40.183 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 580 sec latency 583863.951 ms 2022-03-17T15:37:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:39.568338+0000 mgr.smithi067.rdualw (mgr.24569) 303 : cluster [DBG] pgmap v251: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:39.568338+0000 mgr.smithi067.rdualw (mgr.24569) 303 : cluster [DBG] pgmap v251: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:41.183 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 581 sec latency 584864.075 ms 2022-03-17T15:37:42.183 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 582 sec latency 585864.200 ms 2022-03-17T15:37:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:41.569504+0000 mgr.smithi067.rdualw (mgr.24569) 304 : cluster [DBG] pgmap v252: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:41.569504+0000 mgr.smithi067.rdualw (mgr.24569) 304 : cluster [DBG] pgmap v252: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:43.183 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 583 sec latency 586864.251 ms 2022-03-17T15:37:44.183 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 584 sec latency 587864.365 ms 2022-03-17T15:37:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:43.570314+0000 mgr.smithi067.rdualw (mgr.24569) 305 : cluster [DBG] pgmap v253: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:43.570314+0000 mgr.smithi067.rdualw (mgr.24569) 305 : cluster [DBG] pgmap v253: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:45.183 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 585 sec latency 588864.459 ms 2022-03-17T15:37:46.183 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 586 sec latency 589864.566 ms 2022-03-17T15:37:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:45.571435+0000 mgr.smithi067.rdualw (mgr.24569) 306 : cluster [DBG] pgmap v254: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:45.571435+0000 mgr.smithi067.rdualw (mgr.24569) 306 : cluster [DBG] pgmap v254: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:47.183 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 587 sec latency 590864.671 ms 2022-03-17T15:37:48.183 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 588 sec latency 591864.750 ms 2022-03-17T15:37:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:47.572440+0000 mgr.smithi067.rdualw (mgr.24569) 307 : cluster [DBG] pgmap v255: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:47.572440+0000 mgr.smithi067.rdualw (mgr.24569) 307 : cluster [DBG] pgmap v255: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:49.183 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 589 sec latency 592864.847 ms 2022-03-17T15:37:50.183 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 590 sec latency 593864.905 ms 2022-03-17T15:37:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:49.573255+0000 mgr.smithi067.rdualw (mgr.24569) 308 : cluster [DBG] pgmap v256: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:49.573255+0000 mgr.smithi067.rdualw (mgr.24569) 308 : cluster [DBG] pgmap v256: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:50.649 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:37:50.940 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:37:50.941 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (15m) 7m ago 16m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:37:50.941 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (8m) 7m ago 16m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:37:50.941 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (7m) 7m ago 15m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:37:50.941 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (15m) 7m ago 16m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:37:50.941 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (8m) 7m ago 12m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:37:50.942 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (8m) 7m ago 12m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:37:50.942 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (9m) 7m ago 17m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:37:50.942 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (9m) 7m ago 15m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:37:50.942 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (9m) 7m ago 17m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:37:50.943 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (8m) 7m ago 15m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:37:50.943 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (9m) 7m ago 9m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:37:50.943 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (9m) 7m ago 9m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:37:50.943 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (16m) 7m ago 16m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:37:50.943 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (15m) 7m ago 15m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:37:50.944 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (15m) 7m ago 15m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:37:50.944 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (15m) 7m ago 15m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:37:50.944 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (14m) 7m ago 14m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:37:50.944 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (14m) 7m ago 14m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:37:50.945 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (14m) 7m ago 14m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:37:50.945 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (13m) 7m ago 13m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:37:50.945 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (13m) 7m ago 13m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:37:50.945 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (13m) 7m ago 13m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:37:50.945 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (15m) 7m ago 16m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:37:51.183 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 591 sec latency 594864.956 ms 2022-03-17T15:37:51.283 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:37:51.283 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:37:51.283 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:37:51.284 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:37:51.284 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:37:51.284 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:37:51.284 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:37:51.284 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:37:51.285 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:37:51.285 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:37:51.285 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:37:51.285 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:37:51.286 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:37:51.286 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:37:51.286 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:37:51.287 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:37:51.287 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:37:51.287 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:37:51.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:37:50.634479+0000 mgr.smithi067.rdualw (mgr.24569) 309 : audit [DBG] from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:37:51.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:37:51.280699+0000 mon.smithi061 (mon.0) 217 : audit [DBG] from='client.? 172.21.15.61:0/1919574155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:37:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:37:50.634479+0000 mgr.smithi067.rdualw (mgr.24569) 309 : audit [DBG] from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:37:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:37:51.280699+0000 mon.smithi061 (mon.0) 217 : audit [DBG] from='client.? 172.21.15.61:0/1919574155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:37:52.184 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 592 sec latency 595865.043 ms 2022-03-17T15:37:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:37:50.922527+0000 mgr.smithi067.rdualw (mgr.24569) 310 : audit [DBG] from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:37:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:51.574576+0000 mgr.smithi067.rdualw (mgr.24569) 311 : cluster [DBG] pgmap v257: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:37:50.922527+0000 mgr.smithi067.rdualw (mgr.24569) 310 : audit [DBG] from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:37:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:51.574576+0000 mgr.smithi067.rdualw (mgr.24569) 311 : cluster [DBG] pgmap v257: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:53.184 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 593 sec latency 596865.138 ms 2022-03-17T15:37:54.184 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 594 sec latency 597865.265 ms 2022-03-17T15:37:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:53.575371+0000 mgr.smithi067.rdualw (mgr.24569) 312 : cluster [DBG] pgmap v258: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:53.575371+0000 mgr.smithi067.rdualw (mgr.24569) 312 : cluster [DBG] pgmap v258: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:55.184 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 595 sec latency 598865.391 ms 2022-03-17T15:37:56.184 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 596 sec latency 599865.488 ms 2022-03-17T15:37:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:55.576767+0000 mgr.smithi067.rdualw (mgr.24569) 313 : cluster [DBG] pgmap v259: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:55.576767+0000 mgr.smithi067.rdualw (mgr.24569) 313 : cluster [DBG] pgmap v259: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:57.185 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 597 sec latency 600865.598 ms 2022-03-17T15:37:58.184 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 598 sec latency 601865.730 ms 2022-03-17T15:37:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:37:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:57.577713+0000 mgr.smithi067.rdualw (mgr.24569) 314 : cluster [DBG] pgmap v260: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:37:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:57.577713+0000 mgr.smithi067.rdualw (mgr.24569) 314 : cluster [DBG] pgmap v260: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:37:59.185 INFO:teuthology.orchestra.run.smithi061.stdout: 5 86673 0.00 MB/sec execute 599 sec latency 602865.792 ms 2022-03-17T15:38:00.184 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 600 sec 2022-03-17T15:38:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:37:59.578554+0000 mgr.smithi067.rdualw (mgr.24569) 315 : cluster [DBG] pgmap v261: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:37:59.578554+0000 mgr.smithi067.rdualw (mgr.24569) 315 : cluster [DBG] pgmap v261: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:01.185 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 601 sec 2022-03-17T15:38:02.185 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 602 sec 2022-03-17T15:38:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:01.579761+0000 mgr.smithi067.rdualw (mgr.24569) 316 : cluster [DBG] pgmap v262: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:01.579761+0000 mgr.smithi067.rdualw (mgr.24569) 316 : cluster [DBG] pgmap v262: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:03.185 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 603 sec 2022-03-17T15:38:04.185 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 604 sec 2022-03-17T15:38:05.007 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:03.580803+0000 mgr.smithi067.rdualw (mgr.24569) 317 : cluster [DBG] pgmap v263: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:03.580803+0000 mgr.smithi067.rdualw (mgr.24569) 317 : cluster [DBG] pgmap v263: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:05.185 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 605 sec 2022-03-17T15:38:06.185 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 606 sec 2022-03-17T15:38:07.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:05.581907+0000 mgr.smithi067.rdualw (mgr.24569) 318 : cluster [DBG] pgmap v264: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:05.581907+0000 mgr.smithi067.rdualw (mgr.24569) 318 : cluster [DBG] pgmap v264: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:07.185 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 607 sec 2022-03-17T15:38:08.185 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 608 sec 2022-03-17T15:38:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:07.582722+0000 mgr.smithi067.rdualw (mgr.24569) 319 : cluster [DBG] pgmap v265: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:07.582722+0000 mgr.smithi067.rdualw (mgr.24569) 319 : cluster [DBG] pgmap v265: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:09.185 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 609 sec 2022-03-17T15:38:10.186 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 610 sec 2022-03-17T15:38:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:09.583592+0000 mgr.smithi067.rdualw (mgr.24569) 320 : cluster [DBG] pgmap v266: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:09.583592+0000 mgr.smithi067.rdualw (mgr.24569) 320 : cluster [DBG] pgmap v266: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:11.185 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 611 sec 2022-03-17T15:38:12.186 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 612 sec 2022-03-17T15:38:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:11.584786+0000 mgr.smithi067.rdualw (mgr.24569) 321 : cluster [DBG] pgmap v267: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:38:12.433026+0000 mon.smithi067 (mon.1) 90 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:38:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:38:12.434514+0000 mon.smithi067 (mon.1) 91 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:38:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:38:12.435465+0000 mon.smithi067 (mon.1) 92 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:38:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:11.584786+0000 mgr.smithi067.rdualw (mgr.24569) 321 : cluster [DBG] pgmap v267: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:38:12.433026+0000 mon.smithi067 (mon.1) 90 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:38:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:38:12.434514+0000 mon.smithi067 (mon.1) 91 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:38:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:38:12.435465+0000 mon.smithi067 (mon.1) 92 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:38:13.186 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 613 sec 2022-03-17T15:38:14.186 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 614 sec 2022-03-17T15:38:14.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:38:12.436321+0000 mgr.smithi067.rdualw (mgr.24569) 322 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:38:14.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:38:12.854347+0000 mon.smithi061 (mon.0) 218 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:38:14.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:38:12.860008+0000 mon.smithi061 (mon.0) 219 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:38:14.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:38:12.436321+0000 mgr.smithi067.rdualw (mgr.24569) 322 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:38:14.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:38:12.854347+0000 mon.smithi061 (mon.0) 218 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:38:14.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:38:12.860008+0000 mon.smithi061 (mon.0) 219 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:38:15.186 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 615 sec 2022-03-17T15:38:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:13.585673+0000 mgr.smithi067.rdualw (mgr.24569) 323 : cluster [DBG] pgmap v268: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:13.585673+0000 mgr.smithi067.rdualw (mgr.24569) 323 : cluster [DBG] pgmap v268: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:16.186 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 616 sec 2022-03-17T15:38:17.186 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 617 sec 2022-03-17T15:38:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:15.586837+0000 mgr.smithi067.rdualw (mgr.24569) 324 : cluster [DBG] pgmap v269: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:15.586837+0000 mgr.smithi067.rdualw (mgr.24569) 324 : cluster [DBG] pgmap v269: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:18.186 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 618 sec 2022-03-17T15:38:19.186 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 619 sec 2022-03-17T15:38:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:17.587654+0000 mgr.smithi067.rdualw (mgr.24569) 325 : cluster [DBG] pgmap v270: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:17.587654+0000 mgr.smithi067.rdualw (mgr.24569) 325 : cluster [DBG] pgmap v270: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:20.186 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 620 sec 2022-03-17T15:38:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:19.588465+0000 mgr.smithi067.rdualw (mgr.24569) 326 : cluster [DBG] pgmap v271: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:19.588465+0000 mgr.smithi067.rdualw (mgr.24569) 326 : cluster [DBG] pgmap v271: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:21.187 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 621 sec 2022-03-17T15:38:21.607 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:38:21.901 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:38:21.902 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (15m) 8m ago 16m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:38:21.902 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (8m) 8m ago 16m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:38:21.902 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (8m) 8m ago 16m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:38:21.903 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (15m) 8m ago 16m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:38:21.903 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (9m) 8m ago 12m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:38:21.903 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (8m) 8m ago 12m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:38:21.903 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (10m) 8m ago 18m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:38:21.903 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (9m) 8m ago 16m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:38:21.904 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (9m) 8m ago 18m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:38:21.904 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (9m) 8m ago 16m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:38:21.904 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (10m) 8m ago 10m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:38:21.904 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (10m) 8m ago 10m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:38:21.904 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (16m) 8m ago 16m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:38:21.905 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (16m) 8m ago 16m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:38:21.905 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (15m) 8m ago 15m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:38:21.905 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (15m) 8m ago 15m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:38:21.905 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (15m) 8m ago 15m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:38:21.906 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (14m) 8m ago 14m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:38:21.906 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (14m) 8m ago 14m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:38:21.906 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (14m) 8m ago 14m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:38:21.906 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (14m) 8m ago 14m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:38:21.907 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (14m) 8m ago 13m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:38:21.907 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (15m) 8m ago 16m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:38:22.187 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 622 sec 2022-03-17T15:38:22.241 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:38:22.241 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:38:22.242 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:38:22.242 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:38:22.242 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:38:22.242 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:38:22.243 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:38:22.243 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:38:22.243 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:38:22.243 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:38:22.244 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:38:22.244 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:38:22.244 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:38:22.244 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:38:22.244 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:38:22.245 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:38:22.245 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:38:22.245 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:38:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:21.589764+0000 mgr.smithi067.rdualw (mgr.24569) 327 : cluster [DBG] pgmap v272: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:38:21.591354+0000 mgr.smithi067.rdualw (mgr.24569) 328 : audit [DBG] from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:38:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:38:21.883685+0000 mgr.smithi067.rdualw (mgr.24569) 329 : audit [DBG] from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:38:23.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:38:22.239455+0000 mon.smithi061 (mon.0) 220 : audit [DBG] from='client.? 172.21.15.61:0/586320553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:38:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:21.589764+0000 mgr.smithi067.rdualw (mgr.24569) 327 : cluster [DBG] pgmap v272: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:38:21.591354+0000 mgr.smithi067.rdualw (mgr.24569) 328 : audit [DBG] from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:38:23.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:38:21.883685+0000 mgr.smithi067.rdualw (mgr.24569) 329 : audit [DBG] from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:38:23.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:38:22.239455+0000 mon.smithi061 (mon.0) 220 : audit [DBG] from='client.? 172.21.15.61:0/586320553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:38:23.187 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 623 sec 2022-03-17T15:38:24.187 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 624 sec 2022-03-17T15:38:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:23.590610+0000 mgr.smithi067.rdualw (mgr.24569) 330 : cluster [DBG] pgmap v273: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:25.094 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:23.590610+0000 mgr.smithi067.rdualw (mgr.24569) 330 : cluster [DBG] pgmap v273: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:25.187 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 625 sec 2022-03-17T15:38:26.187 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 626 sec 2022-03-17T15:38:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:25.591965+0000 mgr.smithi067.rdualw (mgr.24569) 331 : cluster [DBG] pgmap v274: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:25.591965+0000 mgr.smithi067.rdualw (mgr.24569) 331 : cluster [DBG] pgmap v274: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:27.187 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 627 sec 2022-03-17T15:38:28.187 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 628 sec 2022-03-17T15:38:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:27.592949+0000 mgr.smithi067.rdualw (mgr.24569) 332 : cluster [DBG] pgmap v275: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:27.592949+0000 mgr.smithi067.rdualw (mgr.24569) 332 : cluster [DBG] pgmap v275: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:29.187 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 629 sec 2022-03-17T15:38:30.187 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 630 sec 2022-03-17T15:38:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:29.593945+0000 mgr.smithi067.rdualw (mgr.24569) 333 : cluster [DBG] pgmap v276: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:30.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:29.593945+0000 mgr.smithi067.rdualw (mgr.24569) 333 : cluster [DBG] pgmap v276: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:31.187 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 631 sec 2022-03-17T15:38:32.187 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 632 sec 2022-03-17T15:38:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:31.595142+0000 mgr.smithi067.rdualw (mgr.24569) 334 : cluster [DBG] pgmap v277: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:31.595142+0000 mgr.smithi067.rdualw (mgr.24569) 334 : cluster [DBG] pgmap v277: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.8 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:33.188 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 633 sec 2022-03-17T15:38:34.188 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 634 sec 2022-03-17T15:38:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:33.596233+0000 mgr.smithi067.rdualw (mgr.24569) 335 : cluster [DBG] pgmap v278: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:38:34.480014+0000 mon.smithi067 (mon.1) 93 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:38:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:38:34.480620+0000 mon.smithi061 (mon.0) 221 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:38:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:38:34.483550+0000 mon.smithi067 (mon.1) 94 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:38:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:38:34.484075+0000 mon.smithi061 (mon.0) 222 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:38:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:33.596233+0000 mgr.smithi067.rdualw (mgr.24569) 335 : cluster [DBG] pgmap v278: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:38:34.480014+0000 mon.smithi067 (mon.1) 93 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:38:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:38:34.480620+0000 mon.smithi061 (mon.0) 221 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:38:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:38:34.483550+0000 mon.smithi067 (mon.1) 94 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:38:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:38:34.484075+0000 mon.smithi061 (mon.0) 222 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:38:35.188 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 635 sec 2022-03-17T15:38:36.188 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 636 sec 2022-03-17T15:38:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:35.597367+0000 mgr.smithi067.rdualw (mgr.24569) 336 : cluster [DBG] pgmap v279: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:35.597367+0000 mgr.smithi067.rdualw (mgr.24569) 336 : cluster [DBG] pgmap v279: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:37.188 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 637 sec 2022-03-17T15:38:38.188 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 638 sec 2022-03-17T15:38:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:37.598215+0000 mgr.smithi067.rdualw (mgr.24569) 337 : cluster [DBG] pgmap v280: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:37.598215+0000 mgr.smithi067.rdualw (mgr.24569) 337 : cluster [DBG] pgmap v280: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:39.188 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 639 sec 2022-03-17T15:38:40.188 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 640 sec 2022-03-17T15:38:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:39.599084+0000 mgr.smithi067.rdualw (mgr.24569) 338 : cluster [DBG] pgmap v281: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:39.599084+0000 mgr.smithi067.rdualw (mgr.24569) 338 : cluster [DBG] pgmap v281: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:41.188 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 641 sec 2022-03-17T15:38:42.189 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 642 sec 2022-03-17T15:38:43.052 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:42 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: start operation timed out. Terminating. 2022-03-17T15:38:43.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:41.600317+0000 mgr.smithi067.rdualw (mgr.24569) 339 : cluster [DBG] pgmap v282: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:41.600317+0000 mgr.smithi067.rdualw (mgr.24569) 339 : cluster [DBG] pgmap v282: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:43.188 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 643 sec 2022-03-17T15:38:44.189 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 644 sec 2022-03-17T15:38:44.302 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:44 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Failed with result 'timeout'. 2022-03-17T15:38:44.302 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:44 smithi061 systemd[1]: Failed to start Ceph osd.0 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:38:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:43.601310+0000 mgr.smithi067.rdualw (mgr.24569) 340 : cluster [DBG] pgmap v283: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 682 B/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:43.601310+0000 mgr.smithi067.rdualw (mgr.24569) 340 : cluster [DBG] pgmap v283: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 682 B/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:45.189 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 645 sec 2022-03-17T15:38:46.189 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 646 sec 2022-03-17T15:38:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:45.602624+0000 mgr.smithi067.rdualw (mgr.24569) 341 : cluster [DBG] pgmap v284: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.3 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:45.602624+0000 mgr.smithi067.rdualw (mgr.24569) 341 : cluster [DBG] pgmap v284: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.3 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:47.189 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 647 sec 2022-03-17T15:38:48.190 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 648 sec 2022-03-17T15:38:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:47.603605+0000 mgr.smithi067.rdualw (mgr.24569) 342 : cluster [DBG] pgmap v285: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 767 B/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:47.603605+0000 mgr.smithi067.rdualw (mgr.24569) 342 : cluster [DBG] pgmap v285: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 767 B/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:49.189 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 649 sec 2022-03-17T15:38:50.190 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 650 sec 2022-03-17T15:38:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:49.604373+0000 mgr.smithi067.rdualw (mgr.24569) 343 : cluster [DBG] pgmap v286: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 767 B/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:49.604373+0000 mgr.smithi067.rdualw (mgr.24569) 343 : cluster [DBG] pgmap v286: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 767 B/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:51.190 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 651 sec 2022-03-17T15:38:52.190 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 652 sec 2022-03-17T15:38:52.564 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:38:52.855 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:38:52.856 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (16m) 8m ago 17m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:38:52.856 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (9m) 8m ago 17m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:38:52.856 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (8m) 8m ago 17m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:38:52.856 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (16m) 8m ago 17m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:38:52.857 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (9m) 8m ago 13m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:38:52.857 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (9m) 8m ago 13m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:38:52.857 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (10m) 8m ago 18m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:38:52.857 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (10m) 8m ago 16m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:38:52.858 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (10m) 8m ago 18m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:38:52.858 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (9m) 8m ago 16m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:38:52.858 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (10m) 8m ago 10m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:38:52.859 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (10m) 8m ago 10m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:38:52.859 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (17m) 8m ago 17m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:38:52.859 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (16m) 8m ago 16m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:38:52.859 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (16m) 8m ago 16m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:38:52.860 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (16m) 8m ago 16m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:38:52.860 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (15m) 8m ago 15m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:38:52.860 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (15m) 8m ago 15m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:38:52.860 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (15m) 8m ago 15m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:38:52.860 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (15m) 8m ago 15m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:38:52.861 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (14m) 8m ago 14m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:38:52.861 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (14m) 8m ago 14m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:38:52.861 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (16m) 8m ago 17m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:38:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:51.605787+0000 mgr.smithi067.rdualw (mgr.24569) 344 : cluster [DBG] pgmap v287: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.3 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:51.605787+0000 mgr.smithi067.rdualw (mgr.24569) 344 : cluster [DBG] pgmap v287: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.3 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:53.190 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 653 sec 2022-03-17T15:38:53.197 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:38:53.197 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:38:53.197 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:38:53.198 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:38:53.198 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:38:53.198 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:38:53.198 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:38:53.199 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:38:53.199 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7 2022-03-17T15:38:53.199 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:38:53.199 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:38:53.200 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:38:53.200 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:38:53.200 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:38:53.200 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:38:53.200 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 3 2022-03-17T15:38:53.201 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:38:53.201 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:38:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:38:52.548939+0000 mgr.smithi067.rdualw (mgr.24569) 345 : audit [DBG] from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:38:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:38:52.837142+0000 mgr.smithi067.rdualw (mgr.24569) 346 : audit [DBG] from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:38:54.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:38:53.195806+0000 mon.smithi061 (mon.0) 223 : audit [DBG] from='client.? 172.21.15.61:0/496443595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:38:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:38:52.548939+0000 mgr.smithi067.rdualw (mgr.24569) 345 : audit [DBG] from='client.34362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:38:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:38:52.837142+0000 mgr.smithi067.rdualw (mgr.24569) 346 : audit [DBG] from='client.34366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:38:54.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:38:53.195806+0000 mon.smithi061 (mon.0) 223 : audit [DBG] from='client.? 172.21.15.61:0/496443595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:38:54.190 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 654 sec 2022-03-17T15:38:54.494 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:54 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Service RestartSec=10s expired, scheduling restart. 2022-03-17T15:38:54.495 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:54 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Scheduled restart job, restart counter is at 4. 2022-03-17T15:38:54.495 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:54 smithi061 systemd[1]: Stopped Ceph osd.0 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:38:54.495 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:54 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 80548 (bash) in control group while starting unit. Ignoring. 2022-03-17T15:38:54.496 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:54 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:38:54.496 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:54 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 80625 (podman) in control group while starting unit. Ignoring. 2022-03-17T15:38:54.496 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:54 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:38:54.496 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:54 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 80641 (conmon) in control group while starting unit. Ignoring. 2022-03-17T15:38:54.497 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:54 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:38:54.497 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:54 smithi061 systemd[1]: Starting Ceph osd.0 for ae1b9b88-a605-11ec-8c35-001a4aab830c... 2022-03-17T15:38:54.497 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:54 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 80548 (bash) in control group while starting unit. Ignoring. 2022-03-17T15:38:54.497 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:54 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:38:54.498 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:54 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 80625 (podman) in control group while starting unit. Ignoring. 2022-03-17T15:38:54.498 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:54 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:38:54.498 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:54 smithi061 systemd[1]: ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service: Found left-over process 80641 (conmon) in control group while starting unit. Ignoring. 2022-03-17T15:38:54.498 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:54 smithi061 systemd[1]: This usually indicates unclean termination of a previous run, or service implementation deficiencies. 2022-03-17T15:38:54.802 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:54 smithi061 bash[81271]: 20e19b88dc85549b834681a3f0dd868a1085b2d0310fdd72d9efa2c2edf3a626 2022-03-17T15:38:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:53.606568+0000 mgr.smithi067.rdualw (mgr.24569) 347 : cluster [DBG] pgmap v288: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:53.606568+0000 mgr.smithi067.rdualw (mgr.24569) 347 : cluster [DBG] pgmap v288: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:55.190 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 655 sec 2022-03-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi061.stdout: 0 cleanup 656 sec 2022-03-17T15:38:55.880 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi061.stdout: Operation Count AvgLat MaxLat 2022-03-17T15:38:55.881 INFO:teuthology.orchestra.run.smithi061.stdout: ---------------------------------------- 2022-03-17T15:38:55.882 INFO:teuthology.orchestra.run.smithi061.stdout: NTCreateX 2 659364.185 659366.278 2022-03-17T15:38:55.882 INFO:teuthology.orchestra.run.smithi061.stdout: Qpathinfo 2 659360.078 659361.599 2022-03-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi061.stdout: WriteX 1 659372.663 659372.663 2022-03-17T15:38:55.883 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:38:55.884 INFO:teuthology.orchestra.run.smithi061.stdout:Throughput 0 MB/sec 5 clients 5 procs max_latency=602865.792 ms 2022-03-17T15:38:55.885 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:55 smithi061 bash[80625]: time="2022-03-17T15:38:55Z" level=error msg="Could not retrieve exit code from event: died not found: unable to find event" 2022-03-17T15:38:55.885 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:55 smithi061 bash[81336]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-03-17T15:38:55.885 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:55 smithi061 bash[81336]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2022-03-17T15:38:55.886 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:55 smithi061 bash[81336]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2022-03-17T15:38:55.886 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:55 smithi061 bash[81336]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2022-03-17T15:38:55.886 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:55 smithi061 bash[81336]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2022-03-17T15:38:55.886 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:55 smithi061 bash[81336]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2022-03-17T15:38:55.887 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:55 smithi061 bash[81336]: --> ceph-volume lvm activate successful for osd ID: 0 2022-03-17T15:38:55.888 DEBUG:teuthology.orchestra.run.smithi061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'umount /mnt/foo' 2022-03-17T15:38:55.962 DEBUG:teuthology.orchestra.run.smithi061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'while ! mount -t nfs $(hostname):/fake /mnt/foo ; do sleep 5 ; done' 2022-03-17T15:38:56.043 DEBUG:teuthology.orchestra.run.smithi061:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'cd /mnt/foo && dbench 5 -t 5' 2022-03-17T15:38:56.071 INFO:teuthology.orchestra.run.smithi061.stdout:dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 2022-03-17T15:38:56.072 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:38:56.072 INFO:teuthology.orchestra.run.smithi061.stdout:Running for 5 seconds with load '/usr/share/dbench/client.txt' and minimum warmup 1 secs 2022-03-17T15:38:56.073 INFO:teuthology.orchestra.run.smithi061.stdout:4 of 5 processes prepared for launch 0 sec 2022-03-17T15:38:56.172 INFO:teuthology.orchestra.run.smithi061.stdout:5 of 5 processes prepared for launch 0 sec 2022-03-17T15:38:56.182 INFO:teuthology.orchestra.run.smithi061.stdout:releasing clients 2022-03-17T15:38:56.964 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:56 smithi061 podman[81555]: 2022-03-17T15:38:56.965 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:56 smithi061 bash[81555]: a6b168048b8faab4285f6b029c982259dad704c4fa60afa98205c72471cb54ac 2022-03-17T15:38:56.965 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:55.607713+0000 mgr.smithi067.rdualw (mgr.24569) 348 : cluster [DBG] pgmap v289: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:55.607713+0000 mgr.smithi067.rdualw (mgr.24569) 348 : cluster [DBG] pgmap v289: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 1.8 KiB/s wr, 1 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:57.302 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:56 smithi061 systemd[1]: Started Ceph osd.0 for ae1b9b88-a605-11ec-8c35-001a4aab830c. 2022-03-17T15:38:57.802 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:38:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd-0[81570]: debug 2022-03-17T15:38:57.383+0000 7fed941b6200 -1 Falling back to public interface 2022-03-17T15:38:58.172 INFO:teuthology.orchestra.run.smithi061.stdout: 5 997 39.83 MB/sec execute 1 sec latency 25.832 ms 2022-03-17T15:38:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:38:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:57.608496+0000 mgr.smithi067.rdualw (mgr.24569) 349 : cluster [DBG] pgmap v290: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:38:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:57.608496+0000 mgr.smithi067.rdualw (mgr.24569) 349 : cluster [DBG] pgmap v290: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:38:59.172 INFO:teuthology.orchestra.run.smithi061.stdout: 5 2033 30.68 MB/sec execute 2 sec latency 17.613 ms 2022-03-17T15:39:00.172 INFO:teuthology.orchestra.run.smithi061.stdout: 5 3215 33.86 MB/sec execute 3 sec latency 17.562 ms 2022-03-17T15:39:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:38:59.609306+0000 mgr.smithi067.rdualw (mgr.24569) 350 : cluster [DBG] pgmap v291: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:39:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:38:59.609306+0000 mgr.smithi067.rdualw (mgr.24569) 350 : cluster [DBG] pgmap v291: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 314 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 1.2 KiB/s wr, 0 op/s; 188/1377 objects degraded (13.653%) 2022-03-17T15:39:01.172 INFO:teuthology.orchestra.run.smithi061.stdout: 5 3976 32.21 MB/sec execute 4 sec latency 31.688 ms 2022-03-17T15:39:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:01.662360+0000 mon.smithi061 (mon.0) 224 : cluster [WRN] Health check update: Degraded data redundancy: 258/1845 objects degraded (13.984%), 28 pgs degraded, 49 pgs undersized (PG_DEGRADED) 2022-03-17T15:39:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:01.662360+0000 mon.smithi061 (mon.0) 224 : cluster [WRN] Health check update: Degraded data redundancy: 258/1845 objects degraded (13.984%), 28 pgs degraded, 49 pgs undersized (PG_DEGRADED) 2022-03-17T15:39:02.172 INFO:teuthology.orchestra.run.smithi061.stdout: 5 cleanup 5 sec 2022-03-17T15:39:02.336 INFO:teuthology.orchestra.run.smithi061.stdout: 0 cleanup 5 sec 2022-03-17T15:39:02.336 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:39:02.336 INFO:teuthology.orchestra.run.smithi061.stdout: Operation Count AvgLat MaxLat 2022-03-17T15:39:02.336 INFO:teuthology.orchestra.run.smithi061.stdout: ---------------------------------------- 2022-03-17T15:39:02.337 INFO:teuthology.orchestra.run.smithi061.stdout: NTCreateX 3623 2.237 31.684 2022-03-17T15:39:02.337 INFO:teuthology.orchestra.run.smithi061.stdout: Close 2756 1.514 21.284 2022-03-17T15:39:02.337 INFO:teuthology.orchestra.run.smithi061.stdout: Rename 167 4.897 18.632 2022-03-17T15:39:02.337 INFO:teuthology.orchestra.run.smithi061.stdout: Unlink 684 2.485 19.998 2022-03-17T15:39:02.338 INFO:teuthology.orchestra.run.smithi061.stdout: Qpathinfo 3231 0.783 12.326 2022-03-17T15:39:02.338 INFO:teuthology.orchestra.run.smithi061.stdout: Qfileinfo 698 4.215 14.702 2022-03-17T15:39:02.338 INFO:teuthology.orchestra.run.smithi061.stdout: Qfsinfo 648 0.523 4.902 2022-03-17T15:39:02.338 INFO:teuthology.orchestra.run.smithi061.stdout: Sfileinfo 379 5.161 15.410 2022-03-17T15:39:02.339 INFO:teuthology.orchestra.run.smithi061.stdout: Find 1251 0.428 8.861 2022-03-17T15:39:02.339 INFO:teuthology.orchestra.run.smithi061.stdout: WriteX 2538 0.018 0.076 2022-03-17T15:39:02.339 INFO:teuthology.orchestra.run.smithi061.stdout: ReadX 5419 0.013 1.283 2022-03-17T15:39:02.339 INFO:teuthology.orchestra.run.smithi061.stdout: LockX 10 0.447 1.201 2022-03-17T15:39:02.340 INFO:teuthology.orchestra.run.smithi061.stdout: UnlockX 10 0.411 1.350 2022-03-17T15:39:02.340 INFO:teuthology.orchestra.run.smithi061.stdout: Flush 335 5.205 17.504 2022-03-17T15:39:02.340 INFO:teuthology.orchestra.run.smithi061.stdout: 2022-03-17T15:39:02.340 INFO:teuthology.orchestra.run.smithi061.stdout:Throughput 32.2145 MB/sec 5 clients 5 procs max_latency=31.688 ms 2022-03-17T15:39:02.341 DEBUG:teuthology.parallel:result is None 2022-03-17T15:39:03.033 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:01.610564+0000 mgr.smithi067.rdualw (mgr.24569) 351 : cluster [DBG] pgmap v292: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 333 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.0 KiB/s rd, 12 MiB/s wr, 411 op/s; 258/1845 objects degraded (13.984%) 2022-03-17T15:39:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:01.610564+0000 mgr.smithi067.rdualw (mgr.24569) 351 : cluster [DBG] pgmap v292: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 333 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.0 KiB/s rd, 12 MiB/s wr, 411 op/s; 258/1845 objects degraded (13.984%) 2022-03-17T15:39:03.302 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:39:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd-0[81570]: debug 2022-03-17T15:39:03.030+0000 7fed941b6200 -1 osd.0 72 log_to_monitors {default=true} 2022-03-17T15:39:04.052 INFO:journalctl@ceph.osd.0.smithi061.stdout:Mar 17 15:39:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-osd-0[81570]: debug 2022-03-17T15:39:03.738+0000 7fed858d0700 -1 osd.0 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2022-03-17T15:39:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:03.034961+0000 mon.smithi061 (mon.0) 225 : audit [INF] from='osd.0 [v2:172.21.15.61:6802/854676548,v1:172.21.15.61:6803/854676548]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2022-03-17T15:39:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:03.034961+0000 mon.smithi061 (mon.0) 225 : audit [INF] from='osd.0 [v2:172.21.15.61:6802/854676548,v1:172.21.15.61:6803/854676548]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2022-03-17T15:39:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:03.611459+0000 mgr.smithi067.rdualw (mgr.24569) 352 : cluster [DBG] pgmap v293: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 333 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.0 KiB/s rd, 12 MiB/s wr, 410 op/s; 258/1845 objects degraded (13.984%) 2022-03-17T15:39:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:03.725281+0000 mon.smithi061 (mon.0) 226 : audit [INF] from='osd.0 [v2:172.21.15.61:6802/854676548,v1:172.21.15.61:6803/854676548]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2022-03-17T15:39:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:03.725378+0000 mon.smithi061 (mon.0) 227 : cluster [DBG] osdmap e76: 8 total, 7 up, 8 in 2022-03-17T15:39:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:03.725969+0000 mon.smithi061 (mon.0) 228 : audit [INF] from='osd.0 [v2:172.21.15.61:6802/854676548,v1:172.21.15.61:6803/854676548]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]: dispatch 2022-03-17T15:39:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:03.611459+0000 mgr.smithi067.rdualw (mgr.24569) 352 : cluster [DBG] pgmap v293: 129 pgs: 28 active+undersized+degraded, 21 active+undersized, 80 active+clean; 333 MiB data, 2.5 GiB used, 713 GiB / 715 GiB avail; 4.0 KiB/s rd, 12 MiB/s wr, 410 op/s; 258/1845 objects degraded (13.984%) 2022-03-17T15:39:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:03.725281+0000 mon.smithi061 (mon.0) 226 : audit [INF] from='osd.0 [v2:172.21.15.61:6802/854676548,v1:172.21.15.61:6803/854676548]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2022-03-17T15:39:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:03.725378+0000 mon.smithi061 (mon.0) 227 : cluster [DBG] osdmap e76: 8 total, 7 up, 8 in 2022-03-17T15:39:05.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:03.725969+0000 mon.smithi061 (mon.0) 228 : audit [INF] from='osd.0 [v2:172.21.15.61:6802/854676548,v1:172.21.15.61:6803/854676548]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi061", "root=default"]}]: dispatch 2022-03-17T15:39:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:04.721172+0000 mon.smithi061 (mon.0) 229 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2022-03-17T15:39:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:04.730078+0000 mon.smithi067 (mon.1) 95 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:39:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:04.730284+0000 mon.smithi061 (mon.0) 230 : cluster [INF] osd.0 [v2:172.21.15.61:6802/854676548,v1:172.21.15.61:6803/854676548] boot 2022-03-17T15:39:06.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:04.730363+0000 mon.smithi061 (mon.0) 231 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2022-03-17T15:39:06.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:05.728940+0000 mon.smithi061 (mon.0) 232 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2022-03-17T15:39:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:04.721172+0000 mon.smithi061 (mon.0) 229 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2022-03-17T15:39:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:04.730078+0000 mon.smithi067 (mon.1) 95 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2022-03-17T15:39:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:04.730284+0000 mon.smithi061 (mon.0) 230 : cluster [INF] osd.0 [v2:172.21.15.61:6802/854676548,v1:172.21.15.61:6803/854676548] boot 2022-03-17T15:39:06.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:04.730363+0000 mon.smithi061 (mon.0) 231 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2022-03-17T15:39:06.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:05.728940+0000 mon.smithi061 (mon.0) 232 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2022-03-17T15:39:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:05.612518+0000 mgr.smithi067.rdualw (mgr.24569) 353 : cluster [DBG] pgmap v296: 129 pgs: 33 peering, 9 active+undersized+degraded, 7 active+undersized, 80 active+clean; 242 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 13 KiB/s rd, 21 MiB/s wr, 890 op/s; 96/696 objects degraded (13.793%) 2022-03-17T15:39:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:06.730072+0000 mon.smithi061 (mon.0) 233 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2022-03-17T15:39:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:05.612518+0000 mgr.smithi067.rdualw (mgr.24569) 353 : cluster [DBG] pgmap v296: 129 pgs: 33 peering, 9 active+undersized+degraded, 7 active+undersized, 80 active+clean; 242 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 13 KiB/s rd, 21 MiB/s wr, 890 op/s; 96/696 objects degraded (13.793%) 2022-03-17T15:39:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:06.730072+0000 mon.smithi061 (mon.0) 233 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2022-03-17T15:39:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:07.613214+0000 mgr.smithi067.rdualw (mgr.24569) 354 : cluster [DBG] pgmap v299: 129 pgs: 33 peering, 9 active+undersized+degraded, 7 active+undersized, 80 active+clean; 242 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 550 op/s; 96/696 objects degraded (13.793%) 2022-03-17T15:39:09.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:07.762337+0000 mon.smithi061 (mon.0) 234 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2022-03-17T15:39:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:07.613214+0000 mgr.smithi067.rdualw (mgr.24569) 354 : cluster [DBG] pgmap v299: 129 pgs: 33 peering, 9 active+undersized+degraded, 7 active+undersized, 80 active+clean; 242 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 15 KiB/s rd, 5.8 MiB/s wr, 550 op/s; 96/696 objects degraded (13.793%) 2022-03-17T15:39:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:07.762337+0000 mon.smithi061 (mon.0) 234 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2022-03-17T15:39:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:08.763956+0000 mon.smithi061 (mon.0) 235 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2022-03-17T15:39:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:09.310565+0000 mon.smithi061 (mon.0) 236 : cluster [WRN] Health check update: Degraded data redundancy: 96/696 objects degraded (13.793%), 9 pgs degraded, 16 pgs undersized (PG_DEGRADED) 2022-03-17T15:39:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:08.763956+0000 mon.smithi061 (mon.0) 235 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2022-03-17T15:39:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:09.310565+0000 mon.smithi061 (mon.0) 236 : cluster [WRN] Health check update: Degraded data redundancy: 96/696 objects degraded (13.793%), 9 pgs degraded, 16 pgs undersized (PG_DEGRADED) 2022-03-17T15:39:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:09.613793+0000 mgr.smithi067.rdualw (mgr.24569) 355 : cluster [DBG] pgmap v302: 129 pgs: 33 peering, 4 active+undersized+degraded, 1 active+recovery_wait+degraded, 1 active+recovering, 90 active+clean; 240 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 22 KiB/s wr, 5 op/s; 80/642 objects degraded (12.461%); 0 B/s, 2 keys/s, 8 objects/s recovering 2022-03-17T15:39:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:09.613793+0000 mgr.smithi067.rdualw (mgr.24569) 355 : cluster [DBG] pgmap v302: 129 pgs: 33 peering, 4 active+undersized+degraded, 1 active+recovery_wait+degraded, 1 active+recovering, 90 active+clean; 240 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 22 KiB/s wr, 5 op/s; 80/642 objects degraded (12.461%); 0 B/s, 2 keys/s, 8 objects/s recovering 2022-03-17T15:39:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:11.316818+0000 mon.smithi061 (mon.0) 237 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2022-03-17T15:39:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:11.614450+0000 mgr.smithi067.rdualw (mgr.24569) 356 : cluster [DBG] pgmap v304: 129 pgs: 1 active+recovering+undersized+remapped, 118 active+clean, 3 active+recovery_wait+degraded, 1 active+recovering, 6 active+recovery_wait+undersized+degraded+remapped; 212 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 489 KiB/s wr, 28 op/s; 261/429 objects degraded (60.839%); 1.3 MiB/s, 51 keys/s, 25 objects/s recovering 2022-03-17T15:39:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:11.316818+0000 mon.smithi061 (mon.0) 237 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2022-03-17T15:39:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:11.614450+0000 mgr.smithi067.rdualw (mgr.24569) 356 : cluster [DBG] pgmap v304: 129 pgs: 1 active+recovering+undersized+remapped, 118 active+clean, 3 active+recovery_wait+degraded, 1 active+recovering, 6 active+recovery_wait+undersized+degraded+remapped; 212 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 489 KiB/s wr, 28 op/s; 261/429 objects degraded (60.839%); 1.3 MiB/s, 51 keys/s, 25 objects/s recovering 2022-03-17T15:39:13.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:12.320947+0000 mon.smithi061 (mon.0) 238 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2022-03-17T15:39:13.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:12.863341+0000 mon.smithi067 (mon.1) 96 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:39:13.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:12.864846+0000 mon.smithi067 (mon.1) 97 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:39:13.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:12.865809+0000 mon.smithi067 (mon.1) 98 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:39:13.807 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:39:12.866692+0000 mgr.smithi067.rdualw (mgr.24569) 357 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:39:13.807 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:13.298007+0000 mon.smithi061 (mon.0) 239 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:39:13.807 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:13.306667+0000 mon.smithi061 (mon.0) 240 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:39:13.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:12.320947+0000 mon.smithi061 (mon.0) 238 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2022-03-17T15:39:13.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:12.863341+0000 mon.smithi067 (mon.1) 96 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:39:13.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:12.864846+0000 mon.smithi067 (mon.1) 97 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:39:13.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:12.865809+0000 mon.smithi067 (mon.1) 98 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:39:13.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:39:12.866692+0000 mgr.smithi067.rdualw (mgr.24569) 357 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:39:13.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:13.298007+0000 mon.smithi061 (mon.0) 239 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:39:13.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:13.306667+0000 mon.smithi061 (mon.0) 240 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:39:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:13.615019+0000 mgr.smithi067.rdualw (mgr.24569) 358 : cluster [DBG] pgmap v306: 129 pgs: 1 active+recovering+undersized+remapped, 118 active+clean, 3 active+recovery_wait+degraded, 1 active+recovering, 6 active+recovery_wait+undersized+degraded+remapped; 212 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 409 KiB/s wr, 23 op/s; 261/429 objects degraded (60.839%); 1.1 MiB/s, 43 keys/s, 21 objects/s recovering 2022-03-17T15:39:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:14.311320+0000 mon.smithi061 (mon.0) 241 : cluster [WRN] Health check update: Degraded data redundancy: 261/429 objects degraded (60.839%), 9 pgs degraded (PG_DEGRADED) 2022-03-17T15:39:14.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:13.615019+0000 mgr.smithi067.rdualw (mgr.24569) 358 : cluster [DBG] pgmap v306: 129 pgs: 1 active+recovering+undersized+remapped, 118 active+clean, 3 active+recovery_wait+degraded, 1 active+recovering, 6 active+recovery_wait+undersized+degraded+remapped; 212 MiB data, 2.1 GiB used, 713 GiB / 715 GiB avail; 409 KiB/s wr, 23 op/s; 261/429 objects degraded (60.839%); 1.1 MiB/s, 43 keys/s, 21 objects/s recovering 2022-03-17T15:39:14.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:14.311320+0000 mon.smithi061 (mon.0) 241 : cluster [WRN] Health check update: Degraded data redundancy: 261/429 objects degraded (60.839%), 9 pgs degraded (PG_DEGRADED) 2022-03-17T15:39:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:15.332060+0000 mon.smithi061 (mon.0) 242 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2022-03-17T15:39:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:15.615588+0000 mgr.smithi067.rdualw (mgr.24569) 359 : cluster [DBG] pgmap v308: 129 pgs: 1 active+recovering+undersized+remapped, 125 active+clean, 1 active+recovery_wait+degraded, 1 active+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 385 KiB/s wr, 19 op/s; 54/429 objects degraded (12.587%); 1.0 MiB/s, 39 keys/s, 44 objects/s recovering 2022-03-17T15:39:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:15.332060+0000 mon.smithi061 (mon.0) 242 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2022-03-17T15:39:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:15.615588+0000 mgr.smithi067.rdualw (mgr.24569) 359 : cluster [DBG] pgmap v308: 129 pgs: 1 active+recovering+undersized+remapped, 125 active+clean, 1 active+recovery_wait+degraded, 1 active+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 385 KiB/s wr, 19 op/s; 54/429 objects degraded (12.587%); 1.0 MiB/s, 39 keys/s, 44 objects/s recovering 2022-03-17T15:39:17.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:16.336164+0000 mon.smithi061 (mon.0) 243 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2022-03-17T15:39:17.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:16.336164+0000 mon.smithi061 (mon.0) 243 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2022-03-17T15:39:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:17.616173+0000 mgr.smithi067.rdualw (mgr.24569) 360 : cluster [DBG] pgmap v310: 129 pgs: 1 active+recovering+undersized+remapped, 125 active+clean, 1 active+recovery_wait+degraded, 1 active+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 853 B/s wr, 0 op/s; 54/429 objects degraded (12.587%); 0 B/s, 29 objects/s recovering 2022-03-17T15:39:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:17.616173+0000 mgr.smithi067.rdualw (mgr.24569) 360 : cluster [DBG] pgmap v310: 129 pgs: 1 active+recovering+undersized+remapped, 125 active+clean, 1 active+recovery_wait+degraded, 1 active+undersized+remapped, 1 active+recovery_wait+undersized+degraded+remapped; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 853 B/s wr, 0 op/s; 54/429 objects degraded (12.587%); 0 B/s, 29 objects/s recovering 2022-03-17T15:39:19.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:18.341965+0000 mon.smithi061 (mon.0) 244 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2022-03-17T15:39:19.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:19.312269+0000 mon.smithi061 (mon.0) 245 : cluster [WRN] Health check update: Degraded data redundancy: 54/429 objects degraded (12.587%), 2 pgs degraded (PG_DEGRADED) 2022-03-17T15:39:19.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:18.341965+0000 mon.smithi061 (mon.0) 244 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2022-03-17T15:39:19.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:19.312269+0000 mon.smithi061 (mon.0) 245 : cluster [WRN] Health check update: Degraded data redundancy: 54/429 objects degraded (12.587%), 2 pgs degraded (PG_DEGRADED) 2022-03-17T15:39:20.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:19.342956+0000 mon.smithi061 (mon.0) 246 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2022-03-17T15:39:20.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:19.440681+0000 mon.smithi061 (mon.0) 247 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:39:20.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:19.616855+0000 mgr.smithi067.rdualw (mgr.24569) 361 : cluster [DBG] pgmap v313: 129 pgs: 1 active+recovering+undersized+remapped, 126 active+clean, 1 active+recovery_wait+degraded, 1 active+recovery_wait+undersized+degraded+remapped; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 54/429 objects degraded (12.587%) 2022-03-17T15:39:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:19.342956+0000 mon.smithi061 (mon.0) 246 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2022-03-17T15:39:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:19.440681+0000 mon.smithi061 (mon.0) 247 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:39:20.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:19.616855+0000 mgr.smithi067.rdualw (mgr.24569) 361 : cluster [DBG] pgmap v313: 129 pgs: 1 active+recovering+undersized+remapped, 126 active+clean, 1 active+recovery_wait+degraded, 1 active+recovery_wait+undersized+degraded+remapped; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 54/429 objects degraded (12.587%) 2022-03-17T15:39:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:21.669133+0000 mon.smithi061 (mon.0) 248 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 54/429 objects degraded (12.587%), 2 pgs degraded) 2022-03-17T15:39:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:21.669133+0000 mon.smithi061 (mon.0) 248 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 54/429 objects degraded (12.587%), 2 pgs degraded) 2022-03-17T15:39:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:21.617904+0000 mgr.smithi067.rdualw (mgr.24569) 362 : cluster [DBG] pgmap v314: 129 pgs: 1 active+recovering+undersized+remapped, 128 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 9 objects/s recovering 2022-03-17T15:39:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:21.617904+0000 mgr.smithi067.rdualw (mgr.24569) 362 : cluster [DBG] pgmap v314: 129 pgs: 1 active+recovering+undersized+remapped, 128 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 9 objects/s recovering 2022-03-17T15:39:23.515 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:39:23.809 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:39:23.810 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (16m) 9m ago 18m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:39:23.810 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (9m) 9m ago 17m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:39:23.811 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (9m) 9m ago 17m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:39:23.811 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (16m) 9m ago 17m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:39:23.812 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (10m) 9m ago 13m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:39:23.812 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (9m) 9m ago 13m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:39:23.812 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (11m) 9m ago 19m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:39:23.812 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (10m) 9m ago 17m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:39:23.813 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (10m) 9m ago 19m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:39:23.813 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (10m) 9m ago 17m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:39:23.813 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (11m) 9m ago 11m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:39:23.813 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (11m) 9m ago 11m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:39:23.814 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (17m) 9m ago 17m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:39:23.814 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (17m) 9m ago 17m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:39:23.814 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (16m) 9m ago 16m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:39:23.814 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (16m) 9m ago 16m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:39:23.814 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (16m) 9m ago 16m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:39:23.815 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (16m) 9m ago 16m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:39:23.815 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (15m) 9m ago 15m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:39:23.815 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (15m) 9m ago 15m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:39:23.815 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (15m) 9m ago 15m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:39:23.816 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (15m) 9m ago 15m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:39:23.816 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (16m) 9m ago 17m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:39:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:22.727544+0000 mon.smithi061 (mon.0) 249 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2022-03-17T15:39:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:22.727544+0000 mon.smithi061 (mon.0) 249 : cluster [DBG] osdmap e88: 8 total, 8 up, 8 in 2022-03-17T15:39:24.155 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:39:24.155 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:39:24.155 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:39:24.155 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:39:24.156 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:39:24.156 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:39:24.156 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:39:24.156 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:39:24.157 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:39:24.157 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:39:24.157 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:39:24.157 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:39:24.157 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:39:24.158 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:39:24.158 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:39:24.158 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:39:24.158 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:39:24.159 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:39:24.159 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:39:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:23.500243+0000 mgr.smithi067.rdualw (mgr.24569) 363 : audit [DBG] from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:39:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:23.618659+0000 mgr.smithi067.rdualw (mgr.24569) 364 : cluster [DBG] pgmap v316: 129 pgs: 1 active+recovering+undersized+remapped, 128 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 9 objects/s recovering 2022-03-17T15:39:25.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:23.732752+0000 mon.smithi061 (mon.0) 250 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2022-03-17T15:39:25.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:23.791402+0000 mgr.smithi067.rdualw (mgr.24569) 365 : audit [DBG] from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:39:25.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:24.153070+0000 mon.smithi061 (mon.0) 251 : audit [DBG] from='client.? 172.21.15.61:0/1695975135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:39:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:23.500243+0000 mgr.smithi067.rdualw (mgr.24569) 363 : audit [DBG] from='client.34378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:39:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:23.618659+0000 mgr.smithi067.rdualw (mgr.24569) 364 : cluster [DBG] pgmap v316: 129 pgs: 1 active+recovering+undersized+remapped, 128 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 0 B/s, 9 objects/s recovering 2022-03-17T15:39:25.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:23.732752+0000 mon.smithi061 (mon.0) 250 : cluster [DBG] osdmap e89: 8 total, 8 up, 8 in 2022-03-17T15:39:25.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:23.791402+0000 mgr.smithi067.rdualw (mgr.24569) 365 : audit [DBG] from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:39:25.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:24.153070+0000 mon.smithi061 (mon.0) 251 : audit [DBG] from='client.? 172.21.15.61:0/1695975135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:39:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:25.619438+0000 mgr.smithi067.rdualw (mgr.24569) 366 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 326 B/s rd, 0 op/s; 0 B/s, 13 objects/s recovering 2022-03-17T15:39:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:25.619438+0000 mgr.smithi067.rdualw (mgr.24569) 366 : cluster [DBG] pgmap v318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 326 B/s rd, 0 op/s; 0 B/s, 13 objects/s recovering 2022-03-17T15:39:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:27.620166+0000 mgr.smithi067.rdualw (mgr.24569) 367 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 0 B/s, 10 objects/s recovering 2022-03-17T15:39:29.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:27.620166+0000 mgr.smithi067.rdualw (mgr.24569) 367 : cluster [DBG] pgmap v319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 0 B/s, 10 objects/s recovering 2022-03-17T15:39:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:29.620976+0000 mgr.smithi067.rdualw (mgr.24569) 368 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 0 B/s, 3 objects/s recovering 2022-03-17T15:39:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:29.620976+0000 mgr.smithi067.rdualw (mgr.24569) 368 : cluster [DBG] pgmap v320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s; 0 B/s, 3 objects/s recovering 2022-03-17T15:39:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:31.622031+0000 mgr.smithi067.rdualw (mgr.24569) 369 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 230 B/s rd, 0 op/s; 0 B/s, 3 objects/s recovering 2022-03-17T15:39:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:31.622031+0000 mgr.smithi067.rdualw (mgr.24569) 369 : cluster [DBG] pgmap v321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 230 B/s rd, 0 op/s; 0 B/s, 3 objects/s recovering 2022-03-17T15:39:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:33.622772+0000 mgr.smithi067.rdualw (mgr.24569) 370 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 0 op/s; 0 B/s, 2 objects/s recovering 2022-03-17T15:39:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:34.441395+0000 mon.smithi061 (mon.0) 252 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:39:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:34.484919+0000 mon.smithi067 (mon.1) 99 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:39:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:34.485425+0000 mon.smithi061 (mon.0) 253 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:39:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:34.486893+0000 mon.smithi067 (mon.1) 100 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:39:35.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:34.487282+0000 mon.smithi061 (mon.0) 254 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:39:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:33.622772+0000 mgr.smithi067.rdualw (mgr.24569) 370 : cluster [DBG] pgmap v322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 0 op/s; 0 B/s, 2 objects/s recovering 2022-03-17T15:39:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:34.441395+0000 mon.smithi061 (mon.0) 252 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:39:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:34.484919+0000 mon.smithi067 (mon.1) 99 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:39:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:34.485425+0000 mon.smithi061 (mon.0) 253 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:39:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:34.486893+0000 mon.smithi067 (mon.1) 100 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:39:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:34.487282+0000 mon.smithi061 (mon.0) 254 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:39:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:34.765743+0000 mon.smithi061 (mon.0) 255 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:39:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:34.765743+0000 mon.smithi061 (mon.0) 255 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:39:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:35.623720+0000 mgr.smithi067.rdualw (mgr.24569) 371 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 344 B/s rd, 0 op/s; 0 B/s, 2 objects/s recovering 2022-03-17T15:39:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:35.623720+0000 mgr.smithi067.rdualw (mgr.24569) 371 : cluster [DBG] pgmap v323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 344 B/s rd, 0 op/s; 0 B/s, 2 objects/s recovering 2022-03-17T15:39:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:37.624411+0000 mgr.smithi067.rdualw (mgr.24569) 372 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:39:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:37.624411+0000 mgr.smithi067.rdualw (mgr.24569) 372 : cluster [DBG] pgmap v324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:39:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:39.624990+0000 mgr.smithi067.rdualw (mgr.24569) 373 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:39:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:39.624990+0000 mgr.smithi067.rdualw (mgr.24569) 373 : cluster [DBG] pgmap v325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:39:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:41.625939+0000 mgr.smithi067.rdualw (mgr.24569) 374 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:39:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:41.625939+0000 mgr.smithi067.rdualw (mgr.24569) 374 : cluster [DBG] pgmap v326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:39:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:43.626484+0000 mgr.smithi067.rdualw (mgr.24569) 375 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:39:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:43.626484+0000 mgr.smithi067.rdualw (mgr.24569) 375 : cluster [DBG] pgmap v327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:39:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:45.627454+0000 mgr.smithi067.rdualw (mgr.24569) 376 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:39:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:45.627454+0000 mgr.smithi067.rdualw (mgr.24569) 376 : cluster [DBG] pgmap v328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:39:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:47.628070+0000 mgr.smithi067.rdualw (mgr.24569) 377 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:39:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:47.628070+0000 mgr.smithi067.rdualw (mgr.24569) 377 : cluster [DBG] pgmap v329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:39:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:49.628693+0000 mgr.smithi067.rdualw (mgr.24569) 378 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:39:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:49.628693+0000 mgr.smithi067.rdualw (mgr.24569) 378 : cluster [DBG] pgmap v330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:39:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:51.629731+0000 mgr.smithi067.rdualw (mgr.24569) 379 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:39:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:51.629731+0000 mgr.smithi067.rdualw (mgr.24569) 379 : cluster [DBG] pgmap v331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:39:54.465 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:39:54.759 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:39:54.760 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (17m) 10m ago 18m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:39:54.760 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (10m) 10m ago 18m 35.4M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:39:54.760 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (9m) 9m ago 18m 7356k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:39:54.761 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (17m) 10m ago 18m 38.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:39:54.761 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (10m) 10m ago 14m 26.4M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:39:54.761 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (10m) 9m ago 14m 13.3M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:39:54.762 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (11m) 10m ago 19m 435M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:39:54.762 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (11m) 9m ago 17m 428M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:39:54.762 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (11m) 10m ago 19m 72.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:39:54.762 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (10m) 9m ago 17m 45.0M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:39:54.763 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (11m) 10m ago 11m 61.1M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:39:54.763 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (11m) 9m ago 11m 62.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:39:54.763 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (18m) 10m ago 18m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:39:54.763 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (17m) 9m ago 17m 18.2M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:39:54.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (17m) 10m ago 17m 1216M 4096M 16.2.4 8d91d370c2b8 aafae6e8e8f6 2022-03-17T15:39:54.764 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (17m) 10m ago 17m 1073M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:39:54.764 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (16m) 10m ago 16m 619M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:39:54.764 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (16m) 10m ago 16m 1146M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:39:54.764 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (16m) 9m ago 16m 1134M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:39:54.764 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (16m) 9m ago 16m 1372M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:39:54.765 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (15m) 9m ago 15m 1045M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:39:54.765 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (15m) 9m ago 15m 1827M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:39:54.765 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (17m) 10m ago 18m 47.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:39:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:53.630245+0000 mgr.smithi067.rdualw (mgr.24569) 380 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:39:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:53.630245+0000 mgr.smithi067.rdualw (mgr.24569) 380 : cluster [DBG] pgmap v332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:39:55.103 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:39:55.104 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:39:55.104 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:39:55.104 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:39:55.104 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:39:55.104 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:39:55.105 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:39:55.105 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:39:55.105 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:39:55.106 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:39:55.106 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:39:55.106 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:39:55.107 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:39:55.107 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:39:55.107 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:39:55.107 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:39:55.108 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:39:55.108 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:39:55.108 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:39:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:54.450348+0000 mgr.smithi067.rdualw (mgr.24569) 381 : audit [DBG] from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:39:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:54.741617+0000 mgr.smithi067.rdualw (mgr.24569) 382 : audit [DBG] from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:39:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:39:55.101698+0000 mon.smithi061 (mon.0) 256 : audit [DBG] from='client.? 172.21.15.61:0/4290401277' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:39:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:54.450348+0000 mgr.smithi067.rdualw (mgr.24569) 381 : audit [DBG] from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:39:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:54.741617+0000 mgr.smithi067.rdualw (mgr.24569) 382 : audit [DBG] from='client.34394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:39:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:39:55.101698+0000 mon.smithi061 (mon.0) 256 : audit [DBG] from='client.? 172.21.15.61:0/4290401277' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:39:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:55.631061+0000 mgr.smithi067.rdualw (mgr.24569) 383 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:39:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:55.631061+0000 mgr.smithi067.rdualw (mgr.24569) 383 : cluster [DBG] pgmap v333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:39:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:39:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:57.631818+0000 mgr.smithi067.rdualw (mgr.24569) 384 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:39:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:39:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:57.631818+0000 mgr.smithi067.rdualw (mgr.24569) 384 : cluster [DBG] pgmap v334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:39:59.632459+0000 mgr.smithi067.rdualw (mgr.24569) 385 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:00.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000116+0000 mon.smithi061 (mon.0) 257 : cluster [WRN] Health detail: HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T15:40:00.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000138+0000 mon.smithi061 (mon.0) 258 : cluster [WRN] [WRN] RECENT_CRASH: 3 daemons have recently crashed 2022-03-17T15:40:00.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000147+0000 mon.smithi061 (mon.0) 259 : cluster [WRN] mds.foofs.smithi061.atvhsa crashed on host smithi061 at 2022-03-17T15:29:06.488220Z 2022-03-17T15:40:00.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000157+0000 mon.smithi061 (mon.0) 260 : cluster [WRN] mds.foofs.smithi067.osftcx crashed on host smithi067 at 2022-03-17T15:28:52.485939Z 2022-03-17T15:40:00.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000163+0000 mon.smithi061 (mon.0) 261 : cluster [WRN] mds.foofs.smithi067.osftcx crashed on host smithi067 at 2022-03-17T15:29:20.491125Z 2022-03-17T15:40:00.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000172+0000 mon.smithi061 (mon.0) 262 : cluster [WRN] [WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T15:40:00.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000184+0000 mon.smithi061 (mon.0) 263 : cluster [WRN] Upgrade daemon: osd.0: cephadm exited with an error code: 1, stderr:Redeploy daemon osd.0 ... 2022-03-17T15:40:00.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000192+0000 mon.smithi061 (mon.0) 264 : cluster [WRN] Non-zero exit code 1 from systemctl start ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0 2022-03-17T15:40:00.806 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000203+0000 mon.smithi061 (mon.0) 265 : cluster [WRN] systemctl: stderr Job for ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-03-17T15:40:00.806 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000212+0000 mon.smithi061 (mon.0) 266 : cluster [WRN] systemctl: stderr See "systemctl status ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-03-17T15:40:00.806 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000221+0000 mon.smithi061 (mon.0) 267 : cluster [WRN] Traceback (most recent call last): 2022-03-17T15:40:00.806 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000231+0000 mon.smithi061 (mon.0) 268 : cluster [WRN] File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 8876, in 2022-03-17T15:40:00.807 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000240+0000 mon.smithi061 (mon.0) 269 : cluster [WRN] main() 2022-03-17T15:40:00.807 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000260+0000 mon.smithi061 (mon.0) 270 : cluster [WRN] File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 8864, in main 2022-03-17T15:40:00.807 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000270+0000 mon.smithi061 (mon.0) 271 : cluster [WRN] r = ctx.func(ctx) 2022-03-17T15:40:00.807 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000281+0000 mon.smithi061 (mon.0) 272 : cluster [WRN] File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 1940, in _default_image 2022-03-17T15:40:00.808 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000292+0000 mon.smithi061 (mon.0) 273 : cluster [WRN] return func(ctx) 2022-03-17T15:40:00.808 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000302+0000 mon.smithi061 (mon.0) 274 : cluster [WRN] File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 4806, in command_deploy 2022-03-17T15:40:00.808 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000312+0000 mon.smithi061 (mon.0) 275 : cluster [WRN] ports=daemon_ports) 2022-03-17T15:40:00.808 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000322+0000 mon.smithi061 (mon.0) 276 : cluster [WRN] File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 2886, in deploy_daemon 2022-03-17T15:40:00.808 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000331+0000 mon.smithi061 (mon.0) 277 : cluster [WRN] c, osd_fsid=osd_fsid, ports=ports) 2022-03-17T15:40:00.809 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000341+0000 mon.smithi061 (mon.0) 278 : cluster [WRN] File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 3131, in deploy_daemon_units 2022-03-17T15:40:00.809 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000352+0000 mon.smithi061 (mon.0) 279 : cluster [WRN] call_throws(ctx, ['systemctl', 'start', unit_name]) 2022-03-17T15:40:00.809 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000361+0000 mon.smithi061 (mon.0) 280 : cluster [WRN] File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 1617, in call_throws 2022-03-17T15:40:00.809 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000372+0000 mon.smithi061 (mon.0) 281 : cluster [WRN] raise RuntimeError(f'Failed command: {" ".join(command)}: {s}') 2022-03-17T15:40:00.810 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000382+0000 mon.smithi061 (mon.0) 282 : cluster [WRN] RuntimeError: Failed command: systemctl start ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0: Job for ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-03-17T15:40:00.810 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:00.000393+0000 mon.smithi061 (mon.0) 283 : cluster [WRN] See "systemctl status ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-03-17T15:40:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:39:59.632459+0000 mgr.smithi067.rdualw (mgr.24569) 385 : cluster [DBG] pgmap v335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000116+0000 mon.smithi061 (mon.0) 257 : cluster [WRN] Health detail: HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T15:40:00.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000138+0000 mon.smithi061 (mon.0) 258 : cluster [WRN] [WRN] RECENT_CRASH: 3 daemons have recently crashed 2022-03-17T15:40:00.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000147+0000 mon.smithi061 (mon.0) 259 : cluster [WRN] mds.foofs.smithi061.atvhsa crashed on host smithi061 at 2022-03-17T15:29:06.488220Z 2022-03-17T15:40:00.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000157+0000 mon.smithi061 (mon.0) 260 : cluster [WRN] mds.foofs.smithi067.osftcx crashed on host smithi067 at 2022-03-17T15:28:52.485939Z 2022-03-17T15:40:00.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000163+0000 mon.smithi061 (mon.0) 261 : cluster [WRN] mds.foofs.smithi067.osftcx crashed on host smithi067 at 2022-03-17T15:29:20.491125Z 2022-03-17T15:40:00.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000172+0000 mon.smithi061 (mon.0) 262 : cluster [WRN] [WRN] UPGRADE_REDEPLOY_DAEMON: Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T15:40:00.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000184+0000 mon.smithi061 (mon.0) 263 : cluster [WRN] Upgrade daemon: osd.0: cephadm exited with an error code: 1, stderr:Redeploy daemon osd.0 ... 2022-03-17T15:40:00.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000192+0000 mon.smithi061 (mon.0) 264 : cluster [WRN] Non-zero exit code 1 from systemctl start ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0 2022-03-17T15:40:00.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000203+0000 mon.smithi061 (mon.0) 265 : cluster [WRN] systemctl: stderr Job for ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-03-17T15:40:00.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000212+0000 mon.smithi061 (mon.0) 266 : cluster [WRN] systemctl: stderr See "systemctl status ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-03-17T15:40:00.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000221+0000 mon.smithi061 (mon.0) 267 : cluster [WRN] Traceback (most recent call last): 2022-03-17T15:40:00.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000231+0000 mon.smithi061 (mon.0) 268 : cluster [WRN] File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 8876, in 2022-03-17T15:40:00.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000240+0000 mon.smithi061 (mon.0) 269 : cluster [WRN] main() 2022-03-17T15:40:00.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000260+0000 mon.smithi061 (mon.0) 270 : cluster [WRN] File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 8864, in main 2022-03-17T15:40:00.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000270+0000 mon.smithi061 (mon.0) 271 : cluster [WRN] r = ctx.func(ctx) 2022-03-17T15:40:00.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000281+0000 mon.smithi061 (mon.0) 272 : cluster [WRN] File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 1940, in _default_image 2022-03-17T15:40:00.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000292+0000 mon.smithi061 (mon.0) 273 : cluster [WRN] return func(ctx) 2022-03-17T15:40:00.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000302+0000 mon.smithi061 (mon.0) 274 : cluster [WRN] File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 4806, in command_deploy 2022-03-17T15:40:00.821 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000312+0000 mon.smithi061 (mon.0) 275 : cluster [WRN] ports=daemon_ports) 2022-03-17T15:40:00.821 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000322+0000 mon.smithi061 (mon.0) 276 : cluster [WRN] File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 2886, in deploy_daemon 2022-03-17T15:40:00.821 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000331+0000 mon.smithi061 (mon.0) 277 : cluster [WRN] c, osd_fsid=osd_fsid, ports=ports) 2022-03-17T15:40:00.821 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000341+0000 mon.smithi061 (mon.0) 278 : cluster [WRN] File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 3131, in deploy_daemon_units 2022-03-17T15:40:00.821 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000352+0000 mon.smithi061 (mon.0) 279 : cluster [WRN] call_throws(ctx, ['systemctl', 'start', unit_name]) 2022-03-17T15:40:00.822 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000361+0000 mon.smithi061 (mon.0) 280 : cluster [WRN] File "/var/lib/ceph/ae1b9b88-a605-11ec-8c35-001a4aab830c/cephadm.73bfc5c16202a01665bf73b807bc00daf3afcf22e938da9b642da1d93a3acdee", line 1617, in call_throws 2022-03-17T15:40:00.822 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000372+0000 mon.smithi061 (mon.0) 281 : cluster [WRN] raise RuntimeError(f'Failed command: {" ".join(command)}: {s}') 2022-03-17T15:40:00.822 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000382+0000 mon.smithi061 (mon.0) 282 : cluster [WRN] RuntimeError: Failed command: systemctl start ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0: Job for ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service failed because a timeout was exceeded. 2022-03-17T15:40:00.822 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:00.000393+0000 mon.smithi061 (mon.0) 283 : cluster [WRN] See "systemctl status ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c@osd.0.service" and "journalctl -xe" for details. 2022-03-17T15:40:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:01.633345+0000 mgr.smithi067.rdualw (mgr.24569) 386 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:01.633345+0000 mgr.smithi067.rdualw (mgr.24569) 386 : cluster [DBG] pgmap v336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:03.633952+0000 mgr.smithi067.rdualw (mgr.24569) 387 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:03.633952+0000 mgr.smithi067.rdualw (mgr.24569) 387 : cluster [DBG] pgmap v337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:05.634958+0000 mgr.smithi067.rdualw (mgr.24569) 388 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:40:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:05.634958+0000 mgr.smithi067.rdualw (mgr.24569) 388 : cluster [DBG] pgmap v338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:40:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:07.635518+0000 mgr.smithi067.rdualw (mgr.24569) 389 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:07.635518+0000 mgr.smithi067.rdualw (mgr.24569) 389 : cluster [DBG] pgmap v339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:09.636153+0000 mgr.smithi067.rdualw (mgr.24569) 390 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:09.636153+0000 mgr.smithi067.rdualw (mgr.24569) 390 : cluster [DBG] pgmap v340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:11.636996+0000 mgr.smithi067.rdualw (mgr.24569) 391 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:11.636996+0000 mgr.smithi067.rdualw (mgr.24569) 391 : cluster [DBG] pgmap v341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:13.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:13.310182+0000 mon.smithi067 (mon.1) 101 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:40:13.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:13.311727+0000 mon.smithi067 (mon.1) 102 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:40:13.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:13.312697+0000 mon.smithi067 (mon.1) 103 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:40:13.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:13.310182+0000 mon.smithi067 (mon.1) 101 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:40:13.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:13.311727+0000 mon.smithi067 (mon.1) 102 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:40:13.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:13.312697+0000 mon.smithi067 (mon.1) 103 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:40:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:40:13.313586+0000 mgr.smithi067.rdualw (mgr.24569) 392 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:40:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:13.637453+0000 mgr.smithi067.rdualw (mgr.24569) 393 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:40:13.313586+0000 mgr.smithi067.rdualw (mgr.24569) 392 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:40:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:13.637453+0000 mgr.smithi067.rdualw (mgr.24569) 393 : cluster [DBG] pgmap v342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:15.638219+0000 mgr.smithi067.rdualw (mgr.24569) 394 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:40:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:15.638219+0000 mgr.smithi067.rdualw (mgr.24569) 394 : cluster [DBG] pgmap v343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:40:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:17.638707+0000 mgr.smithi067.rdualw (mgr.24569) 395 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:18.001748+0000 mon.smithi061 (mon.0) 284 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:40:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:18.401013+0000 mon.smithi067 (mon.1) 104 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:40:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:18.401477+0000 mon.smithi061 (mon.0) 285 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:40:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:17.638707+0000 mgr.smithi067.rdualw (mgr.24569) 395 : cluster [DBG] pgmap v344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:18.001748+0000 mon.smithi061 (mon.0) 284 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:40:19.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:18.401013+0000 mon.smithi067 (mon.1) 104 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:40:19.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:18.401477+0000 mon.smithi061 (mon.0) 285 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:40:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:19.639521+0000 mgr.smithi067.rdualw (mgr.24569) 396 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:19.639521+0000 mgr.smithi067.rdualw (mgr.24569) 396 : cluster [DBG] pgmap v345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:21.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:20.420510+0000 mon.smithi061 (mon.0) 286 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:40:21.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:20.830303+0000 mon.smithi067 (mon.1) 105 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:40:21.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:20.830909+0000 mon.smithi061 (mon.0) 287 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:40:21.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:20.835706+0000 mon.smithi061 (mon.0) 288 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:40:21.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:20.843266+0000 mon.smithi061 (mon.0) 289 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:40:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:20.420510+0000 mon.smithi061 (mon.0) 286 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:40:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:20.830303+0000 mon.smithi067 (mon.1) 105 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:40:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:20.830909+0000 mon.smithi061 (mon.0) 287 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:40:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:20.835706+0000 mon.smithi061 (mon.0) 288 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:40:21.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:20.843266+0000 mon.smithi061 (mon.0) 289 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:40:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:21.640437+0000 mgr.smithi067.rdualw (mgr.24569) 397 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:21.640437+0000 mgr.smithi067.rdualw (mgr.24569) 397 : cluster [DBG] pgmap v346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:23.640962+0000 mgr.smithi067.rdualw (mgr.24569) 398 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:23.640962+0000 mgr.smithi067.rdualw (mgr.24569) 398 : cluster [DBG] pgmap v347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:25.422 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:40:25.713 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:40:25.713 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (17m) 5s ago 19m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:40:25.714 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (10m) 5s ago 19m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:40:25.714 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (10m) 7s ago 18m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:40:25.714 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (17m) 5s ago 18m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:40:25.714 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (11m) 5s ago 14m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:40:25.715 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (10m) 7s ago 14m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:40:25.715 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (12m) 5s ago 20m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:40:25.715 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (11m) 7s ago 18m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:40:25.716 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (11m) 5s ago 20m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:40:25.716 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (11m) 7s ago 18m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:40:25.716 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (12m) 5s ago 12m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:40:25.716 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (12m) 7s ago 12m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:40:25.717 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (18m) 5s ago 18m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:40:25.717 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (18m) 7s ago 18m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:40:25.717 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (89s) 5s ago 17m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:40:25.717 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (17m) 5s ago 17m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:40:25.718 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (17m) 5s ago 17m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:40:25.718 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (17m) 5s ago 17m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:40:25.718 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (16m) 7s ago 16m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:40:25.718 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (16m) 7s ago 16m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:40:25.719 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (16m) 7s ago 16m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:40:25.719 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (16m) 7s ago 16m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:40:25.719 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (17m) 5s ago 18m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:40:26.057 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:40:26.057 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:40:26.058 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:40:26.058 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:40:26.058 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:40:26.058 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:40:26.058 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:40:26.059 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:40:26.059 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:40:26.059 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:40:26.059 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:40:26.060 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:40:26.060 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:40:26.060 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:40:26.060 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:40:26.060 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:40:26.061 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:40:26.061 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:40:26.061 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:40:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:25.408442+0000 mgr.smithi067.rdualw (mgr.24569) 399 : audit [DBG] from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:40:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:25.641972+0000 mgr.smithi067.rdualw (mgr.24569) 400 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:40:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:25.695153+0000 mgr.smithi067.rdualw (mgr.24569) 401 : audit [DBG] from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:40:27.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:26.055521+0000 mon.smithi061 (mon.0) 290 : audit [DBG] from='client.? 172.21.15.61:0/1478118374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:40:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:25.408442+0000 mgr.smithi067.rdualw (mgr.24569) 399 : audit [DBG] from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:40:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:25.641972+0000 mgr.smithi067.rdualw (mgr.24569) 400 : cluster [DBG] pgmap v348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:40:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:25.695153+0000 mgr.smithi067.rdualw (mgr.24569) 401 : audit [DBG] from='client.34406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:40:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:26.055521+0000 mon.smithi061 (mon.0) 290 : audit [DBG] from='client.? 172.21.15.61:0/1478118374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:40:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:27.642631+0000 mgr.smithi067.rdualw (mgr.24569) 402 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:27.642631+0000 mgr.smithi067.rdualw (mgr.24569) 402 : cluster [DBG] pgmap v349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:29.643185+0000 mgr.smithi067.rdualw (mgr.24569) 403 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:29.643185+0000 mgr.smithi067.rdualw (mgr.24569) 403 : cluster [DBG] pgmap v350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:31.644052+0000 mgr.smithi067.rdualw (mgr.24569) 404 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:31.644052+0000 mgr.smithi067.rdualw (mgr.24569) 404 : cluster [DBG] pgmap v351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:33.644684+0000 mgr.smithi067.rdualw (mgr.24569) 405 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:34.489955+0000 mon.smithi067 (mon.1) 106 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:40:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:34.490185+0000 mon.smithi067 (mon.1) 107 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:40:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:34.490442+0000 mon.smithi061 (mon.0) 291 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:40:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:34.490745+0000 mon.smithi061 (mon.0) 292 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:40:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:33.644684+0000 mgr.smithi067.rdualw (mgr.24569) 405 : cluster [DBG] pgmap v352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:34.489955+0000 mon.smithi067 (mon.1) 106 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:40:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:34.490185+0000 mon.smithi067 (mon.1) 107 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:40:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:34.490442+0000 mon.smithi061 (mon.0) 291 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:40:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:34.490745+0000 mon.smithi061 (mon.0) 292 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:40:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:35.645519+0000 mgr.smithi067.rdualw (mgr.24569) 406 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:40:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:35.645519+0000 mgr.smithi067.rdualw (mgr.24569) 406 : cluster [DBG] pgmap v353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:40:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:37.646353+0000 mgr.smithi067.rdualw (mgr.24569) 407 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:37.646353+0000 mgr.smithi067.rdualw (mgr.24569) 407 : cluster [DBG] pgmap v354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:39.647156+0000 mgr.smithi067.rdualw (mgr.24569) 408 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:39.647156+0000 mgr.smithi067.rdualw (mgr.24569) 408 : cluster [DBG] pgmap v355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:41.648096+0000 mgr.smithi067.rdualw (mgr.24569) 409 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:41.648096+0000 mgr.smithi067.rdualw (mgr.24569) 409 : cluster [DBG] pgmap v356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:43.648731+0000 mgr.smithi067.rdualw (mgr.24569) 410 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:43.648731+0000 mgr.smithi067.rdualw (mgr.24569) 410 : cluster [DBG] pgmap v357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:45.649563+0000 mgr.smithi067.rdualw (mgr.24569) 411 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:40:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:45.649563+0000 mgr.smithi067.rdualw (mgr.24569) 411 : cluster [DBG] pgmap v358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:40:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:47.650360+0000 mgr.smithi067.rdualw (mgr.24569) 412 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:47.650360+0000 mgr.smithi067.rdualw (mgr.24569) 412 : cluster [DBG] pgmap v359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:49.651161+0000 mgr.smithi067.rdualw (mgr.24569) 413 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:49.651161+0000 mgr.smithi067.rdualw (mgr.24569) 413 : cluster [DBG] pgmap v360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:51.652196+0000 mgr.smithi067.rdualw (mgr.24569) 414 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:51.652196+0000 mgr.smithi067.rdualw (mgr.24569) 414 : cluster [DBG] pgmap v361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:53.652774+0000 mgr.smithi067.rdualw (mgr.24569) 415 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:53.652774+0000 mgr.smithi067.rdualw (mgr.24569) 415 : cluster [DBG] pgmap v362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:56.392 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:40:56.683 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:40:56.683 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (18m) 36s ago 19m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:40:56.683 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (11m) 36s ago 19m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:40:56.684 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (10m) 38s ago 19m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:40:56.684 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (18m) 36s ago 19m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:40:56.684 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (11m) 36s ago 15m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:40:56.684 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (11m) 38s ago 15m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:40:56.684 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (12m) 36s ago 20m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:40:56.685 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (12m) 38s ago 18m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:40:56.685 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (12m) 36s ago 20m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:40:56.685 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (11m) 38s ago 18m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:40:56.685 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (12m) 36s ago 12m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:40:56.685 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (12m) 38s ago 12m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:40:56.686 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (19m) 36s ago 19m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:40:56.686 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (18m) 38s ago 18m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:40:56.686 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2m) 36s ago 18m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:40:56.686 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (18m) 36s ago 18m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:40:56.686 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (17m) 36s ago 17m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:40:56.687 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (17m) 36s ago 17m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:40:56.687 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (17m) 38s ago 17m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:40:56.687 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (17m) 38s ago 17m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:40:56.687 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (16m) 38s ago 16m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:40:56.687 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (16m) 38s ago 16m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:40:56.688 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (18m) 36s ago 19m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:40:57.026 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:40:57.026 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:40:57.026 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:40:57.027 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:40:57.027 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:40:57.027 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:40:57.027 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:40:57.028 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:40:57.028 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:40:57.028 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:40:57.028 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:40:57.029 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:40:57.029 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:40:57.029 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:40:57.029 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:40:57.029 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:40:57.030 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:40:57.030 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:40:57.030 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:40:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:55.653597+0000 mgr.smithi067.rdualw (mgr.24569) 416 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:40:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:55.653597+0000 mgr.smithi067.rdualw (mgr.24569) 416 : cluster [DBG] pgmap v363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:40:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:56.377374+0000 mgr.smithi067.rdualw (mgr.24569) 417 : audit [DBG] from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:40:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:56.664612+0000 mgr.smithi067.rdualw (mgr.24569) 418 : audit [DBG] from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:40:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:40:57.024324+0000 mon.smithi061 (mon.0) 293 : audit [DBG] from='client.? 172.21.15.61:0/572728308' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:40:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:56.377374+0000 mgr.smithi067.rdualw (mgr.24569) 417 : audit [DBG] from='client.34414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:40:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:56.664612+0000 mgr.smithi067.rdualw (mgr.24569) 418 : audit [DBG] from='client.34418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:40:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:40:57.024324+0000 mon.smithi061 (mon.0) 293 : audit [DBG] from='client.? 172.21.15.61:0/572728308' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:40:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:40:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:57.654166+0000 mgr.smithi067.rdualw (mgr.24569) 419 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:40:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:40:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:57.654166+0000 mgr.smithi067.rdualw (mgr.24569) 419 : cluster [DBG] pgmap v364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:40:59.654771+0000 mgr.smithi067.rdualw (mgr.24569) 420 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:40:59.654771+0000 mgr.smithi067.rdualw (mgr.24569) 420 : cluster [DBG] pgmap v365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:01.655817+0000 mgr.smithi067.rdualw (mgr.24569) 421 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:01.655817+0000 mgr.smithi067.rdualw (mgr.24569) 421 : cluster [DBG] pgmap v366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:03.656585+0000 mgr.smithi067.rdualw (mgr.24569) 422 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:03.656585+0000 mgr.smithi067.rdualw (mgr.24569) 422 : cluster [DBG] pgmap v367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:07.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:05.657444+0000 mgr.smithi067.rdualw (mgr.24569) 423 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:41:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:05.657444+0000 mgr.smithi067.rdualw (mgr.24569) 423 : cluster [DBG] pgmap v368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:41:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:07.658026+0000 mgr.smithi067.rdualw (mgr.24569) 424 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:07.658026+0000 mgr.smithi067.rdualw (mgr.24569) 424 : cluster [DBG] pgmap v369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:09.658797+0000 mgr.smithi067.rdualw (mgr.24569) 425 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:09.658797+0000 mgr.smithi067.rdualw (mgr.24569) 425 : cluster [DBG] pgmap v370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:11.659775+0000 mgr.smithi067.rdualw (mgr.24569) 426 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:11.659775+0000 mgr.smithi067.rdualw (mgr.24569) 426 : cluster [DBG] pgmap v371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:13.660323+0000 mgr.smithi067.rdualw (mgr.24569) 427 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:13.660323+0000 mgr.smithi067.rdualw (mgr.24569) 427 : cluster [DBG] pgmap v372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:15.661373+0000 mgr.smithi067.rdualw (mgr.24569) 428 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:41:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:15.661373+0000 mgr.smithi067.rdualw (mgr.24569) 428 : cluster [DBG] pgmap v373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:41:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:17.662155+0000 mgr.smithi067.rdualw (mgr.24569) 429 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:17.662155+0000 mgr.smithi067.rdualw (mgr.24569) 429 : cluster [DBG] pgmap v374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:19.662915+0000 mgr.smithi067.rdualw (mgr.24569) 430 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:19.662915+0000 mgr.smithi067.rdualw (mgr.24569) 430 : cluster [DBG] pgmap v375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:21.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:41:20.850165+0000 mon.smithi067 (mon.1) 108 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:41:21.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:41:20.851665+0000 mon.smithi067 (mon.1) 109 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:41:21.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:41:20.852568+0000 mon.smithi067 (mon.1) 110 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:41:21.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:41:20.853372+0000 mgr.smithi067.rdualw (mgr.24569) 431 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:41:21.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:41:21.305272+0000 mon.smithi061 (mon.0) 294 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:41:21.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:41:21.311180+0000 mon.smithi061 (mon.0) 295 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:41:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:41:20.850165+0000 mon.smithi067 (mon.1) 108 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:41:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:41:20.851665+0000 mon.smithi067 (mon.1) 109 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:41:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:41:20.852568+0000 mon.smithi067 (mon.1) 110 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:41:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:41:20.853372+0000 mgr.smithi067.rdualw (mgr.24569) 431 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:41:21.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:41:21.305272+0000 mon.smithi061 (mon.0) 294 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:41:21.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:41:21.311180+0000 mon.smithi061 (mon.0) 295 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:41:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:21.663702+0000 mgr.smithi067.rdualw (mgr.24569) 432 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:21.663702+0000 mgr.smithi067.rdualw (mgr.24569) 432 : cluster [DBG] pgmap v376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:23.664228+0000 mgr.smithi067.rdualw (mgr.24569) 433 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:23.664228+0000 mgr.smithi067.rdualw (mgr.24569) 433 : cluster [DBG] pgmap v377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:25.665070+0000 mgr.smithi067.rdualw (mgr.24569) 434 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:41:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:25.665070+0000 mgr.smithi067.rdualw (mgr.24569) 434 : cluster [DBG] pgmap v378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:41:27.335 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:41:27.627 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:41:27.627 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (18m) 67s ago 20m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:41:27.634 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (11m) 67s ago 20m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:41:27.634 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (11m) 69s ago 19m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:41:27.635 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (18m) 67s ago 19m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:41:27.635 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (12m) 67s ago 15m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:41:27.635 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (11m) 69s ago 15m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:41:27.635 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (13m) 67s ago 21m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:41:27.636 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (12m) 69s ago 19m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:41:27.636 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (12m) 67s ago 21m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:41:27.636 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (12m) 69s ago 19m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:41:27.636 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (13m) 67s ago 13m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:41:27.637 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (13m) 69s ago 13m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:41:27.637 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (19m) 67s ago 19m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:41:27.637 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (19m) 69s ago 19m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:41:27.637 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2m) 67s ago 18m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:41:27.637 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (18m) 67s ago 18m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:41:27.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (18m) 67s ago 18m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:41:27.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (18m) 67s ago 18m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:41:27.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (17m) 69s ago 17m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:41:27.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (17m) 69s ago 17m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:41:27.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (17m) 69s ago 17m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:41:27.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (17m) 69s ago 17m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:41:27.639 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (18m) 67s ago 19m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:41:27.974 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:41:27.974 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:41:27.974 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:41:27.974 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:41:27.975 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:41:27.975 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:41:27.975 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:41:27.975 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:41:27.976 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:41:27.976 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:41:27.976 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:41:27.976 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:41:27.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:41:27.977 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:41:27.977 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:41:27.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:41:27.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:41:27.978 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:41:27.978 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:41:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:41:27.321839+0000 mgr.smithi067.rdualw (mgr.24569) 435 : audit [DBG] from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:41:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:41:27.609248+0000 mgr.smithi067.rdualw (mgr.24569) 436 : audit [DBG] from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:41:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:27.665589+0000 mgr.smithi067.rdualw (mgr.24569) 437 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:29.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:41:27.972184+0000 mon.smithi061 (mon.0) 296 : audit [DBG] from='client.? 172.21.15.61:0/3982748035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:41:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:41:27.321839+0000 mgr.smithi067.rdualw (mgr.24569) 435 : audit [DBG] from='client.34426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:41:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:41:27.609248+0000 mgr.smithi067.rdualw (mgr.24569) 436 : audit [DBG] from='client.34430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:41:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:27.665589+0000 mgr.smithi067.rdualw (mgr.24569) 437 : cluster [DBG] pgmap v379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:29.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:41:27.972184+0000 mon.smithi061 (mon.0) 296 : audit [DBG] from='client.? 172.21.15.61:0/3982748035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:41:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:29.666147+0000 mgr.smithi067.rdualw (mgr.24569) 438 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:29.666147+0000 mgr.smithi067.rdualw (mgr.24569) 438 : cluster [DBG] pgmap v380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:31.667060+0000 mgr.smithi067.rdualw (mgr.24569) 439 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:31.667060+0000 mgr.smithi067.rdualw (mgr.24569) 439 : cluster [DBG] pgmap v381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:33.667640+0000 mgr.smithi067.rdualw (mgr.24569) 440 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:41:34.495209+0000 mon.smithi067 (mon.1) 111 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:41:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:41:34.495440+0000 mon.smithi067 (mon.1) 112 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:41:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:41:34.495680+0000 mon.smithi061 (mon.0) 297 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:41:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:41:34.495905+0000 mon.smithi061 (mon.0) 298 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:41:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:33.667640+0000 mgr.smithi067.rdualw (mgr.24569) 440 : cluster [DBG] pgmap v382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:41:34.495209+0000 mon.smithi067 (mon.1) 111 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:41:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:41:34.495440+0000 mon.smithi067 (mon.1) 112 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:41:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:41:34.495680+0000 mon.smithi061 (mon.0) 297 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:41:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:41:34.495905+0000 mon.smithi061 (mon.0) 298 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:41:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:35.668483+0000 mgr.smithi067.rdualw (mgr.24569) 441 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:41:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:35.668483+0000 mgr.smithi067.rdualw (mgr.24569) 441 : cluster [DBG] pgmap v383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:41:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:37.668958+0000 mgr.smithi067.rdualw (mgr.24569) 442 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:37.668958+0000 mgr.smithi067.rdualw (mgr.24569) 442 : cluster [DBG] pgmap v384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:39.669566+0000 mgr.smithi067.rdualw (mgr.24569) 443 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:39.669566+0000 mgr.smithi067.rdualw (mgr.24569) 443 : cluster [DBG] pgmap v385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:41.670389+0000 mgr.smithi067.rdualw (mgr.24569) 444 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:41.670389+0000 mgr.smithi067.rdualw (mgr.24569) 444 : cluster [DBG] pgmap v386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:43.671047+0000 mgr.smithi067.rdualw (mgr.24569) 445 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:45.111 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:43.671047+0000 mgr.smithi067.rdualw (mgr.24569) 445 : cluster [DBG] pgmap v387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:47.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:45.671986+0000 mgr.smithi067.rdualw (mgr.24569) 446 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:41:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:45.671986+0000 mgr.smithi067.rdualw (mgr.24569) 446 : cluster [DBG] pgmap v388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:41:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:47.672515+0000 mgr.smithi067.rdualw (mgr.24569) 447 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:47.672515+0000 mgr.smithi067.rdualw (mgr.24569) 447 : cluster [DBG] pgmap v389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:50.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:49.673115+0000 mgr.smithi067.rdualw (mgr.24569) 448 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:49.673115+0000 mgr.smithi067.rdualw (mgr.24569) 448 : cluster [DBG] pgmap v390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:51.674125+0000 mgr.smithi067.rdualw (mgr.24569) 449 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:51.674125+0000 mgr.smithi067.rdualw (mgr.24569) 449 : cluster [DBG] pgmap v391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:53.674717+0000 mgr.smithi067.rdualw (mgr.24569) 450 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:53.674717+0000 mgr.smithi067.rdualw (mgr.24569) 450 : cluster [DBG] pgmap v392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:55.675702+0000 mgr.smithi067.rdualw (mgr.24569) 451 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:41:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:55.675702+0000 mgr.smithi067.rdualw (mgr.24569) 451 : cluster [DBG] pgmap v393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:41:58.308 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:41:58.598 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:41:58.599 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (19m) 98s ago 20m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:41:58.599 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (12m) 98s ago 20m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:41:58.599 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (12m) 100s ago 20m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:41:58.599 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (19m) 98s ago 20m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:41:58.600 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (12m) 98s ago 16m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:41:58.600 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (12m) 100s ago 16m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:41:58.600 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (13m) 98s ago 21m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:41:58.600 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (13m) 100s ago 20m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:41:58.601 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (13m) 98s ago 21m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:41:58.601 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (12m) 100s ago 19m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:41:58.601 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (13m) 98s ago 13m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:41:58.601 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (13m) 100s ago 13m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:41:58.602 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (20m) 98s ago 20m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:41:58.602 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (19m) 100s ago 19m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:41:58.602 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3m) 98s ago 19m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:41:58.602 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (19m) 98s ago 19m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:41:58.602 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (18m) 98s ago 18m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:41:58.603 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (18m) 98s ago 18m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:41:58.603 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (18m) 100s ago 18m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:41:58.603 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (18m) 100s ago 18m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:41:58.604 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (17m) 100s ago 17m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:41:58.604 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (17m) 100s ago 17m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:41:58.604 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (19m) 98s ago 20m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:41:58.940 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:41:58.940 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:41:58.940 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:41:58.941 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:41:58.941 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:41:58.941 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:41:58.941 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:41:58.942 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:41:58.942 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:41:58.942 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:41:58.942 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:41:58.942 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:41:58.943 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:41:58.943 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:41:58.943 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:41:58.943 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:41:58.944 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:41:58.944 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:41:58.944 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:41:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:57.676270+0000 mgr.smithi067.rdualw (mgr.24569) 452 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:41:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:57.676270+0000 mgr.smithi067.rdualw (mgr.24569) 452 : cluster [DBG] pgmap v394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:41:58.294357+0000 mgr.smithi067.rdualw (mgr.24569) 453 : audit [DBG] from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:42:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:41:58.580842+0000 mgr.smithi067.rdualw (mgr.24569) 454 : audit [DBG] from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:42:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:41:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:41:58.938282+0000 mon.smithi061 (mon.0) 299 : audit [DBG] from='client.? 172.21.15.61:0/3782597757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:42:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:41:58.294357+0000 mgr.smithi067.rdualw (mgr.24569) 453 : audit [DBG] from='client.34438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:42:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:41:58.580842+0000 mgr.smithi067.rdualw (mgr.24569) 454 : audit [DBG] from='client.34442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:42:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:41:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:41:58.938282+0000 mon.smithi061 (mon.0) 299 : audit [DBG] from='client.? 172.21.15.61:0/3782597757' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:42:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:41:59.676921+0000 mgr.smithi067.rdualw (mgr.24569) 455 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:41:59.676921+0000 mgr.smithi067.rdualw (mgr.24569) 455 : cluster [DBG] pgmap v395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:01.677810+0000 mgr.smithi067.rdualw (mgr.24569) 456 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:01.677810+0000 mgr.smithi067.rdualw (mgr.24569) 456 : cluster [DBG] pgmap v396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:03.678428+0000 mgr.smithi067.rdualw (mgr.24569) 457 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:03.678428+0000 mgr.smithi067.rdualw (mgr.24569) 457 : cluster [DBG] pgmap v397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:05.679410+0000 mgr.smithi067.rdualw (mgr.24569) 458 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:42:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:05.679410+0000 mgr.smithi067.rdualw (mgr.24569) 458 : cluster [DBG] pgmap v398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:42:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:07.680023+0000 mgr.smithi067.rdualw (mgr.24569) 459 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:07.680023+0000 mgr.smithi067.rdualw (mgr.24569) 459 : cluster [DBG] pgmap v399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:09.680615+0000 mgr.smithi067.rdualw (mgr.24569) 460 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:09.680615+0000 mgr.smithi067.rdualw (mgr.24569) 460 : cluster [DBG] pgmap v400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:11.681460+0000 mgr.smithi067.rdualw (mgr.24569) 461 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:11.681460+0000 mgr.smithi067.rdualw (mgr.24569) 461 : cluster [DBG] pgmap v401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:13.682113+0000 mgr.smithi067.rdualw (mgr.24569) 462 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:13.682113+0000 mgr.smithi067.rdualw (mgr.24569) 462 : cluster [DBG] pgmap v402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:15.683100+0000 mgr.smithi067.rdualw (mgr.24569) 463 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:42:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:15.683100+0000 mgr.smithi067.rdualw (mgr.24569) 463 : cluster [DBG] pgmap v403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:42:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:17.683673+0000 mgr.smithi067.rdualw (mgr.24569) 464 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:17.683673+0000 mgr.smithi067.rdualw (mgr.24569) 464 : cluster [DBG] pgmap v404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:19.684222+0000 mgr.smithi067.rdualw (mgr.24569) 465 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:19.684222+0000 mgr.smithi067.rdualw (mgr.24569) 465 : cluster [DBG] pgmap v405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:21.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:42:21.315039+0000 mon.smithi067 (mon.1) 113 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:42:21.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:42:21.316554+0000 mon.smithi067 (mon.1) 114 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:42:21.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:42:21.317517+0000 mon.smithi067 (mon.1) 115 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:42:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:42:21.315039+0000 mon.smithi067 (mon.1) 113 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:42:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:42:21.316554+0000 mon.smithi067 (mon.1) 114 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:42:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:42:21.317517+0000 mon.smithi067 (mon.1) 115 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:42:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:42:21.318405+0000 mgr.smithi067.rdualw (mgr.24569) 466 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:42:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:42:21.678094+0000 mon.smithi061 (mon.0) 300 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:42:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:42:21.682615+0000 mon.smithi061 (mon.0) 301 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:42:23.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:21.684984+0000 mgr.smithi067.rdualw (mgr.24569) 467 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:23.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:42:22.074251+0000 mon.smithi061 (mon.0) 302 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:42:23.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:42:22.079431+0000 mon.smithi061 (mon.0) 303 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:42:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:42:21.318405+0000 mgr.smithi067.rdualw (mgr.24569) 466 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:42:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:42:21.678094+0000 mon.smithi061 (mon.0) 300 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:42:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:42:21.682615+0000 mon.smithi061 (mon.0) 301 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:42:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:21.684984+0000 mgr.smithi067.rdualw (mgr.24569) 467 : cluster [DBG] pgmap v406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:23.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:42:22.074251+0000 mon.smithi061 (mon.0) 302 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:42:23.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:42:22.079431+0000 mon.smithi061 (mon.0) 303 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:42:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:23.685655+0000 mgr.smithi067.rdualw (mgr.24569) 468 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:23.685655+0000 mgr.smithi067.rdualw (mgr.24569) 468 : cluster [DBG] pgmap v407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:25.686458+0000 mgr.smithi067.rdualw (mgr.24569) 469 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:42:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:25.686458+0000 mgr.smithi067.rdualw (mgr.24569) 469 : cluster [DBG] pgmap v408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:42:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:27.687055+0000 mgr.smithi067.rdualw (mgr.24569) 470 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:27.687055+0000 mgr.smithi067.rdualw (mgr.24569) 470 : cluster [DBG] pgmap v409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:29.247 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:42:29.538 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:42:29.539 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (20m) 2m ago 21m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:42:29.539 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (12m) 2m ago 21m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:42:29.539 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (12m) 2m ago 20m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:42:29.539 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (19m) 2m ago 20m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:42:29.540 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (13m) 2m ago 16m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:42:29.540 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (12m) 2m ago 16m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:42:29.540 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (14m) 2m ago 22m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:42:29.540 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (13m) 2m ago 20m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:42:29.540 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (13m) 2m ago 22m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:42:29.541 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (13m) 2m ago 20m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:42:29.541 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (14m) 2m ago 14m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:42:29.541 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (14m) 2m ago 14m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:42:29.541 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (20m) 2m ago 20m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:42:29.542 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (20m) 2m ago 20m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:42:29.542 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3m) 2m ago 19m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:42:29.542 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (19m) 2m ago 19m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:42:29.542 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (19m) 2m ago 19m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:42:29.542 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (19m) 2m ago 19m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:42:29.543 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (18m) 2m ago 18m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:42:29.543 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (18m) 2m ago 18m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:42:29.543 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (18m) 2m ago 18m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:42:29.544 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (18m) 2m ago 18m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:42:29.544 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (19m) 2m ago 20m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:42:29.882 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:42:29.883 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:42:29.883 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:42:29.883 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:42:29.884 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:42:29.884 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:42:29.884 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:42:29.884 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:42:29.884 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:42:29.885 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:42:29.885 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:42:29.885 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:42:29.885 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:42:29.886 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:42:29.886 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:42:29.886 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:42:29.886 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:42:29.887 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:42:29.887 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:42:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:42:29.232925+0000 mgr.smithi067.rdualw (mgr.24569) 471 : audit [DBG] from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:42:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:42:29.520102+0000 mgr.smithi067.rdualw (mgr.24569) 472 : audit [DBG] from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:42:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:29.687714+0000 mgr.smithi067.rdualw (mgr.24569) 473 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:30.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:42:29.881123+0000 mon.smithi061 (mon.0) 304 : audit [DBG] from='client.? 172.21.15.61:0/1518836898' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:42:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:42:29.232925+0000 mgr.smithi067.rdualw (mgr.24569) 471 : audit [DBG] from='client.34450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:42:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:42:29.520102+0000 mgr.smithi067.rdualw (mgr.24569) 472 : audit [DBG] from='client.34454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:42:30.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:29.687714+0000 mgr.smithi067.rdualw (mgr.24569) 473 : cluster [DBG] pgmap v410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:30.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:42:29.881123+0000 mon.smithi061 (mon.0) 304 : audit [DBG] from='client.? 172.21.15.61:0/1518836898' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:42:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:31.688643+0000 mgr.smithi067.rdualw (mgr.24569) 474 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:31.688643+0000 mgr.smithi067.rdualw (mgr.24569) 474 : cluster [DBG] pgmap v411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:33.689202+0000 mgr.smithi067.rdualw (mgr.24569) 475 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:42:34.500080+0000 mon.smithi067 (mon.1) 116 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:42:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:42:34.500413+0000 mon.smithi067 (mon.1) 117 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:42:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:42:34.500738+0000 mon.smithi061 (mon.0) 305 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:42:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:42:34.501349+0000 mon.smithi061 (mon.0) 306 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:42:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:33.689202+0000 mgr.smithi067.rdualw (mgr.24569) 475 : cluster [DBG] pgmap v412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:42:34.500080+0000 mon.smithi067 (mon.1) 116 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:42:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:42:34.500413+0000 mon.smithi067 (mon.1) 117 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:42:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:42:34.500738+0000 mon.smithi061 (mon.0) 305 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:42:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:42:34.501349+0000 mon.smithi061 (mon.0) 306 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:42:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:35.690162+0000 mgr.smithi067.rdualw (mgr.24569) 476 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:42:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:35.690162+0000 mgr.smithi067.rdualw (mgr.24569) 476 : cluster [DBG] pgmap v413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:42:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:37.690902+0000 mgr.smithi067.rdualw (mgr.24569) 477 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:37.690902+0000 mgr.smithi067.rdualw (mgr.24569) 477 : cluster [DBG] pgmap v414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:39.691596+0000 mgr.smithi067.rdualw (mgr.24569) 478 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:39.691596+0000 mgr.smithi067.rdualw (mgr.24569) 478 : cluster [DBG] pgmap v415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:41.692436+0000 mgr.smithi067.rdualw (mgr.24569) 479 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:41.692436+0000 mgr.smithi067.rdualw (mgr.24569) 479 : cluster [DBG] pgmap v416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:43.692883+0000 mgr.smithi067.rdualw (mgr.24569) 480 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:43.692883+0000 mgr.smithi067.rdualw (mgr.24569) 480 : cluster [DBG] pgmap v417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:45.693753+0000 mgr.smithi067.rdualw (mgr.24569) 481 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:42:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:45.693753+0000 mgr.smithi067.rdualw (mgr.24569) 481 : cluster [DBG] pgmap v418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:42:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:47.694423+0000 mgr.smithi067.rdualw (mgr.24569) 482 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:47.694423+0000 mgr.smithi067.rdualw (mgr.24569) 482 : cluster [DBG] pgmap v419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:49.694954+0000 mgr.smithi067.rdualw (mgr.24569) 483 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:49.694954+0000 mgr.smithi067.rdualw (mgr.24569) 483 : cluster [DBG] pgmap v420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:51.695886+0000 mgr.smithi067.rdualw (mgr.24569) 484 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:51.695886+0000 mgr.smithi067.rdualw (mgr.24569) 484 : cluster [DBG] pgmap v421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:53.696444+0000 mgr.smithi067.rdualw (mgr.24569) 485 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:53.696444+0000 mgr.smithi067.rdualw (mgr.24569) 485 : cluster [DBG] pgmap v422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:55.697252+0000 mgr.smithi067.rdualw (mgr.24569) 486 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:42:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:55.697252+0000 mgr.smithi067.rdualw (mgr.24569) 486 : cluster [DBG] pgmap v423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:42:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:42:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:57.697758+0000 mgr.smithi067.rdualw (mgr.24569) 487 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:42:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:42:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:57.697758+0000 mgr.smithi067.rdualw (mgr.24569) 487 : cluster [DBG] pgmap v424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:00.192 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:43:00.484 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:43:00.484 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (20m) 2m ago 21m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:43:00.485 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (13m) 2m ago 21m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:43:00.485 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (13m) 2m ago 21m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:43:00.485 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (20m) 2m ago 21m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:43:00.485 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (13m) 2m ago 17m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:43:00.485 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (13m) 2m ago 17m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:43:00.486 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (14m) 2m ago 22m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:43:00.486 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (14m) 2m ago 21m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:43:00.486 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (14m) 2m ago 22m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:43:00.486 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (14m) 2m ago 20m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:43:00.486 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (14m) 2m ago 14m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:43:00.487 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (14m) 2m ago 14m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:43:00.487 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (21m) 2m ago 21m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:43:00.487 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (20m) 2m ago 20m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:43:00.487 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4m) 2m ago 20m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:43:00.488 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (20m) 2m ago 20m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:43:00.488 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (19m) 2m ago 19m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:43:00.488 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (19m) 2m ago 19m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:43:00.488 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (19m) 2m ago 19m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:43:00.488 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (19m) 2m ago 19m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:43:00.489 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (18m) 2m ago 18m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:43:00.489 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (18m) 2m ago 18m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:43:00.489 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (20m) 2m ago 21m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:43:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:42:59.698564+0000 mgr.smithi067.rdualw (mgr.24569) 488 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:42:59.698564+0000 mgr.smithi067.rdualw (mgr.24569) 488 : cluster [DBG] pgmap v425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:00.840 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:43:00.840 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:43:00.840 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:43:00.841 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:43:00.841 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:43:00.841 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:43:00.841 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:43:00.842 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:43:00.842 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:43:00.842 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:43:00.842 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:43:00.842 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:43:00.843 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:43:00.843 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:43:00.843 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:43:00.843 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:43:00.844 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:43:00.844 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:43:00.844 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:43:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:43:00.178181+0000 mgr.smithi067.rdualw (mgr.24569) 489 : audit [DBG] from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:43:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:43:00.465623+0000 mgr.smithi067.rdualw (mgr.24569) 490 : audit [DBG] from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:43:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:43:00.838458+0000 mon.smithi061 (mon.0) 307 : audit [DBG] from='client.? 172.21.15.61:0/855505011' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:43:01.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:43:00.178181+0000 mgr.smithi067.rdualw (mgr.24569) 489 : audit [DBG] from='client.34462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:43:01.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:43:00.465623+0000 mgr.smithi067.rdualw (mgr.24569) 490 : audit [DBG] from='client.34466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:43:01.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:43:00.838458+0000 mon.smithi061 (mon.0) 307 : audit [DBG] from='client.? 172.21.15.61:0/855505011' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:43:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:01.699408+0000 mgr.smithi067.rdualw (mgr.24569) 491 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:01.699408+0000 mgr.smithi067.rdualw (mgr.24569) 491 : cluster [DBG] pgmap v426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:03.699890+0000 mgr.smithi067.rdualw (mgr.24569) 492 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:03.699890+0000 mgr.smithi067.rdualw (mgr.24569) 492 : cluster [DBG] pgmap v427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:05.700695+0000 mgr.smithi067.rdualw (mgr.24569) 493 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:43:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:05.700695+0000 mgr.smithi067.rdualw (mgr.24569) 493 : cluster [DBG] pgmap v428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:43:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:07.701228+0000 mgr.smithi067.rdualw (mgr.24569) 494 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:07.701228+0000 mgr.smithi067.rdualw (mgr.24569) 494 : cluster [DBG] pgmap v429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:09.701970+0000 mgr.smithi067.rdualw (mgr.24569) 495 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:09.701970+0000 mgr.smithi067.rdualw (mgr.24569) 495 : cluster [DBG] pgmap v430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:11.702775+0000 mgr.smithi067.rdualw (mgr.24569) 496 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:11.702775+0000 mgr.smithi067.rdualw (mgr.24569) 496 : cluster [DBG] pgmap v431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:13.703292+0000 mgr.smithi067.rdualw (mgr.24569) 497 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:13.703292+0000 mgr.smithi067.rdualw (mgr.24569) 497 : cluster [DBG] pgmap v432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:15.704105+0000 mgr.smithi067.rdualw (mgr.24569) 498 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:43:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:15.704105+0000 mgr.smithi067.rdualw (mgr.24569) 498 : cluster [DBG] pgmap v433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:43:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:17.704571+0000 mgr.smithi067.rdualw (mgr.24569) 499 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:17.704571+0000 mgr.smithi067.rdualw (mgr.24569) 499 : cluster [DBG] pgmap v434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:19.705243+0000 mgr.smithi067.rdualw (mgr.24569) 500 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:19.705243+0000 mgr.smithi067.rdualw (mgr.24569) 500 : cluster [DBG] pgmap v435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:21.706241+0000 mgr.smithi067.rdualw (mgr.24569) 501 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:43:22.082875+0000 mon.smithi067 (mon.1) 118 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:43:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:43:22.084277+0000 mon.smithi067 (mon.1) 119 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:43:23.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:43:22.085216+0000 mon.smithi067 (mon.1) 120 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:43:23.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:43:22.498509+0000 mon.smithi061 (mon.0) 308 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:43:23.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:43:22.506226+0000 mon.smithi061 (mon.0) 309 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:43:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:21.706241+0000 mgr.smithi067.rdualw (mgr.24569) 501 : cluster [DBG] pgmap v436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:43:22.082875+0000 mon.smithi067 (mon.1) 118 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:43:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:43:22.084277+0000 mon.smithi067 (mon.1) 119 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:43:23.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:43:22.085216+0000 mon.smithi067 (mon.1) 120 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:43:23.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:43:22.498509+0000 mon.smithi061 (mon.0) 308 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:43:23.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:43:22.506226+0000 mon.smithi061 (mon.0) 309 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:43:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:43:22.086057+0000 mgr.smithi067.rdualw (mgr.24569) 502 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:43:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:43:22.086057+0000 mgr.smithi067.rdualw (mgr.24569) 502 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:43:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:23.706839+0000 mgr.smithi067.rdualw (mgr.24569) 503 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:23.706839+0000 mgr.smithi067.rdualw (mgr.24569) 503 : cluster [DBG] pgmap v437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:25.707646+0000 mgr.smithi067.rdualw (mgr.24569) 504 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:43:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:25.707646+0000 mgr.smithi067.rdualw (mgr.24569) 504 : cluster [DBG] pgmap v438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:43:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:27.708098+0000 mgr.smithi067.rdualw (mgr.24569) 505 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:27.708098+0000 mgr.smithi067.rdualw (mgr.24569) 505 : cluster [DBG] pgmap v439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:29.708704+0000 mgr.smithi067.rdualw (mgr.24569) 506 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:29.708704+0000 mgr.smithi067.rdualw (mgr.24569) 506 : cluster [DBG] pgmap v440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:31.146 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:43:31.437 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:43:31.438 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (21m) 3m ago 22m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:43:31.438 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (13m) 3m ago 22m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:43:31.438 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (13m) 3m ago 21m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:43:31.439 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (20m) 3m ago 21m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:43:31.439 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (14m) 3m ago 17m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:43:31.439 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (14m) 3m ago 17m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:43:31.439 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (15m) 3m ago 23m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:43:31.440 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (14m) 3m ago 21m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:43:31.440 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (14m) 3m ago 23m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:43:31.440 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (14m) 3m ago 21m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:43:31.440 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (15m) 3m ago 15m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:43:31.440 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (15m) 3m ago 15m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:43:31.441 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (21m) 3m ago 21m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:43:31.441 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (21m) 3m ago 21m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:43:31.441 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4m) 3m ago 20m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:43:31.441 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (20m) 3m ago 20m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:43:31.442 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (20m) 3m ago 20m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:43:31.442 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (20m) 3m ago 20m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:43:31.442 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (19m) 3m ago 19m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:43:31.442 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (19m) 3m ago 19m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:43:31.443 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (19m) 3m ago 19m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:43:31.443 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (19m) 3m ago 19m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:43:31.443 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (20m) 3m ago 21m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:43:31.785 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:43:31.785 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:43:31.785 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:43:31.785 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:43:31.786 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:43:31.786 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:43:31.786 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:43:31.787 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:43:31.787 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:43:31.787 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:43:31.787 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:43:31.787 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:43:31.788 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:43:31.788 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:43:31.788 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:43:31.789 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:43:31.789 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:43:31.789 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:43:31.789 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:43:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:43:31.132833+0000 mgr.smithi067.rdualw (mgr.24569) 507 : audit [DBG] from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:43:33.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:43:31.419085+0000 mgr.smithi067.rdualw (mgr.24569) 508 : audit [DBG] from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:43:33.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:31.709738+0000 mgr.smithi067.rdualw (mgr.24569) 509 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:33.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:43:31.783216+0000 mon.smithi061 (mon.0) 310 : audit [DBG] from='client.? 172.21.15.61:0/4023905516' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:43:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:43:31.132833+0000 mgr.smithi067.rdualw (mgr.24569) 507 : audit [DBG] from='client.34474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:43:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:43:31.419085+0000 mgr.smithi067.rdualw (mgr.24569) 508 : audit [DBG] from='client.34478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:43:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:31.709738+0000 mgr.smithi067.rdualw (mgr.24569) 509 : cluster [DBG] pgmap v441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:43:31.783216+0000 mon.smithi061 (mon.0) 310 : audit [DBG] from='client.? 172.21.15.61:0/4023905516' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:43:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:33.710267+0000 mgr.smithi067.rdualw (mgr.24569) 510 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:43:34.505416+0000 mon.smithi067 (mon.1) 121 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:43:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:43:34.505686+0000 mon.smithi067 (mon.1) 122 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:43:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:43:34.506079+0000 mon.smithi061 (mon.0) 311 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:43:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:43:34.506556+0000 mon.smithi061 (mon.0) 312 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:43:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:33.710267+0000 mgr.smithi067.rdualw (mgr.24569) 510 : cluster [DBG] pgmap v442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:43:34.505416+0000 mon.smithi067 (mon.1) 121 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:43:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:43:34.505686+0000 mon.smithi067 (mon.1) 122 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:43:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:43:34.506079+0000 mon.smithi061 (mon.0) 311 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:43:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:43:34.506556+0000 mon.smithi061 (mon.0) 312 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:43:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:35.711197+0000 mgr.smithi067.rdualw (mgr.24569) 511 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:43:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:35.711197+0000 mgr.smithi067.rdualw (mgr.24569) 511 : cluster [DBG] pgmap v443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:43:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:37.711879+0000 mgr.smithi067.rdualw (mgr.24569) 512 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:37.711879+0000 mgr.smithi067.rdualw (mgr.24569) 512 : cluster [DBG] pgmap v444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:39.712569+0000 mgr.smithi067.rdualw (mgr.24569) 513 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:39.712569+0000 mgr.smithi067.rdualw (mgr.24569) 513 : cluster [DBG] pgmap v445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:41.713503+0000 mgr.smithi067.rdualw (mgr.24569) 514 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:41.713503+0000 mgr.smithi067.rdualw (mgr.24569) 514 : cluster [DBG] pgmap v446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:43.714123+0000 mgr.smithi067.rdualw (mgr.24569) 515 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:43.714123+0000 mgr.smithi067.rdualw (mgr.24569) 515 : cluster [DBG] pgmap v447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:45.714965+0000 mgr.smithi067.rdualw (mgr.24569) 516 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:43:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:45.714965+0000 mgr.smithi067.rdualw (mgr.24569) 516 : cluster [DBG] pgmap v448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:43:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:47.715610+0000 mgr.smithi067.rdualw (mgr.24569) 517 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:47.715610+0000 mgr.smithi067.rdualw (mgr.24569) 517 : cluster [DBG] pgmap v449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:49.716357+0000 mgr.smithi067.rdualw (mgr.24569) 518 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:49.716357+0000 mgr.smithi067.rdualw (mgr.24569) 518 : cluster [DBG] pgmap v450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:51.717225+0000 mgr.smithi067.rdualw (mgr.24569) 519 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:51.717225+0000 mgr.smithi067.rdualw (mgr.24569) 519 : cluster [DBG] pgmap v451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:53.717674+0000 mgr.smithi067.rdualw (mgr.24569) 520 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:53.717674+0000 mgr.smithi067.rdualw (mgr.24569) 520 : cluster [DBG] pgmap v452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:55.718453+0000 mgr.smithi067.rdualw (mgr.24569) 521 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:43:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:55.718453+0000 mgr.smithi067.rdualw (mgr.24569) 521 : cluster [DBG] pgmap v453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:43:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:43:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:57.718965+0000 mgr.smithi067.rdualw (mgr.24569) 522 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:43:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:43:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:57.718965+0000 mgr.smithi067.rdualw (mgr.24569) 522 : cluster [DBG] pgmap v454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:43:59.719645+0000 mgr.smithi067.rdualw (mgr.24569) 523 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:43:59.719645+0000 mgr.smithi067.rdualw (mgr.24569) 523 : cluster [DBG] pgmap v455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:02.094 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:44:02.383 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:44:02.383 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (21m) 3m ago 22m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:44:02.384 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (14m) 3m ago 22m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:44:02.384 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (14m) 3m ago 22m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:44:02.384 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (21m) 3m ago 22m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:44:02.384 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (14m) 3m ago 18m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:44:02.384 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (14m) 3m ago 18m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:44:02.385 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (15m) 3m ago 23m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:44:02.385 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (15m) 3m ago 22m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:44:02.385 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (15m) 3m ago 23m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:44:02.385 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (15m) 3m ago 21m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:44:02.386 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (16m) 3m ago 15m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:44:02.386 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (15m) 3m ago 15m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:44:02.386 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (22m) 3m ago 22m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:44:02.387 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (21m) 3m ago 21m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:44:02.387 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5m) 3m ago 21m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:44:02.387 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (21m) 3m ago 21m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:44:02.387 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (20m) 3m ago 20m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:44:02.388 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (20m) 3m ago 20m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:44:02.388 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (20m) 3m ago 20m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:44:02.388 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (20m) 3m ago 20m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:44:02.388 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (19m) 3m ago 19m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:44:02.389 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (19m) 3m ago 19m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:44:02.389 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (21m) 3m ago 22m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:44:02.723 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:44:02.723 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:44:02.724 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:44:02.724 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:44:02.724 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:44:02.724 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:44:02.725 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:44:02.725 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:44:02.725 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:44:02.725 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:44:02.725 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:44:02.726 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:44:02.726 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:44:02.726 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:44:02.726 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:44:02.726 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:44:02.727 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:44:02.727 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:44:02.727 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:44:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:01.720645+0000 mgr.smithi067.rdualw (mgr.24569) 524 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:44:02.721644+0000 mon.smithi061 (mon.0) 313 : audit [DBG] from='client.? 172.21.15.61:0/905355671' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:44:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:01.720645+0000 mgr.smithi067.rdualw (mgr.24569) 524 : cluster [DBG] pgmap v456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:44:02.721644+0000 mon.smithi061 (mon.0) 313 : audit [DBG] from='client.? 172.21.15.61:0/905355671' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:44:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:44:02.080790+0000 mgr.smithi067.rdualw (mgr.24569) 525 : audit [DBG] from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:44:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:44:02.365356+0000 mgr.smithi067.rdualw (mgr.24569) 526 : audit [DBG] from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:44:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:44:02.080790+0000 mgr.smithi067.rdualw (mgr.24569) 525 : audit [DBG] from='client.34486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:44:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:44:02.365356+0000 mgr.smithi067.rdualw (mgr.24569) 526 : audit [DBG] from='client.34490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:44:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:03.721420+0000 mgr.smithi067.rdualw (mgr.24569) 527 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:03.721420+0000 mgr.smithi067.rdualw (mgr.24569) 527 : cluster [DBG] pgmap v457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:05.722341+0000 mgr.smithi067.rdualw (mgr.24569) 528 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:44:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:05.722341+0000 mgr.smithi067.rdualw (mgr.24569) 528 : cluster [DBG] pgmap v458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:44:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:07.722856+0000 mgr.smithi067.rdualw (mgr.24569) 529 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:07.722856+0000 mgr.smithi067.rdualw (mgr.24569) 529 : cluster [DBG] pgmap v459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:09.723449+0000 mgr.smithi067.rdualw (mgr.24569) 530 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:09.723449+0000 mgr.smithi067.rdualw (mgr.24569) 530 : cluster [DBG] pgmap v460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:11.724243+0000 mgr.smithi067.rdualw (mgr.24569) 531 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:11.724243+0000 mgr.smithi067.rdualw (mgr.24569) 531 : cluster [DBG] pgmap v461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:13.724812+0000 mgr.smithi067.rdualw (mgr.24569) 532 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:13.724812+0000 mgr.smithi067.rdualw (mgr.24569) 532 : cluster [DBG] pgmap v462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:15.725816+0000 mgr.smithi067.rdualw (mgr.24569) 533 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:44:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:15.725816+0000 mgr.smithi067.rdualw (mgr.24569) 533 : cluster [DBG] pgmap v463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:44:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:17.726346+0000 mgr.smithi067.rdualw (mgr.24569) 534 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:17.726346+0000 mgr.smithi067.rdualw (mgr.24569) 534 : cluster [DBG] pgmap v464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:19.726910+0000 mgr.smithi067.rdualw (mgr.24569) 535 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:19.726910+0000 mgr.smithi067.rdualw (mgr.24569) 535 : cluster [DBG] pgmap v465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:21.727828+0000 mgr.smithi067.rdualw (mgr.24569) 536 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:44:22.509359+0000 mon.smithi067 (mon.1) 123 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:44:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:44:22.510787+0000 mon.smithi067 (mon.1) 124 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:44:23.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:44:22.511718+0000 mon.smithi067 (mon.1) 125 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:44:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:21.727828+0000 mgr.smithi067.rdualw (mgr.24569) 536 : cluster [DBG] pgmap v466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:44:22.509359+0000 mon.smithi067 (mon.1) 123 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:44:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:44:22.510787+0000 mon.smithi067 (mon.1) 124 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:44:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:44:22.511718+0000 mon.smithi067 (mon.1) 125 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:44:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:44:22.512554+0000 mgr.smithi067.rdualw (mgr.24569) 537 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:44:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:44:22.929783+0000 mon.smithi061 (mon.0) 314 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:44:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:44:22.937066+0000 mon.smithi061 (mon.0) 315 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:44:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:44:22.512554+0000 mgr.smithi067.rdualw (mgr.24569) 537 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:44:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:44:22.929783+0000 mon.smithi061 (mon.0) 314 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:44:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:44:22.937066+0000 mon.smithi061 (mon.0) 315 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:44:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:23.728549+0000 mgr.smithi067.rdualw (mgr.24569) 538 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:23.728549+0000 mgr.smithi067.rdualw (mgr.24569) 538 : cluster [DBG] pgmap v467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:25.729672+0000 mgr.smithi067.rdualw (mgr.24569) 539 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:44:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:25.729672+0000 mgr.smithi067.rdualw (mgr.24569) 539 : cluster [DBG] pgmap v468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:44:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:27.730215+0000 mgr.smithi067.rdualw (mgr.24569) 540 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:27.730215+0000 mgr.smithi067.rdualw (mgr.24569) 540 : cluster [DBG] pgmap v469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:29.730972+0000 mgr.smithi067.rdualw (mgr.24569) 541 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:29.730972+0000 mgr.smithi067.rdualw (mgr.24569) 541 : cluster [DBG] pgmap v470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:31.731840+0000 mgr.smithi067.rdualw (mgr.24569) 542 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:31.731840+0000 mgr.smithi067.rdualw (mgr.24569) 542 : cluster [DBG] pgmap v471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:33.090 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:44:33.383 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:44:33.383 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (22m) 4m ago 23m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:44:33.384 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (14m) 4m ago 23m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:44:33.384 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (14m) 4m ago 22m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:44:33.384 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (21m) 4m ago 22m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:44:33.384 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (15m) 4m ago 18m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:44:33.385 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (15m) 4m ago 18m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:44:33.385 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (16m) 4m ago 24m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:44:33.385 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (15m) 4m ago 22m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:44:33.385 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (15m) 4m ago 24m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:44:33.385 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (15m) 4m ago 22m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:44:33.386 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (16m) 4m ago 16m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:44:33.386 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (16m) 4m ago 16m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:44:33.386 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (22m) 4m ago 22m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:44:33.386 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (22m) 4m ago 22m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:44:33.386 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5m) 4m ago 22m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:44:33.387 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (21m) 4m ago 21m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:44:33.387 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (21m) 4m ago 21m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:44:33.387 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (21m) 4m ago 21m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:44:33.387 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (20m) 4m ago 20m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:44:33.388 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (20m) 4m ago 20m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:44:33.388 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (20m) 4m ago 20m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:44:33.388 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (20m) 4m ago 20m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:44:33.388 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (21m) 4m ago 22m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:44:33.726 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:44:33.726 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:44:33.726 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:44:33.727 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:44:33.727 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:44:33.727 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:44:33.727 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:44:33.727 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:44:33.728 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:44:33.728 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:44:33.728 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:44:33.728 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:44:33.728 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:44:33.729 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:44:33.729 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:44:33.729 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:44:33.729 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:44:33.730 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:44:33.730 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:44:34.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:44:33.724058+0000 mon.smithi061 (mon.0) 316 : audit [DBG] from='client.? 172.21.15.61:0/1262592521' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:44:34.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:44:33.724058+0000 mon.smithi061 (mon.0) 316 : audit [DBG] from='client.? 172.21.15.61:0/1262592521' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:44:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:44:33.073469+0000 mgr.smithi067.rdualw (mgr.24569) 543 : audit [DBG] from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:44:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:44:33.364998+0000 mgr.smithi067.rdualw (mgr.24569) 544 : audit [DBG] from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:44:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:33.732449+0000 mgr.smithi067.rdualw (mgr.24569) 545 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:44:34.510560+0000 mon.smithi067 (mon.1) 126 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:44:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:44:34.510819+0000 mon.smithi067 (mon.1) 127 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:44:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:44:34.510949+0000 mon.smithi061 (mon.0) 317 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:44:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:44:34.511225+0000 mon.smithi061 (mon.0) 318 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:44:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:44:33.073469+0000 mgr.smithi067.rdualw (mgr.24569) 543 : audit [DBG] from='client.34498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:44:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:44:33.364998+0000 mgr.smithi067.rdualw (mgr.24569) 544 : audit [DBG] from='client.34502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:44:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:33.732449+0000 mgr.smithi067.rdualw (mgr.24569) 545 : cluster [DBG] pgmap v472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:44:34.510560+0000 mon.smithi067 (mon.1) 126 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:44:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:44:34.510819+0000 mon.smithi067 (mon.1) 127 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:44:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:44:34.510949+0000 mon.smithi061 (mon.0) 317 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:44:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:44:34.511225+0000 mon.smithi061 (mon.0) 318 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:44:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:35.733551+0000 mgr.smithi067.rdualw (mgr.24569) 546 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:44:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:35.733551+0000 mgr.smithi067.rdualw (mgr.24569) 546 : cluster [DBG] pgmap v473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:44:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:37.734230+0000 mgr.smithi067.rdualw (mgr.24569) 547 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:39.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:37.734230+0000 mgr.smithi067.rdualw (mgr.24569) 547 : cluster [DBG] pgmap v474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:39.734932+0000 mgr.smithi067.rdualw (mgr.24569) 548 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:39.734932+0000 mgr.smithi067.rdualw (mgr.24569) 548 : cluster [DBG] pgmap v475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:41.735819+0000 mgr.smithi067.rdualw (mgr.24569) 549 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:41.735819+0000 mgr.smithi067.rdualw (mgr.24569) 549 : cluster [DBG] pgmap v476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:43.736260+0000 mgr.smithi067.rdualw (mgr.24569) 550 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:43.736260+0000 mgr.smithi067.rdualw (mgr.24569) 550 : cluster [DBG] pgmap v477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:45.737243+0000 mgr.smithi067.rdualw (mgr.24569) 551 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:44:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:45.737243+0000 mgr.smithi067.rdualw (mgr.24569) 551 : cluster [DBG] pgmap v478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:44:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:47.737770+0000 mgr.smithi067.rdualw (mgr.24569) 552 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:47.737770+0000 mgr.smithi067.rdualw (mgr.24569) 552 : cluster [DBG] pgmap v479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:49.738377+0000 mgr.smithi067.rdualw (mgr.24569) 553 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:49.738377+0000 mgr.smithi067.rdualw (mgr.24569) 553 : cluster [DBG] pgmap v480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:51.739386+0000 mgr.smithi067.rdualw (mgr.24569) 554 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:51.739386+0000 mgr.smithi067.rdualw (mgr.24569) 554 : cluster [DBG] pgmap v481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:53.740038+0000 mgr.smithi067.rdualw (mgr.24569) 555 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:53.740038+0000 mgr.smithi067.rdualw (mgr.24569) 555 : cluster [DBG] pgmap v482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:55.740997+0000 mgr.smithi067.rdualw (mgr.24569) 556 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:44:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:55.740997+0000 mgr.smithi067.rdualw (mgr.24569) 556 : cluster [DBG] pgmap v483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:44:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:44:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:57.741734+0000 mgr.smithi067.rdualw (mgr.24569) 557 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:44:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:44:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:57.741734+0000 mgr.smithi067.rdualw (mgr.24569) 557 : cluster [DBG] pgmap v484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:44:59.742331+0000 mgr.smithi067.rdualw (mgr.24569) 558 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:44:59.742331+0000 mgr.smithi067.rdualw (mgr.24569) 558 : cluster [DBG] pgmap v485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:01.743296+0000 mgr.smithi067.rdualw (mgr.24569) 559 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:01.743296+0000 mgr.smithi067.rdualw (mgr.24569) 559 : cluster [DBG] pgmap v486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:04.035 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:45:04.325 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:45:04.326 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (22m) 4m ago 23m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:45:04.326 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (15m) 4m ago 23m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:45:04.326 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (15m) 4m ago 23m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:45:04.327 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (22m) 4m ago 23m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:45:04.327 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (15m) 4m ago 19m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:45:04.327 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (15m) 4m ago 19m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:45:04.327 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (16m) 4m ago 24m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:45:04.328 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (16m) 4m ago 23m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:45:04.328 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (16m) 4m ago 24m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:45:04.328 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (16m) 4m ago 23m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:45:04.328 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (17m) 4m ago 17m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:45:04.328 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (16m) 4m ago 16m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:45:04.329 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (23m) 4m ago 23m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:45:04.329 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (22m) 4m ago 22m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:45:04.329 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (6m) 4m ago 22m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:45:04.329 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (22m) 4m ago 22m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:45:04.330 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (21m) 4m ago 21m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:45:04.330 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (21m) 4m ago 21m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:45:04.330 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (21m) 4m ago 21m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:45:04.330 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (21m) 4m ago 21m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:45:04.331 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (20m) 4m ago 20m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:45:04.331 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (20m) 4m ago 20m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:45:04.331 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (22m) 4m ago 23m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:45:04.670 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:45:04.670 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:45:04.670 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:45:04.671 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:45:04.671 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:45:04.671 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:45:04.671 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:45:04.672 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:45:04.672 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:45:04.672 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:45:04.672 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:45:04.672 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:45:04.673 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:45:04.673 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:45:04.673 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:45:04.673 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:45:04.673 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:45:04.674 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:45:04.674 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:45:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:03.743933+0000 mgr.smithi067.rdualw (mgr.24569) 560 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:45:04.668283+0000 mon.smithi061 (mon.0) 319 : audit [DBG] from='client.? 172.21.15.61:0/1842879800' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:45:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:03.743933+0000 mgr.smithi067.rdualw (mgr.24569) 560 : cluster [DBG] pgmap v487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:45:04.668283+0000 mon.smithi061 (mon.0) 319 : audit [DBG] from='client.? 172.21.15.61:0/1842879800' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:45:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:45:04.021816+0000 mgr.smithi067.rdualw (mgr.24569) 561 : audit [DBG] from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:45:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:45:04.307754+0000 mgr.smithi067.rdualw (mgr.24569) 562 : audit [DBG] from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:45:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:45:04.021816+0000 mgr.smithi067.rdualw (mgr.24569) 561 : audit [DBG] from='client.34510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:45:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:45:04.307754+0000 mgr.smithi067.rdualw (mgr.24569) 562 : audit [DBG] from='client.34514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:45:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:05.744961+0000 mgr.smithi067.rdualw (mgr.24569) 563 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:45:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:05.744961+0000 mgr.smithi067.rdualw (mgr.24569) 563 : cluster [DBG] pgmap v488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:45:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:07.745413+0000 mgr.smithi067.rdualw (mgr.24569) 564 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:07.745413+0000 mgr.smithi067.rdualw (mgr.24569) 564 : cluster [DBG] pgmap v489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:10.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:09.746143+0000 mgr.smithi067.rdualw (mgr.24569) 565 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:09.746143+0000 mgr.smithi067.rdualw (mgr.24569) 565 : cluster [DBG] pgmap v490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:11.746983+0000 mgr.smithi067.rdualw (mgr.24569) 566 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:11.746983+0000 mgr.smithi067.rdualw (mgr.24569) 566 : cluster [DBG] pgmap v491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:13.747710+0000 mgr.smithi067.rdualw (mgr.24569) 567 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:13.747710+0000 mgr.smithi067.rdualw (mgr.24569) 567 : cluster [DBG] pgmap v492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:15.748579+0000 mgr.smithi067.rdualw (mgr.24569) 568 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:45:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:15.748579+0000 mgr.smithi067.rdualw (mgr.24569) 568 : cluster [DBG] pgmap v493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:45:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:17.749174+0000 mgr.smithi067.rdualw (mgr.24569) 569 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:17.749174+0000 mgr.smithi067.rdualw (mgr.24569) 569 : cluster [DBG] pgmap v494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:19.749789+0000 mgr.smithi067.rdualw (mgr.24569) 570 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:19.749789+0000 mgr.smithi067.rdualw (mgr.24569) 570 : cluster [DBG] pgmap v495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:21.750681+0000 mgr.smithi067.rdualw (mgr.24569) 571 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:21.750681+0000 mgr.smithi067.rdualw (mgr.24569) 571 : cluster [DBG] pgmap v496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:45:22.942725+0000 mon.smithi067 (mon.1) 128 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:45:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:45:22.944270+0000 mon.smithi067 (mon.1) 129 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:45:24.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:45:22.945277+0000 mon.smithi067 (mon.1) 130 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:45:24.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:45:22.946186+0000 mgr.smithi067.rdualw (mgr.24569) 572 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:45:24.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:45:23.355963+0000 mon.smithi061 (mon.0) 320 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:45:24.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:45:23.361410+0000 mon.smithi061 (mon.0) 321 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:45:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:45:22.942725+0000 mon.smithi067 (mon.1) 128 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:45:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:45:22.944270+0000 mon.smithi067 (mon.1) 129 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:45:24.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:45:22.945277+0000 mon.smithi067 (mon.1) 130 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:45:24.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:45:22.946186+0000 mgr.smithi067.rdualw (mgr.24569) 572 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:45:24.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:45:23.355963+0000 mon.smithi061 (mon.0) 320 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:45:24.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:45:23.361410+0000 mon.smithi061 (mon.0) 321 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:45:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:23.751137+0000 mgr.smithi067.rdualw (mgr.24569) 573 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:23.751137+0000 mgr.smithi067.rdualw (mgr.24569) 573 : cluster [DBG] pgmap v497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:25.752213+0000 mgr.smithi067.rdualw (mgr.24569) 574 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:45:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:25.752213+0000 mgr.smithi067.rdualw (mgr.24569) 574 : cluster [DBG] pgmap v498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:45:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:27.752937+0000 mgr.smithi067.rdualw (mgr.24569) 575 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:27.752937+0000 mgr.smithi067.rdualw (mgr.24569) 575 : cluster [DBG] pgmap v499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:29.753764+0000 mgr.smithi067.rdualw (mgr.24569) 576 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:29.753764+0000 mgr.smithi067.rdualw (mgr.24569) 576 : cluster [DBG] pgmap v500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:31.754649+0000 mgr.smithi067.rdualw (mgr.24569) 577 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:31.754649+0000 mgr.smithi067.rdualw (mgr.24569) 577 : cluster [DBG] pgmap v501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:34.984 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:45:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:33.755260+0000 mgr.smithi067.rdualw (mgr.24569) 578 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:45:34.515425+0000 mon.smithi067 (mon.1) 131 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:45:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:45:34.515676+0000 mon.smithi067 (mon.1) 132 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:45:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:45:34.515791+0000 mon.smithi061 (mon.0) 322 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:45:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:45:34.516152+0000 mon.smithi061 (mon.0) 323 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:45:35.273 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:45:35.273 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (23m) 5m ago 24m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:45:35.273 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (15m) 5m ago 24m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:45:35.274 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (15m) 5m ago 23m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:45:35.274 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (22m) 5m ago 24m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:45:35.274 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (16m) 5m ago 19m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:45:35.274 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (16m) 5m ago 19m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:45:35.275 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (17m) 5m ago 25m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:45:35.275 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (16m) 5m ago 23m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:45:35.275 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (16m) 5m ago 25m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:45:35.275 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (16m) 5m ago 23m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:45:35.276 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (17m) 5m ago 17m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:45:35.276 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (17m) 5m ago 17m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:45:35.276 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (23m) 5m ago 23m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:45:35.276 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (23m) 5m ago 23m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:45:35.276 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (6m) 5m ago 23m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:45:35.277 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (22m) 5m ago 22m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:45:35.277 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (22m) 5m ago 22m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:45:35.277 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (22m) 5m ago 22m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:45:35.278 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (21m) 5m ago 21m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:45:35.278 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (21m) 5m ago 21m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:45:35.280 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (21m) 5m ago 21m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:45:35.280 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (21m) 5m ago 21m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:45:35.280 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (22m) 5m ago 23m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:45:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:33.755260+0000 mgr.smithi067.rdualw (mgr.24569) 578 : cluster [DBG] pgmap v502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:45:34.515425+0000 mon.smithi067 (mon.1) 131 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:45:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:45:34.515676+0000 mon.smithi067 (mon.1) 132 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:45:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:45:34.515791+0000 mon.smithi061 (mon.0) 322 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:45:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:45:34.516152+0000 mon.smithi061 (mon.0) 323 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:45:35.654 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:45:35.654 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:45:35.654 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:45:35.655 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:45:35.655 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:45:35.655 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:45:35.655 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:45:35.656 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:45:35.656 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:45:35.656 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:45:35.656 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:45:35.657 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:45:35.657 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:45:35.657 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:45:35.657 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:45:35.658 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:45:35.658 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:45:35.658 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:45:35.658 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:45:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:45:34.968042+0000 mgr.smithi067.rdualw (mgr.24569) 579 : audit [DBG] from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:45:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:45:35.652140+0000 mon.smithi061 (mon.0) 324 : audit [DBG] from='client.? 172.21.15.61:0/3759270195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:45:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:45:34.968042+0000 mgr.smithi067.rdualw (mgr.24569) 579 : audit [DBG] from='client.34522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:45:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:45:35.652140+0000 mon.smithi061 (mon.0) 324 : audit [DBG] from='client.? 172.21.15.61:0/3759270195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:45:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:45:35.254984+0000 mgr.smithi067.rdualw (mgr.24569) 580 : audit [DBG] from='client.34526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:45:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:35.756320+0000 mgr.smithi067.rdualw (mgr.24569) 581 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:45:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:45:35.254984+0000 mgr.smithi067.rdualw (mgr.24569) 580 : audit [DBG] from='client.34526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:45:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:35.756320+0000 mgr.smithi067.rdualw (mgr.24569) 581 : cluster [DBG] pgmap v503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:45:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:37.756799+0000 mgr.smithi067.rdualw (mgr.24569) 582 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:37.756799+0000 mgr.smithi067.rdualw (mgr.24569) 582 : cluster [DBG] pgmap v504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:39.757360+0000 mgr.smithi067.rdualw (mgr.24569) 583 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:39.757360+0000 mgr.smithi067.rdualw (mgr.24569) 583 : cluster [DBG] pgmap v505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:41.758180+0000 mgr.smithi067.rdualw (mgr.24569) 584 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:41.758180+0000 mgr.smithi067.rdualw (mgr.24569) 584 : cluster [DBG] pgmap v506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:43.758889+0000 mgr.smithi067.rdualw (mgr.24569) 585 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:43.758889+0000 mgr.smithi067.rdualw (mgr.24569) 585 : cluster [DBG] pgmap v507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:45.759686+0000 mgr.smithi067.rdualw (mgr.24569) 586 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:45:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:45.759686+0000 mgr.smithi067.rdualw (mgr.24569) 586 : cluster [DBG] pgmap v508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:45:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:47.760379+0000 mgr.smithi067.rdualw (mgr.24569) 587 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:47.760379+0000 mgr.smithi067.rdualw (mgr.24569) 587 : cluster [DBG] pgmap v509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:50.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:49.760925+0000 mgr.smithi067.rdualw (mgr.24569) 588 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:49.760925+0000 mgr.smithi067.rdualw (mgr.24569) 588 : cluster [DBG] pgmap v510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:51.761823+0000 mgr.smithi067.rdualw (mgr.24569) 589 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:51.761823+0000 mgr.smithi067.rdualw (mgr.24569) 589 : cluster [DBG] pgmap v511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:53.762519+0000 mgr.smithi067.rdualw (mgr.24569) 590 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:53.762519+0000 mgr.smithi067.rdualw (mgr.24569) 590 : cluster [DBG] pgmap v512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:57.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:55.763674+0000 mgr.smithi067.rdualw (mgr.24569) 591 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:45:57.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:55.763674+0000 mgr.smithi067.rdualw (mgr.24569) 591 : cluster [DBG] pgmap v513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:45:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:45:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:57.764244+0000 mgr.smithi067.rdualw (mgr.24569) 592 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:45:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:45:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:57.764244+0000 mgr.smithi067.rdualw (mgr.24569) 592 : cluster [DBG] pgmap v514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:45:59.765076+0000 mgr.smithi067.rdualw (mgr.24569) 593 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:45:59.765076+0000 mgr.smithi067.rdualw (mgr.24569) 593 : cluster [DBG] pgmap v515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:01.765862+0000 mgr.smithi067.rdualw (mgr.24569) 594 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:01.765862+0000 mgr.smithi067.rdualw (mgr.24569) 594 : cluster [DBG] pgmap v516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:03.766434+0000 mgr.smithi067.rdualw (mgr.24569) 595 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:03.766434+0000 mgr.smithi067.rdualw (mgr.24569) 595 : cluster [DBG] pgmap v517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:05.962 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:46:06.252 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:46:06.252 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (23m) 5m ago 24m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:46:06.252 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (16m) 5m ago 24m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:46:06.253 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (16m) 5m ago 24m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:46:06.253 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (23m) 5m ago 24m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:46:06.253 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (16m) 5m ago 20m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:46:06.253 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (16m) 5m ago 20m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:46:06.254 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (17m) 5m ago 25m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:46:06.254 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (17m) 5m ago 24m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:46:06.254 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (17m) 5m ago 25m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:46:06.254 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (17m) 5m ago 24m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:46:06.254 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (18m) 5m ago 18m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:46:06.255 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (17m) 5m ago 17m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:46:06.255 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (24m) 5m ago 24m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:46:06.255 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (23m) 5m ago 23m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:46:06.255 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (7m) 5m ago 23m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:46:06.256 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (23m) 5m ago 23m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:46:06.256 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (23m) 5m ago 23m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:46:06.256 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (22m) 5m ago 22m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:46:06.256 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (22m) 5m ago 22m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:46:06.256 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (22m) 5m ago 22m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:46:06.257 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (21m) 5m ago 21m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:46:06.257 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (21m) 5m ago 21m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:46:06.257 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (23m) 5m ago 24m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:46:06.592 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:46:06.592 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:46:06.593 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:46:06.593 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:46:06.593 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:46:06.593 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:46:06.594 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:46:06.594 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:46:06.594 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:46:06.594 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:46:06.594 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:46:06.595 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:46:06.595 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:46:06.595 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:46:06.595 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:46:06.596 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:46:06.596 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:46:06.596 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:46:06.596 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:46:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:05.767225+0000 mgr.smithi067.rdualw (mgr.24569) 596 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:46:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:46:05.947811+0000 mgr.smithi067.rdualw (mgr.24569) 597 : audit [DBG] from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:46:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:46:06.590013+0000 mon.smithi061 (mon.0) 325 : audit [DBG] from='client.? 172.21.15.61:0/1718396443' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:46:07.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:05.767225+0000 mgr.smithi067.rdualw (mgr.24569) 596 : cluster [DBG] pgmap v518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:46:07.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:46:05.947811+0000 mgr.smithi067.rdualw (mgr.24569) 597 : audit [DBG] from='client.34534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:46:07.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:46:06.590013+0000 mon.smithi061 (mon.0) 325 : audit [DBG] from='client.? 172.21.15.61:0/1718396443' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:46:08.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:46:06.233447+0000 mgr.smithi067.rdualw (mgr.24569) 598 : audit [DBG] from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:46:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:46:06.233447+0000 mgr.smithi067.rdualw (mgr.24569) 598 : audit [DBG] from='client.34538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:46:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:07.767681+0000 mgr.smithi067.rdualw (mgr.24569) 599 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:09.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:07.767681+0000 mgr.smithi067.rdualw (mgr.24569) 599 : cluster [DBG] pgmap v519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:09.768361+0000 mgr.smithi067.rdualw (mgr.24569) 600 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:09.768361+0000 mgr.smithi067.rdualw (mgr.24569) 600 : cluster [DBG] pgmap v520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:11.769457+0000 mgr.smithi067.rdualw (mgr.24569) 601 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:11.769457+0000 mgr.smithi067.rdualw (mgr.24569) 601 : cluster [DBG] pgmap v521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:13.769944+0000 mgr.smithi067.rdualw (mgr.24569) 602 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:13.769944+0000 mgr.smithi067.rdualw (mgr.24569) 602 : cluster [DBG] pgmap v522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:15.771006+0000 mgr.smithi067.rdualw (mgr.24569) 603 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:46:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:15.771006+0000 mgr.smithi067.rdualw (mgr.24569) 603 : cluster [DBG] pgmap v523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:46:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:17.771790+0000 mgr.smithi067.rdualw (mgr.24569) 604 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:17.771790+0000 mgr.smithi067.rdualw (mgr.24569) 604 : cluster [DBG] pgmap v524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:19.772503+0000 mgr.smithi067.rdualw (mgr.24569) 605 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:19.772503+0000 mgr.smithi067.rdualw (mgr.24569) 605 : cluster [DBG] pgmap v525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:21.773330+0000 mgr.smithi067.rdualw (mgr.24569) 606 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:21.773330+0000 mgr.smithi067.rdualw (mgr.24569) 606 : cluster [DBG] pgmap v526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:46:23.364857+0000 mon.smithi067 (mon.1) 133 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:46:24.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:46:23.366285+0000 mon.smithi067 (mon.1) 134 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:46:24.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:46:23.367233+0000 mon.smithi067 (mon.1) 135 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:46:24.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:46:23.782822+0000 mon.smithi061 (mon.0) 326 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:46:24.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:46:23.788130+0000 mon.smithi061 (mon.0) 327 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:46:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:46:23.364857+0000 mon.smithi067 (mon.1) 133 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:46:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:46:23.366285+0000 mon.smithi067 (mon.1) 134 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:46:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:46:23.367233+0000 mon.smithi067 (mon.1) 135 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:46:24.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:46:23.782822+0000 mon.smithi061 (mon.0) 326 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:46:24.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:46:23.788130+0000 mon.smithi061 (mon.0) 327 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:46:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:46:23.368102+0000 mgr.smithi067.rdualw (mgr.24569) 607 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:46:25.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:23.773937+0000 mgr.smithi067.rdualw (mgr.24569) 608 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:46:23.368102+0000 mgr.smithi067.rdualw (mgr.24569) 607 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:46:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:23.773937+0000 mgr.smithi067.rdualw (mgr.24569) 608 : cluster [DBG] pgmap v527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:25.774827+0000 mgr.smithi067.rdualw (mgr.24569) 609 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:46:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:25.774827+0000 mgr.smithi067.rdualw (mgr.24569) 609 : cluster [DBG] pgmap v528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:46:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:27.775371+0000 mgr.smithi067.rdualw (mgr.24569) 610 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:27.775371+0000 mgr.smithi067.rdualw (mgr.24569) 610 : cluster [DBG] pgmap v529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:29.776101+0000 mgr.smithi067.rdualw (mgr.24569) 611 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:29.776101+0000 mgr.smithi067.rdualw (mgr.24569) 611 : cluster [DBG] pgmap v530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:31.777044+0000 mgr.smithi067.rdualw (mgr.24569) 612 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:31.777044+0000 mgr.smithi067.rdualw (mgr.24569) 612 : cluster [DBG] pgmap v531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:33.777807+0000 mgr.smithi067.rdualw (mgr.24569) 613 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:46:34.520620+0000 mon.smithi067 (mon.1) 136 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:46:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:46:34.520881+0000 mon.smithi067 (mon.1) 137 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:46:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:46:34.521019+0000 mon.smithi061 (mon.0) 328 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:46:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:46:34.521376+0000 mon.smithi061 (mon.0) 329 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:46:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:33.777807+0000 mgr.smithi067.rdualw (mgr.24569) 613 : cluster [DBG] pgmap v532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:46:34.520620+0000 mon.smithi067 (mon.1) 136 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:46:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:46:34.520881+0000 mon.smithi067 (mon.1) 137 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:46:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:46:34.521019+0000 mon.smithi061 (mon.0) 328 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:46:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:46:34.521376+0000 mon.smithi061 (mon.0) 329 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:46:36.900 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:46:37.192 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:46:37.193 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (24m) 6m ago 25m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:46:37.193 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (16m) 6m ago 25m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:46:37.193 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (16m) 6m ago 24m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:46:37.193 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (24m) 6m ago 25m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:46:37.194 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (17m) 6m ago 20m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:46:37.194 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (17m) 6m ago 20m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:46:37.194 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (18m) 6m ago 26m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:46:37.194 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (17m) 6m ago 24m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:46:37.194 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (17m) 6m ago 26m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:46:37.195 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (17m) 6m ago 24m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:46:37.195 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (18m) 6m ago 18m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:46:37.195 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (18m) 6m ago 18m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:46:37.195 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (24m) 6m ago 24m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:46:37.196 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (24m) 6m ago 24m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:46:37.196 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (7m) 6m ago 24m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:46:37.196 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (23m) 6m ago 23m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:46:37.196 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (23m) 6m ago 23m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:46:37.196 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (23m) 6m ago 23m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:46:37.197 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (22m) 6m ago 22m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:46:37.197 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (22m) 6m ago 22m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:46:37.197 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (22m) 6m ago 22m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:46:37.197 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (22m) 6m ago 22m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:46:37.198 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (23m) 6m ago 24m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:46:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:35.778659+0000 mgr.smithi067.rdualw (mgr.24569) 614 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:46:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:35.778659+0000 mgr.smithi067.rdualw (mgr.24569) 614 : cluster [DBG] pgmap v533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:46:37.532 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:46:37.532 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:46:37.533 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:46:37.533 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:46:37.533 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:46:37.534 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:46:37.534 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:46:37.534 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:46:37.534 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:46:37.535 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:46:37.535 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:46:37.535 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:46:37.535 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:46:37.535 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:46:37.536 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:46:37.536 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:46:37.536 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:46:37.537 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:46:37.537 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:46:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:46:36.886747+0000 mgr.smithi067.rdualw (mgr.24569) 615 : audit [DBG] from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:46:38.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:46:37.530546+0000 mon.smithi061 (mon.0) 330 : audit [DBG] from='client.? 172.21.15.61:0/1282703930' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:46:38.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:46:36.886747+0000 mgr.smithi067.rdualw (mgr.24569) 615 : audit [DBG] from='client.34546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:46:38.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:46:37.530546+0000 mon.smithi061 (mon.0) 330 : audit [DBG] from='client.? 172.21.15.61:0/1282703930' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:46:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:46:37.174746+0000 mgr.smithi067.rdualw (mgr.24569) 616 : audit [DBG] from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:46:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:37.779222+0000 mgr.smithi067.rdualw (mgr.24569) 617 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:46:37.174746+0000 mgr.smithi067.rdualw (mgr.24569) 616 : audit [DBG] from='client.34550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:46:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:37.779222+0000 mgr.smithi067.rdualw (mgr.24569) 617 : cluster [DBG] pgmap v534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:39.779988+0000 mgr.smithi067.rdualw (mgr.24569) 618 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:39.779988+0000 mgr.smithi067.rdualw (mgr.24569) 618 : cluster [DBG] pgmap v535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:41.780822+0000 mgr.smithi067.rdualw (mgr.24569) 619 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:41.780822+0000 mgr.smithi067.rdualw (mgr.24569) 619 : cluster [DBG] pgmap v536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:43.781379+0000 mgr.smithi067.rdualw (mgr.24569) 620 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:43.781379+0000 mgr.smithi067.rdualw (mgr.24569) 620 : cluster [DBG] pgmap v537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:45.782163+0000 mgr.smithi067.rdualw (mgr.24569) 621 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:46:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:45.782163+0000 mgr.smithi067.rdualw (mgr.24569) 621 : cluster [DBG] pgmap v538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:46:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:47.782662+0000 mgr.smithi067.rdualw (mgr.24569) 622 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:47.782662+0000 mgr.smithi067.rdualw (mgr.24569) 622 : cluster [DBG] pgmap v539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:49.783361+0000 mgr.smithi067.rdualw (mgr.24569) 623 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:49.783361+0000 mgr.smithi067.rdualw (mgr.24569) 623 : cluster [DBG] pgmap v540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:51.784253+0000 mgr.smithi067.rdualw (mgr.24569) 624 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:51.784253+0000 mgr.smithi067.rdualw (mgr.24569) 624 : cluster [DBG] pgmap v541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:53.784905+0000 mgr.smithi067.rdualw (mgr.24569) 625 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:53.784905+0000 mgr.smithi067.rdualw (mgr.24569) 625 : cluster [DBG] pgmap v542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:57.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:55.785965+0000 mgr.smithi067.rdualw (mgr.24569) 626 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:46:57.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:55.785965+0000 mgr.smithi067.rdualw (mgr.24569) 626 : cluster [DBG] pgmap v543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:46:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:46:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:57.786620+0000 mgr.smithi067.rdualw (mgr.24569) 627 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:46:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:46:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:57.786620+0000 mgr.smithi067.rdualw (mgr.24569) 627 : cluster [DBG] pgmap v544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:46:59.787297+0000 mgr.smithi067.rdualw (mgr.24569) 628 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:46:59.787297+0000 mgr.smithi067.rdualw (mgr.24569) 628 : cluster [DBG] pgmap v545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:01.788408+0000 mgr.smithi067.rdualw (mgr.24569) 629 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:01.788408+0000 mgr.smithi067.rdualw (mgr.24569) 629 : cluster [DBG] pgmap v546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:03.789102+0000 mgr.smithi067.rdualw (mgr.24569) 630 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:03.789102+0000 mgr.smithi067.rdualw (mgr.24569) 630 : cluster [DBG] pgmap v547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:05.789899+0000 mgr.smithi067.rdualw (mgr.24569) 631 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:47:07.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:05.789899+0000 mgr.smithi067.rdualw (mgr.24569) 631 : cluster [DBG] pgmap v548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:47:07.848 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:47:08.153 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:47:08.153 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (24m) 6m ago 25m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:47:08.154 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (17m) 6m ago 25m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:47:08.154 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (17m) 6m ago 25m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:47:08.154 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (24m) 6m ago 25m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:47:08.155 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (17m) 6m ago 21m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:47:08.155 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (17m) 6m ago 21m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:47:08.155 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (18m) 6m ago 26m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:47:08.155 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (18m) 6m ago 25m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:47:08.156 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (18m) 6m ago 27m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:47:08.156 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (18m) 6m ago 25m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:47:08.156 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (19m) 6m ago 19m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:47:08.156 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (19m) 6m ago 19m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:47:08.157 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (25m) 6m ago 25m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:47:08.157 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (24m) 6m ago 24m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:47:08.157 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (8m) 6m ago 24m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:47:08.157 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (24m) 6m ago 24m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:47:08.157 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (24m) 6m ago 24m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:47:08.158 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (23m) 6m ago 23m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:47:08.158 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (23m) 6m ago 23m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:47:08.158 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (23m) 6m ago 23m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:47:08.158 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (23m) 6m ago 23m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:47:08.159 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (22m) 6m ago 22m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:47:08.159 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (24m) 6m ago 25m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:47:08.547 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:47:08.547 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:47:08.547 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:47:08.548 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:47:08.548 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:47:08.548 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:47:08.548 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:47:08.549 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:47:08.549 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:47:08.549 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:47:08.549 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:47:08.549 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:47:08.550 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:47:08.550 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:47:08.550 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:47:08.550 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:47:08.551 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:47:08.551 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:47:08.551 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:47:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:07.790547+0000 mgr.smithi067.rdualw (mgr.24569) 632 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:47:07.833667+0000 mgr.smithi067.rdualw (mgr.24569) 633 : audit [DBG] from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:47:09.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:47:08.545488+0000 mon.smithi061 (mon.0) 331 : audit [DBG] from='client.? 172.21.15.61:0/3552314284' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:47:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:07.790547+0000 mgr.smithi067.rdualw (mgr.24569) 632 : cluster [DBG] pgmap v549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:47:07.833667+0000 mgr.smithi067.rdualw (mgr.24569) 633 : audit [DBG] from='client.34558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:47:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:47:08.545488+0000 mon.smithi061 (mon.0) 331 : audit [DBG] from='client.? 172.21.15.61:0/3552314284' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:47:10.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:47:08.135067+0000 mgr.smithi067.rdualw (mgr.24569) 634 : audit [DBG] from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:47:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:47:08.135067+0000 mgr.smithi067.rdualw (mgr.24569) 634 : audit [DBG] from='client.34562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:47:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:09.791182+0000 mgr.smithi067.rdualw (mgr.24569) 635 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:09.791182+0000 mgr.smithi067.rdualw (mgr.24569) 635 : cluster [DBG] pgmap v550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:11.792033+0000 mgr.smithi067.rdualw (mgr.24569) 636 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:11.792033+0000 mgr.smithi067.rdualw (mgr.24569) 636 : cluster [DBG] pgmap v551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:13.792593+0000 mgr.smithi067.rdualw (mgr.24569) 637 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:13.792593+0000 mgr.smithi067.rdualw (mgr.24569) 637 : cluster [DBG] pgmap v552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:15.793423+0000 mgr.smithi067.rdualw (mgr.24569) 638 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:47:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:15.793423+0000 mgr.smithi067.rdualw (mgr.24569) 638 : cluster [DBG] pgmap v553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:47:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:17.794043+0000 mgr.smithi067.rdualw (mgr.24569) 639 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:17.794043+0000 mgr.smithi067.rdualw (mgr.24569) 639 : cluster [DBG] pgmap v554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:19.794771+0000 mgr.smithi067.rdualw (mgr.24569) 640 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:19.794771+0000 mgr.smithi067.rdualw (mgr.24569) 640 : cluster [DBG] pgmap v555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:21.795618+0000 mgr.smithi067.rdualw (mgr.24569) 641 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:23.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:21.795618+0000 mgr.smithi067.rdualw (mgr.24569) 641 : cluster [DBG] pgmap v556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:47:23.791375+0000 mon.smithi067 (mon.1) 138 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:47:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:47:23.792840+0000 mon.smithi067 (mon.1) 139 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:47:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:47:23.793742+0000 mon.smithi067 (mon.1) 140 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:47:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:47:23.791375+0000 mon.smithi067 (mon.1) 138 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:47:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:47:23.792840+0000 mon.smithi067 (mon.1) 139 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:47:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:47:23.793742+0000 mon.smithi067 (mon.1) 140 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:47:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:47:23.794570+0000 mgr.smithi067.rdualw (mgr.24569) 642 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:47:25.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:23.796170+0000 mgr.smithi067.rdualw (mgr.24569) 643 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:25.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:47:24.212813+0000 mon.smithi061 (mon.0) 332 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:47:25.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:47:24.220516+0000 mon.smithi061 (mon.0) 333 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:47:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:47:23.794570+0000 mgr.smithi067.rdualw (mgr.24569) 642 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:47:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:23.796170+0000 mgr.smithi067.rdualw (mgr.24569) 643 : cluster [DBG] pgmap v557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:25.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:47:24.212813+0000 mon.smithi061 (mon.0) 332 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:47:25.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:47:24.220516+0000 mon.smithi061 (mon.0) 333 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:47:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:25.797044+0000 mgr.smithi067.rdualw (mgr.24569) 644 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:47:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:25.797044+0000 mgr.smithi067.rdualw (mgr.24569) 644 : cluster [DBG] pgmap v558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:47:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:27.797504+0000 mgr.smithi067.rdualw (mgr.24569) 645 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:27.797504+0000 mgr.smithi067.rdualw (mgr.24569) 645 : cluster [DBG] pgmap v559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:29.798214+0000 mgr.smithi067.rdualw (mgr.24569) 646 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:29.798214+0000 mgr.smithi067.rdualw (mgr.24569) 646 : cluster [DBG] pgmap v560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:31.799175+0000 mgr.smithi067.rdualw (mgr.24569) 647 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:33.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:31.799175+0000 mgr.smithi067.rdualw (mgr.24569) 647 : cluster [DBG] pgmap v561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:33.799845+0000 mgr.smithi067.rdualw (mgr.24569) 648 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:47:34.525787+0000 mon.smithi067 (mon.1) 141 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:47:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:47:34.526111+0000 mon.smithi067 (mon.1) 142 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:47:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:47:34.526385+0000 mon.smithi061 (mon.0) 334 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:47:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:47:34.526691+0000 mon.smithi061 (mon.0) 335 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:47:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:33.799845+0000 mgr.smithi067.rdualw (mgr.24569) 648 : cluster [DBG] pgmap v562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:47:34.525787+0000 mon.smithi067 (mon.1) 141 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:47:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:47:34.526111+0000 mon.smithi067 (mon.1) 142 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:47:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:47:34.526385+0000 mon.smithi061 (mon.0) 334 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:47:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:47:34.526691+0000 mon.smithi061 (mon.0) 335 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:47:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:35.800852+0000 mgr.smithi067.rdualw (mgr.24569) 649 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:47:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:35.800852+0000 mgr.smithi067.rdualw (mgr.24569) 649 : cluster [DBG] pgmap v563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:47:38.859 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:47:39.151 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:47:39.152 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (25m) 7m ago 26m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:47:39.152 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (17m) 7m ago 26m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:47:39.152 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (17m) 7m ago 25m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:47:39.153 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (25m) 7m ago 26m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:47:39.153 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (18m) 7m ago 21m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:47:39.153 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (18m) 7m ago 21m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:47:39.153 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (19m) 7m ago 27m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:47:39.154 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (18m) 7m ago 25m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:47:39.154 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (18m) 7m ago 27m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:47:39.154 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (18m) 7m ago 25m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:47:39.154 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (19m) 7m ago 19m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:47:39.154 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (19m) 7m ago 19m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:47:39.155 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (26m) 7m ago 26m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:47:39.155 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (25m) 7m ago 25m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:47:39.155 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (8m) 7m ago 25m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:47:39.155 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (24m) 7m ago 24m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:47:39.156 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (24m) 7m ago 24m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:47:39.156 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (24m) 7m ago 24m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:47:39.156 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (24m) 7m ago 24m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:47:39.156 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (23m) 7m ago 23m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:47:39.156 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (23m) 7m ago 23m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:47:39.157 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (23m) 7m ago 23m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:47:39.157 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (24m) 7m ago 25m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:47:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:37.801361+0000 mgr.smithi067.rdualw (mgr.24569) 650 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:37.801361+0000 mgr.smithi067.rdualw (mgr.24569) 650 : cluster [DBG] pgmap v564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:39.492 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:47:39.493 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:47:39.493 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:47:39.493 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:47:39.494 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:47:39.494 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:47:39.494 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:47:39.494 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:47:39.495 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:47:39.495 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:47:39.495 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:47:39.495 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:47:39.495 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:47:39.496 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:47:39.496 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:47:39.496 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:47:39.496 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:47:39.496 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:47:39.497 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:47:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:47:38.845096+0000 mgr.smithi067.rdualw (mgr.24569) 651 : audit [DBG] from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:47:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:47:39.491035+0000 mon.smithi061 (mon.0) 336 : audit [DBG] from='client.? 172.21.15.61:0/1398452523' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:47:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:47:38.845096+0000 mgr.smithi067.rdualw (mgr.24569) 651 : audit [DBG] from='client.34570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:47:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:47:39.491035+0000 mon.smithi061 (mon.0) 336 : audit [DBG] from='client.? 172.21.15.61:0/1398452523' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:47:41.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:47:39.134108+0000 mgr.smithi067.rdualw (mgr.24569) 652 : audit [DBG] from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:47:41.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:39.801984+0000 mgr.smithi067.rdualw (mgr.24569) 653 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:47:39.134108+0000 mgr.smithi067.rdualw (mgr.24569) 652 : audit [DBG] from='client.34574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:47:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:39.801984+0000 mgr.smithi067.rdualw (mgr.24569) 653 : cluster [DBG] pgmap v565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:41.802935+0000 mgr.smithi067.rdualw (mgr.24569) 654 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:41.802935+0000 mgr.smithi067.rdualw (mgr.24569) 654 : cluster [DBG] pgmap v566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:43.803551+0000 mgr.smithi067.rdualw (mgr.24569) 655 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:43.803551+0000 mgr.smithi067.rdualw (mgr.24569) 655 : cluster [DBG] pgmap v567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:45.804301+0000 mgr.smithi067.rdualw (mgr.24569) 656 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:47:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:45.804301+0000 mgr.smithi067.rdualw (mgr.24569) 656 : cluster [DBG] pgmap v568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:47:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:47.804913+0000 mgr.smithi067.rdualw (mgr.24569) 657 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:47.804913+0000 mgr.smithi067.rdualw (mgr.24569) 657 : cluster [DBG] pgmap v569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:49.805506+0000 mgr.smithi067.rdualw (mgr.24569) 658 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:49.805506+0000 mgr.smithi067.rdualw (mgr.24569) 658 : cluster [DBG] pgmap v570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:51.806350+0000 mgr.smithi067.rdualw (mgr.24569) 659 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:51.806350+0000 mgr.smithi067.rdualw (mgr.24569) 659 : cluster [DBG] pgmap v571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:53.806946+0000 mgr.smithi067.rdualw (mgr.24569) 660 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:53.806946+0000 mgr.smithi067.rdualw (mgr.24569) 660 : cluster [DBG] pgmap v572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:57.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:55.807826+0000 mgr.smithi067.rdualw (mgr.24569) 661 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:47:57.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:55.807826+0000 mgr.smithi067.rdualw (mgr.24569) 661 : cluster [DBG] pgmap v573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:47:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:47:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:57.808344+0000 mgr.smithi067.rdualw (mgr.24569) 662 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:47:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:47:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:57.808344+0000 mgr.smithi067.rdualw (mgr.24569) 662 : cluster [DBG] pgmap v574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:47:59.808972+0000 mgr.smithi067.rdualw (mgr.24569) 663 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:47:59.808972+0000 mgr.smithi067.rdualw (mgr.24569) 663 : cluster [DBG] pgmap v575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:01.810122+0000 mgr.smithi067.rdualw (mgr.24569) 664 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:01.810122+0000 mgr.smithi067.rdualw (mgr.24569) 664 : cluster [DBG] pgmap v576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:03.810939+0000 mgr.smithi067.rdualw (mgr.24569) 665 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:03.810939+0000 mgr.smithi067.rdualw (mgr.24569) 665 : cluster [DBG] pgmap v577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:05.812012+0000 mgr.smithi067.rdualw (mgr.24569) 666 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:48:07.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:05.812012+0000 mgr.smithi067.rdualw (mgr.24569) 666 : cluster [DBG] pgmap v578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:48:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:07.812586+0000 mgr.smithi067.rdualw (mgr.24569) 667 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:07.812586+0000 mgr.smithi067.rdualw (mgr.24569) 667 : cluster [DBG] pgmap v579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:09.799 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:48:10.094 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:48:10.094 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (25m) 7m ago 26m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:48:10.095 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (18m) 7m ago 26m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:48:10.095 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (18m) 7m ago 26m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:48:10.095 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (25m) 7m ago 26m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:48:10.096 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (18m) 7m ago 22m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:48:10.096 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (18m) 7m ago 22m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:48:10.096 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (19m) 7m ago 27m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:48:10.096 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (19m) 7m ago 26m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:48:10.096 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (19m) 7m ago 28m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:48:10.097 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (19m) 7m ago 26m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:48:10.097 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (20m) 7m ago 20m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:48:10.097 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (20m) 7m ago 20m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:48:10.097 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (26m) 7m ago 26m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:48:10.098 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (25m) 7m ago 25m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:48:10.098 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (9m) 7m ago 25m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:48:10.098 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (25m) 7m ago 25m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:48:10.098 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (25m) 7m ago 25m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:48:10.099 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (24m) 7m ago 24m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:48:10.099 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (24m) 7m ago 24m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:48:10.099 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (24m) 7m ago 24m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:48:10.099 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (24m) 7m ago 24m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:48:10.099 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (23m) 7m ago 23m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:48:10.100 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (25m) 7m ago 26m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:48:10.437 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:48:10.437 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:48:10.438 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:48:10.438 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:48:10.438 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:48:10.439 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:48:10.440 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:48:10.440 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:48:10.440 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:48:10.440 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:48:10.441 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:48:10.441 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:48:10.441 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:48:10.441 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:48:10.442 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:48:10.442 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:48:10.442 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:48:10.442 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:48:10.443 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:48:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:48:09.785614+0000 mgr.smithi067.rdualw (mgr.24569) 668 : audit [DBG] from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:48:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:09.813208+0000 mgr.smithi067.rdualw (mgr.24569) 669 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:48:09.785614+0000 mgr.smithi067.rdualw (mgr.24569) 668 : audit [DBG] from='client.34582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:48:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:09.813208+0000 mgr.smithi067.rdualw (mgr.24569) 669 : cluster [DBG] pgmap v580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:11.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:48:10.076577+0000 mgr.smithi067.rdualw (mgr.24569) 670 : audit [DBG] from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:48:11.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:48:10.435642+0000 mon.smithi061 (mon.0) 337 : audit [DBG] from='client.? 172.21.15.61:0/2871271346' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:48:11.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:48:10.076577+0000 mgr.smithi067.rdualw (mgr.24569) 670 : audit [DBG] from='client.34586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:48:11.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:48:10.435642+0000 mon.smithi061 (mon.0) 337 : audit [DBG] from='client.? 172.21.15.61:0/2871271346' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:48:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:11.814056+0000 mgr.smithi067.rdualw (mgr.24569) 671 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:11.814056+0000 mgr.smithi067.rdualw (mgr.24569) 671 : cluster [DBG] pgmap v581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:13.814868+0000 mgr.smithi067.rdualw (mgr.24569) 672 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:13.814868+0000 mgr.smithi067.rdualw (mgr.24569) 672 : cluster [DBG] pgmap v582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:15.815700+0000 mgr.smithi067.rdualw (mgr.24569) 673 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:48:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:15.815700+0000 mgr.smithi067.rdualw (mgr.24569) 673 : cluster [DBG] pgmap v583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:48:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:17.816234+0000 mgr.smithi067.rdualw (mgr.24569) 674 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:17.816234+0000 mgr.smithi067.rdualw (mgr.24569) 674 : cluster [DBG] pgmap v584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:19.816959+0000 mgr.smithi067.rdualw (mgr.24569) 675 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:19.816959+0000 mgr.smithi067.rdualw (mgr.24569) 675 : cluster [DBG] pgmap v585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:21.817879+0000 mgr.smithi067.rdualw (mgr.24569) 676 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:21.817879+0000 mgr.smithi067.rdualw (mgr.24569) 676 : cluster [DBG] pgmap v586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:23.818570+0000 mgr.smithi067.rdualw (mgr.24569) 677 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:48:24.223858+0000 mon.smithi067 (mon.1) 143 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:48:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:48:24.225274+0000 mon.smithi067 (mon.1) 144 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:48:25.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:48:24.226262+0000 mon.smithi067 (mon.1) 145 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:48:25.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:48:24.641198+0000 mon.smithi061 (mon.0) 338 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:48:25.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:48:24.647162+0000 mon.smithi061 (mon.0) 339 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:48:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:23.818570+0000 mgr.smithi067.rdualw (mgr.24569) 677 : cluster [DBG] pgmap v587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:48:24.223858+0000 mon.smithi067 (mon.1) 143 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:48:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:48:24.225274+0000 mon.smithi067 (mon.1) 144 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:48:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:48:24.226262+0000 mon.smithi067 (mon.1) 145 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:48:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:48:24.641198+0000 mon.smithi061 (mon.0) 338 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:48:25.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:48:24.647162+0000 mon.smithi061 (mon.0) 339 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:48:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:48:24.227117+0000 mgr.smithi067.rdualw (mgr.24569) 678 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:48:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:48:24.227117+0000 mgr.smithi067.rdualw (mgr.24569) 678 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:48:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:25.819387+0000 mgr.smithi067.rdualw (mgr.24569) 679 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:48:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:25.819387+0000 mgr.smithi067.rdualw (mgr.24569) 679 : cluster [DBG] pgmap v588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:48:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:27.820076+0000 mgr.smithi067.rdualw (mgr.24569) 680 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:27.820076+0000 mgr.smithi067.rdualw (mgr.24569) 680 : cluster [DBG] pgmap v589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:29.820775+0000 mgr.smithi067.rdualw (mgr.24569) 681 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:29.820775+0000 mgr.smithi067.rdualw (mgr.24569) 681 : cluster [DBG] pgmap v590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:31.821668+0000 mgr.smithi067.rdualw (mgr.24569) 682 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:31.821668+0000 mgr.smithi067.rdualw (mgr.24569) 682 : cluster [DBG] pgmap v591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:33.822317+0000 mgr.smithi067.rdualw (mgr.24569) 683 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:48:34.530748+0000 mon.smithi067 (mon.1) 146 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:48:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:48:34.531000+0000 mon.smithi067 (mon.1) 147 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:48:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:48:34.531092+0000 mon.smithi061 (mon.0) 340 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:48:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:48:34.531558+0000 mon.smithi061 (mon.0) 341 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:48:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:33.822317+0000 mgr.smithi067.rdualw (mgr.24569) 683 : cluster [DBG] pgmap v592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:48:34.530748+0000 mon.smithi067 (mon.1) 146 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:48:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:48:34.531000+0000 mon.smithi067 (mon.1) 147 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:48:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:48:34.531092+0000 mon.smithi061 (mon.0) 340 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:48:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:48:34.531558+0000 mon.smithi061 (mon.0) 341 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:48:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:35.823163+0000 mgr.smithi067.rdualw (mgr.24569) 684 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:48:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:35.823163+0000 mgr.smithi067.rdualw (mgr.24569) 684 : cluster [DBG] pgmap v593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:48:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:37.823677+0000 mgr.smithi067.rdualw (mgr.24569) 685 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:37.823677+0000 mgr.smithi067.rdualw (mgr.24569) 685 : cluster [DBG] pgmap v594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:40.750 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:48:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:39.824445+0000 mgr.smithi067.rdualw (mgr.24569) 686 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:39.824445+0000 mgr.smithi067.rdualw (mgr.24569) 686 : cluster [DBG] pgmap v595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:41.040 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:48:41.041 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (26m) 8m ago 27m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:48:41.041 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (18m) 8m ago 27m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:48:41.041 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (18m) 8m ago 26m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:48:41.041 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (26m) 8m ago 27m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:48:41.041 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (19m) 8m ago 23m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:48:41.042 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (19m) 8m ago 22m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:48:41.042 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (20m) 8m ago 28m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:48:41.042 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (20m) 8m ago 26m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:48:41.042 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (19m) 8m ago 28m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:48:41.043 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (19m) 8m ago 26m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:48:41.043 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (20m) 8m ago 20m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:48:41.043 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (20m) 8m ago 20m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:48:41.043 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (27m) 8m ago 27m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:48:41.044 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (26m) 8m ago 26m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:48:41.044 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (9m) 8m ago 26m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:48:41.044 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (25m) 8m ago 25m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:48:41.044 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (25m) 8m ago 25m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:48:41.044 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (25m) 8m ago 25m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:48:41.045 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (25m) 8m ago 25m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:48:41.045 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (24m) 8m ago 24m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:48:41.045 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (24m) 8m ago 24m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:48:41.045 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (24m) 8m ago 24m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:48:41.046 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (26m) 8m ago 26m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:48:41.383 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:48:41.383 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:48:41.383 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:48:41.384 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:48:41.384 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:48:41.384 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:48:41.384 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:48:41.384 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:48:41.385 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:48:41.385 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:48:41.385 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:48:41.385 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:48:41.386 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:48:41.386 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:48:41.386 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:48:41.386 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:48:41.386 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:48:41.387 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:48:41.387 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:48:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:48:40.736909+0000 mgr.smithi067.rdualw (mgr.24569) 687 : audit [DBG] from='client.34594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:48:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:48:41.381304+0000 mon.smithi061 (mon.0) 342 : audit [DBG] from='client.? 172.21.15.61:0/2454390237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:48:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:48:40.736909+0000 mgr.smithi067.rdualw (mgr.24569) 687 : audit [DBG] from='client.34594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:48:41.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:48:41.381304+0000 mon.smithi061 (mon.0) 342 : audit [DBG] from='client.? 172.21.15.61:0/2454390237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:48:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:48:41.022332+0000 mgr.smithi067.rdualw (mgr.24569) 688 : audit [DBG] from='client.34598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:48:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:41.825286+0000 mgr.smithi067.rdualw (mgr.24569) 689 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:48:41.022332+0000 mgr.smithi067.rdualw (mgr.24569) 688 : audit [DBG] from='client.34598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:48:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:41.825286+0000 mgr.smithi067.rdualw (mgr.24569) 689 : cluster [DBG] pgmap v596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:43.825892+0000 mgr.smithi067.rdualw (mgr.24569) 690 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:43.825892+0000 mgr.smithi067.rdualw (mgr.24569) 690 : cluster [DBG] pgmap v597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:45.826821+0000 mgr.smithi067.rdualw (mgr.24569) 691 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:48:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:45.826821+0000 mgr.smithi067.rdualw (mgr.24569) 691 : cluster [DBG] pgmap v598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:48:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:47.827389+0000 mgr.smithi067.rdualw (mgr.24569) 692 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:47.827389+0000 mgr.smithi067.rdualw (mgr.24569) 692 : cluster [DBG] pgmap v599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:49.828009+0000 mgr.smithi067.rdualw (mgr.24569) 693 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:49.828009+0000 mgr.smithi067.rdualw (mgr.24569) 693 : cluster [DBG] pgmap v600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:51.828830+0000 mgr.smithi067.rdualw (mgr.24569) 694 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:51.828830+0000 mgr.smithi067.rdualw (mgr.24569) 694 : cluster [DBG] pgmap v601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:53.829650+0000 mgr.smithi067.rdualw (mgr.24569) 695 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:53.829650+0000 mgr.smithi067.rdualw (mgr.24569) 695 : cluster [DBG] pgmap v602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:57.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:55.830579+0000 mgr.smithi067.rdualw (mgr.24569) 696 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:48:57.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:55.830579+0000 mgr.smithi067.rdualw (mgr.24569) 696 : cluster [DBG] pgmap v603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:48:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:48:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:57.831040+0000 mgr.smithi067.rdualw (mgr.24569) 697 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:48:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:48:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:57.831040+0000 mgr.smithi067.rdualw (mgr.24569) 697 : cluster [DBG] pgmap v604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:48:59.831673+0000 mgr.smithi067.rdualw (mgr.24569) 698 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:00.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:48:59.831673+0000 mgr.smithi067.rdualw (mgr.24569) 698 : cluster [DBG] pgmap v605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:01.832573+0000 mgr.smithi067.rdualw (mgr.24569) 699 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:01.832573+0000 mgr.smithi067.rdualw (mgr.24569) 699 : cluster [DBG] pgmap v606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:03.833405+0000 mgr.smithi067.rdualw (mgr.24569) 700 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:03.833405+0000 mgr.smithi067.rdualw (mgr.24569) 700 : cluster [DBG] pgmap v607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:05.834237+0000 mgr.smithi067.rdualw (mgr.24569) 701 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:49:07.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:05.834237+0000 mgr.smithi067.rdualw (mgr.24569) 701 : cluster [DBG] pgmap v608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:49:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:07.834856+0000 mgr.smithi067.rdualw (mgr.24569) 702 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:07.834856+0000 mgr.smithi067.rdualw (mgr.24569) 702 : cluster [DBG] pgmap v609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:09.835665+0000 mgr.smithi067.rdualw (mgr.24569) 703 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:09.835665+0000 mgr.smithi067.rdualw (mgr.24569) 703 : cluster [DBG] pgmap v610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:11.690 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:49:11.987 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:49:11.987 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (26m) 8m ago 27m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:49:11.987 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (19m) 8m ago 27m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:49:11.988 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (19m) 8m ago 27m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:49:11.988 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (26m) 8m ago 27m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:49:11.988 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (19m) 8m ago 23m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:49:11.988 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (19m) 8m ago 23m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:49:11.989 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (20m) 8m ago 28m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:49:11.989 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (20m) 8m ago 27m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:49:11.989 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (20m) 8m ago 29m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:49:11.989 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (20m) 8m ago 27m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:49:11.989 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (21m) 8m ago 21m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:49:11.990 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (21m) 8m ago 21m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:49:11.990 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (27m) 8m ago 27m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:49:11.990 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (27m) 8m ago 26m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:49:11.990 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (10m) 8m ago 26m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:49:11.991 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (26m) 8m ago 26m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:49:11.991 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (26m) 8m ago 26m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:49:11.991 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (25m) 8m ago 25m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:49:11.991 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (25m) 8m ago 25m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:49:11.991 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (25m) 8m ago 25m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:49:11.992 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (25m) 8m ago 25m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:49:11.992 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (24m) 8m ago 24m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:49:11.992 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (26m) 8m ago 27m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:49:12.359 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:49:12.359 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:49:12.360 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:49:12.360 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:49:12.360 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:49:12.360 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:49:12.360 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:49:12.361 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:49:12.361 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:49:12.361 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:49:12.361 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:49:12.362 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:49:12.362 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:49:12.362 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:49:12.362 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:49:12.363 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:49:12.363 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:49:12.363 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:49:12.364 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:49:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:49:11.676402+0000 mgr.smithi067.rdualw (mgr.24569) 704 : audit [DBG] from='client.34606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:49:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:11.836681+0000 mgr.smithi067.rdualw (mgr.24569) 705 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:13.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:49:11.969243+0000 mgr.smithi067.rdualw (mgr.24569) 706 : audit [DBG] from='client.34610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:49:13.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:49:12.357308+0000 mon.smithi061 (mon.0) 343 : audit [DBG] from='client.? 172.21.15.61:0/1416919870' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:49:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:49:11.676402+0000 mgr.smithi067.rdualw (mgr.24569) 704 : audit [DBG] from='client.34606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:49:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:11.836681+0000 mgr.smithi067.rdualw (mgr.24569) 705 : cluster [DBG] pgmap v611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:49:11.969243+0000 mgr.smithi067.rdualw (mgr.24569) 706 : audit [DBG] from='client.34610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:49:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:49:12.357308+0000 mon.smithi061 (mon.0) 343 : audit [DBG] from='client.? 172.21.15.61:0/1416919870' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:49:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:13.837227+0000 mgr.smithi067.rdualw (mgr.24569) 707 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:13.837227+0000 mgr.smithi067.rdualw (mgr.24569) 707 : cluster [DBG] pgmap v612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:15.838087+0000 mgr.smithi067.rdualw (mgr.24569) 708 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:49:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:15.838087+0000 mgr.smithi067.rdualw (mgr.24569) 708 : cluster [DBG] pgmap v613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:49:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:17.838808+0000 mgr.smithi067.rdualw (mgr.24569) 709 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:17.838808+0000 mgr.smithi067.rdualw (mgr.24569) 709 : cluster [DBG] pgmap v614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:19.839374+0000 mgr.smithi067.rdualw (mgr.24569) 710 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:19.839374+0000 mgr.smithi067.rdualw (mgr.24569) 710 : cluster [DBG] pgmap v615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:21.840291+0000 mgr.smithi067.rdualw (mgr.24569) 711 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:21.840291+0000 mgr.smithi067.rdualw (mgr.24569) 711 : cluster [DBG] pgmap v616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:23.840915+0000 mgr.smithi067.rdualw (mgr.24569) 712 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:49:24.651180+0000 mon.smithi067 (mon.1) 148 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:49:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:49:24.652592+0000 mon.smithi067 (mon.1) 149 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:49:25.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:49:24.653559+0000 mon.smithi067 (mon.1) 150 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:49:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:23.840915+0000 mgr.smithi067.rdualw (mgr.24569) 712 : cluster [DBG] pgmap v617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:49:24.651180+0000 mon.smithi067 (mon.1) 148 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:49:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:49:24.652592+0000 mon.smithi067 (mon.1) 149 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:49:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:49:24.653559+0000 mon.smithi067 (mon.1) 150 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:49:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:49:24.654401+0000 mgr.smithi067.rdualw (mgr.24569) 713 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:49:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:49:25.069494+0000 mon.smithi061 (mon.0) 344 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:49:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:49:25.075035+0000 mon.smithi061 (mon.0) 345 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:49:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:49:24.654401+0000 mgr.smithi067.rdualw (mgr.24569) 713 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:49:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:49:25.069494+0000 mon.smithi061 (mon.0) 344 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:49:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:49:25.075035+0000 mon.smithi061 (mon.0) 345 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:49:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:25.841744+0000 mgr.smithi067.rdualw (mgr.24569) 714 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:49:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:25.841744+0000 mgr.smithi067.rdualw (mgr.24569) 714 : cluster [DBG] pgmap v618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:49:29.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:27.842474+0000 mgr.smithi067.rdualw (mgr.24569) 715 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:27.842474+0000 mgr.smithi067.rdualw (mgr.24569) 715 : cluster [DBG] pgmap v619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:29.843198+0000 mgr.smithi067.rdualw (mgr.24569) 716 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:29.843198+0000 mgr.smithi067.rdualw (mgr.24569) 716 : cluster [DBG] pgmap v620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:31.844082+0000 mgr.smithi067.rdualw (mgr.24569) 717 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:31.844082+0000 mgr.smithi067.rdualw (mgr.24569) 717 : cluster [DBG] pgmap v621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:33.844711+0000 mgr.smithi067.rdualw (mgr.24569) 718 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:49:34.535818+0000 mon.smithi067 (mon.1) 151 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:49:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:49:34.536171+0000 mon.smithi061 (mon.0) 346 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:49:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:49:34.536172+0000 mon.smithi067 (mon.1) 152 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:49:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:49:34.536417+0000 mon.smithi061 (mon.0) 347 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:49:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:33.844711+0000 mgr.smithi067.rdualw (mgr.24569) 718 : cluster [DBG] pgmap v622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:49:34.535818+0000 mon.smithi067 (mon.1) 151 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:49:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:49:34.536171+0000 mon.smithi061 (mon.0) 346 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:49:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:49:34.536172+0000 mon.smithi067 (mon.1) 152 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:49:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:49:34.536417+0000 mon.smithi061 (mon.0) 347 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:49:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:35.845705+0000 mgr.smithi067.rdualw (mgr.24569) 719 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:49:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:35.845705+0000 mgr.smithi067.rdualw (mgr.24569) 719 : cluster [DBG] pgmap v623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:49:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:37.846183+0000 mgr.smithi067.rdualw (mgr.24569) 720 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:37.846183+0000 mgr.smithi067.rdualw (mgr.24569) 720 : cluster [DBG] pgmap v624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:39.846984+0000 mgr.smithi067.rdualw (mgr.24569) 721 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:39.846984+0000 mgr.smithi067.rdualw (mgr.24569) 721 : cluster [DBG] pgmap v625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:42.675 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:49:42.968 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:49:42.969 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (27m) 9m ago 28m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:49:42.969 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (19m) 9m ago 28m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:49:42.969 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (19m) 9m ago 27m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:49:42.970 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (27m) 9m ago 28m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:49:42.970 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (20m) 9m ago 24m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:49:42.970 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (20m) 9m ago 23m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:49:42.970 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (21m) 9m ago 29m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:49:42.970 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (21m) 9m ago 27m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:49:42.971 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (20m) 9m ago 29m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:49:42.971 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (20m) 9m ago 27m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:49:42.971 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (21m) 9m ago 21m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:49:42.971 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (21m) 9m ago 21m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:49:42.972 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (28m) 9m ago 28m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:49:42.972 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (27m) 9m ago 27m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:49:42.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (10m) 9m ago 27m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:49:42.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (26m) 9m ago 26m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:49:42.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (26m) 9m ago 26m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:49:42.973 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (26m) 9m ago 26m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:49:42.973 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (26m) 9m ago 26m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:49:42.973 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (25m) 9m ago 25m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:49:42.973 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (25m) 9m ago 25m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:49:42.974 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (25m) 9m ago 25m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:49:42.974 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (27m) 9m ago 27m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:49:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:41.847888+0000 mgr.smithi067.rdualw (mgr.24569) 722 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:43.307 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:49:43.307 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:49:43.308 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:49:43.308 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:49:43.308 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:49:43.308 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:49:43.309 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:49:43.309 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:49:43.309 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:49:43.310 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:49:43.310 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:49:43.310 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:49:43.311 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:49:43.311 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:49:43.311 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:49:43.312 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:49:43.312 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:49:43.312 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:49:43.312 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:49:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:41.847888+0000 mgr.smithi067.rdualw (mgr.24569) 722 : cluster [DBG] pgmap v626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:44.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:49:42.661184+0000 mgr.smithi067.rdualw (mgr.24569) 723 : audit [DBG] from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:49:44.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:49:42.950178+0000 mgr.smithi067.rdualw (mgr.24569) 724 : audit [DBG] from='client.34622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:49:44.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:49:43.305752+0000 mon.smithi061 (mon.0) 348 : audit [DBG] from='client.? 172.21.15.61:0/1183823459' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:49:44.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:49:42.661184+0000 mgr.smithi067.rdualw (mgr.24569) 723 : audit [DBG] from='client.34618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:49:44.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:49:42.950178+0000 mgr.smithi067.rdualw (mgr.24569) 724 : audit [DBG] from='client.34622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:49:44.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:49:43.305752+0000 mon.smithi061 (mon.0) 348 : audit [DBG] from='client.? 172.21.15.61:0/1183823459' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:49:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:43.848459+0000 mgr.smithi067.rdualw (mgr.24569) 725 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:45.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:43.848459+0000 mgr.smithi067.rdualw (mgr.24569) 725 : cluster [DBG] pgmap v627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:45.849276+0000 mgr.smithi067.rdualw (mgr.24569) 726 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:49:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:45.849276+0000 mgr.smithi067.rdualw (mgr.24569) 726 : cluster [DBG] pgmap v628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:49:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:47.849823+0000 mgr.smithi067.rdualw (mgr.24569) 727 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:47.849823+0000 mgr.smithi067.rdualw (mgr.24569) 727 : cluster [DBG] pgmap v629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:49.850378+0000 mgr.smithi067.rdualw (mgr.24569) 728 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:49.850378+0000 mgr.smithi067.rdualw (mgr.24569) 728 : cluster [DBG] pgmap v630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:51.851241+0000 mgr.smithi067.rdualw (mgr.24569) 729 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:51.851241+0000 mgr.smithi067.rdualw (mgr.24569) 729 : cluster [DBG] pgmap v631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:53.851885+0000 mgr.smithi067.rdualw (mgr.24569) 730 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:53.851885+0000 mgr.smithi067.rdualw (mgr.24569) 730 : cluster [DBG] pgmap v632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:57.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:55.852775+0000 mgr.smithi067.rdualw (mgr.24569) 731 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:49:57.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:55.852775+0000 mgr.smithi067.rdualw (mgr.24569) 731 : cluster [DBG] pgmap v633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:49:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:49:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:57.853367+0000 mgr.smithi067.rdualw (mgr.24569) 732 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:49:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:49:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:57.853367+0000 mgr.smithi067.rdualw (mgr.24569) 732 : cluster [DBG] pgmap v634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:49:59.854025+0000 mgr.smithi067.rdualw (mgr.24569) 733 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:00.000149+0000 mon.smithi061 (mon.0) 349 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T15:50:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:49:59.854025+0000 mgr.smithi067.rdualw (mgr.24569) 733 : cluster [DBG] pgmap v635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:00.000149+0000 mon.smithi061 (mon.0) 349 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T15:50:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:01.854814+0000 mgr.smithi067.rdualw (mgr.24569) 734 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:01.854814+0000 mgr.smithi067.rdualw (mgr.24569) 734 : cluster [DBG] pgmap v636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:03.855557+0000 mgr.smithi067.rdualw (mgr.24569) 735 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:03.855557+0000 mgr.smithi067.rdualw (mgr.24569) 735 : cluster [DBG] pgmap v637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:05.856359+0000 mgr.smithi067.rdualw (mgr.24569) 736 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:50:07.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:05.856359+0000 mgr.smithi067.rdualw (mgr.24569) 736 : cluster [DBG] pgmap v638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:50:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:07.856965+0000 mgr.smithi067.rdualw (mgr.24569) 737 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:07.856965+0000 mgr.smithi067.rdualw (mgr.24569) 737 : cluster [DBG] pgmap v639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:09.857721+0000 mgr.smithi067.rdualw (mgr.24569) 738 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:09.857721+0000 mgr.smithi067.rdualw (mgr.24569) 738 : cluster [DBG] pgmap v640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:11.858557+0000 mgr.smithi067.rdualw (mgr.24569) 739 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:11.858557+0000 mgr.smithi067.rdualw (mgr.24569) 739 : cluster [DBG] pgmap v641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:13.613 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:50:13.960 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:50:13.961 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (27m) 9m ago 28m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:50:13.961 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (20m) 9m ago 28m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:50:13.961 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (20m) 9m ago 28m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:50:13.961 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (27m) 9m ago 28m 39.4M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:50:13.961 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (20m) 9m ago 24m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:50:13.962 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (20m) 9m ago 24m 15.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:50:13.962 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (21m) 9m ago 30m 437M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:50:13.962 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (21m) 9m ago 28m 451M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:50:13.962 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (21m) 9m ago 30m 144M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:50:13.963 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (21m) 9m ago 28m 116M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:50:13.963 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (22m) 9m ago 22m 149M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:50:13.963 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (22m) 9m ago 22m 90.7M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:50:13.963 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (28m) 9m ago 28m 18.3M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:50:13.963 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (28m) 9m ago 28m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:50:13.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (11m) 9m ago 27m 426M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:50:13.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (27m) 9m ago 27m 1192M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:50:13.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (27m) 9m ago 27m 713M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:50:13.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (26m) 9m ago 26m 1308M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:50:13.965 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (26m) 9m ago 26m 1209M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:50:13.965 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (26m) 9m ago 26m 1477M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:50:13.965 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (26m) 9m ago 26m 1133M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:50:13.965 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (25m) 9m ago 25m 1929M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:50:13.965 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (27m) 9m ago 28m 50.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:50:14.300 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:50:14.301 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:50:14.301 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:50:14.301 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:50:14.301 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:50:14.302 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:50:14.302 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:50:14.302 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:50:14.302 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:50:14.303 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:50:14.303 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:50:14.303 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:50:14.303 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:50:14.303 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:50:14.304 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:50:14.305 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:50:14.306 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:50:14.306 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:50:14.306 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:50:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:13.598809+0000 mgr.smithi067.rdualw (mgr.24569) 740 : audit [DBG] from='client.34630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:50:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:13.859066+0000 mgr.smithi067.rdualw (mgr.24569) 741 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:15.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:13.942828+0000 mgr.smithi067.rdualw (mgr.24569) 742 : audit [DBG] from='client.34634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:50:15.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:14.298846+0000 mon.smithi061 (mon.0) 350 : audit [DBG] from='client.? 172.21.15.61:0/1732449718' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:50:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:13.598809+0000 mgr.smithi067.rdualw (mgr.24569) 740 : audit [DBG] from='client.34630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:50:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:13.859066+0000 mgr.smithi067.rdualw (mgr.24569) 741 : cluster [DBG] pgmap v642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:13.942828+0000 mgr.smithi067.rdualw (mgr.24569) 742 : audit [DBG] from='client.34634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:50:15.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:14.298846+0000 mon.smithi061 (mon.0) 350 : audit [DBG] from='client.? 172.21.15.61:0/1732449718' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:50:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:15.859977+0000 mgr.smithi067.rdualw (mgr.24569) 743 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:50:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:15.859977+0000 mgr.smithi067.rdualw (mgr.24569) 743 : cluster [DBG] pgmap v643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:50:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:17.860622+0000 mgr.smithi067.rdualw (mgr.24569) 744 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:17.860622+0000 mgr.smithi067.rdualw (mgr.24569) 744 : cluster [DBG] pgmap v644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:19.861267+0000 mgr.smithi067.rdualw (mgr.24569) 745 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:19.861267+0000 mgr.smithi067.rdualw (mgr.24569) 745 : cluster [DBG] pgmap v645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:21.862223+0000 mgr.smithi067.rdualw (mgr.24569) 746 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:21.862223+0000 mgr.smithi067.rdualw (mgr.24569) 746 : cluster [DBG] pgmap v646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:23.862838+0000 mgr.smithi067.rdualw (mgr.24569) 747 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:23.862838+0000 mgr.smithi067.rdualw (mgr.24569) 747 : cluster [DBG] pgmap v647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:25.078436+0000 mon.smithi067 (mon.1) 153 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:50:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:25.079812+0000 mon.smithi067 (mon.1) 154 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:50:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:25.080720+0000 mon.smithi067 (mon.1) 155 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:50:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:25.078436+0000 mon.smithi067 (mon.1) 153 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:50:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:25.079812+0000 mon.smithi067 (mon.1) 154 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:50:26.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:25.080720+0000 mon.smithi067 (mon.1) 155 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:50:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:50:25.081556+0000 mgr.smithi067.rdualw (mgr.24569) 748 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:50:27.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:25.863525+0000 mgr.smithi067.rdualw (mgr.24569) 749 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:50:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:50:25.081556+0000 mgr.smithi067.rdualw (mgr.24569) 748 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:50:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:25.863525+0000 mgr.smithi067.rdualw (mgr.24569) 749 : cluster [DBG] pgmap v648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:50:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:27.863952+0000 mgr.smithi067.rdualw (mgr.24569) 750 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:27.863952+0000 mgr.smithi067.rdualw (mgr.24569) 750 : cluster [DBG] pgmap v649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:29.780952+0000 mon.smithi061 (mon.0) 351 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:50:31.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:29.864455+0000 mgr.smithi067.rdualw (mgr.24569) 751 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:31.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:30.178619+0000 mon.smithi067 (mon.1) 156 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:50:31.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:30.179103+0000 mon.smithi061 (mon.0) 352 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:50:31.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:29.780952+0000 mon.smithi061 (mon.0) 351 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:50:31.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:29.864455+0000 mgr.smithi067.rdualw (mgr.24569) 751 : cluster [DBG] pgmap v650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:31.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:30.178619+0000 mon.smithi067 (mon.1) 156 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:50:31.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:30.179103+0000 mon.smithi061 (mon.0) 352 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:50:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:31.865256+0000 mgr.smithi067.rdualw (mgr.24569) 752 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:32.213044+0000 mon.smithi061 (mon.0) 353 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:50:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:32.608176+0000 mon.smithi067 (mon.1) 157 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:50:33.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:32.608755+0000 mon.smithi061 (mon.0) 354 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:50:33.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:32.613359+0000 mon.smithi061 (mon.0) 355 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:50:33.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:32.620431+0000 mon.smithi061 (mon.0) 356 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:50:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:31.865256+0000 mgr.smithi067.rdualw (mgr.24569) 752 : cluster [DBG] pgmap v651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:32.213044+0000 mon.smithi061 (mon.0) 353 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:50:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:32.608176+0000 mon.smithi067 (mon.1) 157 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:50:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:32.608755+0000 mon.smithi061 (mon.0) 354 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T15:50:33.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:32.613359+0000 mon.smithi061 (mon.0) 355 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:50:33.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:32.620431+0000 mon.smithi061 (mon.0) 356 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:50:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:33.865959+0000 mgr.smithi067.rdualw (mgr.24569) 753 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:34.540946+0000 mon.smithi067 (mon.1) 158 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:50:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:34.541201+0000 mon.smithi067 (mon.1) 159 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:50:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:34.541415+0000 mon.smithi061 (mon.0) 357 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:50:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:34.541673+0000 mon.smithi061 (mon.0) 358 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:50:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:33.865959+0000 mgr.smithi067.rdualw (mgr.24569) 753 : cluster [DBG] pgmap v652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:34.540946+0000 mon.smithi067 (mon.1) 158 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:50:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:34.541201+0000 mon.smithi067 (mon.1) 159 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:50:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:34.541415+0000 mon.smithi061 (mon.0) 357 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:50:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:34.541673+0000 mon.smithi061 (mon.0) 358 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:50:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:35.866866+0000 mgr.smithi067.rdualw (mgr.24569) 754 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:50:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:35.866866+0000 mgr.smithi067.rdualw (mgr.24569) 754 : cluster [DBG] pgmap v653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:50:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:37.867444+0000 mgr.smithi067.rdualw (mgr.24569) 755 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:37.867444+0000 mgr.smithi067.rdualw (mgr.24569) 755 : cluster [DBG] pgmap v654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:39.868166+0000 mgr.smithi067.rdualw (mgr.24569) 756 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:39.868166+0000 mgr.smithi067.rdualw (mgr.24569) 756 : cluster [DBG] pgmap v655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:41.869006+0000 mgr.smithi067.rdualw (mgr.24569) 757 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:43.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:41.869006+0000 mgr.smithi067.rdualw (mgr.24569) 757 : cluster [DBG] pgmap v656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:44.631 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:50:44.924 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:50:44.924 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (28m) 12s ago 29m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:50:44.924 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (20m) 12s ago 29m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:50:44.924 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (20m) 15s ago 28m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:50:44.925 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (28m) 12s ago 29m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:50:44.925 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (21m) 12s ago 25m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:50:44.925 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (21m) 15s ago 25m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:50:44.925 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (22m) 12s ago 30m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:50:44.926 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (22m) 15s ago 28m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:50:44.926 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (21m) 12s ago 30m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:50:44.926 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (21m) 15s ago 28m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:50:44.926 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (22m) 12s ago 22m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:50:44.926 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (22m) 15s ago 22m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:50:44.927 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (29m) 12s ago 29m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:50:44.927 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (28m) 15s ago 28m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:50:44.927 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (11m) 12s ago 28m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:50:44.927 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (27m) 12s ago 27m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:50:44.928 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (27m) 12s ago 27m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:50:44.928 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (27m) 12s ago 27m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:50:44.928 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (27m) 15s ago 27m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:50:44.928 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (26m) 15s ago 26m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:50:44.928 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (26m) 15s ago 26m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:50:44.929 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (26m) 15s ago 26m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:50:44.929 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (28m) 12s ago 29m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:50:45.270 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:50:45.271 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:50:45.271 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:50:45.271 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:50:45.272 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:50:45.272 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:50:45.272 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:50:45.272 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:50:45.272 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:50:45.273 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:50:45.273 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:50:45.273 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:50:45.273 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:50:45.274 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:50:45.274 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:50:45.274 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:50:45.274 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:50:45.274 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:50:45.275 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:50:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:43.869690+0000 mgr.smithi067.rdualw (mgr.24569) 758 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:43.869690+0000 mgr.smithi067.rdualw (mgr.24569) 758 : cluster [DBG] pgmap v657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:44.616763+0000 mgr.smithi067.rdualw (mgr.24569) 759 : audit [DBG] from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:50:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:44.904850+0000 mgr.smithi067.rdualw (mgr.24569) 760 : audit [DBG] from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:50:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:50:45.269051+0000 mon.smithi061 (mon.0) 359 : audit [DBG] from='client.? 172.21.15.61:0/3109557678' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:50:46.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:44.616763+0000 mgr.smithi067.rdualw (mgr.24569) 759 : audit [DBG] from='client.34642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:50:46.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:44.904850+0000 mgr.smithi067.rdualw (mgr.24569) 760 : audit [DBG] from='client.34646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:50:46.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:50:45.269051+0000 mon.smithi061 (mon.0) 359 : audit [DBG] from='client.? 172.21.15.61:0/3109557678' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:50:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:45.870694+0000 mgr.smithi067.rdualw (mgr.24569) 761 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:50:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:45.870694+0000 mgr.smithi067.rdualw (mgr.24569) 761 : cluster [DBG] pgmap v658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:50:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:47.871225+0000 mgr.smithi067.rdualw (mgr.24569) 762 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:47.871225+0000 mgr.smithi067.rdualw (mgr.24569) 762 : cluster [DBG] pgmap v659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:49.872013+0000 mgr.smithi067.rdualw (mgr.24569) 763 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:49.872013+0000 mgr.smithi067.rdualw (mgr.24569) 763 : cluster [DBG] pgmap v660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:51.872949+0000 mgr.smithi067.rdualw (mgr.24569) 764 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:51.872949+0000 mgr.smithi067.rdualw (mgr.24569) 764 : cluster [DBG] pgmap v661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:53.873757+0000 mgr.smithi067.rdualw (mgr.24569) 765 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:53.873757+0000 mgr.smithi067.rdualw (mgr.24569) 765 : cluster [DBG] pgmap v662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:57.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:55.874622+0000 mgr.smithi067.rdualw (mgr.24569) 766 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:50:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:55.874622+0000 mgr.smithi067.rdualw (mgr.24569) 766 : cluster [DBG] pgmap v663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:50:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:50:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:57.875155+0000 mgr.smithi067.rdualw (mgr.24569) 767 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:50:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:50:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:57.875155+0000 mgr.smithi067.rdualw (mgr.24569) 767 : cluster [DBG] pgmap v664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:50:59.875833+0000 mgr.smithi067.rdualw (mgr.24569) 768 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:50:59.875833+0000 mgr.smithi067.rdualw (mgr.24569) 768 : cluster [DBG] pgmap v665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:01.876735+0000 mgr.smithi067.rdualw (mgr.24569) 769 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:01.876735+0000 mgr.smithi067.rdualw (mgr.24569) 769 : cluster [DBG] pgmap v666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:03.877493+0000 mgr.smithi067.rdualw (mgr.24569) 770 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:03.877493+0000 mgr.smithi067.rdualw (mgr.24569) 770 : cluster [DBG] pgmap v667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:05.878323+0000 mgr.smithi067.rdualw (mgr.24569) 771 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:51:07.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:05.878323+0000 mgr.smithi067.rdualw (mgr.24569) 771 : cluster [DBG] pgmap v668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:51:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:07.878848+0000 mgr.smithi067.rdualw (mgr.24569) 772 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:07.878848+0000 mgr.smithi067.rdualw (mgr.24569) 772 : cluster [DBG] pgmap v669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:09.879611+0000 mgr.smithi067.rdualw (mgr.24569) 773 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:09.879611+0000 mgr.smithi067.rdualw (mgr.24569) 773 : cluster [DBG] pgmap v670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:11.880423+0000 mgr.smithi067.rdualw (mgr.24569) 774 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:11.880423+0000 mgr.smithi067.rdualw (mgr.24569) 774 : cluster [DBG] pgmap v671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:13.881159+0000 mgr.smithi067.rdualw (mgr.24569) 775 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:13.881159+0000 mgr.smithi067.rdualw (mgr.24569) 775 : cluster [DBG] pgmap v672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:15.578 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:51:15.873 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:51:15.874 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (28m) 43s ago 29m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:51:15.874 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (21m) 43s ago 29m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:51:15.874 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (21m) 46s ago 29m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:51:15.874 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (28m) 43s ago 29m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:51:15.875 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (21m) 43s ago 25m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:51:15.875 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (21m) 46s ago 25m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:51:15.875 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (22m) 43s ago 31m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:51:15.875 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (22m) 46s ago 29m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:51:15.875 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (22m) 43s ago 31m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:51:15.876 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (22m) 46s ago 29m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:51:15.876 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (23m) 43s ago 23m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:51:15.876 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (23m) 46s ago 23m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:51:15.876 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (29m) 43s ago 29m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:51:15.877 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (29m) 46s ago 29m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:51:15.877 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (12m) 43s ago 28m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:51:15.877 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (28m) 43s ago 28m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:51:15.877 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (28m) 43s ago 28m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:51:15.877 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (27m) 43s ago 27m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:51:15.878 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (27m) 46s ago 27m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:51:15.878 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (27m) 46s ago 27m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:51:15.879 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (27m) 46s ago 27m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:51:15.879 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (26m) 46s ago 26m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:51:15.879 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (28m) 43s ago 29m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:51:16.273 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:51:16.274 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:51:16.274 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:51:16.274 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:51:16.274 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:51:16.275 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:51:16.275 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:51:16.275 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:51:16.275 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:51:16.275 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:51:16.276 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:51:16.276 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:51:16.276 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:51:16.276 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:51:16.277 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:51:16.277 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:51:16.277 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:51:16.278 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:51:16.278 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:51:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:51:15.564985+0000 mgr.smithi067.rdualw (mgr.24569) 776 : audit [DBG] from='client.34654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:51:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:51:15.855046+0000 mgr.smithi067.rdualw (mgr.24569) 777 : audit [DBG] from='client.34658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:51:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:15.882012+0000 mgr.smithi067.rdualw (mgr.24569) 778 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:51:17.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:51:16.271665+0000 mon.smithi061 (mon.0) 360 : audit [DBG] from='client.? 172.21.15.61:0/3518478639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:51:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:51:15.564985+0000 mgr.smithi067.rdualw (mgr.24569) 776 : audit [DBG] from='client.34654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:51:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:51:15.855046+0000 mgr.smithi067.rdualw (mgr.24569) 777 : audit [DBG] from='client.34658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:51:17.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:15.882012+0000 mgr.smithi067.rdualw (mgr.24569) 778 : cluster [DBG] pgmap v673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:51:17.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:51:16.271665+0000 mon.smithi061 (mon.0) 360 : audit [DBG] from='client.? 172.21.15.61:0/3518478639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:51:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:17.882508+0000 mgr.smithi067.rdualw (mgr.24569) 779 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:17.882508+0000 mgr.smithi067.rdualw (mgr.24569) 779 : cluster [DBG] pgmap v674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:19.883311+0000 mgr.smithi067.rdualw (mgr.24569) 780 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:19.883311+0000 mgr.smithi067.rdualw (mgr.24569) 780 : cluster [DBG] pgmap v675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:21.884173+0000 mgr.smithi067.rdualw (mgr.24569) 781 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:21.884173+0000 mgr.smithi067.rdualw (mgr.24569) 781 : cluster [DBG] pgmap v676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:23.884776+0000 mgr.smithi067.rdualw (mgr.24569) 782 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:23.884776+0000 mgr.smithi067.rdualw (mgr.24569) 782 : cluster [DBG] pgmap v677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:25.885629+0000 mgr.smithi067.rdualw (mgr.24569) 783 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:51:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:25.885629+0000 mgr.smithi067.rdualw (mgr.24569) 783 : cluster [DBG] pgmap v678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:51:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:27.886131+0000 mgr.smithi067.rdualw (mgr.24569) 784 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:27.886131+0000 mgr.smithi067.rdualw (mgr.24569) 784 : cluster [DBG] pgmap v679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:29.886874+0000 mgr.smithi067.rdualw (mgr.24569) 785 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:29.886874+0000 mgr.smithi067.rdualw (mgr.24569) 785 : cluster [DBG] pgmap v680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:31.887787+0000 mgr.smithi067.rdualw (mgr.24569) 786 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:51:32.624818+0000 mon.smithi067 (mon.1) 160 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:51:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:51:32.626247+0000 mon.smithi067 (mon.1) 161 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:51:33.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:51:32.627193+0000 mon.smithi067 (mon.1) 162 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:51:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:31.887787+0000 mgr.smithi067.rdualw (mgr.24569) 786 : cluster [DBG] pgmap v681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:51:32.624818+0000 mon.smithi067 (mon.1) 160 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:51:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:51:32.626247+0000 mon.smithi067 (mon.1) 161 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:51:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:51:32.627193+0000 mon.smithi067 (mon.1) 162 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:51:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:51:32.628059+0000 mgr.smithi067.rdualw (mgr.24569) 787 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:51:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:51:33.046736+0000 mon.smithi061 (mon.0) 361 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:51:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:51:33.052437+0000 mon.smithi061 (mon.0) 362 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:51:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:51:32.628059+0000 mgr.smithi067.rdualw (mgr.24569) 787 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:51:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:51:33.046736+0000 mon.smithi061 (mon.0) 361 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:51:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:51:33.052437+0000 mon.smithi061 (mon.0) 362 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:51:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:33.888516+0000 mgr.smithi067.rdualw (mgr.24569) 788 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:51:34.546169+0000 mon.smithi067 (mon.1) 163 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:51:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:51:34.546428+0000 mon.smithi067 (mon.1) 164 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:51:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:51:34.546715+0000 mon.smithi061 (mon.0) 363 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:51:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:51:34.547012+0000 mon.smithi061 (mon.0) 364 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:51:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:33.888516+0000 mgr.smithi067.rdualw (mgr.24569) 788 : cluster [DBG] pgmap v682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:51:34.546169+0000 mon.smithi067 (mon.1) 163 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:51:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:51:34.546428+0000 mon.smithi067 (mon.1) 164 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:51:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:51:34.546715+0000 mon.smithi061 (mon.0) 363 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:51:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:51:34.547012+0000 mon.smithi061 (mon.0) 364 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:51:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:35.889287+0000 mgr.smithi067.rdualw (mgr.24569) 789 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:51:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:35.889287+0000 mgr.smithi067.rdualw (mgr.24569) 789 : cluster [DBG] pgmap v683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:51:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:37.889875+0000 mgr.smithi067.rdualw (mgr.24569) 790 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:37.889875+0000 mgr.smithi067.rdualw (mgr.24569) 790 : cluster [DBG] pgmap v684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:39.890711+0000 mgr.smithi067.rdualw (mgr.24569) 791 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:39.890711+0000 mgr.smithi067.rdualw (mgr.24569) 791 : cluster [DBG] pgmap v685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:41.891728+0000 mgr.smithi067.rdualw (mgr.24569) 792 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:41.891728+0000 mgr.smithi067.rdualw (mgr.24569) 792 : cluster [DBG] pgmap v686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:43.892278+0000 mgr.smithi067.rdualw (mgr.24569) 793 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:43.892278+0000 mgr.smithi067.rdualw (mgr.24569) 793 : cluster [DBG] pgmap v687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:46.580 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:51:46.959 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:51:46.960 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (29m) 74s ago 30m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:51:46.960 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (22m) 74s ago 30m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:51:46.960 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (21m) 77s ago 29m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:51:46.960 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (29m) 74s ago 30m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:51:46.961 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (22m) 74s ago 26m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:51:46.961 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (22m) 77s ago 26m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:51:46.961 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (23m) 74s ago 31m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:51:46.961 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (23m) 77s ago 29m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:51:46.961 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (22m) 74s ago 31m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:51:46.962 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (22m) 77s ago 29m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:51:46.962 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (23m) 74s ago 23m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:51:46.962 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (23m) 77s ago 23m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:51:46.962 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (30m) 74s ago 30m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:51:46.963 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (29m) 77s ago 29m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:51:46.963 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (12m) 74s ago 29m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:51:46.963 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (28m) 74s ago 28m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:51:46.963 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (28m) 74s ago 28m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:51:46.963 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (28m) 74s ago 28m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:51:46.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (28m) 77s ago 28m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:51:46.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (27m) 77s ago 27m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:51:46.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (27m) 77s ago 27m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:51:46.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (27m) 77s ago 27m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:51:46.965 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (29m) 74s ago 30m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:51:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:45.893215+0000 mgr.smithi067.rdualw (mgr.24569) 794 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:51:47.303 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:51:47.303 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:51:47.303 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:51:47.303 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:51:47.304 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:51:47.304 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:51:47.304 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:51:47.304 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:51:47.305 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:51:47.305 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:51:47.306 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:51:47.306 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:51:47.306 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:51:47.306 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:51:47.307 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:51:47.307 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:51:47.307 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:51:47.308 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:51:47.308 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:51:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:45.893215+0000 mgr.smithi067.rdualw (mgr.24569) 794 : cluster [DBG] pgmap v688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:51:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:51:46.566378+0000 mgr.smithi067.rdualw (mgr.24569) 795 : audit [DBG] from='client.34666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:51:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:51:46.941366+0000 mgr.smithi067.rdualw (mgr.24569) 796 : audit [DBG] from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:51:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:51:47.301234+0000 mon.smithi061 (mon.0) 365 : audit [DBG] from='client.? 172.21.15.61:0/1481941824' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:51:48.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:51:46.566378+0000 mgr.smithi067.rdualw (mgr.24569) 795 : audit [DBG] from='client.34666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:51:48.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:51:46.941366+0000 mgr.smithi067.rdualw (mgr.24569) 796 : audit [DBG] from='client.34670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:51:48.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:51:47.301234+0000 mon.smithi061 (mon.0) 365 : audit [DBG] from='client.? 172.21.15.61:0/1481941824' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:51:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:47.893740+0000 mgr.smithi067.rdualw (mgr.24569) 797 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:47.893740+0000 mgr.smithi067.rdualw (mgr.24569) 797 : cluster [DBG] pgmap v689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:49.894310+0000 mgr.smithi067.rdualw (mgr.24569) 798 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:49.894310+0000 mgr.smithi067.rdualw (mgr.24569) 798 : cluster [DBG] pgmap v690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:51.895239+0000 mgr.smithi067.rdualw (mgr.24569) 799 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:51.895239+0000 mgr.smithi067.rdualw (mgr.24569) 799 : cluster [DBG] pgmap v691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:53.895792+0000 mgr.smithi067.rdualw (mgr.24569) 800 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:53.895792+0000 mgr.smithi067.rdualw (mgr.24569) 800 : cluster [DBG] pgmap v692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:57.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:55.896813+0000 mgr.smithi067.rdualw (mgr.24569) 801 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:51:57.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:55.896813+0000 mgr.smithi067.rdualw (mgr.24569) 801 : cluster [DBG] pgmap v693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:51:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:51:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:57.897412+0000 mgr.smithi067.rdualw (mgr.24569) 802 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:51:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:51:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:57.897412+0000 mgr.smithi067.rdualw (mgr.24569) 802 : cluster [DBG] pgmap v694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:51:59.898024+0000 mgr.smithi067.rdualw (mgr.24569) 803 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:51:59.898024+0000 mgr.smithi067.rdualw (mgr.24569) 803 : cluster [DBG] pgmap v695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:01.899053+0000 mgr.smithi067.rdualw (mgr.24569) 804 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:01.899053+0000 mgr.smithi067.rdualw (mgr.24569) 804 : cluster [DBG] pgmap v696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:03.899824+0000 mgr.smithi067.rdualw (mgr.24569) 805 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:03.899824+0000 mgr.smithi067.rdualw (mgr.24569) 805 : cluster [DBG] pgmap v697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:05.900908+0000 mgr.smithi067.rdualw (mgr.24569) 806 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:52:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:05.900908+0000 mgr.smithi067.rdualw (mgr.24569) 806 : cluster [DBG] pgmap v698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:52:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:07.901503+0000 mgr.smithi067.rdualw (mgr.24569) 807 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:07.901503+0000 mgr.smithi067.rdualw (mgr.24569) 807 : cluster [DBG] pgmap v699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:09.902148+0000 mgr.smithi067.rdualw (mgr.24569) 808 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:09.902148+0000 mgr.smithi067.rdualw (mgr.24569) 808 : cluster [DBG] pgmap v700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:11.903065+0000 mgr.smithi067.rdualw (mgr.24569) 809 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:11.903065+0000 mgr.smithi067.rdualw (mgr.24569) 809 : cluster [DBG] pgmap v701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:13.903670+0000 mgr.smithi067.rdualw (mgr.24569) 810 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:13.903670+0000 mgr.smithi067.rdualw (mgr.24569) 810 : cluster [DBG] pgmap v702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:15.904477+0000 mgr.smithi067.rdualw (mgr.24569) 811 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:52:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:15.904477+0000 mgr.smithi067.rdualw (mgr.24569) 811 : cluster [DBG] pgmap v703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:52:17.608 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:52:17.927 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:52:17.927 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (29m) 105s ago 30m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:52:17.927 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (22m) 105s ago 30m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:52:17.928 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (22m) 108s ago 30m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:52:17.928 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (29m) 105s ago 30m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:52:17.928 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (23m) 105s ago 26m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:52:17.928 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (22m) 108s ago 26m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:52:17.928 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (23m) 105s ago 32m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:52:17.929 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (23m) 108s ago 30m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:52:17.929 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (23m) 105s ago 32m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:52:17.929 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (23m) 108s ago 30m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:52:17.929 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (24m) 105s ago 24m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:52:17.930 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (24m) 108s ago 24m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:52:17.930 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (30m) 105s ago 30m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:52:17.930 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (30m) 108s ago 30m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:52:17.930 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (13m) 105s ago 29m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:52:17.930 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (29m) 105s ago 29m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:52:17.931 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (29m) 105s ago 29m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:52:17.931 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (28m) 105s ago 28m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:52:17.931 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (28m) 108s ago 28m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:52:17.931 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (28m) 108s ago 28m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:52:17.932 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (28m) 108s ago 28m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:52:17.932 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (27m) 108s ago 27m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:52:17.932 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (29m) 105s ago 30m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:52:18.293 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:52:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:52:18.294 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:52:18.294 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:52:18.294 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:52:18.294 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:52:18.295 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:52:18.295 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:52:18.295 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:52:18.295 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:52:18.295 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:52:18.296 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:52:18.296 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:52:18.296 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:52:18.296 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:52:18.297 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:52:18.297 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:52:18.297 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:52:18.297 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:52:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:52:17.595022+0000 mgr.smithi067.rdualw (mgr.24569) 812 : audit [DBG] from='client.34678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:52:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:17.905021+0000 mgr.smithi067.rdualw (mgr.24569) 813 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:52:17.909045+0000 mgr.smithi067.rdualw (mgr.24569) 814 : audit [DBG] from='client.34682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:52:19.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:52:18.291526+0000 mon.smithi061 (mon.0) 366 : audit [DBG] from='client.? 172.21.15.61:0/358393463' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:52:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:52:17.595022+0000 mgr.smithi067.rdualw (mgr.24569) 812 : audit [DBG] from='client.34678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:52:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:17.905021+0000 mgr.smithi067.rdualw (mgr.24569) 813 : cluster [DBG] pgmap v704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:52:17.909045+0000 mgr.smithi067.rdualw (mgr.24569) 814 : audit [DBG] from='client.34682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:52:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:52:18.291526+0000 mon.smithi061 (mon.0) 366 : audit [DBG] from='client.? 172.21.15.61:0/358393463' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:52:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:19.905703+0000 mgr.smithi067.rdualw (mgr.24569) 815 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:19.905703+0000 mgr.smithi067.rdualw (mgr.24569) 815 : cluster [DBG] pgmap v705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:21.906520+0000 mgr.smithi067.rdualw (mgr.24569) 816 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:21.906520+0000 mgr.smithi067.rdualw (mgr.24569) 816 : cluster [DBG] pgmap v706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:23.907303+0000 mgr.smithi067.rdualw (mgr.24569) 817 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:23.907303+0000 mgr.smithi067.rdualw (mgr.24569) 817 : cluster [DBG] pgmap v707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:25.908191+0000 mgr.smithi067.rdualw (mgr.24569) 818 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:52:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:25.908191+0000 mgr.smithi067.rdualw (mgr.24569) 818 : cluster [DBG] pgmap v708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:52:29.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:27.908856+0000 mgr.smithi067.rdualw (mgr.24569) 819 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:27.908856+0000 mgr.smithi067.rdualw (mgr.24569) 819 : cluster [DBG] pgmap v709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:29.909634+0000 mgr.smithi067.rdualw (mgr.24569) 820 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:29.909634+0000 mgr.smithi067.rdualw (mgr.24569) 820 : cluster [DBG] pgmap v710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:31.910516+0000 mgr.smithi067.rdualw (mgr.24569) 821 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:31.910516+0000 mgr.smithi067.rdualw (mgr.24569) 821 : cluster [DBG] pgmap v711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:52:33.055632+0000 mon.smithi067 (mon.1) 165 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:52:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:52:33.057057+0000 mon.smithi067 (mon.1) 166 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:52:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:52:33.058013+0000 mon.smithi067 (mon.1) 167 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:52:34.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:52:33.414716+0000 mon.smithi061 (mon.0) 367 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:52:34.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:52:33.419869+0000 mon.smithi061 (mon.0) 368 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:52:34.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:52:33.823660+0000 mon.smithi061 (mon.0) 369 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:52:34.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:52:33.832025+0000 mon.smithi061 (mon.0) 370 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:52:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:52:33.055632+0000 mon.smithi067 (mon.1) 165 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:52:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:52:33.057057+0000 mon.smithi067 (mon.1) 166 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:52:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:52:33.058013+0000 mon.smithi067 (mon.1) 167 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:52:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:52:33.414716+0000 mon.smithi061 (mon.0) 367 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:52:34.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:52:33.419869+0000 mon.smithi061 (mon.0) 368 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:52:34.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:52:33.823660+0000 mon.smithi061 (mon.0) 369 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:52:34.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:52:33.832025+0000 mon.smithi061 (mon.0) 370 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:52:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:52:33.058863+0000 mgr.smithi067.rdualw (mgr.24569) 822 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:52:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:33.910999+0000 mgr.smithi067.rdualw (mgr.24569) 823 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:52:34.550817+0000 mon.smithi067 (mon.1) 168 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:52:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:52:34.551032+0000 mon.smithi067 (mon.1) 169 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:52:35.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:52:34.551194+0000 mon.smithi061 (mon.0) 371 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:52:35.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:52:34.551658+0000 mon.smithi061 (mon.0) 372 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:52:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:52:33.058863+0000 mgr.smithi067.rdualw (mgr.24569) 822 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:52:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:33.910999+0000 mgr.smithi067.rdualw (mgr.24569) 823 : cluster [DBG] pgmap v712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:52:34.550817+0000 mon.smithi067 (mon.1) 168 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:52:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:52:34.551032+0000 mon.smithi067 (mon.1) 169 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:52:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:52:34.551194+0000 mon.smithi061 (mon.0) 371 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:52:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:52:34.551658+0000 mon.smithi061 (mon.0) 372 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:52:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:35.911821+0000 mgr.smithi067.rdualw (mgr.24569) 824 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:52:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:35.911821+0000 mgr.smithi067.rdualw (mgr.24569) 824 : cluster [DBG] pgmap v713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:52:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:37.912421+0000 mgr.smithi067.rdualw (mgr.24569) 825 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:37.912421+0000 mgr.smithi067.rdualw (mgr.24569) 825 : cluster [DBG] pgmap v714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:39.913248+0000 mgr.smithi067.rdualw (mgr.24569) 826 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:39.913248+0000 mgr.smithi067.rdualw (mgr.24569) 826 : cluster [DBG] pgmap v715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:41.914087+0000 mgr.smithi067.rdualw (mgr.24569) 827 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:41.914087+0000 mgr.smithi067.rdualw (mgr.24569) 827 : cluster [DBG] pgmap v716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:43.914674+0000 mgr.smithi067.rdualw (mgr.24569) 828 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:43.914674+0000 mgr.smithi067.rdualw (mgr.24569) 828 : cluster [DBG] pgmap v717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:45.915468+0000 mgr.smithi067.rdualw (mgr.24569) 829 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:52:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:45.915468+0000 mgr.smithi067.rdualw (mgr.24569) 829 : cluster [DBG] pgmap v718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:52:48.636 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:52:48.928 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:52:48.928 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (30m) 2m ago 31m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:52:48.928 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (23m) 2m ago 31m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:52:48.928 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (22m) 2m ago 30m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:52:48.929 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (30m) 2m ago 31m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:52:48.929 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (23m) 2m ago 27m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:52:48.929 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (23m) 2m ago 27m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:52:48.929 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (24m) 2m ago 32m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:52:48.930 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (24m) 2m ago 30m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:52:48.930 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (24m) 2m ago 32m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:52:48.930 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (23m) 2m ago 30m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:52:48.930 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (24m) 2m ago 24m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:52:48.931 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (24m) 2m ago 24m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:52:48.931 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (31m) 2m ago 31m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:52:48.931 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (30m) 2m ago 30m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:52:48.931 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (13m) 2m ago 30m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:52:48.931 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (30m) 2m ago 29m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:52:48.932 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (29m) 2m ago 29m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:52:48.932 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (29m) 2m ago 29m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:52:48.932 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (29m) 2m ago 29m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:52:48.932 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (28m) 2m ago 28m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:52:48.933 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (28m) 2m ago 28m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:52:48.933 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (28m) 2m ago 28m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:52:48.933 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (30m) 2m ago 31m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:52:49.271 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:52:49.272 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:52:49.272 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:52:49.272 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:52:49.272 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:52:49.273 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:52:49.273 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:52:49.273 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:52:49.273 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:52:49.273 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:52:49.274 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:52:49.274 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:52:49.274 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:52:49.274 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:52:49.275 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:52:49.275 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:52:49.275 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:52:49.275 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:52:49.276 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:52:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:47.916054+0000 mgr.smithi067.rdualw (mgr.24569) 830 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:47.916054+0000 mgr.smithi067.rdualw (mgr.24569) 830 : cluster [DBG] pgmap v719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:52:48.619278+0000 mgr.smithi067.rdualw (mgr.24569) 831 : audit [DBG] from='client.34690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:52:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:52:48.910171+0000 mgr.smithi067.rdualw (mgr.24569) 832 : audit [DBG] from='client.34694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:52:50.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:52:49.269840+0000 mon.smithi061 (mon.0) 373 : audit [DBG] from='client.? 172.21.15.61:0/2560449363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:52:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:52:48.619278+0000 mgr.smithi067.rdualw (mgr.24569) 831 : audit [DBG] from='client.34690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:52:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:52:48.910171+0000 mgr.smithi067.rdualw (mgr.24569) 832 : audit [DBG] from='client.34694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:52:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:52:49.269840+0000 mon.smithi061 (mon.0) 373 : audit [DBG] from='client.? 172.21.15.61:0/2560449363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:52:51.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:49.916764+0000 mgr.smithi067.rdualw (mgr.24569) 833 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:49.916764+0000 mgr.smithi067.rdualw (mgr.24569) 833 : cluster [DBG] pgmap v720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:51.917605+0000 mgr.smithi067.rdualw (mgr.24569) 834 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:51.917605+0000 mgr.smithi067.rdualw (mgr.24569) 834 : cluster [DBG] pgmap v721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:53.918320+0000 mgr.smithi067.rdualw (mgr.24569) 835 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:53.918320+0000 mgr.smithi067.rdualw (mgr.24569) 835 : cluster [DBG] pgmap v722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:55.919044+0000 mgr.smithi067.rdualw (mgr.24569) 836 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:52:57.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:55.919044+0000 mgr.smithi067.rdualw (mgr.24569) 836 : cluster [DBG] pgmap v723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:52:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:52:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:57.919525+0000 mgr.smithi067.rdualw (mgr.24569) 837 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:52:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:52:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:57.919525+0000 mgr.smithi067.rdualw (mgr.24569) 837 : cluster [DBG] pgmap v724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:52:59.920168+0000 mgr.smithi067.rdualw (mgr.24569) 838 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:52:59.920168+0000 mgr.smithi067.rdualw (mgr.24569) 838 : cluster [DBG] pgmap v725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:01.921132+0000 mgr.smithi067.rdualw (mgr.24569) 839 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:01.921132+0000 mgr.smithi067.rdualw (mgr.24569) 839 : cluster [DBG] pgmap v726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:03.921894+0000 mgr.smithi067.rdualw (mgr.24569) 840 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:03.921894+0000 mgr.smithi067.rdualw (mgr.24569) 840 : cluster [DBG] pgmap v727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:05.922832+0000 mgr.smithi067.rdualw (mgr.24569) 841 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:53:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:05.922832+0000 mgr.smithi067.rdualw (mgr.24569) 841 : cluster [DBG] pgmap v728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:53:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:07.923504+0000 mgr.smithi067.rdualw (mgr.24569) 842 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:07.923504+0000 mgr.smithi067.rdualw (mgr.24569) 842 : cluster [DBG] pgmap v729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:09.924080+0000 mgr.smithi067.rdualw (mgr.24569) 843 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:09.924080+0000 mgr.smithi067.rdualw (mgr.24569) 843 : cluster [DBG] pgmap v730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:11.925092+0000 mgr.smithi067.rdualw (mgr.24569) 844 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:11.925092+0000 mgr.smithi067.rdualw (mgr.24569) 844 : cluster [DBG] pgmap v731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:13.925831+0000 mgr.smithi067.rdualw (mgr.24569) 845 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:13.925831+0000 mgr.smithi067.rdualw (mgr.24569) 845 : cluster [DBG] pgmap v732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:15.926857+0000 mgr.smithi067.rdualw (mgr.24569) 846 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:53:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:15.926857+0000 mgr.smithi067.rdualw (mgr.24569) 846 : cluster [DBG] pgmap v733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:53:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:17.927429+0000 mgr.smithi067.rdualw (mgr.24569) 847 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:17.927429+0000 mgr.smithi067.rdualw (mgr.24569) 847 : cluster [DBG] pgmap v734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:19.582 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:53:19.872 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:53:19.873 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (30m) 2m ago 31m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:53:19.873 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (23m) 2m ago 31m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:53:19.873 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (23m) 2m ago 31m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:53:19.873 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (30m) 2m ago 31m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:53:19.874 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (24m) 2m ago 27m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:53:19.874 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (23m) 2m ago 27m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:53:19.874 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (25m) 2m ago 33m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:53:19.874 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (24m) 2m ago 31m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:53:19.875 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (24m) 2m ago 33m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:53:19.875 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (24m) 2m ago 31m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:53:19.875 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (25m) 2m ago 25m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:53:19.875 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (25m) 2m ago 25m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:53:19.875 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (31m) 2m ago 31m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:53:19.876 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (31m) 2m ago 31m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:53:19.876 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (14m) 2m ago 30m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:53:19.876 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (30m) 2m ago 30m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:53:19.876 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (30m) 2m ago 30m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:53:19.877 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (29m) 2m ago 29m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:53:19.877 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (29m) 2m ago 29m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:53:19.877 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (29m) 2m ago 29m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:53:19.877 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (29m) 2m ago 29m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:53:19.877 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (28m) 2m ago 28m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:53:19.878 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (30m) 2m ago 31m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:53:20.217 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:53:20.218 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:53:20.219 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:53:20.220 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:53:20.220 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:53:20.220 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:53:20.220 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:53:20.221 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:53:20.221 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:53:20.221 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:53:20.221 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:53:20.221 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:53:20.222 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:53:20.222 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:53:20.222 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:53:20.222 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:53:20.223 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:53:20.223 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:53:20.223 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:53:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:53:19.569145+0000 mgr.smithi067.rdualw (mgr.24569) 848 : audit [DBG] from='client.34702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:53:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:53:19.854382+0000 mgr.smithi067.rdualw (mgr.24569) 849 : audit [DBG] from='client.34706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:53:20.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:19.927991+0000 mgr.smithi067.rdualw (mgr.24569) 850 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:20.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:53:20.215861+0000 mon.smithi061 (mon.0) 374 : audit [DBG] from='client.? 172.21.15.61:0/2281607473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:53:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:53:19.569145+0000 mgr.smithi067.rdualw (mgr.24569) 848 : audit [DBG] from='client.34702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:53:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:53:19.854382+0000 mgr.smithi067.rdualw (mgr.24569) 849 : audit [DBG] from='client.34706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:53:20.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:19.927991+0000 mgr.smithi067.rdualw (mgr.24569) 850 : cluster [DBG] pgmap v735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:20.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:53:20.215861+0000 mon.smithi061 (mon.0) 374 : audit [DBG] from='client.? 172.21.15.61:0/2281607473' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:53:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:21.928834+0000 mgr.smithi067.rdualw (mgr.24569) 851 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:21.928834+0000 mgr.smithi067.rdualw (mgr.24569) 851 : cluster [DBG] pgmap v736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:23.929603+0000 mgr.smithi067.rdualw (mgr.24569) 852 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:23.929603+0000 mgr.smithi067.rdualw (mgr.24569) 852 : cluster [DBG] pgmap v737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:25.930395+0000 mgr.smithi067.rdualw (mgr.24569) 853 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:53:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:25.930395+0000 mgr.smithi067.rdualw (mgr.24569) 853 : cluster [DBG] pgmap v738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:53:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:27.930930+0000 mgr.smithi067.rdualw (mgr.24569) 854 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:27.930930+0000 mgr.smithi067.rdualw (mgr.24569) 854 : cluster [DBG] pgmap v739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:29.931750+0000 mgr.smithi067.rdualw (mgr.24569) 855 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:29.931750+0000 mgr.smithi067.rdualw (mgr.24569) 855 : cluster [DBG] pgmap v740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:31.932811+0000 mgr.smithi067.rdualw (mgr.24569) 856 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:31.932811+0000 mgr.smithi067.rdualw (mgr.24569) 856 : cluster [DBG] pgmap v741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:53:33.835280+0000 mon.smithi067 (mon.1) 170 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:53:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:53:33.836704+0000 mon.smithi067 (mon.1) 171 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:53:34.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:53:33.837636+0000 mon.smithi067 (mon.1) 172 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:53:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:53:33.835280+0000 mon.smithi067 (mon.1) 170 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:53:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:53:33.836704+0000 mon.smithi067 (mon.1) 171 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:53:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:53:33.837636+0000 mon.smithi067 (mon.1) 172 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:53:35.258 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:53:33.838499+0000 mgr.smithi067.rdualw (mgr.24569) 857 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:53:35.259 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:33.933334+0000 mgr.smithi067.rdualw (mgr.24569) 858 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:35.259 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:53:34.554878+0000 mon.smithi067 (mon.1) 173 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:53:35.259 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:53:34.555205+0000 mon.smithi061 (mon.0) 375 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:53:35.259 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:53:34.555521+0000 mon.smithi067 (mon.1) 174 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:53:35.260 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:53:34.555696+0000 mon.smithi061 (mon.0) 376 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:53:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:53:33.838499+0000 mgr.smithi067.rdualw (mgr.24569) 857 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:53:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:33.933334+0000 mgr.smithi067.rdualw (mgr.24569) 858 : cluster [DBG] pgmap v742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:53:34.554878+0000 mon.smithi067 (mon.1) 173 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:53:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:53:34.555205+0000 mon.smithi061 (mon.0) 375 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:53:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:53:34.555521+0000 mon.smithi067 (mon.1) 174 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:53:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:53:34.555696+0000 mon.smithi061 (mon.0) 376 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:53:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:35.934319+0000 mgr.smithi067.rdualw (mgr.24569) 859 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:53:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:35.934319+0000 mgr.smithi067.rdualw (mgr.24569) 859 : cluster [DBG] pgmap v743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:53:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:53:37.258029+0000 mon.smithi061 (mon.0) 377 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:53:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:53:37.657790+0000 mon.smithi061 (mon.0) 378 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:53:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:53:37.667104+0000 mon.smithi061 (mon.0) 379 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:53:38.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:37.934868+0000 mgr.smithi067.rdualw (mgr.24569) 860 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:53:37.258029+0000 mon.smithi061 (mon.0) 377 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:53:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:53:37.657790+0000 mon.smithi061 (mon.0) 378 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:53:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:53:37.667104+0000 mon.smithi061 (mon.0) 379 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:53:38.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:37.934868+0000 mgr.smithi067.rdualw (mgr.24569) 860 : cluster [DBG] pgmap v744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:39.935446+0000 mgr.smithi067.rdualw (mgr.24569) 861 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:39.935446+0000 mgr.smithi067.rdualw (mgr.24569) 861 : cluster [DBG] pgmap v745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:41.936475+0000 mgr.smithi067.rdualw (mgr.24569) 862 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:41.936475+0000 mgr.smithi067.rdualw (mgr.24569) 862 : cluster [DBG] pgmap v746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:43.937269+0000 mgr.smithi067.rdualw (mgr.24569) 863 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:43.937269+0000 mgr.smithi067.rdualw (mgr.24569) 863 : cluster [DBG] pgmap v747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:45.938213+0000 mgr.smithi067.rdualw (mgr.24569) 864 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:53:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:45.938213+0000 mgr.smithi067.rdualw (mgr.24569) 864 : cluster [DBG] pgmap v748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:53:49.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:47.938889+0000 mgr.smithi067.rdualw (mgr.24569) 865 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:47.938889+0000 mgr.smithi067.rdualw (mgr.24569) 865 : cluster [DBG] pgmap v749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:50.526 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:53:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:49.939545+0000 mgr.smithi067.rdualw (mgr.24569) 866 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:49.939545+0000 mgr.smithi067.rdualw (mgr.24569) 866 : cluster [DBG] pgmap v750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:50.818 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:53:50.819 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (31m) 3m ago 32m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:53:50.819 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (24m) 3m ago 32m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:53:50.819 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (23m) 3m ago 31m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:53:50.819 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (31m) 3m ago 32m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:53:50.820 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (24m) 3m ago 28m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:53:50.820 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (24m) 3m ago 28m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:53:50.820 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (25m) 3m ago 33m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:53:50.820 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (25m) 3m ago 31m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:53:50.821 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (25m) 3m ago 33m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:53:50.821 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (24m) 3m ago 31m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:53:50.821 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (25m) 3m ago 25m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:53:50.821 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (25m) 3m ago 25m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:53:50.822 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (32m) 3m ago 32m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:53:50.822 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (31m) 3m ago 31m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:53:50.822 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (14m) 3m ago 31m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:53:50.822 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (31m) 3m ago 31m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:53:50.823 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (30m) 3m ago 30m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:53:50.823 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (30m) 3m ago 30m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:53:50.823 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (30m) 3m ago 30m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:53:50.823 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (29m) 3m ago 29m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:53:50.823 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (29m) 3m ago 29m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:53:50.824 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (29m) 3m ago 29m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:53:50.824 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (31m) 3m ago 32m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:53:51.156 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:53:51.157 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:53:51.157 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:53:51.157 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:53:51.158 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:53:51.158 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:53:51.158 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:53:51.158 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:53:51.159 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:53:51.159 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:53:51.159 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:53:51.159 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:53:51.159 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:53:51.160 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:53:51.160 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:53:51.160 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:53:51.160 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:53:51.160 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:53:51.161 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:53:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:53:50.512123+0000 mgr.smithi067.rdualw (mgr.24569) 867 : audit [DBG] from='client.34714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:53:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:53:50.800614+0000 mgr.smithi067.rdualw (mgr.24569) 868 : audit [DBG] from='client.34718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:53:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:53:51.154929+0000 mon.smithi061 (mon.0) 380 : audit [DBG] from='client.? 172.21.15.61:0/4201649575' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:53:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:53:50.512123+0000 mgr.smithi067.rdualw (mgr.24569) 867 : audit [DBG] from='client.34714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:53:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:53:50.800614+0000 mgr.smithi067.rdualw (mgr.24569) 868 : audit [DBG] from='client.34718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:53:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:53:51.154929+0000 mon.smithi061 (mon.0) 380 : audit [DBG] from='client.? 172.21.15.61:0/4201649575' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:53:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:51.940508+0000 mgr.smithi067.rdualw (mgr.24569) 869 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:51.940508+0000 mgr.smithi067.rdualw (mgr.24569) 869 : cluster [DBG] pgmap v751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:53.941228+0000 mgr.smithi067.rdualw (mgr.24569) 870 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:53.941228+0000 mgr.smithi067.rdualw (mgr.24569) 870 : cluster [DBG] pgmap v752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:55.942125+0000 mgr.smithi067.rdualw (mgr.24569) 871 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:53:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:55.942125+0000 mgr.smithi067.rdualw (mgr.24569) 871 : cluster [DBG] pgmap v753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:53:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:53:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:57.942888+0000 mgr.smithi067.rdualw (mgr.24569) 872 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:53:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:53:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:57.942888+0000 mgr.smithi067.rdualw (mgr.24569) 872 : cluster [DBG] pgmap v754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:53:59.943564+0000 mgr.smithi067.rdualw (mgr.24569) 873 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:53:59.943564+0000 mgr.smithi067.rdualw (mgr.24569) 873 : cluster [DBG] pgmap v755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:01.944432+0000 mgr.smithi067.rdualw (mgr.24569) 874 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:01.944432+0000 mgr.smithi067.rdualw (mgr.24569) 874 : cluster [DBG] pgmap v756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:03.945284+0000 mgr.smithi067.rdualw (mgr.24569) 875 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:03.945284+0000 mgr.smithi067.rdualw (mgr.24569) 875 : cluster [DBG] pgmap v757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:05.946263+0000 mgr.smithi067.rdualw (mgr.24569) 876 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:54:07.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:05.946263+0000 mgr.smithi067.rdualw (mgr.24569) 876 : cluster [DBG] pgmap v758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:54:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:07.946867+0000 mgr.smithi067.rdualw (mgr.24569) 877 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:07.946867+0000 mgr.smithi067.rdualw (mgr.24569) 877 : cluster [DBG] pgmap v759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:09.947565+0000 mgr.smithi067.rdualw (mgr.24569) 878 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:09.947565+0000 mgr.smithi067.rdualw (mgr.24569) 878 : cluster [DBG] pgmap v760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:11.948391+0000 mgr.smithi067.rdualw (mgr.24569) 879 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:11.948391+0000 mgr.smithi067.rdualw (mgr.24569) 879 : cluster [DBG] pgmap v761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:13.948980+0000 mgr.smithi067.rdualw (mgr.24569) 880 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:13.948980+0000 mgr.smithi067.rdualw (mgr.24569) 880 : cluster [DBG] pgmap v762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:15.949818+0000 mgr.smithi067.rdualw (mgr.24569) 881 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:54:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:15.949818+0000 mgr.smithi067.rdualw (mgr.24569) 881 : cluster [DBG] pgmap v763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:54:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:17.950341+0000 mgr.smithi067.rdualw (mgr.24569) 882 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:17.950341+0000 mgr.smithi067.rdualw (mgr.24569) 882 : cluster [DBG] pgmap v764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:19.950995+0000 mgr.smithi067.rdualw (mgr.24569) 883 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:19.950995+0000 mgr.smithi067.rdualw (mgr.24569) 883 : cluster [DBG] pgmap v765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:21.466 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:54:21.757 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:54:21.758 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (31m) 3m ago 32m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:54:21.758 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (24m) 3m ago 32m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:54:21.758 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (24m) 3m ago 32m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:54:21.759 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (31m) 3m ago 32m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:54:21.759 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (25m) 3m ago 28m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:54:21.759 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (24m) 3m ago 28m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:54:21.759 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (26m) 3m ago 34m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:54:21.760 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (25m) 3m ago 32m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:54:21.760 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (25m) 3m ago 34m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:54:21.760 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (25m) 3m ago 32m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:54:21.761 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (26m) 3m ago 26m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:54:21.761 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (26m) 3m ago 26m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:54:21.761 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (32m) 3m ago 32m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:54:21.762 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (32m) 3m ago 32m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:54:21.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (15m) 3m ago 31m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:54:21.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (31m) 3m ago 31m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:54:21.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (31m) 3m ago 31m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:54:21.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (30m) 3m ago 30m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:54:21.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (30m) 3m ago 30m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:54:21.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (30m) 3m ago 30m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:54:21.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (30m) 3m ago 30m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:54:21.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (30m) 3m ago 29m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:54:21.764 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (31m) 3m ago 32m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:54:22.102 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:54:22.103 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:54:22.103 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:54:22.103 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:54:22.103 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:54:22.104 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:54:22.104 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:54:22.104 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:54:22.104 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:54:22.104 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:54:22.105 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:54:22.105 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:54:22.105 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:54:22.105 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:54:22.106 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:54:22.106 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:54:22.106 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:54:22.106 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:54:22.106 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:54:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:54:21.452311+0000 mgr.smithi067.rdualw (mgr.24569) 884 : audit [DBG] from='client.34726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:54:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:54:21.739877+0000 mgr.smithi067.rdualw (mgr.24569) 885 : audit [DBG] from='client.34730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:54:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:21.951945+0000 mgr.smithi067.rdualw (mgr.24569) 886 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:23.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:54:22.100397+0000 mon.smithi061 (mon.0) 381 : audit [DBG] from='client.? 172.21.15.61:0/1472171140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:54:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:54:21.452311+0000 mgr.smithi067.rdualw (mgr.24569) 884 : audit [DBG] from='client.34726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:54:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:54:21.739877+0000 mgr.smithi067.rdualw (mgr.24569) 885 : audit [DBG] from='client.34730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:54:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:21.951945+0000 mgr.smithi067.rdualw (mgr.24569) 886 : cluster [DBG] pgmap v766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:54:22.100397+0000 mon.smithi061 (mon.0) 381 : audit [DBG] from='client.? 172.21.15.61:0/1472171140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:54:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:23.952565+0000 mgr.smithi067.rdualw (mgr.24569) 887 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:23.952565+0000 mgr.smithi067.rdualw (mgr.24569) 887 : cluster [DBG] pgmap v767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:25.953333+0000 mgr.smithi067.rdualw (mgr.24569) 888 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:54:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:25.953333+0000 mgr.smithi067.rdualw (mgr.24569) 888 : cluster [DBG] pgmap v768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:54:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:27.954063+0000 mgr.smithi067.rdualw (mgr.24569) 889 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:27.954063+0000 mgr.smithi067.rdualw (mgr.24569) 889 : cluster [DBG] pgmap v769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:29.954816+0000 mgr.smithi067.rdualw (mgr.24569) 890 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:29.954816+0000 mgr.smithi067.rdualw (mgr.24569) 890 : cluster [DBG] pgmap v770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:31.955671+0000 mgr.smithi067.rdualw (mgr.24569) 891 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:31.955671+0000 mgr.smithi067.rdualw (mgr.24569) 891 : cluster [DBG] pgmap v771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:33.956344+0000 mgr.smithi067.rdualw (mgr.24569) 892 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:54:34.560984+0000 mon.smithi067 (mon.1) 175 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:54:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:54:34.561249+0000 mon.smithi067 (mon.1) 176 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:54:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:54:34.561387+0000 mon.smithi061 (mon.0) 382 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:54:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:54:34.561877+0000 mon.smithi061 (mon.0) 383 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:54:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:33.956344+0000 mgr.smithi067.rdualw (mgr.24569) 892 : cluster [DBG] pgmap v772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:54:34.560984+0000 mon.smithi067 (mon.1) 175 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:54:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:54:34.561249+0000 mon.smithi067 (mon.1) 176 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:54:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:54:34.561387+0000 mon.smithi061 (mon.0) 382 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:54:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:54:34.561877+0000 mon.smithi061 (mon.0) 383 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:54:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:35.957205+0000 mgr.smithi067.rdualw (mgr.24569) 893 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:54:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:35.957205+0000 mgr.smithi067.rdualw (mgr.24569) 893 : cluster [DBG] pgmap v773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:54:38.282 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:54:37.671761+0000 mon.smithi067 (mon.1) 177 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:54:38.283 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:54:37.673176+0000 mon.smithi067 (mon.1) 178 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:54:38.283 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:54:37.674121+0000 mon.smithi067 (mon.1) 179 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:54:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:54:37.671761+0000 mon.smithi067 (mon.1) 177 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:54:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:54:37.673176+0000 mon.smithi067 (mon.1) 178 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:54:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:54:37.674121+0000 mon.smithi067 (mon.1) 179 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:54:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:54:37.675003+0000 mgr.smithi067.rdualw (mgr.24569) 894 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:54:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:37.957731+0000 mgr.smithi067.rdualw (mgr.24569) 895 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:54:37.675003+0000 mgr.smithi067.rdualw (mgr.24569) 894 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:54:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:37.957731+0000 mgr.smithi067.rdualw (mgr.24569) 895 : cluster [DBG] pgmap v774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:39.958212+0000 mgr.smithi067.rdualw (mgr.24569) 896 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:39.958212+0000 mgr.smithi067.rdualw (mgr.24569) 896 : cluster [DBG] pgmap v775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:42.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:54:40.593054+0000 mon.smithi061 (mon.0) 384 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:54:42.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:54:41.001019+0000 mon.smithi061 (mon.0) 385 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:54:42.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:54:41.009342+0000 mon.smithi061 (mon.0) 386 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:54:42.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:54:40.593054+0000 mon.smithi061 (mon.0) 384 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:54:42.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:54:41.001019+0000 mon.smithi061 (mon.0) 385 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:54:42.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:54:41.009342+0000 mon.smithi061 (mon.0) 386 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:54:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:41.959095+0000 mgr.smithi067.rdualw (mgr.24569) 897 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:41.959095+0000 mgr.smithi067.rdualw (mgr.24569) 897 : cluster [DBG] pgmap v776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:43.959853+0000 mgr.smithi067.rdualw (mgr.24569) 898 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:43.959853+0000 mgr.smithi067.rdualw (mgr.24569) 898 : cluster [DBG] pgmap v777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:45.960629+0000 mgr.smithi067.rdualw (mgr.24569) 899 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:54:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:45.960629+0000 mgr.smithi067.rdualw (mgr.24569) 899 : cluster [DBG] pgmap v778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:54:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:47.961274+0000 mgr.smithi067.rdualw (mgr.24569) 900 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:47.961274+0000 mgr.smithi067.rdualw (mgr.24569) 900 : cluster [DBG] pgmap v779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:49.961928+0000 mgr.smithi067.rdualw (mgr.24569) 901 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:49.961928+0000 mgr.smithi067.rdualw (mgr.24569) 901 : cluster [DBG] pgmap v780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:52.410 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:54:52.712 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:54:52.712 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (32m) 4m ago 33m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:54:52.713 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (25m) 4m ago 33m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:54:52.713 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (24m) 4m ago 33m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:54:52.713 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (32m) 4m ago 33m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:54:52.713 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (25m) 4m ago 29m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:54:52.714 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (25m) 4m ago 29m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:54:52.714 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (26m) 4m ago 34m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:54:52.714 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (26m) 4m ago 32m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:54:52.714 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (26m) 4m ago 34m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:54:52.715 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (25m) 4m ago 32m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:54:52.715 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (26m) 4m ago 26m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:54:52.715 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (26m) 4m ago 26m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:54:52.715 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (33m) 4m ago 33m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:54:52.715 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (32m) 4m ago 32m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:54:52.716 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (15m) 4m ago 32m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:54:52.716 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (32m) 4m ago 32m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:54:52.716 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (31m) 4m ago 31m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:54:52.716 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (31m) 4m ago 31m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:54:52.717 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (31m) 4m ago 31m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:54:52.717 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (31m) 4m ago 31m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:54:52.717 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (30m) 4m ago 30m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:54:52.717 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (30m) 4m ago 30m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:54:52.717 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (32m) 4m ago 33m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:54:53.054 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:54:53.055 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:54:53.055 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:54:53.055 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:54:53.055 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:54:53.056 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:54:53.056 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:54:53.056 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:54:53.056 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:54:53.056 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:54:53.057 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:54:53.057 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:54:53.057 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:54:53.058 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:54:53.058 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:54:53.058 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:54:53.058 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:54:53.059 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:54:53.059 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:54:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:51.962960+0000 mgr.smithi067.rdualw (mgr.24569) 902 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:51.962960+0000 mgr.smithi067.rdualw (mgr.24569) 902 : cluster [DBG] pgmap v781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:54:52.396769+0000 mgr.smithi067.rdualw (mgr.24569) 903 : audit [DBG] from='client.34738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:54:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:54:52.694378+0000 mgr.smithi067.rdualw (mgr.24569) 904 : audit [DBG] from='client.34742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:54:54.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:54:53.052735+0000 mon.smithi061 (mon.0) 387 : audit [DBG] from='client.? 172.21.15.61:0/4275069514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:54:54.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:54:52.396769+0000 mgr.smithi067.rdualw (mgr.24569) 903 : audit [DBG] from='client.34738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:54:54.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:54:52.694378+0000 mgr.smithi067.rdualw (mgr.24569) 904 : audit [DBG] from='client.34742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:54:54.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:54:53.052735+0000 mon.smithi061 (mon.0) 387 : audit [DBG] from='client.? 172.21.15.61:0/4275069514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:54:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:53.963645+0000 mgr.smithi067.rdualw (mgr.24569) 905 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:53.963645+0000 mgr.smithi067.rdualw (mgr.24569) 905 : cluster [DBG] pgmap v782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:57.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:55.964473+0000 mgr.smithi067.rdualw (mgr.24569) 906 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:54:57.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:55.964473+0000 mgr.smithi067.rdualw (mgr.24569) 906 : cluster [DBG] pgmap v783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:54:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:54:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:57.965123+0000 mgr.smithi067.rdualw (mgr.24569) 907 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:54:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:54:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:57.965123+0000 mgr.smithi067.rdualw (mgr.24569) 907 : cluster [DBG] pgmap v784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:54:59.965770+0000 mgr.smithi067.rdualw (mgr.24569) 908 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:54:59.965770+0000 mgr.smithi067.rdualw (mgr.24569) 908 : cluster [DBG] pgmap v785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:01.966747+0000 mgr.smithi067.rdualw (mgr.24569) 909 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:01.966747+0000 mgr.smithi067.rdualw (mgr.24569) 909 : cluster [DBG] pgmap v786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:03.967493+0000 mgr.smithi067.rdualw (mgr.24569) 910 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:03.967493+0000 mgr.smithi067.rdualw (mgr.24569) 910 : cluster [DBG] pgmap v787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:05.968376+0000 mgr.smithi067.rdualw (mgr.24569) 911 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:55:07.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:05.968376+0000 mgr.smithi067.rdualw (mgr.24569) 911 : cluster [DBG] pgmap v788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:55:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:07.968899+0000 mgr.smithi067.rdualw (mgr.24569) 912 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:07.968899+0000 mgr.smithi067.rdualw (mgr.24569) 912 : cluster [DBG] pgmap v789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:09.969707+0000 mgr.smithi067.rdualw (mgr.24569) 913 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:09.969707+0000 mgr.smithi067.rdualw (mgr.24569) 913 : cluster [DBG] pgmap v790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:11.970582+0000 mgr.smithi067.rdualw (mgr.24569) 914 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:11.970582+0000 mgr.smithi067.rdualw (mgr.24569) 914 : cluster [DBG] pgmap v791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:13.971297+0000 mgr.smithi067.rdualw (mgr.24569) 915 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:13.971297+0000 mgr.smithi067.rdualw (mgr.24569) 915 : cluster [DBG] pgmap v792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:15.972169+0000 mgr.smithi067.rdualw (mgr.24569) 916 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:55:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:15.972169+0000 mgr.smithi067.rdualw (mgr.24569) 916 : cluster [DBG] pgmap v793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:55:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:17.972703+0000 mgr.smithi067.rdualw (mgr.24569) 917 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:17.972703+0000 mgr.smithi067.rdualw (mgr.24569) 917 : cluster [DBG] pgmap v794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:19.973481+0000 mgr.smithi067.rdualw (mgr.24569) 918 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:19.973481+0000 mgr.smithi067.rdualw (mgr.24569) 918 : cluster [DBG] pgmap v795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:21.974376+0000 mgr.smithi067.rdualw (mgr.24569) 919 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:21.974376+0000 mgr.smithi067.rdualw (mgr.24569) 919 : cluster [DBG] pgmap v796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:23.363 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:55:23.655 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:55:23.656 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (32m) 4m ago 34m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:55:23.656 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (25m) 4m ago 33m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:55:23.656 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (25m) 4m ago 33m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:55:23.657 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (32m) 4m ago 33m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:55:23.657 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (26m) 4m ago 29m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:55:23.657 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (25m) 4m ago 29m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:55:23.657 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (27m) 4m ago 35m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:55:23.658 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (26m) 4m ago 33m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:55:23.658 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (26m) 4m ago 35m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:55:23.658 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (26m) 4m ago 33m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:55:23.658 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (27m) 4m ago 27m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:55:23.658 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (27m) 4m ago 27m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:55:23.659 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (33m) 4m ago 33m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:55:23.659 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (33m) 4m ago 33m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:55:23.659 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (16m) 4m ago 32m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:55:23.659 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (32m) 4m ago 32m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:55:23.660 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (32m) 4m ago 32m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:55:23.660 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (32m) 4m ago 32m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:55:23.660 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (31m) 4m ago 31m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:55:23.661 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (31m) 4m ago 31m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:55:23.661 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (31m) 4m ago 31m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:55:23.661 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (31m) 4m ago 31m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:55:23.661 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (32m) 4m ago 33m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:55:23.997 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:55:23.997 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:55:23.997 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:55:23.998 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:55:23.998 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:55:23.998 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:55:23.998 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:55:23.999 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:55:23.999 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:55:23.999 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:55:23.999 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:55:23.999 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:55:24.000 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:55:24.000 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:55:24.000 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:55:24.000 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:55:24.001 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:55:24.001 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:55:24.001 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:55:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:55:23.995410+0000 mon.smithi061 (mon.0) 388 : audit [DBG] from='client.? 172.21.15.61:0/2313193371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:55:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:55:23.995410+0000 mon.smithi061 (mon.0) 388 : audit [DBG] from='client.? 172.21.15.61:0/2313193371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:55:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:55:23.349292+0000 mgr.smithi067.rdualw (mgr.24569) 920 : audit [DBG] from='client.34750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:55:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:55:23.637525+0000 mgr.smithi067.rdualw (mgr.24569) 921 : audit [DBG] from='client.34754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:55:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:23.974925+0000 mgr.smithi067.rdualw (mgr.24569) 922 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:55:23.349292+0000 mgr.smithi067.rdualw (mgr.24569) 920 : audit [DBG] from='client.34750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:55:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:55:23.637525+0000 mgr.smithi067.rdualw (mgr.24569) 921 : audit [DBG] from='client.34754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:55:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:23.974925+0000 mgr.smithi067.rdualw (mgr.24569) 922 : cluster [DBG] pgmap v797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:25.975738+0000 mgr.smithi067.rdualw (mgr.24569) 923 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:55:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:25.975738+0000 mgr.smithi067.rdualw (mgr.24569) 923 : cluster [DBG] pgmap v798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:55:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:27.976397+0000 mgr.smithi067.rdualw (mgr.24569) 924 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:27.976397+0000 mgr.smithi067.rdualw (mgr.24569) 924 : cluster [DBG] pgmap v799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:29.977148+0000 mgr.smithi067.rdualw (mgr.24569) 925 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:29.977148+0000 mgr.smithi067.rdualw (mgr.24569) 925 : cluster [DBG] pgmap v800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:31.978109+0000 mgr.smithi067.rdualw (mgr.24569) 926 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:31.978109+0000 mgr.smithi067.rdualw (mgr.24569) 926 : cluster [DBG] pgmap v801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:33.978849+0000 mgr.smithi067.rdualw (mgr.24569) 927 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:55:34.565780+0000 mon.smithi067 (mon.1) 180 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:55:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:55:34.566085+0000 mon.smithi067 (mon.1) 181 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:55:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:55:34.566277+0000 mon.smithi061 (mon.0) 389 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:55:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:55:34.566518+0000 mon.smithi061 (mon.0) 390 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:55:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:33.978849+0000 mgr.smithi067.rdualw (mgr.24569) 927 : cluster [DBG] pgmap v802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:55:34.565780+0000 mon.smithi067 (mon.1) 180 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:55:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:55:34.566085+0000 mon.smithi067 (mon.1) 181 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:55:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:55:34.566277+0000 mon.smithi061 (mon.0) 389 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:55:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:55:34.566518+0000 mon.smithi061 (mon.0) 390 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:55:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:35.979846+0000 mgr.smithi067.rdualw (mgr.24569) 928 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:55:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:35.979846+0000 mgr.smithi067.rdualw (mgr.24569) 928 : cluster [DBG] pgmap v803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:55:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:37.980424+0000 mgr.smithi067.rdualw (mgr.24569) 929 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:37.980424+0000 mgr.smithi067.rdualw (mgr.24569) 929 : cluster [DBG] pgmap v804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:39.981023+0000 mgr.smithi067.rdualw (mgr.24569) 930 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:39.981023+0000 mgr.smithi067.rdualw (mgr.24569) 930 : cluster [DBG] pgmap v805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:55:41.012729+0000 mon.smithi067 (mon.1) 182 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:55:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:55:41.014459+0000 mon.smithi067 (mon.1) 183 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:55:41.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:55:41.015418+0000 mon.smithi067 (mon.1) 184 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:55:41.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:55:41.016260+0000 mgr.smithi067.rdualw (mgr.24569) 931 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:55:41.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:55:41.428261+0000 mon.smithi061 (mon.0) 391 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:55:41.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:55:41.435831+0000 mon.smithi061 (mon.0) 392 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:55:41.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:55:41.012729+0000 mon.smithi067 (mon.1) 182 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:55:41.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:55:41.014459+0000 mon.smithi067 (mon.1) 183 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:55:41.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:55:41.015418+0000 mon.smithi067 (mon.1) 184 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:55:41.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:55:41.016260+0000 mgr.smithi067.rdualw (mgr.24569) 931 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:55:41.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:55:41.428261+0000 mon.smithi061 (mon.0) 391 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:55:41.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:55:41.435831+0000 mon.smithi061 (mon.0) 392 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:55:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:41.981816+0000 mgr.smithi067.rdualw (mgr.24569) 932 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:41.981816+0000 mgr.smithi067.rdualw (mgr.24569) 932 : cluster [DBG] pgmap v806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:43.982519+0000 mgr.smithi067.rdualw (mgr.24569) 933 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:43.982519+0000 mgr.smithi067.rdualw (mgr.24569) 933 : cluster [DBG] pgmap v807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:45.983375+0000 mgr.smithi067.rdualw (mgr.24569) 934 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:55:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:45.983375+0000 mgr.smithi067.rdualw (mgr.24569) 934 : cluster [DBG] pgmap v808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:55:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:47.983878+0000 mgr.smithi067.rdualw (mgr.24569) 935 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:47.983878+0000 mgr.smithi067.rdualw (mgr.24569) 935 : cluster [DBG] pgmap v809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:49.984647+0000 mgr.smithi067.rdualw (mgr.24569) 936 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:49.984647+0000 mgr.smithi067.rdualw (mgr.24569) 936 : cluster [DBG] pgmap v810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:51.985736+0000 mgr.smithi067.rdualw (mgr.24569) 937 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:51.985736+0000 mgr.smithi067.rdualw (mgr.24569) 937 : cluster [DBG] pgmap v811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:54.313 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:55:54.612 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:55:54.613 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (33m) 5m ago 34m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:55:54.613 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (26m) 5m ago 34m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:55:54.613 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (25m) 5m ago 34m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:55:54.613 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (33m) 5m ago 34m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:55:54.614 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (26m) 5m ago 30m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:55:54.614 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (26m) 5m ago 30m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:55:54.614 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (27m) 5m ago 35m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:55:54.614 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (27m) 5m ago 33m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:55:54.615 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (27m) 5m ago 35m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:55:54.615 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (26m) 5m ago 33m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:55:54.615 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (27m) 5m ago 27m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:55:54.615 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (27m) 5m ago 27m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:55:54.615 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (34m) 5m ago 34m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:55:54.616 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (33m) 5m ago 33m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:55:54.616 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (16m) 5m ago 33m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:55:54.616 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (33m) 5m ago 33m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:55:54.616 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (32m) 5m ago 32m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:55:54.617 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (32m) 5m ago 32m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:55:54.617 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (32m) 5m ago 32m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:55:54.617 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (32m) 5m ago 32m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:55:54.617 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (31m) 5m ago 31m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:55:54.617 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (31m) 5m ago 31m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:55:54.618 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (33m) 5m ago 34m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:55:54.960 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:55:54.961 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:55:54.961 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:55:54.961 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:55:54.961 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:55:54.962 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:55:54.962 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:55:54.962 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:55:54.962 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:55:54.963 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:55:54.963 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:55:54.963 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:55:54.963 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:55:54.964 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:55:54.964 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:55:54.964 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:55:54.964 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:55:54.964 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:55:54.965 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:55:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:53.986286+0000 mgr.smithi067.rdualw (mgr.24569) 938 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:55:54.958885+0000 mon.smithi061 (mon.0) 393 : audit [DBG] from='client.? 172.21.15.61:0/3589058752' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:55:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:53.986286+0000 mgr.smithi067.rdualw (mgr.24569) 938 : cluster [DBG] pgmap v812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:55:54.958885+0000 mon.smithi061 (mon.0) 393 : audit [DBG] from='client.? 172.21.15.61:0/3589058752' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:55:56.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:55:54.300097+0000 mgr.smithi067.rdualw (mgr.24569) 939 : audit [DBG] from='client.34762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:55:56.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:55:54.595051+0000 mgr.smithi067.rdualw (mgr.24569) 940 : audit [DBG] from='client.34766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:55:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:55:54.300097+0000 mgr.smithi067.rdualw (mgr.24569) 939 : audit [DBG] from='client.34762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:55:56.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:55:54.595051+0000 mgr.smithi067.rdualw (mgr.24569) 940 : audit [DBG] from='client.34766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:55:57.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:55.987144+0000 mgr.smithi067.rdualw (mgr.24569) 941 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:55:57.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:55.987144+0000 mgr.smithi067.rdualw (mgr.24569) 941 : cluster [DBG] pgmap v813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:55:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:55:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:57.987810+0000 mgr.smithi067.rdualw (mgr.24569) 942 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:55:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:55:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:57.987810+0000 mgr.smithi067.rdualw (mgr.24569) 942 : cluster [DBG] pgmap v814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:55:59.988374+0000 mgr.smithi067.rdualw (mgr.24569) 943 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:55:59.988374+0000 mgr.smithi067.rdualw (mgr.24569) 943 : cluster [DBG] pgmap v815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:01.989408+0000 mgr.smithi067.rdualw (mgr.24569) 944 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:01.989408+0000 mgr.smithi067.rdualw (mgr.24569) 944 : cluster [DBG] pgmap v816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:03.990099+0000 mgr.smithi067.rdualw (mgr.24569) 945 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:03.990099+0000 mgr.smithi067.rdualw (mgr.24569) 945 : cluster [DBG] pgmap v817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:05.991157+0000 mgr.smithi067.rdualw (mgr.24569) 946 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:56:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:05.991157+0000 mgr.smithi067.rdualw (mgr.24569) 946 : cluster [DBG] pgmap v818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:56:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:07.991819+0000 mgr.smithi067.rdualw (mgr.24569) 947 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:07.991819+0000 mgr.smithi067.rdualw (mgr.24569) 947 : cluster [DBG] pgmap v819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:09.992414+0000 mgr.smithi067.rdualw (mgr.24569) 948 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:09.992414+0000 mgr.smithi067.rdualw (mgr.24569) 948 : cluster [DBG] pgmap v820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:11.993251+0000 mgr.smithi067.rdualw (mgr.24569) 949 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:11.993251+0000 mgr.smithi067.rdualw (mgr.24569) 949 : cluster [DBG] pgmap v821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:13.994005+0000 mgr.smithi067.rdualw (mgr.24569) 950 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:13.994005+0000 mgr.smithi067.rdualw (mgr.24569) 950 : cluster [DBG] pgmap v822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:15.994768+0000 mgr.smithi067.rdualw (mgr.24569) 951 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:56:17.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:15.994768+0000 mgr.smithi067.rdualw (mgr.24569) 951 : cluster [DBG] pgmap v823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:56:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:17.995375+0000 mgr.smithi067.rdualw (mgr.24569) 952 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:19.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:17.995375+0000 mgr.smithi067.rdualw (mgr.24569) 952 : cluster [DBG] pgmap v824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:19.996134+0000 mgr.smithi067.rdualw (mgr.24569) 953 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:19.996134+0000 mgr.smithi067.rdualw (mgr.24569) 953 : cluster [DBG] pgmap v825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:21.997169+0000 mgr.smithi067.rdualw (mgr.24569) 954 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:23.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:21.997169+0000 mgr.smithi067.rdualw (mgr.24569) 954 : cluster [DBG] pgmap v826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:25.269 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:56:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:23.997757+0000 mgr.smithi067.rdualw (mgr.24569) 955 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:25.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:23.997757+0000 mgr.smithi067.rdualw (mgr.24569) 955 : cluster [DBG] pgmap v827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:25.559 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:56:25.560 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (33m) 5m ago 35m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:56:25.560 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (26m) 5m ago 35m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:56:25.560 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (26m) 5m ago 34m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:56:25.560 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (33m) 5m ago 34m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:56:25.560 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (27m) 5m ago 30m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:56:25.561 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (26m) 5m ago 30m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:56:25.561 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (28m) 5m ago 36m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:56:25.561 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (27m) 5m ago 34m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:56:25.561 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (27m) 5m ago 36m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:56:25.562 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (27m) 5m ago 34m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:56:25.562 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (28m) 5m ago 28m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:56:25.562 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (28m) 5m ago 28m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:56:25.562 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (34m) 5m ago 34m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:56:25.562 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (34m) 5m ago 34m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:56:25.563 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (17m) 5m ago 33m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:56:25.563 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (33m) 5m ago 33m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:56:25.563 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (33m) 5m ago 33m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:56:25.563 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (33m) 5m ago 33m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:56:25.563 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (32m) 5m ago 32m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:56:25.564 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (32m) 5m ago 32m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:56:25.564 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (32m) 5m ago 32m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:56:25.564 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (32m) 5m ago 32m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:56:25.564 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (33m) 5m ago 34m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:56:25.906 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:56:25.906 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:56:25.907 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:56:25.907 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:56:25.907 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:56:25.907 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:56:25.908 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:56:25.908 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:56:25.908 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:56:25.908 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:56:25.909 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:56:25.909 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:56:25.909 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:56:25.910 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:56:25.910 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:56:25.910 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:56:25.910 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:56:25.911 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:56:25.911 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:56:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:56:25.904699+0000 mon.smithi061 (mon.0) 394 : audit [DBG] from='client.? 172.21.15.61:0/3140318225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:56:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:56:25.904699+0000 mon.smithi061 (mon.0) 394 : audit [DBG] from='client.? 172.21.15.61:0/3140318225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:56:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:56:25.255027+0000 mgr.smithi067.rdualw (mgr.24569) 956 : audit [DBG] from='client.34774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:56:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:56:25.541725+0000 mgr.smithi067.rdualw (mgr.24569) 957 : audit [DBG] from='client.34778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:56:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:25.998790+0000 mgr.smithi067.rdualw (mgr.24569) 958 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:56:27.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:56:25.255027+0000 mgr.smithi067.rdualw (mgr.24569) 956 : audit [DBG] from='client.34774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:56:27.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:56:25.541725+0000 mgr.smithi067.rdualw (mgr.24569) 957 : audit [DBG] from='client.34778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:56:27.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:25.998790+0000 mgr.smithi067.rdualw (mgr.24569) 958 : cluster [DBG] pgmap v828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:56:29.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:27.999411+0000 mgr.smithi067.rdualw (mgr.24569) 959 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:29.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:27.999411+0000 mgr.smithi067.rdualw (mgr.24569) 959 : cluster [DBG] pgmap v829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:30.000110+0000 mgr.smithi067.rdualw (mgr.24569) 960 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:30.000110+0000 mgr.smithi067.rdualw (mgr.24569) 960 : cluster [DBG] pgmap v830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:32.000985+0000 mgr.smithi067.rdualw (mgr.24569) 961 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:33.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:32.000985+0000 mgr.smithi067.rdualw (mgr.24569) 961 : cluster [DBG] pgmap v831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:34.001686+0000 mgr.smithi067.rdualw (mgr.24569) 962 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:56:34.571008+0000 mon.smithi067 (mon.1) 185 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:56:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:56:34.571262+0000 mon.smithi067 (mon.1) 186 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:56:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:56:34.571352+0000 mon.smithi061 (mon.0) 395 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:56:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:56:34.571636+0000 mon.smithi061 (mon.0) 396 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:56:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:34.001686+0000 mgr.smithi067.rdualw (mgr.24569) 962 : cluster [DBG] pgmap v832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:56:34.571008+0000 mon.smithi067 (mon.1) 185 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:56:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:56:34.571262+0000 mon.smithi067 (mon.1) 186 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:56:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:56:34.571352+0000 mon.smithi061 (mon.0) 395 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:56:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:56:34.571636+0000 mon.smithi061 (mon.0) 396 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:56:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:36.002690+0000 mgr.smithi067.rdualw (mgr.24569) 963 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:56:37.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:36.002690+0000 mgr.smithi067.rdualw (mgr.24569) 963 : cluster [DBG] pgmap v833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:56:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:38.003241+0000 mgr.smithi067.rdualw (mgr.24569) 964 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:39.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:38.003241+0000 mgr.smithi067.rdualw (mgr.24569) 964 : cluster [DBG] pgmap v834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:40.003881+0000 mgr.smithi067.rdualw (mgr.24569) 965 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:40.003881+0000 mgr.smithi067.rdualw (mgr.24569) 965 : cluster [DBG] pgmap v835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:56:41.439314+0000 mon.smithi067 (mon.1) 187 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:56:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:56:41.440908+0000 mon.smithi067 (mon.1) 188 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:56:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:56:41.441860+0000 mon.smithi067 (mon.1) 189 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:56:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:56:41.439314+0000 mon.smithi067 (mon.1) 187 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:56:41.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:56:41.440908+0000 mon.smithi067 (mon.1) 188 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:56:41.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:56:41.441860+0000 mon.smithi067 (mon.1) 189 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:56:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:56:41.442780+0000 mgr.smithi067.rdualw (mgr.24569) 966 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:56:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:56:41.856221+0000 mon.smithi061 (mon.0) 397 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:56:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:56:41.861948+0000 mon.smithi061 (mon.0) 398 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:56:43.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:42.004642+0000 mgr.smithi067.rdualw (mgr.24569) 967 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:56:41.442780+0000 mgr.smithi067.rdualw (mgr.24569) 966 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:56:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:56:41.856221+0000 mon.smithi061 (mon.0) 397 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:56:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:56:41.861948+0000 mon.smithi061 (mon.0) 398 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:56:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:42.004642+0000 mgr.smithi067.rdualw (mgr.24569) 967 : cluster [DBG] pgmap v836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:44.005236+0000 mgr.smithi067.rdualw (mgr.24569) 968 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:45.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:44.005236+0000 mgr.smithi067.rdualw (mgr.24569) 968 : cluster [DBG] pgmap v837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:46.006267+0000 mgr.smithi067.rdualw (mgr.24569) 969 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:56:47.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:46.006267+0000 mgr.smithi067.rdualw (mgr.24569) 969 : cluster [DBG] pgmap v838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:56:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:48.006977+0000 mgr.smithi067.rdualw (mgr.24569) 970 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:48.006977+0000 mgr.smithi067.rdualw (mgr.24569) 970 : cluster [DBG] pgmap v839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:50.007782+0000 mgr.smithi067.rdualw (mgr.24569) 971 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:50.007782+0000 mgr.smithi067.rdualw (mgr.24569) 971 : cluster [DBG] pgmap v840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:52.008846+0000 mgr.smithi067.rdualw (mgr.24569) 972 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:53.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:52.008846+0000 mgr.smithi067.rdualw (mgr.24569) 972 : cluster [DBG] pgmap v841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:54.009596+0000 mgr.smithi067.rdualw (mgr.24569) 973 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:55.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:54.009596+0000 mgr.smithi067.rdualw (mgr.24569) 973 : cluster [DBG] pgmap v842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:56.217 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:56:56.508 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:56:56.509 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (34m) 6m ago 35m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:56:56.509 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (27m) 6m ago 35m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:56:56.509 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (26m) 6m ago 35m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:56:56.509 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (34m) 6m ago 35m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:56:56.510 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (27m) 6m ago 31m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:56:56.510 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (27m) 6m ago 31m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:56:56.510 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (28m) 6m ago 36m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:56:56.510 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (28m) 6m ago 34m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:56:56.511 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (28m) 6m ago 36m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:56:56.511 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (27m) 6m ago 34m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:56:56.511 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (28m) 6m ago 28m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:56:56.511 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (28m) 6m ago 28m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:56:56.511 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (35m) 6m ago 35m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:56:56.512 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (34m) 6m ago 34m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:56:56.512 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (17m) 6m ago 34m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:56:56.512 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (34m) 6m ago 34m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:56:56.512 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (33m) 6m ago 33m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:56:56.513 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (33m) 6m ago 33m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:56:56.513 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (33m) 6m ago 33m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:56:56.513 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (33m) 6m ago 33m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:56:56.513 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (32m) 6m ago 32m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:56:56.513 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (32m) 6m ago 32m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:56:56.514 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (34m) 6m ago 35m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:56:56.848 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:56:56.849 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:56:56.849 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:56:56.849 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:56:56.849 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:56:56.850 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:56:56.850 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:56:56.850 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:56:56.850 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:56:56.851 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:56:56.851 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:56:56.851 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:56:56.851 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:56:56.852 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:56:56.852 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:56:56.852 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:56:56.852 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:56:56.853 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:56:56.853 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:56:57.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:56.010672+0000 mgr.smithi067.rdualw (mgr.24569) 974 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:56:57.656 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:56:56.846790+0000 mon.smithi061 (mon.0) 399 : audit [DBG] from='client.? 172.21.15.61:0/587828860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:56:57.657 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:56.010672+0000 mgr.smithi067.rdualw (mgr.24569) 974 : cluster [DBG] pgmap v843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:56:57.657 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:56:56.846790+0000 mon.smithi061 (mon.0) 399 : audit [DBG] from='client.? 172.21.15.61:0/587828860' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:56:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:56:56.203748+0000 mgr.smithi067.rdualw (mgr.24569) 975 : audit [DBG] from='client.34786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:56:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:56:56.490871+0000 mgr.smithi067.rdualw (mgr.24569) 976 : audit [DBG] from='client.34790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:56:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:56:56.203748+0000 mgr.smithi067.rdualw (mgr.24569) 975 : audit [DBG] from='client.34786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:56:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:56:56.490871+0000 mgr.smithi067.rdualw (mgr.24569) 976 : audit [DBG] from='client.34790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:56:59.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:56:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:56:58.011280+0000 mgr.smithi067.rdualw (mgr.24569) 977 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:56:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:56:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:56:58.011280+0000 mgr.smithi067.rdualw (mgr.24569) 977 : cluster [DBG] pgmap v844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:00.011916+0000 mgr.smithi067.rdualw (mgr.24569) 978 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:00.011916+0000 mgr.smithi067.rdualw (mgr.24569) 978 : cluster [DBG] pgmap v845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:03.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:02.012685+0000 mgr.smithi067.rdualw (mgr.24569) 979 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:03.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:02.012685+0000 mgr.smithi067.rdualw (mgr.24569) 979 : cluster [DBG] pgmap v846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:04.013266+0000 mgr.smithi067.rdualw (mgr.24569) 980 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:05.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:04.013266+0000 mgr.smithi067.rdualw (mgr.24569) 980 : cluster [DBG] pgmap v847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:06.014175+0000 mgr.smithi067.rdualw (mgr.24569) 981 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:57:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:06.014175+0000 mgr.smithi067.rdualw (mgr.24569) 981 : cluster [DBG] pgmap v848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:57:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:08.015011+0000 mgr.smithi067.rdualw (mgr.24569) 982 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:08.015011+0000 mgr.smithi067.rdualw (mgr.24569) 982 : cluster [DBG] pgmap v849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:10.015659+0000 mgr.smithi067.rdualw (mgr.24569) 983 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:10.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:10.015659+0000 mgr.smithi067.rdualw (mgr.24569) 983 : cluster [DBG] pgmap v850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:13.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:12.016505+0000 mgr.smithi067.rdualw (mgr.24569) 984 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:13.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:12.016505+0000 mgr.smithi067.rdualw (mgr.24569) 984 : cluster [DBG] pgmap v851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:14.017152+0000 mgr.smithi067.rdualw (mgr.24569) 985 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:15.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:14.017152+0000 mgr.smithi067.rdualw (mgr.24569) 985 : cluster [DBG] pgmap v852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:17.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:16.018211+0000 mgr.smithi067.rdualw (mgr.24569) 986 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:57:17.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:16.018211+0000 mgr.smithi067.rdualw (mgr.24569) 986 : cluster [DBG] pgmap v853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:57:19.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:18.018732+0000 mgr.smithi067.rdualw (mgr.24569) 987 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:19.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:18.018732+0000 mgr.smithi067.rdualw (mgr.24569) 987 : cluster [DBG] pgmap v854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:20.019335+0000 mgr.smithi067.rdualw (mgr.24569) 988 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:20.019335+0000 mgr.smithi067.rdualw (mgr.24569) 988 : cluster [DBG] pgmap v855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:23.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:22.020334+0000 mgr.smithi067.rdualw (mgr.24569) 989 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:23.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:22.020334+0000 mgr.smithi067.rdualw (mgr.24569) 989 : cluster [DBG] pgmap v856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:25.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:24.020921+0000 mgr.smithi067.rdualw (mgr.24569) 990 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:25.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:24.020921+0000 mgr.smithi067.rdualw (mgr.24569) 990 : cluster [DBG] pgmap v857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:27.158 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:57:27.449 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:57:27.451 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (34m) 6m ago 36m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:57:27.451 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (27m) 6m ago 36m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:57:27.451 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (27m) 6m ago 35m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:57:27.451 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (34m) 6m ago 35m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:57:27.452 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (28m) 6m ago 31m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:57:27.452 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (27m) 6m ago 31m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:57:27.452 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (29m) 6m ago 37m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:57:27.452 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (28m) 6m ago 35m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:57:27.453 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (28m) 6m ago 37m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:57:27.453 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (28m) 6m ago 35m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:57:27.453 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (29m) 6m ago 29m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:57:27.453 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (29m) 6m ago 29m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:57:27.453 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (35m) 6m ago 35m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:57:27.454 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (35m) 6m ago 35m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:57:27.454 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (18m) 6m ago 34m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:57:27.454 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (34m) 6m ago 34m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:57:27.454 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (34m) 6m ago 34m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:57:27.455 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (34m) 6m ago 34m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:57:27.455 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (33m) 6m ago 33m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:57:27.455 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (33m) 6m ago 33m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:57:27.455 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (33m) 6m ago 33m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:57:27.456 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (33m) 6m ago 33m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:57:27.456 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (34m) 6m ago 35m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:57:27.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:26.021797+0000 mgr.smithi067.rdualw (mgr.24569) 991 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:57:27.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:26.021797+0000 mgr.smithi067.rdualw (mgr.24569) 991 : cluster [DBG] pgmap v858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:57:27.791 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:57:27.791 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:57:27.792 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:57:27.792 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:57:27.792 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:57:27.792 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:57:27.793 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:57:27.793 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:57:27.793 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:57:27.793 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:57:27.794 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:57:27.794 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:57:27.794 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:57:27.794 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:57:27.794 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:57:27.795 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:57:27.795 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:57:27.795 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:57:27.796 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:57:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:57:27.789664+0000 mon.smithi061 (mon.0) 400 : audit [DBG] from='client.? 172.21.15.61:0/366673720' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:57:28.790 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:57:27.789664+0000 mon.smithi061 (mon.0) 400 : audit [DBG] from='client.? 172.21.15.61:0/366673720' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:57:29.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:57:27.143459+0000 mgr.smithi067.rdualw (mgr.24569) 992 : audit [DBG] from='client.34798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:57:29.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:57:27.430800+0000 mgr.smithi067.rdualw (mgr.24569) 993 : audit [DBG] from='client.34802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:57:29.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:28.022361+0000 mgr.smithi067.rdualw (mgr.24569) 994 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:29.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:57:27.143459+0000 mgr.smithi067.rdualw (mgr.24569) 992 : audit [DBG] from='client.34798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:57:29.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:57:27.430800+0000 mgr.smithi067.rdualw (mgr.24569) 993 : audit [DBG] from='client.34802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:57:29.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:28.022361+0000 mgr.smithi067.rdualw (mgr.24569) 994 : cluster [DBG] pgmap v859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:30.023082+0000 mgr.smithi067.rdualw (mgr.24569) 995 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:30.023082+0000 mgr.smithi067.rdualw (mgr.24569) 995 : cluster [DBG] pgmap v860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:33.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:32.023936+0000 mgr.smithi067.rdualw (mgr.24569) 996 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:33.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:32.023936+0000 mgr.smithi067.rdualw (mgr.24569) 996 : cluster [DBG] pgmap v861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:34.024654+0000 mgr.smithi067.rdualw (mgr.24569) 997 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:57:34.576207+0000 mon.smithi067 (mon.1) 190 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:57:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:57:34.576455+0000 mon.smithi067 (mon.1) 191 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:57:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:57:34.576542+0000 mon.smithi061 (mon.0) 401 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:57:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:57:34.576822+0000 mon.smithi061 (mon.0) 402 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:57:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:34.024654+0000 mgr.smithi067.rdualw (mgr.24569) 997 : cluster [DBG] pgmap v862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:57:34.576207+0000 mon.smithi067 (mon.1) 190 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:57:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:57:34.576455+0000 mon.smithi067 (mon.1) 191 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:57:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:57:34.576542+0000 mon.smithi061 (mon.0) 401 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:57:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:57:34.576822+0000 mon.smithi061 (mon.0) 402 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:57:37.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:36.025667+0000 mgr.smithi067.rdualw (mgr.24569) 998 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:57:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:36.025667+0000 mgr.smithi067.rdualw (mgr.24569) 998 : cluster [DBG] pgmap v863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:57:39.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:38.026283+0000 mgr.smithi067.rdualw (mgr.24569) 999 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:39.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:38.026283+0000 mgr.smithi067.rdualw (mgr.24569) 999 : cluster [DBG] pgmap v864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:40.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:40.027090+0000 mgr.smithi067.rdualw (mgr.24569) 1000 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:40.027090+0000 mgr.smithi067.rdualw (mgr.24569) 1000 : cluster [DBG] pgmap v865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:57:41.865308+0000 mon.smithi067 (mon.1) 192 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:57:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:57:41.866806+0000 mon.smithi067 (mon.1) 193 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:57:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:57:41.868151+0000 mon.smithi067 (mon.1) 194 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:57:42.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:57:41.865308+0000 mon.smithi067 (mon.1) 192 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:57:42.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:57:41.866806+0000 mon.smithi067 (mon.1) 193 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:57:42.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:57:41.868151+0000 mon.smithi067 (mon.1) 194 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:57:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:57:41.869090+0000 mgr.smithi067.rdualw (mgr.24569) 1001 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:57:43.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:42.027878+0000 mgr.smithi067.rdualw (mgr.24569) 1002 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:43.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:57:42.271161+0000 mon.smithi061 (mon.0) 403 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:57:43.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:57:42.277044+0000 mon.smithi061 (mon.0) 404 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:57:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:57:41.869090+0000 mgr.smithi067.rdualw (mgr.24569) 1001 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:57:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:42.027878+0000 mgr.smithi067.rdualw (mgr.24569) 1002 : cluster [DBG] pgmap v866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:57:42.271161+0000 mon.smithi061 (mon.0) 403 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:57:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:57:42.277044+0000 mon.smithi061 (mon.0) 404 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:57:45.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:44.028641+0000 mgr.smithi067.rdualw (mgr.24569) 1003 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:45.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:44.028641+0000 mgr.smithi067.rdualw (mgr.24569) 1003 : cluster [DBG] pgmap v867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:47.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:46.029575+0000 mgr.smithi067.rdualw (mgr.24569) 1004 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:57:47.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:46.029575+0000 mgr.smithi067.rdualw (mgr.24569) 1004 : cluster [DBG] pgmap v868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:57:49.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:48.030130+0000 mgr.smithi067.rdualw (mgr.24569) 1005 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:48.030130+0000 mgr.smithi067.rdualw (mgr.24569) 1005 : cluster [DBG] pgmap v869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:50.030874+0000 mgr.smithi067.rdualw (mgr.24569) 1006 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:50.030874+0000 mgr.smithi067.rdualw (mgr.24569) 1006 : cluster [DBG] pgmap v870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:53.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:52.031916+0000 mgr.smithi067.rdualw (mgr.24569) 1007 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:53.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:52.031916+0000 mgr.smithi067.rdualw (mgr.24569) 1007 : cluster [DBG] pgmap v871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:54.032700+0000 mgr.smithi067.rdualw (mgr.24569) 1008 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:55.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:54.032700+0000 mgr.smithi067.rdualw (mgr.24569) 1008 : cluster [DBG] pgmap v872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:57.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:56.033729+0000 mgr.smithi067.rdualw (mgr.24569) 1009 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:57:57.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:56.033729+0000 mgr.smithi067.rdualw (mgr.24569) 1009 : cluster [DBG] pgmap v873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:57:58.101 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:57:58.391 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:57:58.392 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (35m) 7m ago 36m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:57:58.392 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (28m) 7m ago 36m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:57:58.393 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (28m) 7m ago 36m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:57:58.393 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (35m) 7m ago 36m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:57:58.394 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (28m) 7m ago 32m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:57:58.394 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (28m) 7m ago 32m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:57:58.395 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (29m) 7m ago 37m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:57:58.395 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (29m) 7m ago 36m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:57:58.396 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (29m) 7m ago 37m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:57:58.396 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (28m) 7m ago 35m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:57:58.397 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (29m) 7m ago 29m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:57:58.397 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (29m) 7m ago 29m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:57:58.398 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (36m) 7m ago 36m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:57:58.398 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (35m) 7m ago 35m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:57:58.399 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (19m) 7m ago 35m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:57:58.399 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (35m) 7m ago 35m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:57:58.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (34m) 7m ago 34m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:57:58.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (34m) 7m ago 34m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:57:58.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (34m) 7m ago 34m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:57:58.401 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (34m) 7m ago 34m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:57:58.402 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (33m) 7m ago 33m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:57:58.402 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (33m) 7m ago 33m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:57:58.403 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (35m) 7m ago 36m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:57:58.728 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:57:58.728 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:57:58.729 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:57:58.729 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:57:58.729 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:57:58.729 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:57:58.729 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:57:58.730 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:57:58.730 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:57:58.730 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:57:58.730 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:57:58.731 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:57:58.731 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:57:58.731 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:57:58.731 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:57:58.731 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:57:58.732 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:57:58.732 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:57:58.732 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:57:59.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:57:58.034182+0000 mgr.smithi067.rdualw (mgr.24569) 1010 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:59.645 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:57:58.085564+0000 mgr.smithi067.rdualw (mgr.24569) 1011 : audit [DBG] from='client.34810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:57:59.646 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:57:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:57:58.726690+0000 mon.smithi061 (mon.0) 405 : audit [DBG] from='client.? 172.21.15.61:0/3023436380' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:57:59.646 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:57:58.034182+0000 mgr.smithi067.rdualw (mgr.24569) 1010 : cluster [DBG] pgmap v874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:57:59.647 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:57:58.085564+0000 mgr.smithi067.rdualw (mgr.24569) 1011 : audit [DBG] from='client.34810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:57:59.647 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:57:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:57:58.726690+0000 mon.smithi061 (mon.0) 405 : audit [DBG] from='client.? 172.21.15.61:0/3023436380' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:58:00.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:57:58.372493+0000 mgr.smithi067.rdualw (mgr.24569) 1012 : audit [DBG] from='client.34814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:58:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:57:58.372493+0000 mgr.smithi067.rdualw (mgr.24569) 1012 : audit [DBG] from='client.34814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:58:01.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:00.034879+0000 mgr.smithi067.rdualw (mgr.24569) 1013 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:01.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:00.034879+0000 mgr.smithi067.rdualw (mgr.24569) 1013 : cluster [DBG] pgmap v875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:03.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:02.035815+0000 mgr.smithi067.rdualw (mgr.24569) 1014 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:03.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:02.035815+0000 mgr.smithi067.rdualw (mgr.24569) 1014 : cluster [DBG] pgmap v876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:05.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:04.036526+0000 mgr.smithi067.rdualw (mgr.24569) 1015 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:05.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:04.036526+0000 mgr.smithi067.rdualw (mgr.24569) 1015 : cluster [DBG] pgmap v877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:06.037506+0000 mgr.smithi067.rdualw (mgr.24569) 1016 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:58:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:06.037506+0000 mgr.smithi067.rdualw (mgr.24569) 1016 : cluster [DBG] pgmap v878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:58:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:08.038204+0000 mgr.smithi067.rdualw (mgr.24569) 1017 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:08.038204+0000 mgr.smithi067.rdualw (mgr.24569) 1017 : cluster [DBG] pgmap v879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:10.807 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:10.038834+0000 mgr.smithi067.rdualw (mgr.24569) 1018 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:10.038834+0000 mgr.smithi067.rdualw (mgr.24569) 1018 : cluster [DBG] pgmap v880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:13.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:12.039681+0000 mgr.smithi067.rdualw (mgr.24569) 1019 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:13.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:12.039681+0000 mgr.smithi067.rdualw (mgr.24569) 1019 : cluster [DBG] pgmap v881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:15.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:14.040378+0000 mgr.smithi067.rdualw (mgr.24569) 1020 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:15.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:14.040378+0000 mgr.smithi067.rdualw (mgr.24569) 1020 : cluster [DBG] pgmap v882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:17.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:16.041284+0000 mgr.smithi067.rdualw (mgr.24569) 1021 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:58:17.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:16.041284+0000 mgr.smithi067.rdualw (mgr.24569) 1021 : cluster [DBG] pgmap v883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:58:19.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:18.041878+0000 mgr.smithi067.rdualw (mgr.24569) 1022 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:18.041878+0000 mgr.smithi067.rdualw (mgr.24569) 1022 : cluster [DBG] pgmap v884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:20.042658+0000 mgr.smithi067.rdualw (mgr.24569) 1023 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:20.042658+0000 mgr.smithi067.rdualw (mgr.24569) 1023 : cluster [DBG] pgmap v885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:23.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:22.043501+0000 mgr.smithi067.rdualw (mgr.24569) 1024 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:23.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:22.043501+0000 mgr.smithi067.rdualw (mgr.24569) 1024 : cluster [DBG] pgmap v886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:25.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:24.044235+0000 mgr.smithi067.rdualw (mgr.24569) 1025 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:25.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:24.044235+0000 mgr.smithi067.rdualw (mgr.24569) 1025 : cluster [DBG] pgmap v887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:27.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:26.045249+0000 mgr.smithi067.rdualw (mgr.24569) 1026 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:58:27.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:26.045249+0000 mgr.smithi067.rdualw (mgr.24569) 1026 : cluster [DBG] pgmap v888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:58:29.039 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:58:29.332 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:58:29.332 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (36m) 7m ago 37m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:58:29.333 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (28m) 7m ago 37m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:58:29.333 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (28m) 7m ago 36m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:58:29.333 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (35m) 7m ago 36m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:58:29.333 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (29m) 7m ago 32m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:58:29.334 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (28m) 7m ago 32m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:58:29.334 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (30m) 7m ago 38m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:58:29.334 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (29m) 7m ago 36m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:58:29.334 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (29m) 7m ago 38m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:58:29.334 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (29m) 7m ago 36m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:58:29.335 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (30m) 7m ago 30m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:58:29.335 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (30m) 7m ago 30m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:58:29.335 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (36m) 7m ago 36m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:58:29.335 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (36m) 7m ago 36m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:58:29.336 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (19m) 7m ago 35m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:58:29.337 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (35m) 7m ago 35m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:58:29.337 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (35m) 7m ago 35m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:58:29.338 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (35m) 7m ago 35m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:58:29.338 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (34m) 7m ago 34m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:58:29.338 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (34m) 7m ago 34m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:58:29.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (34m) 7m ago 34m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:58:29.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (34m) 7m ago 34m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:58:29.339 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (35m) 7m ago 36m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:58:29.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:28.045877+0000 mgr.smithi067.rdualw (mgr.24569) 1027 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:29.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:28.045877+0000 mgr.smithi067.rdualw (mgr.24569) 1027 : cluster [DBG] pgmap v889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:29.672 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:58:29.672 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:58:29.672 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:58:29.673 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:58:29.673 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:58:29.673 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:58:29.673 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:58:29.674 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:58:29.674 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:58:29.674 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:58:29.675 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:58:29.675 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:58:29.675 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:58:29.675 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:58:29.677 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:58:29.677 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:58:29.678 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:58:29.678 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:58:29.679 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:58:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:58:29.025571+0000 mgr.smithi067.rdualw (mgr.24569) 1028 : audit [DBG] from='client.34822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:58:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:58:29.670290+0000 mon.smithi061 (mon.0) 406 : audit [DBG] from='client.? 172.21.15.61:0/2851282640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:58:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:58:29.025571+0000 mgr.smithi067.rdualw (mgr.24569) 1028 : audit [DBG] from='client.34822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:58:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:58:29.670290+0000 mon.smithi061 (mon.0) 406 : audit [DBG] from='client.? 172.21.15.61:0/2851282640' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:58:31.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:58:29.312717+0000 mgr.smithi067.rdualw (mgr.24569) 1029 : audit [DBG] from='client.34826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:58:31.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:30.046460+0000 mgr.smithi067.rdualw (mgr.24569) 1030 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:31.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:58:29.312717+0000 mgr.smithi067.rdualw (mgr.24569) 1029 : audit [DBG] from='client.34826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:58:31.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:30.046460+0000 mgr.smithi067.rdualw (mgr.24569) 1030 : cluster [DBG] pgmap v890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:33.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:32.047433+0000 mgr.smithi067.rdualw (mgr.24569) 1031 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:33.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:32.047433+0000 mgr.smithi067.rdualw (mgr.24569) 1031 : cluster [DBG] pgmap v891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:35.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:34.048227+0000 mgr.smithi067.rdualw (mgr.24569) 1032 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:58:34.581650+0000 mon.smithi067 (mon.1) 195 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:58:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:58:34.581873+0000 mon.smithi067 (mon.1) 196 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:58:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:58:34.582057+0000 mon.smithi061 (mon.0) 407 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:58:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:58:34.582322+0000 mon.smithi061 (mon.0) 408 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:58:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:34.048227+0000 mgr.smithi067.rdualw (mgr.24569) 1032 : cluster [DBG] pgmap v892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:58:34.581650+0000 mon.smithi067 (mon.1) 195 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:58:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:58:34.581873+0000 mon.smithi067 (mon.1) 196 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:58:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:58:34.582057+0000 mon.smithi061 (mon.0) 407 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:58:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:58:34.582322+0000 mon.smithi061 (mon.0) 408 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:58:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:36.049131+0000 mgr.smithi067.rdualw (mgr.24569) 1033 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:58:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:36.049131+0000 mgr.smithi067.rdualw (mgr.24569) 1033 : cluster [DBG] pgmap v893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:58:39.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:38.049778+0000 mgr.smithi067.rdualw (mgr.24569) 1034 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:39.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:38.049778+0000 mgr.smithi067.rdualw (mgr.24569) 1034 : cluster [DBG] pgmap v894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:40.050430+0000 mgr.smithi067.rdualw (mgr.24569) 1035 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:40.050430+0000 mgr.smithi067.rdualw (mgr.24569) 1035 : cluster [DBG] pgmap v895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:43.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:42.051571+0000 mgr.smithi067.rdualw (mgr.24569) 1036 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:43.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:58:42.280403+0000 mon.smithi067 (mon.1) 197 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:58:43.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:58:42.281913+0000 mon.smithi067 (mon.1) 198 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:58:43.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:58:42.282872+0000 mon.smithi067 (mon.1) 199 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:58:43.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:58:42.699881+0000 mon.smithi061 (mon.0) 409 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:58:43.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:58:42.707462+0000 mon.smithi061 (mon.0) 410 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:58:43.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:42.051571+0000 mgr.smithi067.rdualw (mgr.24569) 1036 : cluster [DBG] pgmap v896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:43.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:58:42.280403+0000 mon.smithi067 (mon.1) 197 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:58:43.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:58:42.281913+0000 mon.smithi067 (mon.1) 198 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:58:43.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:58:42.282872+0000 mon.smithi067 (mon.1) 199 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:58:43.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:58:42.699881+0000 mon.smithi061 (mon.0) 409 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:58:43.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:58:42.707462+0000 mon.smithi061 (mon.0) 410 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:58:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:58:42.283771+0000 mgr.smithi067.rdualw (mgr.24569) 1037 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:58:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:58:42.283771+0000 mgr.smithi067.rdualw (mgr.24569) 1037 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:58:45.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:44.052236+0000 mgr.smithi067.rdualw (mgr.24569) 1038 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:45.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:44.052236+0000 mgr.smithi067.rdualw (mgr.24569) 1038 : cluster [DBG] pgmap v897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:47.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:46.053089+0000 mgr.smithi067.rdualw (mgr.24569) 1039 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:58:47.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:46.053089+0000 mgr.smithi067.rdualw (mgr.24569) 1039 : cluster [DBG] pgmap v898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:58:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:48.053750+0000 mgr.smithi067.rdualw (mgr.24569) 1040 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:49.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:48.053750+0000 mgr.smithi067.rdualw (mgr.24569) 1040 : cluster [DBG] pgmap v899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:50.054296+0000 mgr.smithi067.rdualw (mgr.24569) 1041 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:50.054296+0000 mgr.smithi067.rdualw (mgr.24569) 1041 : cluster [DBG] pgmap v900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:53.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:52.055133+0000 mgr.smithi067.rdualw (mgr.24569) 1042 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:53.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:52.055133+0000 mgr.smithi067.rdualw (mgr.24569) 1042 : cluster [DBG] pgmap v901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:54.055735+0000 mgr.smithi067.rdualw (mgr.24569) 1043 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:54.055735+0000 mgr.smithi067.rdualw (mgr.24569) 1043 : cluster [DBG] pgmap v902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:57.557 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:56.056477+0000 mgr.smithi067.rdualw (mgr.24569) 1044 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:58:57.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:56.056477+0000 mgr.smithi067.rdualw (mgr.24569) 1044 : cluster [DBG] pgmap v903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:58:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:58:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:58:58.057089+0000 mgr.smithi067.rdualw (mgr.24569) 1045 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:59.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:58:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:58:58.057089+0000 mgr.smithi067.rdualw (mgr.24569) 1045 : cluster [DBG] pgmap v904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:58:59.980 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:59:00.300 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:59:00.300 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (36m) 8m ago 37m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:59:00.301 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (29m) 8m ago 37m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:59:00.301 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (29m) 8m ago 37m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:59:00.302 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (36m) 8m ago 37m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:59:00.302 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (29m) 8m ago 33m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:59:00.303 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (29m) 8m ago 33m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:59:00.303 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (30m) 8m ago 38m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:59:00.303 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (30m) 8m ago 37m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:59:00.304 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (30m) 8m ago 38m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:59:00.304 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (29m) 8m ago 36m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:59:00.305 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (30m) 8m ago 30m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:59:00.305 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (30m) 8m ago 30m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:59:00.306 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (37m) 8m ago 37m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:59:00.306 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (36m) 8m ago 36m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:59:00.307 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (20m) 8m ago 36m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:59:00.307 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (36m) 8m ago 36m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:59:00.307 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (35m) 8m ago 35m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:59:00.308 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (35m) 8m ago 35m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:59:00.308 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (35m) 8m ago 35m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:59:00.309 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (35m) 8m ago 35m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:59:00.309 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (34m) 8m ago 34m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:59:00.309 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (34m) 8m ago 34m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:59:00.309 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (36m) 8m ago 37m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:59:00.641 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:59:00.642 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:59:00.642 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:59:00.642 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:59:00.642 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:59:00.643 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:59:00.643 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:59:00.643 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:59:00.643 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:59:00.644 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:59:00.644 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:59:00.644 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:59:00.644 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:59:00.644 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:59:00.645 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:59:00.645 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:59:00.645 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:59:00.645 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:59:00.645 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:59:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:58:59.966681+0000 mgr.smithi067.rdualw (mgr.24569) 1046 : audit [DBG] from='client.34834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:59:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:00.057709+0000 mgr.smithi067.rdualw (mgr.24569) 1047 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:58:59.966681+0000 mgr.smithi067.rdualw (mgr.24569) 1046 : audit [DBG] from='client.34834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:59:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:00.057709+0000 mgr.smithi067.rdualw (mgr.24569) 1047 : cluster [DBG] pgmap v905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:59:00.282073+0000 mgr.smithi067.rdualw (mgr.24569) 1048 : audit [DBG] from='client.34838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:59:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:59:00.640114+0000 mon.smithi061 (mon.0) 411 : audit [DBG] from='client.? 172.21.15.61:0/3446006431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:59:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:59:00.282073+0000 mgr.smithi067.rdualw (mgr.24569) 1048 : audit [DBG] from='client.34838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:59:01.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:59:00.640114+0000 mon.smithi061 (mon.0) 411 : audit [DBG] from='client.? 172.21.15.61:0/3446006431' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:59:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:02.058669+0000 mgr.smithi067.rdualw (mgr.24569) 1049 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:02.058669+0000 mgr.smithi067.rdualw (mgr.24569) 1049 : cluster [DBG] pgmap v906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:05.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:04.059346+0000 mgr.smithi067.rdualw (mgr.24569) 1050 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:05.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:04.059346+0000 mgr.smithi067.rdualw (mgr.24569) 1050 : cluster [DBG] pgmap v907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:06.060203+0000 mgr.smithi067.rdualw (mgr.24569) 1051 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:59:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:06.060203+0000 mgr.smithi067.rdualw (mgr.24569) 1051 : cluster [DBG] pgmap v908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:59:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:08.060871+0000 mgr.smithi067.rdualw (mgr.24569) 1052 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:09.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:08.060871+0000 mgr.smithi067.rdualw (mgr.24569) 1052 : cluster [DBG] pgmap v909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:10.061447+0000 mgr.smithi067.rdualw (mgr.24569) 1053 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:10.061447+0000 mgr.smithi067.rdualw (mgr.24569) 1053 : cluster [DBG] pgmap v910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:13.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:12.062420+0000 mgr.smithi067.rdualw (mgr.24569) 1054 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:13.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:12.062420+0000 mgr.smithi067.rdualw (mgr.24569) 1054 : cluster [DBG] pgmap v911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:15.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:14.063127+0000 mgr.smithi067.rdualw (mgr.24569) 1055 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:15.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:14.063127+0000 mgr.smithi067.rdualw (mgr.24569) 1055 : cluster [DBG] pgmap v912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:17.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:16.064212+0000 mgr.smithi067.rdualw (mgr.24569) 1056 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:59:17.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:16.064212+0000 mgr.smithi067.rdualw (mgr.24569) 1056 : cluster [DBG] pgmap v913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:59:18.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:18.064795+0000 mgr.smithi067.rdualw (mgr.24569) 1057 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:18.064795+0000 mgr.smithi067.rdualw (mgr.24569) 1057 : cluster [DBG] pgmap v914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:20.065372+0000 mgr.smithi067.rdualw (mgr.24569) 1058 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:20.065372+0000 mgr.smithi067.rdualw (mgr.24569) 1058 : cluster [DBG] pgmap v915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:23.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:22.066405+0000 mgr.smithi067.rdualw (mgr.24569) 1059 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:23.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:22.066405+0000 mgr.smithi067.rdualw (mgr.24569) 1059 : cluster [DBG] pgmap v916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:25.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:24.067005+0000 mgr.smithi067.rdualw (mgr.24569) 1060 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:25.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:24.067005+0000 mgr.smithi067.rdualw (mgr.24569) 1060 : cluster [DBG] pgmap v917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:26.067971+0000 mgr.smithi067.rdualw (mgr.24569) 1061 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:59:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:26.067971+0000 mgr.smithi067.rdualw (mgr.24569) 1061 : cluster [DBG] pgmap v918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:59:29.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:28.068467+0000 mgr.smithi067.rdualw (mgr.24569) 1062 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:29.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:28.068467+0000 mgr.smithi067.rdualw (mgr.24569) 1062 : cluster [DBG] pgmap v919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:30.069074+0000 mgr.smithi067.rdualw (mgr.24569) 1063 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:30.069074+0000 mgr.smithi067.rdualw (mgr.24569) 1063 : cluster [DBG] pgmap v920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:30.948 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T15:59:31.239 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T15:59:31.240 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (37m) 8m ago 38m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T15:59:31.240 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (29m) 8m ago 38m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T15:59:31.240 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (29m) 9m ago 37m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T15:59:31.241 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (36m) 8m ago 37m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T15:59:31.241 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (30m) 8m ago 33m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T15:59:31.241 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (30m) 9m ago 33m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T15:59:31.241 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (31m) 8m ago 39m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T15:59:31.241 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (30m) 9m ago 37m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T15:59:31.242 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (30m) 8m ago 39m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T15:59:31.242 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (30m) 9m ago 37m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T15:59:31.242 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (31m) 8m ago 31m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T15:59:31.242 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (31m) 9m ago 31m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T15:59:31.243 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (37m) 8m ago 37m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T15:59:31.243 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (37m) 9m ago 37m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T15:59:31.243 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (20m) 8m ago 36m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T15:59:31.243 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (36m) 8m ago 36m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T15:59:31.244 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (36m) 8m ago 36m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T15:59:31.244 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (36m) 8m ago 36m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T15:59:31.244 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (35m) 9m ago 35m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T15:59:31.244 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (35m) 9m ago 35m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T15:59:31.245 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (35m) 9m ago 35m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T15:59:31.245 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (35m) 9m ago 35m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T15:59:31.245 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (36m) 8m ago 37m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T15:59:31.581 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T15:59:31.582 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T15:59:31.582 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T15:59:31.582 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:59:31.583 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T15:59:31.583 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:59:31.583 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:59:31.583 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T15:59:31.583 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T15:59:31.584 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T15:59:31.584 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:59:31.584 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T15:59:31.584 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T15:59:31.585 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T15:59:31.585 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T15:59:31.585 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T15:59:31.585 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T15:59:31.586 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T15:59:31.586 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T15:59:31.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:59:30.934966+0000 mgr.smithi067.rdualw (mgr.24569) 1064 : audit [DBG] from='client.34846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:59:31.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:59:30.934966+0000 mgr.smithi067.rdualw (mgr.24569) 1064 : audit [DBG] from='client.34846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:59:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:59:31.221718+0000 mgr.smithi067.rdualw (mgr.24569) 1065 : audit [DBG] from='client.34850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:59:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:59:31.580226+0000 mon.smithi061 (mon.0) 412 : audit [DBG] from='client.? 172.21.15.61:0/1457294249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:59:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:32.070071+0000 mgr.smithi067.rdualw (mgr.24569) 1066 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:59:31.221718+0000 mgr.smithi067.rdualw (mgr.24569) 1065 : audit [DBG] from='client.34850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T15:59:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:59:31.580226+0000 mon.smithi061 (mon.0) 412 : audit [DBG] from='client.? 172.21.15.61:0/1457294249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T15:59:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:32.070071+0000 mgr.smithi067.rdualw (mgr.24569) 1066 : cluster [DBG] pgmap v921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:34.070771+0000 mgr.smithi067.rdualw (mgr.24569) 1067 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:59:34.586654+0000 mon.smithi067 (mon.1) 200 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:59:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:59:34.586892+0000 mon.smithi067 (mon.1) 201 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:59:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:59:34.586978+0000 mon.smithi061 (mon.0) 413 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:59:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:59:34.587242+0000 mon.smithi061 (mon.0) 414 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:59:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:34.070771+0000 mgr.smithi067.rdualw (mgr.24569) 1067 : cluster [DBG] pgmap v922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:59:34.586654+0000 mon.smithi067 (mon.1) 200 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:59:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:59:34.586892+0000 mon.smithi067 (mon.1) 201 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:59:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:59:34.586978+0000 mon.smithi061 (mon.0) 413 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T15:59:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:59:34.587242+0000 mon.smithi061 (mon.0) 414 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T15:59:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:36.071550+0000 mgr.smithi067.rdualw (mgr.24569) 1068 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:59:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:36.071550+0000 mgr.smithi067.rdualw (mgr.24569) 1068 : cluster [DBG] pgmap v923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:59:39.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:38.072135+0000 mgr.smithi067.rdualw (mgr.24569) 1069 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:39.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:38.072135+0000 mgr.smithi067.rdualw (mgr.24569) 1069 : cluster [DBG] pgmap v924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:40.072913+0000 mgr.smithi067.rdualw (mgr.24569) 1070 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:40.072913+0000 mgr.smithi067.rdualw (mgr.24569) 1070 : cluster [DBG] pgmap v925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:42.073939+0000 mgr.smithi067.rdualw (mgr.24569) 1071 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:42.073939+0000 mgr.smithi067.rdualw (mgr.24569) 1071 : cluster [DBG] pgmap v926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:43.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:59:42.710872+0000 mon.smithi067 (mon.1) 202 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:59:43.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:59:42.712289+0000 mon.smithi067 (mon.1) 203 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:59:43.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:59:42.713190+0000 mon.smithi067 (mon.1) 204 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:59:43.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T15:59:42.714010+0000 mgr.smithi067.rdualw (mgr.24569) 1072 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:59:43.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:59:43.128505+0000 mon.smithi061 (mon.0) 415 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:59:43.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T15:59:43.134060+0000 mon.smithi061 (mon.0) 416 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:59:43.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:59:42.710872+0000 mon.smithi067 (mon.1) 202 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T15:59:43.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:59:42.712289+0000 mon.smithi067 (mon.1) 203 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T15:59:43.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:59:42.713190+0000 mon.smithi067 (mon.1) 204 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T15:59:43.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T15:59:42.714010+0000 mgr.smithi067.rdualw (mgr.24569) 1072 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T15:59:43.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:59:43.128505+0000 mon.smithi061 (mon.0) 415 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:59:43.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T15:59:43.134060+0000 mon.smithi061 (mon.0) 416 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T15:59:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:44.074490+0000 mgr.smithi067.rdualw (mgr.24569) 1073 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:44.074490+0000 mgr.smithi067.rdualw (mgr.24569) 1073 : cluster [DBG] pgmap v927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:46.075530+0000 mgr.smithi067.rdualw (mgr.24569) 1074 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:59:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:46.075530+0000 mgr.smithi067.rdualw (mgr.24569) 1074 : cluster [DBG] pgmap v928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:59:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:48.076345+0000 mgr.smithi067.rdualw (mgr.24569) 1075 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:48.076345+0000 mgr.smithi067.rdualw (mgr.24569) 1075 : cluster [DBG] pgmap v929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:50.077006+0000 mgr.smithi067.rdualw (mgr.24569) 1076 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:50.077006+0000 mgr.smithi067.rdualw (mgr.24569) 1076 : cluster [DBG] pgmap v930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:52.077875+0000 mgr.smithi067.rdualw (mgr.24569) 1077 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:52.077875+0000 mgr.smithi067.rdualw (mgr.24569) 1077 : cluster [DBG] pgmap v931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:54.078398+0000 mgr.smithi067.rdualw (mgr.24569) 1078 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:54.078398+0000 mgr.smithi067.rdualw (mgr.24569) 1078 : cluster [DBG] pgmap v932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:56.079222+0000 mgr.smithi067.rdualw (mgr.24569) 1079 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:59:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:56.079222+0000 mgr.smithi067.rdualw (mgr.24569) 1079 : cluster [DBG] pgmap v933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T15:59:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 15:59:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T15:59:58.079823+0000 mgr.smithi067.rdualw (mgr.24569) 1080 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T15:59:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 15:59:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T15:59:58.079823+0000 mgr.smithi067.rdualw (mgr.24569) 1080 : cluster [DBG] pgmap v934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:00.000076+0000 mon.smithi061 (mon.0) 417 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T16:00:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:00.080415+0000 mgr.smithi067.rdualw (mgr.24569) 1081 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:00.000076+0000 mon.smithi061 (mon.0) 417 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T16:00:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:00.080415+0000 mgr.smithi067.rdualw (mgr.24569) 1081 : cluster [DBG] pgmap v935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:01.905 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:00:02.198 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:00:02.198 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (37m) 9m ago 38m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:00:02.198 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (30m) 9m ago 38m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:00:02.199 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (30m) 9m ago 38m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:00:02.199 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (37m) 9m ago 38m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:00:02.199 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (30m) 9m ago 34m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:00:02.199 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (30m) 9m ago 34m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:00:02.200 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (31m) 9m ago 39m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:00:02.200 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (31m) 9m ago 38m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:00:02.200 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (31m) 9m ago 39m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:00:02.200 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (31m) 9m ago 37m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:00:02.201 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (31m) 9m ago 31m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:00:02.201 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (31m) 9m ago 31m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:00:02.201 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (38m) 9m ago 38m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:00:02.201 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (37m) 9m ago 37m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:00:02.202 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (21m) 9m ago 37m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:00:02.202 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (37m) 9m ago 37m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:00:02.202 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (36m) 9m ago 36m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:00:02.202 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (36m) 9m ago 36m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:00:02.203 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (36m) 9m ago 36m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:00:02.203 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (36m) 9m ago 36m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:00:02.203 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (35m) 9m ago 35m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:00:02.203 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (35m) 9m ago 35m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:00:02.203 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (37m) 9m ago 38m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:00:02.537 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:00:02.537 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:00:02.538 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:00:02.538 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:00:02.539 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:00:02.539 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:00:02.539 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:00:02.540 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:00:02.540 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:00:02.540 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:00:02.541 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:00:02.541 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:00:02.541 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:00:02.541 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:00:02.541 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:00:02.542 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:00:02.542 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:00:02.542 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:00:02.542 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:00:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:01.891429+0000 mgr.smithi067.rdualw (mgr.24569) 1082 : audit [DBG] from='client.34858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:00:02.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:02.081327+0000 mgr.smithi067.rdualw (mgr.24569) 1083 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:01.891429+0000 mgr.smithi067.rdualw (mgr.24569) 1082 : audit [DBG] from='client.34858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:00:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:02.081327+0000 mgr.smithi067.rdualw (mgr.24569) 1083 : cluster [DBG] pgmap v936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:03.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:02.179939+0000 mgr.smithi067.rdualw (mgr.24569) 1084 : audit [DBG] from='client.34862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:00:03.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:02.535318+0000 mon.smithi061 (mon.0) 418 : audit [DBG] from='client.? 172.21.15.61:0/578848684' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:00:03.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:02.179939+0000 mgr.smithi067.rdualw (mgr.24569) 1084 : audit [DBG] from='client.34862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:00:03.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:02.535318+0000 mon.smithi061 (mon.0) 418 : audit [DBG] from='client.? 172.21.15.61:0/578848684' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:00:04.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:04.081943+0000 mgr.smithi067.rdualw (mgr.24569) 1085 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:04.081943+0000 mgr.smithi067.rdualw (mgr.24569) 1085 : cluster [DBG] pgmap v937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:06.082929+0000 mgr.smithi067.rdualw (mgr.24569) 1086 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:00:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:06.082929+0000 mgr.smithi067.rdualw (mgr.24569) 1086 : cluster [DBG] pgmap v938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:00:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:08.083474+0000 mgr.smithi067.rdualw (mgr.24569) 1087 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:08.083474+0000 mgr.smithi067.rdualw (mgr.24569) 1087 : cluster [DBG] pgmap v939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:10.084088+0000 mgr.smithi067.rdualw (mgr.24569) 1088 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:10.084088+0000 mgr.smithi067.rdualw (mgr.24569) 1088 : cluster [DBG] pgmap v940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:12.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:12.085117+0000 mgr.smithi067.rdualw (mgr.24569) 1089 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:12.085117+0000 mgr.smithi067.rdualw (mgr.24569) 1089 : cluster [DBG] pgmap v941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:14.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:14.085730+0000 mgr.smithi067.rdualw (mgr.24569) 1090 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:14.085730+0000 mgr.smithi067.rdualw (mgr.24569) 1090 : cluster [DBG] pgmap v942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:16.086582+0000 mgr.smithi067.rdualw (mgr.24569) 1091 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:00:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:16.086582+0000 mgr.smithi067.rdualw (mgr.24569) 1091 : cluster [DBG] pgmap v943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:00:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:18.087260+0000 mgr.smithi067.rdualw (mgr.24569) 1092 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:18.087260+0000 mgr.smithi067.rdualw (mgr.24569) 1092 : cluster [DBG] pgmap v944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:20.087962+0000 mgr.smithi067.rdualw (mgr.24569) 1093 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:20.087962+0000 mgr.smithi067.rdualw (mgr.24569) 1093 : cluster [DBG] pgmap v945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:22.088948+0000 mgr.smithi067.rdualw (mgr.24569) 1094 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:22.088948+0000 mgr.smithi067.rdualw (mgr.24569) 1094 : cluster [DBG] pgmap v946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:24.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:24.089650+0000 mgr.smithi067.rdualw (mgr.24569) 1095 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:24.089650+0000 mgr.smithi067.rdualw (mgr.24569) 1095 : cluster [DBG] pgmap v947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:26.090630+0000 mgr.smithi067.rdualw (mgr.24569) 1096 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:00:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:26.090630+0000 mgr.smithi067.rdualw (mgr.24569) 1096 : cluster [DBG] pgmap v948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:00:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:28.091152+0000 mgr.smithi067.rdualw (mgr.24569) 1097 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:28.091152+0000 mgr.smithi067.rdualw (mgr.24569) 1097 : cluster [DBG] pgmap v949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:30.091938+0000 mgr.smithi067.rdualw (mgr.24569) 1098 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:30.091938+0000 mgr.smithi067.rdualw (mgr.24569) 1098 : cluster [DBG] pgmap v950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:32.092905+0000 mgr.smithi067.rdualw (mgr.24569) 1099 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:32.092905+0000 mgr.smithi067.rdualw (mgr.24569) 1099 : cluster [DBG] pgmap v951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:32.847 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:00:33.138 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:00:33.139 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (38m) 10m ago 39m 19.9M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:00:33.139 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (30m) 10m ago 39m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:00:33.139 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (30m) 10m ago 38m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:00:33.139 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (37m) 10m ago 38m 39.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:00:33.140 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (31m) 10m ago 34m 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:00:33.140 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (31m) 10m ago 34m 17.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:00:33.140 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (32m) 10m ago 40m 439M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:00:33.141 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (31m) 10m ago 38m 460M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:00:33.141 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (31m) 10m ago 40m 215M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:00:33.141 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (31m) 10m ago 38m 151M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:00:33.141 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (32m) 10m ago 32m 172M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:00:33.142 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (32m) 10m ago 32m 91.1M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:00:33.142 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (38m) 10m ago 38m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:00:33.142 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (38m) 10m ago 38m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:00:33.142 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (21m) 10m ago 38m 453M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:00:33.143 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (37m) 10m ago 37m 1225M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:00:33.143 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (37m) 10m ago 37m 735M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:00:33.143 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (37m) 10m ago 37m 1342M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:00:33.143 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (36m) 10m ago 36m 1242M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:00:33.144 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (36m) 10m ago 36m 1504M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:00:33.144 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (36m) 10m ago 36m 1158M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:00:33.144 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (36m) 10m ago 36m 1961M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:00:33.144 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (37m) 10m ago 38m 52.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:00:33.480 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:00:33.480 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:00:33.481 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:00:33.481 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:00:33.481 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:00:33.482 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:00:33.482 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:00:33.482 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:00:33.482 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:00:33.483 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:00:33.483 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:00:33.483 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:00:33.483 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:00:33.484 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:00:33.484 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:00:33.484 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:00:33.484 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:00:33.484 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:00:33.485 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:00:33.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:32.833710+0000 mgr.smithi067.rdualw (mgr.24569) 1100 : audit [DBG] from='client.34870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:00:33.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:33.120826+0000 mgr.smithi067.rdualw (mgr.24569) 1101 : audit [DBG] from='client.34874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:00:33.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:32.833710+0000 mgr.smithi067.rdualw (mgr.24569) 1100 : audit [DBG] from='client.34870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:00:33.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:33.120826+0000 mgr.smithi067.rdualw (mgr.24569) 1101 : audit [DBG] from='client.34874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:00:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:33.478740+0000 mon.smithi061 (mon.0) 419 : audit [DBG] from='client.? 172.21.15.61:0/1736863856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:00:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:34.093632+0000 mgr.smithi067.rdualw (mgr.24569) 1102 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:33.478740+0000 mon.smithi061 (mon.0) 419 : audit [DBG] from='client.? 172.21.15.61:0/1736863856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:00:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:34.093632+0000 mgr.smithi067.rdualw (mgr.24569) 1102 : cluster [DBG] pgmap v952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:34.592108+0000 mon.smithi067 (mon.1) 205 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:00:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:34.592334+0000 mon.smithi067 (mon.1) 206 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:00:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:34.592612+0000 mon.smithi061 (mon.0) 420 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:00:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:34.592953+0000 mon.smithi061 (mon.0) 421 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:00:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:34.592108+0000 mon.smithi067 (mon.1) 205 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:00:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:34.592334+0000 mon.smithi067 (mon.1) 206 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:00:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:34.592612+0000 mon.smithi061 (mon.0) 420 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:00:35.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:34.592953+0000 mon.smithi061 (mon.0) 421 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:00:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:36.094552+0000 mgr.smithi067.rdualw (mgr.24569) 1103 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:00:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:36.094552+0000 mgr.smithi067.rdualw (mgr.24569) 1103 : cluster [DBG] pgmap v953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:00:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:38.095217+0000 mgr.smithi067.rdualw (mgr.24569) 1104 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:38.095217+0000 mgr.smithi067.rdualw (mgr.24569) 1104 : cluster [DBG] pgmap v954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:40.095870+0000 mgr.smithi067.rdualw (mgr.24569) 1105 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:40.095870+0000 mgr.smithi067.rdualw (mgr.24569) 1105 : cluster [DBG] pgmap v955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:42.096764+0000 mgr.smithi067.rdualw (mgr.24569) 1106 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:42.096764+0000 mgr.smithi067.rdualw (mgr.24569) 1106 : cluster [DBG] pgmap v956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:43.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:43.137398+0000 mon.smithi067 (mon.1) 207 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:00:43.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:43.138942+0000 mon.smithi067 (mon.1) 208 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:00:43.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:43.139906+0000 mon.smithi067 (mon.1) 209 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:00:43.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:43.137398+0000 mon.smithi067 (mon.1) 207 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:00:43.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:43.138942+0000 mon.smithi067 (mon.1) 208 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:00:43.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:43.139906+0000 mon.smithi067 (mon.1) 209 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:00:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:00:43.140810+0000 mgr.smithi067.rdualw (mgr.24569) 1107 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:00:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:44.097283+0000 mgr.smithi067.rdualw (mgr.24569) 1108 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:00:43.140810+0000 mgr.smithi067.rdualw (mgr.24569) 1107 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:00:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:44.097283+0000 mgr.smithi067.rdualw (mgr.24569) 1108 : cluster [DBG] pgmap v957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:46.098008+0000 mgr.smithi067.rdualw (mgr.24569) 1109 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:00:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:46.098008+0000 mgr.smithi067.rdualw (mgr.24569) 1109 : cluster [DBG] pgmap v958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:00:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:47.932913+0000 mon.smithi061 (mon.0) 422 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:00:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:48.098446+0000 mgr.smithi067.rdualw (mgr.24569) 1110 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:48.331023+0000 mon.smithi067 (mon.1) 210 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:00:49.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:48.331436+0000 mon.smithi061 (mon.0) 423 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:00:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:47.932913+0000 mon.smithi061 (mon.0) 422 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:00:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:48.098446+0000 mgr.smithi067.rdualw (mgr.24569) 1110 : cluster [DBG] pgmap v959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:48.331023+0000 mon.smithi067 (mon.1) 210 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:00:49.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:48.331436+0000 mon.smithi061 (mon.0) 423 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:00:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:50.099041+0000 mgr.smithi067.rdualw (mgr.24569) 1111 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:50.099041+0000 mgr.smithi067.rdualw (mgr.24569) 1111 : cluster [DBG] pgmap v960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:50.558181+0000 mon.smithi061 (mon.0) 424 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:00:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:50.964841+0000 mon.smithi067 (mon.1) 211 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:00:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:50.965315+0000 mon.smithi061 (mon.0) 425 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:00:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:50.970068+0000 mon.smithi061 (mon.0) 426 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:00:51.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:00:50.977836+0000 mon.smithi061 (mon.0) 427 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:00:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:50.558181+0000 mon.smithi061 (mon.0) 424 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:00:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:50.964841+0000 mon.smithi067 (mon.1) 211 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:00:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:50.965315+0000 mon.smithi061 (mon.0) 425 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:00:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:50.970068+0000 mon.smithi061 (mon.0) 426 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:00:52.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:00:50.977836+0000 mon.smithi061 (mon.0) 427 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:00:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:52.100091+0000 mgr.smithi067.rdualw (mgr.24569) 1112 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:52.100091+0000 mgr.smithi067.rdualw (mgr.24569) 1112 : cluster [DBG] pgmap v961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:54.100793+0000 mgr.smithi067.rdualw (mgr.24569) 1113 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:54.100793+0000 mgr.smithi067.rdualw (mgr.24569) 1113 : cluster [DBG] pgmap v962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:56.101915+0000 mgr.smithi067.rdualw (mgr.24569) 1114 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:00:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:56.101915+0000 mgr.smithi067.rdualw (mgr.24569) 1114 : cluster [DBG] pgmap v963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:00:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:00:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:00:58.102545+0000 mgr.smithi067.rdualw (mgr.24569) 1115 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:00:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:00:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:00:58.102545+0000 mgr.smithi067.rdualw (mgr.24569) 1115 : cluster [DBG] pgmap v964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:00.103279+0000 mgr.smithi067.rdualw (mgr.24569) 1116 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:00.103279+0000 mgr.smithi067.rdualw (mgr.24569) 1116 : cluster [DBG] pgmap v965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:02.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:02.104154+0000 mgr.smithi067.rdualw (mgr.24569) 1117 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:02.104154+0000 mgr.smithi067.rdualw (mgr.24569) 1117 : cluster [DBG] pgmap v966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:03.792 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:01:04.081 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:01:04.082 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (38m) 13s ago 39m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:01:04.082 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (31m) 13s ago 39m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:01:04.082 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (31m) 16s ago 39m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:01:04.082 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (38m) 13s ago 39m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:01:04.083 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (31m) 13s ago 35m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:01:04.083 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (31m) 16s ago 35m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:01:04.083 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (32m) 13s ago 40m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:01:04.083 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (32m) 16s ago 39m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:01:04.084 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (32m) 13s ago 40m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:01:04.084 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (32m) 16s ago 38m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:01:04.084 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (33m) 13s ago 33m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:01:04.084 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (32m) 16s ago 32m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:01:04.084 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (39m) 13s ago 39m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:01:04.085 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (38m) 16s ago 38m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:01:04.085 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (22m) 13s ago 38m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:01:04.085 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (38m) 13s ago 38m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:01:04.085 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (37m) 13s ago 37m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:01:04.086 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (37m) 13s ago 37m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:01:04.086 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (37m) 16s ago 37m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:01:04.086 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (37m) 16s ago 37m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:01:04.086 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (36m) 16s ago 36m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:01:04.086 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (36m) 16s ago 36m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:01:04.087 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (38m) 13s ago 39m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:01:04.424 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:01:04.424 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:01:04.425 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:01:04.425 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:01:04.425 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:01:04.425 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:01:04.425 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:01:04.426 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:01:04.426 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:01:04.427 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:01:04.427 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:01:04.427 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:01:04.427 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:01:04.427 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:01:04.428 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:01:04.428 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:01:04.428 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:01:04.428 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:01:04.429 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:01:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:01:03.778688+0000 mgr.smithi067.rdualw (mgr.24569) 1118 : audit [DBG] from='client.34882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:01:04.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:01:04.063846+0000 mgr.smithi067.rdualw (mgr.24569) 1119 : audit [DBG] from='client.34886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:01:04.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:04.104975+0000 mgr.smithi067.rdualw (mgr.24569) 1120 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:01:03.778688+0000 mgr.smithi067.rdualw (mgr.24569) 1118 : audit [DBG] from='client.34882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:01:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:01:04.063846+0000 mgr.smithi067.rdualw (mgr.24569) 1119 : audit [DBG] from='client.34886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:01:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:04.104975+0000 mgr.smithi067.rdualw (mgr.24569) 1120 : cluster [DBG] pgmap v967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:05.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:01:04.422492+0000 mon.smithi061 (mon.0) 428 : audit [DBG] from='client.? 172.21.15.61:0/3626414133' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:01:05.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:01:04.422492+0000 mon.smithi061 (mon.0) 428 : audit [DBG] from='client.? 172.21.15.61:0/3626414133' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:01:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:06.106024+0000 mgr.smithi067.rdualw (mgr.24569) 1121 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:01:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:06.106024+0000 mgr.smithi067.rdualw (mgr.24569) 1121 : cluster [DBG] pgmap v968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:01:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:08.106606+0000 mgr.smithi067.rdualw (mgr.24569) 1122 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:08.106606+0000 mgr.smithi067.rdualw (mgr.24569) 1122 : cluster [DBG] pgmap v969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:10.107227+0000 mgr.smithi067.rdualw (mgr.24569) 1123 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:10.107227+0000 mgr.smithi067.rdualw (mgr.24569) 1123 : cluster [DBG] pgmap v970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:12.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:12.108265+0000 mgr.smithi067.rdualw (mgr.24569) 1124 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:12.108265+0000 mgr.smithi067.rdualw (mgr.24569) 1124 : cluster [DBG] pgmap v971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:14.108830+0000 mgr.smithi067.rdualw (mgr.24569) 1125 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:14.108830+0000 mgr.smithi067.rdualw (mgr.24569) 1125 : cluster [DBG] pgmap v972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:16.109746+0000 mgr.smithi067.rdualw (mgr.24569) 1126 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:01:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:16.109746+0000 mgr.smithi067.rdualw (mgr.24569) 1126 : cluster [DBG] pgmap v973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:01:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:18.110265+0000 mgr.smithi067.rdualw (mgr.24569) 1127 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:18.110265+0000 mgr.smithi067.rdualw (mgr.24569) 1127 : cluster [DBG] pgmap v974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:20.110949+0000 mgr.smithi067.rdualw (mgr.24569) 1128 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:20.110949+0000 mgr.smithi067.rdualw (mgr.24569) 1128 : cluster [DBG] pgmap v975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:22.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:22.111813+0000 mgr.smithi067.rdualw (mgr.24569) 1129 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:22.111813+0000 mgr.smithi067.rdualw (mgr.24569) 1129 : cluster [DBG] pgmap v976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:24.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:24.112509+0000 mgr.smithi067.rdualw (mgr.24569) 1130 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:24.112509+0000 mgr.smithi067.rdualw (mgr.24569) 1130 : cluster [DBG] pgmap v977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:26.113275+0000 mgr.smithi067.rdualw (mgr.24569) 1131 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:01:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:26.113275+0000 mgr.smithi067.rdualw (mgr.24569) 1131 : cluster [DBG] pgmap v978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:01:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:28.113767+0000 mgr.smithi067.rdualw (mgr.24569) 1132 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:28.113767+0000 mgr.smithi067.rdualw (mgr.24569) 1132 : cluster [DBG] pgmap v979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:30.114390+0000 mgr.smithi067.rdualw (mgr.24569) 1133 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:30.114390+0000 mgr.smithi067.rdualw (mgr.24569) 1133 : cluster [DBG] pgmap v980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:32.115218+0000 mgr.smithi067.rdualw (mgr.24569) 1134 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:32.115218+0000 mgr.smithi067.rdualw (mgr.24569) 1134 : cluster [DBG] pgmap v981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:34.115802+0000 mgr.smithi067.rdualw (mgr.24569) 1135 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:34.115802+0000 mgr.smithi067.rdualw (mgr.24569) 1135 : cluster [DBG] pgmap v982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:34.734 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:01:35.044 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:01:35.045 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (39m) 44s ago 40m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:01:35.045 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (31m) 44s ago 40m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:01:35.045 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (31m) 47s ago 39m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:01:35.045 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (38m) 44s ago 40m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:01:35.046 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (32m) 44s ago 35m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:01:35.046 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (32m) 47s ago 35m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:01:35.046 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (33m) 44s ago 41m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:01:35.046 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (32m) 47s ago 39m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:01:35.046 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (32m) 44s ago 41m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:01:35.047 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (32m) 47s ago 39m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:01:35.047 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (33m) 44s ago 33m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:01:35.047 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (33m) 47s ago 33m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:01:35.047 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (39m) 44s ago 39m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:01:35.048 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (39m) 47s ago 39m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:01:35.048 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (22m) 44s ago 39m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:01:35.048 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (38m) 44s ago 38m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:01:35.048 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (38m) 44s ago 38m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:01:35.048 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (38m) 44s ago 38m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:01:35.049 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (37m) 47s ago 37m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:01:35.049 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (37m) 47s ago 37m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:01:35.049 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (37m) 47s ago 37m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:01:35.049 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (37m) 47s ago 37m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:01:35.049 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (38m) 44s ago 39m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:01:35.385 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:01:35.386 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:01:35.386 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:01:35.386 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:01:35.386 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:01:35.387 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:01:35.387 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:01:35.387 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:01:35.387 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:01:35.388 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:01:35.388 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:01:35.388 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:01:35.389 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:01:35.389 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:01:35.389 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:01:35.389 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:01:35.389 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:01:35.390 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:01:35.390 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:01:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:01:34.597553+0000 mon.smithi067 (mon.1) 212 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:01:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:01:34.597914+0000 mon.smithi067 (mon.1) 213 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:01:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:01:34.598010+0000 mon.smithi061 (mon.0) 429 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:01:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:01:34.598360+0000 mon.smithi061 (mon.0) 430 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:01:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:01:34.721094+0000 mgr.smithi067.rdualw (mgr.24569) 1136 : audit [DBG] from='client.34894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:01:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:01:35.026847+0000 mgr.smithi067.rdualw (mgr.24569) 1137 : audit [DBG] from='client.34898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:01:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:01:35.384299+0000 mon.smithi061 (mon.0) 431 : audit [DBG] from='client.? 172.21.15.61:0/1951185459' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:01:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:01:34.597553+0000 mon.smithi067 (mon.1) 212 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:01:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:01:34.597914+0000 mon.smithi067 (mon.1) 213 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:01:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:01:34.598010+0000 mon.smithi061 (mon.0) 429 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:01:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:01:34.598360+0000 mon.smithi061 (mon.0) 430 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:01:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:01:34.721094+0000 mgr.smithi067.rdualw (mgr.24569) 1136 : audit [DBG] from='client.34894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:01:35.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:01:35.026847+0000 mgr.smithi067.rdualw (mgr.24569) 1137 : audit [DBG] from='client.34898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:01:35.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:01:35.384299+0000 mon.smithi061 (mon.0) 431 : audit [DBG] from='client.? 172.21.15.61:0/1951185459' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:01:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:36.116816+0000 mgr.smithi067.rdualw (mgr.24569) 1138 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:01:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:36.116816+0000 mgr.smithi067.rdualw (mgr.24569) 1138 : cluster [DBG] pgmap v983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:01:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:38.117445+0000 mgr.smithi067.rdualw (mgr.24569) 1139 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:38.117445+0000 mgr.smithi067.rdualw (mgr.24569) 1139 : cluster [DBG] pgmap v984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:40.118155+0000 mgr.smithi067.rdualw (mgr.24569) 1140 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:40.118155+0000 mgr.smithi067.rdualw (mgr.24569) 1140 : cluster [DBG] pgmap v985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:42.119271+0000 mgr.smithi067.rdualw (mgr.24569) 1141 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:42.119271+0000 mgr.smithi067.rdualw (mgr.24569) 1141 : cluster [DBG] pgmap v986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:44.119877+0000 mgr.smithi067.rdualw (mgr.24569) 1142 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:44.119877+0000 mgr.smithi067.rdualw (mgr.24569) 1142 : cluster [DBG] pgmap v987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:46.120967+0000 mgr.smithi067.rdualw (mgr.24569) 1143 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:01:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:46.120967+0000 mgr.smithi067.rdualw (mgr.24569) 1143 : cluster [DBG] pgmap v988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:01:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:48.121418+0000 mgr.smithi067.rdualw (mgr.24569) 1144 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:48.121418+0000 mgr.smithi067.rdualw (mgr.24569) 1144 : cluster [DBG] pgmap v989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:50.122154+0000 mgr.smithi067.rdualw (mgr.24569) 1145 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:50.122154+0000 mgr.smithi067.rdualw (mgr.24569) 1145 : cluster [DBG] pgmap v990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:01:50.982483+0000 mon.smithi067 (mon.1) 214 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:01:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:01:50.983961+0000 mon.smithi067 (mon.1) 215 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:01:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:01:50.984957+0000 mon.smithi067 (mon.1) 216 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:01:51.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:01:50.985821+0000 mgr.smithi067.rdualw (mgr.24569) 1146 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:01:51.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:01:51.408703+0000 mon.smithi061 (mon.0) 432 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:01:51.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:01:51.414896+0000 mon.smithi061 (mon.0) 433 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:01:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:01:50.982483+0000 mon.smithi067 (mon.1) 214 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:01:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:01:50.983961+0000 mon.smithi067 (mon.1) 215 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:01:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:01:50.984957+0000 mon.smithi067 (mon.1) 216 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:01:51.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:01:50.985821+0000 mgr.smithi067.rdualw (mgr.24569) 1146 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:01:51.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:01:51.408703+0000 mon.smithi061 (mon.0) 432 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:01:51.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:01:51.414896+0000 mon.smithi061 (mon.0) 433 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:01:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:52.123049+0000 mgr.smithi067.rdualw (mgr.24569) 1147 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:52.123049+0000 mgr.smithi067.rdualw (mgr.24569) 1147 : cluster [DBG] pgmap v991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:54.123617+0000 mgr.smithi067.rdualw (mgr.24569) 1148 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:54.123617+0000 mgr.smithi067.rdualw (mgr.24569) 1148 : cluster [DBG] pgmap v992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:56.124413+0000 mgr.smithi067.rdualw (mgr.24569) 1149 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:01:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:56.124413+0000 mgr.smithi067.rdualw (mgr.24569) 1149 : cluster [DBG] pgmap v993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:01:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:01:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:01:58.125021+0000 mgr.smithi067.rdualw (mgr.24569) 1150 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:01:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:01:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:01:58.125021+0000 mgr.smithi067.rdualw (mgr.24569) 1150 : cluster [DBG] pgmap v994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:00.125795+0000 mgr.smithi067.rdualw (mgr.24569) 1151 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:00.125795+0000 mgr.smithi067.rdualw (mgr.24569) 1151 : cluster [DBG] pgmap v995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:02.126650+0000 mgr.smithi067.rdualw (mgr.24569) 1152 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:02.126650+0000 mgr.smithi067.rdualw (mgr.24569) 1152 : cluster [DBG] pgmap v996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:04.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:04.127228+0000 mgr.smithi067.rdualw (mgr.24569) 1153 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:04.127228+0000 mgr.smithi067.rdualw (mgr.24569) 1153 : cluster [DBG] pgmap v997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:05.691 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:02:06.007 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:02:06.007 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (39m) 75s ago 40m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:02:06.007 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (32m) 75s ago 40m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:02:06.008 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (32m) 78s ago 40m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:02:06.008 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (39m) 75s ago 40m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:02:06.008 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (32m) 75s ago 36m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:02:06.008 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (32m) 78s ago 36m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:02:06.008 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (33m) 75s ago 41m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:02:06.009 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (33m) 78s ago 40m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:02:06.009 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (33m) 75s ago 41m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:02:06.009 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (33m) 78s ago 40m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:02:06.009 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (34m) 75s ago 34m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:02:06.009 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (33m) 78s ago 33m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:02:06.010 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (40m) 75s ago 40m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:02:06.010 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (39m) 78s ago 39m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:02:06.010 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (23m) 75s ago 39m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:02:06.010 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (39m) 75s ago 39m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:02:06.011 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (39m) 75s ago 38m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:02:06.011 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (38m) 75s ago 38m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:02:06.011 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (38m) 78s ago 38m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:02:06.012 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (38m) 78s ago 38m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:02:06.012 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (37m) 78s ago 37m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:02:06.012 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (37m) 78s ago 37m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:02:06.012 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (39m) 75s ago 40m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:02:06.355 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:02:06.355 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:02:06.356 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:02:06.356 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:02:06.356 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:02:06.356 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:02:06.357 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:02:06.357 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:02:06.357 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:02:06.357 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:02:06.358 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:02:06.358 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:02:06.358 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:02:06.358 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:02:06.359 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:02:06.359 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:02:06.359 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:02:06.359 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:02:06.360 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:02:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:02:05.678117+0000 mgr.smithi067.rdualw (mgr.24569) 1154 : audit [DBG] from='client.34906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:02:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:02:05.989392+0000 mgr.smithi067.rdualw (mgr.24569) 1155 : audit [DBG] from='client.34910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:02:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:06.128068+0000 mgr.smithi067.rdualw (mgr.24569) 1156 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:02:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:02:05.678117+0000 mgr.smithi067.rdualw (mgr.24569) 1154 : audit [DBG] from='client.34906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:02:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:02:05.989392+0000 mgr.smithi067.rdualw (mgr.24569) 1155 : audit [DBG] from='client.34910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:02:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:06.128068+0000 mgr.smithi067.rdualw (mgr.24569) 1156 : cluster [DBG] pgmap v998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:02:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:02:06.353687+0000 mon.smithi061 (mon.0) 434 : audit [DBG] from='client.? 172.21.15.61:0/2627732006' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:02:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:02:06.353687+0000 mon.smithi061 (mon.0) 434 : audit [DBG] from='client.? 172.21.15.61:0/2627732006' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:02:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:08.128739+0000 mgr.smithi067.rdualw (mgr.24569) 1157 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:08.128739+0000 mgr.smithi067.rdualw (mgr.24569) 1157 : cluster [DBG] pgmap v999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:10.129357+0000 mgr.smithi067.rdualw (mgr.24569) 1158 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:10.129357+0000 mgr.smithi067.rdualw (mgr.24569) 1158 : cluster [DBG] pgmap v1000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:12.130205+0000 mgr.smithi067.rdualw (mgr.24569) 1159 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:12.130205+0000 mgr.smithi067.rdualw (mgr.24569) 1159 : cluster [DBG] pgmap v1001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:14.130792+0000 mgr.smithi067.rdualw (mgr.24569) 1160 : cluster [DBG] pgmap v1002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:14.130792+0000 mgr.smithi067.rdualw (mgr.24569) 1160 : cluster [DBG] pgmap v1002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:16.131825+0000 mgr.smithi067.rdualw (mgr.24569) 1161 : cluster [DBG] pgmap v1003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:02:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:16.131825+0000 mgr.smithi067.rdualw (mgr.24569) 1161 : cluster [DBG] pgmap v1003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:02:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:18.132344+0000 mgr.smithi067.rdualw (mgr.24569) 1162 : cluster [DBG] pgmap v1004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:18.132344+0000 mgr.smithi067.rdualw (mgr.24569) 1162 : cluster [DBG] pgmap v1004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:20.133065+0000 mgr.smithi067.rdualw (mgr.24569) 1163 : cluster [DBG] pgmap v1005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:20.133065+0000 mgr.smithi067.rdualw (mgr.24569) 1163 : cluster [DBG] pgmap v1005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:22.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:22.134013+0000 mgr.smithi067.rdualw (mgr.24569) 1164 : cluster [DBG] pgmap v1006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:22.134013+0000 mgr.smithi067.rdualw (mgr.24569) 1164 : cluster [DBG] pgmap v1006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:24.134743+0000 mgr.smithi067.rdualw (mgr.24569) 1165 : cluster [DBG] pgmap v1007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:24.134743+0000 mgr.smithi067.rdualw (mgr.24569) 1165 : cluster [DBG] pgmap v1007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:26.135557+0000 mgr.smithi067.rdualw (mgr.24569) 1166 : cluster [DBG] pgmap v1008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:02:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:26.135557+0000 mgr.smithi067.rdualw (mgr.24569) 1166 : cluster [DBG] pgmap v1008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:02:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:28.136158+0000 mgr.smithi067.rdualw (mgr.24569) 1167 : cluster [DBG] pgmap v1009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:28.136158+0000 mgr.smithi067.rdualw (mgr.24569) 1167 : cluster [DBG] pgmap v1009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:30.136793+0000 mgr.smithi067.rdualw (mgr.24569) 1168 : cluster [DBG] pgmap v1010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:30.136793+0000 mgr.smithi067.rdualw (mgr.24569) 1168 : cluster [DBG] pgmap v1010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:32.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:32.137835+0000 mgr.smithi067.rdualw (mgr.24569) 1169 : cluster [DBG] pgmap v1011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:32.137835+0000 mgr.smithi067.rdualw (mgr.24569) 1169 : cluster [DBG] pgmap v1011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:34.138574+0000 mgr.smithi067.rdualw (mgr.24569) 1170 : cluster [DBG] pgmap v1012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:34.138574+0000 mgr.smithi067.rdualw (mgr.24569) 1170 : cluster [DBG] pgmap v1012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:02:34.603161+0000 mon.smithi067 (mon.1) 217 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:02:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:02:34.603415+0000 mon.smithi067 (mon.1) 218 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:02:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:02:34.603639+0000 mon.smithi061 (mon.0) 435 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:02:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:02:34.603962+0000 mon.smithi061 (mon.0) 436 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:02:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:02:34.603161+0000 mon.smithi067 (mon.1) 217 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:02:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:02:34.603415+0000 mon.smithi067 (mon.1) 218 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:02:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:02:34.603639+0000 mon.smithi061 (mon.0) 435 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:02:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:02:34.603962+0000 mon.smithi061 (mon.0) 436 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:02:36.662 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:02:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:36.139402+0000 mgr.smithi067.rdualw (mgr.24569) 1171 : cluster [DBG] pgmap v1013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:02:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:36.139402+0000 mgr.smithi067.rdualw (mgr.24569) 1171 : cluster [DBG] pgmap v1013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:02:36.955 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:02:36.955 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (40m) 106s ago 41m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:02:36.955 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (32m) 106s ago 41m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:02:36.955 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (32m) 109s ago 40m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:02:36.956 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (40m) 106s ago 41m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:02:36.956 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (33m) 106s ago 36m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:02:36.956 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (33m) 109s ago 36m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:02:36.956 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (34m) 106s ago 42m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:02:36.957 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (33m) 109s ago 40m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:02:36.957 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (33m) 106s ago 42m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:02:36.957 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (33m) 109s ago 40m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:02:36.957 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (34m) 106s ago 34m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:02:36.958 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (34m) 109s ago 34m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:02:36.958 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (40m) 106s ago 40m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:02:36.958 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (40m) 109s ago 40m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:02:36.958 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (23m) 106s ago 40m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:02:36.959 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (39m) 106s ago 39m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:02:36.959 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (39m) 106s ago 39m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:02:36.959 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (39m) 106s ago 39m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:02:36.959 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (38m) 109s ago 38m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:02:36.959 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (38m) 109s ago 38m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:02:36.960 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (38m) 109s ago 38m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:02:36.960 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (38m) 109s ago 38m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:02:36.960 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (39m) 106s ago 40m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:02:37.297 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:02:37.298 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:02:37.298 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:02:37.298 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:02:37.298 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:02:37.299 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:02:37.299 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:02:37.299 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:02:37.299 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:02:37.299 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:02:37.300 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:02:37.300 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:02:37.300 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:02:37.300 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:02:37.301 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:02:37.301 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:02:37.301 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:02:37.301 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:02:37.301 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:02:37.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:02:36.648310+0000 mgr.smithi067.rdualw (mgr.24569) 1172 : audit [DBG] from='client.34918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:02:37.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:02:36.936371+0000 mgr.smithi067.rdualw (mgr.24569) 1173 : audit [DBG] from='client.34922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:02:37.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:02:37.293736+0000 mon.smithi061 (mon.0) 437 : audit [DBG] from='client.? 172.21.15.61:0/608943160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:02:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:02:36.648310+0000 mgr.smithi067.rdualw (mgr.24569) 1172 : audit [DBG] from='client.34918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:02:37.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:02:36.936371+0000 mgr.smithi067.rdualw (mgr.24569) 1173 : audit [DBG] from='client.34922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:02:37.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:02:37.293736+0000 mon.smithi061 (mon.0) 437 : audit [DBG] from='client.? 172.21.15.61:0/608943160' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:02:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:38.139919+0000 mgr.smithi067.rdualw (mgr.24569) 1174 : cluster [DBG] pgmap v1014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:38.139919+0000 mgr.smithi067.rdualw (mgr.24569) 1174 : cluster [DBG] pgmap v1014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:40.140490+0000 mgr.smithi067.rdualw (mgr.24569) 1175 : cluster [DBG] pgmap v1015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:40.140490+0000 mgr.smithi067.rdualw (mgr.24569) 1175 : cluster [DBG] pgmap v1015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:42.141584+0000 mgr.smithi067.rdualw (mgr.24569) 1176 : cluster [DBG] pgmap v1016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:42.141584+0000 mgr.smithi067.rdualw (mgr.24569) 1176 : cluster [DBG] pgmap v1016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:44.142225+0000 mgr.smithi067.rdualw (mgr.24569) 1177 : cluster [DBG] pgmap v1017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:44.142225+0000 mgr.smithi067.rdualw (mgr.24569) 1177 : cluster [DBG] pgmap v1017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:46.143269+0000 mgr.smithi067.rdualw (mgr.24569) 1178 : cluster [DBG] pgmap v1018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:02:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:46.143269+0000 mgr.smithi067.rdualw (mgr.24569) 1178 : cluster [DBG] pgmap v1018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:02:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:48.143952+0000 mgr.smithi067.rdualw (mgr.24569) 1179 : cluster [DBG] pgmap v1019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:48.143952+0000 mgr.smithi067.rdualw (mgr.24569) 1179 : cluster [DBG] pgmap v1019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:50.144657+0000 mgr.smithi067.rdualw (mgr.24569) 1180 : cluster [DBG] pgmap v1020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:50.144657+0000 mgr.smithi067.rdualw (mgr.24569) 1180 : cluster [DBG] pgmap v1020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:51.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:02:51.418746+0000 mon.smithi067 (mon.1) 219 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:02:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:02:51.420314+0000 mon.smithi067 (mon.1) 220 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:02:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:02:51.421282+0000 mon.smithi067 (mon.1) 221 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:02:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:02:51.418746+0000 mon.smithi067 (mon.1) 219 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:02:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:02:51.420314+0000 mon.smithi067 (mon.1) 220 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:02:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:02:51.421282+0000 mon.smithi067 (mon.1) 221 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:02:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:02:51.422106+0000 mgr.smithi067.rdualw (mgr.24569) 1181 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:02:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:02:51.787952+0000 mon.smithi061 (mon.0) 438 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:02:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:02:51.798744+0000 mon.smithi061 (mon.0) 439 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:02:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:52.145455+0000 mgr.smithi067.rdualw (mgr.24569) 1182 : cluster [DBG] pgmap v1021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:53.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:02:52.196156+0000 mon.smithi061 (mon.0) 440 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:02:53.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:02:52.202077+0000 mon.smithi061 (mon.0) 441 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:02:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:02:51.422106+0000 mgr.smithi067.rdualw (mgr.24569) 1181 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:02:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:02:51.787952+0000 mon.smithi061 (mon.0) 438 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:02:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:02:51.798744+0000 mon.smithi061 (mon.0) 439 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:02:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:52.145455+0000 mgr.smithi067.rdualw (mgr.24569) 1182 : cluster [DBG] pgmap v1021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:02:52.196156+0000 mon.smithi061 (mon.0) 440 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:02:53.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:02:52.202077+0000 mon.smithi061 (mon.0) 441 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:02:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:54.145990+0000 mgr.smithi067.rdualw (mgr.24569) 1183 : cluster [DBG] pgmap v1022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:54.145990+0000 mgr.smithi067.rdualw (mgr.24569) 1183 : cluster [DBG] pgmap v1022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:56.146936+0000 mgr.smithi067.rdualw (mgr.24569) 1184 : cluster [DBG] pgmap v1023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:02:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:56.146936+0000 mgr.smithi067.rdualw (mgr.24569) 1184 : cluster [DBG] pgmap v1023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:02:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:02:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:02:58.147458+0000 mgr.smithi067.rdualw (mgr.24569) 1185 : cluster [DBG] pgmap v1024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:02:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:02:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:02:58.147458+0000 mgr.smithi067.rdualw (mgr.24569) 1185 : cluster [DBG] pgmap v1024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:00.148024+0000 mgr.smithi067.rdualw (mgr.24569) 1186 : cluster [DBG] pgmap v1025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:00.148024+0000 mgr.smithi067.rdualw (mgr.24569) 1186 : cluster [DBG] pgmap v1025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:02.149054+0000 mgr.smithi067.rdualw (mgr.24569) 1187 : cluster [DBG] pgmap v1026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:02.149054+0000 mgr.smithi067.rdualw (mgr.24569) 1187 : cluster [DBG] pgmap v1026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:04.149721+0000 mgr.smithi067.rdualw (mgr.24569) 1188 : cluster [DBG] pgmap v1027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:04.149721+0000 mgr.smithi067.rdualw (mgr.24569) 1188 : cluster [DBG] pgmap v1027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:06.150710+0000 mgr.smithi067.rdualw (mgr.24569) 1189 : cluster [DBG] pgmap v1028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:03:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:06.150710+0000 mgr.smithi067.rdualw (mgr.24569) 1189 : cluster [DBG] pgmap v1028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:03:07.602 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:03:07.897 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:03:07.897 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (40m) 2m ago 41m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:03:07.898 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (33m) 2m ago 41m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:03:07.898 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (33m) 2m ago 41m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:03:07.898 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (40m) 2m ago 41m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:03:07.899 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (33m) 2m ago 37m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:03:07.899 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (33m) 2m ago 37m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:03:07.900 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (34m) 2m ago 42m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:03:07.900 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (34m) 2m ago 41m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:03:07.900 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (34m) 2m ago 43m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:03:07.901 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (34m) 2m ago 41m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:03:07.901 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (35m) 2m ago 35m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:03:07.901 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (35m) 2m ago 35m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:03:07.902 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (41m) 2m ago 41m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:03:07.902 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (40m) 2m ago 40m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:03:07.902 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (24m) 2m ago 40m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:03:07.903 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (40m) 2m ago 40m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:03:07.903 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (40m) 2m ago 40m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:03:07.903 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (39m) 2m ago 39m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:03:07.904 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (39m) 2m ago 39m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:03:07.904 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (39m) 2m ago 39m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:03:07.904 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (39m) 2m ago 39m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:03:07.904 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (38m) 2m ago 38m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:03:07.905 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (40m) 2m ago 41m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:03:08.317 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:03:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:03:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:03:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:03:08.318 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:03:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:03:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:03:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:03:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:03:08.319 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:03:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:03:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:03:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:03:08.320 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:03:08.321 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:03:08.321 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:03:08.321 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:03:08.321 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:03:08.322 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:03:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:03:07.588593+0000 mgr.smithi067.rdualw (mgr.24569) 1190 : audit [DBG] from='client.34930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:03:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:03:07.878815+0000 mgr.smithi067.rdualw (mgr.24569) 1191 : audit [DBG] from='client.34934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:03:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:08.151247+0000 mgr.smithi067.rdualw (mgr.24569) 1192 : cluster [DBG] pgmap v1029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:03:07.588593+0000 mgr.smithi067.rdualw (mgr.24569) 1190 : audit [DBG] from='client.34930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:03:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:03:07.878815+0000 mgr.smithi067.rdualw (mgr.24569) 1191 : audit [DBG] from='client.34934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:03:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:08.151247+0000 mgr.smithi067.rdualw (mgr.24569) 1192 : cluster [DBG] pgmap v1029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:09.556 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:03:08.315989+0000 mon.smithi061 (mon.0) 442 : audit [DBG] from='client.? 172.21.15.61:0/1298663702' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:03:09.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:03:08.315989+0000 mon.smithi061 (mon.0) 442 : audit [DBG] from='client.? 172.21.15.61:0/1298663702' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:03:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:10.151770+0000 mgr.smithi067.rdualw (mgr.24569) 1193 : cluster [DBG] pgmap v1030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:10.151770+0000 mgr.smithi067.rdualw (mgr.24569) 1193 : cluster [DBG] pgmap v1030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:12.152805+0000 mgr.smithi067.rdualw (mgr.24569) 1194 : cluster [DBG] pgmap v1031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:12.152805+0000 mgr.smithi067.rdualw (mgr.24569) 1194 : cluster [DBG] pgmap v1031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:14.153492+0000 mgr.smithi067.rdualw (mgr.24569) 1195 : cluster [DBG] pgmap v1032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:14.153492+0000 mgr.smithi067.rdualw (mgr.24569) 1195 : cluster [DBG] pgmap v1032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:16.154443+0000 mgr.smithi067.rdualw (mgr.24569) 1196 : cluster [DBG] pgmap v1033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:03:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:16.154443+0000 mgr.smithi067.rdualw (mgr.24569) 1196 : cluster [DBG] pgmap v1033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:03:18.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:18.154907+0000 mgr.smithi067.rdualw (mgr.24569) 1197 : cluster [DBG] pgmap v1034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:18.154907+0000 mgr.smithi067.rdualw (mgr.24569) 1197 : cluster [DBG] pgmap v1034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:20.155704+0000 mgr.smithi067.rdualw (mgr.24569) 1198 : cluster [DBG] pgmap v1035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:20.155704+0000 mgr.smithi067.rdualw (mgr.24569) 1198 : cluster [DBG] pgmap v1035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:22.156740+0000 mgr.smithi067.rdualw (mgr.24569) 1199 : cluster [DBG] pgmap v1036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:22.156740+0000 mgr.smithi067.rdualw (mgr.24569) 1199 : cluster [DBG] pgmap v1036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:24.157356+0000 mgr.smithi067.rdualw (mgr.24569) 1200 : cluster [DBG] pgmap v1037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:24.157356+0000 mgr.smithi067.rdualw (mgr.24569) 1200 : cluster [DBG] pgmap v1037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:26.158343+0000 mgr.smithi067.rdualw (mgr.24569) 1201 : cluster [DBG] pgmap v1038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:03:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:26.158343+0000 mgr.smithi067.rdualw (mgr.24569) 1201 : cluster [DBG] pgmap v1038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:03:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:28.159077+0000 mgr.smithi067.rdualw (mgr.24569) 1202 : cluster [DBG] pgmap v1039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:28.159077+0000 mgr.smithi067.rdualw (mgr.24569) 1202 : cluster [DBG] pgmap v1039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:30.159663+0000 mgr.smithi067.rdualw (mgr.24569) 1203 : cluster [DBG] pgmap v1040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:30.159663+0000 mgr.smithi067.rdualw (mgr.24569) 1203 : cluster [DBG] pgmap v1040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:32.160649+0000 mgr.smithi067.rdualw (mgr.24569) 1204 : cluster [DBG] pgmap v1041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:32.160649+0000 mgr.smithi067.rdualw (mgr.24569) 1204 : cluster [DBG] pgmap v1041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:34.161240+0000 mgr.smithi067.rdualw (mgr.24569) 1205 : cluster [DBG] pgmap v1042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:34.161240+0000 mgr.smithi067.rdualw (mgr.24569) 1205 : cluster [DBG] pgmap v1042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:03:34.608703+0000 mon.smithi067 (mon.1) 222 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:03:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:03:34.609049+0000 mon.smithi067 (mon.1) 223 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:03:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:03:34.609102+0000 mon.smithi061 (mon.0) 443 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:03:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:03:34.609356+0000 mon.smithi061 (mon.0) 444 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:03:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:03:34.608703+0000 mon.smithi067 (mon.1) 222 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:03:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:03:34.609049+0000 mon.smithi067 (mon.1) 223 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:03:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:03:34.609102+0000 mon.smithi061 (mon.0) 443 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:03:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:03:34.609356+0000 mon.smithi061 (mon.0) 444 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:03:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:36.162141+0000 mgr.smithi067.rdualw (mgr.24569) 1206 : cluster [DBG] pgmap v1043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:03:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:36.162141+0000 mgr.smithi067.rdualw (mgr.24569) 1206 : cluster [DBG] pgmap v1043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:03:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:38.162679+0000 mgr.smithi067.rdualw (mgr.24569) 1207 : cluster [DBG] pgmap v1044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:38.162679+0000 mgr.smithi067.rdualw (mgr.24569) 1207 : cluster [DBG] pgmap v1044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:38.625 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:03:38.921 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:03:38.922 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (41m) 2m ago 42m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:03:38.922 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (33m) 2m ago 42m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:03:38.923 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (33m) 2m ago 41m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:03:38.923 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (41m) 2m ago 42m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:03:38.924 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (34m) 2m ago 37m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:03:38.924 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (34m) 2m ago 37m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:03:38.924 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (35m) 2m ago 43m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:03:38.925 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (34m) 2m ago 41m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:03:38.925 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (34m) 2m ago 43m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:03:38.926 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (34m) 2m ago 41m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:03:38.926 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (35m) 2m ago 35m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:03:38.927 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (35m) 2m ago 35m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:03:38.927 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (42m) 2m ago 42m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:03:38.927 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (41m) 2m ago 41m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:03:38.928 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (24m) 2m ago 41m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:03:38.928 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (40m) 2m ago 40m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:03:38.929 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (40m) 2m ago 40m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:03:38.929 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (40m) 2m ago 40m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:03:38.930 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (40m) 2m ago 40m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:03:38.930 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (39m) 2m ago 39m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:03:38.930 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (39m) 2m ago 39m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:03:38.931 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (39m) 2m ago 39m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:03:38.931 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (40m) 2m ago 41m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:03:39.261 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:03:39.261 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:03:39.262 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:03:39.262 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:03:39.262 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:03:39.262 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:03:39.263 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:03:39.263 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:03:39.263 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:03:39.263 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:03:39.263 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:03:39.264 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:03:39.264 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:03:39.264 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:03:39.264 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:03:39.265 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:03:39.265 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:03:39.265 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:03:39.265 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:03:39.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:03:38.611494+0000 mgr.smithi067.rdualw (mgr.24569) 1208 : audit [DBG] from='client.34942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:03:39.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:03:38.903043+0000 mgr.smithi067.rdualw (mgr.24569) 1209 : audit [DBG] from='client.34946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:03:39.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:03:38.611494+0000 mgr.smithi067.rdualw (mgr.24569) 1208 : audit [DBG] from='client.34942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:03:39.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:03:38.903043+0000 mgr.smithi067.rdualw (mgr.24569) 1209 : audit [DBG] from='client.34946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:03:40.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:03:39.259744+0000 mon.smithi061 (mon.0) 445 : audit [DBG] from='client.? 172.21.15.61:0/1132677811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:03:40.556 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:40.163200+0000 mgr.smithi067.rdualw (mgr.24569) 1210 : cluster [DBG] pgmap v1045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:03:39.259744+0000 mon.smithi061 (mon.0) 445 : audit [DBG] from='client.? 172.21.15.61:0/1132677811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:03:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:40.163200+0000 mgr.smithi067.rdualw (mgr.24569) 1210 : cluster [DBG] pgmap v1045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:42.164197+0000 mgr.smithi067.rdualw (mgr.24569) 1211 : cluster [DBG] pgmap v1046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:42.164197+0000 mgr.smithi067.rdualw (mgr.24569) 1211 : cluster [DBG] pgmap v1046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:44.164863+0000 mgr.smithi067.rdualw (mgr.24569) 1212 : cluster [DBG] pgmap v1047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:44.164863+0000 mgr.smithi067.rdualw (mgr.24569) 1212 : cluster [DBG] pgmap v1047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:46.165675+0000 mgr.smithi067.rdualw (mgr.24569) 1213 : cluster [DBG] pgmap v1048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:03:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:46.165675+0000 mgr.smithi067.rdualw (mgr.24569) 1213 : cluster [DBG] pgmap v1048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:03:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:48.166146+0000 mgr.smithi067.rdualw (mgr.24569) 1214 : cluster [DBG] pgmap v1049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:48.166146+0000 mgr.smithi067.rdualw (mgr.24569) 1214 : cluster [DBG] pgmap v1049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:50.166856+0000 mgr.smithi067.rdualw (mgr.24569) 1215 : cluster [DBG] pgmap v1050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:50.166856+0000 mgr.smithi067.rdualw (mgr.24569) 1215 : cluster [DBG] pgmap v1050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:52.167669+0000 mgr.smithi067.rdualw (mgr.24569) 1216 : cluster [DBG] pgmap v1051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:03:52.205476+0000 mon.smithi067 (mon.1) 224 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:03:52.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:03:52.206948+0000 mon.smithi067 (mon.1) 225 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:03:52.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:03:52.207838+0000 mon.smithi067 (mon.1) 226 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:03:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:52.167669+0000 mgr.smithi067.rdualw (mgr.24569) 1216 : cluster [DBG] pgmap v1051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:03:52.205476+0000 mon.smithi067 (mon.1) 224 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:03:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:03:52.206948+0000 mon.smithi067 (mon.1) 225 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:03:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:03:52.207838+0000 mon.smithi067 (mon.1) 226 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:03:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:03:52.208653+0000 mgr.smithi067.rdualw (mgr.24569) 1217 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:03:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:03:52.625762+0000 mon.smithi061 (mon.0) 446 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:03:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:03:52.631010+0000 mon.smithi061 (mon.0) 447 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:03:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:03:52.208653+0000 mgr.smithi067.rdualw (mgr.24569) 1217 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:03:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:03:52.625762+0000 mon.smithi061 (mon.0) 446 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:03:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:03:52.631010+0000 mon.smithi061 (mon.0) 447 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:03:55.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:54.168263+0000 mgr.smithi067.rdualw (mgr.24569) 1218 : cluster [DBG] pgmap v1052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:54.168263+0000 mgr.smithi067.rdualw (mgr.24569) 1218 : cluster [DBG] pgmap v1052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:56.169297+0000 mgr.smithi067.rdualw (mgr.24569) 1219 : cluster [DBG] pgmap v1053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:03:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:56.169297+0000 mgr.smithi067.rdualw (mgr.24569) 1219 : cluster [DBG] pgmap v1053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:03:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:03:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:03:58.169886+0000 mgr.smithi067.rdualw (mgr.24569) 1220 : cluster [DBG] pgmap v1054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:03:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:03:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:03:58.169886+0000 mgr.smithi067.rdualw (mgr.24569) 1220 : cluster [DBG] pgmap v1054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:00.170771+0000 mgr.smithi067.rdualw (mgr.24569) 1221 : cluster [DBG] pgmap v1055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:00.170771+0000 mgr.smithi067.rdualw (mgr.24569) 1221 : cluster [DBG] pgmap v1055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:03.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:02.171722+0000 mgr.smithi067.rdualw (mgr.24569) 1222 : cluster [DBG] pgmap v1056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:02.171722+0000 mgr.smithi067.rdualw (mgr.24569) 1222 : cluster [DBG] pgmap v1056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:04.172259+0000 mgr.smithi067.rdualw (mgr.24569) 1223 : cluster [DBG] pgmap v1057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:04.172259+0000 mgr.smithi067.rdualw (mgr.24569) 1223 : cluster [DBG] pgmap v1057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:06.173282+0000 mgr.smithi067.rdualw (mgr.24569) 1224 : cluster [DBG] pgmap v1058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:04:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:06.173282+0000 mgr.smithi067.rdualw (mgr.24569) 1224 : cluster [DBG] pgmap v1058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:04:09.573 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:04:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:08.173842+0000 mgr.smithi067.rdualw (mgr.24569) 1225 : cluster [DBG] pgmap v1059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:09.867 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:04:09.868 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (41m) 3m ago 42m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:04:09.868 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (34m) 3m ago 42m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:04:09.868 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (34m) 3m ago 42m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:04:09.868 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (41m) 3m ago 42m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:04:09.868 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (34m) 3m ago 38m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:04:09.869 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (34m) 3m ago 38m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:04:09.869 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (35m) 3m ago 43m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:04:09.869 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (35m) 3m ago 42m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:04:09.870 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (35m) 3m ago 44m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:04:09.870 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (35m) 3m ago 42m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:04:09.870 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (36m) 3m ago 36m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:04:09.870 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (36m) 3m ago 36m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:04:09.871 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (42m) 3m ago 42m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:04:09.871 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (41m) 3m ago 41m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:04:09.871 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (25m) 3m ago 41m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:04:09.872 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (41m) 3m ago 41m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:04:09.872 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (41m) 3m ago 41m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:04:09.872 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (40m) 3m ago 40m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:04:09.873 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (40m) 3m ago 40m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:04:09.873 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (40m) 3m ago 40m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:04:09.873 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (40m) 3m ago 40m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:04:09.873 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (39m) 3m ago 39m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:04:09.874 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (41m) 3m ago 42m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:04:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:08.173842+0000 mgr.smithi067.rdualw (mgr.24569) 1225 : cluster [DBG] pgmap v1059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:10.210 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:04:10.211 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:04:10.211 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:04:10.211 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:04:10.212 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:04:10.212 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:04:10.212 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:04:10.212 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:04:10.213 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:04:10.213 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:04:10.213 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:04:10.213 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:04:10.213 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:04:10.214 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:04:10.214 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:04:10.214 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:04:10.214 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:04:10.215 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:04:10.215 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:04:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:04:09.557276+0000 mgr.smithi067.rdualw (mgr.24569) 1226 : audit [DBG] from='client.34954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:04:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:04:09.849703+0000 mgr.smithi067.rdualw (mgr.24569) 1227 : audit [DBG] from='client.34958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:04:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:04:10.209255+0000 mon.smithi061 (mon.0) 448 : audit [DBG] from='client.? 172.21.15.61:0/3032250885' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:04:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:04:09.557276+0000 mgr.smithi067.rdualw (mgr.24569) 1226 : audit [DBG] from='client.34954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:04:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:04:09.849703+0000 mgr.smithi067.rdualw (mgr.24569) 1227 : audit [DBG] from='client.34958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:04:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:04:10.209255+0000 mon.smithi061 (mon.0) 448 : audit [DBG] from='client.? 172.21.15.61:0/3032250885' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:04:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:10.174404+0000 mgr.smithi067.rdualw (mgr.24569) 1228 : cluster [DBG] pgmap v1060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:10.174404+0000 mgr.smithi067.rdualw (mgr.24569) 1228 : cluster [DBG] pgmap v1060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:12.175197+0000 mgr.smithi067.rdualw (mgr.24569) 1229 : cluster [DBG] pgmap v1061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:14.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:12.175197+0000 mgr.smithi067.rdualw (mgr.24569) 1229 : cluster [DBG] pgmap v1061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:14.175955+0000 mgr.smithi067.rdualw (mgr.24569) 1230 : cluster [DBG] pgmap v1062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:14.175955+0000 mgr.smithi067.rdualw (mgr.24569) 1230 : cluster [DBG] pgmap v1062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:18.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:16.176758+0000 mgr.smithi067.rdualw (mgr.24569) 1231 : cluster [DBG] pgmap v1063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:04:18.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:16.176758+0000 mgr.smithi067.rdualw (mgr.24569) 1231 : cluster [DBG] pgmap v1063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:04:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:18.177265+0000 mgr.smithi067.rdualw (mgr.24569) 1232 : cluster [DBG] pgmap v1064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:18.177265+0000 mgr.smithi067.rdualw (mgr.24569) 1232 : cluster [DBG] pgmap v1064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:20.177913+0000 mgr.smithi067.rdualw (mgr.24569) 1233 : cluster [DBG] pgmap v1065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:20.177913+0000 mgr.smithi067.rdualw (mgr.24569) 1233 : cluster [DBG] pgmap v1065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:22.178731+0000 mgr.smithi067.rdualw (mgr.24569) 1234 : cluster [DBG] pgmap v1066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:22.178731+0000 mgr.smithi067.rdualw (mgr.24569) 1234 : cluster [DBG] pgmap v1066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:24.179453+0000 mgr.smithi067.rdualw (mgr.24569) 1235 : cluster [DBG] pgmap v1067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:24.179453+0000 mgr.smithi067.rdualw (mgr.24569) 1235 : cluster [DBG] pgmap v1067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:26.180487+0000 mgr.smithi067.rdualw (mgr.24569) 1236 : cluster [DBG] pgmap v1068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:04:28.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:26.180487+0000 mgr.smithi067.rdualw (mgr.24569) 1236 : cluster [DBG] pgmap v1068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:04:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:28.181102+0000 mgr.smithi067.rdualw (mgr.24569) 1237 : cluster [DBG] pgmap v1069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:28.181102+0000 mgr.smithi067.rdualw (mgr.24569) 1237 : cluster [DBG] pgmap v1069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:32.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:30.181746+0000 mgr.smithi067.rdualw (mgr.24569) 1238 : cluster [DBG] pgmap v1070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:32.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:30.181746+0000 mgr.smithi067.rdualw (mgr.24569) 1238 : cluster [DBG] pgmap v1070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:32.182657+0000 mgr.smithi067.rdualw (mgr.24569) 1239 : cluster [DBG] pgmap v1071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:34.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:32.182657+0000 mgr.smithi067.rdualw (mgr.24569) 1239 : cluster [DBG] pgmap v1071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:34.183370+0000 mgr.smithi067.rdualw (mgr.24569) 1240 : cluster [DBG] pgmap v1072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:04:34.613612+0000 mon.smithi067 (mon.1) 227 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:04:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:04:34.613867+0000 mon.smithi067 (mon.1) 228 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:04:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:04:34.613986+0000 mon.smithi061 (mon.0) 449 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:04:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:04:34.614302+0000 mon.smithi061 (mon.0) 450 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:04:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:34.183370+0000 mgr.smithi067.rdualw (mgr.24569) 1240 : cluster [DBG] pgmap v1072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:04:34.613612+0000 mon.smithi067 (mon.1) 227 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:04:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:04:34.613867+0000 mon.smithi067 (mon.1) 228 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:04:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:04:34.613986+0000 mon.smithi061 (mon.0) 449 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:04:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:04:34.614302+0000 mon.smithi061 (mon.0) 450 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:04:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:36.184346+0000 mgr.smithi067.rdualw (mgr.24569) 1241 : cluster [DBG] pgmap v1073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:04:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:36.184346+0000 mgr.smithi067.rdualw (mgr.24569) 1241 : cluster [DBG] pgmap v1073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:04:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:38.184928+0000 mgr.smithi067.rdualw (mgr.24569) 1242 : cluster [DBG] pgmap v1074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:38.184928+0000 mgr.smithi067.rdualw (mgr.24569) 1242 : cluster [DBG] pgmap v1074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:40.521 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:04:40.812 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:04:40.813 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (42m) 3m ago 43m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:04:40.813 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (34m) 3m ago 43m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:04:40.814 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (34m) 3m ago 42m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:04:40.815 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (42m) 3m ago 43m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:04:40.815 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (35m) 3m ago 38m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:04:40.816 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (35m) 3m ago 38m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:04:40.816 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (36m) 3m ago 44m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:04:40.816 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (36m) 3m ago 42m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:04:40.817 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (35m) 3m ago 44m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:04:40.817 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (35m) 3m ago 42m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:04:40.818 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (36m) 3m ago 36m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:04:40.819 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (36m) 3m ago 36m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:04:40.819 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (43m) 3m ago 43m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:04:40.819 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (42m) 3m ago 42m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:04:40.820 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (25m) 3m ago 42m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:04:40.820 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (41m) 3m ago 41m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:04:40.821 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (41m) 3m ago 41m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:04:40.821 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (41m) 3m ago 41m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:04:40.822 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (41m) 3m ago 41m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:04:40.822 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (40m) 3m ago 40m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:04:40.823 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (40m) 3m ago 40m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:04:40.823 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (40m) 3m ago 40m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:04:40.824 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (42m) 3m ago 42m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:04:41.155 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:04:41.155 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:04:41.156 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:04:41.156 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:04:41.156 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:04:41.156 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:04:41.157 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:04:41.157 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:04:41.157 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:04:41.157 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:04:41.158 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:04:41.158 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:04:41.158 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:04:41.158 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:04:41.158 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:04:41.159 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:04:41.159 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:04:41.159 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:04:41.159 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:04:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:40.185571+0000 mgr.smithi067.rdualw (mgr.24569) 1243 : cluster [DBG] pgmap v1075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:42.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:04:40.505361+0000 mgr.smithi067.rdualw (mgr.24569) 1244 : audit [DBG] from='client.34966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:04:42.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:04:40.794623+0000 mgr.smithi067.rdualw (mgr.24569) 1245 : audit [DBG] from='client.34970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:04:42.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:04:41.153947+0000 mon.smithi061 (mon.0) 451 : audit [DBG] from='client.? 172.21.15.61:0/2979119086' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:04:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:40.185571+0000 mgr.smithi067.rdualw (mgr.24569) 1243 : cluster [DBG] pgmap v1075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:42.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:04:40.505361+0000 mgr.smithi067.rdualw (mgr.24569) 1244 : audit [DBG] from='client.34966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:04:42.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:04:40.794623+0000 mgr.smithi067.rdualw (mgr.24569) 1245 : audit [DBG] from='client.34970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:04:42.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:04:41.153947+0000 mon.smithi061 (mon.0) 451 : audit [DBG] from='client.? 172.21.15.61:0/2979119086' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:04:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:42.186410+0000 mgr.smithi067.rdualw (mgr.24569) 1246 : cluster [DBG] pgmap v1076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:44.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:42.186410+0000 mgr.smithi067.rdualw (mgr.24569) 1246 : cluster [DBG] pgmap v1076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:44.187048+0000 mgr.smithi067.rdualw (mgr.24569) 1247 : cluster [DBG] pgmap v1077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:44.187048+0000 mgr.smithi067.rdualw (mgr.24569) 1247 : cluster [DBG] pgmap v1077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:46.187900+0000 mgr.smithi067.rdualw (mgr.24569) 1248 : cluster [DBG] pgmap v1078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:04:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:46.187900+0000 mgr.smithi067.rdualw (mgr.24569) 1248 : cluster [DBG] pgmap v1078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:04:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:48.188640+0000 mgr.smithi067.rdualw (mgr.24569) 1249 : cluster [DBG] pgmap v1079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:48.188640+0000 mgr.smithi067.rdualw (mgr.24569) 1249 : cluster [DBG] pgmap v1079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:50.189189+0000 mgr.smithi067.rdualw (mgr.24569) 1250 : cluster [DBG] pgmap v1080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:50.189189+0000 mgr.smithi067.rdualw (mgr.24569) 1250 : cluster [DBG] pgmap v1080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:52.190142+0000 mgr.smithi067.rdualw (mgr.24569) 1251 : cluster [DBG] pgmap v1081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:54.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:04:52.634338+0000 mon.smithi067 (mon.1) 229 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:04:54.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:04:52.635785+0000 mon.smithi067 (mon.1) 230 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:04:54.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:04:52.636728+0000 mon.smithi067 (mon.1) 231 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:04:54.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:04:52.637563+0000 mgr.smithi067.rdualw (mgr.24569) 1252 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:04:54.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:04:53.052128+0000 mon.smithi061 (mon.0) 452 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:04:54.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:04:53.059814+0000 mon.smithi061 (mon.0) 453 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:04:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:52.190142+0000 mgr.smithi067.rdualw (mgr.24569) 1251 : cluster [DBG] pgmap v1081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:04:52.634338+0000 mon.smithi067 (mon.1) 229 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:04:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:04:52.635785+0000 mon.smithi067 (mon.1) 230 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:04:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:04:52.636728+0000 mon.smithi067 (mon.1) 231 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:04:54.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:04:52.637563+0000 mgr.smithi067.rdualw (mgr.24569) 1252 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:04:54.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:04:53.052128+0000 mon.smithi061 (mon.0) 452 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:04:54.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:04:53.059814+0000 mon.smithi061 (mon.0) 453 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:04:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:54.190794+0000 mgr.smithi067.rdualw (mgr.24569) 1253 : cluster [DBG] pgmap v1082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:54.190794+0000 mgr.smithi067.rdualw (mgr.24569) 1253 : cluster [DBG] pgmap v1082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:04:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:56.191812+0000 mgr.smithi067.rdualw (mgr.24569) 1254 : cluster [DBG] pgmap v1083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:04:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:56.191812+0000 mgr.smithi067.rdualw (mgr.24569) 1254 : cluster [DBG] pgmap v1083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:05:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:04:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:04:58.192292+0000 mgr.smithi067.rdualw (mgr.24569) 1255 : cluster [DBG] pgmap v1084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:04:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:04:58.192292+0000 mgr.smithi067.rdualw (mgr.24569) 1255 : cluster [DBG] pgmap v1084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:00.192937+0000 mgr.smithi067.rdualw (mgr.24569) 1256 : cluster [DBG] pgmap v1085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:00.192937+0000 mgr.smithi067.rdualw (mgr.24569) 1256 : cluster [DBG] pgmap v1085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:02.193955+0000 mgr.smithi067.rdualw (mgr.24569) 1257 : cluster [DBG] pgmap v1086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:02.193955+0000 mgr.smithi067.rdualw (mgr.24569) 1257 : cluster [DBG] pgmap v1086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:04.194460+0000 mgr.smithi067.rdualw (mgr.24569) 1258 : cluster [DBG] pgmap v1087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:04.194460+0000 mgr.smithi067.rdualw (mgr.24569) 1258 : cluster [DBG] pgmap v1087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:06.195394+0000 mgr.smithi067.rdualw (mgr.24569) 1259 : cluster [DBG] pgmap v1088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:05:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:06.195394+0000 mgr.smithi067.rdualw (mgr.24569) 1259 : cluster [DBG] pgmap v1088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:05:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:08.195997+0000 mgr.smithi067.rdualw (mgr.24569) 1260 : cluster [DBG] pgmap v1089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:08.195997+0000 mgr.smithi067.rdualw (mgr.24569) 1260 : cluster [DBG] pgmap v1089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:11.461 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:05:11.751 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:05:11.751 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (42m) 4m ago 43m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:05:11.751 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (35m) 4m ago 43m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:05:11.752 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (35m) 4m ago 43m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:05:11.752 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (42m) 4m ago 43m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:05:11.752 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (35m) 4m ago 39m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:05:11.752 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (35m) 4m ago 39m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:05:11.753 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (36m) 4m ago 44m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:05:11.753 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (36m) 4m ago 43m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:05:11.753 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (36m) 4m ago 45m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:05:11.753 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (36m) 4m ago 43m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:05:11.754 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (37m) 4m ago 37m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:05:11.754 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (37m) 4m ago 37m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:05:11.754 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (43m) 4m ago 43m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:05:11.754 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (43m) 4m ago 42m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:05:11.754 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (26m) 4m ago 42m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:05:11.755 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (42m) 4m ago 42m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:05:11.755 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (42m) 4m ago 42m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:05:11.755 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (41m) 4m ago 41m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:05:11.755 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (41m) 4m ago 41m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:05:11.756 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (41m) 4m ago 41m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:05:11.756 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (41m) 4m ago 41m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:05:11.756 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (40m) 4m ago 40m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:05:11.756 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (42m) 4m ago 43m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:05:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:10.196648+0000 mgr.smithi067.rdualw (mgr.24569) 1261 : cluster [DBG] pgmap v1090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:10.196648+0000 mgr.smithi067.rdualw (mgr.24569) 1261 : cluster [DBG] pgmap v1090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:12.092 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:05:12.093 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:05:12.093 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:05:12.094 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:05:12.094 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:05:12.095 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:05:12.095 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:05:12.095 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:05:12.096 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:05:12.096 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:05:12.096 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:05:12.097 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:05:12.097 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:05:12.097 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:05:12.098 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:05:12.098 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:05:12.099 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:05:12.099 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:05:12.099 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:05:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:05:11.447553+0000 mgr.smithi067.rdualw (mgr.24569) 1262 : audit [DBG] from='client.34978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:05:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:05:11.733062+0000 mgr.smithi067.rdualw (mgr.24569) 1263 : audit [DBG] from='client.34982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:05:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:05:12.091234+0000 mon.smithi061 (mon.0) 454 : audit [DBG] from='client.? 172.21.15.61:0/1698591032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:05:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:05:11.447553+0000 mgr.smithi067.rdualw (mgr.24569) 1262 : audit [DBG] from='client.34978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:05:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:05:11.733062+0000 mgr.smithi067.rdualw (mgr.24569) 1263 : audit [DBG] from='client.34982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:05:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:05:12.091234+0000 mon.smithi061 (mon.0) 454 : audit [DBG] from='client.? 172.21.15.61:0/1698591032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:05:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:12.197560+0000 mgr.smithi067.rdualw (mgr.24569) 1264 : cluster [DBG] pgmap v1091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:12.197560+0000 mgr.smithi067.rdualw (mgr.24569) 1264 : cluster [DBG] pgmap v1091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:14.198214+0000 mgr.smithi067.rdualw (mgr.24569) 1265 : cluster [DBG] pgmap v1092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:14.198214+0000 mgr.smithi067.rdualw (mgr.24569) 1265 : cluster [DBG] pgmap v1092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:16.199080+0000 mgr.smithi067.rdualw (mgr.24569) 1266 : cluster [DBG] pgmap v1093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:05:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:16.199080+0000 mgr.smithi067.rdualw (mgr.24569) 1266 : cluster [DBG] pgmap v1093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:05:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:18.199718+0000 mgr.smithi067.rdualw (mgr.24569) 1267 : cluster [DBG] pgmap v1094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:18.199718+0000 mgr.smithi067.rdualw (mgr.24569) 1267 : cluster [DBG] pgmap v1094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:22.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:20.200362+0000 mgr.smithi067.rdualw (mgr.24569) 1268 : cluster [DBG] pgmap v1095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:20.200362+0000 mgr.smithi067.rdualw (mgr.24569) 1268 : cluster [DBG] pgmap v1095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:22.201281+0000 mgr.smithi067.rdualw (mgr.24569) 1269 : cluster [DBG] pgmap v1096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:22.201281+0000 mgr.smithi067.rdualw (mgr.24569) 1269 : cluster [DBG] pgmap v1096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:26.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:24.201948+0000 mgr.smithi067.rdualw (mgr.24569) 1270 : cluster [DBG] pgmap v1097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:24.201948+0000 mgr.smithi067.rdualw (mgr.24569) 1270 : cluster [DBG] pgmap v1097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:26.203005+0000 mgr.smithi067.rdualw (mgr.24569) 1271 : cluster [DBG] pgmap v1098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:05:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:26.203005+0000 mgr.smithi067.rdualw (mgr.24569) 1271 : cluster [DBG] pgmap v1098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:05:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:28.203571+0000 mgr.smithi067.rdualw (mgr.24569) 1272 : cluster [DBG] pgmap v1099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:28.203571+0000 mgr.smithi067.rdualw (mgr.24569) 1272 : cluster [DBG] pgmap v1099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:32.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:30.204230+0000 mgr.smithi067.rdualw (mgr.24569) 1273 : cluster [DBG] pgmap v1100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:30.204230+0000 mgr.smithi067.rdualw (mgr.24569) 1273 : cluster [DBG] pgmap v1100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:32.205109+0000 mgr.smithi067.rdualw (mgr.24569) 1274 : cluster [DBG] pgmap v1101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:34.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:32.205109+0000 mgr.smithi067.rdualw (mgr.24569) 1274 : cluster [DBG] pgmap v1101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:34.205721+0000 mgr.smithi067.rdualw (mgr.24569) 1275 : cluster [DBG] pgmap v1102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:35.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:05:34.619016+0000 mon.smithi067 (mon.1) 232 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:05:35.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:05:34.619342+0000 mon.smithi067 (mon.1) 233 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:05:35.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:05:34.619675+0000 mon.smithi061 (mon.0) 455 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:05:35.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:05:34.619979+0000 mon.smithi061 (mon.0) 456 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:05:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:34.205721+0000 mgr.smithi067.rdualw (mgr.24569) 1275 : cluster [DBG] pgmap v1102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:05:34.619016+0000 mon.smithi067 (mon.1) 232 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:05:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:05:34.619342+0000 mon.smithi067 (mon.1) 233 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:05:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:05:34.619675+0000 mon.smithi061 (mon.0) 455 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:05:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:05:34.619979+0000 mon.smithi061 (mon.0) 456 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:05:37.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:36.206575+0000 mgr.smithi067.rdualw (mgr.24569) 1276 : cluster [DBG] pgmap v1103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:05:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:36.206575+0000 mgr.smithi067.rdualw (mgr.24569) 1276 : cluster [DBG] pgmap v1103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:05:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:38.207126+0000 mgr.smithi067.rdualw (mgr.24569) 1277 : cluster [DBG] pgmap v1104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:38.207126+0000 mgr.smithi067.rdualw (mgr.24569) 1277 : cluster [DBG] pgmap v1104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:40.207938+0000 mgr.smithi067.rdualw (mgr.24569) 1278 : cluster [DBG] pgmap v1105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:42.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:40.207938+0000 mgr.smithi067.rdualw (mgr.24569) 1278 : cluster [DBG] pgmap v1105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:42.424 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:05:42.737 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:05:42.739 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (43m) 4m ago 44m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:05:42.740 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (35m) 4m ago 44m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:05:42.740 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (35m) 4m ago 43m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:05:42.740 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (43m) 4m ago 44m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:05:42.740 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (36m) 4m ago 40m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:05:42.741 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (36m) 4m ago 39m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:05:42.741 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (37m) 4m ago 45m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:05:42.741 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (37m) 4m ago 43m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:05:42.741 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (36m) 4m ago 45m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:05:42.741 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (36m) 4m ago 43m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:05:42.742 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (37m) 4m ago 37m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:05:42.742 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (37m) 4m ago 37m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:05:42.742 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (44m) 4m ago 44m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:05:42.742 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (43m) 4m ago 43m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:05:42.743 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (26m) 4m ago 43m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:05:42.743 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (42m) 4m ago 42m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:05:42.743 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (42m) 4m ago 42m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:05:42.743 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (42m) 4m ago 42m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:05:42.744 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (42m) 4m ago 42m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:05:42.744 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (41m) 4m ago 41m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:05:42.744 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (41m) 4m ago 41m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:05:42.744 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (41m) 4m ago 41m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:05:42.744 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (43m) 4m ago 43m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:05:43.123 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:05:43.123 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:05:43.123 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:05:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:05:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:05:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:05:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:05:43.124 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:05:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:05:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:05:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:05:43.125 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:05:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:05:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:05:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:05:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:05:43.126 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:05:43.127 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:05:43.127 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:05:44.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:42.208820+0000 mgr.smithi067.rdualw (mgr.24569) 1279 : cluster [DBG] pgmap v1106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:44.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:05:42.410471+0000 mgr.smithi067.rdualw (mgr.24569) 1280 : audit [DBG] from='client.34990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:05:44.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:05:42.719002+0000 mgr.smithi067.rdualw (mgr.24569) 1281 : audit [DBG] from='client.34994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:05:44.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:05:43.121530+0000 mon.smithi061 (mon.0) 457 : audit [DBG] from='client.? 172.21.15.61:0/1993209165' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:05:44.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:42.208820+0000 mgr.smithi067.rdualw (mgr.24569) 1279 : cluster [DBG] pgmap v1106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:44.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:05:42.410471+0000 mgr.smithi067.rdualw (mgr.24569) 1280 : audit [DBG] from='client.34990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:05:44.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:05:42.719002+0000 mgr.smithi067.rdualw (mgr.24569) 1281 : audit [DBG] from='client.34994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:05:44.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:05:43.121530+0000 mon.smithi061 (mon.0) 457 : audit [DBG] from='client.? 172.21.15.61:0/1993209165' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:05:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:44.209409+0000 mgr.smithi067.rdualw (mgr.24569) 1282 : cluster [DBG] pgmap v1107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:44.209409+0000 mgr.smithi067.rdualw (mgr.24569) 1282 : cluster [DBG] pgmap v1107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:46.210370+0000 mgr.smithi067.rdualw (mgr.24569) 1283 : cluster [DBG] pgmap v1108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:05:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:46.210370+0000 mgr.smithi067.rdualw (mgr.24569) 1283 : cluster [DBG] pgmap v1108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:05:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:48.210985+0000 mgr.smithi067.rdualw (mgr.24569) 1284 : cluster [DBG] pgmap v1109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:48.210985+0000 mgr.smithi067.rdualw (mgr.24569) 1284 : cluster [DBG] pgmap v1109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:50.211569+0000 mgr.smithi067.rdualw (mgr.24569) 1285 : cluster [DBG] pgmap v1110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:50.211569+0000 mgr.smithi067.rdualw (mgr.24569) 1285 : cluster [DBG] pgmap v1110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:52.212366+0000 mgr.smithi067.rdualw (mgr.24569) 1286 : cluster [DBG] pgmap v1111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:05:53.063668+0000 mon.smithi067 (mon.1) 234 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:05:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:05:53.065077+0000 mon.smithi067 (mon.1) 235 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:05:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:05:53.066000+0000 mon.smithi067 (mon.1) 236 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:05:54.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:05:53.066822+0000 mgr.smithi067.rdualw (mgr.24569) 1287 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:05:54.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:05:53.380601+0000 mon.smithi061 (mon.0) 458 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:05:54.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:05:53.386070+0000 mon.smithi061 (mon.0) 459 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:05:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:52.212366+0000 mgr.smithi067.rdualw (mgr.24569) 1286 : cluster [DBG] pgmap v1111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:05:53.063668+0000 mon.smithi067 (mon.1) 234 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:05:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:05:53.065077+0000 mon.smithi067 (mon.1) 235 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:05:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:05:53.066000+0000 mon.smithi067 (mon.1) 236 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:05:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:05:53.066822+0000 mgr.smithi067.rdualw (mgr.24569) 1287 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:05:54.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:05:53.380601+0000 mon.smithi061 (mon.0) 458 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:05:54.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:05:53.386070+0000 mon.smithi061 (mon.0) 459 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:05:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:54.213025+0000 mgr.smithi067.rdualw (mgr.24569) 1288 : cluster [DBG] pgmap v1112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:54.213025+0000 mgr.smithi067.rdualw (mgr.24569) 1288 : cluster [DBG] pgmap v1112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:05:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:56.214083+0000 mgr.smithi067.rdualw (mgr.24569) 1289 : cluster [DBG] pgmap v1113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:05:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:56.214083+0000 mgr.smithi067.rdualw (mgr.24569) 1289 : cluster [DBG] pgmap v1113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:06:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:05:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:05:58.214640+0000 mgr.smithi067.rdualw (mgr.24569) 1290 : cluster [DBG] pgmap v1114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:05:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:05:58.214640+0000 mgr.smithi067.rdualw (mgr.24569) 1290 : cluster [DBG] pgmap v1114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:00.215184+0000 mgr.smithi067.rdualw (mgr.24569) 1291 : cluster [DBG] pgmap v1115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:00.215184+0000 mgr.smithi067.rdualw (mgr.24569) 1291 : cluster [DBG] pgmap v1115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:02.216169+0000 mgr.smithi067.rdualw (mgr.24569) 1292 : cluster [DBG] pgmap v1116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:02.216169+0000 mgr.smithi067.rdualw (mgr.24569) 1292 : cluster [DBG] pgmap v1116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:04.216733+0000 mgr.smithi067.rdualw (mgr.24569) 1293 : cluster [DBG] pgmap v1117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:04.216733+0000 mgr.smithi067.rdualw (mgr.24569) 1293 : cluster [DBG] pgmap v1117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:06.217777+0000 mgr.smithi067.rdualw (mgr.24569) 1294 : cluster [DBG] pgmap v1118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:06:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:06.217777+0000 mgr.smithi067.rdualw (mgr.24569) 1294 : cluster [DBG] pgmap v1118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:06:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:08.218300+0000 mgr.smithi067.rdualw (mgr.24569) 1295 : cluster [DBG] pgmap v1119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:08.218300+0000 mgr.smithi067.rdualw (mgr.24569) 1295 : cluster [DBG] pgmap v1119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:10.219080+0000 mgr.smithi067.rdualw (mgr.24569) 1296 : cluster [DBG] pgmap v1120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:10.219080+0000 mgr.smithi067.rdualw (mgr.24569) 1296 : cluster [DBG] pgmap v1120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:13.433 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:06:13.724 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:06:13.725 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (43m) 5m ago 44m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:06:13.725 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (36m) 5m ago 44m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:06:13.725 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (36m) 5m ago 44m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:06:13.725 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (43m) 5m ago 44m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:06:13.726 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (36m) 5m ago 40m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:06:13.726 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (36m) 5m ago 40m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:06:13.726 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (37m) 5m ago 46m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:06:13.727 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (37m) 5m ago 44m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:06:13.727 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (37m) 5m ago 46m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:06:13.727 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (37m) 5m ago 44m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:06:13.727 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (38m) 5m ago 38m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:06:13.727 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (38m) 5m ago 38m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:06:13.728 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (44m) 5m ago 44m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:06:13.728 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (44m) 5m ago 44m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:06:13.728 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (27m) 5m ago 43m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:06:13.729 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (43m) 5m ago 43m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:06:13.729 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (43m) 5m ago 43m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:06:13.730 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (42m) 5m ago 42m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:06:13.730 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (42m) 5m ago 42m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:06:13.730 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (42m) 5m ago 42m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:06:13.731 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (42m) 5m ago 42m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:06:13.731 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (41m) 5m ago 41m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:06:13.731 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (43m) 5m ago 44m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:06:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:12.220022+0000 mgr.smithi067.rdualw (mgr.24569) 1297 : cluster [DBG] pgmap v1121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:12.220022+0000 mgr.smithi067.rdualw (mgr.24569) 1297 : cluster [DBG] pgmap v1121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:14.069 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:06:14.069 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:06:14.069 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:06:14.069 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:06:14.070 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:06:14.070 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:06:14.070 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:06:14.071 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:06:14.071 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:06:14.071 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:06:14.071 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:06:14.072 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:06:14.072 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:06:14.072 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:06:14.072 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:06:14.073 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:06:14.073 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:06:14.073 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:06:14.073 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:06:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:06:13.419846+0000 mgr.smithi067.rdualw (mgr.24569) 1298 : audit [DBG] from='client.35002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:06:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:06:13.706163+0000 mgr.smithi067.rdualw (mgr.24569) 1299 : audit [DBG] from='client.35006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:06:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:06:14.067814+0000 mon.smithi061 (mon.0) 460 : audit [DBG] from='client.? 172.21.15.61:0/2187224834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:06:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:06:13.419846+0000 mgr.smithi067.rdualw (mgr.24569) 1298 : audit [DBG] from='client.35002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:06:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:06:13.706163+0000 mgr.smithi067.rdualw (mgr.24569) 1299 : audit [DBG] from='client.35006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:06:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:06:14.067814+0000 mon.smithi061 (mon.0) 460 : audit [DBG] from='client.? 172.21.15.61:0/2187224834' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:06:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:14.220569+0000 mgr.smithi067.rdualw (mgr.24569) 1300 : cluster [DBG] pgmap v1122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:14.220569+0000 mgr.smithi067.rdualw (mgr.24569) 1300 : cluster [DBG] pgmap v1122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:16.221463+0000 mgr.smithi067.rdualw (mgr.24569) 1301 : cluster [DBG] pgmap v1123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:06:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:16.221463+0000 mgr.smithi067.rdualw (mgr.24569) 1301 : cluster [DBG] pgmap v1123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:06:20.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:18.222128+0000 mgr.smithi067.rdualw (mgr.24569) 1302 : cluster [DBG] pgmap v1124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:18.222128+0000 mgr.smithi067.rdualw (mgr.24569) 1302 : cluster [DBG] pgmap v1124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:20.222853+0000 mgr.smithi067.rdualw (mgr.24569) 1303 : cluster [DBG] pgmap v1125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:20.222853+0000 mgr.smithi067.rdualw (mgr.24569) 1303 : cluster [DBG] pgmap v1125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:22.223838+0000 mgr.smithi067.rdualw (mgr.24569) 1304 : cluster [DBG] pgmap v1126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:22.223838+0000 mgr.smithi067.rdualw (mgr.24569) 1304 : cluster [DBG] pgmap v1126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:26.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:24.224529+0000 mgr.smithi067.rdualw (mgr.24569) 1305 : cluster [DBG] pgmap v1127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:24.224529+0000 mgr.smithi067.rdualw (mgr.24569) 1305 : cluster [DBG] pgmap v1127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:28.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:26.225420+0000 mgr.smithi067.rdualw (mgr.24569) 1306 : cluster [DBG] pgmap v1128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:06:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:26.225420+0000 mgr.smithi067.rdualw (mgr.24569) 1306 : cluster [DBG] pgmap v1128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:06:30.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:28.226105+0000 mgr.smithi067.rdualw (mgr.24569) 1307 : cluster [DBG] pgmap v1129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:28.226105+0000 mgr.smithi067.rdualw (mgr.24569) 1307 : cluster [DBG] pgmap v1129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:30.226879+0000 mgr.smithi067.rdualw (mgr.24569) 1308 : cluster [DBG] pgmap v1130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:30.226879+0000 mgr.smithi067.rdualw (mgr.24569) 1308 : cluster [DBG] pgmap v1130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:32.227840+0000 mgr.smithi067.rdualw (mgr.24569) 1309 : cluster [DBG] pgmap v1131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:32.227840+0000 mgr.smithi067.rdualw (mgr.24569) 1309 : cluster [DBG] pgmap v1131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:34.228612+0000 mgr.smithi067.rdualw (mgr.24569) 1310 : cluster [DBG] pgmap v1132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:36.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:06:34.624145+0000 mon.smithi067 (mon.1) 237 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:06:36.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:06:34.624380+0000 mon.smithi067 (mon.1) 238 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:06:36.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:06:34.624636+0000 mon.smithi061 (mon.0) 461 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:06:36.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:06:34.624922+0000 mon.smithi061 (mon.0) 462 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:06:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:34.228612+0000 mgr.smithi067.rdualw (mgr.24569) 1310 : cluster [DBG] pgmap v1132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:06:34.624145+0000 mon.smithi067 (mon.1) 237 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:06:36.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:06:34.624380+0000 mon.smithi067 (mon.1) 238 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:06:36.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:06:34.624636+0000 mon.smithi061 (mon.0) 461 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:06:36.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:06:34.624922+0000 mon.smithi061 (mon.0) 462 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:06:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:36.229407+0000 mgr.smithi067.rdualw (mgr.24569) 1311 : cluster [DBG] pgmap v1133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:06:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:36.229407+0000 mgr.smithi067.rdualw (mgr.24569) 1311 : cluster [DBG] pgmap v1133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:06:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:38.229959+0000 mgr.smithi067.rdualw (mgr.24569) 1312 : cluster [DBG] pgmap v1134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:38.229959+0000 mgr.smithi067.rdualw (mgr.24569) 1312 : cluster [DBG] pgmap v1134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:40.230575+0000 mgr.smithi067.rdualw (mgr.24569) 1313 : cluster [DBG] pgmap v1135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:42.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:40.230575+0000 mgr.smithi067.rdualw (mgr.24569) 1313 : cluster [DBG] pgmap v1135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:42.231515+0000 mgr.smithi067.rdualw (mgr.24569) 1314 : cluster [DBG] pgmap v1136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:42.231515+0000 mgr.smithi067.rdualw (mgr.24569) 1314 : cluster [DBG] pgmap v1136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:44.464 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:06:44.757 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:06:44.757 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (44m) 5m ago 45m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:06:44.758 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (36m) 5m ago 45m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:06:44.758 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (36m) 5m ago 44m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:06:44.758 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (44m) 5m ago 45m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:06:44.758 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (37m) 5m ago 41m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:06:44.759 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (37m) 5m ago 41m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:06:44.759 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (38m) 5m ago 46m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:06:44.759 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (38m) 5m ago 44m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:06:44.759 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (37m) 5m ago 46m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:06:44.759 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (37m) 5m ago 44m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:06:44.760 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (38m) 5m ago 38m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:06:44.760 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (38m) 5m ago 38m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:06:44.760 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (45m) 5m ago 45m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:06:44.760 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (44m) 5m ago 44m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:06:44.761 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (27m) 5m ago 44m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:06:44.761 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (43m) 5m ago 43m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:06:44.761 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (43m) 5m ago 43m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:06:44.761 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (43m) 5m ago 43m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:06:44.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (43m) 5m ago 43m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:06:44.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (42m) 5m ago 42m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:06:44.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (42m) 5m ago 42m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:06:44.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (42m) 5m ago 42m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:06:44.762 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (44m) 5m ago 45m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:06:45.098 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:06:45.099 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:06:45.099 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:06:45.099 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:06:45.100 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:06:45.100 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:06:45.100 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:06:45.100 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:06:45.100 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:06:45.101 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:06:45.101 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:06:45.101 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:06:45.101 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:06:45.102 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:06:45.102 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:06:45.102 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:06:45.102 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:06:45.102 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:06:45.103 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:06:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:44.232278+0000 mgr.smithi067.rdualw (mgr.24569) 1315 : cluster [DBG] pgmap v1137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:06:44.448208+0000 mgr.smithi067.rdualw (mgr.24569) 1316 : audit [DBG] from='client.35014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:06:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:06:44.739346+0000 mgr.smithi067.rdualw (mgr.24569) 1317 : audit [DBG] from='client.35018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:06:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:06:45.097224+0000 mon.smithi061 (mon.0) 463 : audit [DBG] from='client.? 172.21.15.61:0/1711448411' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:06:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:44.232278+0000 mgr.smithi067.rdualw (mgr.24569) 1315 : cluster [DBG] pgmap v1137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:06:44.448208+0000 mgr.smithi067.rdualw (mgr.24569) 1316 : audit [DBG] from='client.35014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:06:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:06:44.739346+0000 mgr.smithi067.rdualw (mgr.24569) 1317 : audit [DBG] from='client.35018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:06:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:06:45.097224+0000 mon.smithi061 (mon.0) 463 : audit [DBG] from='client.? 172.21.15.61:0/1711448411' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:06:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:46.233112+0000 mgr.smithi067.rdualw (mgr.24569) 1318 : cluster [DBG] pgmap v1138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:06:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:46.233112+0000 mgr.smithi067.rdualw (mgr.24569) 1318 : cluster [DBG] pgmap v1138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:06:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:48.233641+0000 mgr.smithi067.rdualw (mgr.24569) 1319 : cluster [DBG] pgmap v1139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:48.233641+0000 mgr.smithi067.rdualw (mgr.24569) 1319 : cluster [DBG] pgmap v1139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:50.234343+0000 mgr.smithi067.rdualw (mgr.24569) 1320 : cluster [DBG] pgmap v1140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:50.234343+0000 mgr.smithi067.rdualw (mgr.24569) 1320 : cluster [DBG] pgmap v1140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:52.235294+0000 mgr.smithi067.rdualw (mgr.24569) 1321 : cluster [DBG] pgmap v1141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:06:53.389881+0000 mon.smithi067 (mon.1) 239 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:06:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:06:53.391359+0000 mon.smithi067 (mon.1) 240 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:06:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:06:53.392329+0000 mon.smithi067 (mon.1) 241 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:06:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:52.235294+0000 mgr.smithi067.rdualw (mgr.24569) 1321 : cluster [DBG] pgmap v1141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:06:53.389881+0000 mon.smithi067 (mon.1) 239 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:06:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:06:53.391359+0000 mon.smithi067 (mon.1) 240 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:06:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:06:53.392329+0000 mon.smithi067 (mon.1) 241 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:06:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:06:53.393174+0000 mgr.smithi067.rdualw (mgr.24569) 1322 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:06:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:06:53.809262+0000 mon.smithi061 (mon.0) 464 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:06:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:06:53.815141+0000 mon.smithi061 (mon.0) 465 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:06:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:06:53.393174+0000 mgr.smithi067.rdualw (mgr.24569) 1322 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:06:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:06:53.809262+0000 mon.smithi061 (mon.0) 464 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:06:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:06:53.815141+0000 mon.smithi061 (mon.0) 465 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:06:56.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:54.235805+0000 mgr.smithi067.rdualw (mgr.24569) 1323 : cluster [DBG] pgmap v1142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:54.235805+0000 mgr.smithi067.rdualw (mgr.24569) 1323 : cluster [DBG] pgmap v1142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:06:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:56.236803+0000 mgr.smithi067.rdualw (mgr.24569) 1324 : cluster [DBG] pgmap v1143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:06:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:56.236803+0000 mgr.smithi067.rdualw (mgr.24569) 1324 : cluster [DBG] pgmap v1143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:07:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:06:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:06:58.237279+0000 mgr.smithi067.rdualw (mgr.24569) 1325 : cluster [DBG] pgmap v1144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:06:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:06:58.237279+0000 mgr.smithi067.rdualw (mgr.24569) 1325 : cluster [DBG] pgmap v1144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:00.238055+0000 mgr.smithi067.rdualw (mgr.24569) 1326 : cluster [DBG] pgmap v1145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:02.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:00.238055+0000 mgr.smithi067.rdualw (mgr.24569) 1326 : cluster [DBG] pgmap v1145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:04.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:02.239156+0000 mgr.smithi067.rdualw (mgr.24569) 1327 : cluster [DBG] pgmap v1146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:02.239156+0000 mgr.smithi067.rdualw (mgr.24569) 1327 : cluster [DBG] pgmap v1146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:04.239813+0000 mgr.smithi067.rdualw (mgr.24569) 1328 : cluster [DBG] pgmap v1147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:04.239813+0000 mgr.smithi067.rdualw (mgr.24569) 1328 : cluster [DBG] pgmap v1147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:06.240818+0000 mgr.smithi067.rdualw (mgr.24569) 1329 : cluster [DBG] pgmap v1148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:07:08.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:06.240818+0000 mgr.smithi067.rdualw (mgr.24569) 1329 : cluster [DBG] pgmap v1148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:07:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:08.241479+0000 mgr.smithi067.rdualw (mgr.24569) 1330 : cluster [DBG] pgmap v1149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:08.241479+0000 mgr.smithi067.rdualw (mgr.24569) 1330 : cluster [DBG] pgmap v1149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:10.242159+0000 mgr.smithi067.rdualw (mgr.24569) 1331 : cluster [DBG] pgmap v1150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:10.242159+0000 mgr.smithi067.rdualw (mgr.24569) 1331 : cluster [DBG] pgmap v1150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:12.243231+0000 mgr.smithi067.rdualw (mgr.24569) 1332 : cluster [DBG] pgmap v1151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:12.243231+0000 mgr.smithi067.rdualw (mgr.24569) 1332 : cluster [DBG] pgmap v1151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:15.407 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:07:15.707 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:07:15.707 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (44m) 6m ago 45m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:07:15.708 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (37m) 6m ago 45m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:07:15.708 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (37m) 6m ago 45m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:07:15.708 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (44m) 6m ago 45m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:07:15.709 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (37m) 6m ago 41m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:07:15.709 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (37m) 6m ago 41m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:07:15.710 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (38m) 6m ago 47m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:07:15.710 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (38m) 6m ago 45m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:07:15.710 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (38m) 6m ago 47m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:07:15.711 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (38m) 6m ago 45m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:07:15.711 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (39m) 6m ago 39m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:07:15.712 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (39m) 6m ago 39m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:07:15.712 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (45m) 6m ago 45m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:07:15.713 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (45m) 6m ago 45m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:07:15.713 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (28m) 6m ago 44m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:07:15.714 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (44m) 6m ago 44m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:07:15.714 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (44m) 6m ago 44m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:07:15.714 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (43m) 6m ago 43m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:07:15.715 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (43m) 6m ago 43m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:07:15.715 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (43m) 6m ago 43m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:07:15.716 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (43m) 6m ago 43m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:07:15.716 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (42m) 6m ago 42m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:07:15.717 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (44m) 6m ago 45m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:07:16.070 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:07:16.071 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:07:16.071 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:07:16.071 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:07:16.071 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:07:16.072 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:07:16.072 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:07:16.072 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:07:16.072 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:07:16.072 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:07:16.073 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:07:16.073 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:07:16.073 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:07:16.073 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:07:16.074 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:07:16.074 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:07:16.074 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:07:16.074 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:07:16.074 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:07:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:14.244058+0000 mgr.smithi067.rdualw (mgr.24569) 1333 : cluster [DBG] pgmap v1152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:14.244058+0000 mgr.smithi067.rdualw (mgr.24569) 1333 : cluster [DBG] pgmap v1152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:07:15.393191+0000 mgr.smithi067.rdualw (mgr.24569) 1334 : audit [DBG] from='client.35026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:07:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:07:15.689063+0000 mgr.smithi067.rdualw (mgr.24569) 1335 : audit [DBG] from='client.35030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:07:17.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:07:16.069038+0000 mon.smithi061 (mon.0) 466 : audit [DBG] from='client.? 172.21.15.61:0/1436797993' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:07:17.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:07:15.393191+0000 mgr.smithi067.rdualw (mgr.24569) 1334 : audit [DBG] from='client.35026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:07:17.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:07:15.689063+0000 mgr.smithi067.rdualw (mgr.24569) 1335 : audit [DBG] from='client.35030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:07:17.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:07:16.069038+0000 mon.smithi061 (mon.0) 466 : audit [DBG] from='client.? 172.21.15.61:0/1436797993' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:07:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:16.244845+0000 mgr.smithi067.rdualw (mgr.24569) 1336 : cluster [DBG] pgmap v1153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:07:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:16.244845+0000 mgr.smithi067.rdualw (mgr.24569) 1336 : cluster [DBG] pgmap v1153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:07:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:18.245428+0000 mgr.smithi067.rdualw (mgr.24569) 1337 : cluster [DBG] pgmap v1154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:18.245428+0000 mgr.smithi067.rdualw (mgr.24569) 1337 : cluster [DBG] pgmap v1154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:20.246190+0000 mgr.smithi067.rdualw (mgr.24569) 1338 : cluster [DBG] pgmap v1155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:20.246190+0000 mgr.smithi067.rdualw (mgr.24569) 1338 : cluster [DBG] pgmap v1155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:22.247111+0000 mgr.smithi067.rdualw (mgr.24569) 1339 : cluster [DBG] pgmap v1156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:22.247111+0000 mgr.smithi067.rdualw (mgr.24569) 1339 : cluster [DBG] pgmap v1156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:24.247713+0000 mgr.smithi067.rdualw (mgr.24569) 1340 : cluster [DBG] pgmap v1157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:24.247713+0000 mgr.smithi067.rdualw (mgr.24569) 1340 : cluster [DBG] pgmap v1157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:26.248470+0000 mgr.smithi067.rdualw (mgr.24569) 1341 : cluster [DBG] pgmap v1158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:07:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:26.248470+0000 mgr.smithi067.rdualw (mgr.24569) 1341 : cluster [DBG] pgmap v1158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:07:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:28.249017+0000 mgr.smithi067.rdualw (mgr.24569) 1342 : cluster [DBG] pgmap v1159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:28.249017+0000 mgr.smithi067.rdualw (mgr.24569) 1342 : cluster [DBG] pgmap v1159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:30.249674+0000 mgr.smithi067.rdualw (mgr.24569) 1343 : cluster [DBG] pgmap v1160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:30.249674+0000 mgr.smithi067.rdualw (mgr.24569) 1343 : cluster [DBG] pgmap v1160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:32.250502+0000 mgr.smithi067.rdualw (mgr.24569) 1344 : cluster [DBG] pgmap v1161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:32.250502+0000 mgr.smithi067.rdualw (mgr.24569) 1344 : cluster [DBG] pgmap v1161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:34.251064+0000 mgr.smithi067.rdualw (mgr.24569) 1345 : cluster [DBG] pgmap v1162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:07:34.629787+0000 mon.smithi067 (mon.1) 242 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:07:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:07:34.630052+0000 mon.smithi067 (mon.1) 243 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:07:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:07:34.630224+0000 mon.smithi061 (mon.0) 467 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:07:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:07:34.630544+0000 mon.smithi061 (mon.0) 468 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:07:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:34.251064+0000 mgr.smithi067.rdualw (mgr.24569) 1345 : cluster [DBG] pgmap v1162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:07:34.629787+0000 mon.smithi067 (mon.1) 242 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:07:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:07:34.630052+0000 mon.smithi067 (mon.1) 243 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:07:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:07:34.630224+0000 mon.smithi061 (mon.0) 467 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:07:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:07:34.630544+0000 mon.smithi061 (mon.0) 468 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:07:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:36.251872+0000 mgr.smithi067.rdualw (mgr.24569) 1346 : cluster [DBG] pgmap v1163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:07:38.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:36.251872+0000 mgr.smithi067.rdualw (mgr.24569) 1346 : cluster [DBG] pgmap v1163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:07:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:38.252642+0000 mgr.smithi067.rdualw (mgr.24569) 1347 : cluster [DBG] pgmap v1164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:38.252642+0000 mgr.smithi067.rdualw (mgr.24569) 1347 : cluster [DBG] pgmap v1164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:42.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:40.253251+0000 mgr.smithi067.rdualw (mgr.24569) 1348 : cluster [DBG] pgmap v1165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:40.253251+0000 mgr.smithi067.rdualw (mgr.24569) 1348 : cluster [DBG] pgmap v1165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:42.254115+0000 mgr.smithi067.rdualw (mgr.24569) 1349 : cluster [DBG] pgmap v1166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:44.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:42.254115+0000 mgr.smithi067.rdualw (mgr.24569) 1349 : cluster [DBG] pgmap v1166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:44.254821+0000 mgr.smithi067.rdualw (mgr.24569) 1350 : cluster [DBG] pgmap v1167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:44.254821+0000 mgr.smithi067.rdualw (mgr.24569) 1350 : cluster [DBG] pgmap v1167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:46.382 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:07:46.676 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:07:46.677 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (45m) 6m ago 46m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:07:46.677 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (38m) 6m ago 46m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:07:46.677 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (37m) 6m ago 45m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:07:46.678 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (45m) 6m ago 46m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:07:46.678 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (38m) 6m ago 42m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:07:46.678 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (38m) 6m ago 42m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:07:46.678 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (39m) 6m ago 47m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:07:46.679 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (39m) 6m ago 45m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:07:46.679 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (38m) 6m ago 47m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:07:46.679 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (38m) 6m ago 45m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:07:46.679 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (39m) 6m ago 39m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:07:46.679 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (39m) 6m ago 39m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:07:46.680 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (46m) 6m ago 46m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:07:46.680 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (45m) 6m ago 45m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:07:46.680 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (28m) 6m ago 45m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:07:46.680 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (44m) 6m ago 44m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:07:46.681 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (44m) 6m ago 44m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:07:46.681 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (44m) 6m ago 44m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:07:46.681 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (44m) 6m ago 44m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:07:46.681 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (43m) 6m ago 43m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:07:46.681 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (43m) 6m ago 43m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:07:46.682 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (43m) 6m ago 43m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:07:46.682 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (45m) 6m ago 46m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:07:47.016 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:07:47.016 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:07:47.016 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:07:47.017 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:07:47.017 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:07:47.017 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:07:47.017 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:07:47.018 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:07:47.018 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:07:47.018 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:07:47.018 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:07:47.019 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:07:47.019 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:07:47.019 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:07:47.019 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:07:47.020 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:07:47.020 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:07:47.020 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:07:47.020 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:07:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:46.255685+0000 mgr.smithi067.rdualw (mgr.24569) 1351 : cluster [DBG] pgmap v1168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:07:48.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:07:46.366528+0000 mgr.smithi067.rdualw (mgr.24569) 1352 : audit [DBG] from='client.35038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:07:48.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:07:46.657726+0000 mgr.smithi067.rdualw (mgr.24569) 1353 : audit [DBG] from='client.35042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:07:48.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:07:47.014622+0000 mon.smithi061 (mon.0) 469 : audit [DBG] from='client.? 172.21.15.61:0/1291348553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:07:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:46.255685+0000 mgr.smithi067.rdualw (mgr.24569) 1351 : cluster [DBG] pgmap v1168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:07:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:07:46.366528+0000 mgr.smithi067.rdualw (mgr.24569) 1352 : audit [DBG] from='client.35038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:07:48.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:07:46.657726+0000 mgr.smithi067.rdualw (mgr.24569) 1353 : audit [DBG] from='client.35042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:07:48.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:07:47.014622+0000 mon.smithi061 (mon.0) 469 : audit [DBG] from='client.? 172.21.15.61:0/1291348553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:07:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:48.256207+0000 mgr.smithi067.rdualw (mgr.24569) 1354 : cluster [DBG] pgmap v1169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:48.256207+0000 mgr.smithi067.rdualw (mgr.24569) 1354 : cluster [DBG] pgmap v1169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:50.256850+0000 mgr.smithi067.rdualw (mgr.24569) 1355 : cluster [DBG] pgmap v1170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:50.256850+0000 mgr.smithi067.rdualw (mgr.24569) 1355 : cluster [DBG] pgmap v1170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:52.257585+0000 mgr.smithi067.rdualw (mgr.24569) 1356 : cluster [DBG] pgmap v1171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:52.257585+0000 mgr.smithi067.rdualw (mgr.24569) 1356 : cluster [DBG] pgmap v1171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:07:53.820658+0000 mon.smithi067 (mon.1) 244 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:07:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:07:53.822096+0000 mon.smithi067 (mon.1) 245 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:07:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:07:53.822993+0000 mon.smithi067 (mon.1) 246 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:07:55.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:07:53.823842+0000 mgr.smithi067.rdualw (mgr.24569) 1357 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:07:55.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:07:54.240131+0000 mon.smithi061 (mon.0) 470 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:07:55.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:07:54.247487+0000 mon.smithi061 (mon.0) 471 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:07:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:07:53.820658+0000 mon.smithi067 (mon.1) 244 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:07:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:07:53.822096+0000 mon.smithi067 (mon.1) 245 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:07:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:07:53.822993+0000 mon.smithi067 (mon.1) 246 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:07:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:07:53.823842+0000 mgr.smithi067.rdualw (mgr.24569) 1357 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:07:55.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:07:54.240131+0000 mon.smithi061 (mon.0) 470 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:07:55.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:07:54.247487+0000 mon.smithi061 (mon.0) 471 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:07:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:54.258106+0000 mgr.smithi067.rdualw (mgr.24569) 1358 : cluster [DBG] pgmap v1172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:56.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:54.258106+0000 mgr.smithi067.rdualw (mgr.24569) 1358 : cluster [DBG] pgmap v1172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:07:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:56.258968+0000 mgr.smithi067.rdualw (mgr.24569) 1359 : cluster [DBG] pgmap v1173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:07:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:56.258968+0000 mgr.smithi067.rdualw (mgr.24569) 1359 : cluster [DBG] pgmap v1173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:08:00.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:07:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:07:58.259583+0000 mgr.smithi067.rdualw (mgr.24569) 1360 : cluster [DBG] pgmap v1174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:07:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:07:58.259583+0000 mgr.smithi067.rdualw (mgr.24569) 1360 : cluster [DBG] pgmap v1174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:00.260439+0000 mgr.smithi067.rdualw (mgr.24569) 1361 : cluster [DBG] pgmap v1175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:00.260439+0000 mgr.smithi067.rdualw (mgr.24569) 1361 : cluster [DBG] pgmap v1175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:02.261369+0000 mgr.smithi067.rdualw (mgr.24569) 1362 : cluster [DBG] pgmap v1176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:02.261369+0000 mgr.smithi067.rdualw (mgr.24569) 1362 : cluster [DBG] pgmap v1176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:04.262049+0000 mgr.smithi067.rdualw (mgr.24569) 1363 : cluster [DBG] pgmap v1177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:04.262049+0000 mgr.smithi067.rdualw (mgr.24569) 1363 : cluster [DBG] pgmap v1177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:06.262977+0000 mgr.smithi067.rdualw (mgr.24569) 1364 : cluster [DBG] pgmap v1178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:08:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:06.262977+0000 mgr.smithi067.rdualw (mgr.24569) 1364 : cluster [DBG] pgmap v1178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:08:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:08.263465+0000 mgr.smithi067.rdualw (mgr.24569) 1365 : cluster [DBG] pgmap v1179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:08.263465+0000 mgr.smithi067.rdualw (mgr.24569) 1365 : cluster [DBG] pgmap v1179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:10.264183+0000 mgr.smithi067.rdualw (mgr.24569) 1366 : cluster [DBG] pgmap v1180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:10.264183+0000 mgr.smithi067.rdualw (mgr.24569) 1366 : cluster [DBG] pgmap v1180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:14.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:12.265078+0000 mgr.smithi067.rdualw (mgr.24569) 1367 : cluster [DBG] pgmap v1181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:12.265078+0000 mgr.smithi067.rdualw (mgr.24569) 1367 : cluster [DBG] pgmap v1181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:14.265887+0000 mgr.smithi067.rdualw (mgr.24569) 1368 : cluster [DBG] pgmap v1182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:14.265887+0000 mgr.smithi067.rdualw (mgr.24569) 1368 : cluster [DBG] pgmap v1182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:17.333 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:08:17.705 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:08:17.706 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (45m) 7m ago 46m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:08:17.706 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (38m) 7m ago 46m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:08:17.706 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (38m) 7m ago 46m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:08:17.706 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (45m) 7m ago 46m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:08:17.707 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (39m) 7m ago 42m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:08:17.707 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (38m) 7m ago 42m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:08:17.707 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (39m) 7m ago 48m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:08:17.707 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (39m) 7m ago 46m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:08:17.707 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (39m) 7m ago 48m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:08:17.708 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (39m) 7m ago 46m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:08:17.708 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (40m) 7m ago 40m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:08:17.708 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (40m) 7m ago 40m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:08:17.708 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (46m) 7m ago 46m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:08:17.709 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (46m) 7m ago 46m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:08:17.709 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (29m) 7m ago 45m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:08:17.709 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (45m) 7m ago 45m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:08:17.709 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (45m) 7m ago 45m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:08:17.709 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (44m) 7m ago 44m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:08:17.710 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (44m) 7m ago 44m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:08:17.710 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (44m) 7m ago 44m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:08:17.710 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (44m) 7m ago 44m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:08:17.710 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (43m) 7m ago 43m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:08:17.711 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (45m) 7m ago 46m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:08:18.049 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:08:18.050 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:08:18.050 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:08:18.051 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:08:18.051 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:08:18.051 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:08:18.051 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:08:18.052 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:08:18.052 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:08:18.052 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:08:18.052 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:08:18.052 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:08:18.053 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:08:18.053 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:08:18.053 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:08:18.053 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:08:18.054 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:08:18.054 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:08:18.054 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:08:18.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:16.266834+0000 mgr.smithi067.rdualw (mgr.24569) 1369 : cluster [DBG] pgmap v1183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:08:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:16.266834+0000 mgr.smithi067.rdualw (mgr.24569) 1369 : cluster [DBG] pgmap v1183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:08:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:08:17.319858+0000 mgr.smithi067.rdualw (mgr.24569) 1370 : audit [DBG] from='client.35050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:08:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:08:17.687992+0000 mgr.smithi067.rdualw (mgr.24569) 1371 : audit [DBG] from='client.35054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:08:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:08:18.048287+0000 mon.smithi061 (mon.0) 472 : audit [DBG] from='client.? 172.21.15.61:0/2230561998' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:08:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:08:17.319858+0000 mgr.smithi067.rdualw (mgr.24569) 1370 : audit [DBG] from='client.35050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:08:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:08:17.687992+0000 mgr.smithi067.rdualw (mgr.24569) 1371 : audit [DBG] from='client.35054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:08:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:08:18.048287+0000 mon.smithi061 (mon.0) 472 : audit [DBG] from='client.? 172.21.15.61:0/2230561998' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:08:20.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:18.267428+0000 mgr.smithi067.rdualw (mgr.24569) 1372 : cluster [DBG] pgmap v1184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:18.267428+0000 mgr.smithi067.rdualw (mgr.24569) 1372 : cluster [DBG] pgmap v1184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:20.268330+0000 mgr.smithi067.rdualw (mgr.24569) 1373 : cluster [DBG] pgmap v1185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:20.268330+0000 mgr.smithi067.rdualw (mgr.24569) 1373 : cluster [DBG] pgmap v1185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:22.269119+0000 mgr.smithi067.rdualw (mgr.24569) 1374 : cluster [DBG] pgmap v1186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:22.269119+0000 mgr.smithi067.rdualw (mgr.24569) 1374 : cluster [DBG] pgmap v1186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:26.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:24.269779+0000 mgr.smithi067.rdualw (mgr.24569) 1375 : cluster [DBG] pgmap v1187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:26.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:24.269779+0000 mgr.smithi067.rdualw (mgr.24569) 1375 : cluster [DBG] pgmap v1187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:26.270661+0000 mgr.smithi067.rdualw (mgr.24569) 1376 : cluster [DBG] pgmap v1188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:08:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:26.270661+0000 mgr.smithi067.rdualw (mgr.24569) 1376 : cluster [DBG] pgmap v1188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:08:30.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:28.271220+0000 mgr.smithi067.rdualw (mgr.24569) 1377 : cluster [DBG] pgmap v1189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:28.271220+0000 mgr.smithi067.rdualw (mgr.24569) 1377 : cluster [DBG] pgmap v1189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:30.271983+0000 mgr.smithi067.rdualw (mgr.24569) 1378 : cluster [DBG] pgmap v1190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:30.271983+0000 mgr.smithi067.rdualw (mgr.24569) 1378 : cluster [DBG] pgmap v1190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:32.272929+0000 mgr.smithi067.rdualw (mgr.24569) 1379 : cluster [DBG] pgmap v1191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:32.272929+0000 mgr.smithi067.rdualw (mgr.24569) 1379 : cluster [DBG] pgmap v1191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:34.273601+0000 mgr.smithi067.rdualw (mgr.24569) 1380 : cluster [DBG] pgmap v1192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:08:34.635173+0000 mon.smithi067 (mon.1) 247 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:08:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:08:34.635428+0000 mon.smithi067 (mon.1) 248 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:08:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:08:34.635662+0000 mon.smithi061 (mon.0) 473 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:08:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:08:34.635934+0000 mon.smithi061 (mon.0) 474 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:08:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:34.273601+0000 mgr.smithi067.rdualw (mgr.24569) 1380 : cluster [DBG] pgmap v1192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:08:34.635173+0000 mon.smithi067 (mon.1) 247 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:08:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:08:34.635428+0000 mon.smithi067 (mon.1) 248 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:08:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:08:34.635662+0000 mon.smithi061 (mon.0) 473 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:08:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:08:34.635934+0000 mon.smithi061 (mon.0) 474 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:08:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:36.274439+0000 mgr.smithi067.rdualw (mgr.24569) 1381 : cluster [DBG] pgmap v1193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:08:38.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:36.274439+0000 mgr.smithi067.rdualw (mgr.24569) 1381 : cluster [DBG] pgmap v1193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:08:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:38.275123+0000 mgr.smithi067.rdualw (mgr.24569) 1382 : cluster [DBG] pgmap v1194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:38.275123+0000 mgr.smithi067.rdualw (mgr.24569) 1382 : cluster [DBG] pgmap v1194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:42.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:40.275898+0000 mgr.smithi067.rdualw (mgr.24569) 1383 : cluster [DBG] pgmap v1195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:42.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:40.275898+0000 mgr.smithi067.rdualw (mgr.24569) 1383 : cluster [DBG] pgmap v1195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:44.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:42.276747+0000 mgr.smithi067.rdualw (mgr.24569) 1384 : cluster [DBG] pgmap v1196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:42.276747+0000 mgr.smithi067.rdualw (mgr.24569) 1384 : cluster [DBG] pgmap v1196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:44.277570+0000 mgr.smithi067.rdualw (mgr.24569) 1385 : cluster [DBG] pgmap v1197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:44.277570+0000 mgr.smithi067.rdualw (mgr.24569) 1385 : cluster [DBG] pgmap v1197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:46.278631+0000 mgr.smithi067.rdualw (mgr.24569) 1386 : cluster [DBG] pgmap v1198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:08:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:46.278631+0000 mgr.smithi067.rdualw (mgr.24569) 1386 : cluster [DBG] pgmap v1198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:08:48.356 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:08:48.647 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:08:48.648 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (46m) 7m ago 47m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:08:48.648 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (39m) 7m ago 47m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:08:48.648 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (38m) 8m ago 46m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:08:48.648 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (46m) 7m ago 47m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:08:48.649 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (39m) 7m ago 43m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:08:48.649 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (39m) 8m ago 43m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:08:48.649 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (40m) 7m ago 48m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:08:48.649 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (40m) 8m ago 46m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:08:48.650 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (39m) 7m ago 48m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:08:48.650 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (39m) 8m ago 46m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:08:48.650 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (40m) 7m ago 40m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:08:48.650 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (40m) 8m ago 40m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:08:48.651 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (47m) 7m ago 47m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:08:48.651 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (46m) 8m ago 46m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:08:48.651 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (29m) 7m ago 46m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:08:48.651 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (45m) 7m ago 45m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:08:48.652 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (45m) 7m ago 45m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:08:48.652 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (45m) 7m ago 45m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:08:48.652 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (45m) 8m ago 45m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:08:48.652 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (44m) 8m ago 44m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:08:48.652 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (44m) 8m ago 44m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:08:48.653 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (44m) 8m ago 44m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:08:48.653 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (46m) 7m ago 47m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:08:48.991 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:08:48.991 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:08:48.991 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:08:48.991 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:08:48.992 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:08:48.992 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:08:48.992 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:08:48.992 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:08:48.993 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:08:48.993 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:08:48.993 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:08:48.993 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:08:48.994 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:08:48.994 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:08:48.994 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:08:48.994 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:08:48.994 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:08:48.995 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:08:48.995 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:08:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:48.279209+0000 mgr.smithi067.rdualw (mgr.24569) 1387 : cluster [DBG] pgmap v1199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:08:48.342385+0000 mgr.smithi067.rdualw (mgr.24569) 1388 : audit [DBG] from='client.35062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:08:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:08:48.629590+0000 mgr.smithi067.rdualw (mgr.24569) 1389 : audit [DBG] from='client.35066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:08:50.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:08:48.989490+0000 mon.smithi061 (mon.0) 475 : audit [DBG] from='client.? 172.21.15.61:0/1193891064' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:08:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:48.279209+0000 mgr.smithi067.rdualw (mgr.24569) 1387 : cluster [DBG] pgmap v1199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:08:48.342385+0000 mgr.smithi067.rdualw (mgr.24569) 1388 : audit [DBG] from='client.35062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:08:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:08:48.629590+0000 mgr.smithi067.rdualw (mgr.24569) 1389 : audit [DBG] from='client.35066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:08:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:08:48.989490+0000 mon.smithi061 (mon.0) 475 : audit [DBG] from='client.? 172.21.15.61:0/1193891064' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:08:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:50.279942+0000 mgr.smithi067.rdualw (mgr.24569) 1390 : cluster [DBG] pgmap v1200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:50.279942+0000 mgr.smithi067.rdualw (mgr.24569) 1390 : cluster [DBG] pgmap v1200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:52.280845+0000 mgr.smithi067.rdualw (mgr.24569) 1391 : cluster [DBG] pgmap v1201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:52.280845+0000 mgr.smithi067.rdualw (mgr.24569) 1391 : cluster [DBG] pgmap v1201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:08:54.251032+0000 mon.smithi067 (mon.1) 249 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:08:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:08:54.252425+0000 mon.smithi067 (mon.1) 250 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:08:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:08:54.253382+0000 mon.smithi067 (mon.1) 251 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:08:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:08:54.251032+0000 mon.smithi067 (mon.1) 249 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:08:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:08:54.252425+0000 mon.smithi067 (mon.1) 250 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:08:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:08:54.253382+0000 mon.smithi067 (mon.1) 251 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:08:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:08:54.254284+0000 mgr.smithi067.rdualw (mgr.24569) 1392 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:08:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:54.281433+0000 mgr.smithi067.rdualw (mgr.24569) 1393 : cluster [DBG] pgmap v1202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:08:54.669735+0000 mon.smithi061 (mon.0) 476 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:08:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:08:54.675362+0000 mon.smithi061 (mon.0) 477 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:08:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:08:54.254284+0000 mgr.smithi067.rdualw (mgr.24569) 1392 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:08:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:54.281433+0000 mgr.smithi067.rdualw (mgr.24569) 1393 : cluster [DBG] pgmap v1202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:08:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:08:54.669735+0000 mon.smithi061 (mon.0) 476 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:08:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:08:54.675362+0000 mon.smithi061 (mon.0) 477 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:08:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:56.282441+0000 mgr.smithi067.rdualw (mgr.24569) 1394 : cluster [DBG] pgmap v1203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:08:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:56.282441+0000 mgr.smithi067.rdualw (mgr.24569) 1394 : cluster [DBG] pgmap v1203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:09:00.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:08:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:08:58.283108+0000 mgr.smithi067.rdualw (mgr.24569) 1395 : cluster [DBG] pgmap v1204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:08:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:08:58.283108+0000 mgr.smithi067.rdualw (mgr.24569) 1395 : cluster [DBG] pgmap v1204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:00.283780+0000 mgr.smithi067.rdualw (mgr.24569) 1396 : cluster [DBG] pgmap v1205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:00.283780+0000 mgr.smithi067.rdualw (mgr.24569) 1396 : cluster [DBG] pgmap v1205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:02.284682+0000 mgr.smithi067.rdualw (mgr.24569) 1397 : cluster [DBG] pgmap v1206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:02.284682+0000 mgr.smithi067.rdualw (mgr.24569) 1397 : cluster [DBG] pgmap v1206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:04.285236+0000 mgr.smithi067.rdualw (mgr.24569) 1398 : cluster [DBG] pgmap v1207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:04.285236+0000 mgr.smithi067.rdualw (mgr.24569) 1398 : cluster [DBG] pgmap v1207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:06.286230+0000 mgr.smithi067.rdualw (mgr.24569) 1399 : cluster [DBG] pgmap v1208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:09:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:06.286230+0000 mgr.smithi067.rdualw (mgr.24569) 1399 : cluster [DBG] pgmap v1208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:09:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:08.286785+0000 mgr.smithi067.rdualw (mgr.24569) 1400 : cluster [DBG] pgmap v1209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:08.286785+0000 mgr.smithi067.rdualw (mgr.24569) 1400 : cluster [DBG] pgmap v1209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:10.287674+0000 mgr.smithi067.rdualw (mgr.24569) 1401 : cluster [DBG] pgmap v1210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:10.287674+0000 mgr.smithi067.rdualw (mgr.24569) 1401 : cluster [DBG] pgmap v1210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:12.288487+0000 mgr.smithi067.rdualw (mgr.24569) 1402 : cluster [DBG] pgmap v1211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:12.288487+0000 mgr.smithi067.rdualw (mgr.24569) 1402 : cluster [DBG] pgmap v1211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:14.289264+0000 mgr.smithi067.rdualw (mgr.24569) 1403 : cluster [DBG] pgmap v1212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:14.289264+0000 mgr.smithi067.rdualw (mgr.24569) 1403 : cluster [DBG] pgmap v1212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:16.290214+0000 mgr.smithi067.rdualw (mgr.24569) 1404 : cluster [DBG] pgmap v1213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:09:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:16.290214+0000 mgr.smithi067.rdualw (mgr.24569) 1404 : cluster [DBG] pgmap v1213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:09:19.298 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:09:19.587 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:09:19.588 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (46m) 8m ago 47m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:09:19.588 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (39m) 8m ago 47m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:09:19.588 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (39m) 8m ago 47m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:09:19.588 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (46m) 8m ago 47m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:09:19.589 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (40m) 8m ago 43m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:09:19.589 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (39m) 8m ago 43m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:09:19.589 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (41m) 8m ago 49m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:09:19.589 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (40m) 8m ago 47m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:09:19.590 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (40m) 8m ago 49m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:09:19.590 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (40m) 8m ago 47m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:09:19.591 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (41m) 8m ago 41m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:09:19.591 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (41m) 8m ago 41m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:09:19.591 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (47m) 8m ago 47m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:09:19.592 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (47m) 8m ago 47m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:09:19.592 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (30m) 8m ago 46m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:09:19.592 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (46m) 8m ago 46m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:09:19.593 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (46m) 8m ago 46m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:09:19.593 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (45m) 8m ago 45m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:09:19.593 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (45m) 8m ago 45m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:09:19.594 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (45m) 8m ago 45m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:09:19.594 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (45m) 8m ago 45m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:09:19.594 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (44m) 8m ago 44m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:09:19.594 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (46m) 8m ago 47m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:09:19.934 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:09:19.935 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:09:19.935 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:09:19.935 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:09:19.935 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:09:19.936 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:09:19.936 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:09:19.936 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:09:19.936 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:09:19.937 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:09:19.937 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:09:19.937 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:09:19.938 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:09:19.938 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:09:19.938 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:09:19.938 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:09:19.939 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:09:19.939 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:09:19.939 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:09:20.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:18.290846+0000 mgr.smithi067.rdualw (mgr.24569) 1405 : cluster [DBG] pgmap v1214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:18.290846+0000 mgr.smithi067.rdualw (mgr.24569) 1405 : cluster [DBG] pgmap v1214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:09:19.285520+0000 mgr.smithi067.rdualw (mgr.24569) 1406 : audit [DBG] from='client.35074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:09:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:09:19.569738+0000 mgr.smithi067.rdualw (mgr.24569) 1407 : audit [DBG] from='client.35078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:09:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:09:19.932649+0000 mon.smithi061 (mon.0) 478 : audit [DBG] from='client.? 172.21.15.61:0/3787016439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:09:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:09:19.285520+0000 mgr.smithi067.rdualw (mgr.24569) 1406 : audit [DBG] from='client.35074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:09:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:09:19.569738+0000 mgr.smithi067.rdualw (mgr.24569) 1407 : audit [DBG] from='client.35078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:09:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:09:19.932649+0000 mon.smithi061 (mon.0) 478 : audit [DBG] from='client.? 172.21.15.61:0/3787016439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:09:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:20.291685+0000 mgr.smithi067.rdualw (mgr.24569) 1408 : cluster [DBG] pgmap v1215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:20.291685+0000 mgr.smithi067.rdualw (mgr.24569) 1408 : cluster [DBG] pgmap v1215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:24.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:22.292308+0000 mgr.smithi067.rdualw (mgr.24569) 1409 : cluster [DBG] pgmap v1216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:22.292308+0000 mgr.smithi067.rdualw (mgr.24569) 1409 : cluster [DBG] pgmap v1216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:24.292932+0000 mgr.smithi067.rdualw (mgr.24569) 1410 : cluster [DBG] pgmap v1217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:26.129 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:24.292932+0000 mgr.smithi067.rdualw (mgr.24569) 1410 : cluster [DBG] pgmap v1217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:26.293950+0000 mgr.smithi067.rdualw (mgr.24569) 1411 : cluster [DBG] pgmap v1218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:09:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:26.293950+0000 mgr.smithi067.rdualw (mgr.24569) 1411 : cluster [DBG] pgmap v1218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:09:30.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:28.294706+0000 mgr.smithi067.rdualw (mgr.24569) 1412 : cluster [DBG] pgmap v1219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:28.294706+0000 mgr.smithi067.rdualw (mgr.24569) 1412 : cluster [DBG] pgmap v1219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:32.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:30.295614+0000 mgr.smithi067.rdualw (mgr.24569) 1413 : cluster [DBG] pgmap v1220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:30.295614+0000 mgr.smithi067.rdualw (mgr.24569) 1413 : cluster [DBG] pgmap v1220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:34.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:32.296351+0000 mgr.smithi067.rdualw (mgr.24569) 1414 : cluster [DBG] pgmap v1221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:32.296351+0000 mgr.smithi067.rdualw (mgr.24569) 1414 : cluster [DBG] pgmap v1221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:34.296993+0000 mgr.smithi067.rdualw (mgr.24569) 1415 : cluster [DBG] pgmap v1222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:09:34.640228+0000 mon.smithi067 (mon.1) 252 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:09:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:09:34.640487+0000 mon.smithi067 (mon.1) 253 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:09:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:09:34.640621+0000 mon.smithi061 (mon.0) 479 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:09:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:09:34.641025+0000 mon.smithi061 (mon.0) 480 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:09:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:34.296993+0000 mgr.smithi067.rdualw (mgr.24569) 1415 : cluster [DBG] pgmap v1222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:09:34.640228+0000 mon.smithi067 (mon.1) 252 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:09:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:09:34.640487+0000 mon.smithi067 (mon.1) 253 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:09:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:09:34.640621+0000 mon.smithi061 (mon.0) 479 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:09:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:09:34.641025+0000 mon.smithi061 (mon.0) 480 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:09:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:36.298003+0000 mgr.smithi067.rdualw (mgr.24569) 1416 : cluster [DBG] pgmap v1223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:09:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:36.298003+0000 mgr.smithi067.rdualw (mgr.24569) 1416 : cluster [DBG] pgmap v1223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:09:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:38.298576+0000 mgr.smithi067.rdualw (mgr.24569) 1417 : cluster [DBG] pgmap v1224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:38.298576+0000 mgr.smithi067.rdualw (mgr.24569) 1417 : cluster [DBG] pgmap v1224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:40.299404+0000 mgr.smithi067.rdualw (mgr.24569) 1418 : cluster [DBG] pgmap v1225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:40.299404+0000 mgr.smithi067.rdualw (mgr.24569) 1418 : cluster [DBG] pgmap v1225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:44.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:42.299876+0000 mgr.smithi067.rdualw (mgr.24569) 1419 : cluster [DBG] pgmap v1226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:44.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:42.299876+0000 mgr.smithi067.rdualw (mgr.24569) 1419 : cluster [DBG] pgmap v1226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:44.300553+0000 mgr.smithi067.rdualw (mgr.24569) 1420 : cluster [DBG] pgmap v1227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:44.300553+0000 mgr.smithi067.rdualw (mgr.24569) 1420 : cluster [DBG] pgmap v1227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:46.301588+0000 mgr.smithi067.rdualw (mgr.24569) 1421 : cluster [DBG] pgmap v1228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:09:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:46.301588+0000 mgr.smithi067.rdualw (mgr.24569) 1421 : cluster [DBG] pgmap v1228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:09:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:48.302147+0000 mgr.smithi067.rdualw (mgr.24569) 1422 : cluster [DBG] pgmap v1229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:48.302147+0000 mgr.smithi067.rdualw (mgr.24569) 1422 : cluster [DBG] pgmap v1229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:50.243 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:09:50.535 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:09:50.536 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (47m) 8m ago 48m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:09:50.536 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (40m) 8m ago 48m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:09:50.536 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (39m) 9m ago 47m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:09:50.537 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (47m) 8m ago 48m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:09:50.537 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (40m) 8m ago 44m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:09:50.537 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (40m) 9m ago 44m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:09:50.537 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (41m) 8m ago 49m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:09:50.538 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (41m) 9m ago 47m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:09:50.538 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (41m) 8m ago 49m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:09:50.538 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (40m) 9m ago 47m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:09:50.539 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (41m) 8m ago 41m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:09:50.539 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (41m) 9m ago 41m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:09:50.539 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (48m) 8m ago 48m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:09:50.539 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (47m) 9m ago 47m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:09:50.539 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (30m) 8m ago 47m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:09:50.540 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (47m) 8m ago 47m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:09:50.540 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (46m) 8m ago 46m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:09:50.540 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (46m) 8m ago 46m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:09:50.540 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (46m) 9m ago 46m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:09:50.541 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (45m) 9m ago 45m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:09:50.541 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (45m) 9m ago 45m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:09:50.541 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (45m) 9m ago 45m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:09:50.541 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (47m) 8m ago 48m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:09:50.878 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:09:50.879 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:09:50.879 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:09:50.879 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:09:50.880 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:09:50.880 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:09:50.880 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:09:50.880 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:09:50.881 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:09:50.881 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:09:50.881 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:09:50.882 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:09:50.882 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:09:50.882 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:09:50.882 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:09:50.883 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:09:50.883 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:09:50.883 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:09:50.883 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:09:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:09:50.229501+0000 mgr.smithi067.rdualw (mgr.24569) 1423 : audit [DBG] from='client.35086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:09:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:09:50.229501+0000 mgr.smithi067.rdualw (mgr.24569) 1423 : audit [DBG] from='client.35086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:09:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:50.302940+0000 mgr.smithi067.rdualw (mgr.24569) 1424 : cluster [DBG] pgmap v1230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:09:50.517925+0000 mgr.smithi067.rdualw (mgr.24569) 1425 : audit [DBG] from='client.35090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:09:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:09:50.876865+0000 mon.smithi061 (mon.0) 481 : audit [DBG] from='client.? 172.21.15.61:0/1504283751' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:09:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:50.302940+0000 mgr.smithi067.rdualw (mgr.24569) 1424 : cluster [DBG] pgmap v1230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:52.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:09:50.517925+0000 mgr.smithi067.rdualw (mgr.24569) 1425 : audit [DBG] from='client.35090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:09:52.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:09:50.876865+0000 mon.smithi061 (mon.0) 481 : audit [DBG] from='client.? 172.21.15.61:0/1504283751' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:09:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:52.303639+0000 mgr.smithi067.rdualw (mgr.24569) 1426 : cluster [DBG] pgmap v1231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:52.303639+0000 mgr.smithi067.rdualw (mgr.24569) 1426 : cluster [DBG] pgmap v1231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:54.304240+0000 mgr.smithi067.rdualw (mgr.24569) 1427 : cluster [DBG] pgmap v1232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:09:54.678661+0000 mon.smithi067 (mon.1) 254 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:09:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:09:54.680159+0000 mon.smithi067 (mon.1) 255 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:09:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:09:54.681145+0000 mon.smithi067 (mon.1) 256 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:09:56.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:09:54.682026+0000 mgr.smithi067.rdualw (mgr.24569) 1428 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:09:56.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:09:55.096857+0000 mon.smithi061 (mon.0) 482 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:09:56.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:09:55.105001+0000 mon.smithi061 (mon.0) 483 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:09:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:54.304240+0000 mgr.smithi067.rdualw (mgr.24569) 1427 : cluster [DBG] pgmap v1232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:09:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:09:54.678661+0000 mon.smithi067 (mon.1) 254 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:09:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:09:54.680159+0000 mon.smithi067 (mon.1) 255 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:09:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:09:54.681145+0000 mon.smithi067 (mon.1) 256 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:09:56.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:09:54.682026+0000 mgr.smithi067.rdualw (mgr.24569) 1428 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:09:56.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:09:55.096857+0000 mon.smithi061 (mon.0) 482 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:09:56.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:09:55.105001+0000 mon.smithi061 (mon.0) 483 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:09:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:56.305163+0000 mgr.smithi067.rdualw (mgr.24569) 1429 : cluster [DBG] pgmap v1233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:09:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:56.305163+0000 mgr.smithi067.rdualw (mgr.24569) 1429 : cluster [DBG] pgmap v1233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:10:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:09:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:09:58.305829+0000 mgr.smithi067.rdualw (mgr.24569) 1430 : cluster [DBG] pgmap v1234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:09:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:09:58.305829+0000 mgr.smithi067.rdualw (mgr.24569) 1430 : cluster [DBG] pgmap v1234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:00.000091+0000 mon.smithi061 (mon.0) 484 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T16:10:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:00.000091+0000 mon.smithi061 (mon.0) 484 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T16:10:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:00.306624+0000 mgr.smithi067.rdualw (mgr.24569) 1431 : cluster [DBG] pgmap v1235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:00.306624+0000 mgr.smithi067.rdualw (mgr.24569) 1431 : cluster [DBG] pgmap v1235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:02.307234+0000 mgr.smithi067.rdualw (mgr.24569) 1432 : cluster [DBG] pgmap v1236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:02.307234+0000 mgr.smithi067.rdualw (mgr.24569) 1432 : cluster [DBG] pgmap v1236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:06.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:04.307835+0000 mgr.smithi067.rdualw (mgr.24569) 1433 : cluster [DBG] pgmap v1237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:04.307835+0000 mgr.smithi067.rdualw (mgr.24569) 1433 : cluster [DBG] pgmap v1237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:06.308779+0000 mgr.smithi067.rdualw (mgr.24569) 1434 : cluster [DBG] pgmap v1238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:10:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:06.308779+0000 mgr.smithi067.rdualw (mgr.24569) 1434 : cluster [DBG] pgmap v1238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:10:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:08.309383+0000 mgr.smithi067.rdualw (mgr.24569) 1435 : cluster [DBG] pgmap v1239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:08.309383+0000 mgr.smithi067.rdualw (mgr.24569) 1435 : cluster [DBG] pgmap v1239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:10.310268+0000 mgr.smithi067.rdualw (mgr.24569) 1436 : cluster [DBG] pgmap v1240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:10.310268+0000 mgr.smithi067.rdualw (mgr.24569) 1436 : cluster [DBG] pgmap v1240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:12.310860+0000 mgr.smithi067.rdualw (mgr.24569) 1437 : cluster [DBG] pgmap v1241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:12.310860+0000 mgr.smithi067.rdualw (mgr.24569) 1437 : cluster [DBG] pgmap v1241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:14.311522+0000 mgr.smithi067.rdualw (mgr.24569) 1438 : cluster [DBG] pgmap v1242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:14.311522+0000 mgr.smithi067.rdualw (mgr.24569) 1438 : cluster [DBG] pgmap v1242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:18.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:16.312580+0000 mgr.smithi067.rdualw (mgr.24569) 1439 : cluster [DBG] pgmap v1243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:10:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:16.312580+0000 mgr.smithi067.rdualw (mgr.24569) 1439 : cluster [DBG] pgmap v1243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:10:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:18.313075+0000 mgr.smithi067.rdualw (mgr.24569) 1440 : cluster [DBG] pgmap v1244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:18.313075+0000 mgr.smithi067.rdualw (mgr.24569) 1440 : cluster [DBG] pgmap v1244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:21.185 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:10:21.478 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:10:21.479 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (47m) 9m ago 48m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:10:21.479 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (40m) 9m ago 48m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:10:21.479 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (40m) 9m ago 48m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:10:21.479 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (47m) 9m ago 48m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:10:21.480 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (41m) 9m ago 44m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:10:21.480 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (40m) 9m ago 44m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:10:21.480 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (42m) 9m ago 50m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:10:21.480 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (41m) 9m ago 48m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:10:21.480 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (41m) 9m ago 50m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:10:21.481 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (41m) 9m ago 48m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:10:21.481 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (42m) 9m ago 42m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:10:21.481 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (42m) 9m ago 42m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:10:21.481 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (48m) 9m ago 48m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:10:21.481 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (48m) 9m ago 48m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:10:21.482 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (31m) 9m ago 47m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:10:21.482 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (47m) 9m ago 47m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:10:21.482 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (47m) 9m ago 47m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:10:21.483 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (46m) 9m ago 46m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:10:21.483 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (46m) 9m ago 46m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:10:21.483 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (46m) 9m ago 46m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:10:21.483 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (46m) 9m ago 46m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:10:21.483 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (45m) 9m ago 45m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:10:21.484 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (47m) 9m ago 48m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:10:21.826 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:10:21.826 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:10:21.826 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:10:21.827 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:10:21.827 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:10:21.827 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:10:21.827 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:10:21.828 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:10:21.828 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:10:21.828 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:10:21.828 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:10:21.829 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:10:21.829 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:10:21.829 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:10:21.829 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:10:21.829 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:10:21.830 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:10:21.830 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:10:21.830 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:10:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:20.313933+0000 mgr.smithi067.rdualw (mgr.24569) 1441 : cluster [DBG] pgmap v1245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:10:21.171699+0000 mgr.smithi067.rdualw (mgr.24569) 1442 : audit [DBG] from='client.35098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:10:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:20.313933+0000 mgr.smithi067.rdualw (mgr.24569) 1441 : cluster [DBG] pgmap v1245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:10:21.171699+0000 mgr.smithi067.rdualw (mgr.24569) 1442 : audit [DBG] from='client.35098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:10:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:10:21.460587+0000 mgr.smithi067.rdualw (mgr.24569) 1443 : audit [DBG] from='client.35102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:10:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:10:21.824506+0000 mon.smithi061 (mon.0) 485 : audit [DBG] from='client.? 172.21.15.61:0/3914931186' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:10:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:10:21.460587+0000 mgr.smithi067.rdualw (mgr.24569) 1443 : audit [DBG] from='client.35102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:10:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:10:21.824506+0000 mon.smithi061 (mon.0) 485 : audit [DBG] from='client.? 172.21.15.61:0/3914931186' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:10:24.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:22.314730+0000 mgr.smithi067.rdualw (mgr.24569) 1444 : cluster [DBG] pgmap v1246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:22.314730+0000 mgr.smithi067.rdualw (mgr.24569) 1444 : cluster [DBG] pgmap v1246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:24.315387+0000 mgr.smithi067.rdualw (mgr.24569) 1445 : cluster [DBG] pgmap v1247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:24.315387+0000 mgr.smithi067.rdualw (mgr.24569) 1445 : cluster [DBG] pgmap v1247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:26.316446+0000 mgr.smithi067.rdualw (mgr.24569) 1446 : cluster [DBG] pgmap v1248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:10:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:26.316446+0000 mgr.smithi067.rdualw (mgr.24569) 1446 : cluster [DBG] pgmap v1248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:10:30.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:28.317015+0000 mgr.smithi067.rdualw (mgr.24569) 1447 : cluster [DBG] pgmap v1249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:28.317015+0000 mgr.smithi067.rdualw (mgr.24569) 1447 : cluster [DBG] pgmap v1249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:30.318040+0000 mgr.smithi067.rdualw (mgr.24569) 1448 : cluster [DBG] pgmap v1250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:30.318040+0000 mgr.smithi067.rdualw (mgr.24569) 1448 : cluster [DBG] pgmap v1250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:34.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:32.318640+0000 mgr.smithi067.rdualw (mgr.24569) 1449 : cluster [DBG] pgmap v1251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:32.318640+0000 mgr.smithi067.rdualw (mgr.24569) 1449 : cluster [DBG] pgmap v1251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:34.319320+0000 mgr.smithi067.rdualw (mgr.24569) 1450 : cluster [DBG] pgmap v1252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:10:34.645656+0000 mon.smithi067 (mon.1) 257 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:10:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:10:34.645916+0000 mon.smithi067 (mon.1) 258 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:10:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:10:34.646332+0000 mon.smithi061 (mon.0) 486 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:10:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:10:34.646631+0000 mon.smithi061 (mon.0) 487 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:10:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:34.319320+0000 mgr.smithi067.rdualw (mgr.24569) 1450 : cluster [DBG] pgmap v1252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:10:34.645656+0000 mon.smithi067 (mon.1) 257 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:10:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:10:34.645916+0000 mon.smithi067 (mon.1) 258 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:10:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:10:34.646332+0000 mon.smithi061 (mon.0) 486 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:10:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:10:34.646631+0000 mon.smithi061 (mon.0) 487 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:10:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:36.320400+0000 mgr.smithi067.rdualw (mgr.24569) 1451 : cluster [DBG] pgmap v1253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:10:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:36.320400+0000 mgr.smithi067.rdualw (mgr.24569) 1451 : cluster [DBG] pgmap v1253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:10:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:38.321062+0000 mgr.smithi067.rdualw (mgr.24569) 1452 : cluster [DBG] pgmap v1254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:38.321062+0000 mgr.smithi067.rdualw (mgr.24569) 1452 : cluster [DBG] pgmap v1254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:40.322151+0000 mgr.smithi067.rdualw (mgr.24569) 1453 : cluster [DBG] pgmap v1255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:42.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:40.322151+0000 mgr.smithi067.rdualw (mgr.24569) 1453 : cluster [DBG] pgmap v1255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:44.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:42.322759+0000 mgr.smithi067.rdualw (mgr.24569) 1454 : cluster [DBG] pgmap v1256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:44.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:42.322759+0000 mgr.smithi067.rdualw (mgr.24569) 1454 : cluster [DBG] pgmap v1256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:44.323509+0000 mgr.smithi067.rdualw (mgr.24569) 1455 : cluster [DBG] pgmap v1257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:44.323509+0000 mgr.smithi067.rdualw (mgr.24569) 1455 : cluster [DBG] pgmap v1257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:46.324306+0000 mgr.smithi067.rdualw (mgr.24569) 1456 : cluster [DBG] pgmap v1258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:10:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:46.324306+0000 mgr.smithi067.rdualw (mgr.24569) 1456 : cluster [DBG] pgmap v1258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:10:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:48.324817+0000 mgr.smithi067.rdualw (mgr.24569) 1457 : cluster [DBG] pgmap v1259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:48.324817+0000 mgr.smithi067.rdualw (mgr.24569) 1457 : cluster [DBG] pgmap v1259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:50.325587+0000 mgr.smithi067.rdualw (mgr.24569) 1458 : cluster [DBG] pgmap v1260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:50.325587+0000 mgr.smithi067.rdualw (mgr.24569) 1458 : cluster [DBG] pgmap v1260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:52.135 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:10:52.426 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:10:52.427 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (48m) 10m ago 49m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:10:52.427 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (41m) 10m ago 49m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:10:52.427 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (40m) 10m ago 49m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:10:52.428 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (48m) 10m ago 49m 40.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:10:52.428 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (41m) 10m ago 45m 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:10:52.428 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (41m) 10m ago 45m 19.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:10:52.428 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (42m) 10m ago 50m 441M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:10:52.428 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (42m) 10m ago 48m 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:10:52.429 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (42m) 10m ago 50m 281M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:10:52.429 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (41m) 10m ago 48m 179M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:10:52.429 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (42m) 10m ago 42m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:10:52.429 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (42m) 10m ago 42m 95.5M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:10:52.430 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (49m) 10m ago 49m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:10:52.430 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (48m) 10m ago 48m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:10:52.431 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (31m) 10m ago 48m 481M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:10:52.431 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (48m) 10m ago 48m 1261M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:10:52.431 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (47m) 10m ago 47m 757M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:10:52.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (47m) 10m ago 47m 1378M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:10:52.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (47m) 10m ago 47m 1272M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:10:52.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (47m) 10m ago 47m 1533M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:10:52.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (46m) 10m ago 46m 1183M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:10:52.433 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (46m) 10m ago 46m 1994M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:10:52.433 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (48m) 10m ago 49m 54.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:10:52.799 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:10:52.800 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:10:52.800 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:10:52.800 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:10:52.801 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:10:52.801 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:10:52.801 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:10:52.801 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:10:52.802 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:10:52.802 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:10:52.802 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:10:52.802 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:10:52.802 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:10:52.803 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:10:52.803 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:10:52.803 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:10:52.803 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:10:52.804 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:10:52.804 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:10:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:10:52.121241+0000 mgr.smithi067.rdualw (mgr.24569) 1459 : audit [DBG] from='client.35110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:10:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:10:52.121241+0000 mgr.smithi067.rdualw (mgr.24569) 1459 : audit [DBG] from='client.35110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:10:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:52.326308+0000 mgr.smithi067.rdualw (mgr.24569) 1460 : cluster [DBG] pgmap v1261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:10:52.408952+0000 mgr.smithi067.rdualw (mgr.24569) 1461 : audit [DBG] from='client.35114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:10:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:10:52.798282+0000 mon.smithi061 (mon.0) 488 : audit [DBG] from='client.? 172.21.15.61:0/1702958543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:10:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:52.326308+0000 mgr.smithi067.rdualw (mgr.24569) 1460 : cluster [DBG] pgmap v1261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:10:52.408952+0000 mgr.smithi067.rdualw (mgr.24569) 1461 : audit [DBG] from='client.35114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:10:54.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:10:52.798282+0000 mon.smithi061 (mon.0) 488 : audit [DBG] from='client.? 172.21.15.61:0/1702958543' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:10:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:54.327132+0000 mgr.smithi067.rdualw (mgr.24569) 1462 : cluster [DBG] pgmap v1262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:10:55.110093+0000 mon.smithi067 (mon.1) 259 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:10:56.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:10:55.111580+0000 mon.smithi067 (mon.1) 260 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:10:56.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:10:55.112488+0000 mon.smithi067 (mon.1) 261 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:10:56.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:10:55.113362+0000 mgr.smithi067.rdualw (mgr.24569) 1463 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:10:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:54.327132+0000 mgr.smithi067.rdualw (mgr.24569) 1462 : cluster [DBG] pgmap v1262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:10:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:10:55.110093+0000 mon.smithi067 (mon.1) 259 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:10:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:10:55.111580+0000 mon.smithi067 (mon.1) 260 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:10:56.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:10:55.112488+0000 mon.smithi067 (mon.1) 261 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:10:56.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:10:55.113362+0000 mgr.smithi067.rdualw (mgr.24569) 1463 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:10:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:56.327903+0000 mgr.smithi067.rdualw (mgr.24569) 1464 : cluster [DBG] pgmap v1263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:10:58.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:56.327903+0000 mgr.smithi067.rdualw (mgr.24569) 1464 : cluster [DBG] pgmap v1263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:11:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:10:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:10:58.328332+0000 mgr.smithi067.rdualw (mgr.24569) 1465 : cluster [DBG] pgmap v1264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:10:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:10:58.328332+0000 mgr.smithi067.rdualw (mgr.24569) 1465 : cluster [DBG] pgmap v1264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:01.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:10:59.902708+0000 mon.smithi061 (mon.0) 489 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:11:01.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:11:00.301705+0000 mon.smithi067 (mon.1) 262 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:11:01.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:11:00.302164+0000 mon.smithi061 (mon.0) 490 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:11:01.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:10:59.902708+0000 mon.smithi061 (mon.0) 489 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:11:01.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:11:00.301705+0000 mon.smithi067 (mon.1) 262 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:11:01.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:11:00.302164+0000 mon.smithi061 (mon.0) 490 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:11:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:00.329129+0000 mgr.smithi067.rdualw (mgr.24569) 1466 : cluster [DBG] pgmap v1265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:00.329129+0000 mgr.smithi067.rdualw (mgr.24569) 1466 : cluster [DBG] pgmap v1265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:03.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:11:02.321903+0000 mon.smithi061 (mon.0) 491 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:11:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:02.329591+0000 mgr.smithi067.rdualw (mgr.24569) 1467 : cluster [DBG] pgmap v1266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:11:02.712451+0000 mon.smithi067 (mon.1) 263 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:11:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:11:02.712994+0000 mon.smithi061 (mon.0) 492 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:11:03.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:11:02.717450+0000 mon.smithi061 (mon.0) 493 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:11:03.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:11:02.724130+0000 mon.smithi061 (mon.0) 494 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:11:03.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:11:02.321903+0000 mon.smithi061 (mon.0) 491 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:11:03.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:02.329591+0000 mgr.smithi067.rdualw (mgr.24569) 1467 : cluster [DBG] pgmap v1266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:03.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:11:02.712451+0000 mon.smithi067 (mon.1) 263 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:11:03.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:11:02.712994+0000 mon.smithi061 (mon.0) 492 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:11:03.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:11:02.717450+0000 mon.smithi061 (mon.0) 493 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:11:03.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:11:02.724130+0000 mon.smithi061 (mon.0) 494 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:11:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:04.330105+0000 mgr.smithi067.rdualw (mgr.24569) 1468 : cluster [DBG] pgmap v1267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:04.330105+0000 mgr.smithi067.rdualw (mgr.24569) 1468 : cluster [DBG] pgmap v1267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:06.331142+0000 mgr.smithi067.rdualw (mgr.24569) 1469 : cluster [DBG] pgmap v1268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:11:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:06.331142+0000 mgr.smithi067.rdualw (mgr.24569) 1469 : cluster [DBG] pgmap v1268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:11:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:08.331680+0000 mgr.smithi067.rdualw (mgr.24569) 1470 : cluster [DBG] pgmap v1269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:08.331680+0000 mgr.smithi067.rdualw (mgr.24569) 1470 : cluster [DBG] pgmap v1269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:12.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:10.332617+0000 mgr.smithi067.rdualw (mgr.24569) 1471 : cluster [DBG] pgmap v1270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:10.332617+0000 mgr.smithi067.rdualw (mgr.24569) 1471 : cluster [DBG] pgmap v1270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:12.333163+0000 mgr.smithi067.rdualw (mgr.24569) 1472 : cluster [DBG] pgmap v1271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:12.333163+0000 mgr.smithi067.rdualw (mgr.24569) 1472 : cluster [DBG] pgmap v1271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:14.333885+0000 mgr.smithi067.rdualw (mgr.24569) 1473 : cluster [DBG] pgmap v1272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:14.333885+0000 mgr.smithi067.rdualw (mgr.24569) 1473 : cluster [DBG] pgmap v1272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:16.334783+0000 mgr.smithi067.rdualw (mgr.24569) 1474 : cluster [DBG] pgmap v1273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:11:18.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:16.334783+0000 mgr.smithi067.rdualw (mgr.24569) 1474 : cluster [DBG] pgmap v1273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:11:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:18.335311+0000 mgr.smithi067.rdualw (mgr.24569) 1475 : cluster [DBG] pgmap v1274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:18.335311+0000 mgr.smithi067.rdualw (mgr.24569) 1475 : cluster [DBG] pgmap v1274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:20.336206+0000 mgr.smithi067.rdualw (mgr.24569) 1476 : cluster [DBG] pgmap v1275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:20.336206+0000 mgr.smithi067.rdualw (mgr.24569) 1476 : cluster [DBG] pgmap v1275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:23.109 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:11:23.401 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:11:23.402 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (48m) 21s ago 50m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:11:23.402 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (41m) 21s ago 49m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:11:23.402 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (41m) 23s ago 49m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:11:23.403 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (48m) 21s ago 49m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:11:23.403 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (42m) 21s ago 45m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:11:23.403 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (41m) 23s ago 45m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:11:23.403 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (43m) 21s ago 51m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:11:23.403 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (42m) 23s ago 49m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:11:23.404 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (42m) 21s ago 51m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:11:23.404 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (42m) 23s ago 49m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:11:23.404 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (43m) 21s ago 43m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:11:23.404 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (43m) 23s ago 43m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:11:23.405 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (49m) 21s ago 49m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:11:23.405 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (49m) 23s ago 49m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:11:23.405 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (32m) 21s ago 48m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:11:23.405 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (48m) 21s ago 48m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:11:23.406 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (48m) 21s ago 48m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:11:23.406 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (48m) 21s ago 47m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:11:23.406 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (47m) 23s ago 47m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:11:23.406 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (47m) 23s ago 47m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:11:23.407 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (47m) 23s ago 47m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:11:23.407 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (47m) 23s ago 47m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:11:23.407 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (48m) 21s ago 49m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:11:23.771 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:11:23.772 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:11:23.772 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:11:23.772 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:11:23.773 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:11:23.773 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:11:23.773 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:11:23.773 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:11:23.773 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:11:23.774 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:11:23.774 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:11:23.774 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:11:23.774 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:11:23.775 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:11:23.775 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:11:23.775 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:11:23.775 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:11:23.775 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:11:23.776 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:11:24.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:22.336775+0000 mgr.smithi067.rdualw (mgr.24569) 1477 : cluster [DBG] pgmap v1276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:11:23.095622+0000 mgr.smithi067.rdualw (mgr.24569) 1478 : audit [DBG] from='client.35122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:11:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:22.336775+0000 mgr.smithi067.rdualw (mgr.24569) 1477 : cluster [DBG] pgmap v1276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:11:23.095622+0000 mgr.smithi067.rdualw (mgr.24569) 1478 : audit [DBG] from='client.35122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:11:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:11:23.383963+0000 mgr.smithi067.rdualw (mgr.24569) 1479 : audit [DBG] from='client.35126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:11:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:11:23.770013+0000 mon.smithi061 (mon.0) 495 : audit [DBG] from='client.? 172.21.15.61:0/879041462' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:11:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:11:23.383963+0000 mgr.smithi067.rdualw (mgr.24569) 1479 : audit [DBG] from='client.35126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:11:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:11:23.770013+0000 mon.smithi061 (mon.0) 495 : audit [DBG] from='client.? 172.21.15.61:0/879041462' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:11:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:24.337570+0000 mgr.smithi067.rdualw (mgr.24569) 1480 : cluster [DBG] pgmap v1277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:24.337570+0000 mgr.smithi067.rdualw (mgr.24569) 1480 : cluster [DBG] pgmap v1277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:28.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:26.338615+0000 mgr.smithi067.rdualw (mgr.24569) 1481 : cluster [DBG] pgmap v1278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:11:28.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:26.338615+0000 mgr.smithi067.rdualw (mgr.24569) 1481 : cluster [DBG] pgmap v1278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:11:30.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:28.339135+0000 mgr.smithi067.rdualw (mgr.24569) 1482 : cluster [DBG] pgmap v1279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:28.339135+0000 mgr.smithi067.rdualw (mgr.24569) 1482 : cluster [DBG] pgmap v1279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:30.339959+0000 mgr.smithi067.rdualw (mgr.24569) 1483 : cluster [DBG] pgmap v1280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:30.339959+0000 mgr.smithi067.rdualw (mgr.24569) 1483 : cluster [DBG] pgmap v1280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:32.340572+0000 mgr.smithi067.rdualw (mgr.24569) 1484 : cluster [DBG] pgmap v1281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:34.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:32.340572+0000 mgr.smithi067.rdualw (mgr.24569) 1484 : cluster [DBG] pgmap v1281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:34.341306+0000 mgr.smithi067.rdualw (mgr.24569) 1485 : cluster [DBG] pgmap v1282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:11:34.653343+0000 mon.smithi067 (mon.1) 264 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:11:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:11:34.653703+0000 mon.smithi067 (mon.1) 265 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:11:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:11:34.653936+0000 mon.smithi061 (mon.0) 496 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:11:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:11:34.654254+0000 mon.smithi061 (mon.0) 497 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:11:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:34.341306+0000 mgr.smithi067.rdualw (mgr.24569) 1485 : cluster [DBG] pgmap v1282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:11:34.653343+0000 mon.smithi067 (mon.1) 264 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:11:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:11:34.653703+0000 mon.smithi067 (mon.1) 265 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:11:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:11:34.653936+0000 mon.smithi061 (mon.0) 496 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:11:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:11:34.654254+0000 mon.smithi061 (mon.0) 497 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:11:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:36.342400+0000 mgr.smithi067.rdualw (mgr.24569) 1486 : cluster [DBG] pgmap v1283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:11:38.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:36.342400+0000 mgr.smithi067.rdualw (mgr.24569) 1486 : cluster [DBG] pgmap v1283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:11:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:38.342901+0000 mgr.smithi067.rdualw (mgr.24569) 1487 : cluster [DBG] pgmap v1284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:38.342901+0000 mgr.smithi067.rdualw (mgr.24569) 1487 : cluster [DBG] pgmap v1284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:42.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:40.343727+0000 mgr.smithi067.rdualw (mgr.24569) 1488 : cluster [DBG] pgmap v1285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:40.343727+0000 mgr.smithi067.rdualw (mgr.24569) 1488 : cluster [DBG] pgmap v1285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:42.344220+0000 mgr.smithi067.rdualw (mgr.24569) 1489 : cluster [DBG] pgmap v1286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:42.344220+0000 mgr.smithi067.rdualw (mgr.24569) 1489 : cluster [DBG] pgmap v1286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:44.344791+0000 mgr.smithi067.rdualw (mgr.24569) 1490 : cluster [DBG] pgmap v1287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:44.344791+0000 mgr.smithi067.rdualw (mgr.24569) 1490 : cluster [DBG] pgmap v1287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:46.345787+0000 mgr.smithi067.rdualw (mgr.24569) 1491 : cluster [DBG] pgmap v1288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:11:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:46.345787+0000 mgr.smithi067.rdualw (mgr.24569) 1491 : cluster [DBG] pgmap v1288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:11:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:48.346318+0000 mgr.smithi067.rdualw (mgr.24569) 1492 : cluster [DBG] pgmap v1289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:48.346318+0000 mgr.smithi067.rdualw (mgr.24569) 1492 : cluster [DBG] pgmap v1289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:50.347145+0000 mgr.smithi067.rdualw (mgr.24569) 1493 : cluster [DBG] pgmap v1290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:52.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:50.347145+0000 mgr.smithi067.rdualw (mgr.24569) 1493 : cluster [DBG] pgmap v1290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:52.347663+0000 mgr.smithi067.rdualw (mgr.24569) 1494 : cluster [DBG] pgmap v1291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:52.347663+0000 mgr.smithi067.rdualw (mgr.24569) 1494 : cluster [DBG] pgmap v1291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:54.099 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:11:54.391 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:11:54.392 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (49m) 52s ago 50m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:11:54.392 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (42m) 52s ago 50m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:11:54.393 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (41m) 54s ago 50m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:11:54.394 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (49m) 52s ago 50m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:11:54.394 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (42m) 52s ago 46m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:11:54.395 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (42m) 54s ago 46m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:11:54.395 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (43m) 52s ago 51m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:11:54.396 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (43m) 54s ago 49m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:11:54.396 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (43m) 52s ago 51m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:11:54.396 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (42m) 54s ago 49m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:11:54.397 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (43m) 52s ago 43m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:11:54.398 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (43m) 54s ago 43m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:11:54.398 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (50m) 52s ago 50m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:11:54.399 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (49m) 54s ago 49m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:11:54.399 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (32m) 52s ago 49m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:11:54.399 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (49m) 52s ago 49m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:11:54.399 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (48m) 52s ago 48m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:11:54.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (48m) 52s ago 48m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:11:54.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (48m) 54s ago 48m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:11:54.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (48m) 54s ago 48m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:11:54.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (47m) 54s ago 47m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:11:54.401 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (47m) 54s ago 47m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:11:54.401 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (49m) 52s ago 50m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:11:54.757 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:11:54.757 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:11:54.757 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:11:54.758 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:11:54.758 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:11:54.758 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:11:54.759 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:11:54.759 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:11:54.759 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:11:54.759 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:11:54.759 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:11:54.760 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:11:54.760 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:11:54.760 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:11:54.760 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:11:54.761 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:11:54.761 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:11:54.761 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:11:54.761 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:11:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:11:54.083289+0000 mgr.smithi067.rdualw (mgr.24569) 1495 : audit [DBG] from='client.35134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:11:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:11:54.083289+0000 mgr.smithi067.rdualw (mgr.24569) 1495 : audit [DBG] from='client.35134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:11:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:54.348191+0000 mgr.smithi067.rdualw (mgr.24569) 1496 : cluster [DBG] pgmap v1292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:11:54.373168+0000 mgr.smithi067.rdualw (mgr.24569) 1497 : audit [DBG] from='client.35138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:11:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:11:54.755540+0000 mon.smithi061 (mon.0) 498 : audit [DBG] from='client.? 172.21.15.61:0/1340090311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:11:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:54.348191+0000 mgr.smithi067.rdualw (mgr.24569) 1496 : cluster [DBG] pgmap v1292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:11:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:11:54.373168+0000 mgr.smithi067.rdualw (mgr.24569) 1497 : audit [DBG] from='client.35138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:11:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:11:54.755540+0000 mon.smithi061 (mon.0) 498 : audit [DBG] from='client.? 172.21.15.61:0/1340090311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:11:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:56.349242+0000 mgr.smithi067.rdualw (mgr.24569) 1498 : cluster [DBG] pgmap v1293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:11:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:56.349242+0000 mgr.smithi067.rdualw (mgr.24569) 1498 : cluster [DBG] pgmap v1293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:12:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:11:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:11:58.349960+0000 mgr.smithi067.rdualw (mgr.24569) 1499 : cluster [DBG] pgmap v1294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:11:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:11:58.349960+0000 mgr.smithi067.rdualw (mgr.24569) 1499 : cluster [DBG] pgmap v1294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:01.982 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:00.350910+0000 mgr.smithi067.rdualw (mgr.24569) 1500 : cluster [DBG] pgmap v1295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:00.350910+0000 mgr.smithi067.rdualw (mgr.24569) 1500 : cluster [DBG] pgmap v1295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:02.351473+0000 mgr.smithi067.rdualw (mgr.24569) 1501 : cluster [DBG] pgmap v1296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:12:02.728356+0000 mon.smithi067 (mon.1) 266 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:12:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:12:02.729808+0000 mon.smithi067 (mon.1) 267 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:12:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:12:02.730756+0000 mon.smithi067 (mon.1) 268 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:12:04.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:12:02.731625+0000 mgr.smithi067.rdualw (mgr.24569) 1502 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:12:04.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:12:03.144860+0000 mon.smithi061 (mon.0) 499 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:12:04.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:12:03.152841+0000 mon.smithi061 (mon.0) 500 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:12:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:02.351473+0000 mgr.smithi067.rdualw (mgr.24569) 1501 : cluster [DBG] pgmap v1296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:12:02.728356+0000 mon.smithi067 (mon.1) 266 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:12:04.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:12:02.729808+0000 mon.smithi067 (mon.1) 267 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:12:04.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:12:02.730756+0000 mon.smithi067 (mon.1) 268 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:12:04.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:12:02.731625+0000 mgr.smithi067.rdualw (mgr.24569) 1502 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:12:04.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:12:03.144860+0000 mon.smithi061 (mon.0) 499 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:12:04.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:12:03.152841+0000 mon.smithi061 (mon.0) 500 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:12:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:04.352101+0000 mgr.smithi067.rdualw (mgr.24569) 1503 : cluster [DBG] pgmap v1297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:04.352101+0000 mgr.smithi067.rdualw (mgr.24569) 1503 : cluster [DBG] pgmap v1297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:06.352933+0000 mgr.smithi067.rdualw (mgr.24569) 1504 : cluster [DBG] pgmap v1298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:12:08.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:06.352933+0000 mgr.smithi067.rdualw (mgr.24569) 1504 : cluster [DBG] pgmap v1298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:12:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:08.353641+0000 mgr.smithi067.rdualw (mgr.24569) 1505 : cluster [DBG] pgmap v1299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:08.353641+0000 mgr.smithi067.rdualw (mgr.24569) 1505 : cluster [DBG] pgmap v1299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:10.354506+0000 mgr.smithi067.rdualw (mgr.24569) 1506 : cluster [DBG] pgmap v1300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:10.354506+0000 mgr.smithi067.rdualw (mgr.24569) 1506 : cluster [DBG] pgmap v1300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:12.355001+0000 mgr.smithi067.rdualw (mgr.24569) 1507 : cluster [DBG] pgmap v1301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:12.355001+0000 mgr.smithi067.rdualw (mgr.24569) 1507 : cluster [DBG] pgmap v1301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:14.355722+0000 mgr.smithi067.rdualw (mgr.24569) 1508 : cluster [DBG] pgmap v1302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:14.355722+0000 mgr.smithi067.rdualw (mgr.24569) 1508 : cluster [DBG] pgmap v1302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:18.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:16.356734+0000 mgr.smithi067.rdualw (mgr.24569) 1509 : cluster [DBG] pgmap v1303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:12:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:16.356734+0000 mgr.smithi067.rdualw (mgr.24569) 1509 : cluster [DBG] pgmap v1303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:12:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:18.357288+0000 mgr.smithi067.rdualw (mgr.24569) 1510 : cluster [DBG] pgmap v1304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:18.357288+0000 mgr.smithi067.rdualw (mgr.24569) 1510 : cluster [DBG] pgmap v1304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:20.358174+0000 mgr.smithi067.rdualw (mgr.24569) 1511 : cluster [DBG] pgmap v1305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:20.358174+0000 mgr.smithi067.rdualw (mgr.24569) 1511 : cluster [DBG] pgmap v1305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:24.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:22.358709+0000 mgr.smithi067.rdualw (mgr.24569) 1512 : cluster [DBG] pgmap v1306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:22.358709+0000 mgr.smithi067.rdualw (mgr.24569) 1512 : cluster [DBG] pgmap v1306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:25.130 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:12:25.505 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:12:25.505 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (49m) 83s ago 51m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:12:25.506 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (42m) 83s ago 51m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:12:25.507 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (42m) 85s ago 50m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:12:25.508 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (49m) 83s ago 50m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:12:25.508 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (43m) 83s ago 46m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:12:25.508 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (42m) 85s ago 46m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:12:25.508 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (44m) 83s ago 52m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:12:25.508 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (43m) 85s ago 50m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:12:25.509 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (43m) 83s ago 52m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:12:25.509 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (43m) 85s ago 50m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:12:25.509 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (44m) 83s ago 44m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:12:25.509 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (44m) 85s ago 44m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:12:25.510 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (50m) 83s ago 50m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:12:25.510 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (50m) 85s ago 50m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:12:25.510 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (33m) 83s ago 49m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:12:25.510 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (49m) 83s ago 49m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:12:25.511 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (49m) 83s ago 49m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:12:25.511 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (49m) 83s ago 49m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:12:25.511 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (48m) 85s ago 48m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:12:25.511 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (48m) 85s ago 48m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:12:25.511 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (48m) 85s ago 48m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:12:25.512 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (48m) 85s ago 48m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:12:25.512 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (49m) 83s ago 50m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:12:25.846 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:12:25.847 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:12:25.847 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:12:25.847 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:12:25.847 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:12:25.848 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:12:25.848 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:12:25.848 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:12:25.848 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:12:25.849 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:12:25.849 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:12:25.849 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:12:25.849 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:12:25.850 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:12:25.850 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:12:25.850 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:12:25.850 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:12:25.851 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:12:25.851 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:12:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:24.359360+0000 mgr.smithi067.rdualw (mgr.24569) 1513 : cluster [DBG] pgmap v1307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:26.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:12:25.117330+0000 mgr.smithi067.rdualw (mgr.24569) 1514 : audit [DBG] from='client.35146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:12:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:24.359360+0000 mgr.smithi067.rdualw (mgr.24569) 1513 : cluster [DBG] pgmap v1307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:12:25.117330+0000 mgr.smithi067.rdualw (mgr.24569) 1514 : audit [DBG] from='client.35146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:12:27.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:12:25.487010+0000 mgr.smithi067.rdualw (mgr.24569) 1515 : audit [DBG] from='client.35150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:12:27.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:12:25.845105+0000 mon.smithi061 (mon.0) 501 : audit [DBG] from='client.? 172.21.15.61:0/1559269454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:12:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:12:25.487010+0000 mgr.smithi067.rdualw (mgr.24569) 1515 : audit [DBG] from='client.35150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:12:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:12:25.845105+0000 mon.smithi061 (mon.0) 501 : audit [DBG] from='client.? 172.21.15.61:0/1559269454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:12:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:26.360192+0000 mgr.smithi067.rdualw (mgr.24569) 1516 : cluster [DBG] pgmap v1308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:12:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:26.360192+0000 mgr.smithi067.rdualw (mgr.24569) 1516 : cluster [DBG] pgmap v1308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:12:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:28.360820+0000 mgr.smithi067.rdualw (mgr.24569) 1517 : cluster [DBG] pgmap v1309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:28.360820+0000 mgr.smithi067.rdualw (mgr.24569) 1517 : cluster [DBG] pgmap v1309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:30.361708+0000 mgr.smithi067.rdualw (mgr.24569) 1518 : cluster [DBG] pgmap v1310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:30.361708+0000 mgr.smithi067.rdualw (mgr.24569) 1518 : cluster [DBG] pgmap v1310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:32.362242+0000 mgr.smithi067.rdualw (mgr.24569) 1519 : cluster [DBG] pgmap v1311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:32.362242+0000 mgr.smithi067.rdualw (mgr.24569) 1519 : cluster [DBG] pgmap v1311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:34.363004+0000 mgr.smithi067.rdualw (mgr.24569) 1520 : cluster [DBG] pgmap v1312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:12:34.656492+0000 mon.smithi067 (mon.1) 269 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:12:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:12:34.656970+0000 mon.smithi061 (mon.0) 502 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:12:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:12:34.657126+0000 mon.smithi067 (mon.1) 270 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:12:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:12:34.657413+0000 mon.smithi061 (mon.0) 503 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:12:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:34.363004+0000 mgr.smithi067.rdualw (mgr.24569) 1520 : cluster [DBG] pgmap v1312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:12:34.656492+0000 mon.smithi067 (mon.1) 269 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:12:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:12:34.656970+0000 mon.smithi061 (mon.0) 502 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:12:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:12:34.657126+0000 mon.smithi067 (mon.1) 270 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:12:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:12:34.657413+0000 mon.smithi061 (mon.0) 503 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:12:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:36.363905+0000 mgr.smithi067.rdualw (mgr.24569) 1521 : cluster [DBG] pgmap v1313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:12:38.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:36.363905+0000 mgr.smithi067.rdualw (mgr.24569) 1521 : cluster [DBG] pgmap v1313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:12:40.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:38.364471+0000 mgr.smithi067.rdualw (mgr.24569) 1522 : cluster [DBG] pgmap v1314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:38.364471+0000 mgr.smithi067.rdualw (mgr.24569) 1522 : cluster [DBG] pgmap v1314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:42.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:40.365305+0000 mgr.smithi067.rdualw (mgr.24569) 1523 : cluster [DBG] pgmap v1315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:42.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:40.365305+0000 mgr.smithi067.rdualw (mgr.24569) 1523 : cluster [DBG] pgmap v1315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:44.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:42.365917+0000 mgr.smithi067.rdualw (mgr.24569) 1524 : cluster [DBG] pgmap v1316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:42.365917+0000 mgr.smithi067.rdualw (mgr.24569) 1524 : cluster [DBG] pgmap v1316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:44.366483+0000 mgr.smithi067.rdualw (mgr.24569) 1525 : cluster [DBG] pgmap v1317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:44.366483+0000 mgr.smithi067.rdualw (mgr.24569) 1525 : cluster [DBG] pgmap v1317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:46.367270+0000 mgr.smithi067.rdualw (mgr.24569) 1526 : cluster [DBG] pgmap v1318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:12:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:46.367270+0000 mgr.smithi067.rdualw (mgr.24569) 1526 : cluster [DBG] pgmap v1318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:12:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:48.367898+0000 mgr.smithi067.rdualw (mgr.24569) 1527 : cluster [DBG] pgmap v1319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:48.367898+0000 mgr.smithi067.rdualw (mgr.24569) 1527 : cluster [DBG] pgmap v1319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:50.368784+0000 mgr.smithi067.rdualw (mgr.24569) 1528 : cluster [DBG] pgmap v1320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:50.368784+0000 mgr.smithi067.rdualw (mgr.24569) 1528 : cluster [DBG] pgmap v1320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:52.369360+0000 mgr.smithi067.rdualw (mgr.24569) 1529 : cluster [DBG] pgmap v1321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:52.369360+0000 mgr.smithi067.rdualw (mgr.24569) 1529 : cluster [DBG] pgmap v1321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:54.370140+0000 mgr.smithi067.rdualw (mgr.24569) 1530 : cluster [DBG] pgmap v1322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:54.370140+0000 mgr.smithi067.rdualw (mgr.24569) 1530 : cluster [DBG] pgmap v1322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:12:56.156 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:12:56.448 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:12:56.449 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (50m) 114s ago 51m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:12:56.449 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (43m) 114s ago 51m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:12:56.449 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (42m) 116s ago 51m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:12:56.450 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (50m) 114s ago 51m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:12:56.450 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (43m) 114s ago 47m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:12:56.450 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (43m) 116s ago 47m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:12:56.450 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (44m) 114s ago 52m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:12:56.451 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (44m) 116s ago 50m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:12:56.451 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (44m) 114s ago 52m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:12:56.451 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (43m) 116s ago 50m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:12:56.451 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (44m) 114s ago 44m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:12:56.452 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (44m) 116s ago 44m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:12:56.452 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (51m) 114s ago 51m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:12:56.452 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (50m) 116s ago 50m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:12:56.452 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (33m) 114s ago 50m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:12:56.452 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (50m) 114s ago 50m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:12:56.453 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (49m) 114s ago 49m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:12:56.453 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (49m) 114s ago 49m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:12:56.453 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (49m) 116s ago 49m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:12:56.453 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (49m) 116s ago 49m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:12:56.454 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (48m) 116s ago 48m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:12:56.454 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (48m) 116s ago 48m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:12:56.454 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (50m) 114s ago 51m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:12:56.871 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:12:56.872 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:12:56.872 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:12:56.872 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:12:56.872 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:12:56.873 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:12:56.873 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:12:56.873 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:12:56.873 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:12:56.875 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:12:56.875 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:12:56.875 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:12:56.876 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:12:56.876 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:12:56.876 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:12:56.876 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:12:56.877 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:12:56.877 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:12:56.877 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:12:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:12:56.142636+0000 mgr.smithi067.rdualw (mgr.24569) 1531 : audit [DBG] from='client.35158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:12:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:12:56.142636+0000 mgr.smithi067.rdualw (mgr.24569) 1531 : audit [DBG] from='client.35158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:12:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:56.371058+0000 mgr.smithi067.rdualw (mgr.24569) 1532 : cluster [DBG] pgmap v1323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:12:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:12:56.431079+0000 mgr.smithi067.rdualw (mgr.24569) 1533 : audit [DBG] from='client.35162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:12:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:12:56.870224+0000 mon.smithi061 (mon.0) 504 : audit [DBG] from='client.? 172.21.15.61:0/2540968185' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:12:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:56.371058+0000 mgr.smithi067.rdualw (mgr.24569) 1532 : cluster [DBG] pgmap v1323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:12:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:12:56.431079+0000 mgr.smithi067.rdualw (mgr.24569) 1533 : audit [DBG] from='client.35162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:12:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:12:56.870224+0000 mon.smithi061 (mon.0) 504 : audit [DBG] from='client.? 172.21.15.61:0/2540968185' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:13:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:12:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:12:58.371652+0000 mgr.smithi067.rdualw (mgr.24569) 1534 : cluster [DBG] pgmap v1324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:12:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:12:58.371652+0000 mgr.smithi067.rdualw (mgr.24569) 1534 : cluster [DBG] pgmap v1324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:00.372487+0000 mgr.smithi067.rdualw (mgr.24569) 1535 : cluster [DBG] pgmap v1325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:00.372487+0000 mgr.smithi067.rdualw (mgr.24569) 1535 : cluster [DBG] pgmap v1325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:02.373086+0000 mgr.smithi067.rdualw (mgr.24569) 1536 : cluster [DBG] pgmap v1326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:04.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:13:03.156236+0000 mon.smithi067 (mon.1) 271 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:13:04.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:13:03.157700+0000 mon.smithi067 (mon.1) 272 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:13:04.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:13:03.158750+0000 mon.smithi067 (mon.1) 273 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:13:04.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:13:03.159655+0000 mgr.smithi067.rdualw (mgr.24569) 1537 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:13:04.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:13:03.416851+0000 mon.smithi061 (mon.0) 505 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:13:04.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:13:03.521557+0000 mon.smithi061 (mon.0) 506 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:13:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:02.373086+0000 mgr.smithi067.rdualw (mgr.24569) 1536 : cluster [DBG] pgmap v1326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:13:03.156236+0000 mon.smithi067 (mon.1) 271 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:13:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:13:03.157700+0000 mon.smithi067 (mon.1) 272 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:13:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:13:03.158750+0000 mon.smithi067 (mon.1) 273 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:13:04.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:13:03.159655+0000 mgr.smithi067.rdualw (mgr.24569) 1537 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:13:04.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:13:03.416851+0000 mon.smithi061 (mon.0) 505 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:13:04.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:13:03.521557+0000 mon.smithi061 (mon.0) 506 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:13:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:13:03.924154+0000 mon.smithi061 (mon.0) 507 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:13:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:13:03.931669+0000 mon.smithi061 (mon.0) 508 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:13:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:13:03.924154+0000 mon.smithi061 (mon.0) 507 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:13:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:13:03.931669+0000 mon.smithi061 (mon.0) 508 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:13:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:04.373610+0000 mgr.smithi067.rdualw (mgr.24569) 1538 : cluster [DBG] pgmap v1327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:04.373610+0000 mgr.smithi067.rdualw (mgr.24569) 1538 : cluster [DBG] pgmap v1327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:08.306 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:06.374477+0000 mgr.smithi067.rdualw (mgr.24569) 1539 : cluster [DBG] pgmap v1328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:13:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:06.374477+0000 mgr.smithi067.rdualw (mgr.24569) 1539 : cluster [DBG] pgmap v1328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:13:10.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:08.374996+0000 mgr.smithi067.rdualw (mgr.24569) 1540 : cluster [DBG] pgmap v1329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:10.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:08.374996+0000 mgr.smithi067.rdualw (mgr.24569) 1540 : cluster [DBG] pgmap v1329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:10.376018+0000 mgr.smithi067.rdualw (mgr.24569) 1541 : cluster [DBG] pgmap v1330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:12.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:10.376018+0000 mgr.smithi067.rdualw (mgr.24569) 1541 : cluster [DBG] pgmap v1330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:12.376731+0000 mgr.smithi067.rdualw (mgr.24569) 1542 : cluster [DBG] pgmap v1331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:12.376731+0000 mgr.smithi067.rdualw (mgr.24569) 1542 : cluster [DBG] pgmap v1331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:14.377407+0000 mgr.smithi067.rdualw (mgr.24569) 1543 : cluster [DBG] pgmap v1332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:16.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:14.377407+0000 mgr.smithi067.rdualw (mgr.24569) 1543 : cluster [DBG] pgmap v1332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:16.378351+0000 mgr.smithi067.rdualw (mgr.24569) 1544 : cluster [DBG] pgmap v1333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:13:18.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:16.378351+0000 mgr.smithi067.rdualw (mgr.24569) 1544 : cluster [DBG] pgmap v1333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:13:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:18.379060+0000 mgr.smithi067.rdualw (mgr.24569) 1545 : cluster [DBG] pgmap v1334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:18.379060+0000 mgr.smithi067.rdualw (mgr.24569) 1545 : cluster [DBG] pgmap v1334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:20.379970+0000 mgr.smithi067.rdualw (mgr.24569) 1546 : cluster [DBG] pgmap v1335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:20.379970+0000 mgr.smithi067.rdualw (mgr.24569) 1546 : cluster [DBG] pgmap v1335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:22.380608+0000 mgr.smithi067.rdualw (mgr.24569) 1547 : cluster [DBG] pgmap v1336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:22.380608+0000 mgr.smithi067.rdualw (mgr.24569) 1547 : cluster [DBG] pgmap v1336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:24.381263+0000 mgr.smithi067.rdualw (mgr.24569) 1548 : cluster [DBG] pgmap v1337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:24.381263+0000 mgr.smithi067.rdualw (mgr.24569) 1548 : cluster [DBG] pgmap v1337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:27.255 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:13:27.550 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:13:27.550 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (50m) 2m ago 52m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:13:27.552 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (43m) 2m ago 52m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:13:27.552 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (43m) 2m ago 51m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:13:27.552 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (50m) 2m ago 51m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:13:27.552 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (44m) 2m ago 47m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:13:27.552 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (43m) 2m ago 47m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:13:27.553 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (45m) 2m ago 53m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:13:27.553 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (44m) 2m ago 51m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:13:27.553 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (44m) 2m ago 53m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:13:27.553 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (44m) 2m ago 51m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:13:27.554 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (45m) 2m ago 45m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:13:27.554 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (45m) 2m ago 45m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:13:27.554 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (51m) 2m ago 51m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:13:27.554 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (51m) 2m ago 51m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:13:27.555 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (34m) 2m ago 50m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:13:27.555 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (50m) 2m ago 50m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:13:27.555 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (50m) 2m ago 50m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:13:27.555 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (50m) 2m ago 50m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:13:27.556 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (49m) 2m ago 49m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:13:27.556 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (49m) 2m ago 49m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:13:27.556 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (49m) 2m ago 49m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:13:27.557 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (49m) 2m ago 49m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:13:27.557 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (50m) 2m ago 51m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:13:27.904 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:13:27.905 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:13:27.905 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:13:27.905 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:13:27.906 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:13:27.906 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:13:27.906 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:13:27.906 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:13:27.906 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:13:27.907 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:13:27.907 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:13:27.907 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:13:27.908 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:13:27.908 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:13:27.908 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:13:27.908 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:13:27.909 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:13:27.909 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:13:27.909 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:13:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:26.382091+0000 mgr.smithi067.rdualw (mgr.24569) 1549 : cluster [DBG] pgmap v1338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:13:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:13:27.241758+0000 mgr.smithi067.rdualw (mgr.24569) 1550 : audit [DBG] from='client.35170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:13:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:13:27.902839+0000 mon.smithi061 (mon.0) 509 : audit [DBG] from='client.? 172.21.15.61:0/1698996271' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:13:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:26.382091+0000 mgr.smithi067.rdualw (mgr.24569) 1549 : cluster [DBG] pgmap v1338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:13:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:13:27.241758+0000 mgr.smithi067.rdualw (mgr.24569) 1550 : audit [DBG] from='client.35170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:13:28.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:13:27.902839+0000 mon.smithi061 (mon.0) 509 : audit [DBG] from='client.? 172.21.15.61:0/1698996271' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:13:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:13:27.532306+0000 mgr.smithi067.rdualw (mgr.24569) 1551 : audit [DBG] from='client.35174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:13:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:13:27.532306+0000 mgr.smithi067.rdualw (mgr.24569) 1551 : audit [DBG] from='client.35174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:13:30.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:28.382718+0000 mgr.smithi067.rdualw (mgr.24569) 1552 : cluster [DBG] pgmap v1339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:28.382718+0000 mgr.smithi067.rdualw (mgr.24569) 1552 : cluster [DBG] pgmap v1339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:30.383648+0000 mgr.smithi067.rdualw (mgr.24569) 1553 : cluster [DBG] pgmap v1340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:30.383648+0000 mgr.smithi067.rdualw (mgr.24569) 1553 : cluster [DBG] pgmap v1340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:32.384254+0000 mgr.smithi067.rdualw (mgr.24569) 1554 : cluster [DBG] pgmap v1341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:34.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:32.384254+0000 mgr.smithi067.rdualw (mgr.24569) 1554 : cluster [DBG] pgmap v1341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:34.384962+0000 mgr.smithi067.rdualw (mgr.24569) 1555 : cluster [DBG] pgmap v1342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:13:34.660941+0000 mon.smithi067 (mon.1) 274 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:13:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:13:34.661392+0000 mon.smithi061 (mon.0) 510 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:13:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:13:34.661636+0000 mon.smithi067 (mon.1) 275 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:13:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:13:34.661914+0000 mon.smithi061 (mon.0) 511 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:13:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:34.384962+0000 mgr.smithi067.rdualw (mgr.24569) 1555 : cluster [DBG] pgmap v1342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:13:34.660941+0000 mon.smithi067 (mon.1) 274 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:13:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:13:34.661392+0000 mon.smithi061 (mon.0) 510 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:13:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:13:34.661636+0000 mon.smithi067 (mon.1) 275 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:13:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:13:34.661914+0000 mon.smithi061 (mon.0) 511 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:13:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:36.385727+0000 mgr.smithi067.rdualw (mgr.24569) 1556 : cluster [DBG] pgmap v1343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:13:38.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:36.385727+0000 mgr.smithi067.rdualw (mgr.24569) 1556 : cluster [DBG] pgmap v1343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:13:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:38.386207+0000 mgr.smithi067.rdualw (mgr.24569) 1557 : cluster [DBG] pgmap v1344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:38.386207+0000 mgr.smithi067.rdualw (mgr.24569) 1557 : cluster [DBG] pgmap v1344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:40.387134+0000 mgr.smithi067.rdualw (mgr.24569) 1558 : cluster [DBG] pgmap v1345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:40.387134+0000 mgr.smithi067.rdualw (mgr.24569) 1558 : cluster [DBG] pgmap v1345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:42.387776+0000 mgr.smithi067.rdualw (mgr.24569) 1559 : cluster [DBG] pgmap v1346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:42.387776+0000 mgr.smithi067.rdualw (mgr.24569) 1559 : cluster [DBG] pgmap v1346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:44.388529+0000 mgr.smithi067.rdualw (mgr.24569) 1560 : cluster [DBG] pgmap v1347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:44.388529+0000 mgr.smithi067.rdualw (mgr.24569) 1560 : cluster [DBG] pgmap v1347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:46.389463+0000 mgr.smithi067.rdualw (mgr.24569) 1561 : cluster [DBG] pgmap v1348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:13:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:46.389463+0000 mgr.smithi067.rdualw (mgr.24569) 1561 : cluster [DBG] pgmap v1348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:13:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:48.389990+0000 mgr.smithi067.rdualw (mgr.24569) 1562 : cluster [DBG] pgmap v1349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:48.389990+0000 mgr.smithi067.rdualw (mgr.24569) 1562 : cluster [DBG] pgmap v1349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:50.391010+0000 mgr.smithi067.rdualw (mgr.24569) 1563 : cluster [DBG] pgmap v1350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:50.391010+0000 mgr.smithi067.rdualw (mgr.24569) 1563 : cluster [DBG] pgmap v1350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:52.391806+0000 mgr.smithi067.rdualw (mgr.24569) 1564 : cluster [DBG] pgmap v1351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:52.391806+0000 mgr.smithi067.rdualw (mgr.24569) 1564 : cluster [DBG] pgmap v1351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:54.392462+0000 mgr.smithi067.rdualw (mgr.24569) 1565 : cluster [DBG] pgmap v1352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:54.392462+0000 mgr.smithi067.rdualw (mgr.24569) 1565 : cluster [DBG] pgmap v1352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:13:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:56.393303+0000 mgr.smithi067.rdualw (mgr.24569) 1566 : cluster [DBG] pgmap v1353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:13:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:56.393303+0000 mgr.smithi067.rdualw (mgr.24569) 1566 : cluster [DBG] pgmap v1353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:13:58.214 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:13:58.504 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:13:58.504 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (51m) 2m ago 52m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:13:58.505 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (44m) 2m ago 52m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:13:58.505 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (44m) 2m ago 52m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:13:58.505 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (51m) 2m ago 52m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:13:58.505 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (44m) 2m ago 48m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:13:58.505 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (44m) 2m ago 48m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:13:58.506 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (45m) 2m ago 53m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:13:58.506 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (45m) 2m ago 52m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:13:58.506 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (45m) 2m ago 53m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:13:58.506 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (44m) 2m ago 51m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:13:58.507 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (45m) 2m ago 45m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:13:58.507 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (45m) 2m ago 45m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:13:58.507 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (52m) 2m ago 52m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:13:58.507 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (51m) 2m ago 51m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:13:58.507 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (35m) 2m ago 51m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:13:58.508 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (51m) 2m ago 51m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:13:58.508 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (50m) 2m ago 50m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:13:58.508 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (50m) 2m ago 50m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:13:58.508 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (50m) 2m ago 50m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:13:58.509 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (50m) 2m ago 50m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:13:58.509 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (49m) 2m ago 49m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:13:58.509 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (49m) 2m ago 49m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:13:58.509 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (51m) 2m ago 52m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:13:58.845 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:13:58.846 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:13:58.846 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:13:58.846 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:13:58.846 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:13:58.847 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:13:58.847 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:13:58.847 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:13:58.847 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:13:58.847 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:13:58.848 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:13:58.848 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:13:58.848 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:13:58.848 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:13:58.849 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:13:58.849 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:13:58.849 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:13:58.849 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:13:58.850 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:13:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:13:58.200197+0000 mgr.smithi067.rdualw (mgr.24569) 1567 : audit [DBG] from='client.35182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:13:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:13:58.200197+0000 mgr.smithi067.rdualw (mgr.24569) 1567 : audit [DBG] from='client.35182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:14:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:13:58.393845+0000 mgr.smithi067.rdualw (mgr.24569) 1568 : cluster [DBG] pgmap v1354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:13:58.486306+0000 mgr.smithi067.rdualw (mgr.24569) 1569 : audit [DBG] from='client.35186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:14:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:13:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:13:58.843803+0000 mon.smithi061 (mon.0) 512 : audit [DBG] from='client.? 172.21.15.61:0/1600752168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:14:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:13:58.393845+0000 mgr.smithi067.rdualw (mgr.24569) 1568 : cluster [DBG] pgmap v1354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:13:58.486306+0000 mgr.smithi067.rdualw (mgr.24569) 1569 : audit [DBG] from='client.35186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:14:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:13:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:13:58.843803+0000 mon.smithi061 (mon.0) 512 : audit [DBG] from='client.? 172.21.15.61:0/1600752168' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:14:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:00.394622+0000 mgr.smithi067.rdualw (mgr.24569) 1570 : cluster [DBG] pgmap v1355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:00.394622+0000 mgr.smithi067.rdualw (mgr.24569) 1570 : cluster [DBG] pgmap v1355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:02.395231+0000 mgr.smithi067.rdualw (mgr.24569) 1571 : cluster [DBG] pgmap v1356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:02.395231+0000 mgr.smithi067.rdualw (mgr.24569) 1571 : cluster [DBG] pgmap v1356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:14:03.934966+0000 mon.smithi067 (mon.1) 276 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:14:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:14:03.936487+0000 mon.smithi067 (mon.1) 277 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:14:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:14:03.937475+0000 mon.smithi067 (mon.1) 278 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:14:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:14:03.938372+0000 mgr.smithi067.rdualw (mgr.24569) 1572 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:14:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:14:04.354426+0000 mon.smithi061 (mon.0) 513 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:14:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:14:04.362363+0000 mon.smithi061 (mon.0) 514 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:14:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:14:03.934966+0000 mon.smithi067 (mon.1) 276 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:14:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:14:03.936487+0000 mon.smithi067 (mon.1) 277 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:14:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:14:03.937475+0000 mon.smithi067 (mon.1) 278 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:14:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:14:03.938372+0000 mgr.smithi067.rdualw (mgr.24569) 1572 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:14:05.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:14:04.354426+0000 mon.smithi061 (mon.0) 513 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:14:05.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:14:04.362363+0000 mon.smithi061 (mon.0) 514 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:14:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:04.395822+0000 mgr.smithi067.rdualw (mgr.24569) 1573 : cluster [DBG] pgmap v1357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:04.395822+0000 mgr.smithi067.rdualw (mgr.24569) 1573 : cluster [DBG] pgmap v1357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:06.396708+0000 mgr.smithi067.rdualw (mgr.24569) 1574 : cluster [DBG] pgmap v1358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:14:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:06.396708+0000 mgr.smithi067.rdualw (mgr.24569) 1574 : cluster [DBG] pgmap v1358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:14:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:08.397461+0000 mgr.smithi067.rdualw (mgr.24569) 1575 : cluster [DBG] pgmap v1359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:08.397461+0000 mgr.smithi067.rdualw (mgr.24569) 1575 : cluster [DBG] pgmap v1359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:10.398330+0000 mgr.smithi067.rdualw (mgr.24569) 1576 : cluster [DBG] pgmap v1360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:10.398330+0000 mgr.smithi067.rdualw (mgr.24569) 1576 : cluster [DBG] pgmap v1360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:12.399041+0000 mgr.smithi067.rdualw (mgr.24569) 1577 : cluster [DBG] pgmap v1361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:12.399041+0000 mgr.smithi067.rdualw (mgr.24569) 1577 : cluster [DBG] pgmap v1361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:14.399669+0000 mgr.smithi067.rdualw (mgr.24569) 1578 : cluster [DBG] pgmap v1362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:14.399669+0000 mgr.smithi067.rdualw (mgr.24569) 1578 : cluster [DBG] pgmap v1362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:16.400500+0000 mgr.smithi067.rdualw (mgr.24569) 1579 : cluster [DBG] pgmap v1363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:14:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:16.400500+0000 mgr.smithi067.rdualw (mgr.24569) 1579 : cluster [DBG] pgmap v1363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:14:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:18.401234+0000 mgr.smithi067.rdualw (mgr.24569) 1580 : cluster [DBG] pgmap v1364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:18.401234+0000 mgr.smithi067.rdualw (mgr.24569) 1580 : cluster [DBG] pgmap v1364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:20.402151+0000 mgr.smithi067.rdualw (mgr.24569) 1581 : cluster [DBG] pgmap v1365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:20.402151+0000 mgr.smithi067.rdualw (mgr.24569) 1581 : cluster [DBG] pgmap v1365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:22.402711+0000 mgr.smithi067.rdualw (mgr.24569) 1582 : cluster [DBG] pgmap v1366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:22.402711+0000 mgr.smithi067.rdualw (mgr.24569) 1582 : cluster [DBG] pgmap v1366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:24.403381+0000 mgr.smithi067.rdualw (mgr.24569) 1583 : cluster [DBG] pgmap v1367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:26.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:24.403381+0000 mgr.smithi067.rdualw (mgr.24569) 1583 : cluster [DBG] pgmap v1367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:26.404301+0000 mgr.smithi067.rdualw (mgr.24569) 1584 : cluster [DBG] pgmap v1368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:14:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:26.404301+0000 mgr.smithi067.rdualw (mgr.24569) 1584 : cluster [DBG] pgmap v1368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:14:29.156 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:14:29.446 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:14:29.447 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (52m) 3m ago 53m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:14:29.447 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (44m) 3m ago 53m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:14:29.447 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (44m) 3m ago 52m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:14:29.448 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (51m) 3m ago 52m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:14:29.448 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (45m) 3m ago 48m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:14:29.449 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (44m) 3m ago 48m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:14:29.449 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (46m) 3m ago 54m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:14:29.449 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (45m) 3m ago 52m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:14:29.449 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (45m) 3m ago 54m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:14:29.449 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (45m) 3m ago 52m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:14:29.450 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (46m) 3m ago 46m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:14:29.450 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (46m) 3m ago 46m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:14:29.450 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (52m) 3m ago 52m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:14:29.450 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (52m) 3m ago 52m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:14:29.451 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (35m) 3m ago 51m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:14:29.451 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (51m) 3m ago 51m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:14:29.451 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (51m) 3m ago 51m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:14:29.451 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (51m) 3m ago 51m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:14:29.451 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (50m) 3m ago 50m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:14:29.452 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (50m) 3m ago 50m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:14:29.452 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (50m) 3m ago 50m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:14:29.452 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (50m) 3m ago 50m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:14:29.452 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (51m) 3m ago 52m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:14:29.788 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:14:29.789 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:14:29.789 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:14:29.789 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:14:29.789 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:14:29.790 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:14:29.790 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:14:29.790 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:14:29.790 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:14:29.791 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:14:29.791 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:14:29.791 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:14:29.791 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:14:29.792 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:14:29.792 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:14:29.792 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:14:29.792 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:14:29.792 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:14:29.793 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:14:30.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:28.404804+0000 mgr.smithi067.rdualw (mgr.24569) 1585 : cluster [DBG] pgmap v1369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:14:29.142522+0000 mgr.smithi067.rdualw (mgr.24569) 1586 : audit [DBG] from='client.35194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:14:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:28.404804+0000 mgr.smithi067.rdualw (mgr.24569) 1585 : cluster [DBG] pgmap v1369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:14:29.142522+0000 mgr.smithi067.rdualw (mgr.24569) 1586 : audit [DBG] from='client.35194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:14:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:14:29.428994+0000 mgr.smithi067.rdualw (mgr.24569) 1587 : audit [DBG] from='client.35198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:14:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:14:29.787208+0000 mon.smithi061 (mon.0) 515 : audit [DBG] from='client.? 172.21.15.61:0/930016845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:14:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:14:29.428994+0000 mgr.smithi067.rdualw (mgr.24569) 1587 : audit [DBG] from='client.35198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:14:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:14:29.787208+0000 mon.smithi061 (mon.0) 515 : audit [DBG] from='client.? 172.21.15.61:0/930016845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:14:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:30.405812+0000 mgr.smithi067.rdualw (mgr.24569) 1588 : cluster [DBG] pgmap v1370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:30.405812+0000 mgr.smithi067.rdualw (mgr.24569) 1588 : cluster [DBG] pgmap v1370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:34.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:32.406452+0000 mgr.smithi067.rdualw (mgr.24569) 1589 : cluster [DBG] pgmap v1371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:32.406452+0000 mgr.smithi067.rdualw (mgr.24569) 1589 : cluster [DBG] pgmap v1371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:34.407040+0000 mgr.smithi067.rdualw (mgr.24569) 1590 : cluster [DBG] pgmap v1372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:14:34.667299+0000 mon.smithi067 (mon.1) 279 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:14:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:14:34.667564+0000 mon.smithi067 (mon.1) 280 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:14:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:14:34.667673+0000 mon.smithi061 (mon.0) 516 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:14:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:14:34.667965+0000 mon.smithi061 (mon.0) 517 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:14:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:34.407040+0000 mgr.smithi067.rdualw (mgr.24569) 1590 : cluster [DBG] pgmap v1372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:14:34.667299+0000 mon.smithi067 (mon.1) 279 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:14:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:14:34.667564+0000 mon.smithi067 (mon.1) 280 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:14:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:14:34.667673+0000 mon.smithi061 (mon.0) 516 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:14:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:14:34.667965+0000 mon.smithi061 (mon.0) 517 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:14:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:36.407997+0000 mgr.smithi067.rdualw (mgr.24569) 1591 : cluster [DBG] pgmap v1373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:14:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:36.407997+0000 mgr.smithi067.rdualw (mgr.24569) 1591 : cluster [DBG] pgmap v1373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:14:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:38.408642+0000 mgr.smithi067.rdualw (mgr.24569) 1592 : cluster [DBG] pgmap v1374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:38.408642+0000 mgr.smithi067.rdualw (mgr.24569) 1592 : cluster [DBG] pgmap v1374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:42.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:40.409473+0000 mgr.smithi067.rdualw (mgr.24569) 1593 : cluster [DBG] pgmap v1375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:42.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:40.409473+0000 mgr.smithi067.rdualw (mgr.24569) 1593 : cluster [DBG] pgmap v1375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:42.409994+0000 mgr.smithi067.rdualw (mgr.24569) 1594 : cluster [DBG] pgmap v1376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:42.409994+0000 mgr.smithi067.rdualw (mgr.24569) 1594 : cluster [DBG] pgmap v1376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:46.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:44.410607+0000 mgr.smithi067.rdualw (mgr.24569) 1595 : cluster [DBG] pgmap v1377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:44.410607+0000 mgr.smithi067.rdualw (mgr.24569) 1595 : cluster [DBG] pgmap v1377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:46.411437+0000 mgr.smithi067.rdualw (mgr.24569) 1596 : cluster [DBG] pgmap v1378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:14:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:46.411437+0000 mgr.smithi067.rdualw (mgr.24569) 1596 : cluster [DBG] pgmap v1378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:14:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:48.412075+0000 mgr.smithi067.rdualw (mgr.24569) 1597 : cluster [DBG] pgmap v1379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:48.412075+0000 mgr.smithi067.rdualw (mgr.24569) 1597 : cluster [DBG] pgmap v1379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:50.413035+0000 mgr.smithi067.rdualw (mgr.24569) 1598 : cluster [DBG] pgmap v1380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:50.413035+0000 mgr.smithi067.rdualw (mgr.24569) 1598 : cluster [DBG] pgmap v1380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:52.413646+0000 mgr.smithi067.rdualw (mgr.24569) 1599 : cluster [DBG] pgmap v1381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:52.413646+0000 mgr.smithi067.rdualw (mgr.24569) 1599 : cluster [DBG] pgmap v1381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:54.414175+0000 mgr.smithi067.rdualw (mgr.24569) 1600 : cluster [DBG] pgmap v1382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:54.414175+0000 mgr.smithi067.rdualw (mgr.24569) 1600 : cluster [DBG] pgmap v1382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:14:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:56.415152+0000 mgr.smithi067.rdualw (mgr.24569) 1601 : cluster [DBG] pgmap v1383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:14:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:56.415152+0000 mgr.smithi067.rdualw (mgr.24569) 1601 : cluster [DBG] pgmap v1383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:15:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:14:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:14:58.415759+0000 mgr.smithi067.rdualw (mgr.24569) 1602 : cluster [DBG] pgmap v1384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:14:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:14:58.415759+0000 mgr.smithi067.rdualw (mgr.24569) 1602 : cluster [DBG] pgmap v1384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:00.094 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:15:00.386 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:15:00.386 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (52m) 3m ago 53m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:15:00.387 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (45m) 3m ago 53m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:15:00.387 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (45m) 4m ago 53m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:15:00.387 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (52m) 3m ago 53m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:15:00.387 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (45m) 3m ago 49m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:15:00.388 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (45m) 4m ago 49m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:15:00.388 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (46m) 3m ago 54m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:15:00.388 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (46m) 4m ago 53m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:15:00.388 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (46m) 3m ago 54m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:15:00.389 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (46m) 4m ago 52m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:15:00.389 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (46m) 3m ago 46m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:15:00.389 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (46m) 4m ago 46m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:15:00.389 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (53m) 3m ago 53m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:15:00.389 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (52m) 4m ago 52m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:15:00.390 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (36m) 3m ago 52m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:15:00.390 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (52m) 3m ago 52m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:15:00.390 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (51m) 3m ago 51m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:15:00.390 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (51m) 3m ago 51m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:15:00.391 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (51m) 4m ago 51m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:15:00.391 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (51m) 4m ago 51m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:15:00.391 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (50m) 4m ago 50m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:15:00.391 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (50m) 4m ago 50m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:15:00.392 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (52m) 3m ago 53m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:15:00.729 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:15:00.729 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:15:00.729 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:15:00.730 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:15:00.730 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:15:00.730 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:15:00.730 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:15:00.731 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:15:00.731 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:15:00.731 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:15:00.731 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:15:00.731 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:15:00.732 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:15:00.732 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:15:00.732 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:15:00.732 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:15:00.733 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:15:00.733 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:15:00.733 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:15:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:15:00.081006+0000 mgr.smithi067.rdualw (mgr.24569) 1603 : audit [DBG] from='client.35206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:15:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:15:00.081006+0000 mgr.smithi067.rdualw (mgr.24569) 1603 : audit [DBG] from='client.35206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:15:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:15:00.368444+0000 mgr.smithi067.rdualw (mgr.24569) 1604 : audit [DBG] from='client.35210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:15:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:00.416594+0000 mgr.smithi067.rdualw (mgr.24569) 1605 : cluster [DBG] pgmap v1385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:02.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:15:00.727604+0000 mon.smithi061 (mon.0) 518 : audit [DBG] from='client.? 172.21.15.61:0/1294551863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:15:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:15:00.368444+0000 mgr.smithi067.rdualw (mgr.24569) 1604 : audit [DBG] from='client.35210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:15:02.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:00.416594+0000 mgr.smithi067.rdualw (mgr.24569) 1605 : cluster [DBG] pgmap v1385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:02.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:15:00.727604+0000 mon.smithi061 (mon.0) 518 : audit [DBG] from='client.? 172.21.15.61:0/1294551863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:15:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:02.417176+0000 mgr.smithi067.rdualw (mgr.24569) 1606 : cluster [DBG] pgmap v1386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:02.417176+0000 mgr.smithi067.rdualw (mgr.24569) 1606 : cluster [DBG] pgmap v1386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:15:04.365563+0000 mon.smithi067 (mon.1) 281 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:15:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:15:04.367029+0000 mon.smithi067 (mon.1) 282 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:15:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:15:04.367989+0000 mon.smithi067 (mon.1) 283 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:15:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:15:04.365563+0000 mon.smithi067 (mon.1) 281 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:15:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:15:04.367029+0000 mon.smithi067 (mon.1) 282 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:15:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:15:04.367989+0000 mon.smithi067 (mon.1) 283 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:15:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:15:04.368858+0000 mgr.smithi067.rdualw (mgr.24569) 1607 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:15:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:04.417762+0000 mgr.smithi067.rdualw (mgr.24569) 1608 : cluster [DBG] pgmap v1387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:06.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:15:04.784741+0000 mon.smithi061 (mon.0) 519 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:15:06.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:15:04.790087+0000 mon.smithi061 (mon.0) 520 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:15:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:15:04.368858+0000 mgr.smithi067.rdualw (mgr.24569) 1607 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:15:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:04.417762+0000 mgr.smithi067.rdualw (mgr.24569) 1608 : cluster [DBG] pgmap v1387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:15:04.784741+0000 mon.smithi061 (mon.0) 519 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:15:06.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:15:04.790087+0000 mon.smithi061 (mon.0) 520 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:15:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:06.418663+0000 mgr.smithi067.rdualw (mgr.24569) 1609 : cluster [DBG] pgmap v1388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:15:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:06.418663+0000 mgr.smithi067.rdualw (mgr.24569) 1609 : cluster [DBG] pgmap v1388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:15:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:08.419203+0000 mgr.smithi067.rdualw (mgr.24569) 1610 : cluster [DBG] pgmap v1389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:08.419203+0000 mgr.smithi067.rdualw (mgr.24569) 1610 : cluster [DBG] pgmap v1389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:10.420075+0000 mgr.smithi067.rdualw (mgr.24569) 1611 : cluster [DBG] pgmap v1390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:10.420075+0000 mgr.smithi067.rdualw (mgr.24569) 1611 : cluster [DBG] pgmap v1390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:12.420660+0000 mgr.smithi067.rdualw (mgr.24569) 1612 : cluster [DBG] pgmap v1391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:12.420660+0000 mgr.smithi067.rdualw (mgr.24569) 1612 : cluster [DBG] pgmap v1391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:14.421423+0000 mgr.smithi067.rdualw (mgr.24569) 1613 : cluster [DBG] pgmap v1392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:14.421423+0000 mgr.smithi067.rdualw (mgr.24569) 1613 : cluster [DBG] pgmap v1392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:18.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:16.422488+0000 mgr.smithi067.rdualw (mgr.24569) 1614 : cluster [DBG] pgmap v1393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:15:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:16.422488+0000 mgr.smithi067.rdualw (mgr.24569) 1614 : cluster [DBG] pgmap v1393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:15:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:18.423233+0000 mgr.smithi067.rdualw (mgr.24569) 1615 : cluster [DBG] pgmap v1394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:20.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:18.423233+0000 mgr.smithi067.rdualw (mgr.24569) 1615 : cluster [DBG] pgmap v1394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:20.424140+0000 mgr.smithi067.rdualw (mgr.24569) 1616 : cluster [DBG] pgmap v1395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:20.424140+0000 mgr.smithi067.rdualw (mgr.24569) 1616 : cluster [DBG] pgmap v1395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:22.424805+0000 mgr.smithi067.rdualw (mgr.24569) 1617 : cluster [DBG] pgmap v1396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:22.424805+0000 mgr.smithi067.rdualw (mgr.24569) 1617 : cluster [DBG] pgmap v1396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:24.425573+0000 mgr.smithi067.rdualw (mgr.24569) 1618 : cluster [DBG] pgmap v1397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:24.425573+0000 mgr.smithi067.rdualw (mgr.24569) 1618 : cluster [DBG] pgmap v1397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:26.426408+0000 mgr.smithi067.rdualw (mgr.24569) 1619 : cluster [DBG] pgmap v1398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:15:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:26.426408+0000 mgr.smithi067.rdualw (mgr.24569) 1619 : cluster [DBG] pgmap v1398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:15:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:28.426939+0000 mgr.smithi067.rdualw (mgr.24569) 1620 : cluster [DBG] pgmap v1399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:28.426939+0000 mgr.smithi067.rdualw (mgr.24569) 1620 : cluster [DBG] pgmap v1399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:31.041 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:15:31.332 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:15:31.332 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (53m) 4m ago 54m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:15:31.332 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (45m) 4m ago 54m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:15:31.333 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (45m) 4m ago 53m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:15:31.333 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (52m) 4m ago 53m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:15:31.333 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (46m) 4m ago 49m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:15:31.333 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (46m) 4m ago 49m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:15:31.334 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (47m) 4m ago 55m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:15:31.334 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (46m) 4m ago 53m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:15:31.334 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (46m) 4m ago 55m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:15:31.334 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (46m) 4m ago 53m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:15:31.334 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (47m) 4m ago 47m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:15:31.335 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (47m) 4m ago 47m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:15:31.335 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (53m) 4m ago 53m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:15:31.335 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (53m) 4m ago 53m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:15:31.335 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (36m) 4m ago 52m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:15:31.336 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (52m) 4m ago 52m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:15:31.336 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (52m) 4m ago 52m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:15:31.336 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (52m) 4m ago 52m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:15:31.336 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (51m) 4m ago 51m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:15:31.336 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (51m) 4m ago 51m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:15:31.337 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (51m) 4m ago 51m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:15:31.337 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (51m) 4m ago 51m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:15:31.337 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (52m) 4m ago 53m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:15:31.692 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:15:31.692 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:15:31.693 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:15:31.693 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:15:31.693 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:15:31.693 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:15:31.694 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:15:31.694 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:15:31.694 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:15:31.694 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:15:31.695 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:15:31.695 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:15:31.695 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:15:31.695 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:15:31.696 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:15:31.696 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:15:31.696 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:15:31.696 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:15:31.696 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:15:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:30.427859+0000 mgr.smithi067.rdualw (mgr.24569) 1621 : cluster [DBG] pgmap v1400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:15:31.025320+0000 mgr.smithi067.rdualw (mgr.24569) 1622 : audit [DBG] from='client.35218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:15:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:15:31.690532+0000 mon.smithi061 (mon.0) 521 : audit [DBG] from='client.? 172.21.15.61:0/1282348004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:15:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:30.427859+0000 mgr.smithi067.rdualw (mgr.24569) 1621 : cluster [DBG] pgmap v1400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:15:31.025320+0000 mgr.smithi067.rdualw (mgr.24569) 1622 : audit [DBG] from='client.35218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:15:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:15:31.690532+0000 mon.smithi061 (mon.0) 521 : audit [DBG] from='client.? 172.21.15.61:0/1282348004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:15:33.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:15:31.313866+0000 mgr.smithi067.rdualw (mgr.24569) 1623 : audit [DBG] from='client.35222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:15:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:15:31.313866+0000 mgr.smithi067.rdualw (mgr.24569) 1623 : audit [DBG] from='client.35222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:15:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:32.428488+0000 mgr.smithi067.rdualw (mgr.24569) 1624 : cluster [DBG] pgmap v1401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:32.428488+0000 mgr.smithi067.rdualw (mgr.24569) 1624 : cluster [DBG] pgmap v1401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:34.429168+0000 mgr.smithi067.rdualw (mgr.24569) 1625 : cluster [DBG] pgmap v1402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:15:34.673146+0000 mon.smithi067 (mon.1) 284 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:15:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:15:34.673504+0000 mon.smithi067 (mon.1) 285 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:15:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:15:34.673595+0000 mon.smithi061 (mon.0) 522 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:15:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:15:34.673851+0000 mon.smithi061 (mon.0) 523 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:15:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:34.429168+0000 mgr.smithi067.rdualw (mgr.24569) 1625 : cluster [DBG] pgmap v1402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:15:34.673146+0000 mon.smithi067 (mon.1) 284 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:15:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:15:34.673504+0000 mon.smithi067 (mon.1) 285 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:15:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:15:34.673595+0000 mon.smithi061 (mon.0) 522 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:15:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:15:34.673851+0000 mon.smithi061 (mon.0) 523 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:15:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:36.430287+0000 mgr.smithi067.rdualw (mgr.24569) 1626 : cluster [DBG] pgmap v1403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:15:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:36.430287+0000 mgr.smithi067.rdualw (mgr.24569) 1626 : cluster [DBG] pgmap v1403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:15:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:38.431091+0000 mgr.smithi067.rdualw (mgr.24569) 1627 : cluster [DBG] pgmap v1404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:38.431091+0000 mgr.smithi067.rdualw (mgr.24569) 1627 : cluster [DBG] pgmap v1404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:40.431997+0000 mgr.smithi067.rdualw (mgr.24569) 1628 : cluster [DBG] pgmap v1405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:42.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:40.431997+0000 mgr.smithi067.rdualw (mgr.24569) 1628 : cluster [DBG] pgmap v1405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:42.432727+0000 mgr.smithi067.rdualw (mgr.24569) 1629 : cluster [DBG] pgmap v1406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:44.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:42.432727+0000 mgr.smithi067.rdualw (mgr.24569) 1629 : cluster [DBG] pgmap v1406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:44.433339+0000 mgr.smithi067.rdualw (mgr.24569) 1630 : cluster [DBG] pgmap v1407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:44.433339+0000 mgr.smithi067.rdualw (mgr.24569) 1630 : cluster [DBG] pgmap v1407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:46.434256+0000 mgr.smithi067.rdualw (mgr.24569) 1631 : cluster [DBG] pgmap v1408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:15:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:46.434256+0000 mgr.smithi067.rdualw (mgr.24569) 1631 : cluster [DBG] pgmap v1408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:15:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:48.434895+0000 mgr.smithi067.rdualw (mgr.24569) 1632 : cluster [DBG] pgmap v1409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:48.434895+0000 mgr.smithi067.rdualw (mgr.24569) 1632 : cluster [DBG] pgmap v1409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:50.435714+0000 mgr.smithi067.rdualw (mgr.24569) 1633 : cluster [DBG] pgmap v1410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:50.435714+0000 mgr.smithi067.rdualw (mgr.24569) 1633 : cluster [DBG] pgmap v1410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:52.436403+0000 mgr.smithi067.rdualw (mgr.24569) 1634 : cluster [DBG] pgmap v1411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:52.436403+0000 mgr.smithi067.rdualw (mgr.24569) 1634 : cluster [DBG] pgmap v1411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:54.437089+0000 mgr.smithi067.rdualw (mgr.24569) 1635 : cluster [DBG] pgmap v1412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:54.437089+0000 mgr.smithi067.rdualw (mgr.24569) 1635 : cluster [DBG] pgmap v1412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:15:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:56.437923+0000 mgr.smithi067.rdualw (mgr.24569) 1636 : cluster [DBG] pgmap v1413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:15:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:56.437923+0000 mgr.smithi067.rdualw (mgr.24569) 1636 : cluster [DBG] pgmap v1413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:16:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:15:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:15:58.438438+0000 mgr.smithi067.rdualw (mgr.24569) 1637 : cluster [DBG] pgmap v1414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:15:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:15:58.438438+0000 mgr.smithi067.rdualw (mgr.24569) 1637 : cluster [DBG] pgmap v1414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:02.009 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:16:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:00.439254+0000 mgr.smithi067.rdualw (mgr.24569) 1638 : cluster [DBG] pgmap v1415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:00.439254+0000 mgr.smithi067.rdualw (mgr.24569) 1638 : cluster [DBG] pgmap v1415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:02.301 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:16:02.301 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (53m) 4m ago 54m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:16:02.301 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (46m) 4m ago 54m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:16:02.302 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (46m) 5m ago 54m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:16:02.302 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (53m) 4m ago 54m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:16:02.302 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (46m) 4m ago 50m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:16:02.302 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (46m) 5m ago 50m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:16:02.303 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (47m) 4m ago 55m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:16:02.303 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (47m) 5m ago 54m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:16:02.303 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (47m) 4m ago 55m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:16:02.303 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (47m) 5m ago 53m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:16:02.304 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (47m) 4m ago 47m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:16:02.304 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (47m) 5m ago 47m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:16:02.304 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (54m) 4m ago 54m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:16:02.304 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (53m) 5m ago 53m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:16:02.304 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (37m) 4m ago 53m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:16:02.305 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (53m) 4m ago 53m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:16:02.305 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (52m) 4m ago 52m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:16:02.305 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (52m) 4m ago 52m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:16:02.305 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (52m) 5m ago 52m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:16:02.306 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (52m) 5m ago 52m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:16:02.306 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (51m) 5m ago 51m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:16:02.306 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (51m) 5m ago 51m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:16:02.306 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (53m) 4m ago 54m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:16:02.641 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:16:02.642 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:16:02.642 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:16:02.643 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:16:02.643 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:16:02.643 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:16:02.643 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:16:02.643 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:16:02.644 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:16:02.644 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:16:02.644 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:16:02.644 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:16:02.645 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:16:02.645 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:16:02.645 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:16:02.645 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:16:02.646 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:16:02.646 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:16:02.646 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:16:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:16:01.993002+0000 mgr.smithi067.rdualw (mgr.24569) 1639 : audit [DBG] from='client.35230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:16:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:16:02.283271+0000 mgr.smithi067.rdualw (mgr.24569) 1640 : audit [DBG] from='client.35234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:16:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:16:02.640285+0000 mon.smithi061 (mon.0) 524 : audit [DBG] from='client.? 172.21.15.61:0/3315380356' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:16:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:16:01.993002+0000 mgr.smithi067.rdualw (mgr.24569) 1639 : audit [DBG] from='client.35230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:16:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:16:02.283271+0000 mgr.smithi067.rdualw (mgr.24569) 1640 : audit [DBG] from='client.35234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:16:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:16:02.640285+0000 mon.smithi061 (mon.0) 524 : audit [DBG] from='client.? 172.21.15.61:0/3315380356' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:16:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:02.439841+0000 mgr.smithi067.rdualw (mgr.24569) 1641 : cluster [DBG] pgmap v1416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:04.143 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:02.439841+0000 mgr.smithi067.rdualw (mgr.24569) 1641 : cluster [DBG] pgmap v1416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:04.440455+0000 mgr.smithi067.rdualw (mgr.24569) 1642 : cluster [DBG] pgmap v1417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:16:04.793517+0000 mon.smithi067 (mon.1) 286 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:16:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:16:04.794901+0000 mon.smithi067 (mon.1) 287 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:16:06.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:16:04.795801+0000 mon.smithi067 (mon.1) 288 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:16:06.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:16:04.796610+0000 mgr.smithi067.rdualw (mgr.24569) 1643 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:16:06.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:16:05.209984+0000 mon.smithi061 (mon.0) 525 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:16:06.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:16:05.215891+0000 mon.smithi061 (mon.0) 526 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:16:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:04.440455+0000 mgr.smithi067.rdualw (mgr.24569) 1642 : cluster [DBG] pgmap v1417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:16:04.793517+0000 mon.smithi067 (mon.1) 286 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:16:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:16:04.794901+0000 mon.smithi067 (mon.1) 287 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:16:06.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:16:04.795801+0000 mon.smithi067 (mon.1) 288 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:16:06.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:16:04.796610+0000 mgr.smithi067.rdualw (mgr.24569) 1643 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:16:06.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:16:05.209984+0000 mon.smithi061 (mon.0) 525 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:16:06.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:16:05.215891+0000 mon.smithi061 (mon.0) 526 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:16:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:06.441515+0000 mgr.smithi067.rdualw (mgr.24569) 1644 : cluster [DBG] pgmap v1418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:16:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:06.441515+0000 mgr.smithi067.rdualw (mgr.24569) 1644 : cluster [DBG] pgmap v1418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:16:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:08.441985+0000 mgr.smithi067.rdualw (mgr.24569) 1645 : cluster [DBG] pgmap v1419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:08.441985+0000 mgr.smithi067.rdualw (mgr.24569) 1645 : cluster [DBG] pgmap v1419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:10.442852+0000 mgr.smithi067.rdualw (mgr.24569) 1646 : cluster [DBG] pgmap v1420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:12.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:10.442852+0000 mgr.smithi067.rdualw (mgr.24569) 1646 : cluster [DBG] pgmap v1420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:14.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:12.443593+0000 mgr.smithi067.rdualw (mgr.24569) 1647 : cluster [DBG] pgmap v1421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:12.443593+0000 mgr.smithi067.rdualw (mgr.24569) 1647 : cluster [DBG] pgmap v1421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:14.444444+0000 mgr.smithi067.rdualw (mgr.24569) 1648 : cluster [DBG] pgmap v1422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:14.444444+0000 mgr.smithi067.rdualw (mgr.24569) 1648 : cluster [DBG] pgmap v1422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:16.445292+0000 mgr.smithi067.rdualw (mgr.24569) 1649 : cluster [DBG] pgmap v1423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:16:18.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:16.445292+0000 mgr.smithi067.rdualw (mgr.24569) 1649 : cluster [DBG] pgmap v1423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:16:20.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:18.445999+0000 mgr.smithi067.rdualw (mgr.24569) 1650 : cluster [DBG] pgmap v1424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:18.445999+0000 mgr.smithi067.rdualw (mgr.24569) 1650 : cluster [DBG] pgmap v1424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:20.446857+0000 mgr.smithi067.rdualw (mgr.24569) 1651 : cluster [DBG] pgmap v1425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:20.446857+0000 mgr.smithi067.rdualw (mgr.24569) 1651 : cluster [DBG] pgmap v1425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:22.447632+0000 mgr.smithi067.rdualw (mgr.24569) 1652 : cluster [DBG] pgmap v1426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:22.447632+0000 mgr.smithi067.rdualw (mgr.24569) 1652 : cluster [DBG] pgmap v1426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:26.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:24.448181+0000 mgr.smithi067.rdualw (mgr.24569) 1653 : cluster [DBG] pgmap v1427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:24.448181+0000 mgr.smithi067.rdualw (mgr.24569) 1653 : cluster [DBG] pgmap v1427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:28.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:26.449082+0000 mgr.smithi067.rdualw (mgr.24569) 1654 : cluster [DBG] pgmap v1428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:16:28.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:26.449082+0000 mgr.smithi067.rdualw (mgr.24569) 1654 : cluster [DBG] pgmap v1428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:16:30.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:28.449806+0000 mgr.smithi067.rdualw (mgr.24569) 1655 : cluster [DBG] pgmap v1429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:28.449806+0000 mgr.smithi067.rdualw (mgr.24569) 1655 : cluster [DBG] pgmap v1429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:30.450676+0000 mgr.smithi067.rdualw (mgr.24569) 1656 : cluster [DBG] pgmap v1430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:30.450676+0000 mgr.smithi067.rdualw (mgr.24569) 1656 : cluster [DBG] pgmap v1430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:32.950 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:16:33.242 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:16:33.243 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (54m) 5m ago 55m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:16:33.243 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (46m) 5m ago 55m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:16:33.243 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (46m) 5m ago 54m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:16:33.244 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (53m) 5m ago 54m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:16:33.244 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (47m) 5m ago 50m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:16:33.244 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (47m) 5m ago 50m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:16:33.244 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (48m) 5m ago 56m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:16:33.244 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (47m) 5m ago 54m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:16:33.245 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (47m) 5m ago 56m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:16:33.245 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (47m) 5m ago 54m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:16:33.245 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (48m) 5m ago 48m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:16:33.245 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (48m) 5m ago 48m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:16:33.246 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (54m) 5m ago 54m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:16:33.246 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (54m) 5m ago 54m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:16:33.246 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (37m) 5m ago 54m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:16:33.246 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (53m) 5m ago 53m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:16:33.246 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (53m) 5m ago 53m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:16:33.247 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (53m) 5m ago 53m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:16:33.247 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (52m) 5m ago 52m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:16:33.247 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (52m) 5m ago 52m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:16:33.247 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (52m) 5m ago 52m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:16:33.248 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (52m) 5m ago 52m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:16:33.248 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (53m) 5m ago 54m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:16:33.583 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:16:33.584 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:16:33.584 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:16:33.584 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:16:33.584 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:16:33.585 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:16:33.585 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:16:33.585 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:16:33.585 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:16:33.586 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:16:33.586 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:16:33.586 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:16:33.586 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:16:33.586 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:16:33.587 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:16:33.587 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:16:33.587 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:16:33.587 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:16:33.588 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:16:34.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:32.451445+0000 mgr.smithi067.rdualw (mgr.24569) 1657 : cluster [DBG] pgmap v1431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:34.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:16:32.937039+0000 mgr.smithi067.rdualw (mgr.24569) 1658 : audit [DBG] from='client.35242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:16:34.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:16:33.224855+0000 mgr.smithi067.rdualw (mgr.24569) 1659 : audit [DBG] from='client.35246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:16:34.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:16:33.582099+0000 mon.smithi061 (mon.0) 527 : audit [DBG] from='client.? 172.21.15.61:0/2054109144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:16:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:32.451445+0000 mgr.smithi067.rdualw (mgr.24569) 1657 : cluster [DBG] pgmap v1431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:34.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:16:32.937039+0000 mgr.smithi067.rdualw (mgr.24569) 1658 : audit [DBG] from='client.35242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:16:34.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:16:33.224855+0000 mgr.smithi067.rdualw (mgr.24569) 1659 : audit [DBG] from='client.35246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:16:34.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:16:33.582099+0000 mon.smithi061 (mon.0) 527 : audit [DBG] from='client.? 172.21.15.61:0/2054109144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:16:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:34.452145+0000 mgr.smithi067.rdualw (mgr.24569) 1660 : cluster [DBG] pgmap v1432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:16:34.679194+0000 mon.smithi067 (mon.1) 289 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:16:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:16:34.679456+0000 mon.smithi067 (mon.1) 290 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:16:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:16:34.679596+0000 mon.smithi061 (mon.0) 528 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:16:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:16:34.679794+0000 mon.smithi061 (mon.0) 529 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:16:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:34.452145+0000 mgr.smithi067.rdualw (mgr.24569) 1660 : cluster [DBG] pgmap v1432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:16:34.679194+0000 mon.smithi067 (mon.1) 289 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:16:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:16:34.679456+0000 mon.smithi067 (mon.1) 290 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:16:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:16:34.679596+0000 mon.smithi061 (mon.0) 528 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:16:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:16:34.679794+0000 mon.smithi061 (mon.0) 529 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:16:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:36.453141+0000 mgr.smithi067.rdualw (mgr.24569) 1661 : cluster [DBG] pgmap v1433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:16:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:36.453141+0000 mgr.smithi067.rdualw (mgr.24569) 1661 : cluster [DBG] pgmap v1433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:16:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:38.453800+0000 mgr.smithi067.rdualw (mgr.24569) 1662 : cluster [DBG] pgmap v1434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:38.453800+0000 mgr.smithi067.rdualw (mgr.24569) 1662 : cluster [DBG] pgmap v1434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:42.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:40.454885+0000 mgr.smithi067.rdualw (mgr.24569) 1663 : cluster [DBG] pgmap v1435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:42.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:40.454885+0000 mgr.smithi067.rdualw (mgr.24569) 1663 : cluster [DBG] pgmap v1435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:42.455356+0000 mgr.smithi067.rdualw (mgr.24569) 1664 : cluster [DBG] pgmap v1436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:42.455356+0000 mgr.smithi067.rdualw (mgr.24569) 1664 : cluster [DBG] pgmap v1436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:44.456150+0000 mgr.smithi067.rdualw (mgr.24569) 1665 : cluster [DBG] pgmap v1437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:44.456150+0000 mgr.smithi067.rdualw (mgr.24569) 1665 : cluster [DBG] pgmap v1437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:48.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:46.457181+0000 mgr.smithi067.rdualw (mgr.24569) 1666 : cluster [DBG] pgmap v1438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:16:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:46.457181+0000 mgr.smithi067.rdualw (mgr.24569) 1666 : cluster [DBG] pgmap v1438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:16:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:48.457754+0000 mgr.smithi067.rdualw (mgr.24569) 1667 : cluster [DBG] pgmap v1439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:48.457754+0000 mgr.smithi067.rdualw (mgr.24569) 1667 : cluster [DBG] pgmap v1439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:50.458610+0000 mgr.smithi067.rdualw (mgr.24569) 1668 : cluster [DBG] pgmap v1440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:50.458610+0000 mgr.smithi067.rdualw (mgr.24569) 1668 : cluster [DBG] pgmap v1440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:52.459240+0000 mgr.smithi067.rdualw (mgr.24569) 1669 : cluster [DBG] pgmap v1441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:52.459240+0000 mgr.smithi067.rdualw (mgr.24569) 1669 : cluster [DBG] pgmap v1441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:54.459884+0000 mgr.smithi067.rdualw (mgr.24569) 1670 : cluster [DBG] pgmap v1442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:54.459884+0000 mgr.smithi067.rdualw (mgr.24569) 1670 : cluster [DBG] pgmap v1442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:16:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:56.460806+0000 mgr.smithi067.rdualw (mgr.24569) 1671 : cluster [DBG] pgmap v1443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:16:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:56.460806+0000 mgr.smithi067.rdualw (mgr.24569) 1671 : cluster [DBG] pgmap v1443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:17:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:16:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:16:58.461521+0000 mgr.smithi067.rdualw (mgr.24569) 1672 : cluster [DBG] pgmap v1444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:16:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:16:58.461521+0000 mgr.smithi067.rdualw (mgr.24569) 1672 : cluster [DBG] pgmap v1444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:00.462530+0000 mgr.smithi067.rdualw (mgr.24569) 1673 : cluster [DBG] pgmap v1445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:00.462530+0000 mgr.smithi067.rdualw (mgr.24569) 1673 : cluster [DBG] pgmap v1445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:03.893 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:17:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:02.463087+0000 mgr.smithi067.rdualw (mgr.24569) 1674 : cluster [DBG] pgmap v1446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:02.463087+0000 mgr.smithi067.rdualw (mgr.24569) 1674 : cluster [DBG] pgmap v1446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:04.186 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:17:04.187 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (54m) 6m ago 55m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:17:04.187 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (47m) 6m ago 55m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:17:04.187 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (47m) 6m ago 55m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:17:04.187 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (54m) 6m ago 55m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:17:04.188 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (47m) 6m ago 51m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:17:04.188 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (47m) 6m ago 51m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:17:04.188 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (48m) 6m ago 56m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:17:04.188 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (48m) 6m ago 55m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:17:04.189 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (48m) 6m ago 56m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:17:04.189 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (48m) 6m ago 55m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:17:04.189 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (49m) 6m ago 49m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:17:04.190 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (48m) 6m ago 48m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:17:04.190 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (55m) 6m ago 55m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:17:04.190 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (54m) 6m ago 54m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:17:04.190 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (38m) 6m ago 54m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:17:04.191 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (54m) 6m ago 54m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:17:04.191 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (53m) 6m ago 53m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:17:04.191 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (53m) 6m ago 53m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:17:04.191 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (53m) 6m ago 53m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:17:04.191 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (53m) 6m ago 53m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:17:04.192 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (52m) 6m ago 52m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:17:04.192 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (52m) 6m ago 52m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:17:04.192 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (54m) 6m ago 55m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:17:04.527 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:17:04.527 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:17:04.528 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:17:04.528 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:17:04.528 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:17:04.528 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:17:04.529 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:17:04.529 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:17:04.529 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:17:04.529 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:17:04.529 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:17:04.530 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:17:04.530 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:17:04.530 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:17:04.530 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:17:04.531 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:17:04.531 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:17:04.531 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:17:04.531 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:17:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:17:03.880045+0000 mgr.smithi067.rdualw (mgr.24569) 1675 : audit [DBG] from='client.35254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:17:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:17:04.168261+0000 mgr.smithi067.rdualw (mgr.24569) 1676 : audit [DBG] from='client.35258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:17:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:17:04.525778+0000 mon.smithi061 (mon.0) 530 : audit [DBG] from='client.? 172.21.15.61:0/3863604549' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:17:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:17:03.880045+0000 mgr.smithi067.rdualw (mgr.24569) 1675 : audit [DBG] from='client.35254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:17:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:17:04.168261+0000 mgr.smithi067.rdualw (mgr.24569) 1676 : audit [DBG] from='client.35258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:17:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:17:04.525778+0000 mon.smithi061 (mon.0) 530 : audit [DBG] from='client.? 172.21.15.61:0/3863604549' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:17:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:04.463751+0000 mgr.smithi067.rdualw (mgr.24569) 1677 : cluster [DBG] pgmap v1447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:17:05.221337+0000 mon.smithi067 (mon.1) 291 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:17:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:17:05.222787+0000 mon.smithi067 (mon.1) 292 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:17:06.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:17:05.223711+0000 mon.smithi067 (mon.1) 293 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:17:06.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:17:05.224553+0000 mgr.smithi067.rdualw (mgr.24569) 1678 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:17:06.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:17:05.640507+0000 mon.smithi061 (mon.0) 531 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:17:06.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:17:05.646163+0000 mon.smithi061 (mon.0) 532 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:17:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:04.463751+0000 mgr.smithi067.rdualw (mgr.24569) 1677 : cluster [DBG] pgmap v1447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:17:05.221337+0000 mon.smithi067 (mon.1) 291 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:17:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:17:05.222787+0000 mon.smithi067 (mon.1) 292 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:17:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:17:05.223711+0000 mon.smithi067 (mon.1) 293 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:17:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:17:05.224553+0000 mgr.smithi067.rdualw (mgr.24569) 1678 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:17:06.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:17:05.640507+0000 mon.smithi061 (mon.0) 531 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:17:06.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:17:05.646163+0000 mon.smithi061 (mon.0) 532 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:17:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:06.464662+0000 mgr.smithi067.rdualw (mgr.24569) 1679 : cluster [DBG] pgmap v1448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:17:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:06.464662+0000 mgr.smithi067.rdualw (mgr.24569) 1679 : cluster [DBG] pgmap v1448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:17:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:08.465258+0000 mgr.smithi067.rdualw (mgr.24569) 1680 : cluster [DBG] pgmap v1449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:08.465258+0000 mgr.smithi067.rdualw (mgr.24569) 1680 : cluster [DBG] pgmap v1449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:10.466073+0000 mgr.smithi067.rdualw (mgr.24569) 1681 : cluster [DBG] pgmap v1450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:10.466073+0000 mgr.smithi067.rdualw (mgr.24569) 1681 : cluster [DBG] pgmap v1450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:12.466616+0000 mgr.smithi067.rdualw (mgr.24569) 1682 : cluster [DBG] pgmap v1451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:12.466616+0000 mgr.smithi067.rdualw (mgr.24569) 1682 : cluster [DBG] pgmap v1451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:14.467384+0000 mgr.smithi067.rdualw (mgr.24569) 1683 : cluster [DBG] pgmap v1452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:14.467384+0000 mgr.smithi067.rdualw (mgr.24569) 1683 : cluster [DBG] pgmap v1452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:16.468304+0000 mgr.smithi067.rdualw (mgr.24569) 1684 : cluster [DBG] pgmap v1453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:17:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:16.468304+0000 mgr.smithi067.rdualw (mgr.24569) 1684 : cluster [DBG] pgmap v1453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:17:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:18.468965+0000 mgr.smithi067.rdualw (mgr.24569) 1685 : cluster [DBG] pgmap v1454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:18.468965+0000 mgr.smithi067.rdualw (mgr.24569) 1685 : cluster [DBG] pgmap v1454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:20.469803+0000 mgr.smithi067.rdualw (mgr.24569) 1686 : cluster [DBG] pgmap v1455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:20.469803+0000 mgr.smithi067.rdualw (mgr.24569) 1686 : cluster [DBG] pgmap v1455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:22.470446+0000 mgr.smithi067.rdualw (mgr.24569) 1687 : cluster [DBG] pgmap v1456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:22.470446+0000 mgr.smithi067.rdualw (mgr.24569) 1687 : cluster [DBG] pgmap v1456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:24.471084+0000 mgr.smithi067.rdualw (mgr.24569) 1688 : cluster [DBG] pgmap v1457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:26.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:24.471084+0000 mgr.smithi067.rdualw (mgr.24569) 1688 : cluster [DBG] pgmap v1457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:26.471893+0000 mgr.smithi067.rdualw (mgr.24569) 1689 : cluster [DBG] pgmap v1458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:17:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:26.471893+0000 mgr.smithi067.rdualw (mgr.24569) 1689 : cluster [DBG] pgmap v1458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:17:30.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:28.472413+0000 mgr.smithi067.rdualw (mgr.24569) 1690 : cluster [DBG] pgmap v1459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:28.472413+0000 mgr.smithi067.rdualw (mgr.24569) 1690 : cluster [DBG] pgmap v1459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:30.473296+0000 mgr.smithi067.rdualw (mgr.24569) 1691 : cluster [DBG] pgmap v1460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:30.473296+0000 mgr.smithi067.rdualw (mgr.24569) 1691 : cluster [DBG] pgmap v1460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:32.473900+0000 mgr.smithi067.rdualw (mgr.24569) 1692 : cluster [DBG] pgmap v1461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:32.473900+0000 mgr.smithi067.rdualw (mgr.24569) 1692 : cluster [DBG] pgmap v1461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:34.835 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:17:35.127 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:17:35.127 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (55m) 6m ago 56m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:17:35.127 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (47m) 6m ago 56m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:17:35.128 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (47m) 6m ago 55m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:17:35.128 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (54m) 6m ago 56m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:17:35.128 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (48m) 6m ago 51m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:17:35.128 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (48m) 6m ago 51m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:17:35.129 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (49m) 6m ago 57m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:17:35.129 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (48m) 6m ago 55m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:17:35.129 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (48m) 6m ago 57m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:17:35.129 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (48m) 6m ago 55m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:17:35.129 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (49m) 6m ago 49m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:17:35.130 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (49m) 6m ago 49m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:17:35.130 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (55m) 6m ago 55m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:17:35.130 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (55m) 6m ago 55m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:17:35.130 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (38m) 6m ago 55m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:17:35.131 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (54m) 6m ago 54m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:17:35.131 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (54m) 6m ago 54m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:17:35.131 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (54m) 6m ago 54m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:17:35.131 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (53m) 6m ago 53m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:17:35.131 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (53m) 6m ago 53m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:17:35.132 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (53m) 6m ago 53m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:17:35.132 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (53m) 6m ago 53m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:17:35.132 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (54m) 6m ago 55m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:17:35.466 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:17:35.466 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:17:35.466 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:17:35.467 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:17:35.467 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:17:35.467 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:17:35.467 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:17:35.468 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:17:35.468 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:17:35.468 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:17:35.468 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:17:35.469 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:17:35.469 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:17:35.469 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:17:35.469 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:17:35.470 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:17:35.470 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:17:35.470 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:17:35.470 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:17:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:34.474455+0000 mgr.smithi067.rdualw (mgr.24569) 1693 : cluster [DBG] pgmap v1462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:17:34.684137+0000 mon.smithi067 (mon.1) 294 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:17:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:17:34.684437+0000 mon.smithi067 (mon.1) 295 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:17:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:17:34.684517+0000 mon.smithi061 (mon.0) 533 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:17:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:17:34.684811+0000 mon.smithi061 (mon.0) 534 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:17:36.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:17:34.821431+0000 mgr.smithi067.rdualw (mgr.24569) 1694 : audit [DBG] from='client.35266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:17:36.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:17:35.109205+0000 mgr.smithi067.rdualw (mgr.24569) 1695 : audit [DBG] from='client.35270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:17:36.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:17:35.464621+0000 mon.smithi061 (mon.0) 535 : audit [DBG] from='client.? 172.21.15.61:0/335143800' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:17:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:34.474455+0000 mgr.smithi067.rdualw (mgr.24569) 1693 : cluster [DBG] pgmap v1462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:17:34.684137+0000 mon.smithi067 (mon.1) 294 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:17:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:17:34.684437+0000 mon.smithi067 (mon.1) 295 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:17:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:17:34.684517+0000 mon.smithi061 (mon.0) 533 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:17:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:17:34.684811+0000 mon.smithi061 (mon.0) 534 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:17:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:17:34.821431+0000 mgr.smithi067.rdualw (mgr.24569) 1694 : audit [DBG] from='client.35266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:17:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:17:35.109205+0000 mgr.smithi067.rdualw (mgr.24569) 1695 : audit [DBG] from='client.35270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:17:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:17:35.464621+0000 mon.smithi061 (mon.0) 535 : audit [DBG] from='client.? 172.21.15.61:0/335143800' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:17:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:36.475332+0000 mgr.smithi067.rdualw (mgr.24569) 1696 : cluster [DBG] pgmap v1463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:17:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:36.475332+0000 mgr.smithi067.rdualw (mgr.24569) 1696 : cluster [DBG] pgmap v1463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:17:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:38.476054+0000 mgr.smithi067.rdualw (mgr.24569) 1697 : cluster [DBG] pgmap v1464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:38.476054+0000 mgr.smithi067.rdualw (mgr.24569) 1697 : cluster [DBG] pgmap v1464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:40.476998+0000 mgr.smithi067.rdualw (mgr.24569) 1698 : cluster [DBG] pgmap v1465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:40.476998+0000 mgr.smithi067.rdualw (mgr.24569) 1698 : cluster [DBG] pgmap v1465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:42.477576+0000 mgr.smithi067.rdualw (mgr.24569) 1699 : cluster [DBG] pgmap v1466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:42.477576+0000 mgr.smithi067.rdualw (mgr.24569) 1699 : cluster [DBG] pgmap v1466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:44.478317+0000 mgr.smithi067.rdualw (mgr.24569) 1700 : cluster [DBG] pgmap v1467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:46.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:44.478317+0000 mgr.smithi067.rdualw (mgr.24569) 1700 : cluster [DBG] pgmap v1467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:46.479426+0000 mgr.smithi067.rdualw (mgr.24569) 1701 : cluster [DBG] pgmap v1468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:17:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:46.479426+0000 mgr.smithi067.rdualw (mgr.24569) 1701 : cluster [DBG] pgmap v1468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:17:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:48.479979+0000 mgr.smithi067.rdualw (mgr.24569) 1702 : cluster [DBG] pgmap v1469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:48.479979+0000 mgr.smithi067.rdualw (mgr.24569) 1702 : cluster [DBG] pgmap v1469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:50.481069+0000 mgr.smithi067.rdualw (mgr.24569) 1703 : cluster [DBG] pgmap v1470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:50.481069+0000 mgr.smithi067.rdualw (mgr.24569) 1703 : cluster [DBG] pgmap v1470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:52.481662+0000 mgr.smithi067.rdualw (mgr.24569) 1704 : cluster [DBG] pgmap v1471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:52.481662+0000 mgr.smithi067.rdualw (mgr.24569) 1704 : cluster [DBG] pgmap v1471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:54.482438+0000 mgr.smithi067.rdualw (mgr.24569) 1705 : cluster [DBG] pgmap v1472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:54.482438+0000 mgr.smithi067.rdualw (mgr.24569) 1705 : cluster [DBG] pgmap v1472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:17:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:56.483398+0000 mgr.smithi067.rdualw (mgr.24569) 1706 : cluster [DBG] pgmap v1473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:17:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:56.483398+0000 mgr.smithi067.rdualw (mgr.24569) 1706 : cluster [DBG] pgmap v1473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:18:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:17:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:17:58.483950+0000 mgr.smithi067.rdualw (mgr.24569) 1707 : cluster [DBG] pgmap v1474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:17:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:17:58.483950+0000 mgr.smithi067.rdualw (mgr.24569) 1707 : cluster [DBG] pgmap v1474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:00.484868+0000 mgr.smithi067.rdualw (mgr.24569) 1708 : cluster [DBG] pgmap v1475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:00.484868+0000 mgr.smithi067.rdualw (mgr.24569) 1708 : cluster [DBG] pgmap v1475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:02.485372+0000 mgr.smithi067.rdualw (mgr.24569) 1709 : cluster [DBG] pgmap v1476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:02.485372+0000 mgr.smithi067.rdualw (mgr.24569) 1709 : cluster [DBG] pgmap v1476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:05.775 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:18:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:04.486138+0000 mgr.smithi067.rdualw (mgr.24569) 1710 : cluster [DBG] pgmap v1477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:18:05.649438+0000 mon.smithi067 (mon.1) 296 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:18:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:18:05.650905+0000 mon.smithi067 (mon.1) 297 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:18:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:18:05.651800+0000 mon.smithi067 (mon.1) 298 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:18:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:04.486138+0000 mgr.smithi067.rdualw (mgr.24569) 1710 : cluster [DBG] pgmap v1477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:18:05.649438+0000 mon.smithi067 (mon.1) 296 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:18:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:18:05.650905+0000 mon.smithi067 (mon.1) 297 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:18:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:18:05.651800+0000 mon.smithi067 (mon.1) 298 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:18:06.067 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:18:06.067 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (55m) 7m ago 56m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:18:06.067 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (48m) 7m ago 56m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:18:06.068 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (48m) 7m ago 56m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:18:06.068 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (55m) 7m ago 56m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:18:06.068 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (48m) 7m ago 52m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:18:06.069 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (48m) 7m ago 52m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:18:06.069 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (49m) 7m ago 57m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:18:06.069 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (49m) 7m ago 56m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:18:06.069 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (49m) 7m ago 57m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:18:06.070 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (49m) 7m ago 56m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:18:06.070 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (50m) 7m ago 50m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:18:06.070 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (49m) 7m ago 49m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:18:06.071 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (56m) 7m ago 56m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:18:06.071 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (55m) 7m ago 55m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:18:06.071 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (39m) 7m ago 55m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:18:06.072 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (55m) 7m ago 55m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:18:06.072 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (55m) 7m ago 54m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:18:06.072 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (54m) 7m ago 54m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:18:06.072 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (54m) 7m ago 54m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:18:06.073 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (54m) 7m ago 54m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:18:06.073 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (53m) 7m ago 53m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:18:06.073 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (53m) 7m ago 53m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:18:06.073 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (55m) 7m ago 56m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:18:06.418 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:18:06.419 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:18:06.419 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:18:06.419 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:18:06.419 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:18:06.420 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:18:06.420 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:18:06.420 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:18:06.420 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:18:06.421 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:18:06.421 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:18:06.421 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:18:06.421 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:18:06.421 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:18:06.422 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:18:06.422 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:18:06.422 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:18:06.422 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:18:06.423 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:18:07.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:18:05.652625+0000 mgr.smithi067.rdualw (mgr.24569) 1711 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:18:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:18:05.761331+0000 mgr.smithi067.rdualw (mgr.24569) 1712 : audit [DBG] from='client.35278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:18:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:18:06.050787+0000 mgr.smithi067.rdualw (mgr.24569) 1713 : audit [DBG] from='client.35282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:18:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:18:06.071658+0000 mon.smithi061 (mon.0) 536 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:18:07.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:18:06.077338+0000 mon.smithi061 (mon.0) 537 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:18:07.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:18:06.417288+0000 mon.smithi061 (mon.0) 538 : audit [DBG] from='client.? 172.21.15.61:0/2034082889' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:18:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:18:05.652625+0000 mgr.smithi067.rdualw (mgr.24569) 1711 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:18:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:18:05.761331+0000 mgr.smithi067.rdualw (mgr.24569) 1712 : audit [DBG] from='client.35278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:18:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:18:06.050787+0000 mgr.smithi067.rdualw (mgr.24569) 1713 : audit [DBG] from='client.35282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:18:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:18:06.071658+0000 mon.smithi061 (mon.0) 536 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:18:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:18:06.077338+0000 mon.smithi061 (mon.0) 537 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:18:07.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:18:06.417288+0000 mon.smithi061 (mon.0) 538 : audit [DBG] from='client.? 172.21.15.61:0/2034082889' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:18:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:06.486893+0000 mgr.smithi067.rdualw (mgr.24569) 1714 : cluster [DBG] pgmap v1478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:18:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:06.486893+0000 mgr.smithi067.rdualw (mgr.24569) 1714 : cluster [DBG] pgmap v1478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:18:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:08.487351+0000 mgr.smithi067.rdualw (mgr.24569) 1715 : cluster [DBG] pgmap v1479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:08.487351+0000 mgr.smithi067.rdualw (mgr.24569) 1715 : cluster [DBG] pgmap v1479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:12.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:10.488313+0000 mgr.smithi067.rdualw (mgr.24569) 1716 : cluster [DBG] pgmap v1480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:10.488313+0000 mgr.smithi067.rdualw (mgr.24569) 1716 : cluster [DBG] pgmap v1480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:12.488940+0000 mgr.smithi067.rdualw (mgr.24569) 1717 : cluster [DBG] pgmap v1481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:12.488940+0000 mgr.smithi067.rdualw (mgr.24569) 1717 : cluster [DBG] pgmap v1481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:14.489589+0000 mgr.smithi067.rdualw (mgr.24569) 1718 : cluster [DBG] pgmap v1482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:14.489589+0000 mgr.smithi067.rdualw (mgr.24569) 1718 : cluster [DBG] pgmap v1482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:16.490417+0000 mgr.smithi067.rdualw (mgr.24569) 1719 : cluster [DBG] pgmap v1483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:18:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:16.490417+0000 mgr.smithi067.rdualw (mgr.24569) 1719 : cluster [DBG] pgmap v1483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:18:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:18.490990+0000 mgr.smithi067.rdualw (mgr.24569) 1720 : cluster [DBG] pgmap v1484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:18.490990+0000 mgr.smithi067.rdualw (mgr.24569) 1720 : cluster [DBG] pgmap v1484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:20.491850+0000 mgr.smithi067.rdualw (mgr.24569) 1721 : cluster [DBG] pgmap v1485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:20.491850+0000 mgr.smithi067.rdualw (mgr.24569) 1721 : cluster [DBG] pgmap v1485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:22.492389+0000 mgr.smithi067.rdualw (mgr.24569) 1722 : cluster [DBG] pgmap v1486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:22.492389+0000 mgr.smithi067.rdualw (mgr.24569) 1722 : cluster [DBG] pgmap v1486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:24.492985+0000 mgr.smithi067.rdualw (mgr.24569) 1723 : cluster [DBG] pgmap v1487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:24.492985+0000 mgr.smithi067.rdualw (mgr.24569) 1723 : cluster [DBG] pgmap v1487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:26.493815+0000 mgr.smithi067.rdualw (mgr.24569) 1724 : cluster [DBG] pgmap v1488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:18:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:26.493815+0000 mgr.smithi067.rdualw (mgr.24569) 1724 : cluster [DBG] pgmap v1488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:18:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:28.494521+0000 mgr.smithi067.rdualw (mgr.24569) 1725 : cluster [DBG] pgmap v1489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:28.494521+0000 mgr.smithi067.rdualw (mgr.24569) 1725 : cluster [DBG] pgmap v1489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:30.495436+0000 mgr.smithi067.rdualw (mgr.24569) 1726 : cluster [DBG] pgmap v1490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:30.495436+0000 mgr.smithi067.rdualw (mgr.24569) 1726 : cluster [DBG] pgmap v1490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:32.496140+0000 mgr.smithi067.rdualw (mgr.24569) 1727 : cluster [DBG] pgmap v1491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:32.496140+0000 mgr.smithi067.rdualw (mgr.24569) 1727 : cluster [DBG] pgmap v1491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:34.496694+0000 mgr.smithi067.rdualw (mgr.24569) 1728 : cluster [DBG] pgmap v1492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:18:34.689602+0000 mon.smithi067 (mon.1) 299 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:18:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:18:34.689920+0000 mon.smithi067 (mon.1) 300 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:18:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:18:34.689938+0000 mon.smithi061 (mon.0) 539 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:18:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:18:34.690195+0000 mon.smithi061 (mon.0) 540 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:18:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:34.496694+0000 mgr.smithi067.rdualw (mgr.24569) 1728 : cluster [DBG] pgmap v1492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:18:34.689602+0000 mon.smithi067 (mon.1) 299 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:18:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:18:34.689920+0000 mon.smithi067 (mon.1) 300 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:18:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:18:34.689938+0000 mon.smithi061 (mon.0) 539 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:18:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:18:34.690195+0000 mon.smithi061 (mon.0) 540 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:18:36.730 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:18:37.022 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:18:37.022 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (56m) 7m ago 57m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:18:37.023 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (48m) 7m ago 57m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:18:37.023 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (48m) 7m ago 56m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:18:37.023 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (56m) 7m ago 57m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:18:37.023 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (49m) 7m ago 52m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:18:37.024 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (49m) 7m ago 52m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:18:37.024 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (50m) 7m ago 58m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:18:37.024 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (49m) 7m ago 56m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:18:37.024 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (49m) 7m ago 58m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:18:37.024 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (49m) 7m ago 56m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:18:37.025 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (50m) 7m ago 50m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:18:37.025 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (50m) 7m ago 50m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:18:37.025 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (56m) 7m ago 56m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:18:37.025 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (56m) 7m ago 56m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:18:37.026 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (39m) 7m ago 56m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:18:37.026 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (55m) 7m ago 55m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:18:37.026 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (55m) 7m ago 55m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:18:37.026 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (55m) 7m ago 55m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:18:37.026 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (54m) 7m ago 54m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:18:37.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (54m) 7m ago 54m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:18:37.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (54m) 7m ago 54m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:18:37.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (54m) 7m ago 54m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:18:37.027 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (55m) 7m ago 56m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:18:37.362 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:18:37.362 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:18:37.363 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:18:37.363 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:18:37.363 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:18:37.363 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:18:37.364 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:18:37.364 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:18:37.364 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:18:37.365 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:18:37.365 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:18:37.365 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:18:37.365 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:18:37.366 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:18:37.366 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:18:37.366 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:18:37.366 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:18:37.367 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:18:37.367 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:18:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:36.497596+0000 mgr.smithi067.rdualw (mgr.24569) 1729 : cluster [DBG] pgmap v1493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:18:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:18:36.717185+0000 mgr.smithi067.rdualw (mgr.24569) 1730 : audit [DBG] from='client.35290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:18:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:18:37.004616+0000 mgr.smithi067.rdualw (mgr.24569) 1731 : audit [DBG] from='client.35294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:18:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:18:37.360766+0000 mon.smithi061 (mon.0) 541 : audit [DBG] from='client.? 172.21.15.61:0/408985632' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:18:38.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:36.497596+0000 mgr.smithi067.rdualw (mgr.24569) 1729 : cluster [DBG] pgmap v1493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:18:38.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:18:36.717185+0000 mgr.smithi067.rdualw (mgr.24569) 1730 : audit [DBG] from='client.35290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:18:38.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:18:37.004616+0000 mgr.smithi067.rdualw (mgr.24569) 1731 : audit [DBG] from='client.35294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:18:38.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:18:37.360766+0000 mon.smithi061 (mon.0) 541 : audit [DBG] from='client.? 172.21.15.61:0/408985632' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:18:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:38.498089+0000 mgr.smithi067.rdualw (mgr.24569) 1732 : cluster [DBG] pgmap v1494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:38.498089+0000 mgr.smithi067.rdualw (mgr.24569) 1732 : cluster [DBG] pgmap v1494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:40.498975+0000 mgr.smithi067.rdualw (mgr.24569) 1733 : cluster [DBG] pgmap v1495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:40.498975+0000 mgr.smithi067.rdualw (mgr.24569) 1733 : cluster [DBG] pgmap v1495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:42.499720+0000 mgr.smithi067.rdualw (mgr.24569) 1734 : cluster [DBG] pgmap v1496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:42.499720+0000 mgr.smithi067.rdualw (mgr.24569) 1734 : cluster [DBG] pgmap v1496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:44.500404+0000 mgr.smithi067.rdualw (mgr.24569) 1735 : cluster [DBG] pgmap v1497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:44.500404+0000 mgr.smithi067.rdualw (mgr.24569) 1735 : cluster [DBG] pgmap v1497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:46.501242+0000 mgr.smithi067.rdualw (mgr.24569) 1736 : cluster [DBG] pgmap v1498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:18:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:46.501242+0000 mgr.smithi067.rdualw (mgr.24569) 1736 : cluster [DBG] pgmap v1498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:18:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:48.501904+0000 mgr.smithi067.rdualw (mgr.24569) 1737 : cluster [DBG] pgmap v1499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:48.501904+0000 mgr.smithi067.rdualw (mgr.24569) 1737 : cluster [DBG] pgmap v1499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:50.502886+0000 mgr.smithi067.rdualw (mgr.24569) 1738 : cluster [DBG] pgmap v1500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:50.502886+0000 mgr.smithi067.rdualw (mgr.24569) 1738 : cluster [DBG] pgmap v1500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:52.503395+0000 mgr.smithi067.rdualw (mgr.24569) 1739 : cluster [DBG] pgmap v1501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:52.503395+0000 mgr.smithi067.rdualw (mgr.24569) 1739 : cluster [DBG] pgmap v1501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:54.504049+0000 mgr.smithi067.rdualw (mgr.24569) 1740 : cluster [DBG] pgmap v1502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:54.504049+0000 mgr.smithi067.rdualw (mgr.24569) 1740 : cluster [DBG] pgmap v1502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:18:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:56.504956+0000 mgr.smithi067.rdualw (mgr.24569) 1741 : cluster [DBG] pgmap v1503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:18:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:56.504956+0000 mgr.smithi067.rdualw (mgr.24569) 1741 : cluster [DBG] pgmap v1503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:19:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:18:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:18:58.505637+0000 mgr.smithi067.rdualw (mgr.24569) 1742 : cluster [DBG] pgmap v1504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:18:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:18:58.505637+0000 mgr.smithi067.rdualw (mgr.24569) 1742 : cluster [DBG] pgmap v1504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:00.506590+0000 mgr.smithi067.rdualw (mgr.24569) 1743 : cluster [DBG] pgmap v1505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:00.506590+0000 mgr.smithi067.rdualw (mgr.24569) 1743 : cluster [DBG] pgmap v1505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:02.507142+0000 mgr.smithi067.rdualw (mgr.24569) 1744 : cluster [DBG] pgmap v1506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:02.507142+0000 mgr.smithi067.rdualw (mgr.24569) 1744 : cluster [DBG] pgmap v1506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:04.507719+0000 mgr.smithi067.rdualw (mgr.24569) 1745 : cluster [DBG] pgmap v1507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:04.507719+0000 mgr.smithi067.rdualw (mgr.24569) 1745 : cluster [DBG] pgmap v1507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:07.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:19:06.082842+0000 mon.smithi067 (mon.1) 301 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:19:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:19:06.084350+0000 mon.smithi067 (mon.1) 302 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:19:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:19:06.085304+0000 mon.smithi067 (mon.1) 303 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:19:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:19:06.086166+0000 mgr.smithi067.rdualw (mgr.24569) 1746 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:19:07.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:19:06.501569+0000 mon.smithi061 (mon.0) 542 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:19:07.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:19:06.506891+0000 mon.smithi061 (mon.0) 543 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:19:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:19:06.082842+0000 mon.smithi067 (mon.1) 301 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:19:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:19:06.084350+0000 mon.smithi067 (mon.1) 302 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:19:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:19:06.085304+0000 mon.smithi067 (mon.1) 303 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:19:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:19:06.086166+0000 mgr.smithi067.rdualw (mgr.24569) 1746 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:19:07.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:19:06.501569+0000 mon.smithi061 (mon.0) 542 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:19:07.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:19:06.506891+0000 mon.smithi061 (mon.0) 543 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:19:07.669 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:19:07.962 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:19:07.963 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (56m) 8m ago 57m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:19:07.963 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (49m) 8m ago 57m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:19:07.963 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (49m) 8m ago 57m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:19:07.964 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (56m) 8m ago 57m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:19:07.964 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (49m) 8m ago 53m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:19:07.964 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (49m) 8m ago 53m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:19:07.964 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (50m) 8m ago 58m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:19:07.965 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (50m) 8m ago 57m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:19:07.965 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (50m) 8m ago 59m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:19:07.965 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (50m) 8m ago 57m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:19:07.965 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (51m) 8m ago 51m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:19:07.965 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (51m) 8m ago 51m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:19:07.966 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (57m) 8m ago 57m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:19:07.966 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (56m) 8m ago 56m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:19:07.966 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (40m) 8m ago 56m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:19:07.966 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (56m) 8m ago 56m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:19:07.967 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (56m) 8m ago 56m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:19:07.967 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (55m) 8m ago 55m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:19:07.967 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (55m) 8m ago 55m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:19:07.967 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (55m) 8m ago 55m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:19:07.967 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (55m) 8m ago 55m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:19:07.968 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (54m) 8m ago 54m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:19:07.968 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (56m) 8m ago 57m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:19:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:06.508709+0000 mgr.smithi067.rdualw (mgr.24569) 1747 : cluster [DBG] pgmap v1508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:19:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:06.508709+0000 mgr.smithi067.rdualw (mgr.24569) 1747 : cluster [DBG] pgmap v1508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:19:08.305 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:19:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:19:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:19:08.306 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:19:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:19:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:19:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:19:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:19:08.307 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:19:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:19:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:19:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:19:08.308 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:19:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:19:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:19:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:19:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:19:08.309 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:19:08.310 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:19:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:19:07.655767+0000 mgr.smithi067.rdualw (mgr.24569) 1748 : audit [DBG] from='client.35302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:19:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:19:07.944397+0000 mgr.smithi067.rdualw (mgr.24569) 1749 : audit [DBG] from='client.35306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:19:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:19:08.304309+0000 mon.smithi061 (mon.0) 544 : audit [DBG] from='client.? 172.21.15.61:0/1042582247' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:19:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:19:07.655767+0000 mgr.smithi067.rdualw (mgr.24569) 1748 : audit [DBG] from='client.35302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:19:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:19:07.944397+0000 mgr.smithi067.rdualw (mgr.24569) 1749 : audit [DBG] from='client.35306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:19:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:19:08.304309+0000 mon.smithi061 (mon.0) 544 : audit [DBG] from='client.? 172.21.15.61:0/1042582247' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:19:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:08.509273+0000 mgr.smithi067.rdualw (mgr.24569) 1750 : cluster [DBG] pgmap v1509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:08.509273+0000 mgr.smithi067.rdualw (mgr.24569) 1750 : cluster [DBG] pgmap v1509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:10.510134+0000 mgr.smithi067.rdualw (mgr.24569) 1751 : cluster [DBG] pgmap v1510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:10.510134+0000 mgr.smithi067.rdualw (mgr.24569) 1751 : cluster [DBG] pgmap v1510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:12.510654+0000 mgr.smithi067.rdualw (mgr.24569) 1752 : cluster [DBG] pgmap v1511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:12.510654+0000 mgr.smithi067.rdualw (mgr.24569) 1752 : cluster [DBG] pgmap v1511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:14.511345+0000 mgr.smithi067.rdualw (mgr.24569) 1753 : cluster [DBG] pgmap v1512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:14.511345+0000 mgr.smithi067.rdualw (mgr.24569) 1753 : cluster [DBG] pgmap v1512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:16.512436+0000 mgr.smithi067.rdualw (mgr.24569) 1754 : cluster [DBG] pgmap v1513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:19:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:16.512436+0000 mgr.smithi067.rdualw (mgr.24569) 1754 : cluster [DBG] pgmap v1513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:19:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:18.513012+0000 mgr.smithi067.rdualw (mgr.24569) 1755 : cluster [DBG] pgmap v1514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:18.513012+0000 mgr.smithi067.rdualw (mgr.24569) 1755 : cluster [DBG] pgmap v1514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:20.513987+0000 mgr.smithi067.rdualw (mgr.24569) 1756 : cluster [DBG] pgmap v1515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:20.513987+0000 mgr.smithi067.rdualw (mgr.24569) 1756 : cluster [DBG] pgmap v1515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:24.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:22.514689+0000 mgr.smithi067.rdualw (mgr.24569) 1757 : cluster [DBG] pgmap v1516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:22.514689+0000 mgr.smithi067.rdualw (mgr.24569) 1757 : cluster [DBG] pgmap v1516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:24.515314+0000 mgr.smithi067.rdualw (mgr.24569) 1758 : cluster [DBG] pgmap v1517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:24.515314+0000 mgr.smithi067.rdualw (mgr.24569) 1758 : cluster [DBG] pgmap v1517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:26.516275+0000 mgr.smithi067.rdualw (mgr.24569) 1759 : cluster [DBG] pgmap v1518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:19:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:26.516275+0000 mgr.smithi067.rdualw (mgr.24569) 1759 : cluster [DBG] pgmap v1518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:19:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:28.517035+0000 mgr.smithi067.rdualw (mgr.24569) 1760 : cluster [DBG] pgmap v1519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:28.517035+0000 mgr.smithi067.rdualw (mgr.24569) 1760 : cluster [DBG] pgmap v1519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:30.517884+0000 mgr.smithi067.rdualw (mgr.24569) 1761 : cluster [DBG] pgmap v1520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:30.517884+0000 mgr.smithi067.rdualw (mgr.24569) 1761 : cluster [DBG] pgmap v1520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:34.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:32.518478+0000 mgr.smithi067.rdualw (mgr.24569) 1762 : cluster [DBG] pgmap v1521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:32.518478+0000 mgr.smithi067.rdualw (mgr.24569) 1762 : cluster [DBG] pgmap v1521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:34.519012+0000 mgr.smithi067.rdualw (mgr.24569) 1763 : cluster [DBG] pgmap v1522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:19:34.694508+0000 mon.smithi067 (mon.1) 304 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:19:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:19:34.694825+0000 mon.smithi061 (mon.0) 545 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:19:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:19:34.694842+0000 mon.smithi067 (mon.1) 305 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:19:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:19:34.695181+0000 mon.smithi061 (mon.0) 546 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:19:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:34.519012+0000 mgr.smithi067.rdualw (mgr.24569) 1763 : cluster [DBG] pgmap v1522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:19:34.694508+0000 mon.smithi067 (mon.1) 304 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:19:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:19:34.694825+0000 mon.smithi061 (mon.0) 545 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:19:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:19:34.694842+0000 mon.smithi067 (mon.1) 305 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:19:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:19:34.695181+0000 mon.smithi061 (mon.0) 546 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:19:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:36.519970+0000 mgr.smithi067.rdualw (mgr.24569) 1764 : cluster [DBG] pgmap v1523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:19:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:36.519970+0000 mgr.smithi067.rdualw (mgr.24569) 1764 : cluster [DBG] pgmap v1523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:19:38.611 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:19:38.903 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:19:38.903 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (57m) 8m ago 58m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:19:38.904 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (49m) 8m ago 58m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:19:38.904 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (49m) 8m ago 57m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:19:38.904 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (57m) 8m ago 58m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:19:38.904 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (50m) 8m ago 53m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:19:38.905 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (50m) 8m ago 53m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:19:38.905 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (51m) 8m ago 59m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:19:38.905 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (50m) 8m ago 57m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:19:38.905 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (50m) 8m ago 59m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:19:38.905 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (50m) 8m ago 57m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:19:38.906 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (51m) 8m ago 51m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:19:38.906 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (51m) 8m ago 51m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:19:38.906 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (58m) 8m ago 58m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:19:38.907 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (57m) 8m ago 57m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:19:38.907 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (40m) 8m ago 57m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:19:38.907 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (56m) 8m ago 56m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:19:38.907 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (56m) 8m ago 56m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:19:38.908 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (56m) 8m ago 56m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:19:38.908 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (56m) 8m ago 56m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:19:38.908 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (55m) 8m ago 55m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:19:38.908 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (55m) 8m ago 55m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:19:38.908 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (55m) 8m ago 55m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:19:38.909 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (56m) 8m ago 57m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:19:39.241 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:19:39.241 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:19:39.242 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:19:39.242 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:19:39.242 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:19:39.242 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:19:39.243 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:19:39.243 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:19:39.243 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:19:39.243 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:19:39.243 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:19:39.244 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:19:39.244 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:19:39.244 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:19:39.244 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:19:39.245 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:19:39.245 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:19:39.245 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:19:39.245 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:19:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:38.520576+0000 mgr.smithi067.rdualw (mgr.24569) 1765 : cluster [DBG] pgmap v1524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:19:38.597907+0000 mgr.smithi067.rdualw (mgr.24569) 1766 : audit [DBG] from='client.35314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:19:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:19:38.885289+0000 mgr.smithi067.rdualw (mgr.24569) 1767 : audit [DBG] from='client.35318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:19:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:19:39.239913+0000 mon.smithi061 (mon.0) 547 : audit [DBG] from='client.? 172.21.15.61:0/4120370606' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:19:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:38.520576+0000 mgr.smithi067.rdualw (mgr.24569) 1765 : cluster [DBG] pgmap v1524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:19:38.597907+0000 mgr.smithi067.rdualw (mgr.24569) 1766 : audit [DBG] from='client.35314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:19:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:19:38.885289+0000 mgr.smithi067.rdualw (mgr.24569) 1767 : audit [DBG] from='client.35318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:19:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:19:39.239913+0000 mon.smithi061 (mon.0) 547 : audit [DBG] from='client.? 172.21.15.61:0/4120370606' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:19:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:40.521463+0000 mgr.smithi067.rdualw (mgr.24569) 1768 : cluster [DBG] pgmap v1525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:40.521463+0000 mgr.smithi067.rdualw (mgr.24569) 1768 : cluster [DBG] pgmap v1525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:42.522002+0000 mgr.smithi067.rdualw (mgr.24569) 1769 : cluster [DBG] pgmap v1526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:42.522002+0000 mgr.smithi067.rdualw (mgr.24569) 1769 : cluster [DBG] pgmap v1526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:44.522650+0000 mgr.smithi067.rdualw (mgr.24569) 1770 : cluster [DBG] pgmap v1527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:44.522650+0000 mgr.smithi067.rdualw (mgr.24569) 1770 : cluster [DBG] pgmap v1527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:46.523737+0000 mgr.smithi067.rdualw (mgr.24569) 1771 : cluster [DBG] pgmap v1528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:19:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:46.523737+0000 mgr.smithi067.rdualw (mgr.24569) 1771 : cluster [DBG] pgmap v1528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:19:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:48.524257+0000 mgr.smithi067.rdualw (mgr.24569) 1772 : cluster [DBG] pgmap v1529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:48.524257+0000 mgr.smithi067.rdualw (mgr.24569) 1772 : cluster [DBG] pgmap v1529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:50.525201+0000 mgr.smithi067.rdualw (mgr.24569) 1773 : cluster [DBG] pgmap v1530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:52.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:50.525201+0000 mgr.smithi067.rdualw (mgr.24569) 1773 : cluster [DBG] pgmap v1530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:52.525789+0000 mgr.smithi067.rdualw (mgr.24569) 1774 : cluster [DBG] pgmap v1531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:52.525789+0000 mgr.smithi067.rdualw (mgr.24569) 1774 : cluster [DBG] pgmap v1531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:54.526472+0000 mgr.smithi067.rdualw (mgr.24569) 1775 : cluster [DBG] pgmap v1532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:54.526472+0000 mgr.smithi067.rdualw (mgr.24569) 1775 : cluster [DBG] pgmap v1532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:19:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:56.527274+0000 mgr.smithi067.rdualw (mgr.24569) 1776 : cluster [DBG] pgmap v1533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:19:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:56.527274+0000 mgr.smithi067.rdualw (mgr.24569) 1776 : cluster [DBG] pgmap v1533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:20:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:19:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:19:58.527857+0000 mgr.smithi067.rdualw (mgr.24569) 1777 : cluster [DBG] pgmap v1534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:19:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:19:58.527857+0000 mgr.smithi067.rdualw (mgr.24569) 1777 : cluster [DBG] pgmap v1534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:00.000179+0000 mon.smithi061 (mon.0) 548 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T16:20:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:00.000179+0000 mon.smithi061 (mon.0) 548 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T16:20:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:00.528762+0000 mgr.smithi067.rdualw (mgr.24569) 1778 : cluster [DBG] pgmap v1535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:00.528762+0000 mgr.smithi067.rdualw (mgr.24569) 1778 : cluster [DBG] pgmap v1535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:02.529289+0000 mgr.smithi067.rdualw (mgr.24569) 1779 : cluster [DBG] pgmap v1536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:02.529289+0000 mgr.smithi067.rdualw (mgr.24569) 1779 : cluster [DBG] pgmap v1536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:04.530064+0000 mgr.smithi067.rdualw (mgr.24569) 1780 : cluster [DBG] pgmap v1537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:04.530064+0000 mgr.smithi067.rdualw (mgr.24569) 1780 : cluster [DBG] pgmap v1537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:20:06.512784+0000 mon.smithi067 (mon.1) 306 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:20:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:20:06.514339+0000 mon.smithi067 (mon.1) 307 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:20:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:20:06.515406+0000 mon.smithi067 (mon.1) 308 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:20:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:20:06.512784+0000 mon.smithi067 (mon.1) 306 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:20:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:20:06.514339+0000 mon.smithi067 (mon.1) 307 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:20:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:20:06.515406+0000 mon.smithi067 (mon.1) 308 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:20:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:20:06.516265+0000 mgr.smithi067.rdualw (mgr.24569) 1781 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:20:08.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:06.531089+0000 mgr.smithi067.rdualw (mgr.24569) 1782 : cluster [DBG] pgmap v1538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:20:08.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:20:06.939978+0000 mon.smithi061 (mon.0) 549 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:20:08.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:20:06.945464+0000 mon.smithi061 (mon.0) 550 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:20:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:20:06.516265+0000 mgr.smithi067.rdualw (mgr.24569) 1781 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:20:08.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:06.531089+0000 mgr.smithi067.rdualw (mgr.24569) 1782 : cluster [DBG] pgmap v1538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:20:08.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:20:06.939978+0000 mon.smithi061 (mon.0) 549 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:20:08.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:20:06.945464+0000 mon.smithi061 (mon.0) 550 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:20:09.549 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:20:09.841 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:20:09.842 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (57m) 9m ago 58m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:20:09.842 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (50m) 9m ago 58m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:20:09.842 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (50m) 9m ago 58m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:20:09.842 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (57m) 9m ago 58m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:20:09.843 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (50m) 9m ago 54m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:20:09.843 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (50m) 9m ago 54m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:20:09.843 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (51m) 9m ago 59m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:20:09.843 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (51m) 9m ago 58m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:20:09.844 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (51m) 9m ago 60m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:20:09.844 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (51m) 9m ago 58m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:20:09.844 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (52m) 9m ago 52m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:20:09.844 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (52m) 9m ago 52m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:20:09.844 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (58m) 9m ago 58m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:20:09.845 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (57m) 9m ago 57m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:20:09.845 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (41m) 9m ago 57m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:20:09.845 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (57m) 9m ago 57m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:20:09.845 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (57m) 9m ago 57m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:20:09.846 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (56m) 9m ago 56m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:20:09.846 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (56m) 9m ago 56m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:20:09.846 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (56m) 9m ago 56m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:20:09.846 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (56m) 9m ago 56m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:20:09.846 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (55m) 9m ago 55m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:20:09.847 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (57m) 9m ago 58m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:20:10.189 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:20:10.190 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:20:10.190 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:20:10.190 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:20:10.191 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:20:10.191 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:20:10.191 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:20:10.191 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:20:10.191 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:20:10.192 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:20:10.192 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:20:10.192 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:20:10.192 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:20:10.193 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:20:10.193 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:20:10.193 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:20:10.193 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:20:10.194 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:20:10.194 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:20:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:08.531661+0000 mgr.smithi067.rdualw (mgr.24569) 1783 : cluster [DBG] pgmap v1539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:10.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:08.531661+0000 mgr.smithi067.rdualw (mgr.24569) 1783 : cluster [DBG] pgmap v1539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:20:09.535530+0000 mgr.smithi067.rdualw (mgr.24569) 1784 : audit [DBG] from='client.35326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:20:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:20:09.822847+0000 mgr.smithi067.rdualw (mgr.24569) 1785 : audit [DBG] from='client.35330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:20:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:20:10.188097+0000 mon.smithi061 (mon.0) 551 : audit [DBG] from='client.? 172.21.15.61:0/1796880745' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:20:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:20:09.535530+0000 mgr.smithi067.rdualw (mgr.24569) 1784 : audit [DBG] from='client.35326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:20:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:20:09.822847+0000 mgr.smithi067.rdualw (mgr.24569) 1785 : audit [DBG] from='client.35330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:20:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:20:10.188097+0000 mon.smithi061 (mon.0) 551 : audit [DBG] from='client.? 172.21.15.61:0/1796880745' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:20:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:10.532442+0000 mgr.smithi067.rdualw (mgr.24569) 1786 : cluster [DBG] pgmap v1540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:10.532442+0000 mgr.smithi067.rdualw (mgr.24569) 1786 : cluster [DBG] pgmap v1540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:14.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:12.532961+0000 mgr.smithi067.rdualw (mgr.24569) 1787 : cluster [DBG] pgmap v1541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:14.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:12.532961+0000 mgr.smithi067.rdualw (mgr.24569) 1787 : cluster [DBG] pgmap v1541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:16.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:14.533590+0000 mgr.smithi067.rdualw (mgr.24569) 1788 : cluster [DBG] pgmap v1542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:16.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:14.533590+0000 mgr.smithi067.rdualw (mgr.24569) 1788 : cluster [DBG] pgmap v1542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:16.534729+0000 mgr.smithi067.rdualw (mgr.24569) 1789 : cluster [DBG] pgmap v1543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:20:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:16.534729+0000 mgr.smithi067.rdualw (mgr.24569) 1789 : cluster [DBG] pgmap v1543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:20:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:18.535364+0000 mgr.smithi067.rdualw (mgr.24569) 1790 : cluster [DBG] pgmap v1544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:18.535364+0000 mgr.smithi067.rdualw (mgr.24569) 1790 : cluster [DBG] pgmap v1544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:20.536269+0000 mgr.smithi067.rdualw (mgr.24569) 1791 : cluster [DBG] pgmap v1545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:20.536269+0000 mgr.smithi067.rdualw (mgr.24569) 1791 : cluster [DBG] pgmap v1545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:22.536994+0000 mgr.smithi067.rdualw (mgr.24569) 1792 : cluster [DBG] pgmap v1546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:22.536994+0000 mgr.smithi067.rdualw (mgr.24569) 1792 : cluster [DBG] pgmap v1546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:24.537634+0000 mgr.smithi067.rdualw (mgr.24569) 1793 : cluster [DBG] pgmap v1547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:24.537634+0000 mgr.smithi067.rdualw (mgr.24569) 1793 : cluster [DBG] pgmap v1547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:26.538570+0000 mgr.smithi067.rdualw (mgr.24569) 1794 : cluster [DBG] pgmap v1548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:20:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:26.538570+0000 mgr.smithi067.rdualw (mgr.24569) 1794 : cluster [DBG] pgmap v1548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:20:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:28.539311+0000 mgr.smithi067.rdualw (mgr.24569) 1795 : cluster [DBG] pgmap v1549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:28.539311+0000 mgr.smithi067.rdualw (mgr.24569) 1795 : cluster [DBG] pgmap v1549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:30.540126+0000 mgr.smithi067.rdualw (mgr.24569) 1796 : cluster [DBG] pgmap v1550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:30.540126+0000 mgr.smithi067.rdualw (mgr.24569) 1796 : cluster [DBG] pgmap v1550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:32.540656+0000 mgr.smithi067.rdualw (mgr.24569) 1797 : cluster [DBG] pgmap v1551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:32.540656+0000 mgr.smithi067.rdualw (mgr.24569) 1797 : cluster [DBG] pgmap v1551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:34.541362+0000 mgr.smithi067.rdualw (mgr.24569) 1798 : cluster [DBG] pgmap v1552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:20:34.700621+0000 mon.smithi067 (mon.1) 309 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:20:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:20:34.700927+0000 mon.smithi067 (mon.1) 310 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:20:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:20:34.700987+0000 mon.smithi061 (mon.0) 552 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:20:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:20:34.701311+0000 mon.smithi061 (mon.0) 553 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:20:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:34.541362+0000 mgr.smithi067.rdualw (mgr.24569) 1798 : cluster [DBG] pgmap v1552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:20:34.700621+0000 mon.smithi067 (mon.1) 309 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:20:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:20:34.700927+0000 mon.smithi067 (mon.1) 310 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:20:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:20:34.700987+0000 mon.smithi061 (mon.0) 552 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:20:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:20:34.701311+0000 mon.smithi061 (mon.0) 553 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:20:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:36.542265+0000 mgr.smithi067.rdualw (mgr.24569) 1799 : cluster [DBG] pgmap v1553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:20:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:36.542265+0000 mgr.smithi067.rdualw (mgr.24569) 1799 : cluster [DBG] pgmap v1553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:20:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:38.542742+0000 mgr.smithi067.rdualw (mgr.24569) 1800 : cluster [DBG] pgmap v1554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:38.542742+0000 mgr.smithi067.rdualw (mgr.24569) 1800 : cluster [DBG] pgmap v1554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:40.495 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:20:40.791 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:20:40.791 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (58m) 9m ago 59m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:20:40.792 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (50m) 9m ago 59m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:20:40.792 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (50m) 9m ago 58m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:20:40.792 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (58m) 9m ago 59m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:20:40.792 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (51m) 9m ago 54m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:20:40.793 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (51m) 9m ago 54m 21.7M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:20:40.793 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (52m) 9m ago 60m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:20:40.793 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (52m) 9m ago 58m 477M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:20:40.793 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (51m) 9m ago 60m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:20:40.793 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (51m) 9m ago 58m 217M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:20:40.794 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (52m) 9m ago 52m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:20:40.794 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (52m) 9m ago 52m 97.6M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:20:40.794 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (59m) 9m ago 59m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:20:40.794 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (58m) 9m ago 58m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:20:40.795 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (41m) 9m ago 58m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:20:40.795 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (57m) 9m ago 57m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:20:40.795 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (57m) 9m ago 57m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:20:40.795 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (57m) 9m ago 57m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:20:40.795 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (57m) 9m ago 57m 1303M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:20:40.796 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (56m) 9m ago 56m 1562M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:20:40.796 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (56m) 9m ago 56m 1210M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:20:40.796 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (56m) 9m ago 56m 2026M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:20:40.796 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (58m) 9m ago 58m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:20:41.130 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:20:41.130 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:20:41.130 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:20:41.131 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:20:41.131 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:20:41.131 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:20:41.131 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:20:41.132 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:20:41.132 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:20:41.132 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:20:41.132 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:20:41.132 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:20:41.133 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:20:41.133 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:20:41.133 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:20:41.133 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:20:41.134 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:20:41.134 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:20:41.134 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:20:42.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:20:40.482358+0000 mgr.smithi067.rdualw (mgr.24569) 1801 : audit [DBG] from='client.35338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:20:42.135 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:40.543506+0000 mgr.smithi067.rdualw (mgr.24569) 1802 : cluster [DBG] pgmap v1555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:42.136 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:20:40.773609+0000 mgr.smithi067.rdualw (mgr.24569) 1803 : audit [DBG] from='client.35342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:20:42.136 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:20:41.128633+0000 mon.smithi061 (mon.0) 554 : audit [DBG] from='client.? 172.21.15.61:0/3209339450' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:20:42.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:20:40.482358+0000 mgr.smithi067.rdualw (mgr.24569) 1801 : audit [DBG] from='client.35338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:20:42.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:40.543506+0000 mgr.smithi067.rdualw (mgr.24569) 1802 : cluster [DBG] pgmap v1555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:42.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:20:40.773609+0000 mgr.smithi067.rdualw (mgr.24569) 1803 : audit [DBG] from='client.35342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:20:42.137 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:20:41.128633+0000 mon.smithi061 (mon.0) 554 : audit [DBG] from='client.? 172.21.15.61:0/3209339450' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:20:44.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:42.544259+0000 mgr.smithi067.rdualw (mgr.24569) 1804 : cluster [DBG] pgmap v1556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:44.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:42.544259+0000 mgr.smithi067.rdualw (mgr.24569) 1804 : cluster [DBG] pgmap v1556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:44.544910+0000 mgr.smithi067.rdualw (mgr.24569) 1805 : cluster [DBG] pgmap v1557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:44.544910+0000 mgr.smithi067.rdualw (mgr.24569) 1805 : cluster [DBG] pgmap v1557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:46.545807+0000 mgr.smithi067.rdualw (mgr.24569) 1806 : cluster [DBG] pgmap v1558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:20:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:46.545807+0000 mgr.smithi067.rdualw (mgr.24569) 1806 : cluster [DBG] pgmap v1558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:20:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:48.546518+0000 mgr.smithi067.rdualw (mgr.24569) 1807 : cluster [DBG] pgmap v1559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:48.546518+0000 mgr.smithi067.rdualw (mgr.24569) 1807 : cluster [DBG] pgmap v1559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:50.547315+0000 mgr.smithi067.rdualw (mgr.24569) 1808 : cluster [DBG] pgmap v1560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:50.547315+0000 mgr.smithi067.rdualw (mgr.24569) 1808 : cluster [DBG] pgmap v1560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:52.547923+0000 mgr.smithi067.rdualw (mgr.24569) 1809 : cluster [DBG] pgmap v1561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:52.547923+0000 mgr.smithi067.rdualw (mgr.24569) 1809 : cluster [DBG] pgmap v1561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:54.548482+0000 mgr.smithi067.rdualw (mgr.24569) 1810 : cluster [DBG] pgmap v1562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:54.548482+0000 mgr.smithi067.rdualw (mgr.24569) 1810 : cluster [DBG] pgmap v1562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:20:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:56.549468+0000 mgr.smithi067.rdualw (mgr.24569) 1811 : cluster [DBG] pgmap v1563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:20:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:56.549468+0000 mgr.smithi067.rdualw (mgr.24569) 1811 : cluster [DBG] pgmap v1563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:21:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:20:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:20:58.550108+0000 mgr.smithi067.rdualw (mgr.24569) 1812 : cluster [DBG] pgmap v1564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:20:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:20:58.550108+0000 mgr.smithi067.rdualw (mgr.24569) 1812 : cluster [DBG] pgmap v1564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:00.551070+0000 mgr.smithi067.rdualw (mgr.24569) 1813 : cluster [DBG] pgmap v1565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:00.551070+0000 mgr.smithi067.rdualw (mgr.24569) 1813 : cluster [DBG] pgmap v1565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:02.551580+0000 mgr.smithi067.rdualw (mgr.24569) 1814 : cluster [DBG] pgmap v1566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:04.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:02.551580+0000 mgr.smithi067.rdualw (mgr.24569) 1814 : cluster [DBG] pgmap v1566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:04.552203+0000 mgr.smithi067.rdualw (mgr.24569) 1815 : cluster [DBG] pgmap v1567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:04.552203+0000 mgr.smithi067.rdualw (mgr.24569) 1815 : cluster [DBG] pgmap v1567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:06.553191+0000 mgr.smithi067.rdualw (mgr.24569) 1816 : cluster [DBG] pgmap v1568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:21:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:06.951146+0000 mon.smithi067 (mon.1) 311 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:21:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:06.952668+0000 mon.smithi067 (mon.1) 312 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:21:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:06.953613+0000 mon.smithi067 (mon.1) 313 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:21:08.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:21:06.954447+0000 mgr.smithi067.rdualw (mgr.24569) 1817 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:21:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:06.553191+0000 mgr.smithi067.rdualw (mgr.24569) 1816 : cluster [DBG] pgmap v1568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:21:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:06.951146+0000 mon.smithi067 (mon.1) 311 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:21:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:06.952668+0000 mon.smithi067 (mon.1) 312 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:21:08.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:06.953613+0000 mon.smithi067 (mon.1) 313 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:21:08.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:21:06.954447+0000 mgr.smithi067.rdualw (mgr.24569) 1817 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:21:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:08.553629+0000 mgr.smithi067.rdualw (mgr.24569) 1818 : cluster [DBG] pgmap v1569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:10.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:08.553629+0000 mgr.smithi067.rdualw (mgr.24569) 1818 : cluster [DBG] pgmap v1569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:11.479 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:21:11.799 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:21:11.799 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (58m) 10m ago 59m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:21:11.799 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (51m) 10m ago 59m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:21:11.800 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (51m) 0s ago 59m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:21:11.800 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (58m) 10m ago 59m 40.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:21:11.800 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (51m) 10m ago 55m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:21:11.800 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (51m) 0s ago 55m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:21:11.801 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (52m) 10m ago 60m 443M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:21:11.801 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (52m) 0s ago 59m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:21:11.801 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (52m) 10m ago 61m 347M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:21:11.801 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (52m) 0s ago 59m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:21:11.802 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (53m) 10m ago 53m 174M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:21:11.802 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (53m) 0s ago 53m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:21:11.802 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (59m) 10m ago 59m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:21:11.802 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (59m) 0s ago 58m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:21:11.803 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (42m) 10m ago 58m 509M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:21:11.803 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (58m) 10m ago 58m 1297M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:21:11.803 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (58m) 10m ago 58m 778M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:21:11.803 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (57m) 10m ago 57m 1414M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:21:11.803 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (57m) 0s ago 57m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:21:11.804 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (57m) 0s ago 57m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:21:11.804 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (57m) 0s ago 57m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:21:11.804 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (56m) 0s ago 56m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:21:11.804 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (58m) 10m ago 59m 57.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:21:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:10.554371+0000 mgr.smithi067.rdualw (mgr.24569) 1819 : cluster [DBG] pgmap v1570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:11.649873+0000 mon.smithi061 (mon.0) 555 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:21:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:10.554371+0000 mgr.smithi067.rdualw (mgr.24569) 1819 : cluster [DBG] pgmap v1570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:11.649873+0000 mon.smithi061 (mon.0) 555 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:21:12.184 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:21:12.184 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:21:12.185 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:21:12.185 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:21:12.186 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:21:12.186 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:21:12.187 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:21:12.187 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:21:12.188 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:21:12.188 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:21:12.188 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:21:12.189 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:21:12.189 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:21:12.190 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:21:12.191 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:21:12.191 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:21:12.192 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:21:12.192 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:21:12.193 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:21:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:11.456895+0000 mgr.smithi067.rdualw (mgr.24569) 1820 : audit [DBG] from='client.35350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:21:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:11.773792+0000 mgr.smithi067.rdualw (mgr.24569) 1821 : audit [DBG] from='client.35354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:21:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:12.051023+0000 mon.smithi067 (mon.1) 314 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:21:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:12.051364+0000 mon.smithi061 (mon.0) 556 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:21:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:12.181567+0000 mon.smithi061 (mon.0) 557 : audit [DBG] from='client.? 172.21.15.61:0/4065108018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:21:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:11.456895+0000 mgr.smithi067.rdualw (mgr.24569) 1820 : audit [DBG] from='client.35350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:21:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:11.773792+0000 mgr.smithi067.rdualw (mgr.24569) 1821 : audit [DBG] from='client.35354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:21:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:12.051023+0000 mon.smithi067 (mon.1) 314 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:21:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:12.051364+0000 mon.smithi061 (mon.0) 556 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:21:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:12.181567+0000 mon.smithi061 (mon.0) 557 : audit [DBG] from='client.? 172.21.15.61:0/4065108018' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:21:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:12.554858+0000 mgr.smithi067.rdualw (mgr.24569) 1822 : cluster [DBG] pgmap v1571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:12.554858+0000 mgr.smithi067.rdualw (mgr.24569) 1822 : cluster [DBG] pgmap v1571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:14.315754+0000 mon.smithi061 (mon.0) 558 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:21:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:14.722301+0000 mon.smithi067 (mon.1) 315 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:21:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:14.722661+0000 mon.smithi061 (mon.0) 559 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:21:15.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:14.728242+0000 mon.smithi061 (mon.0) 560 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:21:15.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:14.735025+0000 mon.smithi061 (mon.0) 561 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:21:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:14.315754+0000 mon.smithi061 (mon.0) 558 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:21:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:14.722301+0000 mon.smithi067 (mon.1) 315 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:21:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:14.722661+0000 mon.smithi061 (mon.0) 559 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:21:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:14.728242+0000 mon.smithi061 (mon.0) 560 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:21:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:14.735025+0000 mon.smithi061 (mon.0) 561 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:21:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:14.555541+0000 mgr.smithi067.rdualw (mgr.24569) 1823 : cluster [DBG] pgmap v1572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:16.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:14.555541+0000 mgr.smithi067.rdualw (mgr.24569) 1823 : cluster [DBG] pgmap v1572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:16.556627+0000 mgr.smithi067.rdualw (mgr.24569) 1824 : cluster [DBG] pgmap v1573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:21:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:16.556627+0000 mgr.smithi067.rdualw (mgr.24569) 1824 : cluster [DBG] pgmap v1573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:21:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:18.557154+0000 mgr.smithi067.rdualw (mgr.24569) 1825 : cluster [DBG] pgmap v1574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:18.557154+0000 mgr.smithi067.rdualw (mgr.24569) 1825 : cluster [DBG] pgmap v1574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:20.558119+0000 mgr.smithi067.rdualw (mgr.24569) 1826 : cluster [DBG] pgmap v1575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:22.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:20.558119+0000 mgr.smithi067.rdualw (mgr.24569) 1826 : cluster [DBG] pgmap v1575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:22.558720+0000 mgr.smithi067.rdualw (mgr.24569) 1827 : cluster [DBG] pgmap v1576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:22.558720+0000 mgr.smithi067.rdualw (mgr.24569) 1827 : cluster [DBG] pgmap v1576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:24.559374+0000 mgr.smithi067.rdualw (mgr.24569) 1828 : cluster [DBG] pgmap v1577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:26.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:24.559374+0000 mgr.smithi067.rdualw (mgr.24569) 1828 : cluster [DBG] pgmap v1577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:26.560188+0000 mgr.smithi067.rdualw (mgr.24569) 1829 : cluster [DBG] pgmap v1578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:21:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:26.560188+0000 mgr.smithi067.rdualw (mgr.24569) 1829 : cluster [DBG] pgmap v1578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:21:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:28.560715+0000 mgr.smithi067.rdualw (mgr.24569) 1830 : cluster [DBG] pgmap v1579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:28.560715+0000 mgr.smithi067.rdualw (mgr.24569) 1830 : cluster [DBG] pgmap v1579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:30.561593+0000 mgr.smithi067.rdualw (mgr.24569) 1831 : cluster [DBG] pgmap v1580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:30.561593+0000 mgr.smithi067.rdualw (mgr.24569) 1831 : cluster [DBG] pgmap v1580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:32.562197+0000 mgr.smithi067.rdualw (mgr.24569) 1832 : cluster [DBG] pgmap v1581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:32.562197+0000 mgr.smithi067.rdualw (mgr.24569) 1832 : cluster [DBG] pgmap v1581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:34.562914+0000 mgr.smithi067.rdualw (mgr.24569) 1833 : cluster [DBG] pgmap v1582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:34.708711+0000 mon.smithi067 (mon.1) 316 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:21:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:34.708905+0000 mon.smithi061 (mon.0) 562 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:21:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:34.708947+0000 mon.smithi067 (mon.1) 317 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:21:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:34.709229+0000 mon.smithi061 (mon.0) 563 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:21:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:34.562914+0000 mgr.smithi067.rdualw (mgr.24569) 1833 : cluster [DBG] pgmap v1582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:34.708711+0000 mon.smithi067 (mon.1) 316 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:21:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:34.708905+0000 mon.smithi061 (mon.0) 562 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:21:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:34.708947+0000 mon.smithi067 (mon.1) 317 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:21:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:34.709229+0000 mon.smithi061 (mon.0) 563 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:21:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:36.563970+0000 mgr.smithi067.rdualw (mgr.24569) 1834 : cluster [DBG] pgmap v1583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:21:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:36.563970+0000 mgr.smithi067.rdualw (mgr.24569) 1834 : cluster [DBG] pgmap v1583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:21:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:38.564486+0000 mgr.smithi067.rdualw (mgr.24569) 1835 : cluster [DBG] pgmap v1584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:38.564486+0000 mgr.smithi067.rdualw (mgr.24569) 1835 : cluster [DBG] pgmap v1584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:40.565461+0000 mgr.smithi067.rdualw (mgr.24569) 1836 : cluster [DBG] pgmap v1585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:40.565461+0000 mgr.smithi067.rdualw (mgr.24569) 1836 : cluster [DBG] pgmap v1585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:42.491 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:21:42.788 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:21:42.788 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (59m) 28s ago 60m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:21:42.789 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (51m) 28s ago 60m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:21:42.790 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (51m) 31s ago 59m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:21:42.790 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (59m) 28s ago 60m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:21:42.790 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (52m) 28s ago 56m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:21:42.791 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (52m) 31s ago 55m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:21:42.791 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (53m) 28s ago 61m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:21:42.791 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (53m) 31s ago 59m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:21:42.791 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (52m) 28s ago 61m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:21:42.792 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (52m) 31s ago 59m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:21:42.792 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (53m) 28s ago 53m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:21:42.792 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (53m) 31s ago 53m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:21:42.792 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (60m) 28s ago 60m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:21:42.792 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (59m) 31s ago 59m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:21:42.793 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (42m) 28s ago 59m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:21:42.793 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (58m) 28s ago 58m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:21:42.793 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (58m) 28s ago 58m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:21:42.794 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (58m) 28s ago 58m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:21:42.794 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (58m) 31s ago 58m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:21:42.794 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (57m) 31s ago 57m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:21:42.794 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (57m) 31s ago 57m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:21:42.794 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (57m) 31s ago 57m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:21:42.795 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (59m) 28s ago 59m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:21:43.133 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:21:43.133 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:21:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:21:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:21:43.134 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:21:43.135 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:21:43.135 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:21:43.135 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:21:43.136 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:21:43.136 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:21:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:21:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:21:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:21:43.137 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:21:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:21:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:21:43.138 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:21:43.139 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:21:43.139 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:21:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:42.477278+0000 mgr.smithi067.rdualw (mgr.24569) 1837 : audit [DBG] from='client.35362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:21:44.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:42.566129+0000 mgr.smithi067.rdualw (mgr.24569) 1838 : cluster [DBG] pgmap v1586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:44.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:42.770387+0000 mgr.smithi067.rdualw (mgr.24569) 1839 : audit [DBG] from='client.35366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:21:44.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:21:43.131564+0000 mon.smithi061 (mon.0) 564 : audit [DBG] from='client.? 172.21.15.61:0/542045973' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:21:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:42.477278+0000 mgr.smithi067.rdualw (mgr.24569) 1837 : audit [DBG] from='client.35362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:21:44.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:42.566129+0000 mgr.smithi067.rdualw (mgr.24569) 1838 : cluster [DBG] pgmap v1586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:44.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:42.770387+0000 mgr.smithi067.rdualw (mgr.24569) 1839 : audit [DBG] from='client.35366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:21:44.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:21:43.131564+0000 mon.smithi061 (mon.0) 564 : audit [DBG] from='client.? 172.21.15.61:0/542045973' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:21:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:44.566823+0000 mgr.smithi067.rdualw (mgr.24569) 1840 : cluster [DBG] pgmap v1587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:44.566823+0000 mgr.smithi067.rdualw (mgr.24569) 1840 : cluster [DBG] pgmap v1587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:46.568017+0000 mgr.smithi067.rdualw (mgr.24569) 1841 : cluster [DBG] pgmap v1588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:21:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:46.568017+0000 mgr.smithi067.rdualw (mgr.24569) 1841 : cluster [DBG] pgmap v1588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:21:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:48.568618+0000 mgr.smithi067.rdualw (mgr.24569) 1842 : cluster [DBG] pgmap v1589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:48.568618+0000 mgr.smithi067.rdualw (mgr.24569) 1842 : cluster [DBG] pgmap v1589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:50.569616+0000 mgr.smithi067.rdualw (mgr.24569) 1843 : cluster [DBG] pgmap v1590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:50.569616+0000 mgr.smithi067.rdualw (mgr.24569) 1843 : cluster [DBG] pgmap v1590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:52.570308+0000 mgr.smithi067.rdualw (mgr.24569) 1844 : cluster [DBG] pgmap v1591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:52.570308+0000 mgr.smithi067.rdualw (mgr.24569) 1844 : cluster [DBG] pgmap v1591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:54.570935+0000 mgr.smithi067.rdualw (mgr.24569) 1845 : cluster [DBG] pgmap v1592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:54.570935+0000 mgr.smithi067.rdualw (mgr.24569) 1845 : cluster [DBG] pgmap v1592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:21:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:56.571737+0000 mgr.smithi067.rdualw (mgr.24569) 1846 : cluster [DBG] pgmap v1593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:21:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:56.571737+0000 mgr.smithi067.rdualw (mgr.24569) 1846 : cluster [DBG] pgmap v1593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:22:00.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:21:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:21:58.572339+0000 mgr.smithi067.rdualw (mgr.24569) 1847 : cluster [DBG] pgmap v1594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:21:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:21:58.572339+0000 mgr.smithi067.rdualw (mgr.24569) 1847 : cluster [DBG] pgmap v1594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:00.573192+0000 mgr.smithi067.rdualw (mgr.24569) 1848 : cluster [DBG] pgmap v1595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:00.573192+0000 mgr.smithi067.rdualw (mgr.24569) 1848 : cluster [DBG] pgmap v1595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:02.573742+0000 mgr.smithi067.rdualw (mgr.24569) 1849 : cluster [DBG] pgmap v1596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:04.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:02.573742+0000 mgr.smithi067.rdualw (mgr.24569) 1849 : cluster [DBG] pgmap v1596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:04.574295+0000 mgr.smithi067.rdualw (mgr.24569) 1850 : cluster [DBG] pgmap v1597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:04.574295+0000 mgr.smithi067.rdualw (mgr.24569) 1850 : cluster [DBG] pgmap v1597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:06.575302+0000 mgr.smithi067.rdualw (mgr.24569) 1851 : cluster [DBG] pgmap v1598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:22:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:06.575302+0000 mgr.smithi067.rdualw (mgr.24569) 1851 : cluster [DBG] pgmap v1598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:22:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:08.575850+0000 mgr.smithi067.rdualw (mgr.24569) 1852 : cluster [DBG] pgmap v1599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:08.575850+0000 mgr.smithi067.rdualw (mgr.24569) 1852 : cluster [DBG] pgmap v1599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:10.576684+0000 mgr.smithi067.rdualw (mgr.24569) 1853 : cluster [DBG] pgmap v1600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:10.576684+0000 mgr.smithi067.rdualw (mgr.24569) 1853 : cluster [DBG] pgmap v1600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:13.440 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:22:13.735 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:22:13.736 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (59m) 59s ago 60m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:22:13.736 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (52m) 59s ago 60m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:22:13.737 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (52m) 62s ago 60m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:22:13.737 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (59m) 59s ago 60m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:22:13.738 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (52m) 59s ago 56m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:22:13.738 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (52m) 62s ago 56m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:22:13.739 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (53m) 59s ago 62m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:22:13.739 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (53m) 62s ago 60m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:22:13.740 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (53m) 59s ago 62m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:22:13.740 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (53m) 62s ago 60m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:22:13.741 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (54m) 59s ago 54m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:22:13.741 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (54m) 62s ago 54m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:22:13.742 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (60m) 59s ago 60m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:22:13.742 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (60m) 62s ago 60m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:22:13.743 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (43m) 59s ago 59m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:22:13.743 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (59m) 59s ago 59m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:22:13.744 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (59m) 59s ago 59m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:22:13.744 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (58m) 59s ago 58m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:22:13.744 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (58m) 62s ago 58m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:22:13.745 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (58m) 62s ago 58m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:22:13.745 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (58m) 62s ago 58m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:22:13.746 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (57m) 62s ago 57m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:22:13.746 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (59m) 59s ago 60m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:22:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:12.577257+0000 mgr.smithi067.rdualw (mgr.24569) 1854 : cluster [DBG] pgmap v1601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:12.577257+0000 mgr.smithi067.rdualw (mgr.24569) 1854 : cluster [DBG] pgmap v1601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:14.077 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:22:14.078 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:22:14.078 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:22:14.078 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:22:14.078 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:22:14.079 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:22:14.079 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:22:14.079 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:22:14.079 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:22:14.080 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:22:14.080 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:22:14.081 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:22:14.081 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:22:14.081 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:22:14.082 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:22:14.082 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:22:14.082 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:22:14.082 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:22:14.083 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:22:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:22:13.426752+0000 mgr.smithi067.rdualw (mgr.24569) 1855 : audit [DBG] from='client.35374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:22:15.170 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:22:13.717465+0000 mgr.smithi067.rdualw (mgr.24569) 1856 : audit [DBG] from='client.35378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:22:15.171 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:22:14.074751+0000 mon.smithi061 (mon.0) 565 : audit [DBG] from='client.? 172.21.15.61:0/1441643709' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:22:15.171 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:22:14.739267+0000 mon.smithi067 (mon.1) 318 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:22:15.171 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:22:14.740681+0000 mon.smithi067 (mon.1) 319 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:22:15.172 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:22:14.741602+0000 mon.smithi067 (mon.1) 320 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:22:15.172 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:22:13.426752+0000 mgr.smithi067.rdualw (mgr.24569) 1855 : audit [DBG] from='client.35374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:22:15.173 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:22:13.717465+0000 mgr.smithi067.rdualw (mgr.24569) 1856 : audit [DBG] from='client.35378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:22:15.173 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:22:14.074751+0000 mon.smithi061 (mon.0) 565 : audit [DBG] from='client.? 172.21.15.61:0/1441643709' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:22:15.173 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:22:14.739267+0000 mon.smithi067 (mon.1) 318 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:22:15.173 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:22:14.740681+0000 mon.smithi067 (mon.1) 319 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:22:15.174 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:22:14.741602+0000 mon.smithi067 (mon.1) 320 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:22:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:14.577832+0000 mgr.smithi067.rdualw (mgr.24569) 1857 : cluster [DBG] pgmap v1602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:22:14.742419+0000 mgr.smithi067.rdualw (mgr.24569) 1858 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:22:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:22:15.165604+0000 mon.smithi061 (mon.0) 566 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:22:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:22:15.171007+0000 mon.smithi061 (mon.0) 567 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:22:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:14.577832+0000 mgr.smithi067.rdualw (mgr.24569) 1857 : cluster [DBG] pgmap v1602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:22:14.742419+0000 mgr.smithi067.rdualw (mgr.24569) 1858 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:22:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:22:15.165604+0000 mon.smithi061 (mon.0) 566 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:22:16.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:22:15.171007+0000 mon.smithi061 (mon.0) 567 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:22:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:16.578693+0000 mgr.smithi067.rdualw (mgr.24569) 1859 : cluster [DBG] pgmap v1603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:22:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:16.578693+0000 mgr.smithi067.rdualw (mgr.24569) 1859 : cluster [DBG] pgmap v1603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:22:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:18.579182+0000 mgr.smithi067.rdualw (mgr.24569) 1860 : cluster [DBG] pgmap v1604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:18.579182+0000 mgr.smithi067.rdualw (mgr.24569) 1860 : cluster [DBG] pgmap v1604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:20.580096+0000 mgr.smithi067.rdualw (mgr.24569) 1861 : cluster [DBG] pgmap v1605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:20.580096+0000 mgr.smithi067.rdualw (mgr.24569) 1861 : cluster [DBG] pgmap v1605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:24.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:22.580585+0000 mgr.smithi067.rdualw (mgr.24569) 1862 : cluster [DBG] pgmap v1606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:22.580585+0000 mgr.smithi067.rdualw (mgr.24569) 1862 : cluster [DBG] pgmap v1606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:24.581114+0000 mgr.smithi067.rdualw (mgr.24569) 1863 : cluster [DBG] pgmap v1607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:24.581114+0000 mgr.smithi067.rdualw (mgr.24569) 1863 : cluster [DBG] pgmap v1607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:26.581944+0000 mgr.smithi067.rdualw (mgr.24569) 1864 : cluster [DBG] pgmap v1608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:22:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:26.581944+0000 mgr.smithi067.rdualw (mgr.24569) 1864 : cluster [DBG] pgmap v1608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:22:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:28.582447+0000 mgr.smithi067.rdualw (mgr.24569) 1865 : cluster [DBG] pgmap v1609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:28.582447+0000 mgr.smithi067.rdualw (mgr.24569) 1865 : cluster [DBG] pgmap v1609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:30.583347+0000 mgr.smithi067.rdualw (mgr.24569) 1866 : cluster [DBG] pgmap v1610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:30.583347+0000 mgr.smithi067.rdualw (mgr.24569) 1866 : cluster [DBG] pgmap v1610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:32.584085+0000 mgr.smithi067.rdualw (mgr.24569) 1867 : cluster [DBG] pgmap v1611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:32.584085+0000 mgr.smithi067.rdualw (mgr.24569) 1867 : cluster [DBG] pgmap v1611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:22:34.711132+0000 mon.smithi067 (mon.1) 321 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:22:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:22:34.711432+0000 mon.smithi061 (mon.0) 568 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:22:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:22:34.714392+0000 mon.smithi067 (mon.1) 322 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:22:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:22:34.714582+0000 mon.smithi061 (mon.0) 569 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:22:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:22:34.711132+0000 mon.smithi067 (mon.1) 321 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:22:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:22:34.711432+0000 mon.smithi061 (mon.0) 568 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:22:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:22:34.714392+0000 mon.smithi067 (mon.1) 322 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:22:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:22:34.714582+0000 mon.smithi061 (mon.0) 569 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:22:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:34.584786+0000 mgr.smithi067.rdualw (mgr.24569) 1868 : cluster [DBG] pgmap v1612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:34.584786+0000 mgr.smithi067.rdualw (mgr.24569) 1868 : cluster [DBG] pgmap v1612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:36.585584+0000 mgr.smithi067.rdualw (mgr.24569) 1869 : cluster [DBG] pgmap v1613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:22:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:36.585584+0000 mgr.smithi067.rdualw (mgr.24569) 1869 : cluster [DBG] pgmap v1613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:22:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:38.586161+0000 mgr.smithi067.rdualw (mgr.24569) 1870 : cluster [DBG] pgmap v1614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:38.586161+0000 mgr.smithi067.rdualw (mgr.24569) 1870 : cluster [DBG] pgmap v1614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:40.587292+0000 mgr.smithi067.rdualw (mgr.24569) 1871 : cluster [DBG] pgmap v1615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:40.587292+0000 mgr.smithi067.rdualw (mgr.24569) 1871 : cluster [DBG] pgmap v1615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:44.409 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:22:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:42.587806+0000 mgr.smithi067.rdualw (mgr.24569) 1872 : cluster [DBG] pgmap v1616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:42.587806+0000 mgr.smithi067.rdualw (mgr.24569) 1872 : cluster [DBG] pgmap v1616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:44.699 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:22:44.700 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (60m) 90s ago 61m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:22:44.700 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (52m) 90s ago 61m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:22:44.700 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (52m) 93s ago 60m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:22:44.700 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (60m) 90s ago 61m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:22:44.701 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (53m) 90s ago 57m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:22:44.701 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (53m) 93s ago 57m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:22:44.701 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (54m) 90s ago 62m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:22:44.701 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (54m) 93s ago 60m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:22:44.701 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (53m) 90s ago 62m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:22:44.702 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (53m) 93s ago 60m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:22:44.702 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (54m) 90s ago 54m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:22:44.702 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (54m) 93s ago 54m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:22:44.702 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (61m) 90s ago 61m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:22:44.702 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (60m) 93s ago 60m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:22:44.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (43m) 90s ago 60m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:22:44.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (59m) 90s ago 59m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:22:44.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (59m) 90s ago 59m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:22:44.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (59m) 90s ago 59m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:22:44.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (59m) 93s ago 59m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:22:44.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (58m) 93s ago 58m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:22:44.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (58m) 93s ago 58m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:22:44.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (58m) 93s ago 58m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:22:44.704 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (60m) 90s ago 61m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:22:45.042 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:22:45.043 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:22:45.043 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:22:45.043 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:22:45.044 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:22:45.044 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:22:45.044 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:22:45.044 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:22:45.045 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:22:45.045 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:22:45.045 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:22:45.045 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:22:45.045 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:22:45.046 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:22:45.046 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:22:45.046 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:22:45.046 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:22:45.047 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:22:45.047 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:22:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:22:44.395722+0000 mgr.smithi067.rdualw (mgr.24569) 1873 : audit [DBG] from='client.35386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:22:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:44.588516+0000 mgr.smithi067.rdualw (mgr.24569) 1874 : cluster [DBG] pgmap v1617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:22:44.681448+0000 mgr.smithi067.rdualw (mgr.24569) 1875 : audit [DBG] from='client.35390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:22:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:22:45.041038+0000 mon.smithi061 (mon.0) 570 : audit [DBG] from='client.? 172.21.15.61:0/699461101' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:22:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:22:44.395722+0000 mgr.smithi067.rdualw (mgr.24569) 1873 : audit [DBG] from='client.35386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:22:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:44.588516+0000 mgr.smithi067.rdualw (mgr.24569) 1874 : cluster [DBG] pgmap v1617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:22:44.681448+0000 mgr.smithi067.rdualw (mgr.24569) 1875 : audit [DBG] from='client.35390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:22:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:22:45.041038+0000 mon.smithi061 (mon.0) 570 : audit [DBG] from='client.? 172.21.15.61:0/699461101' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:22:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:46.589598+0000 mgr.smithi067.rdualw (mgr.24569) 1876 : cluster [DBG] pgmap v1618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:22:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:46.589598+0000 mgr.smithi067.rdualw (mgr.24569) 1876 : cluster [DBG] pgmap v1618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:22:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:48.590140+0000 mgr.smithi067.rdualw (mgr.24569) 1877 : cluster [DBG] pgmap v1619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:48.590140+0000 mgr.smithi067.rdualw (mgr.24569) 1877 : cluster [DBG] pgmap v1619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:50.591029+0000 mgr.smithi067.rdualw (mgr.24569) 1878 : cluster [DBG] pgmap v1620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:50.591029+0000 mgr.smithi067.rdualw (mgr.24569) 1878 : cluster [DBG] pgmap v1620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:52.591645+0000 mgr.smithi067.rdualw (mgr.24569) 1879 : cluster [DBG] pgmap v1621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:52.591645+0000 mgr.smithi067.rdualw (mgr.24569) 1879 : cluster [DBG] pgmap v1621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:54.592337+0000 mgr.smithi067.rdualw (mgr.24569) 1880 : cluster [DBG] pgmap v1622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:54.592337+0000 mgr.smithi067.rdualw (mgr.24569) 1880 : cluster [DBG] pgmap v1622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:22:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:56.593177+0000 mgr.smithi067.rdualw (mgr.24569) 1881 : cluster [DBG] pgmap v1623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:22:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:56.593177+0000 mgr.smithi067.rdualw (mgr.24569) 1881 : cluster [DBG] pgmap v1623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:23:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:22:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:22:58.593930+0000 mgr.smithi067.rdualw (mgr.24569) 1882 : cluster [DBG] pgmap v1624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:22:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:22:58.593930+0000 mgr.smithi067.rdualw (mgr.24569) 1882 : cluster [DBG] pgmap v1624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:00.594916+0000 mgr.smithi067.rdualw (mgr.24569) 1883 : cluster [DBG] pgmap v1625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:00.594916+0000 mgr.smithi067.rdualw (mgr.24569) 1883 : cluster [DBG] pgmap v1625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:02.595620+0000 mgr.smithi067.rdualw (mgr.24569) 1884 : cluster [DBG] pgmap v1626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:02.595620+0000 mgr.smithi067.rdualw (mgr.24569) 1884 : cluster [DBG] pgmap v1626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:04.596213+0000 mgr.smithi067.rdualw (mgr.24569) 1885 : cluster [DBG] pgmap v1627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:04.596213+0000 mgr.smithi067.rdualw (mgr.24569) 1885 : cluster [DBG] pgmap v1627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:06.597114+0000 mgr.smithi067.rdualw (mgr.24569) 1886 : cluster [DBG] pgmap v1628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:23:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:06.597114+0000 mgr.smithi067.rdualw (mgr.24569) 1886 : cluster [DBG] pgmap v1628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:23:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:08.597644+0000 mgr.smithi067.rdualw (mgr.24569) 1887 : cluster [DBG] pgmap v1629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:08.597644+0000 mgr.smithi067.rdualw (mgr.24569) 1887 : cluster [DBG] pgmap v1629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:10.598407+0000 mgr.smithi067.rdualw (mgr.24569) 1888 : cluster [DBG] pgmap v1630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:10.598407+0000 mgr.smithi067.rdualw (mgr.24569) 1888 : cluster [DBG] pgmap v1630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:12.599141+0000 mgr.smithi067.rdualw (mgr.24569) 1889 : cluster [DBG] pgmap v1631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:12.599141+0000 mgr.smithi067.rdualw (mgr.24569) 1889 : cluster [DBG] pgmap v1631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:15.355 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:23:15.680 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:23:15.681 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (60m) 2m ago 61m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:23:15.681 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (53m) 2m ago 61m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:23:15.681 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (53m) 2m ago 61m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:23:15.681 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (60m) 2m ago 61m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:23:15.682 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (53m) 2m ago 57m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:23:15.682 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (53m) 2m ago 57m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:23:15.682 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (54m) 2m ago 63m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:23:15.682 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (54m) 2m ago 61m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:23:15.683 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (54m) 2m ago 63m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:23:15.683 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (54m) 2m ago 61m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:23:15.683 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (55m) 2m ago 55m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:23:15.684 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (55m) 2m ago 55m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:23:15.684 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (61m) 2m ago 61m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:23:15.684 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (61m) 2m ago 61m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:23:15.684 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (44m) 2m ago 60m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:23:15.685 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (60m) 2m ago 60m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:23:15.685 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (60m) 2m ago 60m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:23:15.685 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (59m) 2m ago 59m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:23:15.685 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (59m) 2m ago 59m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:23:15.685 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (59m) 2m ago 59m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:23:15.686 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (59m) 2m ago 59m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:23:15.686 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (58m) 2m ago 58m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:23:15.686 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (60m) 2m ago 61m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:23:16.031 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:23:16.032 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:23:16.032 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:23:16.032 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:23:16.032 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:23:16.033 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:23:16.033 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:23:16.033 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:23:16.033 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:23:16.033 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:23:16.034 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:23:16.034 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:23:16.034 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:23:16.034 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:23:16.035 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:23:16.035 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:23:16.035 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:23:16.035 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:23:16.035 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:23:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:14.599762+0000 mgr.smithi067.rdualw (mgr.24569) 1890 : cluster [DBG] pgmap v1632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:23:15.174933+0000 mon.smithi067 (mon.1) 323 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:23:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:23:15.176427+0000 mon.smithi067 (mon.1) 324 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:23:16.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:23:15.177369+0000 mon.smithi067 (mon.1) 325 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:23:16.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:23:15.178222+0000 mgr.smithi067.rdualw (mgr.24569) 1891 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:23:16.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:23:15.337157+0000 mgr.smithi067.rdualw (mgr.24569) 1892 : audit [DBG] from='client.35398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:23:16.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:23:15.449403+0000 mon.smithi061 (mon.0) 571 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:23:16.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:23:15.541683+0000 mon.smithi061 (mon.0) 572 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:23:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:14.599762+0000 mgr.smithi067.rdualw (mgr.24569) 1890 : cluster [DBG] pgmap v1632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:23:15.174933+0000 mon.smithi067 (mon.1) 323 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:23:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:23:15.176427+0000 mon.smithi067 (mon.1) 324 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:23:16.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:23:15.177369+0000 mon.smithi067 (mon.1) 325 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:23:16.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:23:15.178222+0000 mgr.smithi067.rdualw (mgr.24569) 1891 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:23:16.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:23:15.337157+0000 mgr.smithi067.rdualw (mgr.24569) 1892 : audit [DBG] from='client.35398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:23:16.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:23:15.449403+0000 mon.smithi061 (mon.0) 571 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:23:16.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:23:15.541683+0000 mon.smithi061 (mon.0) 572 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:23:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:23:15.663999+0000 mgr.smithi067.rdualw (mgr.24569) 1893 : audit [DBG] from='client.35402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:23:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:23:15.943807+0000 mon.smithi061 (mon.0) 573 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:23:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:23:15.949585+0000 mon.smithi061 (mon.0) 574 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:23:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:23:16.030107+0000 mon.smithi061 (mon.0) 575 : audit [DBG] from='client.? 172.21.15.61:0/1605480045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:23:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:23:15.663999+0000 mgr.smithi067.rdualw (mgr.24569) 1893 : audit [DBG] from='client.35402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:23:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:23:15.943807+0000 mon.smithi061 (mon.0) 573 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:23:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:23:15.949585+0000 mon.smithi061 (mon.0) 574 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:23:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:23:16.030107+0000 mon.smithi061 (mon.0) 575 : audit [DBG] from='client.? 172.21.15.61:0/1605480045' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:23:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:16.600692+0000 mgr.smithi067.rdualw (mgr.24569) 1894 : cluster [DBG] pgmap v1633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:23:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:16.600692+0000 mgr.smithi067.rdualw (mgr.24569) 1894 : cluster [DBG] pgmap v1633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:23:20.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:18.601372+0000 mgr.smithi067.rdualw (mgr.24569) 1895 : cluster [DBG] pgmap v1634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:20.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:18.601372+0000 mgr.smithi067.rdualw (mgr.24569) 1895 : cluster [DBG] pgmap v1634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:22.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:20.602214+0000 mgr.smithi067.rdualw (mgr.24569) 1896 : cluster [DBG] pgmap v1635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:20.602214+0000 mgr.smithi067.rdualw (mgr.24569) 1896 : cluster [DBG] pgmap v1635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:22.602993+0000 mgr.smithi067.rdualw (mgr.24569) 1897 : cluster [DBG] pgmap v1636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:22.602993+0000 mgr.smithi067.rdualw (mgr.24569) 1897 : cluster [DBG] pgmap v1636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:24.603840+0000 mgr.smithi067.rdualw (mgr.24569) 1898 : cluster [DBG] pgmap v1637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:24.603840+0000 mgr.smithi067.rdualw (mgr.24569) 1898 : cluster [DBG] pgmap v1637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:26.604704+0000 mgr.smithi067.rdualw (mgr.24569) 1899 : cluster [DBG] pgmap v1638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:23:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:26.604704+0000 mgr.smithi067.rdualw (mgr.24569) 1899 : cluster [DBG] pgmap v1638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:23:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:28.605377+0000 mgr.smithi067.rdualw (mgr.24569) 1900 : cluster [DBG] pgmap v1639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:28.605377+0000 mgr.smithi067.rdualw (mgr.24569) 1900 : cluster [DBG] pgmap v1639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:30.606392+0000 mgr.smithi067.rdualw (mgr.24569) 1901 : cluster [DBG] pgmap v1640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:30.606392+0000 mgr.smithi067.rdualw (mgr.24569) 1901 : cluster [DBG] pgmap v1640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:32.606921+0000 mgr.smithi067.rdualw (mgr.24569) 1902 : cluster [DBG] pgmap v1641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:32.606921+0000 mgr.smithi067.rdualw (mgr.24569) 1902 : cluster [DBG] pgmap v1641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:23:34.716519+0000 mon.smithi067 (mon.1) 326 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:23:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:23:34.716931+0000 mon.smithi061 (mon.0) 576 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:23:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:23:34.717019+0000 mon.smithi067 (mon.1) 327 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:23:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:23:34.717158+0000 mon.smithi061 (mon.0) 577 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:23:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:23:34.716519+0000 mon.smithi067 (mon.1) 326 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:23:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:23:34.716931+0000 mon.smithi061 (mon.0) 576 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:23:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:23:34.717019+0000 mon.smithi067 (mon.1) 327 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:23:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:23:34.717158+0000 mon.smithi061 (mon.0) 577 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:23:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:34.607661+0000 mgr.smithi067.rdualw (mgr.24569) 1903 : cluster [DBG] pgmap v1642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:34.607661+0000 mgr.smithi067.rdualw (mgr.24569) 1903 : cluster [DBG] pgmap v1642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:36.608643+0000 mgr.smithi067.rdualw (mgr.24569) 1904 : cluster [DBG] pgmap v1643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:23:38.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:36.608643+0000 mgr.smithi067.rdualw (mgr.24569) 1904 : cluster [DBG] pgmap v1643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:23:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:38.609106+0000 mgr.smithi067.rdualw (mgr.24569) 1905 : cluster [DBG] pgmap v1644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:38.609106+0000 mgr.smithi067.rdualw (mgr.24569) 1905 : cluster [DBG] pgmap v1644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:42.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:40.609896+0000 mgr.smithi067.rdualw (mgr.24569) 1906 : cluster [DBG] pgmap v1645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:40.609896+0000 mgr.smithi067.rdualw (mgr.24569) 1906 : cluster [DBG] pgmap v1645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:42.610372+0000 mgr.smithi067.rdualw (mgr.24569) 1907 : cluster [DBG] pgmap v1646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:42.610372+0000 mgr.smithi067.rdualw (mgr.24569) 1907 : cluster [DBG] pgmap v1646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:44.611096+0000 mgr.smithi067.rdualw (mgr.24569) 1908 : cluster [DBG] pgmap v1647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:44.611096+0000 mgr.smithi067.rdualw (mgr.24569) 1908 : cluster [DBG] pgmap v1647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:46.342 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:23:46.632 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:23:46.632 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (61m) 2m ago 62m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:23:46.632 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (54m) 2m ago 62m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:23:46.632 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (53m) 2m ago 61m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:23:46.633 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (61m) 2m ago 62m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:23:46.633 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (54m) 2m ago 58m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:23:46.633 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (54m) 2m ago 58m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:23:46.634 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (55m) 2m ago 63m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:23:46.634 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (55m) 2m ago 61m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:23:46.634 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (54m) 2m ago 63m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:23:46.634 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (54m) 2m ago 61m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:23:46.635 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (55m) 2m ago 55m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:23:46.635 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (55m) 2m ago 55m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:23:46.635 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (62m) 2m ago 62m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:23:46.635 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (61m) 2m ago 61m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:23:46.636 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (44m) 2m ago 61m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:23:46.636 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (60m) 2m ago 60m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:23:46.636 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (60m) 2m ago 60m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:23:46.636 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (60m) 2m ago 60m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:23:46.637 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (60m) 2m ago 60m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:23:46.637 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (59m) 2m ago 59m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:23:46.637 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (59m) 2m ago 59m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:23:46.637 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (59m) 2m ago 59m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:23:46.637 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (61m) 2m ago 62m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:23:46.973 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:23:46.973 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:23:46.973 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:23:46.974 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:23:46.974 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:23:46.974 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:23:46.974 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:23:46.975 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:23:46.975 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:23:46.975 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:23:46.976 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:23:46.976 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:23:46.976 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:23:46.977 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:23:46.977 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:23:46.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:23:46.978 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:23:46.978 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:23:46.978 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:23:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:23:46.328741+0000 mgr.smithi067.rdualw (mgr.24569) 1909 : audit [DBG] from='client.35410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:23:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:23:46.971624+0000 mon.smithi061 (mon.0) 578 : audit [DBG] from='client.? 172.21.15.61:0/391193361' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:23:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:23:46.328741+0000 mgr.smithi067.rdualw (mgr.24569) 1909 : audit [DBG] from='client.35410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:23:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:23:46.971624+0000 mon.smithi061 (mon.0) 578 : audit [DBG] from='client.? 172.21.15.61:0/391193361' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:23:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:46.611913+0000 mgr.smithi067.rdualw (mgr.24569) 1910 : cluster [DBG] pgmap v1648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:23:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:23:46.614174+0000 mgr.smithi067.rdualw (mgr.24569) 1911 : audit [DBG] from='client.35414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:23:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:46.611913+0000 mgr.smithi067.rdualw (mgr.24569) 1910 : cluster [DBG] pgmap v1648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:23:48.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:23:46.614174+0000 mgr.smithi067.rdualw (mgr.24569) 1911 : audit [DBG] from='client.35414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:23:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:48.612583+0000 mgr.smithi067.rdualw (mgr.24569) 1912 : cluster [DBG] pgmap v1649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:48.612583+0000 mgr.smithi067.rdualw (mgr.24569) 1912 : cluster [DBG] pgmap v1649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:50.613298+0000 mgr.smithi067.rdualw (mgr.24569) 1913 : cluster [DBG] pgmap v1650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:50.613298+0000 mgr.smithi067.rdualw (mgr.24569) 1913 : cluster [DBG] pgmap v1650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:52.613841+0000 mgr.smithi067.rdualw (mgr.24569) 1914 : cluster [DBG] pgmap v1651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:52.613841+0000 mgr.smithi067.rdualw (mgr.24569) 1914 : cluster [DBG] pgmap v1651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:56.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:54.614571+0000 mgr.smithi067.rdualw (mgr.24569) 1915 : cluster [DBG] pgmap v1652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:54.614571+0000 mgr.smithi067.rdualw (mgr.24569) 1915 : cluster [DBG] pgmap v1652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:23:58.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:23:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:56.615683+0000 mgr.smithi067.rdualw (mgr.24569) 1916 : cluster [DBG] pgmap v1653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:23:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:23:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:56.615683+0000 mgr.smithi067.rdualw (mgr.24569) 1916 : cluster [DBG] pgmap v1653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:24:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:23:58.616195+0000 mgr.smithi067.rdualw (mgr.24569) 1917 : cluster [DBG] pgmap v1654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:23:58.616195+0000 mgr.smithi067.rdualw (mgr.24569) 1917 : cluster [DBG] pgmap v1654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:00.617158+0000 mgr.smithi067.rdualw (mgr.24569) 1918 : cluster [DBG] pgmap v1655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:00.617158+0000 mgr.smithi067.rdualw (mgr.24569) 1918 : cluster [DBG] pgmap v1655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:02.617846+0000 mgr.smithi067.rdualw (mgr.24569) 1919 : cluster [DBG] pgmap v1656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:02.617846+0000 mgr.smithi067.rdualw (mgr.24569) 1919 : cluster [DBG] pgmap v1656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:04.618502+0000 mgr.smithi067.rdualw (mgr.24569) 1920 : cluster [DBG] pgmap v1657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:04.618502+0000 mgr.smithi067.rdualw (mgr.24569) 1920 : cluster [DBG] pgmap v1657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:06.619380+0000 mgr.smithi067.rdualw (mgr.24569) 1921 : cluster [DBG] pgmap v1658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:24:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:06.619380+0000 mgr.smithi067.rdualw (mgr.24569) 1921 : cluster [DBG] pgmap v1658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:24:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:08.619856+0000 mgr.smithi067.rdualw (mgr.24569) 1922 : cluster [DBG] pgmap v1659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:08.619856+0000 mgr.smithi067.rdualw (mgr.24569) 1922 : cluster [DBG] pgmap v1659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:10.620776+0000 mgr.smithi067.rdualw (mgr.24569) 1923 : cluster [DBG] pgmap v1660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:10.620776+0000 mgr.smithi067.rdualw (mgr.24569) 1923 : cluster [DBG] pgmap v1660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:14.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:12.621336+0000 mgr.smithi067.rdualw (mgr.24569) 1924 : cluster [DBG] pgmap v1661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:14.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:12.621336+0000 mgr.smithi067.rdualw (mgr.24569) 1924 : cluster [DBG] pgmap v1661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:16.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:14.621935+0000 mgr.smithi067.rdualw (mgr.24569) 1925 : cluster [DBG] pgmap v1662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:16.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:24:15.953128+0000 mon.smithi067 (mon.1) 328 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:24:16.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:24:15.954715+0000 mon.smithi067 (mon.1) 329 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:24:16.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:24:15.955721+0000 mon.smithi067 (mon.1) 330 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:24:16.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:14.621935+0000 mgr.smithi067.rdualw (mgr.24569) 1925 : cluster [DBG] pgmap v1662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:16.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:24:15.953128+0000 mon.smithi067 (mon.1) 328 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:24:16.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:24:15.954715+0000 mon.smithi067 (mon.1) 329 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:24:16.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:24:15.955721+0000 mon.smithi067 (mon.1) 330 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:24:17.290 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:24:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:24:15.956654+0000 mgr.smithi067.rdualw (mgr.24569) 1926 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:24:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:24:15.956654+0000 mgr.smithi067.rdualw (mgr.24569) 1926 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:24:17.596 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:24:17.596 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (61m) 3m ago 62m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:24:17.596 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (54m) 3m ago 62m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:24:17.597 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (54m) 3m ago 62m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:24:17.597 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (61m) 3m ago 62m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:24:17.597 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (55m) 3m ago 58m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:24:17.598 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (54m) 3m ago 58m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:24:17.598 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (55m) 3m ago 64m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:24:17.598 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (55m) 3m ago 62m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:24:17.598 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (55m) 3m ago 64m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:24:17.598 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (55m) 3m ago 62m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:24:17.599 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (56m) 3m ago 56m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:24:17.599 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (56m) 3m ago 56m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:24:17.599 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (62m) 3m ago 62m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:24:17.599 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (62m) 3m ago 62m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:24:17.600 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (45m) 3m ago 61m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:24:17.600 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (61m) 3m ago 61m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:24:17.600 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (61m) 3m ago 61m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:24:17.600 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (60m) 3m ago 60m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:24:17.601 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (60m) 3m ago 60m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:24:17.601 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (60m) 3m ago 60m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:24:17.601 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (60m) 3m ago 60m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:24:17.602 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (59m) 3m ago 59m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:24:17.602 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (61m) 3m ago 62m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:24:17.962 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:24:17.963 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:24:17.963 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:24:17.963 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:24:17.963 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:24:17.964 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:24:17.964 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:24:17.964 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:24:17.964 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:24:17.964 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:24:17.965 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:24:17.965 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:24:17.965 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:24:17.965 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:24:17.965 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:24:17.966 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:24:17.966 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:24:17.966 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:24:17.966 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:24:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:16.622731+0000 mgr.smithi067.rdualw (mgr.24569) 1927 : cluster [DBG] pgmap v1663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:24:18.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:24:17.276748+0000 mgr.smithi067.rdualw (mgr.24569) 1928 : audit [DBG] from='client.35422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:24:18.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:24:17.961004+0000 mon.smithi061 (mon.0) 579 : audit [DBG] from='client.? 172.21.15.61:0/1294089563' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:24:18.472 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:16.622731+0000 mgr.smithi067.rdualw (mgr.24569) 1927 : cluster [DBG] pgmap v1663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:24:18.473 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:24:17.276748+0000 mgr.smithi067.rdualw (mgr.24569) 1928 : audit [DBG] from='client.35422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:24:18.473 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:24:17.961004+0000 mon.smithi061 (mon.0) 579 : audit [DBG] from='client.? 172.21.15.61:0/1294089563' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:24:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:24:17.577773+0000 mgr.smithi067.rdualw (mgr.24569) 1929 : audit [DBG] from='client.35426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:24:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:24:17.577773+0000 mgr.smithi067.rdualw (mgr.24569) 1929 : audit [DBG] from='client.35426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:24:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:18.623221+0000 mgr.smithi067.rdualw (mgr.24569) 1930 : cluster [DBG] pgmap v1664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:24:19.287719+0000 mon.smithi061 (mon.0) 580 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:24:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:24:19.704647+0000 mon.smithi061 (mon.0) 581 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:24:20.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:24:19.711931+0000 mon.smithi061 (mon.0) 582 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:24:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:18.623221+0000 mgr.smithi067.rdualw (mgr.24569) 1930 : cluster [DBG] pgmap v1664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:24:19.287719+0000 mon.smithi061 (mon.0) 580 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:24:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:24:19.704647+0000 mon.smithi061 (mon.0) 581 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:24:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:24:19.711931+0000 mon.smithi061 (mon.0) 582 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:24:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:20.624034+0000 mgr.smithi067.rdualw (mgr.24569) 1931 : cluster [DBG] pgmap v1665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:20.624034+0000 mgr.smithi067.rdualw (mgr.24569) 1931 : cluster [DBG] pgmap v1665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:22.624569+0000 mgr.smithi067.rdualw (mgr.24569) 1932 : cluster [DBG] pgmap v1666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:22.624569+0000 mgr.smithi067.rdualw (mgr.24569) 1932 : cluster [DBG] pgmap v1666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:24.625140+0000 mgr.smithi067.rdualw (mgr.24569) 1933 : cluster [DBG] pgmap v1667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:24.625140+0000 mgr.smithi067.rdualw (mgr.24569) 1933 : cluster [DBG] pgmap v1667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:28.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:26.626061+0000 mgr.smithi067.rdualw (mgr.24569) 1934 : cluster [DBG] pgmap v1668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:24:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:26.626061+0000 mgr.smithi067.rdualw (mgr.24569) 1934 : cluster [DBG] pgmap v1668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:24:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:28.626792+0000 mgr.smithi067.rdualw (mgr.24569) 1935 : cluster [DBG] pgmap v1669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:28.626792+0000 mgr.smithi067.rdualw (mgr.24569) 1935 : cluster [DBG] pgmap v1669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:30.627732+0000 mgr.smithi067.rdualw (mgr.24569) 1936 : cluster [DBG] pgmap v1670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:30.627732+0000 mgr.smithi067.rdualw (mgr.24569) 1936 : cluster [DBG] pgmap v1670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:32.628164+0000 mgr.smithi067.rdualw (mgr.24569) 1937 : cluster [DBG] pgmap v1671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:32.628164+0000 mgr.smithi067.rdualw (mgr.24569) 1937 : cluster [DBG] pgmap v1671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:24:34.722027+0000 mon.smithi067 (mon.1) 331 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:24:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:24:34.722287+0000 mon.smithi067 (mon.1) 332 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:24:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:24:34.722384+0000 mon.smithi061 (mon.0) 583 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:24:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:24:34.722889+0000 mon.smithi061 (mon.0) 584 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:24:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:24:34.722027+0000 mon.smithi067 (mon.1) 331 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:24:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:24:34.722287+0000 mon.smithi067 (mon.1) 332 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:24:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:24:34.722384+0000 mon.smithi061 (mon.0) 583 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:24:35.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:24:34.722889+0000 mon.smithi061 (mon.0) 584 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:24:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:34.628705+0000 mgr.smithi067.rdualw (mgr.24569) 1938 : cluster [DBG] pgmap v1672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:34.628705+0000 mgr.smithi067.rdualw (mgr.24569) 1938 : cluster [DBG] pgmap v1672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:36.629758+0000 mgr.smithi067.rdualw (mgr.24569) 1939 : cluster [DBG] pgmap v1673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:24:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:36.629758+0000 mgr.smithi067.rdualw (mgr.24569) 1939 : cluster [DBG] pgmap v1673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:24:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:38.630378+0000 mgr.smithi067.rdualw (mgr.24569) 1940 : cluster [DBG] pgmap v1674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:38.630378+0000 mgr.smithi067.rdualw (mgr.24569) 1940 : cluster [DBG] pgmap v1674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:40.631196+0000 mgr.smithi067.rdualw (mgr.24569) 1941 : cluster [DBG] pgmap v1675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:40.631196+0000 mgr.smithi067.rdualw (mgr.24569) 1941 : cluster [DBG] pgmap v1675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:42.631768+0000 mgr.smithi067.rdualw (mgr.24569) 1942 : cluster [DBG] pgmap v1676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:42.631768+0000 mgr.smithi067.rdualw (mgr.24569) 1942 : cluster [DBG] pgmap v1676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:44.632415+0000 mgr.smithi067.rdualw (mgr.24569) 1943 : cluster [DBG] pgmap v1677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:44.632415+0000 mgr.smithi067.rdualw (mgr.24569) 1943 : cluster [DBG] pgmap v1677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:48.278 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:24:48.570 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:24:48.570 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (62m) 3m ago 63m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:24:48.570 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (55m) 3m ago 63m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:24:48.570 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (54m) 3m ago 62m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:24:48.571 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (62m) 3m ago 63m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:24:48.571 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (55m) 3m ago 59m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:24:48.571 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (55m) 3m ago 59m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:24:48.571 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (56m) 3m ago 64m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:24:48.572 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (56m) 3m ago 62m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:24:48.572 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (55m) 3m ago 64m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:24:48.572 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (55m) 3m ago 62m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:24:48.572 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (56m) 3m ago 56m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:24:48.573 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (56m) 3m ago 56m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:24:48.573 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (63m) 3m ago 63m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:24:48.573 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (62m) 3m ago 62m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:24:48.573 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (45m) 3m ago 62m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:24:48.573 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (61m) 3m ago 61m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:24:48.574 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (61m) 3m ago 61m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:24:48.574 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (61m) 3m ago 61m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:24:48.574 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (61m) 3m ago 61m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:24:48.574 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (60m) 3m ago 60m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:24:48.575 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (60m) 3m ago 60m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:24:48.575 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (60m) 3m ago 60m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:24:48.575 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (62m) 3m ago 63m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:24:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:46.633172+0000 mgr.smithi067.rdualw (mgr.24569) 1944 : cluster [DBG] pgmap v1678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:24:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:46.633172+0000 mgr.smithi067.rdualw (mgr.24569) 1944 : cluster [DBG] pgmap v1678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:24:48.911 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:24:48.911 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:24:48.911 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:24:48.912 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:24:48.912 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:24:48.912 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:24:48.912 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:24:48.913 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:24:48.913 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:24:48.913 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:24:48.913 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:24:48.914 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:24:48.914 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:24:48.914 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:24:48.914 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:24:48.915 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:24:48.915 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:24:48.915 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:24:48.915 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:24:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:24:48.263990+0000 mgr.smithi067.rdualw (mgr.24569) 1945 : audit [DBG] from='client.35434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:24:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:24:48.909529+0000 mon.smithi061 (mon.0) 585 : audit [DBG] from='client.? 172.21.15.61:0/3972114492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:24:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:24:48.263990+0000 mgr.smithi067.rdualw (mgr.24569) 1945 : audit [DBG] from='client.35434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:24:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:24:48.909529+0000 mon.smithi061 (mon.0) 585 : audit [DBG] from='client.? 172.21.15.61:0/3972114492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:24:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:24:48.552170+0000 mgr.smithi067.rdualw (mgr.24569) 1946 : audit [DBG] from='client.35438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:24:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:48.633840+0000 mgr.smithi067.rdualw (mgr.24569) 1947 : cluster [DBG] pgmap v1679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:24:48.552170+0000 mgr.smithi067.rdualw (mgr.24569) 1946 : audit [DBG] from='client.35438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:24:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:48.633840+0000 mgr.smithi067.rdualw (mgr.24569) 1947 : cluster [DBG] pgmap v1679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:50.634690+0000 mgr.smithi067.rdualw (mgr.24569) 1948 : cluster [DBG] pgmap v1680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:50.634690+0000 mgr.smithi067.rdualw (mgr.24569) 1948 : cluster [DBG] pgmap v1680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:52.635416+0000 mgr.smithi067.rdualw (mgr.24569) 1949 : cluster [DBG] pgmap v1681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:52.635416+0000 mgr.smithi067.rdualw (mgr.24569) 1949 : cluster [DBG] pgmap v1681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:54.636040+0000 mgr.smithi067.rdualw (mgr.24569) 1950 : cluster [DBG] pgmap v1682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:56.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:54.636040+0000 mgr.smithi067.rdualw (mgr.24569) 1950 : cluster [DBG] pgmap v1682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:24:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:24:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:56.636996+0000 mgr.smithi067.rdualw (mgr.24569) 1951 : cluster [DBG] pgmap v1683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:24:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:24:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:56.636996+0000 mgr.smithi067.rdualw (mgr.24569) 1951 : cluster [DBG] pgmap v1683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:25:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:24:58.637565+0000 mgr.smithi067.rdualw (mgr.24569) 1952 : cluster [DBG] pgmap v1684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:24:58.637565+0000 mgr.smithi067.rdualw (mgr.24569) 1952 : cluster [DBG] pgmap v1684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:00.638484+0000 mgr.smithi067.rdualw (mgr.24569) 1953 : cluster [DBG] pgmap v1685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:00.638484+0000 mgr.smithi067.rdualw (mgr.24569) 1953 : cluster [DBG] pgmap v1685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:02.639063+0000 mgr.smithi067.rdualw (mgr.24569) 1954 : cluster [DBG] pgmap v1686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:02.639063+0000 mgr.smithi067.rdualw (mgr.24569) 1954 : cluster [DBG] pgmap v1686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:06.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:04.639689+0000 mgr.smithi067.rdualw (mgr.24569) 1955 : cluster [DBG] pgmap v1687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:06.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:04.639689+0000 mgr.smithi067.rdualw (mgr.24569) 1955 : cluster [DBG] pgmap v1687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:06.640517+0000 mgr.smithi067.rdualw (mgr.24569) 1956 : cluster [DBG] pgmap v1688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:25:08.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:06.640517+0000 mgr.smithi067.rdualw (mgr.24569) 1956 : cluster [DBG] pgmap v1688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:25:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:08.641192+0000 mgr.smithi067.rdualw (mgr.24569) 1957 : cluster [DBG] pgmap v1689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:08.641192+0000 mgr.smithi067.rdualw (mgr.24569) 1957 : cluster [DBG] pgmap v1689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:10.642088+0000 mgr.smithi067.rdualw (mgr.24569) 1958 : cluster [DBG] pgmap v1690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:10.642088+0000 mgr.smithi067.rdualw (mgr.24569) 1958 : cluster [DBG] pgmap v1690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:12.642830+0000 mgr.smithi067.rdualw (mgr.24569) 1959 : cluster [DBG] pgmap v1691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:12.642830+0000 mgr.smithi067.rdualw (mgr.24569) 1959 : cluster [DBG] pgmap v1691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:14.643519+0000 mgr.smithi067.rdualw (mgr.24569) 1960 : cluster [DBG] pgmap v1692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:16.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:14.643519+0000 mgr.smithi067.rdualw (mgr.24569) 1960 : cluster [DBG] pgmap v1692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:16.644339+0000 mgr.smithi067.rdualw (mgr.24569) 1961 : cluster [DBG] pgmap v1693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:25:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:16.644339+0000 mgr.smithi067.rdualw (mgr.24569) 1961 : cluster [DBG] pgmap v1693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:25:19.218 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:25:19.510 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:25:19.511 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (62m) 4m ago 63m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:25:19.511 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (55m) 4m ago 63m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:25:19.511 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (55m) 4m ago 63m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:25:19.511 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (62m) 4m ago 63m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:25:19.511 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (56m) 4m ago 59m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:25:19.512 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (55m) 4m ago 59m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:25:19.512 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (57m) 4m ago 65m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:25:19.512 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (56m) 4m ago 63m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:25:19.512 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (56m) 4m ago 65m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:25:19.513 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (56m) 4m ago 63m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:25:19.513 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (57m) 4m ago 57m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:25:19.513 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (57m) 4m ago 57m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:25:19.513 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (63m) 4m ago 63m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:25:19.513 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (63m) 4m ago 63m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:25:19.514 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (46m) 4m ago 62m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:25:19.514 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (62m) 4m ago 62m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:25:19.514 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (62m) 4m ago 62m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:25:19.514 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (61m) 4m ago 61m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:25:19.515 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (61m) 4m ago 61m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:25:19.515 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (61m) 4m ago 61m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:25:19.515 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (61m) 4m ago 61m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:25:19.515 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (60m) 4m ago 60m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:25:19.515 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (62m) 4m ago 63m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:25:19.903 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:25:19.903 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:25:19.903 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:25:19.904 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:25:19.904 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:25:19.904 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:25:19.904 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:25:19.905 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:25:19.905 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:25:19.905 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:25:19.905 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:25:19.906 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:25:19.906 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:25:19.906 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:25:19.906 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:25:19.906 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:25:19.907 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:25:19.907 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:25:19.907 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:25:20.701 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:18.644971+0000 mgr.smithi067.rdualw (mgr.24569) 1962 : cluster [DBG] pgmap v1694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:20.701 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:25:19.204597+0000 mgr.smithi067.rdualw (mgr.24569) 1963 : audit [DBG] from='client.35446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:25:20.702 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:25:19.716204+0000 mon.smithi067 (mon.1) 333 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:25:20.702 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:25:19.717543+0000 mon.smithi067 (mon.1) 334 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:25:20.702 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:25:19.718340+0000 mon.smithi067 (mon.1) 335 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:25:20.703 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:25:19.901749+0000 mon.smithi061 (mon.0) 586 : audit [DBG] from='client.? 172.21.15.61:0/60282417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:25:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:18.644971+0000 mgr.smithi067.rdualw (mgr.24569) 1962 : cluster [DBG] pgmap v1694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:25:19.204597+0000 mgr.smithi067.rdualw (mgr.24569) 1963 : audit [DBG] from='client.35446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:25:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:25:19.716204+0000 mon.smithi067 (mon.1) 333 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:25:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:25:19.717543+0000 mon.smithi067 (mon.1) 334 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:25:20.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:25:19.718340+0000 mon.smithi067 (mon.1) 335 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:25:20.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:25:19.901749+0000 mon.smithi061 (mon.0) 586 : audit [DBG] from='client.? 172.21.15.61:0/60282417' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:25:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:25:19.491462+0000 mgr.smithi067.rdualw (mgr.24569) 1964 : audit [DBG] from='client.35450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:25:21.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:25:19.719086+0000 mgr.smithi067.rdualw (mgr.24569) 1965 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:25:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:25:19.491462+0000 mgr.smithi067.rdualw (mgr.24569) 1964 : audit [DBG] from='client.35450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:25:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:25:19.719086+0000 mgr.smithi067.rdualw (mgr.24569) 1965 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:25:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:20.645978+0000 mgr.smithi067.rdualw (mgr.24569) 1966 : cluster [DBG] pgmap v1695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:20.645978+0000 mgr.smithi067.rdualw (mgr.24569) 1966 : cluster [DBG] pgmap v1695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:22.646526+0000 mgr.smithi067.rdualw (mgr.24569) 1967 : cluster [DBG] pgmap v1696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:25:22.719213+0000 mon.smithi061 (mon.0) 587 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:25:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:25:23.112384+0000 mon.smithi061 (mon.0) 588 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:25:24.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:25:23.120803+0000 mon.smithi061 (mon.0) 589 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:25:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:22.646526+0000 mgr.smithi067.rdualw (mgr.24569) 1967 : cluster [DBG] pgmap v1696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:25:22.719213+0000 mon.smithi061 (mon.0) 587 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:25:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:25:23.112384+0000 mon.smithi061 (mon.0) 588 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:25:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:25:23.120803+0000 mon.smithi061 (mon.0) 589 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:25:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:24.647241+0000 mgr.smithi067.rdualw (mgr.24569) 1968 : cluster [DBG] pgmap v1697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:24.647241+0000 mgr.smithi067.rdualw (mgr.24569) 1968 : cluster [DBG] pgmap v1697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:26.648079+0000 mgr.smithi067.rdualw (mgr.24569) 1969 : cluster [DBG] pgmap v1698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:25:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:26.648079+0000 mgr.smithi067.rdualw (mgr.24569) 1969 : cluster [DBG] pgmap v1698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:25:30.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:28.648602+0000 mgr.smithi067.rdualw (mgr.24569) 1970 : cluster [DBG] pgmap v1699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:28.648602+0000 mgr.smithi067.rdualw (mgr.24569) 1970 : cluster [DBG] pgmap v1699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:32.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:30.649373+0000 mgr.smithi067.rdualw (mgr.24569) 1971 : cluster [DBG] pgmap v1700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:32.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:30.649373+0000 mgr.smithi067.rdualw (mgr.24569) 1971 : cluster [DBG] pgmap v1700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:32.649906+0000 mgr.smithi067.rdualw (mgr.24569) 1972 : cluster [DBG] pgmap v1701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:32.649906+0000 mgr.smithi067.rdualw (mgr.24569) 1972 : cluster [DBG] pgmap v1701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:25:34.726849+0000 mon.smithi067 (mon.1) 336 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:25:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:25:34.727192+0000 mon.smithi061 (mon.0) 590 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:25:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:25:34.727216+0000 mon.smithi067 (mon.1) 337 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:25:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:25:34.727474+0000 mon.smithi061 (mon.0) 591 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:25:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:25:34.726849+0000 mon.smithi067 (mon.1) 336 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:25:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:25:34.727192+0000 mon.smithi061 (mon.0) 590 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:25:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:25:34.727216+0000 mon.smithi067 (mon.1) 337 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:25:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:25:34.727474+0000 mon.smithi061 (mon.0) 591 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:25:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:34.650460+0000 mgr.smithi067.rdualw (mgr.24569) 1973 : cluster [DBG] pgmap v1702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:34.650460+0000 mgr.smithi067.rdualw (mgr.24569) 1973 : cluster [DBG] pgmap v1702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:36.651472+0000 mgr.smithi067.rdualw (mgr.24569) 1974 : cluster [DBG] pgmap v1703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:25:38.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:36.651472+0000 mgr.smithi067.rdualw (mgr.24569) 1974 : cluster [DBG] pgmap v1703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:25:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:38.651942+0000 mgr.smithi067.rdualw (mgr.24569) 1975 : cluster [DBG] pgmap v1704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:38.651942+0000 mgr.smithi067.rdualw (mgr.24569) 1975 : cluster [DBG] pgmap v1704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:40.652782+0000 mgr.smithi067.rdualw (mgr.24569) 1976 : cluster [DBG] pgmap v1705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:40.652782+0000 mgr.smithi067.rdualw (mgr.24569) 1976 : cluster [DBG] pgmap v1705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:42.653320+0000 mgr.smithi067.rdualw (mgr.24569) 1977 : cluster [DBG] pgmap v1706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:42.653320+0000 mgr.smithi067.rdualw (mgr.24569) 1977 : cluster [DBG] pgmap v1706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:44.654049+0000 mgr.smithi067.rdualw (mgr.24569) 1978 : cluster [DBG] pgmap v1707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:44.654049+0000 mgr.smithi067.rdualw (mgr.24569) 1978 : cluster [DBG] pgmap v1707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:46.655048+0000 mgr.smithi067.rdualw (mgr.24569) 1979 : cluster [DBG] pgmap v1708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:25:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:46.655048+0000 mgr.smithi067.rdualw (mgr.24569) 1979 : cluster [DBG] pgmap v1708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:25:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:48.655652+0000 mgr.smithi067.rdualw (mgr.24569) 1980 : cluster [DBG] pgmap v1709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:48.655652+0000 mgr.smithi067.rdualw (mgr.24569) 1980 : cluster [DBG] pgmap v1709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:50.246 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:25:50.536 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:25:50.537 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (63m) 4m ago 64m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:25:50.537 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (56m) 4m ago 64m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:25:50.537 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (55m) 4m ago 63m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:25:50.538 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (63m) 4m ago 64m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:25:50.538 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (56m) 4m ago 60m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:25:50.538 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (56m) 4m ago 60m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:25:50.538 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (57m) 4m ago 65m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:25:50.539 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (57m) 4m ago 63m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:25:50.539 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (57m) 4m ago 65m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:25:50.539 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (56m) 4m ago 63m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:25:50.539 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (57m) 4m ago 57m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:25:50.540 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (57m) 4m ago 57m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:25:50.540 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (64m) 4m ago 64m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:25:50.541 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (63m) 4m ago 63m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:25:50.541 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (46m) 4m ago 63m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:25:50.541 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (63m) 4m ago 63m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:25:50.541 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (62m) 4m ago 62m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:25:50.542 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (62m) 4m ago 62m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:25:50.542 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (62m) 4m ago 62m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:25:50.542 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (61m) 4m ago 61m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:25:50.542 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (61m) 4m ago 61m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:25:50.542 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (61m) 4m ago 61m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:25:50.543 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (63m) 4m ago 64m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:25:50.876 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:25:50.876 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:25:50.876 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:25:50.877 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:25:50.877 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:25:50.877 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:25:50.877 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:25:50.878 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:25:50.878 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:25:50.878 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:25:50.878 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:25:50.879 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:25:50.879 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:25:50.879 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:25:50.879 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:25:50.879 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:25:50.880 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:25:50.880 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:25:50.880 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:25:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:25:50.229917+0000 mgr.smithi067.rdualw (mgr.24569) 1981 : audit [DBG] from='client.35458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:25:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:25:50.229917+0000 mgr.smithi067.rdualw (mgr.24569) 1981 : audit [DBG] from='client.35458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:25:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:25:50.519126+0000 mgr.smithi067.rdualw (mgr.24569) 1982 : audit [DBG] from='client.35462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:25:52.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:50.656553+0000 mgr.smithi067.rdualw (mgr.24569) 1983 : cluster [DBG] pgmap v1710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:52.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:25:50.874445+0000 mon.smithi061 (mon.0) 592 : audit [DBG] from='client.? 172.21.15.61:0/2729256720' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:25:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:25:50.519126+0000 mgr.smithi067.rdualw (mgr.24569) 1982 : audit [DBG] from='client.35462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:25:52.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:50.656553+0000 mgr.smithi067.rdualw (mgr.24569) 1983 : cluster [DBG] pgmap v1710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:52.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:25:50.874445+0000 mon.smithi061 (mon.0) 592 : audit [DBG] from='client.? 172.21.15.61:0/2729256720' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:25:54.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:52.657015+0000 mgr.smithi067.rdualw (mgr.24569) 1984 : cluster [DBG] pgmap v1711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:52.657015+0000 mgr.smithi067.rdualw (mgr.24569) 1984 : cluster [DBG] pgmap v1711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:54.657740+0000 mgr.smithi067.rdualw (mgr.24569) 1985 : cluster [DBG] pgmap v1712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:54.657740+0000 mgr.smithi067.rdualw (mgr.24569) 1985 : cluster [DBG] pgmap v1712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:25:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:56.658755+0000 mgr.smithi067.rdualw (mgr.24569) 1986 : cluster [DBG] pgmap v1713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:25:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:56.658755+0000 mgr.smithi067.rdualw (mgr.24569) 1986 : cluster [DBG] pgmap v1713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:26:00.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:25:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:25:58.659269+0000 mgr.smithi067.rdualw (mgr.24569) 1987 : cluster [DBG] pgmap v1714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:25:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:25:58.659269+0000 mgr.smithi067.rdualw (mgr.24569) 1987 : cluster [DBG] pgmap v1714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:00.660123+0000 mgr.smithi067.rdualw (mgr.24569) 1988 : cluster [DBG] pgmap v1715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:00.660123+0000 mgr.smithi067.rdualw (mgr.24569) 1988 : cluster [DBG] pgmap v1715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:02.660802+0000 mgr.smithi067.rdualw (mgr.24569) 1989 : cluster [DBG] pgmap v1716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:02.660802+0000 mgr.smithi067.rdualw (mgr.24569) 1989 : cluster [DBG] pgmap v1716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:04.661471+0000 mgr.smithi067.rdualw (mgr.24569) 1990 : cluster [DBG] pgmap v1717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:04.661471+0000 mgr.smithi067.rdualw (mgr.24569) 1990 : cluster [DBG] pgmap v1717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:06.662450+0000 mgr.smithi067.rdualw (mgr.24569) 1991 : cluster [DBG] pgmap v1718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:26:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:06.662450+0000 mgr.smithi067.rdualw (mgr.24569) 1991 : cluster [DBG] pgmap v1718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:26:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:08.663047+0000 mgr.smithi067.rdualw (mgr.24569) 1992 : cluster [DBG] pgmap v1719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:10.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:08.663047+0000 mgr.smithi067.rdualw (mgr.24569) 1992 : cluster [DBG] pgmap v1719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:10.663966+0000 mgr.smithi067.rdualw (mgr.24569) 1993 : cluster [DBG] pgmap v1720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:10.663966+0000 mgr.smithi067.rdualw (mgr.24569) 1993 : cluster [DBG] pgmap v1720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:12.664671+0000 mgr.smithi067.rdualw (mgr.24569) 1994 : cluster [DBG] pgmap v1721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:12.664671+0000 mgr.smithi067.rdualw (mgr.24569) 1994 : cluster [DBG] pgmap v1721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:16.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:14.665346+0000 mgr.smithi067.rdualw (mgr.24569) 1995 : cluster [DBG] pgmap v1722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:16.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:14.665346+0000 mgr.smithi067.rdualw (mgr.24569) 1995 : cluster [DBG] pgmap v1722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:18.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:16.666220+0000 mgr.smithi067.rdualw (mgr.24569) 1996 : cluster [DBG] pgmap v1723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:26:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:16.666220+0000 mgr.smithi067.rdualw (mgr.24569) 1996 : cluster [DBG] pgmap v1723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:26:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:18.666786+0000 mgr.smithi067.rdualw (mgr.24569) 1997 : cluster [DBG] pgmap v1724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:18.666786+0000 mgr.smithi067.rdualw (mgr.24569) 1997 : cluster [DBG] pgmap v1724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:21.183 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:26:21.474 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:26:21.474 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (63m) 5m ago 64m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:26:21.475 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (56m) 5m ago 64m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:26:21.475 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (56m) 5m ago 64m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:26:21.475 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (63m) 5m ago 64m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:26:21.475 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (57m) 5m ago 60m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:26:21.476 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (56m) 5m ago 60m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:26:21.476 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (58m) 5m ago 66m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:26:21.476 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (57m) 5m ago 64m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:26:21.476 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (57m) 5m ago 66m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:26:21.477 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (57m) 5m ago 64m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:26:21.477 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (58m) 5m ago 58m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:26:21.477 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (58m) 5m ago 58m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:26:21.477 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (64m) 5m ago 64m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:26:21.478 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (64m) 5m ago 64m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:26:21.478 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (47m) 5m ago 63m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:26:21.478 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (63m) 5m ago 63m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:26:21.478 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (63m) 5m ago 63m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:26:21.478 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (62m) 5m ago 62m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:26:21.479 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (62m) 5m ago 62m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:26:21.479 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (62m) 5m ago 62m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:26:21.479 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (62m) 5m ago 62m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:26:21.479 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (61m) 5m ago 61m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:26:21.480 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (63m) 5m ago 64m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:26:21.825 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:26:21.826 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:26:21.826 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:26:21.826 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:26:21.826 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:26:21.827 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:26:21.827 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:26:21.827 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:26:21.827 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:26:21.828 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:26:21.828 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:26:21.828 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:26:21.828 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:26:21.828 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:26:21.829 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:26:21.829 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:26:21.829 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:26:21.829 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:26:21.830 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:26:22.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:20.667845+0000 mgr.smithi067.rdualw (mgr.24569) 1998 : cluster [DBG] pgmap v1725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:22.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:26:21.169366+0000 mgr.smithi067.rdualw (mgr.24569) 1999 : audit [DBG] from='client.35470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:26:22.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:26:21.823936+0000 mon.smithi061 (mon.0) 593 : audit [DBG] from='client.? 172.21.15.61:0/4092205921' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:26:22.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:20.667845+0000 mgr.smithi067.rdualw (mgr.24569) 1998 : cluster [DBG] pgmap v1725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:22.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:26:21.169366+0000 mgr.smithi067.rdualw (mgr.24569) 1999 : audit [DBG] from='client.35470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:26:22.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:26:21.823936+0000 mon.smithi061 (mon.0) 593 : audit [DBG] from='client.? 172.21.15.61:0/4092205921' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:26:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:26:21.456061+0000 mgr.smithi067.rdualw (mgr.24569) 2000 : audit [DBG] from='client.35474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:26:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:26:21.456061+0000 mgr.smithi067.rdualw (mgr.24569) 2000 : audit [DBG] from='client.35474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:26:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:22.668401+0000 mgr.smithi067.rdualw (mgr.24569) 2001 : cluster [DBG] pgmap v1726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:26:23.124425+0000 mon.smithi067 (mon.1) 338 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:26:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:26:23.125891+0000 mon.smithi067 (mon.1) 339 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:26:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:26:23.126832+0000 mon.smithi067 (mon.1) 340 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:26:24.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:26:23.127689+0000 mgr.smithi067.rdualw (mgr.24569) 2002 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:26:24.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:26:23.548727+0000 mon.smithi061 (mon.0) 594 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:26:24.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:26:23.554492+0000 mon.smithi061 (mon.0) 595 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:26:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:22.668401+0000 mgr.smithi067.rdualw (mgr.24569) 2001 : cluster [DBG] pgmap v1726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:26:23.124425+0000 mon.smithi067 (mon.1) 338 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:26:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:26:23.125891+0000 mon.smithi067 (mon.1) 339 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:26:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:26:23.126832+0000 mon.smithi067 (mon.1) 340 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:26:24.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:26:23.127689+0000 mgr.smithi067.rdualw (mgr.24569) 2002 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:26:24.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:26:23.548727+0000 mon.smithi061 (mon.0) 594 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:26:24.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:26:23.554492+0000 mon.smithi061 (mon.0) 595 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:26:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:24.669122+0000 mgr.smithi067.rdualw (mgr.24569) 2003 : cluster [DBG] pgmap v1727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:24.669122+0000 mgr.smithi067.rdualw (mgr.24569) 2003 : cluster [DBG] pgmap v1727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:26.670098+0000 mgr.smithi067.rdualw (mgr.24569) 2004 : cluster [DBG] pgmap v1728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:26:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:26.670098+0000 mgr.smithi067.rdualw (mgr.24569) 2004 : cluster [DBG] pgmap v1728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:26:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:28.670676+0000 mgr.smithi067.rdualw (mgr.24569) 2005 : cluster [DBG] pgmap v1729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:28.670676+0000 mgr.smithi067.rdualw (mgr.24569) 2005 : cluster [DBG] pgmap v1729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:30.671820+0000 mgr.smithi067.rdualw (mgr.24569) 2006 : cluster [DBG] pgmap v1730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:30.671820+0000 mgr.smithi067.rdualw (mgr.24569) 2006 : cluster [DBG] pgmap v1730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:32.672324+0000 mgr.smithi067.rdualw (mgr.24569) 2007 : cluster [DBG] pgmap v1731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:32.672324+0000 mgr.smithi067.rdualw (mgr.24569) 2007 : cluster [DBG] pgmap v1731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:26:34.732362+0000 mon.smithi067 (mon.1) 341 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:26:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:26:34.732661+0000 mon.smithi061 (mon.0) 596 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:26:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:26:34.732698+0000 mon.smithi067 (mon.1) 342 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:26:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:26:34.732935+0000 mon.smithi061 (mon.0) 597 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:26:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:26:34.732362+0000 mon.smithi067 (mon.1) 341 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:26:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:26:34.732661+0000 mon.smithi061 (mon.0) 596 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:26:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:26:34.732698+0000 mon.smithi067 (mon.1) 342 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:26:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:26:34.732935+0000 mon.smithi061 (mon.0) 597 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:26:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:34.672979+0000 mgr.smithi067.rdualw (mgr.24569) 2008 : cluster [DBG] pgmap v1732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:34.672979+0000 mgr.smithi067.rdualw (mgr.24569) 2008 : cluster [DBG] pgmap v1732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:36.673916+0000 mgr.smithi067.rdualw (mgr.24569) 2009 : cluster [DBG] pgmap v1733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:26:38.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:36.673916+0000 mgr.smithi067.rdualw (mgr.24569) 2009 : cluster [DBG] pgmap v1733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:26:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:38.674541+0000 mgr.smithi067.rdualw (mgr.24569) 2010 : cluster [DBG] pgmap v1734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:38.674541+0000 mgr.smithi067.rdualw (mgr.24569) 2010 : cluster [DBG] pgmap v1734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:42.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:40.675402+0000 mgr.smithi067.rdualw (mgr.24569) 2011 : cluster [DBG] pgmap v1735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:42.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:40.675402+0000 mgr.smithi067.rdualw (mgr.24569) 2011 : cluster [DBG] pgmap v1735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:44.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:42.675967+0000 mgr.smithi067.rdualw (mgr.24569) 2012 : cluster [DBG] pgmap v1736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:42.675967+0000 mgr.smithi067.rdualw (mgr.24569) 2012 : cluster [DBG] pgmap v1736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:44.676621+0000 mgr.smithi067.rdualw (mgr.24569) 2013 : cluster [DBG] pgmap v1737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:44.676621+0000 mgr.smithi067.rdualw (mgr.24569) 2013 : cluster [DBG] pgmap v1737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:46.677617+0000 mgr.smithi067.rdualw (mgr.24569) 2014 : cluster [DBG] pgmap v1738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:26:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:46.677617+0000 mgr.smithi067.rdualw (mgr.24569) 2014 : cluster [DBG] pgmap v1738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:26:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:48.678287+0000 mgr.smithi067.rdualw (mgr.24569) 2015 : cluster [DBG] pgmap v1739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:50.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:48.678287+0000 mgr.smithi067.rdualw (mgr.24569) 2015 : cluster [DBG] pgmap v1739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:52.135 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:26:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:50.679175+0000 mgr.smithi067.rdualw (mgr.24569) 2016 : cluster [DBG] pgmap v1740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:50.679175+0000 mgr.smithi067.rdualw (mgr.24569) 2016 : cluster [DBG] pgmap v1740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:52.426 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:26:52.427 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (64m) 5m ago 65m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:26:52.427 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (57m) 5m ago 65m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:26:52.427 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (56m) 5m ago 65m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:26:52.428 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (64m) 5m ago 65m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:26:52.428 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (57m) 5m ago 61m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:26:52.428 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (57m) 5m ago 61m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:26:52.428 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (58m) 5m ago 66m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:26:52.429 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (58m) 5m ago 64m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:26:52.429 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (58m) 5m ago 66m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:26:52.429 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (57m) 5m ago 64m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:26:52.429 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (58m) 5m ago 58m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:26:52.429 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (58m) 5m ago 58m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:26:52.430 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (65m) 5m ago 65m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:26:52.430 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (64m) 5m ago 64m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:26:52.430 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (47m) 5m ago 64m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:26:52.430 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (64m) 5m ago 64m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:26:52.431 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (63m) 5m ago 63m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:26:52.431 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (63m) 5m ago 63m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:26:52.431 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (63m) 5m ago 63m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:26:52.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (63m) 5m ago 63m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:26:52.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (62m) 5m ago 62m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:26:52.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (62m) 5m ago 62m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:26:52.432 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (64m) 5m ago 65m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:26:52.795 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:26:52.795 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:26:52.795 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:26:52.796 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:26:52.796 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:26:52.796 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:26:52.796 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:26:52.797 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:26:52.797 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:26:52.797 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:26:52.797 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:26:52.798 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:26:52.798 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:26:52.798 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:26:52.798 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:26:52.798 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:26:52.799 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:26:52.799 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:26:52.799 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:26:53.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:26:52.121119+0000 mgr.smithi067.rdualw (mgr.24569) 2017 : audit [DBG] from='client.35482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:26:53.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:26:52.409065+0000 mgr.smithi067.rdualw (mgr.24569) 2018 : audit [DBG] from='client.35486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:26:53.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:26:52.793546+0000 mon.smithi061 (mon.0) 598 : audit [DBG] from='client.? 172.21.15.61:0/1900359624' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:26:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:26:52.121119+0000 mgr.smithi067.rdualw (mgr.24569) 2017 : audit [DBG] from='client.35482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:26:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:26:52.409065+0000 mgr.smithi067.rdualw (mgr.24569) 2018 : audit [DBG] from='client.35486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:26:53.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:26:52.793546+0000 mon.smithi061 (mon.0) 598 : audit [DBG] from='client.? 172.21.15.61:0/1900359624' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:26:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:52.679667+0000 mgr.smithi067.rdualw (mgr.24569) 2019 : cluster [DBG] pgmap v1741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:54.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:52.679667+0000 mgr.smithi067.rdualw (mgr.24569) 2019 : cluster [DBG] pgmap v1741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:56.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:54.680459+0000 mgr.smithi067.rdualw (mgr.24569) 2020 : cluster [DBG] pgmap v1742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:56.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:54.680459+0000 mgr.smithi067.rdualw (mgr.24569) 2020 : cluster [DBG] pgmap v1742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:26:58.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:56.681373+0000 mgr.smithi067.rdualw (mgr.24569) 2021 : cluster [DBG] pgmap v1743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:26:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:56.681373+0000 mgr.smithi067.rdualw (mgr.24569) 2021 : cluster [DBG] pgmap v1743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:27:00.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:26:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:26:58.682051+0000 mgr.smithi067.rdualw (mgr.24569) 2022 : cluster [DBG] pgmap v1744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:26:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:26:58.682051+0000 mgr.smithi067.rdualw (mgr.24569) 2022 : cluster [DBG] pgmap v1744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:00.682987+0000 mgr.smithi067.rdualw (mgr.24569) 2023 : cluster [DBG] pgmap v1745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:02.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:00.682987+0000 mgr.smithi067.rdualw (mgr.24569) 2023 : cluster [DBG] pgmap v1745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:04.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:02.683691+0000 mgr.smithi067.rdualw (mgr.24569) 2024 : cluster [DBG] pgmap v1746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:04.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:02.683691+0000 mgr.smithi067.rdualw (mgr.24569) 2024 : cluster [DBG] pgmap v1746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:04.684478+0000 mgr.smithi067.rdualw (mgr.24569) 2025 : cluster [DBG] pgmap v1747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:04.684478+0000 mgr.smithi067.rdualw (mgr.24569) 2025 : cluster [DBG] pgmap v1747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:08.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:06.685389+0000 mgr.smithi067.rdualw (mgr.24569) 2026 : cluster [DBG] pgmap v1748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:27:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:06.685389+0000 mgr.smithi067.rdualw (mgr.24569) 2026 : cluster [DBG] pgmap v1748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:27:10.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:08.686136+0000 mgr.smithi067.rdualw (mgr.24569) 2027 : cluster [DBG] pgmap v1749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:08.686136+0000 mgr.smithi067.rdualw (mgr.24569) 2027 : cluster [DBG] pgmap v1749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:10.686947+0000 mgr.smithi067.rdualw (mgr.24569) 2028 : cluster [DBG] pgmap v1750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:10.686947+0000 mgr.smithi067.rdualw (mgr.24569) 2028 : cluster [DBG] pgmap v1750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:14.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:12.687618+0000 mgr.smithi067.rdualw (mgr.24569) 2029 : cluster [DBG] pgmap v1751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:14.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:12.687618+0000 mgr.smithi067.rdualw (mgr.24569) 2029 : cluster [DBG] pgmap v1751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:16.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:14.688220+0000 mgr.smithi067.rdualw (mgr.24569) 2030 : cluster [DBG] pgmap v1752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:14.688220+0000 mgr.smithi067.rdualw (mgr.24569) 2030 : cluster [DBG] pgmap v1752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:16.689152+0000 mgr.smithi067.rdualw (mgr.24569) 2031 : cluster [DBG] pgmap v1753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:27:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:16.689152+0000 mgr.smithi067.rdualw (mgr.24569) 2031 : cluster [DBG] pgmap v1753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:27:20.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:18.689756+0000 mgr.smithi067.rdualw (mgr.24569) 2032 : cluster [DBG] pgmap v1754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:18.689756+0000 mgr.smithi067.rdualw (mgr.24569) 2032 : cluster [DBG] pgmap v1754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:22.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:20.690772+0000 mgr.smithi067.rdualw (mgr.24569) 2033 : cluster [DBG] pgmap v1755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:20.690772+0000 mgr.smithi067.rdualw (mgr.24569) 2033 : cluster [DBG] pgmap v1755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:23.105 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:27:23.396 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:27:23.397 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (64m) 6m ago 66m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:27:23.397 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (57m) 6m ago 65m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:27:23.397 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (57m) 6m ago 65m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:27:23.398 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (64m) 6m ago 65m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:27:23.398 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (58m) 6m ago 61m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:27:23.398 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (57m) 6m ago 61m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:27:23.398 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (59m) 6m ago 67m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:27:23.398 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (58m) 6m ago 65m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:27:23.399 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (58m) 6m ago 67m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:27:23.399 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (58m) 6m ago 65m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:27:23.399 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (59m) 6m ago 59m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:27:23.399 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (59m) 6m ago 59m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:27:23.400 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (65m) 6m ago 65m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:27:23.400 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (65m) 6m ago 65m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:27:23.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (48m) 6m ago 64m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:27:23.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (64m) 6m ago 64m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:27:23.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (64m) 6m ago 64m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:27:23.401 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (64m) 6m ago 63m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:27:23.401 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (63m) 6m ago 63m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:27:23.401 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (63m) 6m ago 63m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:27:23.401 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (63m) 6m ago 63m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:27:23.401 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (63m) 6m ago 63m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:27:23.402 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (64m) 6m ago 65m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:27:23.741 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:27:23.741 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:27:23.742 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:27:23.742 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:27:23.742 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:27:23.743 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:27:23.743 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:27:23.743 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:27:23.743 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:27:23.743 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:27:23.744 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:27:23.744 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:27:23.744 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:27:23.744 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:27:23.745 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:27:23.745 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:27:23.745 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:27:23.745 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:27:23.746 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:27:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:22.691365+0000 mgr.smithi067.rdualw (mgr.24569) 2034 : cluster [DBG] pgmap v1756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:27:23.091498+0000 mgr.smithi067.rdualw (mgr.24569) 2035 : audit [DBG] from='client.35494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:27:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:27:23.378404+0000 mgr.smithi067.rdualw (mgr.24569) 2036 : audit [DBG] from='client.35498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:27:24.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:27:23.558502+0000 mon.smithi067 (mon.1) 343 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:27:24.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:27:23.559953+0000 mon.smithi067 (mon.1) 344 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:27:24.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:27:23.560977+0000 mon.smithi067 (mon.1) 345 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:27:24.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:27:23.739838+0000 mon.smithi061 (mon.0) 599 : audit [DBG] from='client.? 172.21.15.61:0/1739077324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:27:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:22.691365+0000 mgr.smithi067.rdualw (mgr.24569) 2034 : cluster [DBG] pgmap v1756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:27:23.091498+0000 mgr.smithi067.rdualw (mgr.24569) 2035 : audit [DBG] from='client.35494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:27:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:27:23.378404+0000 mgr.smithi067.rdualw (mgr.24569) 2036 : audit [DBG] from='client.35498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:27:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:27:23.558502+0000 mon.smithi067 (mon.1) 343 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:27:24.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:27:23.559953+0000 mon.smithi067 (mon.1) 344 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:27:24.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:27:23.560977+0000 mon.smithi067 (mon.1) 345 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:27:24.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:27:23.739838+0000 mon.smithi061 (mon.0) 599 : audit [DBG] from='client.? 172.21.15.61:0/1739077324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:27:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:27:23.561881+0000 mgr.smithi067.rdualw (mgr.24569) 2037 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:27:25.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:27:23.980705+0000 mon.smithi061 (mon.0) 600 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:27:25.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:27:23.988613+0000 mon.smithi061 (mon.0) 601 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:27:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:27:23.561881+0000 mgr.smithi067.rdualw (mgr.24569) 2037 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:27:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:27:23.980705+0000 mon.smithi061 (mon.0) 600 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:27:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:27:23.988613+0000 mon.smithi061 (mon.0) 601 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:27:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:24.691898+0000 mgr.smithi067.rdualw (mgr.24569) 2038 : cluster [DBG] pgmap v1757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:24.691898+0000 mgr.smithi067.rdualw (mgr.24569) 2038 : cluster [DBG] pgmap v1757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:26.692926+0000 mgr.smithi067.rdualw (mgr.24569) 2039 : cluster [DBG] pgmap v1758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:27:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:26.692926+0000 mgr.smithi067.rdualw (mgr.24569) 2039 : cluster [DBG] pgmap v1758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:27:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:28.693449+0000 mgr.smithi067.rdualw (mgr.24569) 2040 : cluster [DBG] pgmap v1759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:28.693449+0000 mgr.smithi067.rdualw (mgr.24569) 2040 : cluster [DBG] pgmap v1759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:30.694287+0000 mgr.smithi067.rdualw (mgr.24569) 2041 : cluster [DBG] pgmap v1760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:32.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:30.694287+0000 mgr.smithi067.rdualw (mgr.24569) 2041 : cluster [DBG] pgmap v1760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:32.694838+0000 mgr.smithi067.rdualw (mgr.24569) 2042 : cluster [DBG] pgmap v1761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:32.694838+0000 mgr.smithi067.rdualw (mgr.24569) 2042 : cluster [DBG] pgmap v1761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:27:34.737625+0000 mon.smithi067 (mon.1) 346 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:27:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:27:34.737884+0000 mon.smithi067 (mon.1) 347 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:27:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:27:34.737895+0000 mon.smithi061 (mon.0) 602 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:27:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:27:34.738168+0000 mon.smithi061 (mon.0) 603 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:27:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:27:34.737625+0000 mon.smithi067 (mon.1) 346 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:27:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:27:34.737884+0000 mon.smithi067 (mon.1) 347 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:27:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:27:34.737895+0000 mon.smithi061 (mon.0) 602 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:27:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:27:34.738168+0000 mon.smithi061 (mon.0) 603 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:27:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:34.695446+0000 mgr.smithi067.rdualw (mgr.24569) 2043 : cluster [DBG] pgmap v1762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:34.695446+0000 mgr.smithi067.rdualw (mgr.24569) 2043 : cluster [DBG] pgmap v1762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:36.696363+0000 mgr.smithi067.rdualw (mgr.24569) 2044 : cluster [DBG] pgmap v1763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:27:38.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:36.696363+0000 mgr.smithi067.rdualw (mgr.24569) 2044 : cluster [DBG] pgmap v1763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:27:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:38.697030+0000 mgr.smithi067.rdualw (mgr.24569) 2045 : cluster [DBG] pgmap v1764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:38.697030+0000 mgr.smithi067.rdualw (mgr.24569) 2045 : cluster [DBG] pgmap v1764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:40.697999+0000 mgr.smithi067.rdualw (mgr.24569) 2046 : cluster [DBG] pgmap v1765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:40.697999+0000 mgr.smithi067.rdualw (mgr.24569) 2046 : cluster [DBG] pgmap v1765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:42.698804+0000 mgr.smithi067.rdualw (mgr.24569) 2047 : cluster [DBG] pgmap v1766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:42.698804+0000 mgr.smithi067.rdualw (mgr.24569) 2047 : cluster [DBG] pgmap v1766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:44.699427+0000 mgr.smithi067.rdualw (mgr.24569) 2048 : cluster [DBG] pgmap v1767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:44.699427+0000 mgr.smithi067.rdualw (mgr.24569) 2048 : cluster [DBG] pgmap v1767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:46.700523+0000 mgr.smithi067.rdualw (mgr.24569) 2049 : cluster [DBG] pgmap v1768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:27:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:46.700523+0000 mgr.smithi067.rdualw (mgr.24569) 2049 : cluster [DBG] pgmap v1768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:27:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:48.701130+0000 mgr.smithi067.rdualw (mgr.24569) 2050 : cluster [DBG] pgmap v1769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:48.701130+0000 mgr.smithi067.rdualw (mgr.24569) 2050 : cluster [DBG] pgmap v1769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:52.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:50.702188+0000 mgr.smithi067.rdualw (mgr.24569) 2051 : cluster [DBG] pgmap v1770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:50.702188+0000 mgr.smithi067.rdualw (mgr.24569) 2051 : cluster [DBG] pgmap v1770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:54.060 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:27:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:52.702736+0000 mgr.smithi067.rdualw (mgr.24569) 2052 : cluster [DBG] pgmap v1771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:54.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:52.702736+0000 mgr.smithi067.rdualw (mgr.24569) 2052 : cluster [DBG] pgmap v1771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:54.349 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:27:54.350 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (65m) 6m ago 66m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:27:54.350 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (58m) 6m ago 66m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:27:54.351 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (57m) 6m ago 66m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:27:54.351 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (65m) 6m ago 66m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:27:54.351 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (58m) 6m ago 62m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:27:54.351 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (58m) 6m ago 62m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:27:54.351 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (59m) 6m ago 67m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:27:54.352 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (59m) 6m ago 65m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:27:54.352 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (59m) 6m ago 67m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:27:54.352 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (58m) 6m ago 65m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:27:54.353 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (59m) 6m ago 59m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:27:54.353 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (59m) 6m ago 59m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:27:54.354 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (66m) 6m ago 66m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:27:54.354 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (65m) 6m ago 65m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:27:54.354 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (48m) 6m ago 65m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:27:54.354 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (65m) 6m ago 65m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:27:54.355 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (64m) 6m ago 64m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:27:54.356 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (64m) 6m ago 64m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:27:54.356 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (64m) 6m ago 64m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:27:54.356 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (64m) 6m ago 64m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:27:54.357 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (63m) 6m ago 63m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:27:54.357 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (63m) 6m ago 63m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:27:54.358 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (65m) 6m ago 66m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:27:54.723 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:27:54.724 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:27:54.724 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:27:54.724 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:27:54.724 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:27:54.725 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:27:54.725 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:27:54.725 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:27:54.725 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:27:54.725 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:27:54.726 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:27:54.726 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:27:54.726 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:27:54.726 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:27:54.727 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:27:54.727 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:27:54.727 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:27:54.727 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:27:54.728 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:27:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:27:54.046445+0000 mgr.smithi067.rdualw (mgr.24569) 2053 : audit [DBG] from='client.35506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:27:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:27:54.331150+0000 mgr.smithi067.rdualw (mgr.24569) 2054 : audit [DBG] from='client.35510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:27:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:27:54.722092+0000 mon.smithi061 (mon.0) 604 : audit [DBG] from='client.? 172.21.15.61:0/154206738' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:27:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:27:54.046445+0000 mgr.smithi067.rdualw (mgr.24569) 2053 : audit [DBG] from='client.35506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:27:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:27:54.331150+0000 mgr.smithi067.rdualw (mgr.24569) 2054 : audit [DBG] from='client.35510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:27:55.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:27:54.722092+0000 mon.smithi061 (mon.0) 604 : audit [DBG] from='client.? 172.21.15.61:0/154206738' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:27:56.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:54.703312+0000 mgr.smithi067.rdualw (mgr.24569) 2055 : cluster [DBG] pgmap v1772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:54.703312+0000 mgr.smithi067.rdualw (mgr.24569) 2055 : cluster [DBG] pgmap v1772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:27:58.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:27:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:56.704208+0000 mgr.smithi067.rdualw (mgr.24569) 2056 : cluster [DBG] pgmap v1773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:27:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:27:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:56.704208+0000 mgr.smithi067.rdualw (mgr.24569) 2056 : cluster [DBG] pgmap v1773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:28:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:27:58.704817+0000 mgr.smithi067.rdualw (mgr.24569) 2057 : cluster [DBG] pgmap v1774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:00.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:27:58.704817+0000 mgr.smithi067.rdualw (mgr.24569) 2057 : cluster [DBG] pgmap v1774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:00.705758+0000 mgr.smithi067.rdualw (mgr.24569) 2058 : cluster [DBG] pgmap v1775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:02.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:00.705758+0000 mgr.smithi067.rdualw (mgr.24569) 2058 : cluster [DBG] pgmap v1775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:02.706488+0000 mgr.smithi067.rdualw (mgr.24569) 2059 : cluster [DBG] pgmap v1776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:02.706488+0000 mgr.smithi067.rdualw (mgr.24569) 2059 : cluster [DBG] pgmap v1776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:04.707090+0000 mgr.smithi067.rdualw (mgr.24569) 2060 : cluster [DBG] pgmap v1777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:04.707090+0000 mgr.smithi067.rdualw (mgr.24569) 2060 : cluster [DBG] pgmap v1777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:08.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:06.707904+0000 mgr.smithi067.rdualw (mgr.24569) 2061 : cluster [DBG] pgmap v1778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:28:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:06.707904+0000 mgr.smithi067.rdualw (mgr.24569) 2061 : cluster [DBG] pgmap v1778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:28:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:08.708556+0000 mgr.smithi067.rdualw (mgr.24569) 2062 : cluster [DBG] pgmap v1779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:08.708556+0000 mgr.smithi067.rdualw (mgr.24569) 2062 : cluster [DBG] pgmap v1779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:12.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:10.709490+0000 mgr.smithi067.rdualw (mgr.24569) 2063 : cluster [DBG] pgmap v1780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:12.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:10.709490+0000 mgr.smithi067.rdualw (mgr.24569) 2063 : cluster [DBG] pgmap v1780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:14.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:12.710105+0000 mgr.smithi067.rdualw (mgr.24569) 2064 : cluster [DBG] pgmap v1781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:12.710105+0000 mgr.smithi067.rdualw (mgr.24569) 2064 : cluster [DBG] pgmap v1781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:14.710717+0000 mgr.smithi067.rdualw (mgr.24569) 2065 : cluster [DBG] pgmap v1782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:14.710717+0000 mgr.smithi067.rdualw (mgr.24569) 2065 : cluster [DBG] pgmap v1782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:16.711638+0000 mgr.smithi067.rdualw (mgr.24569) 2066 : cluster [DBG] pgmap v1783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:28:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:16.711638+0000 mgr.smithi067.rdualw (mgr.24569) 2066 : cluster [DBG] pgmap v1783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:28:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:18.712176+0000 mgr.smithi067.rdualw (mgr.24569) 2067 : cluster [DBG] pgmap v1784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:18.712176+0000 mgr.smithi067.rdualw (mgr.24569) 2067 : cluster [DBG] pgmap v1784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:22.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:20.712975+0000 mgr.smithi067.rdualw (mgr.24569) 2068 : cluster [DBG] pgmap v1785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:20.712975+0000 mgr.smithi067.rdualw (mgr.24569) 2068 : cluster [DBG] pgmap v1785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:22.713503+0000 mgr.smithi067.rdualw (mgr.24569) 2069 : cluster [DBG] pgmap v1786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:24.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:28:23.992345+0000 mon.smithi067 (mon.1) 348 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:28:24.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:28:23.993790+0000 mon.smithi067 (mon.1) 349 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:28:24.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:28:23.994721+0000 mon.smithi067 (mon.1) 350 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:28:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:22.713503+0000 mgr.smithi067.rdualw (mgr.24569) 2069 : cluster [DBG] pgmap v1786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:28:23.992345+0000 mon.smithi067 (mon.1) 348 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:28:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:28:23.993790+0000 mon.smithi067 (mon.1) 349 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:28:24.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:28:23.994721+0000 mon.smithi067 (mon.1) 350 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:28:25.109 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:28:25.403 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:28:25.403 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (65m) 7m ago 67m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:28:25.404 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (58m) 7m ago 67m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:28:25.404 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (58m) 7m ago 66m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:28:25.404 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (65m) 7m ago 66m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:28:25.404 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (59m) 7m ago 62m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:28:25.404 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (58m) 7m ago 62m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:28:25.405 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (60m) 7m ago 68m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:28:25.405 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (59m) 7m ago 66m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:28:25.405 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (59m) 7m ago 68m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:28:25.405 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (59m) 7m ago 66m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:28:25.406 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (60m) 7m ago 60m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:28:25.406 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (60m) 7m ago 60m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:28:25.406 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (66m) 7m ago 66m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:28:25.406 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (66m) 7m ago 66m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:28:25.406 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (49m) 7m ago 65m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:28:25.407 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (65m) 7m ago 65m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:28:25.407 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (65m) 7m ago 65m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:28:25.407 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (65m) 7m ago 65m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:28:25.407 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (64m) 7m ago 64m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:28:25.408 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (64m) 7m ago 64m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:28:25.408 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (64m) 7m ago 64m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:28:25.408 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (64m) 7m ago 64m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:28:25.408 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (65m) 7m ago 66m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:28:25.749 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:28:25.750 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:28:25.750 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:28:25.750 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:28:25.751 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:28:25.751 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:28:25.751 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:28:25.751 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:28:25.752 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:28:25.752 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:28:25.752 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:28:25.752 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:28:25.753 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:28:25.753 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:28:25.753 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:28:25.753 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:28:25.753 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:28:25.754 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:28:25.754 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:28:25.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:28:23.995559+0000 mgr.smithi067.rdualw (mgr.24569) 2070 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:28:25.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:28:24.405395+0000 mon.smithi061 (mon.0) 605 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:28:25.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:28:24.411987+0000 mon.smithi061 (mon.0) 606 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:28:25.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:28:23.995559+0000 mgr.smithi067.rdualw (mgr.24569) 2070 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:28:25.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:28:24.405395+0000 mon.smithi061 (mon.0) 605 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:28:25.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:28:24.411987+0000 mon.smithi061 (mon.0) 606 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:28:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:24.714005+0000 mgr.smithi067.rdualw (mgr.24569) 2071 : cluster [DBG] pgmap v1787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:28:25.093833+0000 mgr.smithi067.rdualw (mgr.24569) 2072 : audit [DBG] from='client.35518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:28:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:28:25.385549+0000 mgr.smithi067.rdualw (mgr.24569) 2073 : audit [DBG] from='client.35522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:28:26.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:28:25.748173+0000 mon.smithi061 (mon.0) 607 : audit [DBG] from='client.? 172.21.15.61:0/1324005846' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:28:26.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:24.714005+0000 mgr.smithi067.rdualw (mgr.24569) 2071 : cluster [DBG] pgmap v1787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:28:25.093833+0000 mgr.smithi067.rdualw (mgr.24569) 2072 : audit [DBG] from='client.35518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:28:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:28:25.385549+0000 mgr.smithi067.rdualw (mgr.24569) 2073 : audit [DBG] from='client.35522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:28:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:28:25.748173+0000 mon.smithi061 (mon.0) 607 : audit [DBG] from='client.? 172.21.15.61:0/1324005846' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:28:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:26.714890+0000 mgr.smithi067.rdualw (mgr.24569) 2074 : cluster [DBG] pgmap v1788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:28:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:26.714890+0000 mgr.smithi067.rdualw (mgr.24569) 2074 : cluster [DBG] pgmap v1788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:28:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:28.715508+0000 mgr.smithi067.rdualw (mgr.24569) 2075 : cluster [DBG] pgmap v1789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:28.715508+0000 mgr.smithi067.rdualw (mgr.24569) 2075 : cluster [DBG] pgmap v1789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:30.716466+0000 mgr.smithi067.rdualw (mgr.24569) 2076 : cluster [DBG] pgmap v1790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:30.716466+0000 mgr.smithi067.rdualw (mgr.24569) 2076 : cluster [DBG] pgmap v1790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:32.717174+0000 mgr.smithi067.rdualw (mgr.24569) 2077 : cluster [DBG] pgmap v1791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:32.717174+0000 mgr.smithi067.rdualw (mgr.24569) 2077 : cluster [DBG] pgmap v1791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:28:34.743103+0000 mon.smithi067 (mon.1) 351 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:28:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:28:34.743367+0000 mon.smithi061 (mon.0) 608 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:28:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:28:34.743426+0000 mon.smithi067 (mon.1) 352 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:28:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:28:34.743605+0000 mon.smithi061 (mon.0) 609 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:28:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:28:34.743103+0000 mon.smithi067 (mon.1) 351 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:28:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:28:34.743367+0000 mon.smithi061 (mon.0) 608 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:28:35.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:28:34.743426+0000 mon.smithi067 (mon.1) 352 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:28:35.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:28:34.743605+0000 mon.smithi061 (mon.0) 609 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:28:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:34.717900+0000 mgr.smithi067.rdualw (mgr.24569) 2078 : cluster [DBG] pgmap v1792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:34.717900+0000 mgr.smithi067.rdualw (mgr.24569) 2078 : cluster [DBG] pgmap v1792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:36.718719+0000 mgr.smithi067.rdualw (mgr.24569) 2079 : cluster [DBG] pgmap v1793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:28:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:36.718719+0000 mgr.smithi067.rdualw (mgr.24569) 2079 : cluster [DBG] pgmap v1793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:28:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:38.719216+0000 mgr.smithi067.rdualw (mgr.24569) 2080 : cluster [DBG] pgmap v1794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:38.719216+0000 mgr.smithi067.rdualw (mgr.24569) 2080 : cluster [DBG] pgmap v1794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:42.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:40.720072+0000 mgr.smithi067.rdualw (mgr.24569) 2081 : cluster [DBG] pgmap v1795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:40.720072+0000 mgr.smithi067.rdualw (mgr.24569) 2081 : cluster [DBG] pgmap v1795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:44.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:42.720629+0000 mgr.smithi067.rdualw (mgr.24569) 2082 : cluster [DBG] pgmap v1796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:42.720629+0000 mgr.smithi067.rdualw (mgr.24569) 2082 : cluster [DBG] pgmap v1796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:44.721260+0000 mgr.smithi067.rdualw (mgr.24569) 2083 : cluster [DBG] pgmap v1797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:44.721260+0000 mgr.smithi067.rdualw (mgr.24569) 2083 : cluster [DBG] pgmap v1797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:46.722310+0000 mgr.smithi067.rdualw (mgr.24569) 2084 : cluster [DBG] pgmap v1798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:28:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:46.722310+0000 mgr.smithi067.rdualw (mgr.24569) 2084 : cluster [DBG] pgmap v1798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:28:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:48.722912+0000 mgr.smithi067.rdualw (mgr.24569) 2085 : cluster [DBG] pgmap v1799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:48.722912+0000 mgr.smithi067.rdualw (mgr.24569) 2085 : cluster [DBG] pgmap v1799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:50.723969+0000 mgr.smithi067.rdualw (mgr.24569) 2086 : cluster [DBG] pgmap v1800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:50.723969+0000 mgr.smithi067.rdualw (mgr.24569) 2086 : cluster [DBG] pgmap v1800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:52.724678+0000 mgr.smithi067.rdualw (mgr.24569) 2087 : cluster [DBG] pgmap v1801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:52.724678+0000 mgr.smithi067.rdualw (mgr.24569) 2087 : cluster [DBG] pgmap v1801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:54.725275+0000 mgr.smithi067.rdualw (mgr.24569) 2088 : cluster [DBG] pgmap v1802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:56.059 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:28:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:54.725275+0000 mgr.smithi067.rdualw (mgr.24569) 2088 : cluster [DBG] pgmap v1802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:28:56.349 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:28:56.350 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (66m) 7m ago 67m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:28:56.350 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (59m) 7m ago 67m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:28:56.350 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (58m) 7m ago 67m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:28:56.350 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (66m) 7m ago 67m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:28:56.351 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (59m) 7m ago 63m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:28:56.351 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (59m) 7m ago 63m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:28:56.351 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (60m) 7m ago 68m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:28:56.351 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (60m) 7m ago 66m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:28:56.352 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (60m) 7m ago 68m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:28:56.352 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (59m) 7m ago 66m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:28:56.352 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (60m) 7m ago 60m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:28:56.352 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (60m) 7m ago 60m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:28:56.352 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (67m) 7m ago 67m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:28:56.353 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (66m) 7m ago 66m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:28:56.353 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (49m) 7m ago 66m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:28:56.353 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (66m) 7m ago 66m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:28:56.353 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (65m) 7m ago 65m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:28:56.354 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (65m) 7m ago 65m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:28:56.354 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (65m) 7m ago 65m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:28:56.354 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (65m) 7m ago 65m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:28:56.354 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (64m) 7m ago 64m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:28:56.354 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (64m) 7m ago 64m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:28:56.355 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (66m) 7m ago 67m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:28:56.689 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:28:56.690 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:28:56.690 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:28:56.690 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:28:56.690 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:28:56.691 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:28:56.691 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:28:56.691 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:28:56.691 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:28:56.691 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:28:56.692 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:28:56.692 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:28:56.692 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:28:56.692 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:28:56.693 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:28:56.693 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:28:56.693 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:28:56.693 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:28:56.693 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:28:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:28:56.045265+0000 mgr.smithi067.rdualw (mgr.24569) 2089 : audit [DBG] from='client.35530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:28:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:28:56.331982+0000 mgr.smithi067.rdualw (mgr.24569) 2090 : audit [DBG] from='client.35534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:28:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:28:56.687839+0000 mon.smithi061 (mon.0) 610 : audit [DBG] from='client.? 172.21.15.61:0/2070163102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:28:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:28:56.045265+0000 mgr.smithi067.rdualw (mgr.24569) 2089 : audit [DBG] from='client.35530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:28:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:28:56.331982+0000 mgr.smithi067.rdualw (mgr.24569) 2090 : audit [DBG] from='client.35534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:28:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:28:56.687839+0000 mon.smithi061 (mon.0) 610 : audit [DBG] from='client.? 172.21.15.61:0/2070163102' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:28:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:56.726106+0000 mgr.smithi067.rdualw (mgr.24569) 2091 : cluster [DBG] pgmap v1803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:28:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:56.726106+0000 mgr.smithi067.rdualw (mgr.24569) 2091 : cluster [DBG] pgmap v1803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:29:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:28:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:28:58.726694+0000 mgr.smithi067.rdualw (mgr.24569) 2092 : cluster [DBG] pgmap v1804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:28:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:28:58.726694+0000 mgr.smithi067.rdualw (mgr.24569) 2092 : cluster [DBG] pgmap v1804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:00.727566+0000 mgr.smithi067.rdualw (mgr.24569) 2093 : cluster [DBG] pgmap v1805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:00.727566+0000 mgr.smithi067.rdualw (mgr.24569) 2093 : cluster [DBG] pgmap v1805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:02.728124+0000 mgr.smithi067.rdualw (mgr.24569) 2094 : cluster [DBG] pgmap v1806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:02.728124+0000 mgr.smithi067.rdualw (mgr.24569) 2094 : cluster [DBG] pgmap v1806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:04.728764+0000 mgr.smithi067.rdualw (mgr.24569) 2095 : cluster [DBG] pgmap v1807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:04.728764+0000 mgr.smithi067.rdualw (mgr.24569) 2095 : cluster [DBG] pgmap v1807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:06.729798+0000 mgr.smithi067.rdualw (mgr.24569) 2096 : cluster [DBG] pgmap v1808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:29:08.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:06.729798+0000 mgr.smithi067.rdualw (mgr.24569) 2096 : cluster [DBG] pgmap v1808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:29:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:08.730490+0000 mgr.smithi067.rdualw (mgr.24569) 2097 : cluster [DBG] pgmap v1809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:08.730490+0000 mgr.smithi067.rdualw (mgr.24569) 2097 : cluster [DBG] pgmap v1809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:10.731323+0000 mgr.smithi067.rdualw (mgr.24569) 2098 : cluster [DBG] pgmap v1810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:12.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:10.731323+0000 mgr.smithi067.rdualw (mgr.24569) 2098 : cluster [DBG] pgmap v1810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:12.732018+0000 mgr.smithi067.rdualw (mgr.24569) 2099 : cluster [DBG] pgmap v1811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:14.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:12.732018+0000 mgr.smithi067.rdualw (mgr.24569) 2099 : cluster [DBG] pgmap v1811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:14.732662+0000 mgr.smithi067.rdualw (mgr.24569) 2100 : cluster [DBG] pgmap v1812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:14.732662+0000 mgr.smithi067.rdualw (mgr.24569) 2100 : cluster [DBG] pgmap v1812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:16.733470+0000 mgr.smithi067.rdualw (mgr.24569) 2101 : cluster [DBG] pgmap v1813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:29:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:16.733470+0000 mgr.smithi067.rdualw (mgr.24569) 2101 : cluster [DBG] pgmap v1813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:29:20.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:18.734078+0000 mgr.smithi067.rdualw (mgr.24569) 2102 : cluster [DBG] pgmap v1814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:18.734078+0000 mgr.smithi067.rdualw (mgr.24569) 2102 : cluster [DBG] pgmap v1814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:20.735096+0000 mgr.smithi067.rdualw (mgr.24569) 2103 : cluster [DBG] pgmap v1815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:20.735096+0000 mgr.smithi067.rdualw (mgr.24569) 2103 : cluster [DBG] pgmap v1815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:22.735648+0000 mgr.smithi067.rdualw (mgr.24569) 2104 : cluster [DBG] pgmap v1816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:22.735648+0000 mgr.smithi067.rdualw (mgr.24569) 2104 : cluster [DBG] pgmap v1816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:25.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:29:24.417675+0000 mon.smithi067 (mon.1) 353 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:29:25.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:29:24.419135+0000 mon.smithi067 (mon.1) 354 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:29:25.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:29:24.420069+0000 mon.smithi067 (mon.1) 355 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:29:25.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:29:24.420910+0000 mgr.smithi067.rdualw (mgr.24569) 2105 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:29:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:29:24.417675+0000 mon.smithi067 (mon.1) 353 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:29:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:29:24.419135+0000 mon.smithi067 (mon.1) 354 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:29:25.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:29:24.420069+0000 mon.smithi067 (mon.1) 355 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:29:25.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:29:24.420910+0000 mgr.smithi067.rdualw (mgr.24569) 2105 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:29:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:24.736312+0000 mgr.smithi067.rdualw (mgr.24569) 2106 : cluster [DBG] pgmap v1817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:29:24.834538+0000 mon.smithi061 (mon.0) 611 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:29:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:29:24.841303+0000 mon.smithi061 (mon.0) 612 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:29:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:24.736312+0000 mgr.smithi067.rdualw (mgr.24569) 2106 : cluster [DBG] pgmap v1817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:29:24.834538+0000 mon.smithi061 (mon.0) 611 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:29:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:29:24.841303+0000 mon.smithi061 (mon.0) 612 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:29:27.008 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:29:27.396 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:29:27.396 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (66m) 8m ago 68m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:29:27.396 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (59m) 8m ago 68m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:29:27.397 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (59m) 8m ago 67m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:29:27.397 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (66m) 8m ago 67m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:29:27.397 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (60m) 8m ago 63m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:29:27.397 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (59m) 8m ago 63m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:29:27.398 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (61m) 8m ago 69m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:29:27.398 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (60m) 8m ago 67m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:29:27.398 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (60m) 8m ago 69m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:29:27.398 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (60m) 8m ago 67m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:29:27.399 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (61m) 8m ago 61m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:29:27.399 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (61m) 8m ago 61m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:29:27.399 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (67m) 8m ago 67m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:29:27.399 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (67m) 8m ago 67m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:29:27.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (50m) 8m ago 66m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:29:27.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (66m) 8m ago 66m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:29:27.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (66m) 8m ago 66m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:29:27.401 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (66m) 8m ago 66m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:29:27.401 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (65m) 8m ago 65m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:29:27.401 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (65m) 8m ago 65m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:29:27.401 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (65m) 8m ago 65m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:29:27.402 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (65m) 8m ago 65m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:29:27.402 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (66m) 8m ago 67m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:29:27.739 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:29:27.739 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:29:27.739 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:29:27.740 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:29:27.740 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:29:27.740 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:29:27.740 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:29:27.740 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:29:27.741 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:29:27.741 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:29:27.741 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:29:27.741 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:29:27.742 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:29:27.742 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:29:27.742 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:29:27.742 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:29:27.742 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:29:27.743 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:29:27.743 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:29:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:26.737271+0000 mgr.smithi067.rdualw (mgr.24569) 2107 : cluster [DBG] pgmap v1818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:29:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:29:26.992705+0000 mgr.smithi067.rdualw (mgr.24569) 2108 : audit [DBG] from='client.35542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:29:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:29:27.377864+0000 mgr.smithi067.rdualw (mgr.24569) 2109 : audit [DBG] from='client.35546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:29:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:29:27.737419+0000 mon.smithi061 (mon.0) 613 : audit [DBG] from='client.? 172.21.15.61:0/730607209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:29:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:26.737271+0000 mgr.smithi067.rdualw (mgr.24569) 2107 : cluster [DBG] pgmap v1818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:29:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:29:26.992705+0000 mgr.smithi067.rdualw (mgr.24569) 2108 : audit [DBG] from='client.35542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:29:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:29:27.377864+0000 mgr.smithi067.rdualw (mgr.24569) 2109 : audit [DBG] from='client.35546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:29:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:29:27.737419+0000 mon.smithi061 (mon.0) 613 : audit [DBG] from='client.? 172.21.15.61:0/730607209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:29:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:28.738022+0000 mgr.smithi067.rdualw (mgr.24569) 2110 : cluster [DBG] pgmap v1819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:28.738022+0000 mgr.smithi067.rdualw (mgr.24569) 2110 : cluster [DBG] pgmap v1819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:30.739016+0000 mgr.smithi067.rdualw (mgr.24569) 2111 : cluster [DBG] pgmap v1820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:30.739016+0000 mgr.smithi067.rdualw (mgr.24569) 2111 : cluster [DBG] pgmap v1820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:32.739616+0000 mgr.smithi067.rdualw (mgr.24569) 2112 : cluster [DBG] pgmap v1821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:32.739616+0000 mgr.smithi067.rdualw (mgr.24569) 2112 : cluster [DBG] pgmap v1821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:29:34.748770+0000 mon.smithi067 (mon.1) 356 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:29:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:29:34.749017+0000 mon.smithi067 (mon.1) 357 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:29:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:29:34.749170+0000 mon.smithi061 (mon.0) 614 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:29:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:29:34.749744+0000 mon.smithi061 (mon.0) 615 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:29:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:29:34.748770+0000 mon.smithi067 (mon.1) 356 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:29:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:29:34.749017+0000 mon.smithi067 (mon.1) 357 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:29:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:29:34.749170+0000 mon.smithi061 (mon.0) 614 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:29:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:29:34.749744+0000 mon.smithi061 (mon.0) 615 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:29:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:34.740151+0000 mgr.smithi067.rdualw (mgr.24569) 2113 : cluster [DBG] pgmap v1822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:34.740151+0000 mgr.smithi067.rdualw (mgr.24569) 2113 : cluster [DBG] pgmap v1822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:36.741076+0000 mgr.smithi067.rdualw (mgr.24569) 2114 : cluster [DBG] pgmap v1823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:29:38.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:36.741076+0000 mgr.smithi067.rdualw (mgr.24569) 2114 : cluster [DBG] pgmap v1823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:29:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:38.741783+0000 mgr.smithi067.rdualw (mgr.24569) 2115 : cluster [DBG] pgmap v1824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:40.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:38.741783+0000 mgr.smithi067.rdualw (mgr.24569) 2115 : cluster [DBG] pgmap v1824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:40.742658+0000 mgr.smithi067.rdualw (mgr.24569) 2116 : cluster [DBG] pgmap v1825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:40.742658+0000 mgr.smithi067.rdualw (mgr.24569) 2116 : cluster [DBG] pgmap v1825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:44.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:42.743230+0000 mgr.smithi067.rdualw (mgr.24569) 2117 : cluster [DBG] pgmap v1826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:42.743230+0000 mgr.smithi067.rdualw (mgr.24569) 2117 : cluster [DBG] pgmap v1826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:44.743970+0000 mgr.smithi067.rdualw (mgr.24569) 2118 : cluster [DBG] pgmap v1827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:46.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:44.743970+0000 mgr.smithi067.rdualw (mgr.24569) 2118 : cluster [DBG] pgmap v1827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:46.744801+0000 mgr.smithi067.rdualw (mgr.24569) 2119 : cluster [DBG] pgmap v1828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:29:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:46.744801+0000 mgr.smithi067.rdualw (mgr.24569) 2119 : cluster [DBG] pgmap v1828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:29:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:48.745335+0000 mgr.smithi067.rdualw (mgr.24569) 2120 : cluster [DBG] pgmap v1829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:48.745335+0000 mgr.smithi067.rdualw (mgr.24569) 2120 : cluster [DBG] pgmap v1829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:52.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:50.746184+0000 mgr.smithi067.rdualw (mgr.24569) 2121 : cluster [DBG] pgmap v1830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:50.746184+0000 mgr.smithi067.rdualw (mgr.24569) 2121 : cluster [DBG] pgmap v1830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:52.746753+0000 mgr.smithi067.rdualw (mgr.24569) 2122 : cluster [DBG] pgmap v1831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:52.746753+0000 mgr.smithi067.rdualw (mgr.24569) 2122 : cluster [DBG] pgmap v1831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:56.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:54.747465+0000 mgr.smithi067.rdualw (mgr.24569) 2123 : cluster [DBG] pgmap v1832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:56.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:54.747465+0000 mgr.smithi067.rdualw (mgr.24569) 2123 : cluster [DBG] pgmap v1832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:29:58.090 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:29:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:56.748419+0000 mgr.smithi067.rdualw (mgr.24569) 2124 : cluster [DBG] pgmap v1833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:29:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:56.748419+0000 mgr.smithi067.rdualw (mgr.24569) 2124 : cluster [DBG] pgmap v1833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:29:58.385 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:29:58.385 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (67m) 8m ago 68m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:29:58.385 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (60m) 8m ago 68m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:29:58.386 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (60m) 8m ago 68m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:29:58.386 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (67m) 8m ago 68m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:29:58.386 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (60m) 8m ago 64m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:29:58.387 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (60m) 8m ago 64m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:29:58.387 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (61m) 8m ago 69m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:29:58.387 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (61m) 8m ago 68m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:29:58.387 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (61m) 8m ago 69m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:29:58.388 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (60m) 8m ago 67m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:29:58.388 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (61m) 8m ago 61m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:29:58.388 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (61m) 8m ago 61m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:29:58.389 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (68m) 8m ago 68m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:29:58.389 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (67m) 8m ago 67m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:29:58.389 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (51m) 8m ago 67m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:29:58.389 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (67m) 8m ago 67m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:29:58.389 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (66m) 8m ago 66m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:29:58.390 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (66m) 8m ago 66m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:29:58.390 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (66m) 8m ago 66m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:29:58.390 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (66m) 8m ago 66m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:29:58.390 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (65m) 8m ago 65m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:29:58.391 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (65m) 8m ago 65m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:29:58.391 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (67m) 8m ago 68m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:29:58.725 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:29:58.726 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:29:58.726 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:29:58.726 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:29:58.727 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:29:58.727 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:29:58.727 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:29:58.727 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:29:58.727 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:29:58.728 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:29:58.728 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:29:58.728 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:29:58.728 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:29:58.729 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:29:58.729 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:29:58.729 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:29:58.729 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:29:58.730 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:29:58.730 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:29:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:29:58.074763+0000 mgr.smithi067.rdualw (mgr.24569) 2125 : audit [DBG] from='client.35554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:29:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:29:58.367058+0000 mgr.smithi067.rdualw (mgr.24569) 2126 : audit [DBG] from='client.35558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:29:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:29:58.724108+0000 mon.smithi061 (mon.0) 616 : audit [DBG] from='client.? 172.21.15.61:0/516607980' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:29:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:29:58.074763+0000 mgr.smithi067.rdualw (mgr.24569) 2125 : audit [DBG] from='client.35554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:29:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:29:58.367058+0000 mgr.smithi067.rdualw (mgr.24569) 2126 : audit [DBG] from='client.35558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:29:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:29:58.724108+0000 mon.smithi061 (mon.0) 616 : audit [DBG] from='client.? 172.21.15.61:0/516607980' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:30:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:29:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:29:58.748958+0000 mgr.smithi067.rdualw (mgr.24569) 2127 : cluster [DBG] pgmap v1834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:00.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:29:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:29:58.748958+0000 mgr.smithi067.rdualw (mgr.24569) 2127 : cluster [DBG] pgmap v1834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:01.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:00.000126+0000 mon.smithi061 (mon.0) 617 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T16:30:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:00.000126+0000 mon.smithi061 (mon.0) 617 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T16:30:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:00.749934+0000 mgr.smithi067.rdualw (mgr.24569) 2128 : cluster [DBG] pgmap v1835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:00.749934+0000 mgr.smithi067.rdualw (mgr.24569) 2128 : cluster [DBG] pgmap v1835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:02.750590+0000 mgr.smithi067.rdualw (mgr.24569) 2129 : cluster [DBG] pgmap v1836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:02.750590+0000 mgr.smithi067.rdualw (mgr.24569) 2129 : cluster [DBG] pgmap v1836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:04.751123+0000 mgr.smithi067.rdualw (mgr.24569) 2130 : cluster [DBG] pgmap v1837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:04.751123+0000 mgr.smithi067.rdualw (mgr.24569) 2130 : cluster [DBG] pgmap v1837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:06.751931+0000 mgr.smithi067.rdualw (mgr.24569) 2131 : cluster [DBG] pgmap v1838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:30:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:06.751931+0000 mgr.smithi067.rdualw (mgr.24569) 2131 : cluster [DBG] pgmap v1838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:30:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:08.752477+0000 mgr.smithi067.rdualw (mgr.24569) 2132 : cluster [DBG] pgmap v1839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:08.752477+0000 mgr.smithi067.rdualw (mgr.24569) 2132 : cluster [DBG] pgmap v1839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:10.753354+0000 mgr.smithi067.rdualw (mgr.24569) 2133 : cluster [DBG] pgmap v1840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:10.753354+0000 mgr.smithi067.rdualw (mgr.24569) 2133 : cluster [DBG] pgmap v1840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:12.753891+0000 mgr.smithi067.rdualw (mgr.24569) 2134 : cluster [DBG] pgmap v1841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:12.753891+0000 mgr.smithi067.rdualw (mgr.24569) 2134 : cluster [DBG] pgmap v1841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:14.754495+0000 mgr.smithi067.rdualw (mgr.24569) 2135 : cluster [DBG] pgmap v1842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:14.754495+0000 mgr.smithi067.rdualw (mgr.24569) 2135 : cluster [DBG] pgmap v1842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:16.755613+0000 mgr.smithi067.rdualw (mgr.24569) 2136 : cluster [DBG] pgmap v1843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:30:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:16.755613+0000 mgr.smithi067.rdualw (mgr.24569) 2136 : cluster [DBG] pgmap v1843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:30:20.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:18.756165+0000 mgr.smithi067.rdualw (mgr.24569) 2137 : cluster [DBG] pgmap v1844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:18.756165+0000 mgr.smithi067.rdualw (mgr.24569) 2137 : cluster [DBG] pgmap v1844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:22.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:20.756999+0000 mgr.smithi067.rdualw (mgr.24569) 2138 : cluster [DBG] pgmap v1845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:22.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:20.756999+0000 mgr.smithi067.rdualw (mgr.24569) 2138 : cluster [DBG] pgmap v1845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:22.757579+0000 mgr.smithi067.rdualw (mgr.24569) 2139 : cluster [DBG] pgmap v1846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:22.757579+0000 mgr.smithi067.rdualw (mgr.24569) 2139 : cluster [DBG] pgmap v1846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:26.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:24.758401+0000 mgr.smithi067.rdualw (mgr.24569) 2140 : cluster [DBG] pgmap v1847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:26.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:30:24.846989+0000 mon.smithi067 (mon.1) 358 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:30:26.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:30:24.848397+0000 mon.smithi067 (mon.1) 359 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:30:26.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:30:24.849312+0000 mon.smithi067 (mon.1) 360 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:30:26.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:30:24.850166+0000 mgr.smithi067.rdualw (mgr.24569) 2141 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:30:26.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:30:25.270425+0000 mon.smithi061 (mon.0) 618 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:30:26.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:30:25.276519+0000 mon.smithi061 (mon.0) 619 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:30:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:24.758401+0000 mgr.smithi067.rdualw (mgr.24569) 2140 : cluster [DBG] pgmap v1847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:30:24.846989+0000 mon.smithi067 (mon.1) 358 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:30:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:30:24.848397+0000 mon.smithi067 (mon.1) 359 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:30:26.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:30:24.849312+0000 mon.smithi067 (mon.1) 360 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:30:26.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:30:24.850166+0000 mgr.smithi067.rdualw (mgr.24569) 2141 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:30:26.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:30:25.270425+0000 mon.smithi061 (mon.0) 618 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:30:26.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:30:25.276519+0000 mon.smithi061 (mon.0) 619 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:30:28.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:26.759503+0000 mgr.smithi067.rdualw (mgr.24569) 2142 : cluster [DBG] pgmap v1848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:30:28.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:26.759503+0000 mgr.smithi067.rdualw (mgr.24569) 2142 : cluster [DBG] pgmap v1848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:30:29.034 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:30:29.327 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:30:29.328 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (68m) 9m ago 69m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:30:29.328 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (60m) 9m ago 69m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:30:29.328 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (60m) 9m ago 68m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:30:29.328 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (67m) 9m ago 68m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:30:29.329 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (61m) 9m ago 64m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:30:29.329 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (60m) 9m ago 64m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:30:29.329 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (62m) 9m ago 70m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:30:29.330 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (61m) 9m ago 68m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:30:29.330 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (61m) 9m ago 70m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:30:29.330 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (61m) 9m ago 68m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:30:29.330 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (62m) 9m ago 62m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:30:29.331 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (62m) 9m ago 62m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:30:29.331 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (68m) 9m ago 68m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:30:29.331 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (68m) 9m ago 68m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:30:29.331 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (51m) 9m ago 67m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:30:29.332 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (67m) 9m ago 67m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:30:29.332 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (67m) 9m ago 67m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:30:29.333 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (67m) 9m ago 67m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:30:29.333 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (66m) 9m ago 66m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:30:29.333 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (66m) 9m ago 66m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:30:29.333 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (66m) 9m ago 66m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:30:29.334 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (66m) 9m ago 66m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:30:29.334 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (67m) 9m ago 68m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:30:29.692 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:30:29.692 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:30:29.692 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:30:29.693 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:30:29.693 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:30:29.693 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:30:29.693 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:30:29.694 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:30:29.694 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:30:29.694 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:30:29.694 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:30:29.695 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:30:29.695 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:30:29.695 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:30:29.695 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:30:29.695 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:30:29.696 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:30:29.696 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:30:29.696 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:30:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:28.760073+0000 mgr.smithi067.rdualw (mgr.24569) 2143 : cluster [DBG] pgmap v1849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:30:29.019546+0000 mgr.smithi067.rdualw (mgr.24569) 2144 : audit [DBG] from='client.35566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:30:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:30:29.310131+0000 mgr.smithi067.rdualw (mgr.24569) 2145 : audit [DBG] from='client.35570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:30:30.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:30:29.690480+0000 mon.smithi061 (mon.0) 620 : audit [DBG] from='client.? 172.21.15.61:0/1108315609' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:30:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:28.760073+0000 mgr.smithi067.rdualw (mgr.24569) 2143 : cluster [DBG] pgmap v1849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:30:29.019546+0000 mgr.smithi067.rdualw (mgr.24569) 2144 : audit [DBG] from='client.35566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:30:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:30:29.310131+0000 mgr.smithi067.rdualw (mgr.24569) 2145 : audit [DBG] from='client.35570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:30:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:30:29.690480+0000 mon.smithi061 (mon.0) 620 : audit [DBG] from='client.? 172.21.15.61:0/1108315609' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:30:32.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:30.760902+0000 mgr.smithi067.rdualw (mgr.24569) 2146 : cluster [DBG] pgmap v1850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:30.760902+0000 mgr.smithi067.rdualw (mgr.24569) 2146 : cluster [DBG] pgmap v1850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:34.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:32.761568+0000 mgr.smithi067.rdualw (mgr.24569) 2147 : cluster [DBG] pgmap v1851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:32.761568+0000 mgr.smithi067.rdualw (mgr.24569) 2147 : cluster [DBG] pgmap v1851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:30:34.754278+0000 mon.smithi067 (mon.1) 361 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:30:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:30:34.754563+0000 mon.smithi061 (mon.0) 621 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:30:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:30:34.754653+0000 mon.smithi067 (mon.1) 362 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:30:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:30:34.754814+0000 mon.smithi061 (mon.0) 622 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:30:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:30:34.754278+0000 mon.smithi067 (mon.1) 361 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:30:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:30:34.754563+0000 mon.smithi061 (mon.0) 621 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:30:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:30:34.754653+0000 mon.smithi067 (mon.1) 362 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:30:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:30:34.754814+0000 mon.smithi061 (mon.0) 622 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:30:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:34.762191+0000 mgr.smithi067.rdualw (mgr.24569) 2148 : cluster [DBG] pgmap v1852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:34.762191+0000 mgr.smithi067.rdualw (mgr.24569) 2148 : cluster [DBG] pgmap v1852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:38.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:36.763208+0000 mgr.smithi067.rdualw (mgr.24569) 2149 : cluster [DBG] pgmap v1853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:30:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:36.763208+0000 mgr.smithi067.rdualw (mgr.24569) 2149 : cluster [DBG] pgmap v1853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:30:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:38.763859+0000 mgr.smithi067.rdualw (mgr.24569) 2150 : cluster [DBG] pgmap v1854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:38.763859+0000 mgr.smithi067.rdualw (mgr.24569) 2150 : cluster [DBG] pgmap v1854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:40.764812+0000 mgr.smithi067.rdualw (mgr.24569) 2151 : cluster [DBG] pgmap v1855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:40.764812+0000 mgr.smithi067.rdualw (mgr.24569) 2151 : cluster [DBG] pgmap v1855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:42.765384+0000 mgr.smithi067.rdualw (mgr.24569) 2152 : cluster [DBG] pgmap v1856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:42.765384+0000 mgr.smithi067.rdualw (mgr.24569) 2152 : cluster [DBG] pgmap v1856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:44.766079+0000 mgr.smithi067.rdualw (mgr.24569) 2153 : cluster [DBG] pgmap v1857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:44.766079+0000 mgr.smithi067.rdualw (mgr.24569) 2153 : cluster [DBG] pgmap v1857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:46.767055+0000 mgr.smithi067.rdualw (mgr.24569) 2154 : cluster [DBG] pgmap v1858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:30:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:46.767055+0000 mgr.smithi067.rdualw (mgr.24569) 2154 : cluster [DBG] pgmap v1858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:30:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:48.767600+0000 mgr.smithi067.rdualw (mgr.24569) 2155 : cluster [DBG] pgmap v1859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:48.767600+0000 mgr.smithi067.rdualw (mgr.24569) 2155 : cluster [DBG] pgmap v1859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:52.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:50.768426+0000 mgr.smithi067.rdualw (mgr.24569) 2156 : cluster [DBG] pgmap v1860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:50.768426+0000 mgr.smithi067.rdualw (mgr.24569) 2156 : cluster [DBG] pgmap v1860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:52.769029+0000 mgr.smithi067.rdualw (mgr.24569) 2157 : cluster [DBG] pgmap v1861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:52.769029+0000 mgr.smithi067.rdualw (mgr.24569) 2157 : cluster [DBG] pgmap v1861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:56.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:54.769585+0000 mgr.smithi067.rdualw (mgr.24569) 2158 : cluster [DBG] pgmap v1862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:56.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:54.769585+0000 mgr.smithi067.rdualw (mgr.24569) 2158 : cluster [DBG] pgmap v1862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:30:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:56.770364+0000 mgr.smithi067.rdualw (mgr.24569) 2159 : cluster [DBG] pgmap v1863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:30:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:56.770364+0000 mgr.smithi067.rdualw (mgr.24569) 2159 : cluster [DBG] pgmap v1863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:31:00.004 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:31:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:30:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:30:58.770881+0000 mgr.smithi067.rdualw (mgr.24569) 2160 : cluster [DBG] pgmap v1864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:00.311 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:31:00.312 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (68m) 9m ago 69m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:31:00.312 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (61m) 9m ago 69m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:31:00.312 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (61m) 9m ago 69m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:31:00.312 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (68m) 9m ago 69m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:31:00.312 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (61m) 9m ago 65m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:31:00.313 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (61m) 9m ago 65m 23.6M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:31:00.313 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (62m) 9m ago 70m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:31:00.313 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (62m) 9m ago 69m 484M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:31:00.313 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (62m) 9m ago 70m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:31:00.314 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (62m) 9m ago 68m 240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:31:00.314 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (62m) 9m ago 62m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:31:00.314 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (62m) 9m ago 62m 97.8M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:31:00.314 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (69m) 9m ago 69m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:31:00.314 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (68m) 9m ago 68m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:31:00.315 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (52m) 9m ago 68m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:31:00.315 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (68m) 9m ago 68m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:31:00.315 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (67m) 9m ago 67m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:31:00.315 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (67m) 9m ago 67m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:31:00.316 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (67m) 9m ago 67m 1336M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:31:00.316 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (67m) 9m ago 67m 1589M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:31:00.316 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (66m) 9m ago 66m 1236M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:31:00.316 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (66m) 9m ago 66m 2059M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:31:00.316 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (68m) 9m ago 69m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:31:00.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:30:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:30:58.770881+0000 mgr.smithi067.rdualw (mgr.24569) 2160 : cluster [DBG] pgmap v1864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:00.658 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:31:00.658 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:31:00.659 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:31:00.659 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:31:00.659 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:31:00.659 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:31:00.660 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:31:00.660 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:31:00.660 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:31:00.660 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:31:00.660 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:31:00.661 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:31:00.661 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:31:00.661 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:31:00.661 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:31:00.661 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:31:00.662 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:31:00.662 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:31:00.662 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:31:01.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:30:59.990376+0000 mgr.smithi067.rdualw (mgr.24569) 2161 : audit [DBG] from='client.35578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:31:01.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:00.293985+0000 mgr.smithi067.rdualw (mgr.24569) 2162 : audit [DBG] from='client.35582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:31:01.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:00.656771+0000 mon.smithi061 (mon.0) 623 : audit [DBG] from='client.? 172.21.15.61:0/2560859319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:31:01.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:30:59.990376+0000 mgr.smithi067.rdualw (mgr.24569) 2161 : audit [DBG] from='client.35578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:31:01.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:00.293985+0000 mgr.smithi067.rdualw (mgr.24569) 2162 : audit [DBG] from='client.35582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:31:01.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:00.656771+0000 mon.smithi061 (mon.0) 623 : audit [DBG] from='client.? 172.21.15.61:0/2560859319' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:31:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:00.771971+0000 mgr.smithi067.rdualw (mgr.24569) 2163 : cluster [DBG] pgmap v1865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:02.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:00.771971+0000 mgr.smithi067.rdualw (mgr.24569) 2163 : cluster [DBG] pgmap v1865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:04.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:02.772475+0000 mgr.smithi067.rdualw (mgr.24569) 2164 : cluster [DBG] pgmap v1866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:04.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:02.772475+0000 mgr.smithi067.rdualw (mgr.24569) 2164 : cluster [DBG] pgmap v1866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:04.772998+0000 mgr.smithi067.rdualw (mgr.24569) 2165 : cluster [DBG] pgmap v1867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:06.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:04.772998+0000 mgr.smithi067.rdualw (mgr.24569) 2165 : cluster [DBG] pgmap v1867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:06.773976+0000 mgr.smithi067.rdualw (mgr.24569) 2166 : cluster [DBG] pgmap v1868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:31:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:06.773976+0000 mgr.smithi067.rdualw (mgr.24569) 2166 : cluster [DBG] pgmap v1868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:31:10.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:08.774559+0000 mgr.smithi067.rdualw (mgr.24569) 2167 : cluster [DBG] pgmap v1869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:08.774559+0000 mgr.smithi067.rdualw (mgr.24569) 2167 : cluster [DBG] pgmap v1869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:10.775413+0000 mgr.smithi067.rdualw (mgr.24569) 2168 : cluster [DBG] pgmap v1870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:10.775413+0000 mgr.smithi067.rdualw (mgr.24569) 2168 : cluster [DBG] pgmap v1870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:14.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:12.775935+0000 mgr.smithi067.rdualw (mgr.24569) 2169 : cluster [DBG] pgmap v1871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:12.775935+0000 mgr.smithi067.rdualw (mgr.24569) 2169 : cluster [DBG] pgmap v1871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:16.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:14.776560+0000 mgr.smithi067.rdualw (mgr.24569) 2170 : cluster [DBG] pgmap v1872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:14.776560+0000 mgr.smithi067.rdualw (mgr.24569) 2170 : cluster [DBG] pgmap v1872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:16.777680+0000 mgr.smithi067.rdualw (mgr.24569) 2171 : cluster [DBG] pgmap v1873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:31:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:16.777680+0000 mgr.smithi067.rdualw (mgr.24569) 2171 : cluster [DBG] pgmap v1873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:31:20.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:18.778246+0000 mgr.smithi067.rdualw (mgr.24569) 2172 : cluster [DBG] pgmap v1874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:18.778246+0000 mgr.smithi067.rdualw (mgr.24569) 2172 : cluster [DBG] pgmap v1874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:20.779276+0000 mgr.smithi067.rdualw (mgr.24569) 2173 : cluster [DBG] pgmap v1875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:20.779276+0000 mgr.smithi067.rdualw (mgr.24569) 2173 : cluster [DBG] pgmap v1875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:22.779932+0000 mgr.smithi067.rdualw (mgr.24569) 2174 : cluster [DBG] pgmap v1876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:22.779932+0000 mgr.smithi067.rdualw (mgr.24569) 2174 : cluster [DBG] pgmap v1876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:26.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:24.780613+0000 mgr.smithi067.rdualw (mgr.24569) 2175 : cluster [DBG] pgmap v1877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:26.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:25.282585+0000 mon.smithi067 (mon.1) 363 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:31:26.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:25.284000+0000 mon.smithi067 (mon.1) 364 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:31:26.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:25.284914+0000 mon.smithi067 (mon.1) 365 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:31:26.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:31:25.285779+0000 mgr.smithi067.rdualw (mgr.24569) 2176 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:31:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:24.780613+0000 mgr.smithi067.rdualw (mgr.24569) 2175 : cluster [DBG] pgmap v1877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:25.282585+0000 mon.smithi067 (mon.1) 363 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:31:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:25.284000+0000 mon.smithi067 (mon.1) 364 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:31:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:25.284914+0000 mon.smithi067 (mon.1) 365 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:31:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:31:25.285779+0000 mgr.smithi067.rdualw (mgr.24569) 2176 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:31:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:26.781356+0000 mgr.smithi067.rdualw (mgr.24569) 2177 : cluster [DBG] pgmap v1878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:31:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:26.781356+0000 mgr.smithi067.rdualw (mgr.24569) 2177 : cluster [DBG] pgmap v1878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:31:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:28.781777+0000 mgr.smithi067.rdualw (mgr.24569) 2178 : cluster [DBG] pgmap v1879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:28.781777+0000 mgr.smithi067.rdualw (mgr.24569) 2178 : cluster [DBG] pgmap v1879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:30.982 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:31:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:29.977849+0000 mon.smithi061 (mon.0) 624 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:31:31.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:30.377557+0000 mon.smithi067 (mon.1) 366 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:31:31.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:30.377877+0000 mon.smithi061 (mon.0) 625 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:31:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:29.977849+0000 mon.smithi061 (mon.0) 624 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:31:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:30.377557+0000 mon.smithi067 (mon.1) 366 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:31:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:30.377877+0000 mon.smithi061 (mon.0) 625 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:31:31.328 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:31:31.328 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (69m) 10m ago 70m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:31:31.329 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (61m) 10m ago 70m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:31:31.330 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (61m) 1s ago 69m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:31:31.330 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (68m) 10m ago 69m 40.8M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:31:31.331 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (62m) 10m ago 65m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:31:31.332 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (62m) 1s ago 65m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:31:31.332 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (63m) 10m ago 71m 445M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:31:31.333 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (62m) 1s ago 69m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:31:31.333 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (62m) 10m ago 71m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:31:31.334 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (62m) 1s ago 69m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:31:31.335 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (63m) 10m ago 63m 177M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:31:31.336 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (63m) 1s ago 63m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:31:31.337 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (69m) 10m ago 69m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:31:31.338 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (69m) 1s ago 69m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:31:31.338 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (52m) 10m ago 68m 537M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:31:31.338 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (68m) 10m ago 68m 1330M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:31:31.338 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (68m) 10m ago 68m 801M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:31:31.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (68m) 10m ago 68m 1448M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:31:31.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (67m) 1s ago 67m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:31:31.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (67m) 1s ago 67m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:31:31.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (67m) 1s ago 67m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:31:31.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (67m) 1s ago 67m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:31:31.340 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (68m) 10m ago 69m 59.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:31:31.708 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:31:31.709 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:31:31.709 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:31:31.709 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:31:31.710 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:31:31.710 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:31:31.710 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:31:31.711 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:31:31.711 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:31:31.711 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:31:31.712 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:31:31.712 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:31:31.713 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:31:31.713 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:31:31.713 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:31:31.713 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:31:31.714 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:31:31.714 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:31:31.715 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:31:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:30.782600+0000 mgr.smithi067.rdualw (mgr.24569) 2179 : cluster [DBG] pgmap v1880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:30.966022+0000 mgr.smithi067.rdualw (mgr.24569) 2180 : audit [DBG] from='client.35590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:31:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:31.309617+0000 mgr.smithi067.rdualw (mgr.24569) 2181 : audit [DBG] from='client.35594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:31:32.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:31.706859+0000 mon.smithi061 (mon.0) 626 : audit [DBG] from='client.? 172.21.15.61:0/3899102812' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:31:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:30.782600+0000 mgr.smithi067.rdualw (mgr.24569) 2179 : cluster [DBG] pgmap v1880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:32.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:30.966022+0000 mgr.smithi067.rdualw (mgr.24569) 2180 : audit [DBG] from='client.35590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:31:32.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:31.309617+0000 mgr.smithi067.rdualw (mgr.24569) 2181 : audit [DBG] from='client.35594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:31:32.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:31.706859+0000 mon.smithi061 (mon.0) 626 : audit [DBG] from='client.? 172.21.15.61:0/3899102812' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:31:33.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:32.352539+0000 mon.smithi061 (mon.0) 627 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:31:33.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:32.746418+0000 mon.smithi067 (mon.1) 367 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:31:33.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:32.746970+0000 mon.smithi061 (mon.0) 628 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:31:33.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:32.751590+0000 mon.smithi061 (mon.0) 629 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:31:33.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:32.758995+0000 mon.smithi061 (mon.0) 630 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:31:33.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:32.352539+0000 mon.smithi061 (mon.0) 627 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:31:33.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:32.746418+0000 mon.smithi067 (mon.1) 367 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:31:33.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:32.746970+0000 mon.smithi061 (mon.0) 628 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:31:33.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:32.751590+0000 mon.smithi061 (mon.0) 629 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:31:33.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:32.758995+0000 mon.smithi061 (mon.0) 630 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:31:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:32.783237+0000 mgr.smithi067.rdualw (mgr.24569) 2182 : cluster [DBG] pgmap v1881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:32.783237+0000 mgr.smithi067.rdualw (mgr.24569) 2182 : cluster [DBG] pgmap v1881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:34.759849+0000 mon.smithi067 (mon.1) 368 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:31:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:34.760129+0000 mon.smithi067 (mon.1) 369 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:31:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:34.760296+0000 mon.smithi061 (mon.0) 631 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:31:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:31:34.760602+0000 mon.smithi061 (mon.0) 632 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:31:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:34.759849+0000 mon.smithi067 (mon.1) 368 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:31:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:34.760129+0000 mon.smithi067 (mon.1) 369 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:31:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:34.760296+0000 mon.smithi061 (mon.0) 631 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:31:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:31:34.760602+0000 mon.smithi061 (mon.0) 632 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:31:36.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:34.784031+0000 mgr.smithi067.rdualw (mgr.24569) 2183 : cluster [DBG] pgmap v1882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:34.784031+0000 mgr.smithi067.rdualw (mgr.24569) 2183 : cluster [DBG] pgmap v1882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:36.785024+0000 mgr.smithi067.rdualw (mgr.24569) 2184 : cluster [DBG] pgmap v1883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:31:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:36.785024+0000 mgr.smithi067.rdualw (mgr.24569) 2184 : cluster [DBG] pgmap v1883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:31:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:38.785587+0000 mgr.smithi067.rdualw (mgr.24569) 2185 : cluster [DBG] pgmap v1884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:38.785587+0000 mgr.smithi067.rdualw (mgr.24569) 2185 : cluster [DBG] pgmap v1884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:40.786387+0000 mgr.smithi067.rdualw (mgr.24569) 2186 : cluster [DBG] pgmap v1885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:40.786387+0000 mgr.smithi067.rdualw (mgr.24569) 2186 : cluster [DBG] pgmap v1885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:42.786994+0000 mgr.smithi067.rdualw (mgr.24569) 2187 : cluster [DBG] pgmap v1886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:42.786994+0000 mgr.smithi067.rdualw (mgr.24569) 2187 : cluster [DBG] pgmap v1886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:44.787802+0000 mgr.smithi067.rdualw (mgr.24569) 2188 : cluster [DBG] pgmap v1887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:44.787802+0000 mgr.smithi067.rdualw (mgr.24569) 2188 : cluster [DBG] pgmap v1887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:46.788633+0000 mgr.smithi067.rdualw (mgr.24569) 2189 : cluster [DBG] pgmap v1888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:31:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:46.788633+0000 mgr.smithi067.rdualw (mgr.24569) 2189 : cluster [DBG] pgmap v1888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:31:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:48.789215+0000 mgr.smithi067.rdualw (mgr.24569) 2190 : cluster [DBG] pgmap v1889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:48.789215+0000 mgr.smithi067.rdualw (mgr.24569) 2190 : cluster [DBG] pgmap v1889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:50.790072+0000 mgr.smithi067.rdualw (mgr.24569) 2191 : cluster [DBG] pgmap v1890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:50.790072+0000 mgr.smithi067.rdualw (mgr.24569) 2191 : cluster [DBG] pgmap v1890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:52.790592+0000 mgr.smithi067.rdualw (mgr.24569) 2192 : cluster [DBG] pgmap v1891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:52.790592+0000 mgr.smithi067.rdualw (mgr.24569) 2192 : cluster [DBG] pgmap v1891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:56.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:54.791156+0000 mgr.smithi067.rdualw (mgr.24569) 2193 : cluster [DBG] pgmap v1892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:56.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:54.791156+0000 mgr.smithi067.rdualw (mgr.24569) 2193 : cluster [DBG] pgmap v1892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:31:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:31:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:56.792154+0000 mgr.smithi067.rdualw (mgr.24569) 2194 : cluster [DBG] pgmap v1893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:31:58.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:31:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:56.792154+0000 mgr.smithi067.rdualw (mgr.24569) 2194 : cluster [DBG] pgmap v1893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:32:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:31:58.792760+0000 mgr.smithi067.rdualw (mgr.24569) 2195 : cluster [DBG] pgmap v1894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:31:58.792760+0000 mgr.smithi067.rdualw (mgr.24569) 2195 : cluster [DBG] pgmap v1894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:02.087 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:32:02.398 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:32:02.399 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (69m) 30s ago 70m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:32:02.399 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (62m) 30s ago 70m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:32:02.399 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (62m) 32s ago 70m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:32:02.399 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (69m) 30s ago 70m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:32:02.400 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (62m) 30s ago 66m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:32:02.400 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (62m) 32s ago 66m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:32:02.400 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (63m) 30s ago 71m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:32:02.400 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (63m) 32s ago 70m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:32:02.401 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (63m) 30s ago 71m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:32:02.401 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (63m) 32s ago 69m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:32:02.401 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (64m) 30s ago 63m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:32:02.401 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (63m) 32s ago 63m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:32:02.402 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (70m) 30s ago 70m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:32:02.403 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (69m) 32s ago 69m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:32:02.403 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (53m) 30s ago 69m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:32:02.404 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (69m) 30s ago 69m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:32:02.404 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (68m) 30s ago 68m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:32:02.404 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (68m) 30s ago 68m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:32:02.404 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (68m) 32s ago 68m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:32:02.405 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (68m) 32s ago 68m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:32:02.405 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (67m) 32s ago 67m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:32:02.405 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (67m) 32s ago 67m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:32:02.405 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (69m) 30s ago 70m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:32:02.743 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:32:02.743 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:32:02.744 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:32:02.744 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:32:02.744 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:32:02.744 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:32:02.745 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:32:02.745 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:32:02.745 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:32:02.745 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:32:02.746 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:32:02.746 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:32:02.746 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:32:02.747 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:32:02.747 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:32:02.747 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:32:02.747 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:32:02.748 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:32:02.748 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:32:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:00.793661+0000 mgr.smithi067.rdualw (mgr.24569) 2196 : cluster [DBG] pgmap v1895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:00.793661+0000 mgr.smithi067.rdualw (mgr.24569) 2196 : cluster [DBG] pgmap v1895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:03.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:32:02.071355+0000 mgr.smithi067.rdualw (mgr.24569) 2197 : audit [DBG] from='client.35602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:32:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:32:02.380466+0000 mgr.smithi067.rdualw (mgr.24569) 2198 : audit [DBG] from='client.35606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:32:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:32:02.741927+0000 mon.smithi061 (mon.0) 633 : audit [DBG] from='client.? 172.21.15.61:0/888849989' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:32:03.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:32:02.071355+0000 mgr.smithi067.rdualw (mgr.24569) 2197 : audit [DBG] from='client.35602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:32:03.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:32:02.380466+0000 mgr.smithi067.rdualw (mgr.24569) 2198 : audit [DBG] from='client.35606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:32:03.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:32:02.741927+0000 mon.smithi061 (mon.0) 633 : audit [DBG] from='client.? 172.21.15.61:0/888849989' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:32:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:02.794176+0000 mgr.smithi067.rdualw (mgr.24569) 2199 : cluster [DBG] pgmap v1896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:02.794176+0000 mgr.smithi067.rdualw (mgr.24569) 2199 : cluster [DBG] pgmap v1896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:04.794996+0000 mgr.smithi067.rdualw (mgr.24569) 2200 : cluster [DBG] pgmap v1897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:06.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:04.794996+0000 mgr.smithi067.rdualw (mgr.24569) 2200 : cluster [DBG] pgmap v1897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:06.796008+0000 mgr.smithi067.rdualw (mgr.24569) 2201 : cluster [DBG] pgmap v1898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:32:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:06.796008+0000 mgr.smithi067.rdualw (mgr.24569) 2201 : cluster [DBG] pgmap v1898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:32:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:08.796552+0000 mgr.smithi067.rdualw (mgr.24569) 2202 : cluster [DBG] pgmap v1899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:08.796552+0000 mgr.smithi067.rdualw (mgr.24569) 2202 : cluster [DBG] pgmap v1899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:10.797346+0000 mgr.smithi067.rdualw (mgr.24569) 2203 : cluster [DBG] pgmap v1900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:10.797346+0000 mgr.smithi067.rdualw (mgr.24569) 2203 : cluster [DBG] pgmap v1900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:14.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:12.797977+0000 mgr.smithi067.rdualw (mgr.24569) 2204 : cluster [DBG] pgmap v1901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:12.797977+0000 mgr.smithi067.rdualw (mgr.24569) 2204 : cluster [DBG] pgmap v1901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:14.798728+0000 mgr.smithi067.rdualw (mgr.24569) 2205 : cluster [DBG] pgmap v1902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:16.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:14.798728+0000 mgr.smithi067.rdualw (mgr.24569) 2205 : cluster [DBG] pgmap v1902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:16.799678+0000 mgr.smithi067.rdualw (mgr.24569) 2206 : cluster [DBG] pgmap v1903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:32:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:16.799678+0000 mgr.smithi067.rdualw (mgr.24569) 2206 : cluster [DBG] pgmap v1903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:32:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:18.800311+0000 mgr.smithi067.rdualw (mgr.24569) 2207 : cluster [DBG] pgmap v1904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:18.800311+0000 mgr.smithi067.rdualw (mgr.24569) 2207 : cluster [DBG] pgmap v1904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:20.801221+0000 mgr.smithi067.rdualw (mgr.24569) 2208 : cluster [DBG] pgmap v1905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:20.801221+0000 mgr.smithi067.rdualw (mgr.24569) 2208 : cluster [DBG] pgmap v1905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:22.802009+0000 mgr.smithi067.rdualw (mgr.24569) 2209 : cluster [DBG] pgmap v1906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:22.802009+0000 mgr.smithi067.rdualw (mgr.24569) 2209 : cluster [DBG] pgmap v1906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:26.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:24.802823+0000 mgr.smithi067.rdualw (mgr.24569) 2210 : cluster [DBG] pgmap v1907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:26.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:24.802823+0000 mgr.smithi067.rdualw (mgr.24569) 2210 : cluster [DBG] pgmap v1907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:26.803695+0000 mgr.smithi067.rdualw (mgr.24569) 2211 : cluster [DBG] pgmap v1908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:32:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:26.803695+0000 mgr.smithi067.rdualw (mgr.24569) 2211 : cluster [DBG] pgmap v1908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:32:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:28.804348+0000 mgr.smithi067.rdualw (mgr.24569) 2212 : cluster [DBG] pgmap v1909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:28.804348+0000 mgr.smithi067.rdualw (mgr.24569) 2212 : cluster [DBG] pgmap v1909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:30.805358+0000 mgr.smithi067.rdualw (mgr.24569) 2213 : cluster [DBG] pgmap v1910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:30.805358+0000 mgr.smithi067.rdualw (mgr.24569) 2213 : cluster [DBG] pgmap v1910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:33.060 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:32:33.355 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:32:33.355 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (70m) 60s ago 71m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:32:33.355 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (62m) 60s ago 71m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:32:33.355 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (62m) 63s ago 70m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:32:33.356 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (69m) 60s ago 70m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:32:33.356 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (63m) 60s ago 66m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:32:33.356 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (63m) 63s ago 66m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:32:33.356 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (64m) 60s ago 72m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:32:33.357 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (63m) 63s ago 70m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:32:33.357 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (63m) 60s ago 72m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:32:33.357 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (63m) 63s ago 70m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:32:33.357 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (64m) 60s ago 64m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:32:33.357 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (64m) 63s ago 64m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:32:33.358 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (70m) 60s ago 70m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:32:33.358 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (70m) 63s ago 70m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:32:33.358 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (53m) 60s ago 70m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:32:33.358 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (69m) 60s ago 69m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:32:33.359 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (69m) 60s ago 69m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:32:33.359 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (69m) 60s ago 69m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:32:33.359 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (68m) 63s ago 68m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:32:33.359 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (68m) 63s ago 68m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:32:33.359 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (68m) 63s ago 68m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:32:33.360 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (68m) 63s ago 68m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:32:33.360 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (69m) 60s ago 70m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:32:33.699 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:32:33.700 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:32:33.700 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:32:33.700 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:32:33.700 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:32:33.701 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:32:33.701 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:32:33.701 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:32:33.701 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:32:33.701 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:32:33.702 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:32:33.702 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:32:33.702 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:32:33.704 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:32:33.704 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:32:33.704 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:32:33.704 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:32:33.704 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:32:33.705 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:32:33.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:32:32.763421+0000 mon.smithi067 (mon.1) 370 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:32:33.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:32:32.764837+0000 mon.smithi067 (mon.1) 371 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:32:33.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:32:32.765759+0000 mon.smithi067 (mon.1) 372 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:32:33.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:32:33.186638+0000 mon.smithi061 (mon.0) 634 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:32:33.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:32:33.192291+0000 mon.smithi061 (mon.0) 635 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:32:33.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:32:32.763421+0000 mon.smithi067 (mon.1) 370 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:32:33.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:32:32.764837+0000 mon.smithi067 (mon.1) 371 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:32:33.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:32:32.765759+0000 mon.smithi067 (mon.1) 372 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:32:33.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:32:33.186638+0000 mon.smithi061 (mon.0) 634 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:32:33.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:32:33.192291+0000 mon.smithi061 (mon.0) 635 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:32:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:32:32.766595+0000 mgr.smithi067.rdualw (mgr.24569) 2214 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:32:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:32.805898+0000 mgr.smithi067.rdualw (mgr.24569) 2215 : cluster [DBG] pgmap v1911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:32:33.047468+0000 mgr.smithi067.rdualw (mgr.24569) 2216 : audit [DBG] from='client.35614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:32:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:32:33.338701+0000 mgr.smithi067.rdualw (mgr.24569) 2217 : audit [DBG] from='client.45247 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:32:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:32:33.698141+0000 mon.smithi061 (mon.0) 636 : audit [DBG] from='client.? 172.21.15.61:0/2610544054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:32:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:32:32.766595+0000 mgr.smithi067.rdualw (mgr.24569) 2214 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:32:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:32.805898+0000 mgr.smithi067.rdualw (mgr.24569) 2215 : cluster [DBG] pgmap v1911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:32:33.047468+0000 mgr.smithi067.rdualw (mgr.24569) 2216 : audit [DBG] from='client.35614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:32:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:32:33.338701+0000 mgr.smithi067.rdualw (mgr.24569) 2217 : audit [DBG] from='client.45247 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:32:34.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:32:33.698141+0000 mon.smithi061 (mon.0) 636 : audit [DBG] from='client.? 172.21.15.61:0/2610544054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:32:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:32:34.765118+0000 mon.smithi067 (mon.1) 373 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:32:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:32:34.765385+0000 mon.smithi067 (mon.1) 374 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:32:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:32:34.765495+0000 mon.smithi061 (mon.0) 637 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:32:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:32:34.765738+0000 mon.smithi061 (mon.0) 638 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:32:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:32:34.765118+0000 mon.smithi067 (mon.1) 373 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:32:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:32:34.765385+0000 mon.smithi067 (mon.1) 374 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:32:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:32:34.765495+0000 mon.smithi061 (mon.0) 637 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:32:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:32:34.765738+0000 mon.smithi061 (mon.0) 638 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:32:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:34.806655+0000 mgr.smithi067.rdualw (mgr.24569) 2218 : cluster [DBG] pgmap v1912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:34.806655+0000 mgr.smithi067.rdualw (mgr.24569) 2218 : cluster [DBG] pgmap v1912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:36.807640+0000 mgr.smithi067.rdualw (mgr.24569) 2219 : cluster [DBG] pgmap v1913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:32:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:36.807640+0000 mgr.smithi067.rdualw (mgr.24569) 2219 : cluster [DBG] pgmap v1913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:32:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:38.808220+0000 mgr.smithi067.rdualw (mgr.24569) 2220 : cluster [DBG] pgmap v1914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:38.808220+0000 mgr.smithi067.rdualw (mgr.24569) 2220 : cluster [DBG] pgmap v1914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:40.809072+0000 mgr.smithi067.rdualw (mgr.24569) 2221 : cluster [DBG] pgmap v1915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:40.809072+0000 mgr.smithi067.rdualw (mgr.24569) 2221 : cluster [DBG] pgmap v1915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:42.809765+0000 mgr.smithi067.rdualw (mgr.24569) 2222 : cluster [DBG] pgmap v1916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:42.809765+0000 mgr.smithi067.rdualw (mgr.24569) 2222 : cluster [DBG] pgmap v1916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:44.810385+0000 mgr.smithi067.rdualw (mgr.24569) 2223 : cluster [DBG] pgmap v1917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:44.810385+0000 mgr.smithi067.rdualw (mgr.24569) 2223 : cluster [DBG] pgmap v1917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:46.811467+0000 mgr.smithi067.rdualw (mgr.24569) 2224 : cluster [DBG] pgmap v1918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:32:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:46.811467+0000 mgr.smithi067.rdualw (mgr.24569) 2224 : cluster [DBG] pgmap v1918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:32:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:48.812170+0000 mgr.smithi067.rdualw (mgr.24569) 2225 : cluster [DBG] pgmap v1919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:48.812170+0000 mgr.smithi067.rdualw (mgr.24569) 2225 : cluster [DBG] pgmap v1919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:50.813062+0000 mgr.smithi067.rdualw (mgr.24569) 2226 : cluster [DBG] pgmap v1920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:50.813062+0000 mgr.smithi067.rdualw (mgr.24569) 2226 : cluster [DBG] pgmap v1920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:52.813766+0000 mgr.smithi067.rdualw (mgr.24569) 2227 : cluster [DBG] pgmap v1921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:52.813766+0000 mgr.smithi067.rdualw (mgr.24569) 2227 : cluster [DBG] pgmap v1921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:54.814381+0000 mgr.smithi067.rdualw (mgr.24569) 2228 : cluster [DBG] pgmap v1922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:54.814381+0000 mgr.smithi067.rdualw (mgr.24569) 2228 : cluster [DBG] pgmap v1922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:32:58.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:56.815257+0000 mgr.smithi067.rdualw (mgr.24569) 2229 : cluster [DBG] pgmap v1923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:32:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:56.815257+0000 mgr.smithi067.rdualw (mgr.24569) 2229 : cluster [DBG] pgmap v1923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:33:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:32:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:32:58.815884+0000 mgr.smithi067.rdualw (mgr.24569) 2230 : cluster [DBG] pgmap v1924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:32:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:32:58.815884+0000 mgr.smithi067.rdualw (mgr.24569) 2230 : cluster [DBG] pgmap v1924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:00.816687+0000 mgr.smithi067.rdualw (mgr.24569) 2231 : cluster [DBG] pgmap v1925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:02.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:00.816687+0000 mgr.smithi067.rdualw (mgr.24569) 2231 : cluster [DBG] pgmap v1925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:04.020 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:33:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:02.817362+0000 mgr.smithi067.rdualw (mgr.24569) 2232 : cluster [DBG] pgmap v1926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:04.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:02.817362+0000 mgr.smithi067.rdualw (mgr.24569) 2232 : cluster [DBG] pgmap v1926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:04.360 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:33:04.361 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (70m) 92s ago 71m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:33:04.362 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (63m) 92s ago 71m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:33:04.362 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (63m) 94s ago 71m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:33:04.362 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (70m) 92s ago 71m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:33:04.363 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (63m) 92s ago 67m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:33:04.363 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (63m) 94s ago 67m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:33:04.364 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (64m) 92s ago 72m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:33:04.364 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (64m) 94s ago 71m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:33:04.365 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (64m) 92s ago 72m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:33:04.365 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (64m) 94s ago 71m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:33:04.366 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (65m) 92s ago 65m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:33:04.367 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (64m) 94s ago 64m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:33:04.367 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (71m) 92s ago 71m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:33:04.368 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (70m) 94s ago 70m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:33:04.368 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (54m) 92s ago 70m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:33:04.369 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (70m) 92s ago 70m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:33:04.369 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (69m) 92s ago 69m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:33:04.369 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (69m) 92s ago 69m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:33:04.370 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (69m) 94s ago 69m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:33:04.370 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (69m) 94s ago 69m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:33:04.371 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (68m) 94s ago 68m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:33:04.371 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (68m) 94s ago 68m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:33:04.371 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (70m) 92s ago 71m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:33:04.705 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:33:04.705 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:33:04.706 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:33:04.706 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:33:04.706 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:33:04.707 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:33:04.707 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:33:04.707 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:33:04.708 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:33:04.708 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:33:04.708 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:33:04.708 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:33:04.709 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:33:04.709 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:33:04.709 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:33:04.709 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:33:04.709 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:33:04.710 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:33:04.710 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:33:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:33:04.007078+0000 mgr.smithi067.rdualw (mgr.24569) 2233 : audit [DBG] from='client.35626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:33:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:33:04.342985+0000 mgr.smithi067.rdualw (mgr.24569) 2234 : audit [DBG] from='client.35630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:33:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:33:04.703094+0000 mon.smithi061 (mon.0) 639 : audit [DBG] from='client.? 172.21.15.61:0/2394768642' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:33:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:33:04.007078+0000 mgr.smithi067.rdualw (mgr.24569) 2233 : audit [DBG] from='client.35626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:33:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:33:04.342985+0000 mgr.smithi067.rdualw (mgr.24569) 2234 : audit [DBG] from='client.35630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:33:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:33:04.703094+0000 mon.smithi061 (mon.0) 639 : audit [DBG] from='client.? 172.21.15.61:0/2394768642' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:33:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:04.818106+0000 mgr.smithi067.rdualw (mgr.24569) 2235 : cluster [DBG] pgmap v1927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:04.818106+0000 mgr.smithi067.rdualw (mgr.24569) 2235 : cluster [DBG] pgmap v1927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:08.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:06.818940+0000 mgr.smithi067.rdualw (mgr.24569) 2236 : cluster [DBG] pgmap v1928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:33:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:06.818940+0000 mgr.smithi067.rdualw (mgr.24569) 2236 : cluster [DBG] pgmap v1928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:33:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:08.819498+0000 mgr.smithi067.rdualw (mgr.24569) 2237 : cluster [DBG] pgmap v1929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:08.819498+0000 mgr.smithi067.rdualw (mgr.24569) 2237 : cluster [DBG] pgmap v1929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:12.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:10.820587+0000 mgr.smithi067.rdualw (mgr.24569) 2238 : cluster [DBG] pgmap v1930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:10.820587+0000 mgr.smithi067.rdualw (mgr.24569) 2238 : cluster [DBG] pgmap v1930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:14.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:12.821071+0000 mgr.smithi067.rdualw (mgr.24569) 2239 : cluster [DBG] pgmap v1931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:14.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:12.821071+0000 mgr.smithi067.rdualw (mgr.24569) 2239 : cluster [DBG] pgmap v1931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:16.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:14.821639+0000 mgr.smithi067.rdualw (mgr.24569) 2240 : cluster [DBG] pgmap v1932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:14.821639+0000 mgr.smithi067.rdualw (mgr.24569) 2240 : cluster [DBG] pgmap v1932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:16.822619+0000 mgr.smithi067.rdualw (mgr.24569) 2241 : cluster [DBG] pgmap v1933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:33:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:16.822619+0000 mgr.smithi067.rdualw (mgr.24569) 2241 : cluster [DBG] pgmap v1933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:33:20.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:18.823202+0000 mgr.smithi067.rdualw (mgr.24569) 2242 : cluster [DBG] pgmap v1934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:18.823202+0000 mgr.smithi067.rdualw (mgr.24569) 2242 : cluster [DBG] pgmap v1934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:22.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:20.824046+0000 mgr.smithi067.rdualw (mgr.24569) 2243 : cluster [DBG] pgmap v1935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:20.824046+0000 mgr.smithi067.rdualw (mgr.24569) 2243 : cluster [DBG] pgmap v1935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:22.824599+0000 mgr.smithi067.rdualw (mgr.24569) 2244 : cluster [DBG] pgmap v1936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:22.824599+0000 mgr.smithi067.rdualw (mgr.24569) 2244 : cluster [DBG] pgmap v1936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:24.825252+0000 mgr.smithi067.rdualw (mgr.24569) 2245 : cluster [DBG] pgmap v1937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:24.825252+0000 mgr.smithi067.rdualw (mgr.24569) 2245 : cluster [DBG] pgmap v1937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:26.826021+0000 mgr.smithi067.rdualw (mgr.24569) 2246 : cluster [DBG] pgmap v1938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:33:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:26.826021+0000 mgr.smithi067.rdualw (mgr.24569) 2246 : cluster [DBG] pgmap v1938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:33:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:28.826603+0000 mgr.smithi067.rdualw (mgr.24569) 2247 : cluster [DBG] pgmap v1939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:28.826603+0000 mgr.smithi067.rdualw (mgr.24569) 2247 : cluster [DBG] pgmap v1939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:30.827399+0000 mgr.smithi067.rdualw (mgr.24569) 2248 : cluster [DBG] pgmap v1940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:30.827399+0000 mgr.smithi067.rdualw (mgr.24569) 2248 : cluster [DBG] pgmap v1940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:32.827917+0000 mgr.smithi067.rdualw (mgr.24569) 2249 : cluster [DBG] pgmap v1941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:33:33.195844+0000 mon.smithi067 (mon.1) 375 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:33:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:33:33.197311+0000 mon.smithi067 (mon.1) 376 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:33:34.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:33:33.198243+0000 mon.smithi067 (mon.1) 377 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:33:34.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:33:33.199077+0000 mgr.smithi067.rdualw (mgr.24569) 2250 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:33:34.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:33:33.554368+0000 mon.smithi061 (mon.0) 640 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:33:34.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:33:33.565862+0000 mon.smithi061 (mon.0) 641 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:33:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:32.827917+0000 mgr.smithi067.rdualw (mgr.24569) 2249 : cluster [DBG] pgmap v1941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:33:33.195844+0000 mon.smithi067 (mon.1) 375 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:33:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:33:33.197311+0000 mon.smithi067 (mon.1) 376 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:33:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:33:33.198243+0000 mon.smithi067 (mon.1) 377 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:33:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:33:33.199077+0000 mgr.smithi067.rdualw (mgr.24569) 2250 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:33:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:33:33.554368+0000 mon.smithi061 (mon.0) 640 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:33:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:33:33.565862+0000 mon.smithi061 (mon.0) 641 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:33:35.051 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:33:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:33:33.971125+0000 mon.smithi061 (mon.0) 642 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:33:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:33:33.977268+0000 mon.smithi061 (mon.0) 643 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:33:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:33:34.769767+0000 mon.smithi067 (mon.1) 378 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:33:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:33:34.770089+0000 mon.smithi067 (mon.1) 379 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:33:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:33:34.770127+0000 mon.smithi061 (mon.0) 644 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:33:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:33:34.770644+0000 mon.smithi061 (mon.0) 645 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:33:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:33:33.971125+0000 mon.smithi061 (mon.0) 642 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:33:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:33:33.977268+0000 mon.smithi061 (mon.0) 643 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:33:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:33:34.769767+0000 mon.smithi067 (mon.1) 378 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:33:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:33:34.770089+0000 mon.smithi067 (mon.1) 379 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:33:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:33:34.770127+0000 mon.smithi061 (mon.0) 644 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:33:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:33:34.770644+0000 mon.smithi061 (mon.0) 645 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:33:35.342 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:33:35.342 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (71m) 2m ago 72m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:33:35.342 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (63m) 2m ago 72m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:33:35.343 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (63m) 2m ago 71m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:33:35.343 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (70m) 2m ago 72m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:33:35.343 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (64m) 2m ago 67m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:33:35.343 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (64m) 2m ago 67m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:33:35.344 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (65m) 2m ago 73m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:33:35.344 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (64m) 2m ago 71m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:33:35.344 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (64m) 2m ago 73m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:33:35.344 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (64m) 2m ago 71m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:33:35.344 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (65m) 2m ago 65m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:33:35.345 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (65m) 2m ago 65m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:33:35.345 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (71m) 2m ago 71m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:33:35.345 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (71m) 2m ago 71m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:33:35.345 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (54m) 2m ago 71m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:33:35.345 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (70m) 2m ago 70m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:33:35.346 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (70m) 2m ago 70m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:33:35.346 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (70m) 2m ago 70m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:33:35.346 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (69m) 2m ago 69m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:33:35.346 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (69m) 2m ago 69m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:33:35.346 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (69m) 2m ago 69m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:33:35.347 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (69m) 2m ago 69m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:33:35.347 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (70m) 2m ago 71m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:33:35.683 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:33:35.684 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:33:35.684 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:33:35.684 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:33:35.684 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:33:35.685 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:33:35.685 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:33:35.685 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:33:35.685 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:33:35.685 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:33:35.686 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:33:35.686 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:33:35.686 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:33:35.686 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:33:35.687 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:33:35.687 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:33:35.687 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:33:35.687 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:33:35.687 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:33:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:34.828566+0000 mgr.smithi067.rdualw (mgr.24569) 2251 : cluster [DBG] pgmap v1942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:33:35.035551+0000 mgr.smithi067.rdualw (mgr.24569) 2252 : audit [DBG] from='client.35638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:33:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:33:35.324797+0000 mgr.smithi067.rdualw (mgr.24569) 2253 : audit [DBG] from='client.35642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:33:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:33:35.681968+0000 mon.smithi061 (mon.0) 646 : audit [DBG] from='client.? 172.21.15.61:0/344717142' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:33:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:34.828566+0000 mgr.smithi067.rdualw (mgr.24569) 2251 : cluster [DBG] pgmap v1942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:33:35.035551+0000 mgr.smithi067.rdualw (mgr.24569) 2252 : audit [DBG] from='client.35638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:33:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:33:35.324797+0000 mgr.smithi067.rdualw (mgr.24569) 2253 : audit [DBG] from='client.35642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:33:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:33:35.681968+0000 mon.smithi061 (mon.0) 646 : audit [DBG] from='client.? 172.21.15.61:0/344717142' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:33:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:36.829441+0000 mgr.smithi067.rdualw (mgr.24569) 2254 : cluster [DBG] pgmap v1943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:33:38.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:36.829441+0000 mgr.smithi067.rdualw (mgr.24569) 2254 : cluster [DBG] pgmap v1943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:33:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:38.830036+0000 mgr.smithi067.rdualw (mgr.24569) 2255 : cluster [DBG] pgmap v1944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:38.830036+0000 mgr.smithi067.rdualw (mgr.24569) 2255 : cluster [DBG] pgmap v1944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:40.830951+0000 mgr.smithi067.rdualw (mgr.24569) 2256 : cluster [DBG] pgmap v1945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:40.830951+0000 mgr.smithi067.rdualw (mgr.24569) 2256 : cluster [DBG] pgmap v1945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:42.831549+0000 mgr.smithi067.rdualw (mgr.24569) 2257 : cluster [DBG] pgmap v1946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:42.831549+0000 mgr.smithi067.rdualw (mgr.24569) 2257 : cluster [DBG] pgmap v1946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:46.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:44.832100+0000 mgr.smithi067.rdualw (mgr.24569) 2258 : cluster [DBG] pgmap v1947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:44.832100+0000 mgr.smithi067.rdualw (mgr.24569) 2258 : cluster [DBG] pgmap v1947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:46.833094+0000 mgr.smithi067.rdualw (mgr.24569) 2259 : cluster [DBG] pgmap v1948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:33:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:46.833094+0000 mgr.smithi067.rdualw (mgr.24569) 2259 : cluster [DBG] pgmap v1948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:33:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:48.833670+0000 mgr.smithi067.rdualw (mgr.24569) 2260 : cluster [DBG] pgmap v1949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:48.833670+0000 mgr.smithi067.rdualw (mgr.24569) 2260 : cluster [DBG] pgmap v1949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:50.834546+0000 mgr.smithi067.rdualw (mgr.24569) 2261 : cluster [DBG] pgmap v1950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:52.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:50.834546+0000 mgr.smithi067.rdualw (mgr.24569) 2261 : cluster [DBG] pgmap v1950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:52.835089+0000 mgr.smithi067.rdualw (mgr.24569) 2262 : cluster [DBG] pgmap v1951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:54.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:52.835089+0000 mgr.smithi067.rdualw (mgr.24569) 2262 : cluster [DBG] pgmap v1951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:56.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:54.835958+0000 mgr.smithi067.rdualw (mgr.24569) 2263 : cluster [DBG] pgmap v1952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:54.835958+0000 mgr.smithi067.rdualw (mgr.24569) 2263 : cluster [DBG] pgmap v1952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:33:58.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:56.837043+0000 mgr.smithi067.rdualw (mgr.24569) 2264 : cluster [DBG] pgmap v1953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:33:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:56.837043+0000 mgr.smithi067.rdualw (mgr.24569) 2264 : cluster [DBG] pgmap v1953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:34:00.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:33:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:33:58.837589+0000 mgr.smithi067.rdualw (mgr.24569) 2265 : cluster [DBG] pgmap v1954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:33:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:33:58.837589+0000 mgr.smithi067.rdualw (mgr.24569) 2265 : cluster [DBG] pgmap v1954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:00.838587+0000 mgr.smithi067.rdualw (mgr.24569) 2266 : cluster [DBG] pgmap v1955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:00.838587+0000 mgr.smithi067.rdualw (mgr.24569) 2266 : cluster [DBG] pgmap v1955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:04.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:02.839151+0000 mgr.smithi067.rdualw (mgr.24569) 2267 : cluster [DBG] pgmap v1956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:02.839151+0000 mgr.smithi067.rdualw (mgr.24569) 2267 : cluster [DBG] pgmap v1956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:05.994 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:34:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:04.839742+0000 mgr.smithi067.rdualw (mgr.24569) 2268 : cluster [DBG] pgmap v1957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:06.311 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:34:06.311 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (71m) 2m ago 72m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:34:06.312 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (64m) 2m ago 72m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:34:06.312 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (64m) 2m ago 72m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:34:06.312 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (71m) 2m ago 72m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:34:06.312 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (64m) 2m ago 68m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:34:06.313 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (64m) 2m ago 68m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:34:06.313 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (65m) 2m ago 73m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:34:06.313 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (65m) 2m ago 72m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:34:06.313 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (65m) 2m ago 73m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:34:06.313 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (65m) 2m ago 72m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:34:06.314 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (66m) 2m ago 66m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:34:06.314 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (65m) 2m ago 65m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:34:06.314 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (72m) 2m ago 72m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:34:06.314 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (71m) 2m ago 71m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:34:06.315 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (55m) 2m ago 71m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:34:06.315 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (71m) 2m ago 71m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:34:06.315 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (71m) 2m ago 71m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:34:06.315 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (70m) 2m ago 70m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:34:06.316 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (70m) 2m ago 70m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:34:06.316 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (70m) 2m ago 70m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:34:06.316 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (69m) 2m ago 69m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:34:06.316 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (69m) 2m ago 69m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:34:06.316 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (71m) 2m ago 72m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:34:06.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:04.839742+0000 mgr.smithi067.rdualw (mgr.24569) 2268 : cluster [DBG] pgmap v1957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:06.654 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:34:06.655 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:34:06.655 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:34:06.655 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:34:06.655 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:34:06.656 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:34:06.656 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:34:06.656 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:34:06.656 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:34:06.657 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:34:06.657 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:34:06.657 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:34:06.657 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:34:06.657 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:34:06.658 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:34:06.658 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:34:06.658 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:34:06.658 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:34:06.659 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:34:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:34:05.978664+0000 mgr.smithi067.rdualw (mgr.24569) 2269 : audit [DBG] from='client.35650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:34:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:34:06.294007+0000 mgr.smithi067.rdualw (mgr.24569) 2270 : audit [DBG] from='client.35654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:34:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:34:06.652736+0000 mon.smithi061 (mon.0) 647 : audit [DBG] from='client.? 172.21.15.61:0/1078978300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:34:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:34:05.978664+0000 mgr.smithi067.rdualw (mgr.24569) 2269 : audit [DBG] from='client.35650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:34:07.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:34:06.294007+0000 mgr.smithi067.rdualw (mgr.24569) 2270 : audit [DBG] from='client.35654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:34:07.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:34:06.652736+0000 mon.smithi061 (mon.0) 647 : audit [DBG] from='client.? 172.21.15.61:0/1078978300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:34:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:06.840602+0000 mgr.smithi067.rdualw (mgr.24569) 2271 : cluster [DBG] pgmap v1958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:34:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:06.840602+0000 mgr.smithi067.rdualw (mgr.24569) 2271 : cluster [DBG] pgmap v1958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:34:10.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:08.841219+0000 mgr.smithi067.rdualw (mgr.24569) 2272 : cluster [DBG] pgmap v1959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:08.841219+0000 mgr.smithi067.rdualw (mgr.24569) 2272 : cluster [DBG] pgmap v1959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:10.842127+0000 mgr.smithi067.rdualw (mgr.24569) 2273 : cluster [DBG] pgmap v1960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:10.842127+0000 mgr.smithi067.rdualw (mgr.24569) 2273 : cluster [DBG] pgmap v1960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:14.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:12.842716+0000 mgr.smithi067.rdualw (mgr.24569) 2274 : cluster [DBG] pgmap v1961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:14.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:12.842716+0000 mgr.smithi067.rdualw (mgr.24569) 2274 : cluster [DBG] pgmap v1961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:14.843418+0000 mgr.smithi067.rdualw (mgr.24569) 2275 : cluster [DBG] pgmap v1962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:16.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:14.843418+0000 mgr.smithi067.rdualw (mgr.24569) 2275 : cluster [DBG] pgmap v1962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:16.844208+0000 mgr.smithi067.rdualw (mgr.24569) 2276 : cluster [DBG] pgmap v1963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:34:18.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:16.844208+0000 mgr.smithi067.rdualw (mgr.24569) 2276 : cluster [DBG] pgmap v1963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:34:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:18.844742+0000 mgr.smithi067.rdualw (mgr.24569) 2277 : cluster [DBG] pgmap v1964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:18.844742+0000 mgr.smithi067.rdualw (mgr.24569) 2277 : cluster [DBG] pgmap v1964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:20.845582+0000 mgr.smithi067.rdualw (mgr.24569) 2278 : cluster [DBG] pgmap v1965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:20.845582+0000 mgr.smithi067.rdualw (mgr.24569) 2278 : cluster [DBG] pgmap v1965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:22.846136+0000 mgr.smithi067.rdualw (mgr.24569) 2279 : cluster [DBG] pgmap v1966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:22.846136+0000 mgr.smithi067.rdualw (mgr.24569) 2279 : cluster [DBG] pgmap v1966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:24.846752+0000 mgr.smithi067.rdualw (mgr.24569) 2280 : cluster [DBG] pgmap v1967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:24.846752+0000 mgr.smithi067.rdualw (mgr.24569) 2280 : cluster [DBG] pgmap v1967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:26.847584+0000 mgr.smithi067.rdualw (mgr.24569) 2281 : cluster [DBG] pgmap v1968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:34:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:26.847584+0000 mgr.smithi067.rdualw (mgr.24569) 2281 : cluster [DBG] pgmap v1968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:34:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:28.848138+0000 mgr.smithi067.rdualw (mgr.24569) 2282 : cluster [DBG] pgmap v1969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:28.848138+0000 mgr.smithi067.rdualw (mgr.24569) 2282 : cluster [DBG] pgmap v1969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:30.849129+0000 mgr.smithi067.rdualw (mgr.24569) 2283 : cluster [DBG] pgmap v1970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:30.849129+0000 mgr.smithi067.rdualw (mgr.24569) 2283 : cluster [DBG] pgmap v1970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:32.849824+0000 mgr.smithi067.rdualw (mgr.24569) 2284 : cluster [DBG] pgmap v1971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:32.849824+0000 mgr.smithi067.rdualw (mgr.24569) 2284 : cluster [DBG] pgmap v1971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:34:33.981065+0000 mon.smithi067 (mon.1) 380 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:34:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:34:33.982502+0000 mon.smithi067 (mon.1) 381 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:34:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:34:33.983403+0000 mon.smithi067 (mon.1) 382 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:34:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:34:33.984221+0000 mgr.smithi067.rdualw (mgr.24569) 2285 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:34:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:34:34.399602+0000 mon.smithi061 (mon.0) 648 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:34:35.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:34:34.407413+0000 mon.smithi061 (mon.0) 649 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:34:35.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:34:34.774372+0000 mon.smithi067 (mon.1) 383 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:34:35.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:34:34.774569+0000 mon.smithi061 (mon.0) 650 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:34:35.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:34:34.774579+0000 mon.smithi067 (mon.1) 384 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:34:35.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:34:34.774921+0000 mon.smithi061 (mon.0) 651 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:34:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:34:33.981065+0000 mon.smithi067 (mon.1) 380 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:34:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:34:33.982502+0000 mon.smithi067 (mon.1) 381 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:34:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:34:33.983403+0000 mon.smithi067 (mon.1) 382 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:34:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:34:33.984221+0000 mgr.smithi067.rdualw (mgr.24569) 2285 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:34:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:34:34.399602+0000 mon.smithi061 (mon.0) 648 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:34:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:34:34.407413+0000 mon.smithi061 (mon.0) 649 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:34:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:34:34.774372+0000 mon.smithi067 (mon.1) 383 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:34:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:34:34.774569+0000 mon.smithi061 (mon.0) 650 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:34:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:34:34.774579+0000 mon.smithi067 (mon.1) 384 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:34:35.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:34:34.774921+0000 mon.smithi061 (mon.0) 651 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:34:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:34.850526+0000 mgr.smithi067.rdualw (mgr.24569) 2286 : cluster [DBG] pgmap v1972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:34.850526+0000 mgr.smithi067.rdualw (mgr.24569) 2286 : cluster [DBG] pgmap v1972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:36.963 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:34:37.259 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:34:37.259 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (72m) 3m ago 73m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:34:37.259 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (64m) 3m ago 73m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:34:37.259 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (64m) 3m ago 72m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:34:37.260 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (72m) 3m ago 73m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:34:37.260 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (65m) 3m ago 68m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:34:37.260 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (65m) 3m ago 68m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:34:37.260 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (66m) 3m ago 74m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:34:37.261 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (65m) 3m ago 72m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:34:37.261 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (65m) 3m ago 74m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:34:37.261 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (65m) 3m ago 72m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:34:37.261 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (66m) 3m ago 66m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:34:37.261 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (66m) 3m ago 66m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:34:37.262 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (72m) 3m ago 72m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:34:37.262 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (72m) 3m ago 72m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:34:37.262 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (55m) 3m ago 72m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:34:37.263 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (71m) 3m ago 71m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:34:37.263 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (71m) 3m ago 71m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:34:37.263 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (71m) 3m ago 71m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:34:37.263 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (71m) 3m ago 70m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:34:37.264 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (70m) 3m ago 70m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:34:37.264 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (70m) 3m ago 70m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:34:37.264 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (70m) 3m ago 70m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:34:37.264 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (71m) 3m ago 72m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:34:37.597 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:34:37.598 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:34:37.598 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:34:37.598 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:34:37.598 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:34:37.599 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:34:37.599 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:34:37.599 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:34:37.599 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:34:37.600 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:34:37.600 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:34:37.600 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:34:37.600 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:34:37.600 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:34:37.601 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:34:37.601 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:34:37.601 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:34:37.601 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:34:37.601 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:34:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:36.851397+0000 mgr.smithi067.rdualw (mgr.24569) 2287 : cluster [DBG] pgmap v1973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:34:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:34:36.949321+0000 mgr.smithi067.rdualw (mgr.24569) 2288 : audit [DBG] from='client.35662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:34:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:34:37.240622+0000 mgr.smithi067.rdualw (mgr.24569) 2289 : audit [DBG] from='client.35666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:34:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:34:37.596099+0000 mon.smithi061 (mon.0) 652 : audit [DBG] from='client.? 172.21.15.61:0/300572797' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:34:38.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:36.851397+0000 mgr.smithi067.rdualw (mgr.24569) 2287 : cluster [DBG] pgmap v1973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:34:38.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:34:36.949321+0000 mgr.smithi067.rdualw (mgr.24569) 2288 : audit [DBG] from='client.35662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:34:38.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:34:37.240622+0000 mgr.smithi067.rdualw (mgr.24569) 2289 : audit [DBG] from='client.35666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:34:38.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:34:37.596099+0000 mon.smithi061 (mon.0) 652 : audit [DBG] from='client.? 172.21.15.61:0/300572797' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:34:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:38.852192+0000 mgr.smithi067.rdualw (mgr.24569) 2290 : cluster [DBG] pgmap v1974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:40.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:39.835684+0000 mon.smithi061 (mon.0) 653 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2022-03-17T16:34:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:38.852192+0000 mgr.smithi067.rdualw (mgr.24569) 2290 : cluster [DBG] pgmap v1974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:39.835684+0000 mon.smithi061 (mon.0) 653 : cluster [DBG] osdmap e90: 8 total, 8 up, 8 in 2022-03-17T16:34:42.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:40.853184+0000 mgr.smithi067.rdualw (mgr.24569) 2291 : cluster [DBG] pgmap v1976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 0 op/s 2022-03-17T16:34:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:40.853184+0000 mgr.smithi067.rdualw (mgr.24569) 2291 : cluster [DBG] pgmap v1976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 0 op/s 2022-03-17T16:34:44.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:42.853894+0000 mgr.smithi067.rdualw (mgr.24569) 2292 : cluster [DBG] pgmap v1977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 0 op/s 2022-03-17T16:34:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:42.853894+0000 mgr.smithi067.rdualw (mgr.24569) 2292 : cluster [DBG] pgmap v1977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 0 op/s 2022-03-17T16:34:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:44.854572+0000 mgr.smithi067.rdualw (mgr.24569) 2293 : cluster [DBG] pgmap v1978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 0 op/s 2022-03-17T16:34:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:44.854572+0000 mgr.smithi067.rdualw (mgr.24569) 2293 : cluster [DBG] pgmap v1978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 0 op/s 2022-03-17T16:34:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:46.855331+0000 mgr.smithi067.rdualw (mgr.24569) 2294 : cluster [DBG] pgmap v1979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 0 op/s 2022-03-17T16:34:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:46.855331+0000 mgr.smithi067.rdualw (mgr.24569) 2294 : cluster [DBG] pgmap v1979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 0 op/s 2022-03-17T16:34:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:48.855984+0000 mgr.smithi067.rdualw (mgr.24569) 2295 : cluster [DBG] pgmap v1980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 0 op/s 2022-03-17T16:34:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:48.855984+0000 mgr.smithi067.rdualw (mgr.24569) 2295 : cluster [DBG] pgmap v1980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 204 B/s rd, 0 op/s 2022-03-17T16:34:52.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:50.856969+0000 mgr.smithi067.rdualw (mgr.24569) 2296 : cluster [DBG] pgmap v1981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 185 B/s rd, 0 op/s 2022-03-17T16:34:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:50.856969+0000 mgr.smithi067.rdualw (mgr.24569) 2296 : cluster [DBG] pgmap v1981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 185 B/s rd, 0 op/s 2022-03-17T16:34:54.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:52.857685+0000 mgr.smithi067.rdualw (mgr.24569) 2297 : cluster [DBG] pgmap v1982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:54.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:52.857685+0000 mgr.smithi067.rdualw (mgr.24569) 2297 : cluster [DBG] pgmap v1982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:56.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:54.858250+0000 mgr.smithi067.rdualw (mgr.24569) 2298 : cluster [DBG] pgmap v1983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:54.858250+0000 mgr.smithi067.rdualw (mgr.24569) 2298 : cluster [DBG] pgmap v1983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:34:58.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:56.859109+0000 mgr.smithi067.rdualw (mgr.24569) 2299 : cluster [DBG] pgmap v1984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:34:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:56.859109+0000 mgr.smithi067.rdualw (mgr.24569) 2299 : cluster [DBG] pgmap v1984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:35:00.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:34:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:34:58.859783+0000 mgr.smithi067.rdualw (mgr.24569) 2300 : cluster [DBG] pgmap v1985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:00.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:34:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:34:58.859783+0000 mgr.smithi067.rdualw (mgr.24569) 2300 : cluster [DBG] pgmap v1985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:02.306 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:00.860610+0000 mgr.smithi067.rdualw (mgr.24569) 2301 : cluster [DBG] pgmap v1986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:02.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:00.860610+0000 mgr.smithi067.rdualw (mgr.24569) 2301 : cluster [DBG] pgmap v1986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:02.861182+0000 mgr.smithi067.rdualw (mgr.24569) 2302 : cluster [DBG] pgmap v1987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:02.861182+0000 mgr.smithi067.rdualw (mgr.24569) 2302 : cluster [DBG] pgmap v1987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:06.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:04.861892+0000 mgr.smithi067.rdualw (mgr.24569) 2303 : cluster [DBG] pgmap v1988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:04.861892+0000 mgr.smithi067.rdualw (mgr.24569) 2303 : cluster [DBG] pgmap v1988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:07.917 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:35:08.202 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:35:08.203 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (72m) 3m ago 73m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:35:08.203 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (65m) 3m ago 73m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:35:08.203 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (65m) 3m ago 73m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:35:08.204 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (72m) 3m ago 73m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:35:08.204 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (65m) 3m ago 69m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:35:08.204 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (65m) 3m ago 69m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:35:08.204 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (66m) 3m ago 74m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:35:08.204 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (66m) 3m ago 73m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:35:08.205 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (66m) 3m ago 75m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:35:08.205 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (66m) 3m ago 73m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:35:08.205 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (67m) 3m ago 67m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:35:08.206 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (67m) 3m ago 67m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:35:08.206 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (73m) 3m ago 73m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:35:08.207 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (72m) 3m ago 72m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:35:08.207 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (56m) 3m ago 72m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:35:08.207 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (72m) 3m ago 72m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:35:08.208 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (72m) 3m ago 72m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:35:08.208 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (71m) 3m ago 71m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:35:08.208 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (71m) 3m ago 71m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:35:08.208 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (71m) 3m ago 71m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:35:08.209 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (71m) 3m ago 71m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:35:08.209 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (70m) 3m ago 70m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:35:08.209 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (72m) 3m ago 73m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:35:08.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:06.862834+0000 mgr.smithi067.rdualw (mgr.24569) 2304 : cluster [DBG] pgmap v1989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:35:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:06.862834+0000 mgr.smithi067.rdualw (mgr.24569) 2304 : cluster [DBG] pgmap v1989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:35:08.546 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:35:08.547 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:35:08.547 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:35:08.547 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:35:08.548 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:35:08.548 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:35:08.548 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:35:08.548 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:35:08.548 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:35:08.549 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:35:08.549 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:35:08.549 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:35:08.549 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:35:08.550 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:35:08.551 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:35:08.551 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:35:08.551 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:35:08.552 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:35:08.552 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:35:09.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:35:07.897457+0000 mgr.smithi067.rdualw (mgr.24569) 2305 : audit [DBG] from='client.35674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:35:09.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:35:08.184764+0000 mgr.smithi067.rdualw (mgr.24569) 2306 : audit [DBG] from='client.35678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:35:09.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:35:08.544759+0000 mon.smithi061 (mon.0) 654 : audit [DBG] from='client.? 172.21.15.61:0/1626899601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:35:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:35:07.897457+0000 mgr.smithi067.rdualw (mgr.24569) 2305 : audit [DBG] from='client.35674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:35:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:35:08.184764+0000 mgr.smithi067.rdualw (mgr.24569) 2306 : audit [DBG] from='client.35678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:35:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:35:08.544759+0000 mon.smithi061 (mon.0) 654 : audit [DBG] from='client.? 172.21.15.61:0/1626899601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:35:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:08.863550+0000 mgr.smithi067.rdualw (mgr.24569) 2307 : cluster [DBG] pgmap v1990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:08.863550+0000 mgr.smithi067.rdualw (mgr.24569) 2307 : cluster [DBG] pgmap v1990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:12.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:10.864294+0000 mgr.smithi067.rdualw (mgr.24569) 2308 : cluster [DBG] pgmap v1991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:12.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:10.864294+0000 mgr.smithi067.rdualw (mgr.24569) 2308 : cluster [DBG] pgmap v1991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:12.864956+0000 mgr.smithi067.rdualw (mgr.24569) 2309 : cluster [DBG] pgmap v1992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:12.864956+0000 mgr.smithi067.rdualw (mgr.24569) 2309 : cluster [DBG] pgmap v1992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:14.865516+0000 mgr.smithi067.rdualw (mgr.24569) 2310 : cluster [DBG] pgmap v1993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:14.865516+0000 mgr.smithi067.rdualw (mgr.24569) 2310 : cluster [DBG] pgmap v1993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:16.866296+0000 mgr.smithi067.rdualw (mgr.24569) 2311 : cluster [DBG] pgmap v1994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:35:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:16.866296+0000 mgr.smithi067.rdualw (mgr.24569) 2311 : cluster [DBG] pgmap v1994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:35:20.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:18.866881+0000 mgr.smithi067.rdualw (mgr.24569) 2312 : cluster [DBG] pgmap v1995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:18.866881+0000 mgr.smithi067.rdualw (mgr.24569) 2312 : cluster [DBG] pgmap v1995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:22.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:20.867704+0000 mgr.smithi067.rdualw (mgr.24569) 2313 : cluster [DBG] pgmap v1996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:20.867704+0000 mgr.smithi067.rdualw (mgr.24569) 2313 : cluster [DBG] pgmap v1996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:22.868270+0000 mgr.smithi067.rdualw (mgr.24569) 2314 : cluster [DBG] pgmap v1997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:22.868270+0000 mgr.smithi067.rdualw (mgr.24569) 2314 : cluster [DBG] pgmap v1997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:24.868919+0000 mgr.smithi067.rdualw (mgr.24569) 2315 : cluster [DBG] pgmap v1998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:24.868919+0000 mgr.smithi067.rdualw (mgr.24569) 2315 : cluster [DBG] pgmap v1998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:26.869749+0000 mgr.smithi067.rdualw (mgr.24569) 2316 : cluster [DBG] pgmap v1999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:35:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:26.869749+0000 mgr.smithi067.rdualw (mgr.24569) 2316 : cluster [DBG] pgmap v1999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:35:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:28.870348+0000 mgr.smithi067.rdualw (mgr.24569) 2317 : cluster [DBG] pgmap v2000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:28.870348+0000 mgr.smithi067.rdualw (mgr.24569) 2317 : cluster [DBG] pgmap v2000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:30.871139+0000 mgr.smithi067.rdualw (mgr.24569) 2318 : cluster [DBG] pgmap v2001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:30.871139+0000 mgr.smithi067.rdualw (mgr.24569) 2318 : cluster [DBG] pgmap v2001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:32.871832+0000 mgr.smithi067.rdualw (mgr.24569) 2319 : cluster [DBG] pgmap v2002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:32.871832+0000 mgr.smithi067.rdualw (mgr.24569) 2319 : cluster [DBG] pgmap v2002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:35:34.410835+0000 mon.smithi067 (mon.1) 385 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:35:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:35:34.412315+0000 mon.smithi067 (mon.1) 386 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:35:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:35:34.413210+0000 mon.smithi067 (mon.1) 387 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:35:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:35:34.414049+0000 mgr.smithi067.rdualw (mgr.24569) 2320 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:35:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:35:34.779235+0000 mon.smithi067 (mon.1) 388 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:35:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:35:34.779529+0000 mon.smithi061 (mon.0) 655 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:35:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:35:34.779577+0000 mon.smithi067 (mon.1) 389 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:35:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:35:34.779858+0000 mon.smithi061 (mon.0) 656 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:35:35.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:35:34.832813+0000 mon.smithi061 (mon.0) 657 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:35:35.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:35:34.841256+0000 mon.smithi061 (mon.0) 658 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:35:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:35:34.410835+0000 mon.smithi067 (mon.1) 385 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:35:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:35:34.412315+0000 mon.smithi067 (mon.1) 386 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:35:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:35:34.413210+0000 mon.smithi067 (mon.1) 387 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:35:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:35:34.414049+0000 mgr.smithi067.rdualw (mgr.24569) 2320 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:35:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:35:34.779235+0000 mon.smithi067 (mon.1) 388 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:35:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:35:34.779529+0000 mon.smithi061 (mon.0) 655 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:35:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:35:34.779577+0000 mon.smithi067 (mon.1) 389 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:35:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:35:34.779858+0000 mon.smithi061 (mon.0) 656 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:35:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:35:34.832813+0000 mon.smithi061 (mon.0) 657 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:35:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:35:34.841256+0000 mon.smithi061 (mon.0) 658 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:35:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:34.872445+0000 mgr.smithi067.rdualw (mgr.24569) 2321 : cluster [DBG] pgmap v2003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:34.872445+0000 mgr.smithi067.rdualw (mgr.24569) 2321 : cluster [DBG] pgmap v2003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:36.873421+0000 mgr.smithi067.rdualw (mgr.24569) 2322 : cluster [DBG] pgmap v2004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:35:38.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:36.873421+0000 mgr.smithi067.rdualw (mgr.24569) 2322 : cluster [DBG] pgmap v2004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:35:38.853 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:35:39.145 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:35:39.145 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (73m) 4m ago 74m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:35:39.145 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (65m) 4m ago 74m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:35:39.146 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (65m) 4m ago 73m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:35:39.146 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (73m) 4m ago 74m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:35:39.146 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (66m) 4m ago 69m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:35:39.146 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (66m) 4m ago 69m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:35:39.147 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (67m) 4m ago 75m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:35:39.147 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (66m) 4m ago 73m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:35:39.147 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (66m) 4m ago 75m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:35:39.147 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (66m) 4m ago 73m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:35:39.147 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (67m) 4m ago 67m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:35:39.148 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (67m) 4m ago 67m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:35:39.148 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (74m) 4m ago 74m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:35:39.148 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (73m) 4m ago 73m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:35:39.148 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (56m) 4m ago 73m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:35:39.149 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (72m) 4m ago 72m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:35:39.149 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (72m) 4m ago 72m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:35:39.149 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (72m) 4m ago 72m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:35:39.149 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (72m) 4m ago 72m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:35:39.149 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (71m) 4m ago 71m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:35:39.150 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (71m) 4m ago 71m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:35:39.150 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (71m) 4m ago 71m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:35:39.150 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (72m) 4m ago 73m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:35:39.486 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:35:39.487 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:35:39.487 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:35:39.487 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:35:39.488 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:35:39.488 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:35:39.488 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:35:39.488 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:35:39.489 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:35:39.489 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:35:39.489 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:35:39.489 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:35:39.489 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:35:39.490 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:35:39.490 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:35:39.490 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:35:39.490 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:35:39.491 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:35:39.491 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:35:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:35:38.839652+0000 mgr.smithi067.rdualw (mgr.24569) 2323 : audit [DBG] from='client.35686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:35:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:38.873933+0000 mgr.smithi067.rdualw (mgr.24569) 2324 : cluster [DBG] pgmap v2005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:35:39.127101+0000 mgr.smithi067.rdualw (mgr.24569) 2325 : audit [DBG] from='client.35690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:35:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:35:39.485367+0000 mon.smithi061 (mon.0) 659 : audit [DBG] from='client.? 172.21.15.61:0/501527589' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:35:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:35:38.839652+0000 mgr.smithi067.rdualw (mgr.24569) 2323 : audit [DBG] from='client.35686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:35:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:38.873933+0000 mgr.smithi067.rdualw (mgr.24569) 2324 : cluster [DBG] pgmap v2005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:35:39.127101+0000 mgr.smithi067.rdualw (mgr.24569) 2325 : audit [DBG] from='client.35690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:35:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:35:39.485367+0000 mon.smithi061 (mon.0) 659 : audit [DBG] from='client.? 172.21.15.61:0/501527589' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:35:42.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:40.874810+0000 mgr.smithi067.rdualw (mgr.24569) 2326 : cluster [DBG] pgmap v2006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:40.874810+0000 mgr.smithi067.rdualw (mgr.24569) 2326 : cluster [DBG] pgmap v2006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:42.875338+0000 mgr.smithi067.rdualw (mgr.24569) 2327 : cluster [DBG] pgmap v2007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:42.875338+0000 mgr.smithi067.rdualw (mgr.24569) 2327 : cluster [DBG] pgmap v2007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:44.876015+0000 mgr.smithi067.rdualw (mgr.24569) 2328 : cluster [DBG] pgmap v2008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:44.876015+0000 mgr.smithi067.rdualw (mgr.24569) 2328 : cluster [DBG] pgmap v2008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:46.876861+0000 mgr.smithi067.rdualw (mgr.24569) 2329 : cluster [DBG] pgmap v2009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:35:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:46.876861+0000 mgr.smithi067.rdualw (mgr.24569) 2329 : cluster [DBG] pgmap v2009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:35:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:48.877483+0000 mgr.smithi067.rdualw (mgr.24569) 2330 : cluster [DBG] pgmap v2010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:48.877483+0000 mgr.smithi067.rdualw (mgr.24569) 2330 : cluster [DBG] pgmap v2010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:50.878253+0000 mgr.smithi067.rdualw (mgr.24569) 2331 : cluster [DBG] pgmap v2011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:50.878253+0000 mgr.smithi067.rdualw (mgr.24569) 2331 : cluster [DBG] pgmap v2011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:52.879000+0000 mgr.smithi067.rdualw (mgr.24569) 2332 : cluster [DBG] pgmap v2012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:52.879000+0000 mgr.smithi067.rdualw (mgr.24569) 2332 : cluster [DBG] pgmap v2012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:54.879734+0000 mgr.smithi067.rdualw (mgr.24569) 2333 : cluster [DBG] pgmap v2013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:54.879734+0000 mgr.smithi067.rdualw (mgr.24569) 2333 : cluster [DBG] pgmap v2013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:35:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:56.880729+0000 mgr.smithi067.rdualw (mgr.24569) 2334 : cluster [DBG] pgmap v2014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:35:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:56.880729+0000 mgr.smithi067.rdualw (mgr.24569) 2334 : cluster [DBG] pgmap v2014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:36:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:35:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:35:58.881493+0000 mgr.smithi067.rdualw (mgr.24569) 2335 : cluster [DBG] pgmap v2015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:35:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:35:58.881493+0000 mgr.smithi067.rdualw (mgr.24569) 2335 : cluster [DBG] pgmap v2015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:00.882274+0000 mgr.smithi067.rdualw (mgr.24569) 2336 : cluster [DBG] pgmap v2016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:00.882274+0000 mgr.smithi067.rdualw (mgr.24569) 2336 : cluster [DBG] pgmap v2016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:02.882828+0000 mgr.smithi067.rdualw (mgr.24569) 2337 : cluster [DBG] pgmap v2017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:02.882828+0000 mgr.smithi067.rdualw (mgr.24569) 2337 : cluster [DBG] pgmap v2017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:04.883450+0000 mgr.smithi067.rdualw (mgr.24569) 2338 : cluster [DBG] pgmap v2018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:04.883450+0000 mgr.smithi067.rdualw (mgr.24569) 2338 : cluster [DBG] pgmap v2018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:06.884405+0000 mgr.smithi067.rdualw (mgr.24569) 2339 : cluster [DBG] pgmap v2019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:36:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:06.884405+0000 mgr.smithi067.rdualw (mgr.24569) 2339 : cluster [DBG] pgmap v2019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:36:09.793 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:36:10.088 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:36:10.088 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (73m) 4m ago 74m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:36:10.089 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (66m) 4m ago 74m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:36:10.089 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (66m) 4m ago 74m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:36:10.089 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (73m) 4m ago 74m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:36:10.090 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (66m) 4m ago 70m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:36:10.090 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (66m) 4m ago 70m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:36:10.090 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (67m) 4m ago 75m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:36:10.090 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (67m) 4m ago 74m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:36:10.090 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (67m) 4m ago 76m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:36:10.091 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (67m) 4m ago 74m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:36:10.091 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (68m) 4m ago 68m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:36:10.091 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (68m) 4m ago 68m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:36:10.091 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (74m) 4m ago 74m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:36:10.092 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (73m) 4m ago 73m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:36:10.092 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (57m) 4m ago 73m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:36:10.092 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (73m) 4m ago 73m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:36:10.092 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (73m) 4m ago 73m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:36:10.092 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (72m) 4m ago 72m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:36:10.093 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (72m) 4m ago 72m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:36:10.093 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (72m) 4m ago 72m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:36:10.093 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (72m) 4m ago 72m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:36:10.093 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (71m) 4m ago 71m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:36:10.093 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (73m) 4m ago 74m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:36:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:08.885070+0000 mgr.smithi067.rdualw (mgr.24569) 2340 : cluster [DBG] pgmap v2020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:08.885070+0000 mgr.smithi067.rdualw (mgr.24569) 2340 : cluster [DBG] pgmap v2020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:10.460 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:36:10.460 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:36:10.460 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:36:10.460 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:36:10.461 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:36:10.461 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:36:10.461 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:36:10.461 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:36:10.462 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:36:10.462 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:36:10.462 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:36:10.462 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:36:10.462 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:36:10.463 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:36:10.463 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:36:10.463 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:36:10.463 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:36:10.464 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:36:10.464 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:36:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:36:09.779950+0000 mgr.smithi067.rdualw (mgr.24569) 2341 : audit [DBG] from='client.35698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:36:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:36:10.070269+0000 mgr.smithi067.rdualw (mgr.24569) 2342 : audit [DBG] from='client.35702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:36:11.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:36:10.458559+0000 mon.smithi061 (mon.0) 660 : audit [DBG] from='client.? 172.21.15.61:0/1313338851' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:36:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:36:09.779950+0000 mgr.smithi067.rdualw (mgr.24569) 2341 : audit [DBG] from='client.35698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:36:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:36:10.070269+0000 mgr.smithi067.rdualw (mgr.24569) 2342 : audit [DBG] from='client.35702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:36:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:36:10.458559+0000 mon.smithi061 (mon.0) 660 : audit [DBG] from='client.? 172.21.15.61:0/1313338851' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:36:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:10.885986+0000 mgr.smithi067.rdualw (mgr.24569) 2343 : cluster [DBG] pgmap v2021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:10.885986+0000 mgr.smithi067.rdualw (mgr.24569) 2343 : cluster [DBG] pgmap v2021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:12.886703+0000 mgr.smithi067.rdualw (mgr.24569) 2344 : cluster [DBG] pgmap v2022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:12.886703+0000 mgr.smithi067.rdualw (mgr.24569) 2344 : cluster [DBG] pgmap v2022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:14.887319+0000 mgr.smithi067.rdualw (mgr.24569) 2345 : cluster [DBG] pgmap v2023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:14.887319+0000 mgr.smithi067.rdualw (mgr.24569) 2345 : cluster [DBG] pgmap v2023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:16.888296+0000 mgr.smithi067.rdualw (mgr.24569) 2346 : cluster [DBG] pgmap v2024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:36:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:16.888296+0000 mgr.smithi067.rdualw (mgr.24569) 2346 : cluster [DBG] pgmap v2024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:36:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:18.889036+0000 mgr.smithi067.rdualw (mgr.24569) 2347 : cluster [DBG] pgmap v2025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:18.889036+0000 mgr.smithi067.rdualw (mgr.24569) 2347 : cluster [DBG] pgmap v2025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:20.889929+0000 mgr.smithi067.rdualw (mgr.24569) 2348 : cluster [DBG] pgmap v2026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:20.889929+0000 mgr.smithi067.rdualw (mgr.24569) 2348 : cluster [DBG] pgmap v2026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:22.890472+0000 mgr.smithi067.rdualw (mgr.24569) 2349 : cluster [DBG] pgmap v2027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:24.325 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:22.890472+0000 mgr.smithi067.rdualw (mgr.24569) 2349 : cluster [DBG] pgmap v2027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:24.891058+0000 mgr.smithi067.rdualw (mgr.24569) 2350 : cluster [DBG] pgmap v2028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:24.891058+0000 mgr.smithi067.rdualw (mgr.24569) 2350 : cluster [DBG] pgmap v2028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:26.892162+0000 mgr.smithi067.rdualw (mgr.24569) 2351 : cluster [DBG] pgmap v2029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:36:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:26.892162+0000 mgr.smithi067.rdualw (mgr.24569) 2351 : cluster [DBG] pgmap v2029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:36:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:28.892896+0000 mgr.smithi067.rdualw (mgr.24569) 2352 : cluster [DBG] pgmap v2030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:28.892896+0000 mgr.smithi067.rdualw (mgr.24569) 2352 : cluster [DBG] pgmap v2030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:30.893702+0000 mgr.smithi067.rdualw (mgr.24569) 2353 : cluster [DBG] pgmap v2031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:30.893702+0000 mgr.smithi067.rdualw (mgr.24569) 2353 : cluster [DBG] pgmap v2031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:32.894205+0000 mgr.smithi067.rdualw (mgr.24569) 2354 : cluster [DBG] pgmap v2032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:32.894205+0000 mgr.smithi067.rdualw (mgr.24569) 2354 : cluster [DBG] pgmap v2032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:36:34.784899+0000 mon.smithi067 (mon.1) 390 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:36:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:36:34.785132+0000 mon.smithi061 (mon.0) 661 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:36:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:36:34.785186+0000 mon.smithi067 (mon.1) 391 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:36:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:36:34.785481+0000 mon.smithi061 (mon.0) 662 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:36:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:36:34.845241+0000 mon.smithi067 (mon.1) 392 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:36:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:36:34.846653+0000 mon.smithi067 (mon.1) 393 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:36:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:36:34.847598+0000 mon.smithi067 (mon.1) 394 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:36:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:36:34.784899+0000 mon.smithi067 (mon.1) 390 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:36:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:36:34.785132+0000 mon.smithi061 (mon.0) 661 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:36:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:36:34.785186+0000 mon.smithi067 (mon.1) 391 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:36:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:36:34.785481+0000 mon.smithi061 (mon.0) 662 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:36:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:36:34.845241+0000 mon.smithi067 (mon.1) 392 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:36:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:36:34.846653+0000 mon.smithi067 (mon.1) 393 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:36:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:36:34.847598+0000 mon.smithi067 (mon.1) 394 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:36:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:36:34.848551+0000 mgr.smithi067.rdualw (mgr.24569) 2355 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:36:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:34.894797+0000 mgr.smithi067.rdualw (mgr.24569) 2356 : cluster [DBG] pgmap v2033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:36:35.262728+0000 mon.smithi061 (mon.0) 663 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:36:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:36:35.268342+0000 mon.smithi061 (mon.0) 664 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:36:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:36:34.848551+0000 mgr.smithi067.rdualw (mgr.24569) 2355 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:36:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:34.894797+0000 mgr.smithi067.rdualw (mgr.24569) 2356 : cluster [DBG] pgmap v2033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:36:35.262728+0000 mon.smithi061 (mon.0) 663 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:36:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:36:35.268342+0000 mon.smithi061 (mon.0) 664 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:36:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:36.895837+0000 mgr.smithi067.rdualw (mgr.24569) 2357 : cluster [DBG] pgmap v2034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:36:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:36.895837+0000 mgr.smithi067.rdualw (mgr.24569) 2357 : cluster [DBG] pgmap v2034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:36:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:38.896519+0000 mgr.smithi067.rdualw (mgr.24569) 2358 : cluster [DBG] pgmap v2035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:38.896519+0000 mgr.smithi067.rdualw (mgr.24569) 2358 : cluster [DBG] pgmap v2035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:40.767 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:36:41.059 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:36:41.059 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (74m) 5m ago 75m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:36:41.060 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (66m) 5m ago 75m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:36:41.060 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (66m) 5m ago 74m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:36:41.060 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (74m) 5m ago 75m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:36:41.060 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (67m) 5m ago 71m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:36:41.060 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (67m) 5m ago 70m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:36:41.061 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (68m) 5m ago 76m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:36:41.061 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (68m) 5m ago 74m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:36:41.061 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (67m) 5m ago 76m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:36:41.061 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (67m) 5m ago 74m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:36:41.062 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (68m) 5m ago 68m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:36:41.062 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (68m) 5m ago 68m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:36:41.062 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (75m) 5m ago 75m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:36:41.062 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (74m) 5m ago 74m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:36:41.063 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (57m) 5m ago 74m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:36:41.063 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (73m) 5m ago 73m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:36:41.063 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (73m) 5m ago 73m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:36:41.063 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (73m) 5m ago 73m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:36:41.064 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (73m) 5m ago 73m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:36:41.064 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (72m) 5m ago 72m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:36:41.064 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (72m) 5m ago 72m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:36:41.064 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (72m) 5m ago 72m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:36:41.064 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (74m) 5m ago 74m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:36:41.402 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:36:41.402 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:36:41.402 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:36:41.403 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:36:41.403 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:36:41.403 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:36:41.403 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:36:41.404 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:36:41.404 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:36:41.404 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:36:41.404 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:36:41.404 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:36:41.405 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:36:41.405 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:36:41.405 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:36:41.405 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:36:41.406 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:36:41.406 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:36:41.406 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:36:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:36:40.753962+0000 mgr.smithi067.rdualw (mgr.24569) 2359 : audit [DBG] from='client.35710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:36:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:40.897324+0000 mgr.smithi067.rdualw (mgr.24569) 2360 : cluster [DBG] pgmap v2036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:36:41.041299+0000 mgr.smithi067.rdualw (mgr.24569) 2361 : audit [DBG] from='client.35714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:36:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:36:41.400605+0000 mon.smithi061 (mon.0) 665 : audit [DBG] from='client.? 172.21.15.61:0/2377473073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:36:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:36:40.753962+0000 mgr.smithi067.rdualw (mgr.24569) 2359 : audit [DBG] from='client.35710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:36:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:40.897324+0000 mgr.smithi067.rdualw (mgr.24569) 2360 : cluster [DBG] pgmap v2036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:36:41.041299+0000 mgr.smithi067.rdualw (mgr.24569) 2361 : audit [DBG] from='client.35714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:36:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:36:41.400605+0000 mon.smithi061 (mon.0) 665 : audit [DBG] from='client.? 172.21.15.61:0/2377473073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:36:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:42.898050+0000 mgr.smithi067.rdualw (mgr.24569) 2362 : cluster [DBG] pgmap v2037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:42.898050+0000 mgr.smithi067.rdualw (mgr.24569) 2362 : cluster [DBG] pgmap v2037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:44.898763+0000 mgr.smithi067.rdualw (mgr.24569) 2363 : cluster [DBG] pgmap v2038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:44.898763+0000 mgr.smithi067.rdualw (mgr.24569) 2363 : cluster [DBG] pgmap v2038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:46.899561+0000 mgr.smithi067.rdualw (mgr.24569) 2364 : cluster [DBG] pgmap v2039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:36:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:46.899561+0000 mgr.smithi067.rdualw (mgr.24569) 2364 : cluster [DBG] pgmap v2039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:36:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:48.900137+0000 mgr.smithi067.rdualw (mgr.24569) 2365 : cluster [DBG] pgmap v2040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:48.900137+0000 mgr.smithi067.rdualw (mgr.24569) 2365 : cluster [DBG] pgmap v2040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:52.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:50.901028+0000 mgr.smithi067.rdualw (mgr.24569) 2366 : cluster [DBG] pgmap v2041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:50.901028+0000 mgr.smithi067.rdualw (mgr.24569) 2366 : cluster [DBG] pgmap v2041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:52.901472+0000 mgr.smithi067.rdualw (mgr.24569) 2367 : cluster [DBG] pgmap v2042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:52.901472+0000 mgr.smithi067.rdualw (mgr.24569) 2367 : cluster [DBG] pgmap v2042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:54.902040+0000 mgr.smithi067.rdualw (mgr.24569) 2368 : cluster [DBG] pgmap v2043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:54.902040+0000 mgr.smithi067.rdualw (mgr.24569) 2368 : cluster [DBG] pgmap v2043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:36:58.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:56.903029+0000 mgr.smithi067.rdualw (mgr.24569) 2369 : cluster [DBG] pgmap v2044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:36:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:56.903029+0000 mgr.smithi067.rdualw (mgr.24569) 2369 : cluster [DBG] pgmap v2044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:37:00.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:36:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:36:58.903589+0000 mgr.smithi067.rdualw (mgr.24569) 2370 : cluster [DBG] pgmap v2045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:36:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:36:58.903589+0000 mgr.smithi067.rdualw (mgr.24569) 2370 : cluster [DBG] pgmap v2045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:00.904548+0000 mgr.smithi067.rdualw (mgr.24569) 2371 : cluster [DBG] pgmap v2046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:00.904548+0000 mgr.smithi067.rdualw (mgr.24569) 2371 : cluster [DBG] pgmap v2046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:02.905144+0000 mgr.smithi067.rdualw (mgr.24569) 2372 : cluster [DBG] pgmap v2047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:02.905144+0000 mgr.smithi067.rdualw (mgr.24569) 2372 : cluster [DBG] pgmap v2047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:04.905885+0000 mgr.smithi067.rdualw (mgr.24569) 2373 : cluster [DBG] pgmap v2048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:04.905885+0000 mgr.smithi067.rdualw (mgr.24569) 2373 : cluster [DBG] pgmap v2048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:06.906677+0000 mgr.smithi067.rdualw (mgr.24569) 2374 : cluster [DBG] pgmap v2049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:37:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:06.906677+0000 mgr.smithi067.rdualw (mgr.24569) 2374 : cluster [DBG] pgmap v2049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:37:10.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:08.907249+0000 mgr.smithi067.rdualw (mgr.24569) 2375 : cluster [DBG] pgmap v2050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:08.907249+0000 mgr.smithi067.rdualw (mgr.24569) 2375 : cluster [DBG] pgmap v2050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:11.712 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:37:12.015 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:37:12.015 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (74m) 5m ago 75m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:37:12.016 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (67m) 5m ago 75m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:37:12.016 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (67m) 5m ago 75m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:37:12.016 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (74m) 5m ago 75m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:37:12.016 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (67m) 5m ago 71m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:37:12.017 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (67m) 5m ago 71m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:37:12.017 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (68m) 5m ago 76m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:37:12.017 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (68m) 5m ago 75m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:37:12.017 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (68m) 5m ago 77m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:37:12.017 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (68m) 5m ago 75m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:37:12.018 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (69m) 5m ago 69m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:37:12.018 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (69m) 5m ago 69m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:37:12.018 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (75m) 5m ago 75m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:37:12.018 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (75m) 5m ago 74m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:37:12.019 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (58m) 5m ago 74m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:37:12.019 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (74m) 5m ago 74m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:37:12.019 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (74m) 5m ago 74m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:37:12.019 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (73m) 5m ago 73m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:37:12.019 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (73m) 5m ago 73m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:37:12.020 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (73m) 5m ago 73m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:37:12.020 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (73m) 5m ago 73m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:37:12.020 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (72m) 5m ago 72m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:37:12.020 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (74m) 5m ago 75m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:37:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:10.908280+0000 mgr.smithi067.rdualw (mgr.24569) 2376 : cluster [DBG] pgmap v2051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:10.908280+0000 mgr.smithi067.rdualw (mgr.24569) 2376 : cluster [DBG] pgmap v2051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:12.385 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:37:12.386 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:37:12.386 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:37:12.386 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:37:12.386 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:37:12.387 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:37:12.387 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:37:12.387 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:37:12.387 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:37:12.388 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:37:12.388 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:37:12.388 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:37:12.388 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:37:12.388 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:37:12.389 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:37:12.389 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:37:12.389 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:37:12.389 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:37:12.389 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:37:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:37:11.699623+0000 mgr.smithi067.rdualw (mgr.24569) 2377 : audit [DBG] from='client.35722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:37:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:37:11.997809+0000 mgr.smithi067.rdualw (mgr.24569) 2378 : audit [DBG] from='client.35726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:37:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:37:12.384235+0000 mon.smithi061 (mon.0) 666 : audit [DBG] from='client.? 172.21.15.61:0/2321852274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:37:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:37:11.699623+0000 mgr.smithi067.rdualw (mgr.24569) 2377 : audit [DBG] from='client.35722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:37:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:37:11.997809+0000 mgr.smithi067.rdualw (mgr.24569) 2378 : audit [DBG] from='client.35726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:37:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:37:12.384235+0000 mon.smithi061 (mon.0) 666 : audit [DBG] from='client.? 172.21.15.61:0/2321852274' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:37:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:12.908767+0000 mgr.smithi067.rdualw (mgr.24569) 2379 : cluster [DBG] pgmap v2052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:12.908767+0000 mgr.smithi067.rdualw (mgr.24569) 2379 : cluster [DBG] pgmap v2052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:16.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:14.909293+0000 mgr.smithi067.rdualw (mgr.24569) 2380 : cluster [DBG] pgmap v2053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:16.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:14.909293+0000 mgr.smithi067.rdualw (mgr.24569) 2380 : cluster [DBG] pgmap v2053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:16.910280+0000 mgr.smithi067.rdualw (mgr.24569) 2381 : cluster [DBG] pgmap v2054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:37:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:16.910280+0000 mgr.smithi067.rdualw (mgr.24569) 2381 : cluster [DBG] pgmap v2054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:37:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:18.910849+0000 mgr.smithi067.rdualw (mgr.24569) 2382 : cluster [DBG] pgmap v2055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:18.910849+0000 mgr.smithi067.rdualw (mgr.24569) 2382 : cluster [DBG] pgmap v2055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:22.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:20.911712+0000 mgr.smithi067.rdualw (mgr.24569) 2383 : cluster [DBG] pgmap v2056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:20.911712+0000 mgr.smithi067.rdualw (mgr.24569) 2383 : cluster [DBG] pgmap v2056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:22.912210+0000 mgr.smithi067.rdualw (mgr.24569) 2384 : cluster [DBG] pgmap v2057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:22.912210+0000 mgr.smithi067.rdualw (mgr.24569) 2384 : cluster [DBG] pgmap v2057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:24.912984+0000 mgr.smithi067.rdualw (mgr.24569) 2385 : cluster [DBG] pgmap v2058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:24.912984+0000 mgr.smithi067.rdualw (mgr.24569) 2385 : cluster [DBG] pgmap v2058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:26.913937+0000 mgr.smithi067.rdualw (mgr.24569) 2386 : cluster [DBG] pgmap v2059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:37:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:26.913937+0000 mgr.smithi067.rdualw (mgr.24569) 2386 : cluster [DBG] pgmap v2059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:37:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:28.914667+0000 mgr.smithi067.rdualw (mgr.24569) 2387 : cluster [DBG] pgmap v2060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:28.914667+0000 mgr.smithi067.rdualw (mgr.24569) 2387 : cluster [DBG] pgmap v2060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:30.915639+0000 mgr.smithi067.rdualw (mgr.24569) 2388 : cluster [DBG] pgmap v2061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:30.915639+0000 mgr.smithi067.rdualw (mgr.24569) 2388 : cluster [DBG] pgmap v2061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:32.916290+0000 mgr.smithi067.rdualw (mgr.24569) 2389 : cluster [DBG] pgmap v2062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:32.916290+0000 mgr.smithi067.rdualw (mgr.24569) 2389 : cluster [DBG] pgmap v2062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:37:34.789825+0000 mon.smithi067 (mon.1) 395 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:37:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:37:34.790061+0000 mon.smithi061 (mon.0) 667 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:37:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:37:34.790088+0000 mon.smithi067 (mon.1) 396 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:37:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:37:34.790377+0000 mon.smithi061 (mon.0) 668 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:37:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:37:34.789825+0000 mon.smithi067 (mon.1) 395 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:37:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:37:34.790061+0000 mon.smithi061 (mon.0) 667 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:37:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:37:34.790088+0000 mon.smithi067 (mon.1) 396 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:37:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:37:34.790377+0000 mon.smithi061 (mon.0) 668 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:37:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:34.916868+0000 mgr.smithi067.rdualw (mgr.24569) 2390 : cluster [DBG] pgmap v2063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:37:35.272216+0000 mon.smithi067 (mon.1) 397 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:37:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:37:35.273699+0000 mon.smithi067 (mon.1) 398 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:37:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:37:35.274625+0000 mon.smithi067 (mon.1) 399 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:37:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:37:35.275469+0000 mgr.smithi067.rdualw (mgr.24569) 2391 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:37:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:37:35.691964+0000 mon.smithi061 (mon.0) 669 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:37:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:37:35.697734+0000 mon.smithi061 (mon.0) 670 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:37:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:34.916868+0000 mgr.smithi067.rdualw (mgr.24569) 2390 : cluster [DBG] pgmap v2063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:37:35.272216+0000 mon.smithi067 (mon.1) 397 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:37:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:37:35.273699+0000 mon.smithi067 (mon.1) 398 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:37:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:37:35.274625+0000 mon.smithi067 (mon.1) 399 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:37:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:37:35.275469+0000 mgr.smithi067.rdualw (mgr.24569) 2391 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:37:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:37:35.691964+0000 mon.smithi061 (mon.0) 669 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:37:36.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:37:35.697734+0000 mon.smithi061 (mon.0) 670 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:37:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:36.917653+0000 mgr.smithi067.rdualw (mgr.24569) 2392 : cluster [DBG] pgmap v2064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:37:38.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:36.917653+0000 mgr.smithi067.rdualw (mgr.24569) 2392 : cluster [DBG] pgmap v2064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:37:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:38.918258+0000 mgr.smithi067.rdualw (mgr.24569) 2393 : cluster [DBG] pgmap v2065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:38.918258+0000 mgr.smithi067.rdualw (mgr.24569) 2393 : cluster [DBG] pgmap v2065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:42.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:40.919221+0000 mgr.smithi067.rdualw (mgr.24569) 2394 : cluster [DBG] pgmap v2066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:40.919221+0000 mgr.smithi067.rdualw (mgr.24569) 2394 : cluster [DBG] pgmap v2066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:42.690 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:37:42.979 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:37:42.980 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (75m) 6m ago 76m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:37:42.980 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (67m) 6m ago 76m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:37:42.980 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (67m) 6m ago 75m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:37:42.981 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (75m) 6m ago 76m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:37:42.981 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (68m) 6m ago 72m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:37:42.981 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (68m) 6m ago 71m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:37:42.981 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (69m) 6m ago 77m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:37:42.981 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (69m) 6m ago 75m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:37:42.982 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (68m) 6m ago 77m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:37:42.982 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (68m) 6m ago 75m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:37:42.982 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (69m) 6m ago 69m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:37:42.982 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (69m) 6m ago 69m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:37:42.983 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (76m) 6m ago 76m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:37:42.983 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (75m) 6m ago 75m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:37:42.983 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (58m) 6m ago 75m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:37:42.984 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (74m) 6m ago 74m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:37:42.984 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (74m) 6m ago 74m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:37:42.984 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (74m) 6m ago 74m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:37:42.984 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (74m) 6m ago 74m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:37:42.985 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (73m) 6m ago 73m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:37:42.985 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (73m) 6m ago 73m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:37:42.985 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (73m) 6m ago 73m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:37:42.985 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (75m) 6m ago 75m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:37:43.334 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:37:43.335 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:37:43.335 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:37:43.335 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:37:43.335 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:37:43.336 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:37:43.336 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:37:43.336 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:37:43.336 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:37:43.337 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:37:43.337 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:37:43.337 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:37:43.337 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:37:43.337 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:37:43.338 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:37:43.338 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:37:43.338 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:37:43.339 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:37:43.339 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:37:44.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:37:42.677115+0000 mgr.smithi067.rdualw (mgr.24569) 2395 : audit [DBG] from='client.35734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:37:44.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:42.919795+0000 mgr.smithi067.rdualw (mgr.24569) 2396 : cluster [DBG] pgmap v2067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:44.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:37:42.962440+0000 mgr.smithi067.rdualw (mgr.24569) 2397 : audit [DBG] from='client.35738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:37:44.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:37:43.332939+0000 mon.smithi061 (mon.0) 671 : audit [DBG] from='client.? 172.21.15.61:0/2259457553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:37:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:37:42.677115+0000 mgr.smithi067.rdualw (mgr.24569) 2395 : audit [DBG] from='client.35734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:37:44.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:42.919795+0000 mgr.smithi067.rdualw (mgr.24569) 2396 : cluster [DBG] pgmap v2067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:44.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:37:42.962440+0000 mgr.smithi067.rdualw (mgr.24569) 2397 : audit [DBG] from='client.35738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:37:44.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:37:43.332939+0000 mon.smithi061 (mon.0) 671 : audit [DBG] from='client.? 172.21.15.61:0/2259457553' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:37:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:44.920644+0000 mgr.smithi067.rdualw (mgr.24569) 2398 : cluster [DBG] pgmap v2068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:44.920644+0000 mgr.smithi067.rdualw (mgr.24569) 2398 : cluster [DBG] pgmap v2068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:46.921730+0000 mgr.smithi067.rdualw (mgr.24569) 2399 : cluster [DBG] pgmap v2069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:37:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:46.921730+0000 mgr.smithi067.rdualw (mgr.24569) 2399 : cluster [DBG] pgmap v2069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:37:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:48.922230+0000 mgr.smithi067.rdualw (mgr.24569) 2400 : cluster [DBG] pgmap v2070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:48.922230+0000 mgr.smithi067.rdualw (mgr.24569) 2400 : cluster [DBG] pgmap v2070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:50.922991+0000 mgr.smithi067.rdualw (mgr.24569) 2401 : cluster [DBG] pgmap v2071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:50.922991+0000 mgr.smithi067.rdualw (mgr.24569) 2401 : cluster [DBG] pgmap v2071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:52.923735+0000 mgr.smithi067.rdualw (mgr.24569) 2402 : cluster [DBG] pgmap v2072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:52.923735+0000 mgr.smithi067.rdualw (mgr.24569) 2402 : cluster [DBG] pgmap v2072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:56.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:54.924311+0000 mgr.smithi067.rdualw (mgr.24569) 2403 : cluster [DBG] pgmap v2073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:54.924311+0000 mgr.smithi067.rdualw (mgr.24569) 2403 : cluster [DBG] pgmap v2073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:37:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:56.925246+0000 mgr.smithi067.rdualw (mgr.24569) 2404 : cluster [DBG] pgmap v2074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:37:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:56.925246+0000 mgr.smithi067.rdualw (mgr.24569) 2404 : cluster [DBG] pgmap v2074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:38:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:37:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:37:58.925850+0000 mgr.smithi067.rdualw (mgr.24569) 2405 : cluster [DBG] pgmap v2075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:37:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:37:58.925850+0000 mgr.smithi067.rdualw (mgr.24569) 2405 : cluster [DBG] pgmap v2075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:02.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:00.926882+0000 mgr.smithi067.rdualw (mgr.24569) 2406 : cluster [DBG] pgmap v2076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:02.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:00.926882+0000 mgr.smithi067.rdualw (mgr.24569) 2406 : cluster [DBG] pgmap v2076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:02.927503+0000 mgr.smithi067.rdualw (mgr.24569) 2407 : cluster [DBG] pgmap v2077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:02.927503+0000 mgr.smithi067.rdualw (mgr.24569) 2407 : cluster [DBG] pgmap v2077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:06.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:04.928188+0000 mgr.smithi067.rdualw (mgr.24569) 2408 : cluster [DBG] pgmap v2078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:04.928188+0000 mgr.smithi067.rdualw (mgr.24569) 2408 : cluster [DBG] pgmap v2078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:08.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:06.929080+0000 mgr.smithi067.rdualw (mgr.24569) 2409 : cluster [DBG] pgmap v2079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:38:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:06.929080+0000 mgr.smithi067.rdualw (mgr.24569) 2409 : cluster [DBG] pgmap v2079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:38:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:08.929880+0000 mgr.smithi067.rdualw (mgr.24569) 2410 : cluster [DBG] pgmap v2080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:10.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:08.929880+0000 mgr.smithi067.rdualw (mgr.24569) 2410 : cluster [DBG] pgmap v2080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:10.930703+0000 mgr.smithi067.rdualw (mgr.24569) 2411 : cluster [DBG] pgmap v2081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:10.930703+0000 mgr.smithi067.rdualw (mgr.24569) 2411 : cluster [DBG] pgmap v2081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:13.639 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:38:14.012 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:38:14.012 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (75m) 6m ago 76m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:38:14.013 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (68m) 6m ago 76m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:38:14.013 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (68m) 6m ago 76m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:38:14.013 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (75m) 6m ago 76m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:38:14.013 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (68m) 6m ago 72m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:38:14.014 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (68m) 6m ago 72m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:38:14.014 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (69m) 6m ago 78m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:38:14.014 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (69m) 6m ago 76m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:38:14.014 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (69m) 6m ago 78m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:38:14.015 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (69m) 6m ago 76m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:38:14.015 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (70m) 6m ago 70m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:38:14.015 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (70m) 6m ago 70m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:38:14.015 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (76m) 6m ago 76m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:38:14.015 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (76m) 6m ago 76m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:38:14.016 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (59m) 6m ago 75m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:38:14.016 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (75m) 6m ago 75m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:38:14.016 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (75m) 6m ago 75m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:38:14.016 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (74m) 6m ago 74m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:38:14.017 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (74m) 6m ago 74m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:38:14.017 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (74m) 6m ago 74m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:38:14.017 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (74m) 6m ago 74m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:38:14.017 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (73m) 6m ago 73m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:38:14.017 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (75m) 6m ago 76m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:38:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:12.931386+0000 mgr.smithi067.rdualw (mgr.24569) 2412 : cluster [DBG] pgmap v2082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:12.931386+0000 mgr.smithi067.rdualw (mgr.24569) 2412 : cluster [DBG] pgmap v2082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:14.356 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:38:14.356 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:38:14.356 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:38:14.356 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:38:14.357 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:38:14.357 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:38:14.357 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:38:14.357 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:38:14.358 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:38:14.358 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:38:14.358 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:38:14.358 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:38:14.359 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:38:14.359 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:38:14.359 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:38:14.359 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:38:14.359 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:38:14.360 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:38:14.360 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:38:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:38:13.626249+0000 mgr.smithi067.rdualw (mgr.24569) 2413 : audit [DBG] from='client.35746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:38:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:38:13.995118+0000 mgr.smithi067.rdualw (mgr.24569) 2414 : audit [DBG] from='client.35750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:38:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:38:14.354452+0000 mon.smithi061 (mon.0) 672 : audit [DBG] from='client.? 172.21.15.61:0/3187158644' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:38:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:38:13.626249+0000 mgr.smithi067.rdualw (mgr.24569) 2413 : audit [DBG] from='client.35746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:38:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:38:13.995118+0000 mgr.smithi067.rdualw (mgr.24569) 2414 : audit [DBG] from='client.35750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:38:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:38:14.354452+0000 mon.smithi061 (mon.0) 672 : audit [DBG] from='client.? 172.21.15.61:0/3187158644' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:38:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:14.932017+0000 mgr.smithi067.rdualw (mgr.24569) 2415 : cluster [DBG] pgmap v2083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:14.932017+0000 mgr.smithi067.rdualw (mgr.24569) 2415 : cluster [DBG] pgmap v2083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:16.933034+0000 mgr.smithi067.rdualw (mgr.24569) 2416 : cluster [DBG] pgmap v2084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:38:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:16.933034+0000 mgr.smithi067.rdualw (mgr.24569) 2416 : cluster [DBG] pgmap v2084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:38:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:18.933660+0000 mgr.smithi067.rdualw (mgr.24569) 2417 : cluster [DBG] pgmap v2085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:18.933660+0000 mgr.smithi067.rdualw (mgr.24569) 2417 : cluster [DBG] pgmap v2085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:20.934674+0000 mgr.smithi067.rdualw (mgr.24569) 2418 : cluster [DBG] pgmap v2086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:20.934674+0000 mgr.smithi067.rdualw (mgr.24569) 2418 : cluster [DBG] pgmap v2086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:22.935128+0000 mgr.smithi067.rdualw (mgr.24569) 2419 : cluster [DBG] pgmap v2087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:22.935128+0000 mgr.smithi067.rdualw (mgr.24569) 2419 : cluster [DBG] pgmap v2087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:24.935766+0000 mgr.smithi067.rdualw (mgr.24569) 2420 : cluster [DBG] pgmap v2088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:24.935766+0000 mgr.smithi067.rdualw (mgr.24569) 2420 : cluster [DBG] pgmap v2088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:26.936633+0000 mgr.smithi067.rdualw (mgr.24569) 2421 : cluster [DBG] pgmap v2089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:38:28.415 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:26.936633+0000 mgr.smithi067.rdualw (mgr.24569) 2421 : cluster [DBG] pgmap v2089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:38:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:28.937304+0000 mgr.smithi067.rdualw (mgr.24569) 2422 : cluster [DBG] pgmap v2090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:28.937304+0000 mgr.smithi067.rdualw (mgr.24569) 2422 : cluster [DBG] pgmap v2090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:30.938091+0000 mgr.smithi067.rdualw (mgr.24569) 2423 : cluster [DBG] pgmap v2091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:30.938091+0000 mgr.smithi067.rdualw (mgr.24569) 2423 : cluster [DBG] pgmap v2091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:32.938736+0000 mgr.smithi067.rdualw (mgr.24569) 2424 : cluster [DBG] pgmap v2092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:32.938736+0000 mgr.smithi067.rdualw (mgr.24569) 2424 : cluster [DBG] pgmap v2092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:38:34.795656+0000 mon.smithi067 (mon.1) 400 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:38:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:38:34.795817+0000 mon.smithi061 (mon.0) 673 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:38:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:38:34.795916+0000 mon.smithi067 (mon.1) 401 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:38:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:38:34.796109+0000 mon.smithi061 (mon.0) 674 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:38:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:38:34.795656+0000 mon.smithi067 (mon.1) 400 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:38:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:38:34.795817+0000 mon.smithi061 (mon.0) 673 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:38:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:38:34.795916+0000 mon.smithi067 (mon.1) 401 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:38:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:38:34.796109+0000 mon.smithi061 (mon.0) 674 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:38:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:34.939376+0000 mgr.smithi067.rdualw (mgr.24569) 2425 : cluster [DBG] pgmap v2093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:38:35.701701+0000 mon.smithi067 (mon.1) 402 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:38:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:38:35.703189+0000 mon.smithi067 (mon.1) 403 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:38:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:38:35.704102+0000 mon.smithi067 (mon.1) 404 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:38:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:34.939376+0000 mgr.smithi067.rdualw (mgr.24569) 2425 : cluster [DBG] pgmap v2093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:38:35.701701+0000 mon.smithi067 (mon.1) 402 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:38:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:38:35.703189+0000 mon.smithi067 (mon.1) 403 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:38:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:38:35.704102+0000 mon.smithi067 (mon.1) 404 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:38:37.379 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:38:35.704913+0000 mgr.smithi067.rdualw (mgr.24569) 2426 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:38:37.379 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:38:36.120916+0000 mon.smithi061 (mon.0) 675 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:38:37.379 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:38:36.128249+0000 mon.smithi061 (mon.0) 676 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:38:37.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:38:35.704913+0000 mgr.smithi067.rdualw (mgr.24569) 2426 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:38:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:38:36.120916+0000 mon.smithi061 (mon.0) 675 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:38:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:38:36.128249+0000 mon.smithi061 (mon.0) 676 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:38:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:36.940190+0000 mgr.smithi067.rdualw (mgr.24569) 2427 : cluster [DBG] pgmap v2094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:38:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:36.940190+0000 mgr.smithi067.rdualw (mgr.24569) 2427 : cluster [DBG] pgmap v2094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:38:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:38.940798+0000 mgr.smithi067.rdualw (mgr.24569) 2428 : cluster [DBG] pgmap v2095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:38.940798+0000 mgr.smithi067.rdualw (mgr.24569) 2428 : cluster [DBG] pgmap v2095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:40.941811+0000 mgr.smithi067.rdualw (mgr.24569) 2429 : cluster [DBG] pgmap v2096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:40.941811+0000 mgr.smithi067.rdualw (mgr.24569) 2429 : cluster [DBG] pgmap v2096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:42.942384+0000 mgr.smithi067.rdualw (mgr.24569) 2430 : cluster [DBG] pgmap v2097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:42.942384+0000 mgr.smithi067.rdualw (mgr.24569) 2430 : cluster [DBG] pgmap v2097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:44.675 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:38:44.967 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:38:44.968 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (76m) 7m ago 77m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:38:44.968 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (68m) 7m ago 77m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:38:44.968 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (68m) 7m ago 76m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:38:44.968 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (76m) 7m ago 77m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:38:44.969 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (69m) 7m ago 73m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:38:44.969 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (69m) 7m ago 73m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:38:44.969 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (70m) 7m ago 78m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:38:44.969 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (70m) 7m ago 76m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:38:44.970 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (69m) 7m ago 78m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:38:44.970 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (69m) 7m ago 76m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:38:44.970 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (70m) 7m ago 70m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:38:44.970 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (70m) 7m ago 70m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:38:44.971 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (77m) 7m ago 77m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:38:44.971 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (76m) 7m ago 76m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:38:44.971 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (59m) 7m ago 76m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:38:44.971 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (75m) 7m ago 75m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:38:44.971 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (75m) 7m ago 75m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:38:44.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (75m) 7m ago 75m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:38:44.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (75m) 7m ago 75m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:38:44.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (74m) 7m ago 74m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:38:44.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (74m) 7m ago 74m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:38:44.973 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (74m) 7m ago 74m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:38:44.973 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (76m) 7m ago 77m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:38:45.309 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:38:45.309 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:38:45.309 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:38:45.310 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:38:45.310 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:38:45.310 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:38:45.310 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:38:45.311 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:38:45.311 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:38:45.311 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:38:45.311 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:38:45.312 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:38:45.312 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:38:45.312 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:38:45.313 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:38:45.313 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:38:45.313 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:38:45.314 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:38:45.314 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:38:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:38:44.661959+0000 mgr.smithi067.rdualw (mgr.24569) 2431 : audit [DBG] from='client.35758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:38:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:44.943149+0000 mgr.smithi067.rdualw (mgr.24569) 2432 : cluster [DBG] pgmap v2098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:38:44.950420+0000 mgr.smithi067.rdualw (mgr.24569) 2433 : audit [DBG] from='client.35762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:38:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:38:45.307849+0000 mon.smithi061 (mon.0) 677 : audit [DBG] from='client.? 172.21.15.61:0/1918180136' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:38:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:38:44.661959+0000 mgr.smithi067.rdualw (mgr.24569) 2431 : audit [DBG] from='client.35758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:38:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:44.943149+0000 mgr.smithi067.rdualw (mgr.24569) 2432 : cluster [DBG] pgmap v2098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:46.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:38:44.950420+0000 mgr.smithi067.rdualw (mgr.24569) 2433 : audit [DBG] from='client.35762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:38:46.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:38:45.307849+0000 mon.smithi061 (mon.0) 677 : audit [DBG] from='client.? 172.21.15.61:0/1918180136' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:38:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:46.944238+0000 mgr.smithi067.rdualw (mgr.24569) 2434 : cluster [DBG] pgmap v2099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:38:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:46.944238+0000 mgr.smithi067.rdualw (mgr.24569) 2434 : cluster [DBG] pgmap v2099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:38:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:48.944870+0000 mgr.smithi067.rdualw (mgr.24569) 2435 : cluster [DBG] pgmap v2100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:48.944870+0000 mgr.smithi067.rdualw (mgr.24569) 2435 : cluster [DBG] pgmap v2100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:50.945847+0000 mgr.smithi067.rdualw (mgr.24569) 2436 : cluster [DBG] pgmap v2101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:50.945847+0000 mgr.smithi067.rdualw (mgr.24569) 2436 : cluster [DBG] pgmap v2101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:52.946475+0000 mgr.smithi067.rdualw (mgr.24569) 2437 : cluster [DBG] pgmap v2102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:52.946475+0000 mgr.smithi067.rdualw (mgr.24569) 2437 : cluster [DBG] pgmap v2102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:54.947212+0000 mgr.smithi067.rdualw (mgr.24569) 2438 : cluster [DBG] pgmap v2103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:54.947212+0000 mgr.smithi067.rdualw (mgr.24569) 2438 : cluster [DBG] pgmap v2103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:38:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:38:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:56.948187+0000 mgr.smithi067.rdualw (mgr.24569) 2439 : cluster [DBG] pgmap v2104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:38:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:38:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:56.948187+0000 mgr.smithi067.rdualw (mgr.24569) 2439 : cluster [DBG] pgmap v2104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:39:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:38:58.948828+0000 mgr.smithi067.rdualw (mgr.24569) 2440 : cluster [DBG] pgmap v2105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:38:58.948828+0000 mgr.smithi067.rdualw (mgr.24569) 2440 : cluster [DBG] pgmap v2105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:00.949722+0000 mgr.smithi067.rdualw (mgr.24569) 2441 : cluster [DBG] pgmap v2106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:00.949722+0000 mgr.smithi067.rdualw (mgr.24569) 2441 : cluster [DBG] pgmap v2106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:02.950337+0000 mgr.smithi067.rdualw (mgr.24569) 2442 : cluster [DBG] pgmap v2107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:02.950337+0000 mgr.smithi067.rdualw (mgr.24569) 2442 : cluster [DBG] pgmap v2107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:04.950959+0000 mgr.smithi067.rdualw (mgr.24569) 2443 : cluster [DBG] pgmap v2108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:04.950959+0000 mgr.smithi067.rdualw (mgr.24569) 2443 : cluster [DBG] pgmap v2108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:06.951849+0000 mgr.smithi067.rdualw (mgr.24569) 2444 : cluster [DBG] pgmap v2109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:39:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:06.951849+0000 mgr.smithi067.rdualw (mgr.24569) 2444 : cluster [DBG] pgmap v2109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:39:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:08.952447+0000 mgr.smithi067.rdualw (mgr.24569) 2445 : cluster [DBG] pgmap v2110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:08.952447+0000 mgr.smithi067.rdualw (mgr.24569) 2445 : cluster [DBG] pgmap v2110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:10.953268+0000 mgr.smithi067.rdualw (mgr.24569) 2446 : cluster [DBG] pgmap v2111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:10.953268+0000 mgr.smithi067.rdualw (mgr.24569) 2446 : cluster [DBG] pgmap v2111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:12.953960+0000 mgr.smithi067.rdualw (mgr.24569) 2447 : cluster [DBG] pgmap v2112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:12.953960+0000 mgr.smithi067.rdualw (mgr.24569) 2447 : cluster [DBG] pgmap v2112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:15.618 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:39:15.958 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:39:15.958 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (76m) 7m ago 77m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:39:15.958 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (69m) 7m ago 77m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:39:15.958 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (69m) 7m ago 77m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:39:15.959 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (76m) 7m ago 77m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:39:15.959 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (69m) 7m ago 73m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:39:15.959 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (69m) 7m ago 73m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:39:15.959 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (70m) 7m ago 79m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:39:15.960 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (70m) 7m ago 77m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:39:15.960 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (70m) 7m ago 79m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:39:15.960 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (70m) 7m ago 77m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:39:15.960 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (71m) 7m ago 71m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:39:15.960 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (71m) 7m ago 71m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:39:15.961 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (77m) 7m ago 77m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:39:15.961 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (77m) 7m ago 77m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:39:15.961 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (60m) 7m ago 76m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:39:15.961 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (76m) 7m ago 76m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:39:15.961 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (76m) 7m ago 76m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:39:15.962 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (75m) 7m ago 75m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:39:15.962 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (75m) 7m ago 75m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:39:15.962 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (75m) 7m ago 75m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:39:15.962 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (75m) 7m ago 75m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:39:15.963 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (74m) 7m ago 74m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:39:15.963 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (76m) 7m ago 77m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:39:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:14.954571+0000 mgr.smithi067.rdualw (mgr.24569) 2448 : cluster [DBG] pgmap v2113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:16.302 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:39:16.302 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:39:16.302 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:39:16.303 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:39:16.303 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:39:16.303 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:39:16.303 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:39:16.304 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:39:16.304 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:39:16.304 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:39:16.304 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:39:16.305 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:39:16.305 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:39:16.305 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:39:16.306 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:39:16.306 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:39:16.306 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:39:16.306 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:39:16.307 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:39:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:14.954571+0000 mgr.smithi067.rdualw (mgr.24569) 2448 : cluster [DBG] pgmap v2113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:39:15.604924+0000 mgr.smithi067.rdualw (mgr.24569) 2449 : audit [DBG] from='client.35770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:39:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:39:15.940061+0000 mgr.smithi067.rdualw (mgr.24569) 2450 : audit [DBG] from='client.35774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:39:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:39:16.300448+0000 mon.smithi061 (mon.0) 678 : audit [DBG] from='client.? 172.21.15.61:0/2788445277' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:39:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:39:15.604924+0000 mgr.smithi067.rdualw (mgr.24569) 2449 : audit [DBG] from='client.35770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:39:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:39:15.940061+0000 mgr.smithi067.rdualw (mgr.24569) 2450 : audit [DBG] from='client.35774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:39:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:39:16.300448+0000 mon.smithi061 (mon.0) 678 : audit [DBG] from='client.? 172.21.15.61:0/2788445277' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:39:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:16.955597+0000 mgr.smithi067.rdualw (mgr.24569) 2451 : cluster [DBG] pgmap v2114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:39:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:16.955597+0000 mgr.smithi067.rdualw (mgr.24569) 2451 : cluster [DBG] pgmap v2114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:39:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:18.956166+0000 mgr.smithi067.rdualw (mgr.24569) 2452 : cluster [DBG] pgmap v2115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:18.956166+0000 mgr.smithi067.rdualw (mgr.24569) 2452 : cluster [DBG] pgmap v2115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:20.956992+0000 mgr.smithi067.rdualw (mgr.24569) 2453 : cluster [DBG] pgmap v2116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:20.956992+0000 mgr.smithi067.rdualw (mgr.24569) 2453 : cluster [DBG] pgmap v2116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:22.957631+0000 mgr.smithi067.rdualw (mgr.24569) 2454 : cluster [DBG] pgmap v2117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:22.957631+0000 mgr.smithi067.rdualw (mgr.24569) 2454 : cluster [DBG] pgmap v2117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:24.958250+0000 mgr.smithi067.rdualw (mgr.24569) 2455 : cluster [DBG] pgmap v2118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:24.958250+0000 mgr.smithi067.rdualw (mgr.24569) 2455 : cluster [DBG] pgmap v2118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:26.959208+0000 mgr.smithi067.rdualw (mgr.24569) 2456 : cluster [DBG] pgmap v2119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:39:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:26.959208+0000 mgr.smithi067.rdualw (mgr.24569) 2456 : cluster [DBG] pgmap v2119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:39:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:28.959936+0000 mgr.smithi067.rdualw (mgr.24569) 2457 : cluster [DBG] pgmap v2120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:28.959936+0000 mgr.smithi067.rdualw (mgr.24569) 2457 : cluster [DBG] pgmap v2120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:30.960821+0000 mgr.smithi067.rdualw (mgr.24569) 2458 : cluster [DBG] pgmap v2121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:30.960821+0000 mgr.smithi067.rdualw (mgr.24569) 2458 : cluster [DBG] pgmap v2121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:32.961516+0000 mgr.smithi067.rdualw (mgr.24569) 2459 : cluster [DBG] pgmap v2122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:32.961516+0000 mgr.smithi067.rdualw (mgr.24569) 2459 : cluster [DBG] pgmap v2122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:39:34.801060+0000 mon.smithi067 (mon.1) 405 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:39:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:39:34.801272+0000 mon.smithi061 (mon.0) 679 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:39:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:39:34.801347+0000 mon.smithi067 (mon.1) 406 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:39:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:39:34.801587+0000 mon.smithi061 (mon.0) 680 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:39:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:39:34.801060+0000 mon.smithi067 (mon.1) 405 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:39:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:39:34.801272+0000 mon.smithi061 (mon.0) 679 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:39:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:39:34.801347+0000 mon.smithi067 (mon.1) 406 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:39:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:39:34.801587+0000 mon.smithi061 (mon.0) 680 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:39:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:34.962090+0000 mgr.smithi067.rdualw (mgr.24569) 2460 : cluster [DBG] pgmap v2123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:34.962090+0000 mgr.smithi067.rdualw (mgr.24569) 2460 : cluster [DBG] pgmap v2123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:39:36.131925+0000 mon.smithi067 (mon.1) 407 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:39:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:39:36.133357+0000 mon.smithi067 (mon.1) 408 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:39:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:39:36.134327+0000 mon.smithi067 (mon.1) 409 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:39:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:39:36.135208+0000 mgr.smithi067.rdualw (mgr.24569) 2461 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:39:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:39:36.548897+0000 mon.smithi061 (mon.0) 681 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:39:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:39:36.556442+0000 mon.smithi061 (mon.0) 682 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:39:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:39:36.131925+0000 mon.smithi067 (mon.1) 407 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:39:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:39:36.133357+0000 mon.smithi067 (mon.1) 408 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:39:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:39:36.134327+0000 mon.smithi067 (mon.1) 409 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:39:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:39:36.135208+0000 mgr.smithi067.rdualw (mgr.24569) 2461 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:39:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:39:36.548897+0000 mon.smithi061 (mon.0) 681 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:39:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:39:36.556442+0000 mon.smithi061 (mon.0) 682 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:39:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:36.963042+0000 mgr.smithi067.rdualw (mgr.24569) 2462 : cluster [DBG] pgmap v2124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:39:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:36.963042+0000 mgr.smithi067.rdualw (mgr.24569) 2462 : cluster [DBG] pgmap v2124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:39:40.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:38.963667+0000 mgr.smithi067.rdualw (mgr.24569) 2463 : cluster [DBG] pgmap v2125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:38.963667+0000 mgr.smithi067.rdualw (mgr.24569) 2463 : cluster [DBG] pgmap v2125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:40.964441+0000 mgr.smithi067.rdualw (mgr.24569) 2464 : cluster [DBG] pgmap v2126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:40.964441+0000 mgr.smithi067.rdualw (mgr.24569) 2464 : cluster [DBG] pgmap v2126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:44.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:42.965084+0000 mgr.smithi067.rdualw (mgr.24569) 2465 : cluster [DBG] pgmap v2127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:44.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:42.965084+0000 mgr.smithi067.rdualw (mgr.24569) 2465 : cluster [DBG] pgmap v2127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:44.965819+0000 mgr.smithi067.rdualw (mgr.24569) 2466 : cluster [DBG] pgmap v2128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:44.965819+0000 mgr.smithi067.rdualw (mgr.24569) 2466 : cluster [DBG] pgmap v2128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:46.607 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:39:46.899 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:39:46.900 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (77m) 8m ago 78m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:39:46.900 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (70m) 8m ago 78m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:39:46.900 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (69m) 8m ago 77m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:39:46.900 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (77m) 8m ago 78m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:39:46.901 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (70m) 8m ago 74m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:39:46.901 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (70m) 8m ago 74m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:39:46.901 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (71m) 8m ago 79m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:39:46.901 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (71m) 8m ago 77m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:39:46.901 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (70m) 8m ago 79m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:39:46.902 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (70m) 8m ago 77m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:39:46.902 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (71m) 8m ago 71m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:39:46.902 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (71m) 8m ago 71m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:39:46.902 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (78m) 8m ago 78m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:39:46.903 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (77m) 8m ago 77m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:39:46.903 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (60m) 8m ago 77m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:39:46.903 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (76m) 8m ago 76m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:39:46.903 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (76m) 8m ago 76m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:39:46.904 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (76m) 8m ago 76m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:39:46.904 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (76m) 8m ago 76m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:39:46.904 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (75m) 8m ago 75m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:39:46.904 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (75m) 8m ago 75m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:39:46.904 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (75m) 8m ago 75m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:39:46.905 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (77m) 8m ago 78m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:39:47.244 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:39:47.245 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:39:47.245 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:39:47.245 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:39:47.245 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:39:47.246 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:39:47.246 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:39:47.246 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:39:47.246 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:39:47.246 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:39:47.247 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:39:47.247 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:39:47.247 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:39:47.247 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:39:47.248 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:39:47.248 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:39:47.248 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:39:47.248 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:39:47.249 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:39:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:39:46.593953+0000 mgr.smithi067.rdualw (mgr.24569) 2467 : audit [DBG] from='client.35782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:39:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:39:46.881814+0000 mgr.smithi067.rdualw (mgr.24569) 2468 : audit [DBG] from='client.35786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:39:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:46.966912+0000 mgr.smithi067.rdualw (mgr.24569) 2469 : cluster [DBG] pgmap v2129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:39:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:39:47.243291+0000 mon.smithi061 (mon.0) 683 : audit [DBG] from='client.? 172.21.15.61:0/2915115065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:39:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:39:46.593953+0000 mgr.smithi067.rdualw (mgr.24569) 2467 : audit [DBG] from='client.35782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:39:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:39:46.881814+0000 mgr.smithi067.rdualw (mgr.24569) 2468 : audit [DBG] from='client.35786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:39:48.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:46.966912+0000 mgr.smithi067.rdualw (mgr.24569) 2469 : cluster [DBG] pgmap v2129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:39:48.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:39:47.243291+0000 mon.smithi061 (mon.0) 683 : audit [DBG] from='client.? 172.21.15.61:0/2915115065' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:39:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:48.967576+0000 mgr.smithi067.rdualw (mgr.24569) 2470 : cluster [DBG] pgmap v2130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:48.967576+0000 mgr.smithi067.rdualw (mgr.24569) 2470 : cluster [DBG] pgmap v2130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:52.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:50.968436+0000 mgr.smithi067.rdualw (mgr.24569) 2471 : cluster [DBG] pgmap v2131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:50.968436+0000 mgr.smithi067.rdualw (mgr.24569) 2471 : cluster [DBG] pgmap v2131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:52.969068+0000 mgr.smithi067.rdualw (mgr.24569) 2472 : cluster [DBG] pgmap v2132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:52.969068+0000 mgr.smithi067.rdualw (mgr.24569) 2472 : cluster [DBG] pgmap v2132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:54.969728+0000 mgr.smithi067.rdualw (mgr.24569) 2473 : cluster [DBG] pgmap v2133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:54.969728+0000 mgr.smithi067.rdualw (mgr.24569) 2473 : cluster [DBG] pgmap v2133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:39:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:39:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:56.970585+0000 mgr.smithi067.rdualw (mgr.24569) 2474 : cluster [DBG] pgmap v2134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:39:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:39:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:56.970585+0000 mgr.smithi067.rdualw (mgr.24569) 2474 : cluster [DBG] pgmap v2134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:40:00.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:39:58.971321+0000 mgr.smithi067.rdualw (mgr.24569) 2475 : cluster [DBG] pgmap v2135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:00.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:00.000100+0000 mon.smithi061 (mon.0) 684 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T16:40:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:39:58.971321+0000 mgr.smithi067.rdualw (mgr.24569) 2475 : cluster [DBG] pgmap v2135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:00.000100+0000 mon.smithi061 (mon.0) 684 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T16:40:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:00.972246+0000 mgr.smithi067.rdualw (mgr.24569) 2476 : cluster [DBG] pgmap v2136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:00.972246+0000 mgr.smithi067.rdualw (mgr.24569) 2476 : cluster [DBG] pgmap v2136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:02.972909+0000 mgr.smithi067.rdualw (mgr.24569) 2477 : cluster [DBG] pgmap v2137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:02.972909+0000 mgr.smithi067.rdualw (mgr.24569) 2477 : cluster [DBG] pgmap v2137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:04.973527+0000 mgr.smithi067.rdualw (mgr.24569) 2478 : cluster [DBG] pgmap v2138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:04.973527+0000 mgr.smithi067.rdualw (mgr.24569) 2478 : cluster [DBG] pgmap v2138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:06.974349+0000 mgr.smithi067.rdualw (mgr.24569) 2479 : cluster [DBG] pgmap v2139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:40:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:06.974349+0000 mgr.smithi067.rdualw (mgr.24569) 2479 : cluster [DBG] pgmap v2139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:40:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:08.974970+0000 mgr.smithi067.rdualw (mgr.24569) 2480 : cluster [DBG] pgmap v2140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:08.974970+0000 mgr.smithi067.rdualw (mgr.24569) 2480 : cluster [DBG] pgmap v2140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:10.975821+0000 mgr.smithi067.rdualw (mgr.24569) 2481 : cluster [DBG] pgmap v2141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:10.975821+0000 mgr.smithi067.rdualw (mgr.24569) 2481 : cluster [DBG] pgmap v2141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:12.976419+0000 mgr.smithi067.rdualw (mgr.24569) 2482 : cluster [DBG] pgmap v2142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:12.976419+0000 mgr.smithi067.rdualw (mgr.24569) 2482 : cluster [DBG] pgmap v2142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:14.977071+0000 mgr.smithi067.rdualw (mgr.24569) 2483 : cluster [DBG] pgmap v2143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:14.977071+0000 mgr.smithi067.rdualw (mgr.24569) 2483 : cluster [DBG] pgmap v2143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:17.550 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:40:17.854 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:40:17.855 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (77m) 8m ago 78m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:40:17.855 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (70m) 8m ago 78m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:40:17.855 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (70m) 8m ago 78m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:40:17.856 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (77m) 8m ago 78m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:40:17.856 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (71m) 8m ago 74m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:40:17.856 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (70m) 8m ago 74m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:40:17.856 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (71m) 8m ago 80m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:40:17.857 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (71m) 8m ago 78m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:40:17.857 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (71m) 8m ago 80m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:40:17.857 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (71m) 8m ago 78m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:40:17.857 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (72m) 8m ago 72m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:40:17.858 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (72m) 8m ago 72m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:40:17.858 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (78m) 8m ago 78m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:40:17.858 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (78m) 8m ago 78m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:40:17.859 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (61m) 8m ago 77m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:40:17.859 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (77m) 8m ago 77m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:40:17.859 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (77m) 8m ago 77m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:40:17.859 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (76m) 8m ago 76m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:40:17.860 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (76m) 8m ago 76m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:40:17.860 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (76m) 8m ago 76m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:40:17.860 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (76m) 8m ago 76m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:40:17.860 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (75m) 8m ago 75m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:40:17.860 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (77m) 8m ago 78m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:40:18.198 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:40:18.198 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:40:18.198 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:40:18.199 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:40:18.199 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:40:18.199 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:40:18.199 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:40:18.200 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:40:18.200 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:40:18.200 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:40:18.200 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:40:18.200 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:40:18.201 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:40:18.201 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:40:18.201 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:40:18.201 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:40:18.202 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:40:18.202 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:40:18.202 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:40:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:16.977902+0000 mgr.smithi067.rdualw (mgr.24569) 2484 : cluster [DBG] pgmap v2144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:40:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:40:17.537347+0000 mgr.smithi067.rdualw (mgr.24569) 2485 : audit [DBG] from='client.35794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:40:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:16.977902+0000 mgr.smithi067.rdualw (mgr.24569) 2484 : cluster [DBG] pgmap v2144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:40:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:40:17.537347+0000 mgr.smithi067.rdualw (mgr.24569) 2485 : audit [DBG] from='client.35794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:40:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:40:17.837157+0000 mgr.smithi067.rdualw (mgr.24569) 2486 : audit [DBG] from='client.35798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:40:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:40:18.196525+0000 mon.smithi061 (mon.0) 685 : audit [DBG] from='client.? 172.21.15.61:0/1090858827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:40:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:40:17.837157+0000 mgr.smithi067.rdualw (mgr.24569) 2486 : audit [DBG] from='client.35798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:40:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:40:18.196525+0000 mon.smithi061 (mon.0) 685 : audit [DBG] from='client.? 172.21.15.61:0/1090858827' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:40:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:18.978602+0000 mgr.smithi067.rdualw (mgr.24569) 2487 : cluster [DBG] pgmap v2145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:18.978602+0000 mgr.smithi067.rdualw (mgr.24569) 2487 : cluster [DBG] pgmap v2145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:20.979451+0000 mgr.smithi067.rdualw (mgr.24569) 2488 : cluster [DBG] pgmap v2146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:20.979451+0000 mgr.smithi067.rdualw (mgr.24569) 2488 : cluster [DBG] pgmap v2146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:22.980118+0000 mgr.smithi067.rdualw (mgr.24569) 2489 : cluster [DBG] pgmap v2147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:22.980118+0000 mgr.smithi067.rdualw (mgr.24569) 2489 : cluster [DBG] pgmap v2147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:24.980762+0000 mgr.smithi067.rdualw (mgr.24569) 2490 : cluster [DBG] pgmap v2148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:24.980762+0000 mgr.smithi067.rdualw (mgr.24569) 2490 : cluster [DBG] pgmap v2148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:26.981660+0000 mgr.smithi067.rdualw (mgr.24569) 2491 : cluster [DBG] pgmap v2149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:40:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:26.981660+0000 mgr.smithi067.rdualw (mgr.24569) 2491 : cluster [DBG] pgmap v2149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:40:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:28.982304+0000 mgr.smithi067.rdualw (mgr.24569) 2492 : cluster [DBG] pgmap v2150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:28.982304+0000 mgr.smithi067.rdualw (mgr.24569) 2492 : cluster [DBG] pgmap v2150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:30.983136+0000 mgr.smithi067.rdualw (mgr.24569) 2493 : cluster [DBG] pgmap v2151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:30.983136+0000 mgr.smithi067.rdualw (mgr.24569) 2493 : cluster [DBG] pgmap v2151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:32.983687+0000 mgr.smithi067.rdualw (mgr.24569) 2494 : cluster [DBG] pgmap v2152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:32.983687+0000 mgr.smithi067.rdualw (mgr.24569) 2494 : cluster [DBG] pgmap v2152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:40:34.806687+0000 mon.smithi067 (mon.1) 410 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:40:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:40:34.806963+0000 mon.smithi067 (mon.1) 411 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:40:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:40:34.807081+0000 mon.smithi061 (mon.0) 686 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:40:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:40:34.807385+0000 mon.smithi061 (mon.0) 687 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:40:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:40:34.806687+0000 mon.smithi067 (mon.1) 410 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:40:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:40:34.806963+0000 mon.smithi067 (mon.1) 411 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:40:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:40:34.807081+0000 mon.smithi061 (mon.0) 686 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:40:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:40:34.807385+0000 mon.smithi061 (mon.0) 687 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:40:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:34.984347+0000 mgr.smithi067.rdualw (mgr.24569) 2495 : cluster [DBG] pgmap v2153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:34.984347+0000 mgr.smithi067.rdualw (mgr.24569) 2495 : cluster [DBG] pgmap v2153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:40:36.560148+0000 mon.smithi067 (mon.1) 412 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:40:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:40:36.561567+0000 mon.smithi067 (mon.1) 413 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:40:37.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:40:36.562499+0000 mon.smithi067 (mon.1) 414 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:40:37.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:40:36.563349+0000 mgr.smithi067.rdualw (mgr.24569) 2496 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:40:37.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:40:36.978358+0000 mon.smithi061 (mon.0) 688 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:40:37.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:40:36.984103+0000 mon.smithi061 (mon.0) 689 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:40:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:40:36.560148+0000 mon.smithi067 (mon.1) 412 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:40:37.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:40:36.561567+0000 mon.smithi067 (mon.1) 413 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:40:37.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:40:36.562499+0000 mon.smithi067 (mon.1) 414 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:40:37.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:40:36.563349+0000 mgr.smithi067.rdualw (mgr.24569) 2496 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:40:37.320 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:40:36.978358+0000 mon.smithi061 (mon.0) 688 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:40:37.320 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:40:36.984103+0000 mon.smithi061 (mon.0) 689 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:40:38.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:36.985050+0000 mgr.smithi067.rdualw (mgr.24569) 2497 : cluster [DBG] pgmap v2154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:40:38.399 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:36.985050+0000 mgr.smithi067.rdualw (mgr.24569) 2497 : cluster [DBG] pgmap v2154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:40:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:38.985687+0000 mgr.smithi067.rdualw (mgr.24569) 2498 : cluster [DBG] pgmap v2155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:40.399 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:38.985687+0000 mgr.smithi067.rdualw (mgr.24569) 2498 : cluster [DBG] pgmap v2155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:40.986476+0000 mgr.smithi067.rdualw (mgr.24569) 2499 : cluster [DBG] pgmap v2156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:42.399 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:40.986476+0000 mgr.smithi067.rdualw (mgr.24569) 2499 : cluster [DBG] pgmap v2156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:42.987022+0000 mgr.smithi067.rdualw (mgr.24569) 2500 : cluster [DBG] pgmap v2157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:44.400 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:42.987022+0000 mgr.smithi067.rdualw (mgr.24569) 2500 : cluster [DBG] pgmap v2157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:44.987782+0000 mgr.smithi067.rdualw (mgr.24569) 2501 : cluster [DBG] pgmap v2158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:44.987782+0000 mgr.smithi067.rdualw (mgr.24569) 2501 : cluster [DBG] pgmap v2158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:46.988725+0000 mgr.smithi067.rdualw (mgr.24569) 2502 : cluster [DBG] pgmap v2159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:40:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:46.988725+0000 mgr.smithi067.rdualw (mgr.24569) 2502 : cluster [DBG] pgmap v2159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:40:48.503 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:40:48.805 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:40:48.805 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (78m) 9m ago 79m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:40:48.806 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (71m) 9m ago 79m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:40:48.806 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (70m) 9m ago 78m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:40:48.806 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (78m) 9m ago 79m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:40:48.807 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (71m) 9m ago 75m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:40:48.807 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (71m) 9m ago 75m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:40:48.807 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (72m) 9m ago 80m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:40:48.807 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (72m) 9m ago 78m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:40:48.807 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (71m) 9m ago 80m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:40:48.808 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (71m) 9m ago 78m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:40:48.808 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (72m) 9m ago 72m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:40:48.808 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (72m) 9m ago 72m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:40:48.808 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (79m) 9m ago 79m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:40:48.809 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (78m) 9m ago 78m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:40:48.809 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (61m) 9m ago 78m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:40:48.809 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (77m) 9m ago 77m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:40:48.809 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (77m) 9m ago 77m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:40:48.809 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (77m) 9m ago 77m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:40:48.810 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (77m) 9m ago 77m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:40:48.810 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (76m) 9m ago 76m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:40:48.810 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (76m) 9m ago 76m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:40:48.810 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (76m) 9m ago 76m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:40:48.811 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (78m) 9m ago 79m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:40:49.197 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:40:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:40:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:40:49.198 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:40:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:40:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:40:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:40:49.199 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:40:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:40:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:40:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:40:49.200 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:40:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:40:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:40:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:40:49.201 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:40:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:40:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:40:49.202 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:40:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:40:48.490240+0000 mgr.smithi067.rdualw (mgr.24569) 2503 : audit [DBG] from='client.35806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:40:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:40:48.490240+0000 mgr.smithi067.rdualw (mgr.24569) 2503 : audit [DBG] from='client.35806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:40:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:40:48.787967+0000 mgr.smithi067.rdualw (mgr.24569) 2504 : audit [DBG] from='client.35810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:40:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:48.989247+0000 mgr.smithi067.rdualw (mgr.24569) 2505 : cluster [DBG] pgmap v2160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:40:49.196275+0000 mon.smithi061 (mon.0) 690 : audit [DBG] from='client.? 172.21.15.61:0/3292061708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:40:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:40:48.787967+0000 mgr.smithi067.rdualw (mgr.24569) 2504 : audit [DBG] from='client.35810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:40:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:48.989247+0000 mgr.smithi067.rdualw (mgr.24569) 2505 : cluster [DBG] pgmap v2160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:40:49.196275+0000 mon.smithi061 (mon.0) 690 : audit [DBG] from='client.? 172.21.15.61:0/3292061708' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:40:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:50.990187+0000 mgr.smithi067.rdualw (mgr.24569) 2506 : cluster [DBG] pgmap v2161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:52.401 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:50.990187+0000 mgr.smithi067.rdualw (mgr.24569) 2506 : cluster [DBG] pgmap v2161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:52.990815+0000 mgr.smithi067.rdualw (mgr.24569) 2507 : cluster [DBG] pgmap v2162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:54.401 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:52.990815+0000 mgr.smithi067.rdualw (mgr.24569) 2507 : cluster [DBG] pgmap v2162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:54.991381+0000 mgr.smithi067.rdualw (mgr.24569) 2508 : cluster [DBG] pgmap v2163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:54.991381+0000 mgr.smithi067.rdualw (mgr.24569) 2508 : cluster [DBG] pgmap v2163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:40:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:40:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:56.992284+0000 mgr.smithi067.rdualw (mgr.24569) 2509 : cluster [DBG] pgmap v2164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:40:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:40:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:56.992284+0000 mgr.smithi067.rdualw (mgr.24569) 2509 : cluster [DBG] pgmap v2164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:41:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:40:58.992878+0000 mgr.smithi067.rdualw (mgr.24569) 2510 : cluster [DBG] pgmap v2165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:00.402 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:40:58.992878+0000 mgr.smithi067.rdualw (mgr.24569) 2510 : cluster [DBG] pgmap v2165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:00.993664+0000 mgr.smithi067.rdualw (mgr.24569) 2511 : cluster [DBG] pgmap v2166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:02.403 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:00.993664+0000 mgr.smithi067.rdualw (mgr.24569) 2511 : cluster [DBG] pgmap v2166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:02.994242+0000 mgr.smithi067.rdualw (mgr.24569) 2512 : cluster [DBG] pgmap v2167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:04.403 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:02.994242+0000 mgr.smithi067.rdualw (mgr.24569) 2512 : cluster [DBG] pgmap v2167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:04.994932+0000 mgr.smithi067.rdualw (mgr.24569) 2513 : cluster [DBG] pgmap v2168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:04.994932+0000 mgr.smithi067.rdualw (mgr.24569) 2513 : cluster [DBG] pgmap v2168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:06.995944+0000 mgr.smithi067.rdualw (mgr.24569) 2514 : cluster [DBG] pgmap v2169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:41:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:06.995944+0000 mgr.smithi067.rdualw (mgr.24569) 2514 : cluster [DBG] pgmap v2169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:41:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:08.996758+0000 mgr.smithi067.rdualw (mgr.24569) 2515 : cluster [DBG] pgmap v2170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:10.404 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:08.996758+0000 mgr.smithi067.rdualw (mgr.24569) 2515 : cluster [DBG] pgmap v2170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:10.997724+0000 mgr.smithi067.rdualw (mgr.24569) 2516 : cluster [DBG] pgmap v2171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:12.404 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:10.997724+0000 mgr.smithi067.rdualw (mgr.24569) 2516 : cluster [DBG] pgmap v2171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:14.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:12.998221+0000 mgr.smithi067.rdualw (mgr.24569) 2517 : cluster [DBG] pgmap v2172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:14.405 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:12.998221+0000 mgr.smithi067.rdualw (mgr.24569) 2517 : cluster [DBG] pgmap v2172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:14.998895+0000 mgr.smithi067.rdualw (mgr.24569) 2518 : cluster [DBG] pgmap v2173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:14.998895+0000 mgr.smithi067.rdualw (mgr.24569) 2518 : cluster [DBG] pgmap v2173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:16.999700+0000 mgr.smithi067.rdualw (mgr.24569) 2519 : cluster [DBG] pgmap v2174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:41:18.405 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:16.999700+0000 mgr.smithi067.rdualw (mgr.24569) 2519 : cluster [DBG] pgmap v2174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:41:19.503 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:41:19.796 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:41:19.797 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (78m) 9m ago 79m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:41:19.797 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (71m) 9m ago 79m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:41:19.797 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (71m) 9m ago 79m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:41:19.797 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (78m) 9m ago 79m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:41:19.798 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (72m) 9m ago 75m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:41:19.798 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (71m) 9m ago 75m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:41:19.798 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (73m) 9m ago 81m 447M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:41:19.798 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (72m) 9m ago 79m 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:41:19.799 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (72m) 9m ago 81m 482M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:41:19.799 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (72m) 9m ago 79m 286M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:41:19.799 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (73m) 9m ago 73m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:41:19.799 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (73m) 9m ago 73m 99.9M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:41:19.799 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (79m) 9m ago 79m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:41:19.800 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (79m) 9m ago 79m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:41:19.800 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (62m) 9m ago 78m 565M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:41:19.800 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (78m) 9m ago 78m 1363M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:41:19.800 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (78m) 9m ago 78m 823M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:41:19.801 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (77m) 9m ago 77m 1482M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:41:19.801 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (77m) 9m ago 77m 1370M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:41:19.801 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (77m) 9m ago 77m 1617M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:41:19.801 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (77m) 9m ago 77m 1262M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:41:19.801 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (76m) 9m ago 76m 2092M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:41:19.802 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (78m) 9m ago 79m 62.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:41:20.135 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:41:20.136 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:41:20.136 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:41:20.136 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:41:20.137 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:41:20.137 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:41:20.137 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:41:20.137 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:41:20.137 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:41:20.138 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:41:20.138 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:41:20.138 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:41:20.139 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:41:20.139 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:41:20.139 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:41:20.139 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:41:20.140 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:41:20.140 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:41:20.140 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:41:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:19.000366+0000 mgr.smithi067.rdualw (mgr.24569) 2520 : cluster [DBG] pgmap v2175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:20.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:19.490138+0000 mgr.smithi067.rdualw (mgr.24569) 2521 : audit [DBG] from='client.35818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:41:20.406 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:19.000366+0000 mgr.smithi067.rdualw (mgr.24569) 2520 : cluster [DBG] pgmap v2175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:20.406 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:19.490138+0000 mgr.smithi067.rdualw (mgr.24569) 2521 : audit [DBG] from='client.35818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:41:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:19.778612+0000 mgr.smithi067.rdualw (mgr.24569) 2522 : audit [DBG] from='client.35822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:41:21.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:20.134482+0000 mon.smithi061 (mon.0) 691 : audit [DBG] from='client.? 172.21.15.61:0/3862649368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:41:21.406 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:19.778612+0000 mgr.smithi067.rdualw (mgr.24569) 2522 : audit [DBG] from='client.35822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:41:21.406 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:20.134482+0000 mon.smithi061 (mon.0) 691 : audit [DBG] from='client.? 172.21.15.61:0/3862649368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:41:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:21.001158+0000 mgr.smithi067.rdualw (mgr.24569) 2523 : cluster [DBG] pgmap v2176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:22.406 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:21.001158+0000 mgr.smithi067.rdualw (mgr.24569) 2523 : cluster [DBG] pgmap v2176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:24.406 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:23.001847+0000 mgr.smithi067.rdualw (mgr.24569) 2524 : cluster [DBG] pgmap v2177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:23.001847+0000 mgr.smithi067.rdualw (mgr.24569) 2524 : cluster [DBG] pgmap v2177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:25.002438+0000 mgr.smithi067.rdualw (mgr.24569) 2525 : cluster [DBG] pgmap v2178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:25.002438+0000 mgr.smithi067.rdualw (mgr.24569) 2525 : cluster [DBG] pgmap v2178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:27.003448+0000 mgr.smithi067.rdualw (mgr.24569) 2526 : cluster [DBG] pgmap v2179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:41:28.407 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:27.003448+0000 mgr.smithi067.rdualw (mgr.24569) 2526 : cluster [DBG] pgmap v2179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:41:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:29.004166+0000 mgr.smithi067.rdualw (mgr.24569) 2527 : cluster [DBG] pgmap v2180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:30.408 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:29.004166+0000 mgr.smithi067.rdualw (mgr.24569) 2527 : cluster [DBG] pgmap v2180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:32.407 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:31.005211+0000 mgr.smithi067.rdualw (mgr.24569) 2528 : cluster [DBG] pgmap v2181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:31.005211+0000 mgr.smithi067.rdualw (mgr.24569) 2528 : cluster [DBG] pgmap v2181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:34.408 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:33.005973+0000 mgr.smithi067.rdualw (mgr.24569) 2529 : cluster [DBG] pgmap v2182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:33.005973+0000 mgr.smithi067.rdualw (mgr.24569) 2529 : cluster [DBG] pgmap v2182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:34.812222+0000 mon.smithi067 (mon.1) 415 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:41:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:34.812408+0000 mon.smithi061 (mon.0) 692 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:41:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:34.812500+0000 mon.smithi067 (mon.1) 416 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:41:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:34.812791+0000 mon.smithi061 (mon.0) 693 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:41:35.408 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:34.812222+0000 mon.smithi067 (mon.1) 415 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:41:35.409 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:34.812408+0000 mon.smithi061 (mon.0) 692 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:41:35.409 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:34.812500+0000 mon.smithi067 (mon.1) 416 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:41:35.409 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:34.812791+0000 mon.smithi061 (mon.0) 693 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:41:36.408 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:35.006682+0000 mgr.smithi067.rdualw (mgr.24569) 2530 : cluster [DBG] pgmap v2183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:35.006682+0000 mgr.smithi067.rdualw (mgr.24569) 2530 : cluster [DBG] pgmap v2183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:37.408 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:36.988073+0000 mon.smithi067 (mon.1) 417 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:41:37.409 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:36.989447+0000 mon.smithi067 (mon.1) 418 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:41:37.409 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:36.990339+0000 mon.smithi067 (mon.1) 419 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:41:37.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:36.988073+0000 mon.smithi067 (mon.1) 417 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:41:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:36.989447+0000 mon.smithi067 (mon.1) 418 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:41:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:36.990339+0000 mon.smithi067 (mon.1) 419 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:41:38.409 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:41:36.991163+0000 mgr.smithi067.rdualw (mgr.24569) 2531 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:41:38.409 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:37.007739+0000 mgr.smithi067.rdualw (mgr.24569) 2532 : cluster [DBG] pgmap v2184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:41:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:41:36.991163+0000 mgr.smithi067.rdualw (mgr.24569) 2531 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:41:38.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:37.007739+0000 mgr.smithi067.rdualw (mgr.24569) 2532 : cluster [DBG] pgmap v2184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:41:40.409 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:39.008301+0000 mgr.smithi067.rdualw (mgr.24569) 2533 : cluster [DBG] pgmap v2185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:39.008301+0000 mgr.smithi067.rdualw (mgr.24569) 2533 : cluster [DBG] pgmap v2185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:42.410 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:41.009311+0000 mgr.smithi067.rdualw (mgr.24569) 2534 : cluster [DBG] pgmap v2186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:42.410 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:41.682042+0000 mon.smithi061 (mon.0) 694 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:41:42.410 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:42.071410+0000 mon.smithi067 (mon.1) 420 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:41:42.411 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:42.071566+0000 mon.smithi061 (mon.0) 695 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:41:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:41.009311+0000 mgr.smithi067.rdualw (mgr.24569) 2534 : cluster [DBG] pgmap v2186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:41.682042+0000 mon.smithi061 (mon.0) 694 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:41:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:42.071410+0000 mon.smithi067 (mon.1) 420 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:41:42.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:42.071566+0000 mon.smithi061 (mon.0) 695 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:41:44.410 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:43.009906+0000 mgr.smithi067.rdualw (mgr.24569) 2535 : cluster [DBG] pgmap v2187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:43.009906+0000 mgr.smithi067.rdualw (mgr.24569) 2535 : cluster [DBG] pgmap v2187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:45.410 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:44.131648+0000 mon.smithi061 (mon.0) 696 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:41:45.411 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:44.537237+0000 mon.smithi067 (mon.1) 421 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:41:45.411 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:44.537463+0000 mon.smithi061 (mon.0) 697 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:41:45.411 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:44.542180+0000 mon.smithi061 (mon.0) 698 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:41:45.411 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:44.549049+0000 mon.smithi061 (mon.0) 699 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:41:45.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:44.131648+0000 mon.smithi061 (mon.0) 696 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:41:45.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:44.537237+0000 mon.smithi067 (mon.1) 421 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:41:45.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:44.537463+0000 mon.smithi061 (mon.0) 697 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:41:45.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:44.542180+0000 mon.smithi061 (mon.0) 698 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:41:45.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:44.549049+0000 mon.smithi061 (mon.0) 699 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:41:46.410 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:45.010465+0000 mgr.smithi067.rdualw (mgr.24569) 2536 : cluster [DBG] pgmap v2188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:45.010465+0000 mgr.smithi067.rdualw (mgr.24569) 2536 : cluster [DBG] pgmap v2188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:48.410 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:47.011319+0000 mgr.smithi067.rdualw (mgr.24569) 2537 : cluster [DBG] pgmap v2189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:41:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:47.011319+0000 mgr.smithi067.rdualw (mgr.24569) 2537 : cluster [DBG] pgmap v2189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:41:50.410 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:49.012085+0000 mgr.smithi067.rdualw (mgr.24569) 2538 : cluster [DBG] pgmap v2190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:50.511 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:41:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:49.012085+0000 mgr.smithi067.rdualw (mgr.24569) 2538 : cluster [DBG] pgmap v2190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:50.810 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:41:50.810 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (79m) 6s ago 80m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:41:50.810 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (72m) 6s ago 80m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:41:50.811 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (71m) 9s ago 79m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:41:50.811 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (79m) 6s ago 80m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:41:50.811 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (72m) 6s ago 76m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:41:50.811 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (72m) 9s ago 76m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:41:50.812 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (73m) 6s ago 81m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:41:50.812 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (73m) 9s ago 79m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:41:50.812 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (73m) 6s ago 81m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:41:50.812 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (72m) 9s ago 79m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:41:50.813 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (73m) 6s ago 73m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:41:50.813 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (73m) 9s ago 73m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:41:50.813 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (80m) 6s ago 80m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:41:50.813 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (79m) 9s ago 79m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:41:50.814 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (62m) 6s ago 79m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:41:50.814 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (79m) 6s ago 79m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:41:50.814 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (78m) 6s ago 78m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:41:50.814 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (78m) 6s ago 78m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:41:50.815 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (78m) 9s ago 78m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:41:50.815 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (77m) 9s ago 77m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:41:50.815 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (77m) 9s ago 77m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:41:50.815 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (77m) 9s ago 77m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:41:50.816 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (79m) 6s ago 80m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:41:51.147 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:41:51.148 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:41:51.148 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:41:51.148 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:41:51.149 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:41:51.149 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:41:51.149 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:41:51.149 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:41:51.150 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:41:51.150 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:41:51.150 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:41:51.150 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:41:51.151 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:41:51.151 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:41:51.151 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:41:51.151 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:41:51.151 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:41:51.152 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:41:51.152 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:41:51.411 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:50.498005+0000 mgr.smithi067.rdualw (mgr.24569) 2539 : audit [DBG] from='client.35830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:41:51.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:50.498005+0000 mgr.smithi067.rdualw (mgr.24569) 2539 : audit [DBG] from='client.35830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:41:52.411 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:50.792526+0000 mgr.smithi067.rdualw (mgr.24569) 2540 : audit [DBG] from='client.35834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:41:52.411 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:51.012909+0000 mgr.smithi067.rdualw (mgr.24569) 2541 : cluster [DBG] pgmap v2191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:52.411 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:41:51.146436+0000 mon.smithi061 (mon.0) 700 : audit [DBG] from='client.? 172.21.15.61:0/2614959928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:41:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:50.792526+0000 mgr.smithi067.rdualw (mgr.24569) 2540 : audit [DBG] from='client.35834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:41:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:51.012909+0000 mgr.smithi067.rdualw (mgr.24569) 2541 : cluster [DBG] pgmap v2191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:41:51.146436+0000 mon.smithi061 (mon.0) 700 : audit [DBG] from='client.? 172.21.15.61:0/2614959928' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:41:54.412 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:53.013592+0000 mgr.smithi067.rdualw (mgr.24569) 2542 : cluster [DBG] pgmap v2192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:53.013592+0000 mgr.smithi067.rdualw (mgr.24569) 2542 : cluster [DBG] pgmap v2192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:55.014221+0000 mgr.smithi067.rdualw (mgr.24569) 2543 : cluster [DBG] pgmap v2193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:55.014221+0000 mgr.smithi067.rdualw (mgr.24569) 2543 : cluster [DBG] pgmap v2193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:41:58.412 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:41:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:57.015325+0000 mgr.smithi067.rdualw (mgr.24569) 2544 : cluster [DBG] pgmap v2194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:41:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:41:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:57.015325+0000 mgr.smithi067.rdualw (mgr.24569) 2544 : cluster [DBG] pgmap v2194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:42:00.412 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:41:59.016135+0000 mgr.smithi067.rdualw (mgr.24569) 2545 : cluster [DBG] pgmap v2195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:41:59.016135+0000 mgr.smithi067.rdualw (mgr.24569) 2545 : cluster [DBG] pgmap v2195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:02.412 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:01.017158+0000 mgr.smithi067.rdualw (mgr.24569) 2546 : cluster [DBG] pgmap v2196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:01.017158+0000 mgr.smithi067.rdualw (mgr.24569) 2546 : cluster [DBG] pgmap v2196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:04.413 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:03.017875+0000 mgr.smithi067.rdualw (mgr.24569) 2547 : cluster [DBG] pgmap v2197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:03.017875+0000 mgr.smithi067.rdualw (mgr.24569) 2547 : cluster [DBG] pgmap v2197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:05.018481+0000 mgr.smithi067.rdualw (mgr.24569) 2548 : cluster [DBG] pgmap v2198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:05.018481+0000 mgr.smithi067.rdualw (mgr.24569) 2548 : cluster [DBG] pgmap v2198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:08.413 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:07.019266+0000 mgr.smithi067.rdualw (mgr.24569) 2549 : cluster [DBG] pgmap v2199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:42:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:07.019266+0000 mgr.smithi067.rdualw (mgr.24569) 2549 : cluster [DBG] pgmap v2199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:42:10.414 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:09.020025+0000 mgr.smithi067.rdualw (mgr.24569) 2550 : cluster [DBG] pgmap v2200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:09.020025+0000 mgr.smithi067.rdualw (mgr.24569) 2550 : cluster [DBG] pgmap v2200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:12.414 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:11.020796+0000 mgr.smithi067.rdualw (mgr.24569) 2551 : cluster [DBG] pgmap v2201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:11.020796+0000 mgr.smithi067.rdualw (mgr.24569) 2551 : cluster [DBG] pgmap v2201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:14.414 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:13.021339+0000 mgr.smithi067.rdualw (mgr.24569) 2552 : cluster [DBG] pgmap v2202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:13.021339+0000 mgr.smithi067.rdualw (mgr.24569) 2552 : cluster [DBG] pgmap v2202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:15.022118+0000 mgr.smithi067.rdualw (mgr.24569) 2553 : cluster [DBG] pgmap v2203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:15.022118+0000 mgr.smithi067.rdualw (mgr.24569) 2553 : cluster [DBG] pgmap v2203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:18.415 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:17.023007+0000 mgr.smithi067.rdualw (mgr.24569) 2554 : cluster [DBG] pgmap v2204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:42:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:17.023007+0000 mgr.smithi067.rdualw (mgr.24569) 2554 : cluster [DBG] pgmap v2204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:42:20.415 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:19.023744+0000 mgr.smithi067.rdualw (mgr.24569) 2555 : cluster [DBG] pgmap v2205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:19.023744+0000 mgr.smithi067.rdualw (mgr.24569) 2555 : cluster [DBG] pgmap v2205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:21.455 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:42:21.745 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:42:21.745 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (79m) 37s ago 80m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:42:21.745 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (72m) 37s ago 80m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:42:21.746 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (72m) 40s ago 80m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:42:21.746 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (79m) 37s ago 80m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:42:21.746 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (73m) 37s ago 76m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:42:21.747 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (72m) 40s ago 76m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:42:21.747 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (74m) 37s ago 82m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:42:21.747 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (73m) 40s ago 80m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:42:21.747 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (73m) 37s ago 82m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:42:21.748 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (73m) 40s ago 80m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:42:21.748 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (74m) 37s ago 74m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:42:21.748 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (74m) 40s ago 74m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:42:21.748 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (80m) 37s ago 80m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:42:21.748 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (80m) 40s ago 80m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:42:21.749 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (63m) 37s ago 79m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:42:21.749 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (79m) 37s ago 79m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:42:21.749 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (79m) 37s ago 79m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:42:21.749 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (78m) 37s ago 78m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:42:21.750 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (78m) 40s ago 78m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:42:21.750 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (78m) 40s ago 78m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:42:21.750 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (78m) 40s ago 78m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:42:21.750 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (77m) 40s ago 77m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:42:21.750 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (79m) 37s ago 80m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:42:22.089 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:42:22.089 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:42:22.090 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:42:22.090 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:42:22.090 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:42:22.090 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:42:22.091 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:42:22.091 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:42:22.091 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:42:22.091 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:42:22.092 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:42:22.092 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:42:22.092 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:42:22.092 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:42:22.092 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:42:22.093 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:42:22.093 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:42:22.093 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:42:22.093 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:42:22.416 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:21.024558+0000 mgr.smithi067.rdualw (mgr.24569) 2556 : cluster [DBG] pgmap v2206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:22.416 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:42:21.442070+0000 mgr.smithi067.rdualw (mgr.24569) 2557 : audit [DBG] from='client.35842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:42:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:21.024558+0000 mgr.smithi067.rdualw (mgr.24569) 2556 : cluster [DBG] pgmap v2206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:42:21.442070+0000 mgr.smithi067.rdualw (mgr.24569) 2557 : audit [DBG] from='client.35842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:42:23.416 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:42:21.727665+0000 mgr.smithi067.rdualw (mgr.24569) 2558 : audit [DBG] from='client.35846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:42:23.416 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:42:22.088104+0000 mon.smithi061 (mon.0) 701 : audit [DBG] from='client.? 172.21.15.61:0/2694524278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:42:23.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:42:21.727665+0000 mgr.smithi067.rdualw (mgr.24569) 2558 : audit [DBG] from='client.35846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:42:23.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:42:22.088104+0000 mon.smithi061 (mon.0) 701 : audit [DBG] from='client.? 172.21.15.61:0/2694524278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:42:24.416 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:23.025139+0000 mgr.smithi067.rdualw (mgr.24569) 2559 : cluster [DBG] pgmap v2207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:23.025139+0000 mgr.smithi067.rdualw (mgr.24569) 2559 : cluster [DBG] pgmap v2207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:25.025893+0000 mgr.smithi067.rdualw (mgr.24569) 2560 : cluster [DBG] pgmap v2208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:25.025893+0000 mgr.smithi067.rdualw (mgr.24569) 2560 : cluster [DBG] pgmap v2208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:28.417 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:27.026792+0000 mgr.smithi067.rdualw (mgr.24569) 2561 : cluster [DBG] pgmap v2209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:42:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:27.026792+0000 mgr.smithi067.rdualw (mgr.24569) 2561 : cluster [DBG] pgmap v2209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:42:30.417 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:29.027616+0000 mgr.smithi067.rdualw (mgr.24569) 2562 : cluster [DBG] pgmap v2210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:29.027616+0000 mgr.smithi067.rdualw (mgr.24569) 2562 : cluster [DBG] pgmap v2210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:32.417 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:31.028430+0000 mgr.smithi067.rdualw (mgr.24569) 2563 : cluster [DBG] pgmap v2211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:31.028430+0000 mgr.smithi067.rdualw (mgr.24569) 2563 : cluster [DBG] pgmap v2211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:34.418 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:33.029055+0000 mgr.smithi067.rdualw (mgr.24569) 2564 : cluster [DBG] pgmap v2212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:33.029055+0000 mgr.smithi067.rdualw (mgr.24569) 2564 : cluster [DBG] pgmap v2212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:35.418 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:42:34.817597+0000 mon.smithi067 (mon.1) 422 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:42:35.418 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:42:34.817724+0000 mon.smithi061 (mon.0) 702 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:42:35.419 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:42:34.817868+0000 mon.smithi067 (mon.1) 423 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:42:35.419 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:42:34.818016+0000 mon.smithi061 (mon.0) 703 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:42:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:42:34.817597+0000 mon.smithi067 (mon.1) 422 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:42:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:42:34.817724+0000 mon.smithi061 (mon.0) 702 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:42:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:42:34.817868+0000 mon.smithi067 (mon.1) 423 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:42:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:42:34.818016+0000 mon.smithi061 (mon.0) 703 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:42:36.418 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:35.029645+0000 mgr.smithi067.rdualw (mgr.24569) 2565 : cluster [DBG] pgmap v2213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:35.029645+0000 mgr.smithi067.rdualw (mgr.24569) 2565 : cluster [DBG] pgmap v2213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:38.418 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:37.030680+0000 mgr.smithi067.rdualw (mgr.24569) 2566 : cluster [DBG] pgmap v2214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:42:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:37.030680+0000 mgr.smithi067.rdualw (mgr.24569) 2566 : cluster [DBG] pgmap v2214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:42:40.419 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:39.031328+0000 mgr.smithi067.rdualw (mgr.24569) 2567 : cluster [DBG] pgmap v2215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:39.031328+0000 mgr.smithi067.rdualw (mgr.24569) 2567 : cluster [DBG] pgmap v2215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:42.419 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:41.032184+0000 mgr.smithi067.rdualw (mgr.24569) 2568 : cluster [DBG] pgmap v2216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:41.032184+0000 mgr.smithi067.rdualw (mgr.24569) 2568 : cluster [DBG] pgmap v2216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:44.419 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:43.032924+0000 mgr.smithi067.rdualw (mgr.24569) 2569 : cluster [DBG] pgmap v2217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:43.032924+0000 mgr.smithi067.rdualw (mgr.24569) 2569 : cluster [DBG] pgmap v2217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:45.420 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:42:44.553379+0000 mon.smithi067 (mon.1) 424 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:42:45.420 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:42:44.555014+0000 mon.smithi067 (mon.1) 425 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:42:45.420 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:42:44.556078+0000 mon.smithi067 (mon.1) 426 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:42:45.421 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:42:44.557007+0000 mgr.smithi067.rdualw (mgr.24569) 2570 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:42:45.421 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:42:44.975171+0000 mon.smithi061 (mon.0) 704 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:42:45.421 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:42:44.981467+0000 mon.smithi061 (mon.0) 705 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:42:45.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:42:44.553379+0000 mon.smithi067 (mon.1) 424 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:42:45.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:42:44.555014+0000 mon.smithi067 (mon.1) 425 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:42:45.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:42:44.556078+0000 mon.smithi067 (mon.1) 426 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:42:45.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:42:44.557007+0000 mgr.smithi067.rdualw (mgr.24569) 2570 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:42:45.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:42:44.975171+0000 mon.smithi061 (mon.0) 704 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:42:45.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:42:44.981467+0000 mon.smithi061 (mon.0) 705 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:42:46.420 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:45.033560+0000 mgr.smithi067.rdualw (mgr.24569) 2571 : cluster [DBG] pgmap v2218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:45.033560+0000 mgr.smithi067.rdualw (mgr.24569) 2571 : cluster [DBG] pgmap v2218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:48.420 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:47.034376+0000 mgr.smithi067.rdualw (mgr.24569) 2572 : cluster [DBG] pgmap v2219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:42:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:47.034376+0000 mgr.smithi067.rdualw (mgr.24569) 2572 : cluster [DBG] pgmap v2219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:42:50.420 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:49.034938+0000 mgr.smithi067.rdualw (mgr.24569) 2573 : cluster [DBG] pgmap v2220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:49.034938+0000 mgr.smithi067.rdualw (mgr.24569) 2573 : cluster [DBG] pgmap v2220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:52.398 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:42:52.421 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:51.035710+0000 mgr.smithi067.rdualw (mgr.24569) 2574 : cluster [DBG] pgmap v2221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:51.035710+0000 mgr.smithi067.rdualw (mgr.24569) 2574 : cluster [DBG] pgmap v2221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:52.698 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:42:52.698 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (80m) 68s ago 81m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:42:52.699 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (73m) 68s ago 81m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:42:52.699 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (72m) 71s ago 81m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:42:52.699 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (80m) 68s ago 81m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:42:52.699 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (73m) 68s ago 77m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:42:52.700 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (73m) 71s ago 77m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:42:52.700 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (74m) 68s ago 82m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:42:52.700 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (74m) 71s ago 80m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:42:52.700 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (74m) 68s ago 82m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:42:52.701 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (73m) 71s ago 80m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:42:52.701 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (74m) 68s ago 74m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:42:52.701 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (74m) 71s ago 74m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:42:52.701 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (81m) 68s ago 81m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:42:52.702 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (80m) 71s ago 80m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:42:52.702 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (63m) 68s ago 80m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:42:52.702 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (80m) 68s ago 80m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:42:52.702 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (79m) 68s ago 79m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:42:52.702 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (79m) 68s ago 79m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:42:52.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (79m) 71s ago 79m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:42:52.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (79m) 71s ago 79m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:42:52.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (78m) 71s ago 78m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:42:52.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (78m) 71s ago 78m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:42:52.704 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (80m) 68s ago 81m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:42:53.039 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:42:53.039 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:42:53.040 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:42:53.040 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:42:53.040 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:42:53.040 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:42:53.040 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:42:53.041 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:42:53.041 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:42:53.041 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:42:53.041 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:42:53.042 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:42:53.042 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:42:53.042 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:42:53.042 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:42:53.043 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:42:53.043 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:42:53.043 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:42:53.043 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:42:53.421 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:42:52.385221+0000 mgr.smithi067.rdualw (mgr.24569) 2575 : audit [DBG] from='client.35854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:42:53.421 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:42:53.037859+0000 mon.smithi061 (mon.0) 706 : audit [DBG] from='client.? 172.21.15.61:0/3429680919' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:42:53.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:42:52.385221+0000 mgr.smithi067.rdualw (mgr.24569) 2575 : audit [DBG] from='client.35854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:42:53.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:42:53.037859+0000 mon.smithi061 (mon.0) 706 : audit [DBG] from='client.? 172.21.15.61:0/3429680919' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:42:54.421 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:42:52.680378+0000 mgr.smithi067.rdualw (mgr.24569) 2576 : audit [DBG] from='client.35858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:42:54.421 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:53.036170+0000 mgr.smithi067.rdualw (mgr.24569) 2577 : cluster [DBG] pgmap v2222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:42:52.680378+0000 mgr.smithi067.rdualw (mgr.24569) 2576 : audit [DBG] from='client.35858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:42:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:53.036170+0000 mgr.smithi067.rdualw (mgr.24569) 2577 : cluster [DBG] pgmap v2222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:56.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:55.037037+0000 mgr.smithi067.rdualw (mgr.24569) 2578 : cluster [DBG] pgmap v2223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:55.037037+0000 mgr.smithi067.rdualw (mgr.24569) 2578 : cluster [DBG] pgmap v2223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:42:58.421 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:42:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:57.037896+0000 mgr.smithi067.rdualw (mgr.24569) 2579 : cluster [DBG] pgmap v2224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:42:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:42:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:57.037896+0000 mgr.smithi067.rdualw (mgr.24569) 2579 : cluster [DBG] pgmap v2224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:43:00.422 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:42:59.038691+0000 mgr.smithi067.rdualw (mgr.24569) 2580 : cluster [DBG] pgmap v2225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:42:59.038691+0000 mgr.smithi067.rdualw (mgr.24569) 2580 : cluster [DBG] pgmap v2225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:02.422 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:01.039624+0000 mgr.smithi067.rdualw (mgr.24569) 2581 : cluster [DBG] pgmap v2226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:01.039624+0000 mgr.smithi067.rdualw (mgr.24569) 2581 : cluster [DBG] pgmap v2226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:04.423 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:03.040281+0000 mgr.smithi067.rdualw (mgr.24569) 2582 : cluster [DBG] pgmap v2227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:03.040281+0000 mgr.smithi067.rdualw (mgr.24569) 2582 : cluster [DBG] pgmap v2227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:05.041036+0000 mgr.smithi067.rdualw (mgr.24569) 2583 : cluster [DBG] pgmap v2228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:05.041036+0000 mgr.smithi067.rdualw (mgr.24569) 2583 : cluster [DBG] pgmap v2228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:08.423 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:07.042022+0000 mgr.smithi067.rdualw (mgr.24569) 2584 : cluster [DBG] pgmap v2229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:43:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:07.042022+0000 mgr.smithi067.rdualw (mgr.24569) 2584 : cluster [DBG] pgmap v2229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:43:10.424 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:09.042972+0000 mgr.smithi067.rdualw (mgr.24569) 2585 : cluster [DBG] pgmap v2230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:09.042972+0000 mgr.smithi067.rdualw (mgr.24569) 2585 : cluster [DBG] pgmap v2230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:12.424 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:11.044017+0000 mgr.smithi067.rdualw (mgr.24569) 2586 : cluster [DBG] pgmap v2231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:11.044017+0000 mgr.smithi067.rdualw (mgr.24569) 2586 : cluster [DBG] pgmap v2231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:14.424 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:13.044571+0000 mgr.smithi067.rdualw (mgr.24569) 2587 : cluster [DBG] pgmap v2232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:13.044571+0000 mgr.smithi067.rdualw (mgr.24569) 2587 : cluster [DBG] pgmap v2232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:15.045340+0000 mgr.smithi067.rdualw (mgr.24569) 2588 : cluster [DBG] pgmap v2233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:15.045340+0000 mgr.smithi067.rdualw (mgr.24569) 2588 : cluster [DBG] pgmap v2233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:18.425 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:17.046223+0000 mgr.smithi067.rdualw (mgr.24569) 2589 : cluster [DBG] pgmap v2234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:43:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:17.046223+0000 mgr.smithi067.rdualw (mgr.24569) 2589 : cluster [DBG] pgmap v2234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:43:20.425 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:19.046938+0000 mgr.smithi067.rdualw (mgr.24569) 2590 : cluster [DBG] pgmap v2235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:19.046938+0000 mgr.smithi067.rdualw (mgr.24569) 2590 : cluster [DBG] pgmap v2235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:22.425 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:21.047984+0000 mgr.smithi067.rdualw (mgr.24569) 2591 : cluster [DBG] pgmap v2236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:21.047984+0000 mgr.smithi067.rdualw (mgr.24569) 2591 : cluster [DBG] pgmap v2236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:23.346 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:43:23.634 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:43:23.635 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (80m) 99s ago 82m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:43:23.635 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (73m) 99s ago 81m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:43:23.635 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (73m) 101s ago 81m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:43:23.636 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (80m) 99s ago 81m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:43:23.636 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (74m) 99s ago 77m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:43:23.636 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (73m) 101s ago 77m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:43:23.636 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (75m) 99s ago 83m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:43:23.636 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (74m) 101s ago 81m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:43:23.637 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (74m) 99s ago 83m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:43:23.637 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (74m) 101s ago 81m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:43:23.637 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (75m) 99s ago 75m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:43:23.637 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (75m) 101s ago 75m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:43:23.638 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (81m) 99s ago 81m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:43:23.638 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (81m) 101s ago 81m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:43:23.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (64m) 99s ago 80m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:43:23.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (80m) 99s ago 80m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:43:23.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (80m) 99s ago 80m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:43:23.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (80m) 99s ago 80m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:43:23.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (79m) 101s ago 79m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:43:23.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (79m) 101s ago 79m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:43:23.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (79m) 101s ago 79m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:43:23.640 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (79m) 101s ago 79m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:43:23.640 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (80m) 99s ago 81m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:43:23.976 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:43:23.976 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:43:23.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:43:23.977 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:43:23.977 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:43:23.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:43:23.977 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:43:23.978 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:43:23.978 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:43:23.978 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:43:23.978 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:43:23.979 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:43:23.979 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:43:23.979 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:43:23.979 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:43:23.980 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:43:23.980 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:43:23.980 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:43:23.980 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:43:24.426 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:23.048684+0000 mgr.smithi067.rdualw (mgr.24569) 2592 : cluster [DBG] pgmap v2237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:24.426 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:43:23.333389+0000 mgr.smithi067.rdualw (mgr.24569) 2593 : audit [DBG] from='client.35866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:43:24.427 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:43:23.617251+0000 mgr.smithi067.rdualw (mgr.24569) 2594 : audit [DBG] from='client.35870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:43:24.427 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:43:23.974952+0000 mon.smithi061 (mon.0) 707 : audit [DBG] from='client.? 172.21.15.61:0/1814837673' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:43:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:23.048684+0000 mgr.smithi067.rdualw (mgr.24569) 2592 : cluster [DBG] pgmap v2237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:43:23.333389+0000 mgr.smithi067.rdualw (mgr.24569) 2593 : audit [DBG] from='client.35866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:43:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:43:23.617251+0000 mgr.smithi067.rdualw (mgr.24569) 2594 : audit [DBG] from='client.35870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:43:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:43:23.974952+0000 mon.smithi061 (mon.0) 707 : audit [DBG] from='client.? 172.21.15.61:0/1814837673' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:43:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:25.049421+0000 mgr.smithi067.rdualw (mgr.24569) 2595 : cluster [DBG] pgmap v2238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:25.049421+0000 mgr.smithi067.rdualw (mgr.24569) 2595 : cluster [DBG] pgmap v2238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:28.427 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:27.050368+0000 mgr.smithi067.rdualw (mgr.24569) 2596 : cluster [DBG] pgmap v2239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:43:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:27.050368+0000 mgr.smithi067.rdualw (mgr.24569) 2596 : cluster [DBG] pgmap v2239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:43:30.427 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:29.050899+0000 mgr.smithi067.rdualw (mgr.24569) 2597 : cluster [DBG] pgmap v2240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:29.050899+0000 mgr.smithi067.rdualw (mgr.24569) 2597 : cluster [DBG] pgmap v2240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:32.428 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:31.051746+0000 mgr.smithi067.rdualw (mgr.24569) 2598 : cluster [DBG] pgmap v2241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:31.051746+0000 mgr.smithi067.rdualw (mgr.24569) 2598 : cluster [DBG] pgmap v2241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:34.428 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:33.052317+0000 mgr.smithi067.rdualw (mgr.24569) 2599 : cluster [DBG] pgmap v2242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:33.052317+0000 mgr.smithi067.rdualw (mgr.24569) 2599 : cluster [DBG] pgmap v2242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:35.428 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:43:34.822568+0000 mon.smithi067 (mon.1) 427 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:43:35.429 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:43:34.822656+0000 mon.smithi061 (mon.0) 708 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:43:35.429 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:43:34.823258+0000 mon.smithi067 (mon.1) 428 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:43:35.429 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:43:34.823355+0000 mon.smithi061 (mon.0) 709 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:43:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:43:34.822568+0000 mon.smithi067 (mon.1) 427 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:43:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:43:34.822656+0000 mon.smithi061 (mon.0) 708 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:43:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:43:34.823258+0000 mon.smithi067 (mon.1) 428 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:43:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:43:34.823355+0000 mon.smithi061 (mon.0) 709 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:43:36.428 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:35.052907+0000 mgr.smithi067.rdualw (mgr.24569) 2600 : cluster [DBG] pgmap v2243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:35.052907+0000 mgr.smithi067.rdualw (mgr.24569) 2600 : cluster [DBG] pgmap v2243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:38.429 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:37.053759+0000 mgr.smithi067.rdualw (mgr.24569) 2601 : cluster [DBG] pgmap v2244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:43:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:37.053759+0000 mgr.smithi067.rdualw (mgr.24569) 2601 : cluster [DBG] pgmap v2244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:43:40.429 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:39.054550+0000 mgr.smithi067.rdualw (mgr.24569) 2602 : cluster [DBG] pgmap v2245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:39.054550+0000 mgr.smithi067.rdualw (mgr.24569) 2602 : cluster [DBG] pgmap v2245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:42.429 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:41.055395+0000 mgr.smithi067.rdualw (mgr.24569) 2603 : cluster [DBG] pgmap v2246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:41.055395+0000 mgr.smithi067.rdualw (mgr.24569) 2603 : cluster [DBG] pgmap v2246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:44.430 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:43.055921+0000 mgr.smithi067.rdualw (mgr.24569) 2604 : cluster [DBG] pgmap v2247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:43.055921+0000 mgr.smithi067.rdualw (mgr.24569) 2604 : cluster [DBG] pgmap v2247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:43:44.985509+0000 mon.smithi067 (mon.1) 429 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:43:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:43:44.986995+0000 mon.smithi067 (mon.1) 430 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:43:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:43:44.987938+0000 mon.smithi067 (mon.1) 431 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:43:46.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:43:44.988782+0000 mgr.smithi067.rdualw (mgr.24569) 2605 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:43:46.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:45.056496+0000 mgr.smithi067.rdualw (mgr.24569) 2606 : cluster [DBG] pgmap v2248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:46.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:43:45.245974+0000 mon.smithi061 (mon.0) 710 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:43:46.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:43:45.354815+0000 mon.smithi061 (mon.0) 711 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:43:46.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:43:45.755816+0000 mon.smithi061 (mon.0) 712 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:43:46.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:43:45.763607+0000 mon.smithi061 (mon.0) 713 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:43:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:43:44.985509+0000 mon.smithi067 (mon.1) 429 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:43:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:43:44.986995+0000 mon.smithi067 (mon.1) 430 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:43:46.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:43:44.987938+0000 mon.smithi067 (mon.1) 431 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:43:46.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:43:44.988782+0000 mgr.smithi067.rdualw (mgr.24569) 2605 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:43:46.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:45.056496+0000 mgr.smithi067.rdualw (mgr.24569) 2606 : cluster [DBG] pgmap v2248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:46.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:43:45.245974+0000 mon.smithi061 (mon.0) 710 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:43:46.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:43:45.354815+0000 mon.smithi061 (mon.0) 711 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:43:46.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:43:45.755816+0000 mon.smithi061 (mon.0) 712 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:43:46.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:43:45.763607+0000 mon.smithi061 (mon.0) 713 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:43:48.430 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:47.057507+0000 mgr.smithi067.rdualw (mgr.24569) 2607 : cluster [DBG] pgmap v2249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:43:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:47.057507+0000 mgr.smithi067.rdualw (mgr.24569) 2607 : cluster [DBG] pgmap v2249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:43:50.430 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:49.058160+0000 mgr.smithi067.rdualw (mgr.24569) 2608 : cluster [DBG] pgmap v2250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:49.058160+0000 mgr.smithi067.rdualw (mgr.24569) 2608 : cluster [DBG] pgmap v2250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:52.431 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:51.059041+0000 mgr.smithi067.rdualw (mgr.24569) 2609 : cluster [DBG] pgmap v2251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:51.059041+0000 mgr.smithi067.rdualw (mgr.24569) 2609 : cluster [DBG] pgmap v2251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:54.284 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:43:54.431 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:53.059531+0000 mgr.smithi067.rdualw (mgr.24569) 2610 : cluster [DBG] pgmap v2252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:53.059531+0000 mgr.smithi067.rdualw (mgr.24569) 2610 : cluster [DBG] pgmap v2252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:54.595 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:43:54.595 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (81m) 2m ago 82m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:43:54.596 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (74m) 2m ago 82m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:43:54.596 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (73m) 2m ago 82m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:43:54.596 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (81m) 2m ago 82m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:43:54.596 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (74m) 2m ago 78m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:43:54.597 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (74m) 2m ago 78m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:43:54.597 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (75m) 2m ago 83m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:43:54.597 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (75m) 2m ago 81m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:43:54.597 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (75m) 2m ago 83m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:43:54.597 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (74m) 2m ago 81m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:43:54.598 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (75m) 2m ago 75m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:43:54.598 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (75m) 2m ago 75m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:43:54.598 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (82m) 2m ago 82m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:43:54.599 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (81m) 2m ago 81m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:43:54.599 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (64m) 2m ago 81m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:43:54.599 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (81m) 2m ago 81m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:43:54.599 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (80m) 2m ago 80m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:43:54.600 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (80m) 2m ago 80m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:43:54.600 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (80m) 2m ago 80m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:43:54.600 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (80m) 2m ago 80m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:43:54.600 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (79m) 2m ago 79m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:43:54.601 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (79m) 2m ago 79m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:43:54.601 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (81m) 2m ago 82m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:43:54.944 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:43:54.945 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:43:54.945 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:43:54.945 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:43:54.945 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:43:54.946 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:43:54.946 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:43:54.946 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:43:54.946 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:43:54.947 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:43:54.947 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:43:54.947 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:43:54.947 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:43:54.948 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:43:54.948 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:43:54.948 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:43:54.948 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:43:54.949 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:43:54.949 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:43:55.431 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:43:54.270936+0000 mgr.smithi067.rdualw (mgr.24569) 2611 : audit [DBG] from='client.35878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:43:55.432 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:43:54.577796+0000 mgr.smithi067.rdualw (mgr.24569) 2612 : audit [DBG] from='client.35882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:43:55.432 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:43:54.943265+0000 mon.smithi061 (mon.0) 714 : audit [DBG] from='client.? 172.21.15.61:0/2788338483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:43:55.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:43:54.270936+0000 mgr.smithi067.rdualw (mgr.24569) 2611 : audit [DBG] from='client.35878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:43:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:43:54.577796+0000 mgr.smithi067.rdualw (mgr.24569) 2612 : audit [DBG] from='client.35882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:43:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:43:54.943265+0000 mon.smithi061 (mon.0) 714 : audit [DBG] from='client.? 172.21.15.61:0/2788338483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:43:56.432 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:55.060254+0000 mgr.smithi067.rdualw (mgr.24569) 2613 : cluster [DBG] pgmap v2253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:55.060254+0000 mgr.smithi067.rdualw (mgr.24569) 2613 : cluster [DBG] pgmap v2253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:43:58.432 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:43:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:57.061261+0000 mgr.smithi067.rdualw (mgr.24569) 2614 : cluster [DBG] pgmap v2254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:43:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:43:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:57.061261+0000 mgr.smithi067.rdualw (mgr.24569) 2614 : cluster [DBG] pgmap v2254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:44:00.432 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:43:59.061830+0000 mgr.smithi067.rdualw (mgr.24569) 2615 : cluster [DBG] pgmap v2255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:43:59.061830+0000 mgr.smithi067.rdualw (mgr.24569) 2615 : cluster [DBG] pgmap v2255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:02.433 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:01.062543+0000 mgr.smithi067.rdualw (mgr.24569) 2616 : cluster [DBG] pgmap v2256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:01.062543+0000 mgr.smithi067.rdualw (mgr.24569) 2616 : cluster [DBG] pgmap v2256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:04.433 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:03.063204+0000 mgr.smithi067.rdualw (mgr.24569) 2617 : cluster [DBG] pgmap v2257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:03.063204+0000 mgr.smithi067.rdualw (mgr.24569) 2617 : cluster [DBG] pgmap v2257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:05.063908+0000 mgr.smithi067.rdualw (mgr.24569) 2618 : cluster [DBG] pgmap v2258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:05.063908+0000 mgr.smithi067.rdualw (mgr.24569) 2618 : cluster [DBG] pgmap v2258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:08.434 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:07.064945+0000 mgr.smithi067.rdualw (mgr.24569) 2619 : cluster [DBG] pgmap v2259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:44:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:07.064945+0000 mgr.smithi067.rdualw (mgr.24569) 2619 : cluster [DBG] pgmap v2259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:44:10.434 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:09.065587+0000 mgr.smithi067.rdualw (mgr.24569) 2620 : cluster [DBG] pgmap v2260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:09.065587+0000 mgr.smithi067.rdualw (mgr.24569) 2620 : cluster [DBG] pgmap v2260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:12.435 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:11.066584+0000 mgr.smithi067.rdualw (mgr.24569) 2621 : cluster [DBG] pgmap v2261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:11.066584+0000 mgr.smithi067.rdualw (mgr.24569) 2621 : cluster [DBG] pgmap v2261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:14.435 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:13.067138+0000 mgr.smithi067.rdualw (mgr.24569) 2622 : cluster [DBG] pgmap v2262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:13.067138+0000 mgr.smithi067.rdualw (mgr.24569) 2622 : cluster [DBG] pgmap v2262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:16.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:15.067714+0000 mgr.smithi067.rdualw (mgr.24569) 2623 : cluster [DBG] pgmap v2263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:15.067714+0000 mgr.smithi067.rdualw (mgr.24569) 2623 : cluster [DBG] pgmap v2263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:18.435 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:17.068529+0000 mgr.smithi067.rdualw (mgr.24569) 2624 : cluster [DBG] pgmap v2264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:44:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:17.068529+0000 mgr.smithi067.rdualw (mgr.24569) 2624 : cluster [DBG] pgmap v2264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:44:20.436 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:19.069258+0000 mgr.smithi067.rdualw (mgr.24569) 2625 : cluster [DBG] pgmap v2265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:19.069258+0000 mgr.smithi067.rdualw (mgr.24569) 2625 : cluster [DBG] pgmap v2265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:22.436 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:21.070093+0000 mgr.smithi067.rdualw (mgr.24569) 2626 : cluster [DBG] pgmap v2266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:21.070093+0000 mgr.smithi067.rdualw (mgr.24569) 2626 : cluster [DBG] pgmap v2266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:24.436 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:23.070771+0000 mgr.smithi067.rdualw (mgr.24569) 2627 : cluster [DBG] pgmap v2267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:23.070771+0000 mgr.smithi067.rdualw (mgr.24569) 2627 : cluster [DBG] pgmap v2267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:25.251 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:44:25.544 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:44:25.544 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (81m) 2m ago 83m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:44:25.544 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (74m) 2m ago 83m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:44:25.545 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (74m) 2m ago 82m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:44:25.545 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (81m) 2m ago 82m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:44:25.545 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (75m) 2m ago 78m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:44:25.545 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (74m) 2m ago 78m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:44:25.545 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (76m) 2m ago 84m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:44:25.546 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (75m) 2m ago 82m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:44:25.546 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (75m) 2m ago 84m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:44:25.546 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (75m) 2m ago 82m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:44:25.546 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (76m) 2m ago 76m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:44:25.547 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (76m) 2m ago 76m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:44:25.547 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (82m) 2m ago 82m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:44:25.547 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (82m) 2m ago 82m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:44:25.547 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (65m) 2m ago 81m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:44:25.547 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (81m) 2m ago 81m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:44:25.548 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (81m) 2m ago 81m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:44:25.548 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (81m) 2m ago 81m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:44:25.548 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (80m) 2m ago 80m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:44:25.548 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (80m) 2m ago 80m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:44:25.549 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (80m) 2m ago 80m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:44:25.549 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (80m) 2m ago 80m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:44:25.549 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (81m) 2m ago 82m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:44:25.889 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:44:25.890 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:44:25.890 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:44:25.890 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:44:25.890 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:44:25.891 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:44:25.891 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:44:25.891 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:44:25.891 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:44:25.892 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:44:25.892 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:44:25.892 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:44:25.892 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:44:25.893 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:44:25.893 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:44:25.893 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:44:25.893 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:44:25.894 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:44:25.894 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:44:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:25.071526+0000 mgr.smithi067.rdualw (mgr.24569) 2628 : cluster [DBG] pgmap v2268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:44:25.238996+0000 mgr.smithi067.rdualw (mgr.24569) 2629 : audit [DBG] from='client.35890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:44:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:44:25.526664+0000 mgr.smithi067.rdualw (mgr.24569) 2630 : audit [DBG] from='client.35894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:44:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:44:25.888234+0000 mon.smithi061 (mon.0) 715 : audit [DBG] from='client.? 172.21.15.61:0/4224777167' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:44:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:25.071526+0000 mgr.smithi067.rdualw (mgr.24569) 2628 : cluster [DBG] pgmap v2268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:44:25.238996+0000 mgr.smithi067.rdualw (mgr.24569) 2629 : audit [DBG] from='client.35890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:44:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:44:25.526664+0000 mgr.smithi067.rdualw (mgr.24569) 2630 : audit [DBG] from='client.35894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:44:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:44:25.888234+0000 mon.smithi061 (mon.0) 715 : audit [DBG] from='client.? 172.21.15.61:0/4224777167' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:44:28.437 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:27.072451+0000 mgr.smithi067.rdualw (mgr.24569) 2631 : cluster [DBG] pgmap v2269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:44:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:27.072451+0000 mgr.smithi067.rdualw (mgr.24569) 2631 : cluster [DBG] pgmap v2269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:44:30.437 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:29.073086+0000 mgr.smithi067.rdualw (mgr.24569) 2632 : cluster [DBG] pgmap v2270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:29.073086+0000 mgr.smithi067.rdualw (mgr.24569) 2632 : cluster [DBG] pgmap v2270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:32.438 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:31.073889+0000 mgr.smithi067.rdualw (mgr.24569) 2633 : cluster [DBG] pgmap v2271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:31.073889+0000 mgr.smithi067.rdualw (mgr.24569) 2633 : cluster [DBG] pgmap v2271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:34.438 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:33.074406+0000 mgr.smithi067.rdualw (mgr.24569) 2634 : cluster [DBG] pgmap v2272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:33.074406+0000 mgr.smithi067.rdualw (mgr.24569) 2634 : cluster [DBG] pgmap v2272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:35.438 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:44:34.829192+0000 mon.smithi067 (mon.1) 432 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:44:35.439 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:44:34.829365+0000 mon.smithi061 (mon.0) 716 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:44:35.439 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:44:34.829488+0000 mon.smithi067 (mon.1) 433 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:44:35.439 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:44:34.829713+0000 mon.smithi061 (mon.0) 717 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:44:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:44:34.829192+0000 mon.smithi067 (mon.1) 432 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:44:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:44:34.829365+0000 mon.smithi061 (mon.0) 716 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:44:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:44:34.829488+0000 mon.smithi067 (mon.1) 433 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:44:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:44:34.829713+0000 mon.smithi061 (mon.0) 717 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:44:36.438 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:35.075017+0000 mgr.smithi067.rdualw (mgr.24569) 2635 : cluster [DBG] pgmap v2273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:35.075017+0000 mgr.smithi067.rdualw (mgr.24569) 2635 : cluster [DBG] pgmap v2273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:38.439 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:37.075945+0000 mgr.smithi067.rdualw (mgr.24569) 2636 : cluster [DBG] pgmap v2274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:44:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:37.075945+0000 mgr.smithi067.rdualw (mgr.24569) 2636 : cluster [DBG] pgmap v2274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:44:40.439 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:39.076567+0000 mgr.smithi067.rdualw (mgr.24569) 2637 : cluster [DBG] pgmap v2275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:39.076567+0000 mgr.smithi067.rdualw (mgr.24569) 2637 : cluster [DBG] pgmap v2275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:42.439 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:41.077416+0000 mgr.smithi067.rdualw (mgr.24569) 2638 : cluster [DBG] pgmap v2276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:41.077416+0000 mgr.smithi067.rdualw (mgr.24569) 2638 : cluster [DBG] pgmap v2276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:44.440 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:43.077936+0000 mgr.smithi067.rdualw (mgr.24569) 2639 : cluster [DBG] pgmap v2277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:43.077936+0000 mgr.smithi067.rdualw (mgr.24569) 2639 : cluster [DBG] pgmap v2277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:45.078790+0000 mgr.smithi067.rdualw (mgr.24569) 2640 : cluster [DBG] pgmap v2278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:44:45.767573+0000 mon.smithi067 (mon.1) 434 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:44:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:44:45.769095+0000 mon.smithi067 (mon.1) 435 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:44:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:44:45.770042+0000 mon.smithi067 (mon.1) 436 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:44:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:45.078790+0000 mgr.smithi067.rdualw (mgr.24569) 2640 : cluster [DBG] pgmap v2278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:44:45.767573+0000 mon.smithi067 (mon.1) 434 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:44:46.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:44:45.769095+0000 mon.smithi067 (mon.1) 435 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:44:46.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:44:45.770042+0000 mon.smithi067 (mon.1) 436 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:44:47.440 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:44:45.770920+0000 mgr.smithi067.rdualw (mgr.24569) 2641 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:44:47.441 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:44:46.178157+0000 mon.smithi061 (mon.0) 718 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:44:47.441 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:44:46.184061+0000 mon.smithi061 (mon.0) 719 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:44:47.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:44:45.770920+0000 mgr.smithi067.rdualw (mgr.24569) 2641 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:44:47.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:44:46.178157+0000 mon.smithi061 (mon.0) 718 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:44:47.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:44:46.184061+0000 mon.smithi061 (mon.0) 719 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:44:48.440 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:47.079876+0000 mgr.smithi067.rdualw (mgr.24569) 2642 : cluster [DBG] pgmap v2279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:44:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:47.079876+0000 mgr.smithi067.rdualw (mgr.24569) 2642 : cluster [DBG] pgmap v2279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:44:50.441 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:49.080666+0000 mgr.smithi067.rdualw (mgr.24569) 2643 : cluster [DBG] pgmap v2280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:49.080666+0000 mgr.smithi067.rdualw (mgr.24569) 2643 : cluster [DBG] pgmap v2280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:51.081526+0000 mgr.smithi067.rdualw (mgr.24569) 2644 : cluster [DBG] pgmap v2281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:51.081526+0000 mgr.smithi067.rdualw (mgr.24569) 2644 : cluster [DBG] pgmap v2281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:53.082041+0000 mgr.smithi067.rdualw (mgr.24569) 2645 : cluster [DBG] pgmap v2282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:53.082041+0000 mgr.smithi067.rdualw (mgr.24569) 2645 : cluster [DBG] pgmap v2282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:56.203 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:44:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:55.082776+0000 mgr.smithi067.rdualw (mgr.24569) 2646 : cluster [DBG] pgmap v2283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:55.082776+0000 mgr.smithi067.rdualw (mgr.24569) 2646 : cluster [DBG] pgmap v2283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:44:56.492 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:44:56.492 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (82m) 3m ago 83m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:44:56.492 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (75m) 3m ago 83m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:44:56.493 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (74m) 3m ago 83m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:44:56.493 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (82m) 3m ago 83m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:44:56.493 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (75m) 3m ago 79m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:44:56.493 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (75m) 3m ago 79m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:44:56.494 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (76m) 3m ago 84m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:44:56.494 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (76m) 3m ago 82m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:44:56.494 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (76m) 3m ago 84m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:44:56.494 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (75m) 3m ago 82m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:44:56.494 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (76m) 3m ago 76m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:44:56.495 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (76m) 3m ago 76m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:44:56.495 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (83m) 3m ago 83m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:44:56.495 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (82m) 3m ago 82m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:44:56.495 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (65m) 3m ago 82m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:44:56.496 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (82m) 3m ago 82m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:44:56.496 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (81m) 3m ago 81m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:44:56.496 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (81m) 3m ago 81m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:44:56.496 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (81m) 3m ago 81m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:44:56.496 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (81m) 3m ago 81m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:44:56.497 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (80m) 3m ago 80m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:44:56.497 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (80m) 3m ago 80m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:44:56.497 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (82m) 3m ago 83m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:44:56.838 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:44:56.838 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:44:56.838 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:44:56.838 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:44:56.839 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:44:56.839 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:44:56.839 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:44:56.839 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:44:56.840 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:44:56.840 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:44:56.840 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:44:56.840 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:44:56.840 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:44:56.841 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:44:56.841 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:44:56.841 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:44:56.841 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:44:56.842 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:44:56.842 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:44:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:44:56.184446+0000 mgr.smithi067.rdualw (mgr.24569) 2647 : audit [DBG] from='client.35902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:44:57.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:44:56.474839+0000 mgr.smithi067.rdualw (mgr.24569) 2648 : audit [DBG] from='client.35906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:44:57.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:44:56.836604+0000 mon.smithi061 (mon.0) 720 : audit [DBG] from='client.? 172.21.15.61:0/1065111300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:44:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:44:56.184446+0000 mgr.smithi067.rdualw (mgr.24569) 2647 : audit [DBG] from='client.35902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:44:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:44:56.474839+0000 mgr.smithi067.rdualw (mgr.24569) 2648 : audit [DBG] from='client.35906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:44:57.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:44:56.836604+0000 mon.smithi061 (mon.0) 720 : audit [DBG] from='client.? 172.21.15.61:0/1065111300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:44:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:44:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:57.083754+0000 mgr.smithi067.rdualw (mgr.24569) 2649 : cluster [DBG] pgmap v2284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:44:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:44:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:57.083754+0000 mgr.smithi067.rdualw (mgr.24569) 2649 : cluster [DBG] pgmap v2284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:45:00.442 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:44:59.084382+0000 mgr.smithi067.rdualw (mgr.24569) 2650 : cluster [DBG] pgmap v2285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:44:59.084382+0000 mgr.smithi067.rdualw (mgr.24569) 2650 : cluster [DBG] pgmap v2285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:02.443 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:01.085215+0000 mgr.smithi067.rdualw (mgr.24569) 2651 : cluster [DBG] pgmap v2286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:01.085215+0000 mgr.smithi067.rdualw (mgr.24569) 2651 : cluster [DBG] pgmap v2286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:04.443 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:03.085953+0000 mgr.smithi067.rdualw (mgr.24569) 2652 : cluster [DBG] pgmap v2287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:03.085953+0000 mgr.smithi067.rdualw (mgr.24569) 2652 : cluster [DBG] pgmap v2287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:05.086609+0000 mgr.smithi067.rdualw (mgr.24569) 2653 : cluster [DBG] pgmap v2288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:05.086609+0000 mgr.smithi067.rdualw (mgr.24569) 2653 : cluster [DBG] pgmap v2288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:08.444 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:07.087582+0000 mgr.smithi067.rdualw (mgr.24569) 2654 : cluster [DBG] pgmap v2289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:45:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:07.087582+0000 mgr.smithi067.rdualw (mgr.24569) 2654 : cluster [DBG] pgmap v2289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:45:10.444 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:09.088269+0000 mgr.smithi067.rdualw (mgr.24569) 2655 : cluster [DBG] pgmap v2290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:09.088269+0000 mgr.smithi067.rdualw (mgr.24569) 2655 : cluster [DBG] pgmap v2290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:12.444 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:11.089169+0000 mgr.smithi067.rdualw (mgr.24569) 2656 : cluster [DBG] pgmap v2291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:11.089169+0000 mgr.smithi067.rdualw (mgr.24569) 2656 : cluster [DBG] pgmap v2291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:14.445 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:13.089869+0000 mgr.smithi067.rdualw (mgr.24569) 2657 : cluster [DBG] pgmap v2292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:13.089869+0000 mgr.smithi067.rdualw (mgr.24569) 2657 : cluster [DBG] pgmap v2292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:15.090666+0000 mgr.smithi067.rdualw (mgr.24569) 2658 : cluster [DBG] pgmap v2293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:15.090666+0000 mgr.smithi067.rdualw (mgr.24569) 2658 : cluster [DBG] pgmap v2293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:18.445 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:17.091620+0000 mgr.smithi067.rdualw (mgr.24569) 2659 : cluster [DBG] pgmap v2294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:45:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:17.091620+0000 mgr.smithi067.rdualw (mgr.24569) 2659 : cluster [DBG] pgmap v2294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:45:20.446 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:19.092377+0000 mgr.smithi067.rdualw (mgr.24569) 2660 : cluster [DBG] pgmap v2295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:19.092377+0000 mgr.smithi067.rdualw (mgr.24569) 2660 : cluster [DBG] pgmap v2295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:22.446 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:21.093432+0000 mgr.smithi067.rdualw (mgr.24569) 2661 : cluster [DBG] pgmap v2296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:21.093432+0000 mgr.smithi067.rdualw (mgr.24569) 2661 : cluster [DBG] pgmap v2296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:24.446 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:23.094144+0000 mgr.smithi067.rdualw (mgr.24569) 2662 : cluster [DBG] pgmap v2297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:23.094144+0000 mgr.smithi067.rdualw (mgr.24569) 2662 : cluster [DBG] pgmap v2297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:25.094954+0000 mgr.smithi067.rdualw (mgr.24569) 2663 : cluster [DBG] pgmap v2298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:25.094954+0000 mgr.smithi067.rdualw (mgr.24569) 2663 : cluster [DBG] pgmap v2298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:27.145 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:45:27.437 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:45:27.437 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (82m) 3m ago 84m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:45:27.438 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (75m) 3m ago 84m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:45:27.438 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (75m) 3m ago 83m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:45:27.438 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (82m) 3m ago 83m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:45:27.438 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (76m) 3m ago 79m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:45:27.439 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (75m) 3m ago 79m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:45:27.439 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (77m) 3m ago 85m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:45:27.439 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (76m) 3m ago 83m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:45:27.439 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (76m) 3m ago 85m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:45:27.440 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (76m) 3m ago 83m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:45:27.440 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (77m) 3m ago 77m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:45:27.440 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (77m) 3m ago 77m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:45:27.440 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (83m) 3m ago 83m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:45:27.440 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (83m) 3m ago 83m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:45:27.441 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (66m) 3m ago 82m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:45:27.441 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (82m) 3m ago 82m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:45:27.441 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (82m) 3m ago 82m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:45:27.441 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (82m) 3m ago 82m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:45:27.441 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (81m) 3m ago 81m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:45:27.442 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (81m) 3m ago 81m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:45:27.442 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (81m) 3m ago 81m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:45:27.442 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (81m) 3m ago 81m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:45:27.443 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (82m) 3m ago 83m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:45:27.789 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:45:27.789 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:45:27.789 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:45:27.790 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:45:27.790 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:45:27.790 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:45:27.790 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:45:27.791 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:45:27.791 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:45:27.791 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:45:27.791 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:45:27.792 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:45:27.792 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:45:27.792 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:45:27.792 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:45:27.792 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:45:27.793 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:45:27.793 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:45:27.793 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:45:28.447 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:27.095994+0000 mgr.smithi067.rdualw (mgr.24569) 2664 : cluster [DBG] pgmap v2299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:45:28.448 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:45:27.132479+0000 mgr.smithi067.rdualw (mgr.24569) 2665 : audit [DBG] from='client.35914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:45:28.448 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:45:27.419647+0000 mgr.smithi067.rdualw (mgr.24569) 2666 : audit [DBG] from='client.35918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:45:28.449 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:45:27.786601+0000 mon.smithi061 (mon.0) 721 : audit [DBG] from='client.? 172.21.15.61:0/835880396' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:45:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:27.095994+0000 mgr.smithi067.rdualw (mgr.24569) 2664 : cluster [DBG] pgmap v2299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:45:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:45:27.132479+0000 mgr.smithi067.rdualw (mgr.24569) 2665 : audit [DBG] from='client.35914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:45:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:45:27.419647+0000 mgr.smithi067.rdualw (mgr.24569) 2666 : audit [DBG] from='client.35918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:45:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:45:27.786601+0000 mon.smithi061 (mon.0) 721 : audit [DBG] from='client.? 172.21.15.61:0/835880396' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:45:30.447 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:29.096643+0000 mgr.smithi067.rdualw (mgr.24569) 2667 : cluster [DBG] pgmap v2300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:29.096643+0000 mgr.smithi067.rdualw (mgr.24569) 2667 : cluster [DBG] pgmap v2300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:32.448 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:31.097503+0000 mgr.smithi067.rdualw (mgr.24569) 2668 : cluster [DBG] pgmap v2301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:31.097503+0000 mgr.smithi067.rdualw (mgr.24569) 2668 : cluster [DBG] pgmap v2301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:34.448 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:33.098045+0000 mgr.smithi067.rdualw (mgr.24569) 2669 : cluster [DBG] pgmap v2302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:33.098045+0000 mgr.smithi067.rdualw (mgr.24569) 2669 : cluster [DBG] pgmap v2302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:35.448 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:45:34.834743+0000 mon.smithi067 (mon.1) 437 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:45:35.449 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:45:34.834883+0000 mon.smithi061 (mon.0) 722 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:45:35.449 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:45:34.835082+0000 mon.smithi067 (mon.1) 438 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:45:35.449 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:45:34.835136+0000 mon.smithi061 (mon.0) 723 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:45:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:45:34.834743+0000 mon.smithi067 (mon.1) 437 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:45:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:45:34.834883+0000 mon.smithi061 (mon.0) 722 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:45:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:45:34.835082+0000 mon.smithi067 (mon.1) 438 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:45:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:45:34.835136+0000 mon.smithi061 (mon.0) 723 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:45:36.448 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:35.098740+0000 mgr.smithi067.rdualw (mgr.24569) 2670 : cluster [DBG] pgmap v2303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:35.098740+0000 mgr.smithi067.rdualw (mgr.24569) 2670 : cluster [DBG] pgmap v2303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:38.449 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:37.099715+0000 mgr.smithi067.rdualw (mgr.24569) 2671 : cluster [DBG] pgmap v2304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:45:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:37.099715+0000 mgr.smithi067.rdualw (mgr.24569) 2671 : cluster [DBG] pgmap v2304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:45:40.449 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:39.100227+0000 mgr.smithi067.rdualw (mgr.24569) 2672 : cluster [DBG] pgmap v2305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:39.100227+0000 mgr.smithi067.rdualw (mgr.24569) 2672 : cluster [DBG] pgmap v2305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:42.449 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:41.100997+0000 mgr.smithi067.rdualw (mgr.24569) 2673 : cluster [DBG] pgmap v2306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:41.100997+0000 mgr.smithi067.rdualw (mgr.24569) 2673 : cluster [DBG] pgmap v2306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:44.450 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:43.101558+0000 mgr.smithi067.rdualw (mgr.24569) 2674 : cluster [DBG] pgmap v2307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:43.101558+0000 mgr.smithi067.rdualw (mgr.24569) 2674 : cluster [DBG] pgmap v2307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:45.102239+0000 mgr.smithi067.rdualw (mgr.24569) 2675 : cluster [DBG] pgmap v2308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:45.102239+0000 mgr.smithi067.rdualw (mgr.24569) 2675 : cluster [DBG] pgmap v2308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:45:46.187712+0000 mon.smithi067 (mon.1) 439 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:45:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:45:46.189084+0000 mon.smithi067 (mon.1) 440 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:45:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:45:46.189996+0000 mon.smithi067 (mon.1) 441 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:45:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:45:46.190816+0000 mgr.smithi067.rdualw (mgr.24569) 2676 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:45:47.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:45:46.605380+0000 mon.smithi061 (mon.0) 724 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:45:47.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:45:46.611167+0000 mon.smithi061 (mon.0) 725 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:45:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:45:46.187712+0000 mon.smithi067 (mon.1) 439 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:45:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:45:46.189084+0000 mon.smithi067 (mon.1) 440 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:45:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:45:46.189996+0000 mon.smithi067 (mon.1) 441 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:45:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:45:46.190816+0000 mgr.smithi067.rdualw (mgr.24569) 2676 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:45:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:45:46.605380+0000 mon.smithi061 (mon.0) 724 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:45:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:45:46.611167+0000 mon.smithi061 (mon.0) 725 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:45:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:47.103069+0000 mgr.smithi067.rdualw (mgr.24569) 2677 : cluster [DBG] pgmap v2309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:45:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:47.103069+0000 mgr.smithi067.rdualw (mgr.24569) 2677 : cluster [DBG] pgmap v2309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:45:50.450 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:49.103817+0000 mgr.smithi067.rdualw (mgr.24569) 2678 : cluster [DBG] pgmap v2310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:49.103817+0000 mgr.smithi067.rdualw (mgr.24569) 2678 : cluster [DBG] pgmap v2310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:52.451 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:51.104789+0000 mgr.smithi067.rdualw (mgr.24569) 2679 : cluster [DBG] pgmap v2311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:51.104789+0000 mgr.smithi067.rdualw (mgr.24569) 2679 : cluster [DBG] pgmap v2311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:54.451 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:53.105361+0000 mgr.smithi067.rdualw (mgr.24569) 2680 : cluster [DBG] pgmap v2312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:53.105361+0000 mgr.smithi067.rdualw (mgr.24569) 2680 : cluster [DBG] pgmap v2312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:55.106021+0000 mgr.smithi067.rdualw (mgr.24569) 2681 : cluster [DBG] pgmap v2313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:55.106021+0000 mgr.smithi067.rdualw (mgr.24569) 2681 : cluster [DBG] pgmap v2313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:45:58.098 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:45:58.388 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:45:58.389 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (83m) 4m ago 84m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:45:58.389 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (76m) 4m ago 84m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:45:58.389 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (76m) 4m ago 84m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:45:58.390 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (83m) 4m ago 84m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:45:58.390 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (76m) 4m ago 80m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:45:58.390 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (76m) 4m ago 80m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:45:58.391 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (77m) 4m ago 85m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:45:58.391 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (77m) 4m ago 84m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:45:58.391 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (77m) 4m ago 85m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:45:58.392 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (76m) 4m ago 83m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:45:58.392 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (77m) 4m ago 77m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:45:58.392 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (77m) 4m ago 77m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:45:58.393 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (84m) 4m ago 84m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:45:58.393 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (83m) 4m ago 83m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:45:58.393 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (67m) 4m ago 83m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:45:58.393 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (83m) 4m ago 83m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:45:58.393 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (82m) 4m ago 82m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:45:58.394 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (82m) 4m ago 82m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:45:58.394 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (82m) 4m ago 82m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:45:58.394 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (82m) 4m ago 82m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:45:58.394 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (81m) 4m ago 81m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:45:58.395 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (81m) 4m ago 81m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:45:58.395 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (83m) 4m ago 84m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:45:58.452 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:57.106846+0000 mgr.smithi067.rdualw (mgr.24569) 2682 : cluster [DBG] pgmap v2314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:45:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:57.106846+0000 mgr.smithi067.rdualw (mgr.24569) 2682 : cluster [DBG] pgmap v2314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:45:58.734 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:45:58.734 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:45:58.735 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:45:58.735 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:45:58.735 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:45:58.736 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:45:58.736 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:45:58.736 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:45:58.737 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:45:58.737 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:45:58.737 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:45:58.738 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:45:58.738 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:45:58.738 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:45:58.738 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:45:58.739 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:45:58.739 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:45:58.739 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:45:58.739 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:45:59.452 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:45:58.082557+0000 mgr.smithi067.rdualw (mgr.24569) 2683 : audit [DBG] from='client.35926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:45:59.453 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:45:58.371499+0000 mgr.smithi067.rdualw (mgr.24569) 2684 : audit [DBG] from='client.35930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:45:59.453 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:45:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:45:58.732897+0000 mon.smithi061 (mon.0) 726 : audit [DBG] from='client.? 172.21.15.61:0/3098887217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:45:59.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:45:58.082557+0000 mgr.smithi067.rdualw (mgr.24569) 2683 : audit [DBG] from='client.35926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:45:59.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:45:58.371499+0000 mgr.smithi067.rdualw (mgr.24569) 2684 : audit [DBG] from='client.35930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:45:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:45:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:45:58.732897+0000 mon.smithi061 (mon.0) 726 : audit [DBG] from='client.? 172.21.15.61:0/3098887217' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:46:00.452 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:45:59.107568+0000 mgr.smithi067.rdualw (mgr.24569) 2685 : cluster [DBG] pgmap v2315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:45:59.107568+0000 mgr.smithi067.rdualw (mgr.24569) 2685 : cluster [DBG] pgmap v2315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:02.453 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:01.108676+0000 mgr.smithi067.rdualw (mgr.24569) 2686 : cluster [DBG] pgmap v2316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:01.108676+0000 mgr.smithi067.rdualw (mgr.24569) 2686 : cluster [DBG] pgmap v2316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:04.453 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:03.109320+0000 mgr.smithi067.rdualw (mgr.24569) 2687 : cluster [DBG] pgmap v2317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:03.109320+0000 mgr.smithi067.rdualw (mgr.24569) 2687 : cluster [DBG] pgmap v2317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:05.110045+0000 mgr.smithi067.rdualw (mgr.24569) 2688 : cluster [DBG] pgmap v2318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:05.110045+0000 mgr.smithi067.rdualw (mgr.24569) 2688 : cluster [DBG] pgmap v2318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:08.454 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:07.110988+0000 mgr.smithi067.rdualw (mgr.24569) 2689 : cluster [DBG] pgmap v2319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:46:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:07.110988+0000 mgr.smithi067.rdualw (mgr.24569) 2689 : cluster [DBG] pgmap v2319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:46:10.454 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:09.111641+0000 mgr.smithi067.rdualw (mgr.24569) 2690 : cluster [DBG] pgmap v2320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:09.111641+0000 mgr.smithi067.rdualw (mgr.24569) 2690 : cluster [DBG] pgmap v2320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:12.454 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:11.112486+0000 mgr.smithi067.rdualw (mgr.24569) 2691 : cluster [DBG] pgmap v2321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:11.112486+0000 mgr.smithi067.rdualw (mgr.24569) 2691 : cluster [DBG] pgmap v2321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:14.455 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:13.113202+0000 mgr.smithi067.rdualw (mgr.24569) 2692 : cluster [DBG] pgmap v2322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:13.113202+0000 mgr.smithi067.rdualw (mgr.24569) 2692 : cluster [DBG] pgmap v2322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:15.113800+0000 mgr.smithi067.rdualw (mgr.24569) 2693 : cluster [DBG] pgmap v2323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:15.113800+0000 mgr.smithi067.rdualw (mgr.24569) 2693 : cluster [DBG] pgmap v2323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:18.455 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:17.114826+0000 mgr.smithi067.rdualw (mgr.24569) 2694 : cluster [DBG] pgmap v2324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:46:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:17.114826+0000 mgr.smithi067.rdualw (mgr.24569) 2694 : cluster [DBG] pgmap v2324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:46:20.456 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:19.115509+0000 mgr.smithi067.rdualw (mgr.24569) 2695 : cluster [DBG] pgmap v2325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:19.115509+0000 mgr.smithi067.rdualw (mgr.24569) 2695 : cluster [DBG] pgmap v2325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:22.456 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:21.116515+0000 mgr.smithi067.rdualw (mgr.24569) 2696 : cluster [DBG] pgmap v2326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:21.116515+0000 mgr.smithi067.rdualw (mgr.24569) 2696 : cluster [DBG] pgmap v2326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:24.456 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:23.117049+0000 mgr.smithi067.rdualw (mgr.24569) 2697 : cluster [DBG] pgmap v2327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:23.117049+0000 mgr.smithi067.rdualw (mgr.24569) 2697 : cluster [DBG] pgmap v2327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:25.117797+0000 mgr.smithi067.rdualw (mgr.24569) 2698 : cluster [DBG] pgmap v2328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:25.117797+0000 mgr.smithi067.rdualw (mgr.24569) 2698 : cluster [DBG] pgmap v2328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:28.458 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:27.118677+0000 mgr.smithi067.rdualw (mgr.24569) 2699 : cluster [DBG] pgmap v2329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:46:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:27.118677+0000 mgr.smithi067.rdualw (mgr.24569) 2699 : cluster [DBG] pgmap v2329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:46:29.043 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:46:29.336 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:46:29.336 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (84m) 4m ago 85m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:46:29.336 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (76m) 4m ago 85m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:46:29.336 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (76m) 4m ago 84m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:46:29.337 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (83m) 4m ago 84m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:46:29.337 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (77m) 4m ago 80m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:46:29.337 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (76m) 4m ago 80m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:46:29.337 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (78m) 4m ago 86m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:46:29.338 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (77m) 4m ago 84m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:46:29.338 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (77m) 4m ago 86m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:46:29.338 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (77m) 4m ago 84m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:46:29.338 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (78m) 4m ago 78m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:46:29.338 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (78m) 4m ago 78m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:46:29.339 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (84m) 4m ago 84m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:46:29.339 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (84m) 4m ago 84m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:46:29.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (67m) 4m ago 83m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:46:29.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (83m) 4m ago 83m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:46:29.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (83m) 4m ago 83m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:46:29.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (83m) 4m ago 83m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:46:29.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (82m) 4m ago 82m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:46:29.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (82m) 4m ago 82m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:46:29.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (82m) 4m ago 82m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:46:29.341 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (82m) 4m ago 82m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:46:29.341 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (83m) 4m ago 84m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:46:29.679 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:46:29.680 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:46:29.680 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:46:29.680 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:46:29.680 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:46:29.680 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:46:29.681 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:46:29.681 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:46:29.681 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:46:29.681 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:46:29.682 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:46:29.682 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:46:29.682 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:46:29.682 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:46:29.682 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:46:29.683 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:46:29.683 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:46:29.683 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:46:29.683 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:46:30.457 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:46:29.029791+0000 mgr.smithi067.rdualw (mgr.24569) 2700 : audit [DBG] from='client.35938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:46:30.458 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:29.119247+0000 mgr.smithi067.rdualw (mgr.24569) 2701 : cluster [DBG] pgmap v2330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:30.458 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:46:29.318351+0000 mgr.smithi067.rdualw (mgr.24569) 2702 : audit [DBG] from='client.35942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:46:30.458 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:46:29.678110+0000 mon.smithi061 (mon.0) 727 : audit [DBG] from='client.? 172.21.15.61:0/383906586' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:46:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:46:29.029791+0000 mgr.smithi067.rdualw (mgr.24569) 2700 : audit [DBG] from='client.35938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:46:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:29.119247+0000 mgr.smithi067.rdualw (mgr.24569) 2701 : cluster [DBG] pgmap v2330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:46:29.318351+0000 mgr.smithi067.rdualw (mgr.24569) 2702 : audit [DBG] from='client.35942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:46:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:46:29.678110+0000 mon.smithi061 (mon.0) 727 : audit [DBG] from='client.? 172.21.15.61:0/383906586' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:46:32.458 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:31.120195+0000 mgr.smithi067.rdualw (mgr.24569) 2703 : cluster [DBG] pgmap v2331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:31.120195+0000 mgr.smithi067.rdualw (mgr.24569) 2703 : cluster [DBG] pgmap v2331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:34.458 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:33.120844+0000 mgr.smithi067.rdualw (mgr.24569) 2704 : cluster [DBG] pgmap v2332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:33.120844+0000 mgr.smithi067.rdualw (mgr.24569) 2704 : cluster [DBG] pgmap v2332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:35.458 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:46:34.842066+0000 mon.smithi067 (mon.1) 442 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:46:35.459 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:46:34.842219+0000 mon.smithi061 (mon.0) 728 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:46:35.459 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:46:34.842333+0000 mon.smithi067 (mon.1) 443 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:46:35.459 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:46:34.842595+0000 mon.smithi061 (mon.0) 729 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:46:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:46:34.842066+0000 mon.smithi067 (mon.1) 442 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:46:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:46:34.842219+0000 mon.smithi061 (mon.0) 728 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:46:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:46:34.842333+0000 mon.smithi067 (mon.1) 443 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:46:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:46:34.842595+0000 mon.smithi061 (mon.0) 729 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:46:36.458 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:35.121438+0000 mgr.smithi067.rdualw (mgr.24569) 2705 : cluster [DBG] pgmap v2333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:35.121438+0000 mgr.smithi067.rdualw (mgr.24569) 2705 : cluster [DBG] pgmap v2333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:38.459 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:37.122493+0000 mgr.smithi067.rdualw (mgr.24569) 2706 : cluster [DBG] pgmap v2334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:46:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:37.122493+0000 mgr.smithi067.rdualw (mgr.24569) 2706 : cluster [DBG] pgmap v2334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:46:40.459 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:39.123141+0000 mgr.smithi067.rdualw (mgr.24569) 2707 : cluster [DBG] pgmap v2335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:39.123141+0000 mgr.smithi067.rdualw (mgr.24569) 2707 : cluster [DBG] pgmap v2335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:42.460 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:41.123952+0000 mgr.smithi067.rdualw (mgr.24569) 2708 : cluster [DBG] pgmap v2336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:41.123952+0000 mgr.smithi067.rdualw (mgr.24569) 2708 : cluster [DBG] pgmap v2336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:44.460 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:43.124656+0000 mgr.smithi067.rdualw (mgr.24569) 2709 : cluster [DBG] pgmap v2337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:43.124656+0000 mgr.smithi067.rdualw (mgr.24569) 2709 : cluster [DBG] pgmap v2337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:45.125383+0000 mgr.smithi067.rdualw (mgr.24569) 2710 : cluster [DBG] pgmap v2338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:46.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:45.125383+0000 mgr.smithi067.rdualw (mgr.24569) 2710 : cluster [DBG] pgmap v2338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:46:46.615036+0000 mon.smithi067 (mon.1) 444 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:46:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:46:46.616486+0000 mon.smithi067 (mon.1) 445 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:46:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:46:46.617451+0000 mon.smithi067 (mon.1) 446 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:46:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:46:46.618314+0000 mgr.smithi067.rdualw (mgr.24569) 2711 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:46:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:46:46.615036+0000 mon.smithi067 (mon.1) 444 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:46:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:46:46.616486+0000 mon.smithi067 (mon.1) 445 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:46:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:46:46.617451+0000 mon.smithi067 (mon.1) 446 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:46:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:46:46.618314+0000 mgr.smithi067.rdualw (mgr.24569) 2711 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:46:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:46:47.026557+0000 mon.smithi061 (mon.0) 730 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:46:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:46:47.032338+0000 mon.smithi061 (mon.0) 731 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:46:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:47.126349+0000 mgr.smithi067.rdualw (mgr.24569) 2712 : cluster [DBG] pgmap v2339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:46:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:46:47.026557+0000 mon.smithi061 (mon.0) 730 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:46:48.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:46:47.032338+0000 mon.smithi061 (mon.0) 731 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:46:48.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:47.126349+0000 mgr.smithi067.rdualw (mgr.24569) 2712 : cluster [DBG] pgmap v2339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:46:50.461 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:49.126962+0000 mgr.smithi067.rdualw (mgr.24569) 2713 : cluster [DBG] pgmap v2340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:49.126962+0000 mgr.smithi067.rdualw (mgr.24569) 2713 : cluster [DBG] pgmap v2340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:52.469 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:51.127807+0000 mgr.smithi067.rdualw (mgr.24569) 2714 : cluster [DBG] pgmap v2341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:51.127807+0000 mgr.smithi067.rdualw (mgr.24569) 2714 : cluster [DBG] pgmap v2341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:54.461 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:53.128459+0000 mgr.smithi067.rdualw (mgr.24569) 2715 : cluster [DBG] pgmap v2342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:53.128459+0000 mgr.smithi067.rdualw (mgr.24569) 2715 : cluster [DBG] pgmap v2342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:55.129196+0000 mgr.smithi067.rdualw (mgr.24569) 2716 : cluster [DBG] pgmap v2343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:55.129196+0000 mgr.smithi067.rdualw (mgr.24569) 2716 : cluster [DBG] pgmap v2343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:46:58.462 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:46:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:57.130204+0000 mgr.smithi067.rdualw (mgr.24569) 2717 : cluster [DBG] pgmap v2344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:46:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:46:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:57.130204+0000 mgr.smithi067.rdualw (mgr.24569) 2717 : cluster [DBG] pgmap v2344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:46:59.989 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:47:00.284 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:47:00.284 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (84m) 5m ago 85m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:47:00.284 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (77m) 5m ago 85m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:47:00.284 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (77m) 5m ago 85m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:47:00.285 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (84m) 5m ago 85m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:47:00.285 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (77m) 5m ago 81m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:47:00.285 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (77m) 5m ago 81m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:47:00.285 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (78m) 5m ago 86m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:47:00.286 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (78m) 5m ago 85m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:47:00.286 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (78m) 5m ago 86m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:47:00.286 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (77m) 5m ago 84m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:47:00.287 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (78m) 5m ago 78m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:47:00.287 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (78m) 5m ago 78m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:47:00.287 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (85m) 5m ago 85m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:47:00.287 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (84m) 5m ago 84m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:47:00.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (68m) 5m ago 84m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:47:00.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (84m) 5m ago 84m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:47:00.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (83m) 5m ago 83m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:47:00.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (83m) 5m ago 83m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:47:00.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (83m) 5m ago 83m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:47:00.289 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (83m) 5m ago 83m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:47:00.289 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (82m) 5m ago 82m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:47:00.289 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (82m) 5m ago 82m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:47:00.289 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (84m) 5m ago 85m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:47:00.462 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:46:59.130896+0000 mgr.smithi067.rdualw (mgr.24569) 2718 : cluster [DBG] pgmap v2345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:46:59.130896+0000 mgr.smithi067.rdualw (mgr.24569) 2718 : cluster [DBG] pgmap v2345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:00.628 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:47:00.628 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:47:00.629 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:47:00.629 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:47:00.629 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:47:00.629 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:47:00.630 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:47:00.630 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:47:00.630 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:47:00.630 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:47:00.631 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:47:00.631 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:47:00.631 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:47:00.631 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:47:00.632 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:47:00.632 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:47:00.632 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:47:00.632 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:47:00.632 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:47:01.463 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:46:59.976556+0000 mgr.smithi067.rdualw (mgr.24569) 2719 : audit [DBG] from='client.35950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:47:01.463 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:47:00.266223+0000 mgr.smithi067.rdualw (mgr.24569) 2720 : audit [DBG] from='client.35954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:47:01.463 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:47:00.626135+0000 mon.smithi061 (mon.0) 732 : audit [DBG] from='client.? 172.21.15.61:0/3016497507' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:47:01.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:46:59.976556+0000 mgr.smithi067.rdualw (mgr.24569) 2719 : audit [DBG] from='client.35950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:47:01.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:47:00.266223+0000 mgr.smithi067.rdualw (mgr.24569) 2720 : audit [DBG] from='client.35954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:47:01.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:47:00.626135+0000 mon.smithi061 (mon.0) 732 : audit [DBG] from='client.? 172.21.15.61:0/3016497507' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:47:02.463 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:01.131719+0000 mgr.smithi067.rdualw (mgr.24569) 2721 : cluster [DBG] pgmap v2346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:01.131719+0000 mgr.smithi067.rdualw (mgr.24569) 2721 : cluster [DBG] pgmap v2346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:04.463 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:03.132310+0000 mgr.smithi067.rdualw (mgr.24569) 2722 : cluster [DBG] pgmap v2347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:03.132310+0000 mgr.smithi067.rdualw (mgr.24569) 2722 : cluster [DBG] pgmap v2347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:05.132998+0000 mgr.smithi067.rdualw (mgr.24569) 2723 : cluster [DBG] pgmap v2348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:05.132998+0000 mgr.smithi067.rdualw (mgr.24569) 2723 : cluster [DBG] pgmap v2348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:08.464 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:07.134007+0000 mgr.smithi067.rdualw (mgr.24569) 2724 : cluster [DBG] pgmap v2349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:47:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:07.134007+0000 mgr.smithi067.rdualw (mgr.24569) 2724 : cluster [DBG] pgmap v2349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:47:10.464 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:09.134694+0000 mgr.smithi067.rdualw (mgr.24569) 2725 : cluster [DBG] pgmap v2350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:09.134694+0000 mgr.smithi067.rdualw (mgr.24569) 2725 : cluster [DBG] pgmap v2350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:12.465 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:11.135747+0000 mgr.smithi067.rdualw (mgr.24569) 2726 : cluster [DBG] pgmap v2351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:11.135747+0000 mgr.smithi067.rdualw (mgr.24569) 2726 : cluster [DBG] pgmap v2351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:14.464 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:13.136454+0000 mgr.smithi067.rdualw (mgr.24569) 2727 : cluster [DBG] pgmap v2352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:13.136454+0000 mgr.smithi067.rdualw (mgr.24569) 2727 : cluster [DBG] pgmap v2352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:15.137169+0000 mgr.smithi067.rdualw (mgr.24569) 2728 : cluster [DBG] pgmap v2353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:15.137169+0000 mgr.smithi067.rdualw (mgr.24569) 2728 : cluster [DBG] pgmap v2353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:18.465 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:17.138076+0000 mgr.smithi067.rdualw (mgr.24569) 2729 : cluster [DBG] pgmap v2354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:47:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:17.138076+0000 mgr.smithi067.rdualw (mgr.24569) 2729 : cluster [DBG] pgmap v2354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:47:20.465 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:19.138840+0000 mgr.smithi067.rdualw (mgr.24569) 2730 : cluster [DBG] pgmap v2355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:19.138840+0000 mgr.smithi067.rdualw (mgr.24569) 2730 : cluster [DBG] pgmap v2355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:22.466 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:21.139874+0000 mgr.smithi067.rdualw (mgr.24569) 2731 : cluster [DBG] pgmap v2356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:21.139874+0000 mgr.smithi067.rdualw (mgr.24569) 2731 : cluster [DBG] pgmap v2356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:24.466 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:23.140349+0000 mgr.smithi067.rdualw (mgr.24569) 2732 : cluster [DBG] pgmap v2357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:23.140349+0000 mgr.smithi067.rdualw (mgr.24569) 2732 : cluster [DBG] pgmap v2357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:25.140968+0000 mgr.smithi067.rdualw (mgr.24569) 2733 : cluster [DBG] pgmap v2358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:25.140968+0000 mgr.smithi067.rdualw (mgr.24569) 2733 : cluster [DBG] pgmap v2358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:28.466 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:27.141961+0000 mgr.smithi067.rdualw (mgr.24569) 2734 : cluster [DBG] pgmap v2359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:47:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:27.141961+0000 mgr.smithi067.rdualw (mgr.24569) 2734 : cluster [DBG] pgmap v2359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:47:30.467 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:29.142547+0000 mgr.smithi067.rdualw (mgr.24569) 2735 : cluster [DBG] pgmap v2360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:29.142547+0000 mgr.smithi067.rdualw (mgr.24569) 2735 : cluster [DBG] pgmap v2360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:30.951 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:47:31.245 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:47:31.245 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (85m) 5m ago 86m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:47:31.245 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (77m) 5m ago 86m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:47:31.246 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (77m) 5m ago 85m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:47:31.246 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (84m) 5m ago 85m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:47:31.246 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (78m) 5m ago 81m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:47:31.246 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (78m) 5m ago 81m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:47:31.246 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (79m) 5m ago 87m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:47:31.247 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (78m) 5m ago 85m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:47:31.247 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (78m) 5m ago 87m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:47:31.247 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (78m) 5m ago 85m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:47:31.247 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (79m) 5m ago 79m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:47:31.248 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (79m) 5m ago 79m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:47:31.248 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (85m) 5m ago 85m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:47:31.248 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (85m) 5m ago 85m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:47:31.248 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (68m) 5m ago 84m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:47:31.249 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (84m) 5m ago 84m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:47:31.249 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (84m) 5m ago 84m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:47:31.249 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (84m) 5m ago 84m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:47:31.249 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (83m) 5m ago 83m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:47:31.250 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (83m) 5m ago 83m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:47:31.250 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (83m) 5m ago 83m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:47:31.250 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (83m) 5m ago 83m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:47:31.250 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (84m) 5m ago 85m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:47:31.584 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:47:31.584 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:47:31.584 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:47:31.585 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:47:31.585 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:47:31.585 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:47:31.585 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:47:31.586 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:47:31.586 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:47:31.586 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:47:31.586 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:47:31.587 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:47:31.587 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:47:31.587 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:47:31.587 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:47:31.587 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:47:31.588 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:47:31.588 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:47:31.588 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:47:32.467 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:47:30.938785+0000 mgr.smithi067.rdualw (mgr.24569) 2736 : audit [DBG] from='client.35962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:47:32.468 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:31.143526+0000 mgr.smithi067.rdualw (mgr.24569) 2737 : cluster [DBG] pgmap v2361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:32.468 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:47:31.227021+0000 mgr.smithi067.rdualw (mgr.24569) 2738 : audit [DBG] from='client.35966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:47:32.468 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:47:31.582734+0000 mon.smithi061 (mon.0) 733 : audit [DBG] from='client.? 172.21.15.61:0/2405136027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:47:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:47:30.938785+0000 mgr.smithi067.rdualw (mgr.24569) 2736 : audit [DBG] from='client.35962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:47:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:31.143526+0000 mgr.smithi067.rdualw (mgr.24569) 2737 : cluster [DBG] pgmap v2361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:47:31.227021+0000 mgr.smithi067.rdualw (mgr.24569) 2738 : audit [DBG] from='client.35966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:47:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:47:31.582734+0000 mon.smithi061 (mon.0) 733 : audit [DBG] from='client.? 172.21.15.61:0/2405136027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:47:34.467 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:33.144112+0000 mgr.smithi067.rdualw (mgr.24569) 2739 : cluster [DBG] pgmap v2362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:33.144112+0000 mgr.smithi067.rdualw (mgr.24569) 2739 : cluster [DBG] pgmap v2362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:35.468 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:47:34.846100+0000 mon.smithi067 (mon.1) 447 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:47:35.469 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:47:34.846356+0000 mon.smithi067 (mon.1) 448 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:47:35.469 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:47:34.846371+0000 mon.smithi061 (mon.0) 734 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:47:35.470 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:47:34.846683+0000 mon.smithi061 (mon.0) 735 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:47:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:47:34.846100+0000 mon.smithi067 (mon.1) 447 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:47:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:47:34.846356+0000 mon.smithi067 (mon.1) 448 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:47:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:47:34.846371+0000 mon.smithi061 (mon.0) 734 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:47:35.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:47:34.846683+0000 mon.smithi061 (mon.0) 735 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:47:36.468 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:35.144864+0000 mgr.smithi067.rdualw (mgr.24569) 2740 : cluster [DBG] pgmap v2363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:35.144864+0000 mgr.smithi067.rdualw (mgr.24569) 2740 : cluster [DBG] pgmap v2363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:38.468 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:37.145759+0000 mgr.smithi067.rdualw (mgr.24569) 2741 : cluster [DBG] pgmap v2364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:47:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:37.145759+0000 mgr.smithi067.rdualw (mgr.24569) 2741 : cluster [DBG] pgmap v2364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:47:40.469 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:39.146320+0000 mgr.smithi067.rdualw (mgr.24569) 2742 : cluster [DBG] pgmap v2365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:39.146320+0000 mgr.smithi067.rdualw (mgr.24569) 2742 : cluster [DBG] pgmap v2365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:41.147351+0000 mgr.smithi067.rdualw (mgr.24569) 2743 : cluster [DBG] pgmap v2366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:41.147351+0000 mgr.smithi067.rdualw (mgr.24569) 2743 : cluster [DBG] pgmap v2366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:43.147987+0000 mgr.smithi067.rdualw (mgr.24569) 2744 : cluster [DBG] pgmap v2367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:43.147987+0000 mgr.smithi067.rdualw (mgr.24569) 2744 : cluster [DBG] pgmap v2367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:45.148626+0000 mgr.smithi067.rdualw (mgr.24569) 2745 : cluster [DBG] pgmap v2368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:45.148626+0000 mgr.smithi067.rdualw (mgr.24569) 2745 : cluster [DBG] pgmap v2368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:47.470 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:47:47.036309+0000 mon.smithi067 (mon.1) 449 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:47:47.470 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:47:47.037844+0000 mon.smithi067 (mon.1) 450 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:47:47.471 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:47:47.038831+0000 mon.smithi067 (mon.1) 451 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:47:47.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:47:47.036309+0000 mon.smithi067 (mon.1) 449 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:47:47.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:47:47.037844+0000 mon.smithi067 (mon.1) 450 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:47:47.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:47:47.038831+0000 mon.smithi067 (mon.1) 451 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:47:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:47:47.039692+0000 mgr.smithi067.rdualw (mgr.24569) 2746 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:47:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:47.149368+0000 mgr.smithi067.rdualw (mgr.24569) 2747 : cluster [DBG] pgmap v2369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:47:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:47:47.455381+0000 mon.smithi061 (mon.0) 736 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:47:48.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:47:47.463098+0000 mon.smithi061 (mon.0) 737 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:47:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:47:47.039692+0000 mgr.smithi067.rdualw (mgr.24569) 2746 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:47:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:47.149368+0000 mgr.smithi067.rdualw (mgr.24569) 2747 : cluster [DBG] pgmap v2369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:47:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:47:47.455381+0000 mon.smithi061 (mon.0) 736 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:47:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:47:47.463098+0000 mon.smithi061 (mon.0) 737 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:47:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:49.150123+0000 mgr.smithi067.rdualw (mgr.24569) 2748 : cluster [DBG] pgmap v2370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:49.150123+0000 mgr.smithi067.rdualw (mgr.24569) 2748 : cluster [DBG] pgmap v2370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:51.151182+0000 mgr.smithi067.rdualw (mgr.24569) 2749 : cluster [DBG] pgmap v2371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:51.151182+0000 mgr.smithi067.rdualw (mgr.24569) 2749 : cluster [DBG] pgmap v2371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:54.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:53.151901+0000 mgr.smithi067.rdualw (mgr.24569) 2750 : cluster [DBG] pgmap v2372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:53.151901+0000 mgr.smithi067.rdualw (mgr.24569) 2750 : cluster [DBG] pgmap v2372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:56.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:55.152706+0000 mgr.smithi067.rdualw (mgr.24569) 2751 : cluster [DBG] pgmap v2373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:56.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:55.152706+0000 mgr.smithi067.rdualw (mgr.24569) 2751 : cluster [DBG] pgmap v2373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:47:58.472 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:47:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:57.153474+0000 mgr.smithi067.rdualw (mgr.24569) 2752 : cluster [DBG] pgmap v2374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:47:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:47:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:57.153474+0000 mgr.smithi067.rdualw (mgr.24569) 2752 : cluster [DBG] pgmap v2374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:48:00.472 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:47:59.154136+0000 mgr.smithi067.rdualw (mgr.24569) 2753 : cluster [DBG] pgmap v2375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:47:59.154136+0000 mgr.smithi067.rdualw (mgr.24569) 2753 : cluster [DBG] pgmap v2375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:01.935 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:48:02.233 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:48:02.234 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (85m) 6m ago 86m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:48:02.234 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (78m) 6m ago 86m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:48:02.234 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (78m) 6m ago 86m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:48:02.234 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (85m) 6m ago 86m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:48:02.235 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (78m) 6m ago 82m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:48:02.235 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (78m) 6m ago 82m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:48:02.235 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (79m) 6m ago 87m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:48:02.235 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (79m) 6m ago 86m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:48:02.236 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (79m) 6m ago 87m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:48:02.236 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (79m) 6m ago 85m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:48:02.236 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (79m) 6m ago 79m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:48:02.236 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (79m) 6m ago 79m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:48:02.236 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (86m) 6m ago 86m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:48:02.237 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (85m) 6m ago 85m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:48:02.237 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (69m) 6m ago 85m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:48:02.237 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (85m) 6m ago 85m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:48:02.237 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (84m) 6m ago 84m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:48:02.238 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (84m) 6m ago 84m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:48:02.238 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (84m) 6m ago 84m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:48:02.238 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (84m) 6m ago 84m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:48:02.239 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (83m) 6m ago 83m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:48:02.239 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (83m) 6m ago 83m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:48:02.239 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (85m) 6m ago 86m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:48:02.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:01.154894+0000 mgr.smithi067.rdualw (mgr.24569) 2754 : cluster [DBG] pgmap v2376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:01.154894+0000 mgr.smithi067.rdualw (mgr.24569) 2754 : cluster [DBG] pgmap v2376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:02.572 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:48:02.572 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:48:02.573 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:48:02.573 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:48:02.573 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:48:02.573 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:48:02.574 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:48:02.574 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:48:02.574 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:48:02.574 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:48:02.574 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:48:02.575 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:48:02.575 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:48:02.575 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:48:02.575 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:48:02.576 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:48:02.576 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:48:02.576 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:48:02.576 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:48:03.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:48:01.919243+0000 mgr.smithi067.rdualw (mgr.24569) 2755 : audit [DBG] from='client.35974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:48:03.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:48:02.214355+0000 mgr.smithi067.rdualw (mgr.24569) 2756 : audit [DBG] from='client.35978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:48:03.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:48:02.570958+0000 mon.smithi061 (mon.0) 738 : audit [DBG] from='client.? 172.21.15.61:0/1590985863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:48:03.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:48:01.919243+0000 mgr.smithi067.rdualw (mgr.24569) 2755 : audit [DBG] from='client.35974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:48:03.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:48:02.214355+0000 mgr.smithi067.rdualw (mgr.24569) 2756 : audit [DBG] from='client.35978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:48:03.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:48:02.570958+0000 mon.smithi061 (mon.0) 738 : audit [DBG] from='client.? 172.21.15.61:0/1590985863' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:48:04.473 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:03.155400+0000 mgr.smithi067.rdualw (mgr.24569) 2757 : cluster [DBG] pgmap v2377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:03.155400+0000 mgr.smithi067.rdualw (mgr.24569) 2757 : cluster [DBG] pgmap v2377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:05.156022+0000 mgr.smithi067.rdualw (mgr.24569) 2758 : cluster [DBG] pgmap v2378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:05.156022+0000 mgr.smithi067.rdualw (mgr.24569) 2758 : cluster [DBG] pgmap v2378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:08.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:07.156855+0000 mgr.smithi067.rdualw (mgr.24569) 2759 : cluster [DBG] pgmap v2379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:48:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:07.156855+0000 mgr.smithi067.rdualw (mgr.24569) 2759 : cluster [DBG] pgmap v2379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:48:10.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:09.157520+0000 mgr.smithi067.rdualw (mgr.24569) 2760 : cluster [DBG] pgmap v2380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:09.157520+0000 mgr.smithi067.rdualw (mgr.24569) 2760 : cluster [DBG] pgmap v2380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:12.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:11.158610+0000 mgr.smithi067.rdualw (mgr.24569) 2761 : cluster [DBG] pgmap v2381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:11.158610+0000 mgr.smithi067.rdualw (mgr.24569) 2761 : cluster [DBG] pgmap v2381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:14.474 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:13.159282+0000 mgr.smithi067.rdualw (mgr.24569) 2762 : cluster [DBG] pgmap v2382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:13.159282+0000 mgr.smithi067.rdualw (mgr.24569) 2762 : cluster [DBG] pgmap v2382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:16.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:15.159940+0000 mgr.smithi067.rdualw (mgr.24569) 2763 : cluster [DBG] pgmap v2383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:15.159940+0000 mgr.smithi067.rdualw (mgr.24569) 2763 : cluster [DBG] pgmap v2383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:18.475 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:17.160787+0000 mgr.smithi067.rdualw (mgr.24569) 2764 : cluster [DBG] pgmap v2384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:48:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:17.160787+0000 mgr.smithi067.rdualw (mgr.24569) 2764 : cluster [DBG] pgmap v2384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:48:20.476 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:19.161380+0000 mgr.smithi067.rdualw (mgr.24569) 2765 : cluster [DBG] pgmap v2385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:19.161380+0000 mgr.smithi067.rdualw (mgr.24569) 2765 : cluster [DBG] pgmap v2385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:22.476 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:21.162325+0000 mgr.smithi067.rdualw (mgr.24569) 2766 : cluster [DBG] pgmap v2386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:21.162325+0000 mgr.smithi067.rdualw (mgr.24569) 2766 : cluster [DBG] pgmap v2386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:24.476 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:23.162979+0000 mgr.smithi067.rdualw (mgr.24569) 2767 : cluster [DBG] pgmap v2387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:23.162979+0000 mgr.smithi067.rdualw (mgr.24569) 2767 : cluster [DBG] pgmap v2387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:25.163627+0000 mgr.smithi067.rdualw (mgr.24569) 2768 : cluster [DBG] pgmap v2388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:25.163627+0000 mgr.smithi067.rdualw (mgr.24569) 2768 : cluster [DBG] pgmap v2388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:28.479 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:27.164580+0000 mgr.smithi067.rdualw (mgr.24569) 2769 : cluster [DBG] pgmap v2389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:48:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:27.164580+0000 mgr.smithi067.rdualw (mgr.24569) 2769 : cluster [DBG] pgmap v2389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:48:30.477 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:29.165157+0000 mgr.smithi067.rdualw (mgr.24569) 2770 : cluster [DBG] pgmap v2390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:29.165157+0000 mgr.smithi067.rdualw (mgr.24569) 2770 : cluster [DBG] pgmap v2390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:32.478 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:31.165967+0000 mgr.smithi067.rdualw (mgr.24569) 2771 : cluster [DBG] pgmap v2391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:31.165967+0000 mgr.smithi067.rdualw (mgr.24569) 2771 : cluster [DBG] pgmap v2391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:32.878 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:48:33.169 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:48:33.170 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (86m) 6m ago 87m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:48:33.170 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (78m) 6m ago 87m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:48:33.170 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (78m) 6m ago 86m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:48:33.170 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (85m) 6m ago 86m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:48:33.171 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (79m) 6m ago 82m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:48:33.171 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (79m) 6m ago 82m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:48:33.171 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (80m) 6m ago 88m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:48:33.171 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (79m) 6m ago 86m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:48:33.172 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (79m) 6m ago 88m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:48:33.172 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (79m) 6m ago 86m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:48:33.172 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (80m) 6m ago 80m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:48:33.172 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (80m) 6m ago 80m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:48:33.172 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (86m) 6m ago 86m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:48:33.173 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (86m) 6m ago 86m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:48:33.173 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (69m) 6m ago 86m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:48:33.173 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (85m) 6m ago 85m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:48:33.173 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (85m) 6m ago 85m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:48:33.174 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (85m) 6m ago 85m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:48:33.174 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (84m) 6m ago 84m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:48:33.174 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (84m) 6m ago 84m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:48:33.174 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (84m) 6m ago 84m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:48:33.174 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (84m) 6m ago 84m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:48:33.175 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (85m) 6m ago 86m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:48:33.513 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:48:33.513 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:48:33.513 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:48:33.513 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:48:33.514 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:48:33.514 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:48:33.514 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:48:33.514 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:48:33.515 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:48:33.515 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:48:33.515 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:48:33.515 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:48:33.515 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:48:33.516 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:48:33.516 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:48:33.516 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:48:33.516 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:48:33.517 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:48:33.517 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:48:34.478 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:48:32.864935+0000 mgr.smithi067.rdualw (mgr.24569) 2772 : audit [DBG] from='client.35986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:48:34.478 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:48:33.151856+0000 mgr.smithi067.rdualw (mgr.24569) 2773 : audit [DBG] from='client.35990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:48:34.479 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:33.166476+0000 mgr.smithi067.rdualw (mgr.24569) 2774 : cluster [DBG] pgmap v2392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:34.479 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:48:33.511519+0000 mon.smithi061 (mon.0) 739 : audit [DBG] from='client.? 172.21.15.61:0/3159488600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:48:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:48:32.864935+0000 mgr.smithi067.rdualw (mgr.24569) 2772 : audit [DBG] from='client.35986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:48:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:48:33.151856+0000 mgr.smithi067.rdualw (mgr.24569) 2773 : audit [DBG] from='client.35990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:48:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:33.166476+0000 mgr.smithi067.rdualw (mgr.24569) 2774 : cluster [DBG] pgmap v2392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:48:33.511519+0000 mon.smithi061 (mon.0) 739 : audit [DBG] from='client.? 172.21.15.61:0/3159488600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:48:35.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:48:34.851478+0000 mon.smithi067 (mon.1) 452 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:48:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:48:34.851714+0000 mon.smithi061 (mon.0) 740 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:48:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:48:34.851754+0000 mon.smithi067 (mon.1) 453 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:48:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:48:34.851954+0000 mon.smithi061 (mon.0) 741 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:48:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:48:34.851478+0000 mon.smithi067 (mon.1) 452 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:48:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:48:34.851714+0000 mon.smithi061 (mon.0) 740 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:48:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:48:34.851754+0000 mon.smithi067 (mon.1) 453 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:48:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:48:34.851954+0000 mon.smithi061 (mon.0) 741 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:48:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:35.167122+0000 mgr.smithi067.rdualw (mgr.24569) 2775 : cluster [DBG] pgmap v2393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:35.167122+0000 mgr.smithi067.rdualw (mgr.24569) 2775 : cluster [DBG] pgmap v2393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:37.167952+0000 mgr.smithi067.rdualw (mgr.24569) 2776 : cluster [DBG] pgmap v2394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:48:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:37.167952+0000 mgr.smithi067.rdualw (mgr.24569) 2776 : cluster [DBG] pgmap v2394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:48:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:39.168623+0000 mgr.smithi067.rdualw (mgr.24569) 2777 : cluster [DBG] pgmap v2395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:39.168623+0000 mgr.smithi067.rdualw (mgr.24569) 2777 : cluster [DBG] pgmap v2395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:41.169454+0000 mgr.smithi067.rdualw (mgr.24569) 2778 : cluster [DBG] pgmap v2396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:41.169454+0000 mgr.smithi067.rdualw (mgr.24569) 2778 : cluster [DBG] pgmap v2396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:43.170057+0000 mgr.smithi067.rdualw (mgr.24569) 2779 : cluster [DBG] pgmap v2397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:43.170057+0000 mgr.smithi067.rdualw (mgr.24569) 2779 : cluster [DBG] pgmap v2397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:45.170758+0000 mgr.smithi067.rdualw (mgr.24569) 2780 : cluster [DBG] pgmap v2398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:45.170758+0000 mgr.smithi067.rdualw (mgr.24569) 2780 : cluster [DBG] pgmap v2398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:48.480 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:47.171617+0000 mgr.smithi067.rdualw (mgr.24569) 2781 : cluster [DBG] pgmap v2399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:48:48.481 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:48:47.466969+0000 mon.smithi067 (mon.1) 454 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:48:48.481 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:48:47.468401+0000 mon.smithi067 (mon.1) 455 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:48:48.481 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:48:47.469335+0000 mon.smithi067 (mon.1) 456 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:48:48.481 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:48:47.470204+0000 mgr.smithi067.rdualw (mgr.24569) 2782 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:48:48.482 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:48:47.886241+0000 mon.smithi061 (mon.0) 742 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:48:48.482 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:48:47.891860+0000 mon.smithi061 (mon.0) 743 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:48:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:47.171617+0000 mgr.smithi067.rdualw (mgr.24569) 2781 : cluster [DBG] pgmap v2399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:48:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:48:47.466969+0000 mon.smithi067 (mon.1) 454 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:48:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:48:47.468401+0000 mon.smithi067 (mon.1) 455 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:48:48.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:48:47.469335+0000 mon.smithi067 (mon.1) 456 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:48:48.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:48:47.470204+0000 mgr.smithi067.rdualw (mgr.24569) 2782 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:48:48.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:48:47.886241+0000 mon.smithi061 (mon.0) 742 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:48:48.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:48:47.891860+0000 mon.smithi061 (mon.0) 743 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:48:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:49.172161+0000 mgr.smithi067.rdualw (mgr.24569) 2783 : cluster [DBG] pgmap v2400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:49.172161+0000 mgr.smithi067.rdualw (mgr.24569) 2783 : cluster [DBG] pgmap v2400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:51.174067+0000 mgr.smithi067.rdualw (mgr.24569) 2784 : cluster [DBG] pgmap v2401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:51.174067+0000 mgr.smithi067.rdualw (mgr.24569) 2784 : cluster [DBG] pgmap v2401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:53.174586+0000 mgr.smithi067.rdualw (mgr.24569) 2785 : cluster [DBG] pgmap v2402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:53.174586+0000 mgr.smithi067.rdualw (mgr.24569) 2785 : cluster [DBG] pgmap v2402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:55.175187+0000 mgr.smithi067.rdualw (mgr.24569) 2786 : cluster [DBG] pgmap v2403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:55.175187+0000 mgr.smithi067.rdualw (mgr.24569) 2786 : cluster [DBG] pgmap v2403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:48:58.482 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:48:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:57.175995+0000 mgr.smithi067.rdualw (mgr.24569) 2787 : cluster [DBG] pgmap v2404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:48:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:48:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:57.175995+0000 mgr.smithi067.rdualw (mgr.24569) 2787 : cluster [DBG] pgmap v2404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:49:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:48:59.176724+0000 mgr.smithi067.rdualw (mgr.24569) 2788 : cluster [DBG] pgmap v2405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:48:59.176724+0000 mgr.smithi067.rdualw (mgr.24569) 2788 : cluster [DBG] pgmap v2405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:01.177509+0000 mgr.smithi067.rdualw (mgr.24569) 2789 : cluster [DBG] pgmap v2406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:01.177509+0000 mgr.smithi067.rdualw (mgr.24569) 2789 : cluster [DBG] pgmap v2406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:03.832 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:49:04.120 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:49:04.120 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (86m) 7m ago 87m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:49:04.121 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (79m) 7m ago 87m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:49:04.121 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (79m) 7m ago 87m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:49:04.121 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (86m) 7m ago 87m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:49:04.121 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (79m) 7m ago 83m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:49:04.122 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (79m) 7m ago 83m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:49:04.122 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (80m) 7m ago 88m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:49:04.122 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (80m) 7m ago 87m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:49:04.122 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (80m) 7m ago 88m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:49:04.123 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (80m) 7m ago 86m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:49:04.123 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (81m) 7m ago 81m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:49:04.124 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (80m) 7m ago 80m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:49:04.124 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (87m) 7m ago 87m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:49:04.124 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (86m) 7m ago 86m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:49:04.124 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (70m) 7m ago 86m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:49:04.125 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (86m) 7m ago 86m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:49:04.125 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (85m) 7m ago 85m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:49:04.125 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (85m) 7m ago 85m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:49:04.125 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (85m) 7m ago 85m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:49:04.126 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (85m) 7m ago 85m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:49:04.126 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (84m) 7m ago 84m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:49:04.126 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (84m) 7m ago 84m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:49:04.127 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (86m) 7m ago 87m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:49:04.471 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:49:04.471 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:49:04.471 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:49:04.471 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:49:04.472 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:49:04.472 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:49:04.472 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:49:04.473 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:49:04.473 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:49:04.473 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:49:04.473 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:49:04.473 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:49:04.474 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:49:04.474 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:49:04.474 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:49:04.474 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:49:04.475 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:49:04.475 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:49:04.475 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:49:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:03.178160+0000 mgr.smithi067.rdualw (mgr.24569) 2790 : cluster [DBG] pgmap v2407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:03.178160+0000 mgr.smithi067.rdualw (mgr.24569) 2790 : cluster [DBG] pgmap v2407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:05.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:49:03.818641+0000 mgr.smithi067.rdualw (mgr.24569) 2791 : audit [DBG] from='client.35998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:49:05.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:49:04.102779+0000 mgr.smithi067.rdualw (mgr.24569) 2792 : audit [DBG] from='client.36002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:49:05.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:49:04.469306+0000 mon.smithi061 (mon.0) 744 : audit [DBG] from='client.? 172.21.15.61:0/2178032317' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:49:05.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:49:03.818641+0000 mgr.smithi067.rdualw (mgr.24569) 2791 : audit [DBG] from='client.35998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:49:05.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:49:04.102779+0000 mgr.smithi067.rdualw (mgr.24569) 2792 : audit [DBG] from='client.36002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:49:05.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:49:04.469306+0000 mon.smithi061 (mon.0) 744 : audit [DBG] from='client.? 172.21.15.61:0/2178032317' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:49:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:05.178746+0000 mgr.smithi067.rdualw (mgr.24569) 2793 : cluster [DBG] pgmap v2408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:05.178746+0000 mgr.smithi067.rdualw (mgr.24569) 2793 : cluster [DBG] pgmap v2408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:07.179600+0000 mgr.smithi067.rdualw (mgr.24569) 2794 : cluster [DBG] pgmap v2409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:49:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:07.179600+0000 mgr.smithi067.rdualw (mgr.24569) 2794 : cluster [DBG] pgmap v2409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:49:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:09.180162+0000 mgr.smithi067.rdualw (mgr.24569) 2795 : cluster [DBG] pgmap v2410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:09.180162+0000 mgr.smithi067.rdualw (mgr.24569) 2795 : cluster [DBG] pgmap v2410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:11.181117+0000 mgr.smithi067.rdualw (mgr.24569) 2796 : cluster [DBG] pgmap v2411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:11.181117+0000 mgr.smithi067.rdualw (mgr.24569) 2796 : cluster [DBG] pgmap v2411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:13.181602+0000 mgr.smithi067.rdualw (mgr.24569) 2797 : cluster [DBG] pgmap v2412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:13.181602+0000 mgr.smithi067.rdualw (mgr.24569) 2797 : cluster [DBG] pgmap v2412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:15.182335+0000 mgr.smithi067.rdualw (mgr.24569) 2798 : cluster [DBG] pgmap v2413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:15.182335+0000 mgr.smithi067.rdualw (mgr.24569) 2798 : cluster [DBG] pgmap v2413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:17.183180+0000 mgr.smithi067.rdualw (mgr.24569) 2799 : cluster [DBG] pgmap v2414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:49:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:17.183180+0000 mgr.smithi067.rdualw (mgr.24569) 2799 : cluster [DBG] pgmap v2414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:49:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:19.183860+0000 mgr.smithi067.rdualw (mgr.24569) 2800 : cluster [DBG] pgmap v2415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:19.183860+0000 mgr.smithi067.rdualw (mgr.24569) 2800 : cluster [DBG] pgmap v2415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:22.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:21.184715+0000 mgr.smithi067.rdualw (mgr.24569) 2801 : cluster [DBG] pgmap v2416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:21.184715+0000 mgr.smithi067.rdualw (mgr.24569) 2801 : cluster [DBG] pgmap v2416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:23.185436+0000 mgr.smithi067.rdualw (mgr.24569) 2802 : cluster [DBG] pgmap v2417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:23.185436+0000 mgr.smithi067.rdualw (mgr.24569) 2802 : cluster [DBG] pgmap v2417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:25.186129+0000 mgr.smithi067.rdualw (mgr.24569) 2803 : cluster [DBG] pgmap v2418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:25.186129+0000 mgr.smithi067.rdualw (mgr.24569) 2803 : cluster [DBG] pgmap v2418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:27.187115+0000 mgr.smithi067.rdualw (mgr.24569) 2804 : cluster [DBG] pgmap v2419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:49:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:27.187115+0000 mgr.smithi067.rdualw (mgr.24569) 2804 : cluster [DBG] pgmap v2419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:49:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:29.187769+0000 mgr.smithi067.rdualw (mgr.24569) 2805 : cluster [DBG] pgmap v2420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:29.187769+0000 mgr.smithi067.rdualw (mgr.24569) 2805 : cluster [DBG] pgmap v2420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:32.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:31.188681+0000 mgr.smithi067.rdualw (mgr.24569) 2806 : cluster [DBG] pgmap v2421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:31.188681+0000 mgr.smithi067.rdualw (mgr.24569) 2806 : cluster [DBG] pgmap v2421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:33.189314+0000 mgr.smithi067.rdualw (mgr.24569) 2807 : cluster [DBG] pgmap v2422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:33.189314+0000 mgr.smithi067.rdualw (mgr.24569) 2807 : cluster [DBG] pgmap v2422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:34.778 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:49:35.068 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:49:35.069 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (87m) 7m ago 88m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:49:35.069 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (79m) 7m ago 88m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:49:35.069 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (79m) 7m ago 87m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:49:35.069 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (86m) 7m ago 88m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:49:35.070 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (80m) 7m ago 83m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:49:35.070 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (80m) 7m ago 83m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:49:35.070 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (81m) 7m ago 89m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:49:35.070 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (80m) 7m ago 87m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:49:35.071 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (80m) 7m ago 89m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:49:35.071 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (80m) 7m ago 87m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:49:35.071 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (81m) 7m ago 81m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:49:35.071 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (81m) 7m ago 81m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:49:35.071 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (87m) 7m ago 87m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:49:35.072 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (87m) 7m ago 87m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:49:35.072 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (70m) 7m ago 87m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:49:35.072 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (86m) 7m ago 86m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:49:35.072 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (86m) 7m ago 86m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:49:35.073 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (86m) 7m ago 86m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:49:35.073 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (85m) 7m ago 85m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:49:35.073 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (85m) 7m ago 85m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:49:35.073 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (85m) 7m ago 85m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:49:35.073 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (85m) 7m ago 85m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:49:35.074 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (86m) 7m ago 87m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:49:35.414 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:49:35.414 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:49:35.414 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:49:35.415 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:49:35.415 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:49:35.415 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:49:35.415 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:49:35.415 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:49:35.416 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:49:35.416 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:49:35.416 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:49:35.416 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:49:35.416 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:49:35.417 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:49:35.417 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:49:35.417 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:49:35.417 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:49:35.418 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:49:35.418 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:49:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:49:34.856892+0000 mon.smithi067 (mon.1) 457 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:49:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:49:34.857171+0000 mon.smithi061 (mon.0) 745 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:49:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:49:34.857254+0000 mon.smithi067 (mon.1) 458 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:49:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:49:34.857663+0000 mon.smithi061 (mon.0) 746 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:49:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:49:34.856892+0000 mon.smithi067 (mon.1) 457 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:49:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:49:34.857171+0000 mon.smithi061 (mon.0) 745 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:49:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:49:34.857254+0000 mon.smithi067 (mon.1) 458 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:49:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:49:34.857663+0000 mon.smithi061 (mon.0) 746 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:49:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:49:34.763108+0000 mgr.smithi067.rdualw (mgr.24569) 2808 : audit [DBG] from='client.36010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:49:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:49:35.050962+0000 mgr.smithi067.rdualw (mgr.24569) 2809 : audit [DBG] from='client.36014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:49:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:35.189910+0000 mgr.smithi067.rdualw (mgr.24569) 2810 : cluster [DBG] pgmap v2423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:49:35.412571+0000 mon.smithi061 (mon.0) 747 : audit [DBG] from='client.? 172.21.15.61:0/3650598394' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:49:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:49:34.763108+0000 mgr.smithi067.rdualw (mgr.24569) 2808 : audit [DBG] from='client.36010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:49:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:49:35.050962+0000 mgr.smithi067.rdualw (mgr.24569) 2809 : audit [DBG] from='client.36014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:49:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:35.189910+0000 mgr.smithi067.rdualw (mgr.24569) 2810 : cluster [DBG] pgmap v2423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:49:35.412571+0000 mon.smithi061 (mon.0) 747 : audit [DBG] from='client.? 172.21.15.61:0/3650598394' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:49:38.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:37.190908+0000 mgr.smithi067.rdualw (mgr.24569) 2811 : cluster [DBG] pgmap v2424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:49:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:37.190908+0000 mgr.smithi067.rdualw (mgr.24569) 2811 : cluster [DBG] pgmap v2424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:49:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:39.191491+0000 mgr.smithi067.rdualw (mgr.24569) 2812 : cluster [DBG] pgmap v2425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:39.191491+0000 mgr.smithi067.rdualw (mgr.24569) 2812 : cluster [DBG] pgmap v2425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:41.192282+0000 mgr.smithi067.rdualw (mgr.24569) 2813 : cluster [DBG] pgmap v2426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:41.192282+0000 mgr.smithi067.rdualw (mgr.24569) 2813 : cluster [DBG] pgmap v2426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:43.192796+0000 mgr.smithi067.rdualw (mgr.24569) 2814 : cluster [DBG] pgmap v2427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:43.192796+0000 mgr.smithi067.rdualw (mgr.24569) 2814 : cluster [DBG] pgmap v2427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:45.193308+0000 mgr.smithi067.rdualw (mgr.24569) 2815 : cluster [DBG] pgmap v2428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:45.193308+0000 mgr.smithi067.rdualw (mgr.24569) 2815 : cluster [DBG] pgmap v2428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:47.194217+0000 mgr.smithi067.rdualw (mgr.24569) 2816 : cluster [DBG] pgmap v2429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:49:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:49:47.895627+0000 mon.smithi067 (mon.1) 459 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:49:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:49:47.897190+0000 mon.smithi067 (mon.1) 460 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:49:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:49:47.898195+0000 mon.smithi067 (mon.1) 461 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:49:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:47.194217+0000 mgr.smithi067.rdualw (mgr.24569) 2816 : cluster [DBG] pgmap v2429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:49:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:49:47.895627+0000 mon.smithi067 (mon.1) 459 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:49:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:49:47.897190+0000 mon.smithi067 (mon.1) 460 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:49:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:49:47.898195+0000 mon.smithi067 (mon.1) 461 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:49:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:49:47.899145+0000 mgr.smithi067.rdualw (mgr.24569) 2817 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:49:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:49:48.320102+0000 mon.smithi061 (mon.0) 748 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:49:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:49:48.328448+0000 mon.smithi061 (mon.0) 749 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:49:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:49:47.899145+0000 mgr.smithi067.rdualw (mgr.24569) 2817 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:49:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:49:48.320102+0000 mon.smithi061 (mon.0) 748 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:49:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:49:48.328448+0000 mon.smithi061 (mon.0) 749 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:49:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:49.194966+0000 mgr.smithi067.rdualw (mgr.24569) 2818 : cluster [DBG] pgmap v2430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:49.194966+0000 mgr.smithi067.rdualw (mgr.24569) 2818 : cluster [DBG] pgmap v2430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:51.196102+0000 mgr.smithi067.rdualw (mgr.24569) 2819 : cluster [DBG] pgmap v2431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:51.196102+0000 mgr.smithi067.rdualw (mgr.24569) 2819 : cluster [DBG] pgmap v2431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:53.196645+0000 mgr.smithi067.rdualw (mgr.24569) 2820 : cluster [DBG] pgmap v2432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:53.196645+0000 mgr.smithi067.rdualw (mgr.24569) 2820 : cluster [DBG] pgmap v2432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:56.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:55.197346+0000 mgr.smithi067.rdualw (mgr.24569) 2821 : cluster [DBG] pgmap v2433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:55.197346+0000 mgr.smithi067.rdualw (mgr.24569) 2821 : cluster [DBG] pgmap v2433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:49:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:49:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:57.198263+0000 mgr.smithi067.rdualw (mgr.24569) 2822 : cluster [DBG] pgmap v2434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:49:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:49:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:57.198263+0000 mgr.smithi067.rdualw (mgr.24569) 2822 : cluster [DBG] pgmap v2434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:50:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:49:59.199000+0000 mgr.smithi067.rdualw (mgr.24569) 2823 : cluster [DBG] pgmap v2435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:00.000088+0000 mon.smithi061 (mon.0) 750 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T16:50:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:49:59.199000+0000 mgr.smithi067.rdualw (mgr.24569) 2823 : cluster [DBG] pgmap v2435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:00.000088+0000 mon.smithi061 (mon.0) 750 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T16:50:02.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:01.199836+0000 mgr.smithi067.rdualw (mgr.24569) 2824 : cluster [DBG] pgmap v2436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:01.199836+0000 mgr.smithi067.rdualw (mgr.24569) 2824 : cluster [DBG] pgmap v2436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:04.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:03.200463+0000 mgr.smithi067.rdualw (mgr.24569) 2825 : cluster [DBG] pgmap v2437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:03.200463+0000 mgr.smithi067.rdualw (mgr.24569) 2825 : cluster [DBG] pgmap v2437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:05.750 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:50:06.056 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:50:06.056 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (87m) 8m ago 88m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:50:06.056 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (80m) 8m ago 88m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:50:06.056 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (80m) 8m ago 88m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:50:06.057 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (87m) 8m ago 88m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:50:06.057 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (80m) 8m ago 84m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:50:06.057 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (80m) 8m ago 84m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:50:06.057 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (81m) 8m ago 89m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:50:06.058 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (81m) 8m ago 88m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:50:06.058 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (81m) 8m ago 89m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:50:06.058 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (81m) 8m ago 88m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:50:06.058 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (82m) 8m ago 82m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:50:06.059 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (81m) 8m ago 81m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:50:06.059 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (88m) 8m ago 88m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:50:06.059 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (87m) 8m ago 87m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:50:06.059 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (71m) 8m ago 87m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:50:06.059 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (87m) 8m ago 87m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:50:06.060 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (87m) 8m ago 86m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:50:06.060 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (86m) 8m ago 86m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:50:06.060 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (86m) 8m ago 86m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:50:06.060 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (86m) 8m ago 86m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:50:06.061 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (85m) 8m ago 85m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:50:06.061 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (85m) 8m ago 85m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:50:06.061 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (87m) 8m ago 88m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:50:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:05.201106+0000 mgr.smithi067.rdualw (mgr.24569) 2826 : cluster [DBG] pgmap v2438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:05.201106+0000 mgr.smithi067.rdualw (mgr.24569) 2826 : cluster [DBG] pgmap v2438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:06.404 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:50:06.404 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:50:06.405 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:50:06.405 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:50:06.405 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:50:06.405 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:50:06.405 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:50:06.406 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:50:06.406 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:50:06.406 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:50:06.406 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:50:06.407 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:50:06.407 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:50:06.407 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:50:06.407 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:50:06.407 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:50:06.408 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:50:06.408 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:50:06.408 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:50:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:50:05.737394+0000 mgr.smithi067.rdualw (mgr.24569) 2827 : audit [DBG] from='client.36022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:50:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:50:06.038628+0000 mgr.smithi067.rdualw (mgr.24569) 2828 : audit [DBG] from='client.36026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:50:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:50:06.402962+0000 mon.smithi061 (mon.0) 751 : audit [DBG] from='client.? 172.21.15.61:0/3368471538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:50:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:50:05.737394+0000 mgr.smithi067.rdualw (mgr.24569) 2827 : audit [DBG] from='client.36022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:50:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:50:06.038628+0000 mgr.smithi067.rdualw (mgr.24569) 2828 : audit [DBG] from='client.36026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:50:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:50:06.402962+0000 mon.smithi061 (mon.0) 751 : audit [DBG] from='client.? 172.21.15.61:0/3368471538' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:50:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:07.202146+0000 mgr.smithi067.rdualw (mgr.24569) 2829 : cluster [DBG] pgmap v2439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:50:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:07.202146+0000 mgr.smithi067.rdualw (mgr.24569) 2829 : cluster [DBG] pgmap v2439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:50:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:09.202783+0000 mgr.smithi067.rdualw (mgr.24569) 2830 : cluster [DBG] pgmap v2440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:09.202783+0000 mgr.smithi067.rdualw (mgr.24569) 2830 : cluster [DBG] pgmap v2440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:12.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:11.203661+0000 mgr.smithi067.rdualw (mgr.24569) 2831 : cluster [DBG] pgmap v2441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:11.203661+0000 mgr.smithi067.rdualw (mgr.24569) 2831 : cluster [DBG] pgmap v2441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:13.204228+0000 mgr.smithi067.rdualw (mgr.24569) 2832 : cluster [DBG] pgmap v2442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:13.204228+0000 mgr.smithi067.rdualw (mgr.24569) 2832 : cluster [DBG] pgmap v2442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:16.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:15.205053+0000 mgr.smithi067.rdualw (mgr.24569) 2833 : cluster [DBG] pgmap v2443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:15.205053+0000 mgr.smithi067.rdualw (mgr.24569) 2833 : cluster [DBG] pgmap v2443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:18.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:17.205927+0000 mgr.smithi067.rdualw (mgr.24569) 2834 : cluster [DBG] pgmap v2444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:50:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:17.205927+0000 mgr.smithi067.rdualw (mgr.24569) 2834 : cluster [DBG] pgmap v2444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:50:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:19.206572+0000 mgr.smithi067.rdualw (mgr.24569) 2835 : cluster [DBG] pgmap v2445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:19.206572+0000 mgr.smithi067.rdualw (mgr.24569) 2835 : cluster [DBG] pgmap v2445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:21.207569+0000 mgr.smithi067.rdualw (mgr.24569) 2836 : cluster [DBG] pgmap v2446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:21.207569+0000 mgr.smithi067.rdualw (mgr.24569) 2836 : cluster [DBG] pgmap v2446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:23.208145+0000 mgr.smithi067.rdualw (mgr.24569) 2837 : cluster [DBG] pgmap v2447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:23.208145+0000 mgr.smithi067.rdualw (mgr.24569) 2837 : cluster [DBG] pgmap v2447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:25.208917+0000 mgr.smithi067.rdualw (mgr.24569) 2838 : cluster [DBG] pgmap v2448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:25.208917+0000 mgr.smithi067.rdualw (mgr.24569) 2838 : cluster [DBG] pgmap v2448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:27.209727+0000 mgr.smithi067.rdualw (mgr.24569) 2839 : cluster [DBG] pgmap v2449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:50:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:27.209727+0000 mgr.smithi067.rdualw (mgr.24569) 2839 : cluster [DBG] pgmap v2449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:50:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:29.210508+0000 mgr.smithi067.rdualw (mgr.24569) 2840 : cluster [DBG] pgmap v2450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:29.210508+0000 mgr.smithi067.rdualw (mgr.24569) 2840 : cluster [DBG] pgmap v2450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:31.211344+0000 mgr.smithi067.rdualw (mgr.24569) 2841 : cluster [DBG] pgmap v2451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:31.211344+0000 mgr.smithi067.rdualw (mgr.24569) 2841 : cluster [DBG] pgmap v2451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:33.212096+0000 mgr.smithi067.rdualw (mgr.24569) 2842 : cluster [DBG] pgmap v2452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:33.212096+0000 mgr.smithi067.rdualw (mgr.24569) 2842 : cluster [DBG] pgmap v2452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:35.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:50:34.862244+0000 mon.smithi067 (mon.1) 462 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:50:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:50:34.862369+0000 mon.smithi061 (mon.0) 752 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:50:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:50:34.862561+0000 mon.smithi067 (mon.1) 463 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:50:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:50:34.862775+0000 mon.smithi061 (mon.0) 753 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:50:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:50:34.862244+0000 mon.smithi067 (mon.1) 462 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:50:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:50:34.862369+0000 mon.smithi061 (mon.0) 752 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:50:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:50:34.862561+0000 mon.smithi067 (mon.1) 463 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:50:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:50:34.862775+0000 mon.smithi061 (mon.0) 753 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:50:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:35.212722+0000 mgr.smithi067.rdualw (mgr.24569) 2843 : cluster [DBG] pgmap v2453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:36.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:35.212722+0000 mgr.smithi067.rdualw (mgr.24569) 2843 : cluster [DBG] pgmap v2453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:36.712 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:50:37.003 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:50:37.003 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (88m) 8m ago 89m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:50:37.004 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (80m) 8m ago 89m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:50:37.004 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (80m) 8m ago 88m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:50:37.004 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (88m) 8m ago 89m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:50:37.005 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (81m) 8m ago 84m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:50:37.005 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (81m) 8m ago 84m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:50:37.005 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (82m) 8m ago 90m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:50:37.006 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (81m) 8m ago 88m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:50:37.006 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (81m) 8m ago 90m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:50:37.007 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (81m) 8m ago 88m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:50:37.007 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (82m) 8m ago 82m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:50:37.007 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (82m) 8m ago 82m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:50:37.008 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (88m) 8m ago 88m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:50:37.008 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (88m) 8m ago 88m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:50:37.009 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (71m) 8m ago 88m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:50:37.009 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (87m) 8m ago 87m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:50:37.009 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (87m) 8m ago 87m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:50:37.010 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (87m) 8m ago 87m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:50:37.011 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (86m) 8m ago 86m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:50:37.011 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (86m) 8m ago 86m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:50:37.011 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (86m) 8m ago 86m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:50:37.011 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (86m) 8m ago 86m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:50:37.012 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (87m) 8m ago 88m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:50:37.343 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:50:37.344 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:50:37.344 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:50:37.344 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:50:37.344 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:50:37.345 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:50:37.345 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:50:37.345 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:50:37.345 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:50:37.345 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:50:37.346 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:50:37.346 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:50:37.347 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:50:37.347 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:50:37.348 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:50:37.348 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:50:37.348 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:50:37.350 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:50:37.350 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:50:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:50:36.699523+0000 mgr.smithi067.rdualw (mgr.24569) 2844 : audit [DBG] from='client.36034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:50:37.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:50:36.699523+0000 mgr.smithi067.rdualw (mgr.24569) 2844 : audit [DBG] from='client.36034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:50:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:50:36.985094+0000 mgr.smithi067.rdualw (mgr.24569) 2845 : audit [DBG] from='client.36038 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:50:38.602 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:37.213475+0000 mgr.smithi067.rdualw (mgr.24569) 2846 : cluster [DBG] pgmap v2454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:50:38.603 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:50:37.342273+0000 mon.smithi061 (mon.0) 754 : audit [DBG] from='client.? 172.21.15.61:0/2517125610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:50:38.604 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:50:36.985094+0000 mgr.smithi067.rdualw (mgr.24569) 2845 : audit [DBG] from='client.36038 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:50:38.605 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:37.213475+0000 mgr.smithi067.rdualw (mgr.24569) 2846 : cluster [DBG] pgmap v2454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:50:38.605 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:50:37.342273+0000 mon.smithi061 (mon.0) 754 : audit [DBG] from='client.? 172.21.15.61:0/2517125610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:50:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:39.214104+0000 mgr.smithi067.rdualw (mgr.24569) 2847 : cluster [DBG] pgmap v2455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:39.214104+0000 mgr.smithi067.rdualw (mgr.24569) 2847 : cluster [DBG] pgmap v2455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:41.215116+0000 mgr.smithi067.rdualw (mgr.24569) 2848 : cluster [DBG] pgmap v2456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:41.215116+0000 mgr.smithi067.rdualw (mgr.24569) 2848 : cluster [DBG] pgmap v2456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:43.215678+0000 mgr.smithi067.rdualw (mgr.24569) 2849 : cluster [DBG] pgmap v2457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:43.215678+0000 mgr.smithi067.rdualw (mgr.24569) 2849 : cluster [DBG] pgmap v2457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:45.216339+0000 mgr.smithi067.rdualw (mgr.24569) 2850 : cluster [DBG] pgmap v2458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:45.216339+0000 mgr.smithi067.rdualw (mgr.24569) 2850 : cluster [DBG] pgmap v2458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:47.217152+0000 mgr.smithi067.rdualw (mgr.24569) 2851 : cluster [DBG] pgmap v2459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:50:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:47.217152+0000 mgr.smithi067.rdualw (mgr.24569) 2851 : cluster [DBG] pgmap v2459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:50:49.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:50:48.332403+0000 mon.smithi067 (mon.1) 464 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:50:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:50:48.333902+0000 mon.smithi067 (mon.1) 465 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:50:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:50:48.334875+0000 mon.smithi067 (mon.1) 466 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:50:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:50:48.335776+0000 mgr.smithi067.rdualw (mgr.24569) 2852 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:50:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:50:48.754593+0000 mon.smithi061 (mon.0) 755 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:50:49.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:50:48.760426+0000 mon.smithi061 (mon.0) 756 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:50:49.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:50:48.332403+0000 mon.smithi067 (mon.1) 464 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:50:49.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:50:48.333902+0000 mon.smithi067 (mon.1) 465 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:50:49.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:50:48.334875+0000 mon.smithi067 (mon.1) 466 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:50:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:50:48.335776+0000 mgr.smithi067.rdualw (mgr.24569) 2852 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:50:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:50:48.754593+0000 mon.smithi061 (mon.0) 755 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:50:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:50:48.760426+0000 mon.smithi061 (mon.0) 756 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:50:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:49.217854+0000 mgr.smithi067.rdualw (mgr.24569) 2853 : cluster [DBG] pgmap v2460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:49.217854+0000 mgr.smithi067.rdualw (mgr.24569) 2853 : cluster [DBG] pgmap v2460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:51.218719+0000 mgr.smithi067.rdualw (mgr.24569) 2854 : cluster [DBG] pgmap v2461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:51.218719+0000 mgr.smithi067.rdualw (mgr.24569) 2854 : cluster [DBG] pgmap v2461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:53.219214+0000 mgr.smithi067.rdualw (mgr.24569) 2855 : cluster [DBG] pgmap v2462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:53.219214+0000 mgr.smithi067.rdualw (mgr.24569) 2855 : cluster [DBG] pgmap v2462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:55.219865+0000 mgr.smithi067.rdualw (mgr.24569) 2856 : cluster [DBG] pgmap v2463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:55.219865+0000 mgr.smithi067.rdualw (mgr.24569) 2856 : cluster [DBG] pgmap v2463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:50:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:50:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:57.220686+0000 mgr.smithi067.rdualw (mgr.24569) 2857 : cluster [DBG] pgmap v2464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:50:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:50:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:57.220686+0000 mgr.smithi067.rdualw (mgr.24569) 2857 : cluster [DBG] pgmap v2464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:51:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:50:59.221191+0000 mgr.smithi067.rdualw (mgr.24569) 2858 : cluster [DBG] pgmap v2465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:50:59.221191+0000 mgr.smithi067.rdualw (mgr.24569) 2858 : cluster [DBG] pgmap v2465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:02.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:01.222138+0000 mgr.smithi067.rdualw (mgr.24569) 2859 : cluster [DBG] pgmap v2466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:01.222138+0000 mgr.smithi067.rdualw (mgr.24569) 2859 : cluster [DBG] pgmap v2466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:03.222646+0000 mgr.smithi067.rdualw (mgr.24569) 2860 : cluster [DBG] pgmap v2467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:03.222646+0000 mgr.smithi067.rdualw (mgr.24569) 2860 : cluster [DBG] pgmap v2467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:05.223276+0000 mgr.smithi067.rdualw (mgr.24569) 2861 : cluster [DBG] pgmap v2468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:05.223276+0000 mgr.smithi067.rdualw (mgr.24569) 2861 : cluster [DBG] pgmap v2468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:07.651 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:51:07.944 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:51:07.944 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (88m) 9m ago 89m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:51:07.945 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (81m) 9m ago 89m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:51:07.945 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (81m) 9m ago 89m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:51:07.945 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (88m) 9m ago 89m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:51:07.946 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (81m) 9m ago 85m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:51:07.946 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (81m) 9m ago 85m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:51:07.946 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (82m) 9m ago 90m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:51:07.946 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (82m) 9m ago 89m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:51:07.947 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (82m) 9m ago 91m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:51:07.947 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (82m) 9m ago 89m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:51:07.947 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (83m) 9m ago 83m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:51:07.947 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (83m) 9m ago 83m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:51:07.948 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (89m) 9m ago 89m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:51:07.948 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (88m) 9m ago 88m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:51:07.948 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (72m) 9m ago 88m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:51:07.948 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (88m) 9m ago 88m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:51:07.948 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (88m) 9m ago 88m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:51:07.949 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (87m) 9m ago 87m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:51:07.949 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (87m) 9m ago 87m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:51:07.949 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (87m) 9m ago 87m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:51:07.949 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (87m) 9m ago 87m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:51:07.949 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (86m) 9m ago 86m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:51:07.950 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (88m) 9m ago 89m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:51:08.286 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:51:08.286 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:51:08.286 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:51:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:51:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:51:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:51:08.287 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:51:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:51:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:51:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:51:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:51:08.288 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:51:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:51:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:51:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:51:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:51:08.289 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:51:08.290 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:51:08.290 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:51:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:07.224322+0000 mgr.smithi067.rdualw (mgr.24569) 2862 : cluster [DBG] pgmap v2469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:51:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:07.637958+0000 mgr.smithi067.rdualw (mgr.24569) 2863 : audit [DBG] from='client.36046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:51:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:07.224322+0000 mgr.smithi067.rdualw (mgr.24569) 2862 : cluster [DBG] pgmap v2469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:51:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:07.637958+0000 mgr.smithi067.rdualw (mgr.24569) 2863 : audit [DBG] from='client.36046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:51:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:07.926617+0000 mgr.smithi067.rdualw (mgr.24569) 2864 : audit [DBG] from='client.36050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:51:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:08.284674+0000 mon.smithi061 (mon.0) 757 : audit [DBG] from='client.? 172.21.15.61:0/1853062136' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:51:09.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:07.926617+0000 mgr.smithi067.rdualw (mgr.24569) 2864 : audit [DBG] from='client.36050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:51:09.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:08.284674+0000 mon.smithi061 (mon.0) 757 : audit [DBG] from='client.? 172.21.15.61:0/1853062136' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:51:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:09.224935+0000 mgr.smithi067.rdualw (mgr.24569) 2865 : cluster [DBG] pgmap v2470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:09.224935+0000 mgr.smithi067.rdualw (mgr.24569) 2865 : cluster [DBG] pgmap v2470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:11.225842+0000 mgr.smithi067.rdualw (mgr.24569) 2866 : cluster [DBG] pgmap v2471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:11.225842+0000 mgr.smithi067.rdualw (mgr.24569) 2866 : cluster [DBG] pgmap v2471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:13.226507+0000 mgr.smithi067.rdualw (mgr.24569) 2867 : cluster [DBG] pgmap v2472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:13.226507+0000 mgr.smithi067.rdualw (mgr.24569) 2867 : cluster [DBG] pgmap v2472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:15.227091+0000 mgr.smithi067.rdualw (mgr.24569) 2868 : cluster [DBG] pgmap v2473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:15.227091+0000 mgr.smithi067.rdualw (mgr.24569) 2868 : cluster [DBG] pgmap v2473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:17.228078+0000 mgr.smithi067.rdualw (mgr.24569) 2869 : cluster [DBG] pgmap v2474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:51:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:17.228078+0000 mgr.smithi067.rdualw (mgr.24569) 2869 : cluster [DBG] pgmap v2474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:51:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:19.228775+0000 mgr.smithi067.rdualw (mgr.24569) 2870 : cluster [DBG] pgmap v2475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:19.228775+0000 mgr.smithi067.rdualw (mgr.24569) 2870 : cluster [DBG] pgmap v2475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:21.229726+0000 mgr.smithi067.rdualw (mgr.24569) 2871 : cluster [DBG] pgmap v2476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:21.229726+0000 mgr.smithi067.rdualw (mgr.24569) 2871 : cluster [DBG] pgmap v2476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:23.230269+0000 mgr.smithi067.rdualw (mgr.24569) 2872 : cluster [DBG] pgmap v2477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:23.230269+0000 mgr.smithi067.rdualw (mgr.24569) 2872 : cluster [DBG] pgmap v2477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:25.230882+0000 mgr.smithi067.rdualw (mgr.24569) 2873 : cluster [DBG] pgmap v2478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:25.230882+0000 mgr.smithi067.rdualw (mgr.24569) 2873 : cluster [DBG] pgmap v2478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:27.231851+0000 mgr.smithi067.rdualw (mgr.24569) 2874 : cluster [DBG] pgmap v2479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:51:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:27.231851+0000 mgr.smithi067.rdualw (mgr.24569) 2874 : cluster [DBG] pgmap v2479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:51:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:29.232653+0000 mgr.smithi067.rdualw (mgr.24569) 2875 : cluster [DBG] pgmap v2480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:29.232653+0000 mgr.smithi067.rdualw (mgr.24569) 2875 : cluster [DBG] pgmap v2480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:31.233524+0000 mgr.smithi067.rdualw (mgr.24569) 2876 : cluster [DBG] pgmap v2481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:31.233524+0000 mgr.smithi067.rdualw (mgr.24569) 2876 : cluster [DBG] pgmap v2481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:33.234036+0000 mgr.smithi067.rdualw (mgr.24569) 2877 : cluster [DBG] pgmap v2482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:33.234036+0000 mgr.smithi067.rdualw (mgr.24569) 2877 : cluster [DBG] pgmap v2482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:34.867295+0000 mon.smithi067 (mon.1) 467 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:51:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:34.867444+0000 mon.smithi061 (mon.0) 758 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:51:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:34.867571+0000 mon.smithi067 (mon.1) 468 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:51:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:34.867787+0000 mon.smithi061 (mon.0) 759 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:51:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:34.867295+0000 mon.smithi067 (mon.1) 467 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:51:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:34.867444+0000 mon.smithi061 (mon.0) 758 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:51:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:34.867571+0000 mon.smithi067 (mon.1) 468 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:51:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:34.867787+0000 mon.smithi061 (mon.0) 759 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:51:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:35.234591+0000 mgr.smithi067.rdualw (mgr.24569) 2878 : cluster [DBG] pgmap v2483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:35.234591+0000 mgr.smithi067.rdualw (mgr.24569) 2878 : cluster [DBG] pgmap v2483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:37.235695+0000 mgr.smithi067.rdualw (mgr.24569) 2879 : cluster [DBG] pgmap v2484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:51:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:37.235695+0000 mgr.smithi067.rdualw (mgr.24569) 2879 : cluster [DBG] pgmap v2484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:51:38.594 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:51:38.887 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:51:38.888 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (89m) 9m ago 90m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:51:38.888 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (81m) 9m ago 90m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:51:38.888 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (81m) 9m ago 89m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:51:38.889 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (89m) 9m ago 90m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:51:38.889 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (82m) 9m ago 85m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:51:38.889 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (82m) 9m ago 85m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:51:38.889 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (83m) 9m ago 91m 448M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:51:38.890 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (82m) 9m ago 89m 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:51:38.890 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (82m) 9m ago 91m 549M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:51:38.890 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (82m) 9m ago 89m 325M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:51:38.892 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (83m) 9m ago 83m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:51:38.892 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (83m) 9m ago 83m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:51:38.892 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (90m) 9m ago 90m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:51:38.892 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (89m) 9m ago 89m 18.3M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:51:38.893 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (72m) 9m ago 89m 593M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:51:38.893 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (88m) 9m ago 88m 1398M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:51:38.893 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (88m) 9m ago 88m 844M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:51:38.893 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (88m) 9m ago 88m 1516M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:51:38.893 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (88m) 9m ago 88m 1402M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:51:38.894 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (87m) 9m ago 87m 1646M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:51:38.894 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (87m) 9m ago 87m 1289M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:51:38.894 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (87m) 9m ago 87m 2122M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:51:38.894 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (88m) 9m ago 89m 66.7M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:51:39.230 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:51:39.230 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:51:39.231 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:51:39.231 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:51:39.231 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:51:39.231 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:51:39.232 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:51:39.232 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:51:39.232 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:51:39.232 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:51:39.233 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:51:39.233 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:51:39.234 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:51:39.234 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:51:39.234 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:51:39.234 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:51:39.235 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:51:39.235 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:51:39.235 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:51:39.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:38.581452+0000 mgr.smithi067.rdualw (mgr.24569) 2880 : audit [DBG] from='client.36058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:51:39.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:39.228612+0000 mon.smithi061 (mon.0) 760 : audit [DBG] from='client.? 172.21.15.61:0/3646616659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:51:39.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:38.581452+0000 mgr.smithi067.rdualw (mgr.24569) 2880 : audit [DBG] from='client.36058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:51:39.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:39.228612+0000 mon.smithi061 (mon.0) 760 : audit [DBG] from='client.? 172.21.15.61:0/3646616659' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:51:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:38.870414+0000 mgr.smithi067.rdualw (mgr.24569) 2881 : audit [DBG] from='client.36062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:51:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:39.236283+0000 mgr.smithi067.rdualw (mgr.24569) 2882 : cluster [DBG] pgmap v2485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:38.870414+0000 mgr.smithi067.rdualw (mgr.24569) 2881 : audit [DBG] from='client.36062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:51:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:39.236283+0000 mgr.smithi067.rdualw (mgr.24569) 2882 : cluster [DBG] pgmap v2485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:41.237173+0000 mgr.smithi067.rdualw (mgr.24569) 2883 : cluster [DBG] pgmap v2486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:41.237173+0000 mgr.smithi067.rdualw (mgr.24569) 2883 : cluster [DBG] pgmap v2486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:43.237775+0000 mgr.smithi067.rdualw (mgr.24569) 2884 : cluster [DBG] pgmap v2487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:44.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:43.237775+0000 mgr.smithi067.rdualw (mgr.24569) 2884 : cluster [DBG] pgmap v2487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:45.238397+0000 mgr.smithi067.rdualw (mgr.24569) 2885 : cluster [DBG] pgmap v2488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:45.238397+0000 mgr.smithi067.rdualw (mgr.24569) 2885 : cluster [DBG] pgmap v2488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:47.239495+0000 mgr.smithi067.rdualw (mgr.24569) 2886 : cluster [DBG] pgmap v2489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:51:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:47.239495+0000 mgr.smithi067.rdualw (mgr.24569) 2886 : cluster [DBG] pgmap v2489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:51:49.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:48.765202+0000 mon.smithi067 (mon.1) 469 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:51:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:48.766651+0000 mon.smithi067 (mon.1) 470 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:51:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:48.767681+0000 mon.smithi067 (mon.1) 471 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:51:49.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:48.765202+0000 mon.smithi067 (mon.1) 469 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:51:49.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:48.766651+0000 mon.smithi067 (mon.1) 470 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:51:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:48.767681+0000 mon.smithi067 (mon.1) 471 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:51:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:51:48.768530+0000 mgr.smithi067.rdualw (mgr.24569) 2887 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:51:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:49.240016+0000 mgr.smithi067.rdualw (mgr.24569) 2888 : cluster [DBG] pgmap v2490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:51:48.768530+0000 mgr.smithi067.rdualw (mgr.24569) 2887 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:51:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:49.240016+0000 mgr.smithi067.rdualw (mgr.24569) 2888 : cluster [DBG] pgmap v2490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:51.240820+0000 mgr.smithi067.rdualw (mgr.24569) 2889 : cluster [DBG] pgmap v2491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:51.240820+0000 mgr.smithi067.rdualw (mgr.24569) 2889 : cluster [DBG] pgmap v2491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:53.241416+0000 mgr.smithi067.rdualw (mgr.24569) 2890 : cluster [DBG] pgmap v2492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:53.465573+0000 mon.smithi061 (mon.0) 761 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:51:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:53.871174+0000 mon.smithi067 (mon.1) 472 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:51:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:53.871464+0000 mon.smithi061 (mon.0) 762 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:51:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:53.241416+0000 mgr.smithi067.rdualw (mgr.24569) 2890 : cluster [DBG] pgmap v2492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:53.465573+0000 mon.smithi061 (mon.0) 761 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:51:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:53.871174+0000 mon.smithi067 (mon.1) 472 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:51:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:53.871464+0000 mon.smithi061 (mon.0) 762 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:51:56.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:55.242158+0000 mgr.smithi067.rdualw (mgr.24569) 2891 : cluster [DBG] pgmap v2493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:55.242158+0000 mgr.smithi067.rdualw (mgr.24569) 2891 : cluster [DBG] pgmap v2493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:51:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:56.352930+0000 mon.smithi061 (mon.0) 763 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:51:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:56.747774+0000 mon.smithi067 (mon.1) 473 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:51:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:56.747931+0000 mon.smithi061 (mon.0) 764 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:51:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:56.752605+0000 mon.smithi061 (mon.0) 765 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:51:57.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:51:56.759842+0000 mon.smithi061 (mon.0) 766 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:51:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:56.352930+0000 mon.smithi061 (mon.0) 763 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:51:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:56.747774+0000 mon.smithi067 (mon.1) 473 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:51:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:56.747931+0000 mon.smithi061 (mon.0) 764 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T16:51:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:56.752605+0000 mon.smithi061 (mon.0) 765 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:51:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:51:56.759842+0000 mon.smithi061 (mon.0) 766 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:51:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:51:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:57.243153+0000 mgr.smithi067.rdualw (mgr.24569) 2892 : cluster [DBG] pgmap v2494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:51:58.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:51:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:57.243153+0000 mgr.smithi067.rdualw (mgr.24569) 2892 : cluster [DBG] pgmap v2494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:52:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:51:59.243903+0000 mgr.smithi067.rdualw (mgr.24569) 2893 : cluster [DBG] pgmap v2495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:51:59.243903+0000 mgr.smithi067.rdualw (mgr.24569) 2893 : cluster [DBG] pgmap v2495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:01.244987+0000 mgr.smithi067.rdualw (mgr.24569) 2894 : cluster [DBG] pgmap v2496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:01.244987+0000 mgr.smithi067.rdualw (mgr.24569) 2894 : cluster [DBG] pgmap v2496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:03.245774+0000 mgr.smithi067.rdualw (mgr.24569) 2895 : cluster [DBG] pgmap v2497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:03.245774+0000 mgr.smithi067.rdualw (mgr.24569) 2895 : cluster [DBG] pgmap v2497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:05.246459+0000 mgr.smithi067.rdualw (mgr.24569) 2896 : cluster [DBG] pgmap v2498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:05.246459+0000 mgr.smithi067.rdualw (mgr.24569) 2896 : cluster [DBG] pgmap v2498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:07.247398+0000 mgr.smithi067.rdualw (mgr.24569) 2897 : cluster [DBG] pgmap v2499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:52:08.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:07.247398+0000 mgr.smithi067.rdualw (mgr.24569) 2897 : cluster [DBG] pgmap v2499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:52:09.540 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:52:09.855 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:52:09.856 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (89m) 13s ago 90m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:52:09.856 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (82m) 13s ago 90m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:52:09.856 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (82m) 16s ago 90m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:52:09.856 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (89m) 13s ago 90m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:52:09.857 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (82m) 13s ago 86m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:52:09.857 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (82m) 16s ago 86m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:52:09.857 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (83m) 13s ago 91m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:52:09.857 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (83m) 16s ago 90m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:52:09.857 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (83m) 13s ago 92m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:52:09.858 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (83m) 16s ago 90m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:52:09.858 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (84m) 13s ago 84m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:52:09.858 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (84m) 16s ago 84m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:52:09.858 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (90m) 13s ago 90m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:52:09.859 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (89m) 16s ago 89m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:52:09.859 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (73m) 13s ago 89m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:52:09.859 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (89m) 13s ago 89m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:52:09.860 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (89m) 13s ago 89m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:52:09.860 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (88m) 13s ago 88m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:52:09.860 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (88m) 16s ago 88m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:52:09.860 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (88m) 16s ago 88m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:52:09.861 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (88m) 16s ago 88m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:52:09.861 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (87m) 16s ago 87m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:52:09.861 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (89m) 13s ago 90m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:52:10.200 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:52:10.200 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:52:10.201 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:52:10.201 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:52:10.201 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:52:10.201 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:52:10.202 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:52:10.202 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:52:10.202 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:52:10.202 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:52:10.203 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:52:10.203 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:52:10.203 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:52:10.204 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:52:10.204 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:52:10.204 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:52:10.204 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:52:10.205 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:52:10.205 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:52:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:09.248146+0000 mgr.smithi067.rdualw (mgr.24569) 2898 : cluster [DBG] pgmap v2500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:52:09.526180+0000 mgr.smithi067.rdualw (mgr.24569) 2899 : audit [DBG] from='client.36070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:52:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:52:10.198794+0000 mon.smithi061 (mon.0) 767 : audit [DBG] from='client.? 172.21.15.61:0/1210991706' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:52:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:09.248146+0000 mgr.smithi067.rdualw (mgr.24569) 2898 : cluster [DBG] pgmap v2500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:52:09.526180+0000 mgr.smithi067.rdualw (mgr.24569) 2899 : audit [DBG] from='client.36070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:52:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:52:10.198794+0000 mon.smithi061 (mon.0) 767 : audit [DBG] from='client.? 172.21.15.61:0/1210991706' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:52:11.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:52:09.838104+0000 mgr.smithi067.rdualw (mgr.24569) 2900 : audit [DBG] from='client.36074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:52:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:52:09.838104+0000 mgr.smithi067.rdualw (mgr.24569) 2900 : audit [DBG] from='client.36074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:52:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:11.249014+0000 mgr.smithi067.rdualw (mgr.24569) 2901 : cluster [DBG] pgmap v2501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:11.249014+0000 mgr.smithi067.rdualw (mgr.24569) 2901 : cluster [DBG] pgmap v2501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:13.249596+0000 mgr.smithi067.rdualw (mgr.24569) 2902 : cluster [DBG] pgmap v2502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:13.249596+0000 mgr.smithi067.rdualw (mgr.24569) 2902 : cluster [DBG] pgmap v2502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:15.250197+0000 mgr.smithi067.rdualw (mgr.24569) 2903 : cluster [DBG] pgmap v2503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:15.250197+0000 mgr.smithi067.rdualw (mgr.24569) 2903 : cluster [DBG] pgmap v2503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:17.251065+0000 mgr.smithi067.rdualw (mgr.24569) 2904 : cluster [DBG] pgmap v2504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:52:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:17.251065+0000 mgr.smithi067.rdualw (mgr.24569) 2904 : cluster [DBG] pgmap v2504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:52:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:19.251670+0000 mgr.smithi067.rdualw (mgr.24569) 2905 : cluster [DBG] pgmap v2505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:19.251670+0000 mgr.smithi067.rdualw (mgr.24569) 2905 : cluster [DBG] pgmap v2505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:21.252481+0000 mgr.smithi067.rdualw (mgr.24569) 2906 : cluster [DBG] pgmap v2506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:21.252481+0000 mgr.smithi067.rdualw (mgr.24569) 2906 : cluster [DBG] pgmap v2506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:23.253173+0000 mgr.smithi067.rdualw (mgr.24569) 2907 : cluster [DBG] pgmap v2507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:23.253173+0000 mgr.smithi067.rdualw (mgr.24569) 2907 : cluster [DBG] pgmap v2507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:25.253958+0000 mgr.smithi067.rdualw (mgr.24569) 2908 : cluster [DBG] pgmap v2508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:25.253958+0000 mgr.smithi067.rdualw (mgr.24569) 2908 : cluster [DBG] pgmap v2508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:27.254908+0000 mgr.smithi067.rdualw (mgr.24569) 2909 : cluster [DBG] pgmap v2509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:52:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:27.254908+0000 mgr.smithi067.rdualw (mgr.24569) 2909 : cluster [DBG] pgmap v2509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:52:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:29.255596+0000 mgr.smithi067.rdualw (mgr.24569) 2910 : cluster [DBG] pgmap v2510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:29.255596+0000 mgr.smithi067.rdualw (mgr.24569) 2910 : cluster [DBG] pgmap v2510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:31.256577+0000 mgr.smithi067.rdualw (mgr.24569) 2911 : cluster [DBG] pgmap v2511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:31.256577+0000 mgr.smithi067.rdualw (mgr.24569) 2911 : cluster [DBG] pgmap v2511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:33.257195+0000 mgr.smithi067.rdualw (mgr.24569) 2912 : cluster [DBG] pgmap v2512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:33.257195+0000 mgr.smithi067.rdualw (mgr.24569) 2912 : cluster [DBG] pgmap v2512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:52:34.872825+0000 mon.smithi067 (mon.1) 474 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:52:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:52:34.873059+0000 mon.smithi061 (mon.0) 768 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:52:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:52:34.873081+0000 mon.smithi067 (mon.1) 475 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:52:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:52:34.873307+0000 mon.smithi061 (mon.0) 769 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:52:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:52:34.872825+0000 mon.smithi067 (mon.1) 474 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:52:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:52:34.873059+0000 mon.smithi061 (mon.0) 768 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:52:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:52:34.873081+0000 mon.smithi067 (mon.1) 475 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:52:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:52:34.873307+0000 mon.smithi061 (mon.0) 769 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:52:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:35.257759+0000 mgr.smithi067.rdualw (mgr.24569) 2913 : cluster [DBG] pgmap v2513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:52:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:35.257759+0000 mgr.smithi067.rdualw (mgr.24569) 2913 : cluster [DBG] pgmap v2513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:52:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:37.258640+0000 mgr.smithi067.rdualw (mgr.24569) 2914 : cluster [DBG] pgmap v2514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:52:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:37.258640+0000 mgr.smithi067.rdualw (mgr.24569) 2914 : cluster [DBG] pgmap v2514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:52:40.600 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:52:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:39.259332+0000 mgr.smithi067.rdualw (mgr.24569) 2915 : cluster [DBG] pgmap v2515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:39.259332+0000 mgr.smithi067.rdualw (mgr.24569) 2915 : cluster [DBG] pgmap v2515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:40.891 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:52:40.892 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (90m) 44s ago 91m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:52:40.892 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (82m) 44s ago 91m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:52:40.892 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (82m) 47s ago 90m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:52:40.892 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (90m) 44s ago 91m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:52:40.893 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (83m) 44s ago 86m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:52:40.893 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (83m) 47s ago 86m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:52:40.893 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (84m) 44s ago 92m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:52:40.893 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (84m) 47s ago 90m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:52:40.894 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (83m) 44s ago 92m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:52:40.894 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (83m) 47s ago 90m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:52:40.894 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (84m) 44s ago 84m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:52:40.894 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (84m) 47s ago 84m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:52:40.895 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (91m) 44s ago 91m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:52:40.895 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (90m) 47s ago 90m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:52:40.895 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (73m) 44s ago 90m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:52:40.895 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (89m) 44s ago 89m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:52:40.896 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (89m) 44s ago 89m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:52:40.896 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (89m) 44s ago 89m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:52:40.896 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (89m) 47s ago 89m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:52:40.897 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (88m) 47s ago 88m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:52:40.897 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (88m) 47s ago 88m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:52:40.897 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (88m) 47s ago 88m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:52:40.897 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (90m) 44s ago 90m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:52:41.234 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:52:41.234 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:52:41.235 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:52:41.235 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:52:41.235 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:52:41.235 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:52:41.235 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:52:41.236 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:52:41.236 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:52:41.236 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:52:41.236 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:52:41.237 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:52:41.237 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:52:41.237 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:52:41.237 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:52:41.237 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:52:41.238 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:52:41.238 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:52:41.238 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:52:41.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:52:40.584779+0000 mgr.smithi067.rdualw (mgr.24569) 2916 : audit [DBG] from='client.36082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:52:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:52:41.232783+0000 mon.smithi061 (mon.0) 770 : audit [DBG] from='client.? 172.21.15.61:0/2184867104' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:52:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:52:40.584779+0000 mgr.smithi067.rdualw (mgr.24569) 2916 : audit [DBG] from='client.36082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:52:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:52:41.232783+0000 mon.smithi061 (mon.0) 770 : audit [DBG] from='client.? 172.21.15.61:0/2184867104' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:52:42.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:52:40.874282+0000 mgr.smithi067.rdualw (mgr.24569) 2917 : audit [DBG] from='client.36086 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:52:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:41.260243+0000 mgr.smithi067.rdualw (mgr.24569) 2918 : cluster [DBG] pgmap v2516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:52:40.874282+0000 mgr.smithi067.rdualw (mgr.24569) 2917 : audit [DBG] from='client.36086 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:52:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:41.260243+0000 mgr.smithi067.rdualw (mgr.24569) 2918 : cluster [DBG] pgmap v2516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:43.260744+0000 mgr.smithi067.rdualw (mgr.24569) 2919 : cluster [DBG] pgmap v2517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:43.260744+0000 mgr.smithi067.rdualw (mgr.24569) 2919 : cluster [DBG] pgmap v2517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:45.261519+0000 mgr.smithi067.rdualw (mgr.24569) 2920 : cluster [DBG] pgmap v2518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:52:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:45.261519+0000 mgr.smithi067.rdualw (mgr.24569) 2920 : cluster [DBG] pgmap v2518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:52:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:47.262321+0000 mgr.smithi067.rdualw (mgr.24569) 2921 : cluster [DBG] pgmap v2519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:47.262321+0000 mgr.smithi067.rdualw (mgr.24569) 2921 : cluster [DBG] pgmap v2519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:49.263062+0000 mgr.smithi067.rdualw (mgr.24569) 2922 : cluster [DBG] pgmap v2520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:49.263062+0000 mgr.smithi067.rdualw (mgr.24569) 2922 : cluster [DBG] pgmap v2520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:51.263984+0000 mgr.smithi067.rdualw (mgr.24569) 2923 : cluster [DBG] pgmap v2521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:51.263984+0000 mgr.smithi067.rdualw (mgr.24569) 2923 : cluster [DBG] pgmap v2521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:53.264592+0000 mgr.smithi067.rdualw (mgr.24569) 2924 : cluster [DBG] pgmap v2522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:53.264592+0000 mgr.smithi067.rdualw (mgr.24569) 2924 : cluster [DBG] pgmap v2522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:55.265331+0000 mgr.smithi067.rdualw (mgr.24569) 2925 : cluster [DBG] pgmap v2523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:52:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:55.265331+0000 mgr.smithi067.rdualw (mgr.24569) 2925 : cluster [DBG] pgmap v2523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:52:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:52:56.764381+0000 mon.smithi067 (mon.1) 476 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:52:57.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:52:56.765874+0000 mon.smithi067 (mon.1) 477 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:52:57.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:52:56.767000+0000 mon.smithi067 (mon.1) 478 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:52:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:52:56.764381+0000 mon.smithi067 (mon.1) 476 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:52:57.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:52:56.765874+0000 mon.smithi067 (mon.1) 477 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:52:57.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:52:56.767000+0000 mon.smithi067 (mon.1) 478 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:52:58.521 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:52:56.767963+0000 mgr.smithi067.rdualw (mgr.24569) 2926 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:52:58.522 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:52:57.186567+0000 mon.smithi061 (mon.0) 771 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:52:58.522 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:52:57.192605+0000 mon.smithi061 (mon.0) 772 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:52:58.523 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:52:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:57.266155+0000 mgr.smithi067.rdualw (mgr.24569) 2927 : cluster [DBG] pgmap v2524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:52:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:52:56.767963+0000 mgr.smithi067.rdualw (mgr.24569) 2926 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:52:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:52:57.186567+0000 mon.smithi061 (mon.0) 771 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:52:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:52:57.192605+0000 mon.smithi061 (mon.0) 772 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:52:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:52:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:57.266155+0000 mgr.smithi067.rdualw (mgr.24569) 2927 : cluster [DBG] pgmap v2524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:52:59.266732+0000 mgr.smithi067.rdualw (mgr.24569) 2928 : cluster [DBG] pgmap v2525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:52:59.266732+0000 mgr.smithi067.rdualw (mgr.24569) 2928 : cluster [DBG] pgmap v2525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:01.267650+0000 mgr.smithi067.rdualw (mgr.24569) 2929 : cluster [DBG] pgmap v2526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:01.267650+0000 mgr.smithi067.rdualw (mgr.24569) 2929 : cluster [DBG] pgmap v2526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:03.268279+0000 mgr.smithi067.rdualw (mgr.24569) 2930 : cluster [DBG] pgmap v2527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:03.268279+0000 mgr.smithi067.rdualw (mgr.24569) 2930 : cluster [DBG] pgmap v2527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:05.268939+0000 mgr.smithi067.rdualw (mgr.24569) 2931 : cluster [DBG] pgmap v2528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:53:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:05.268939+0000 mgr.smithi067.rdualw (mgr.24569) 2931 : cluster [DBG] pgmap v2528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:53:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:07.269692+0000 mgr.smithi067.rdualw (mgr.24569) 2932 : cluster [DBG] pgmap v2529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:08.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:07.269692+0000 mgr.smithi067.rdualw (mgr.24569) 2932 : cluster [DBG] pgmap v2529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:09.270451+0000 mgr.smithi067.rdualw (mgr.24569) 2933 : cluster [DBG] pgmap v2530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:09.270451+0000 mgr.smithi067.rdualw (mgr.24569) 2933 : cluster [DBG] pgmap v2530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:11.543 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:53:11.917 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:53:11.917 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (90m) 75s ago 91m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:53:11.918 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (83m) 75s ago 91m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:53:11.918 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (83m) 78s ago 91m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:53:11.918 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (90m) 75s ago 91m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:53:11.918 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (83m) 75s ago 87m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:53:11.919 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (83m) 78s ago 87m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:53:11.919 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (84m) 75s ago 92m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:53:11.919 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (84m) 78s ago 91m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:53:11.919 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (84m) 75s ago 93m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:53:11.919 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (84m) 78s ago 91m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:53:11.920 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (85m) 75s ago 85m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:53:11.920 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (85m) 78s ago 85m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:53:11.920 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (91m) 75s ago 91m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:53:11.920 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (91m) 78s ago 90m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:53:11.921 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (74m) 75s ago 90m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:53:11.921 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (90m) 75s ago 90m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:53:11.921 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (90m) 75s ago 90m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:53:11.921 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (89m) 75s ago 89m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:53:11.921 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (89m) 78s ago 89m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:53:11.922 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (89m) 78s ago 89m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:53:11.922 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (89m) 78s ago 89m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:53:11.922 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (88m) 78s ago 88m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:53:11.922 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (90m) 75s ago 91m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:53:12.256 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:53:12.257 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:53:12.257 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:53:12.257 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:53:12.258 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:53:12.258 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:53:12.258 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:53:12.258 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:53:12.258 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:53:12.259 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:53:12.259 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:53:12.259 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:53:12.259 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:53:12.260 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:53:12.260 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:53:12.260 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:53:12.260 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:53:12.261 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:53:12.261 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:53:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:11.271362+0000 mgr.smithi067.rdualw (mgr.24569) 2934 : cluster [DBG] pgmap v2531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:12.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:53:11.529497+0000 mgr.smithi067.rdualw (mgr.24569) 2935 : audit [DBG] from='client.36094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:53:12.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:53:12.255271+0000 mon.smithi061 (mon.0) 773 : audit [DBG] from='client.? 172.21.15.61:0/1718101910' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:53:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:11.271362+0000 mgr.smithi067.rdualw (mgr.24569) 2934 : cluster [DBG] pgmap v2531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:53:11.529497+0000 mgr.smithi067.rdualw (mgr.24569) 2935 : audit [DBG] from='client.36094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:53:12.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:53:12.255271+0000 mon.smithi061 (mon.0) 773 : audit [DBG] from='client.? 172.21.15.61:0/1718101910' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:53:13.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:53:11.899867+0000 mgr.smithi067.rdualw (mgr.24569) 2936 : audit [DBG] from='client.36098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:53:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:53:11.899867+0000 mgr.smithi067.rdualw (mgr.24569) 2936 : audit [DBG] from='client.36098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:53:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:13.271854+0000 mgr.smithi067.rdualw (mgr.24569) 2937 : cluster [DBG] pgmap v2532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:13.271854+0000 mgr.smithi067.rdualw (mgr.24569) 2937 : cluster [DBG] pgmap v2532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:15.272496+0000 mgr.smithi067.rdualw (mgr.24569) 2938 : cluster [DBG] pgmap v2533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:53:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:15.272496+0000 mgr.smithi067.rdualw (mgr.24569) 2938 : cluster [DBG] pgmap v2533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:53:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:17.273412+0000 mgr.smithi067.rdualw (mgr.24569) 2939 : cluster [DBG] pgmap v2534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:17.273412+0000 mgr.smithi067.rdualw (mgr.24569) 2939 : cluster [DBG] pgmap v2534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:19.273941+0000 mgr.smithi067.rdualw (mgr.24569) 2940 : cluster [DBG] pgmap v2535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:19.273941+0000 mgr.smithi067.rdualw (mgr.24569) 2940 : cluster [DBG] pgmap v2535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:21.274861+0000 mgr.smithi067.rdualw (mgr.24569) 2941 : cluster [DBG] pgmap v2536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:21.274861+0000 mgr.smithi067.rdualw (mgr.24569) 2941 : cluster [DBG] pgmap v2536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:23.275466+0000 mgr.smithi067.rdualw (mgr.24569) 2942 : cluster [DBG] pgmap v2537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:23.275466+0000 mgr.smithi067.rdualw (mgr.24569) 2942 : cluster [DBG] pgmap v2537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:25.276168+0000 mgr.smithi067.rdualw (mgr.24569) 2943 : cluster [DBG] pgmap v2538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:53:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:25.276168+0000 mgr.smithi067.rdualw (mgr.24569) 2943 : cluster [DBG] pgmap v2538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:53:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:27.276975+0000 mgr.smithi067.rdualw (mgr.24569) 2944 : cluster [DBG] pgmap v2539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:27.276975+0000 mgr.smithi067.rdualw (mgr.24569) 2944 : cluster [DBG] pgmap v2539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:29.277634+0000 mgr.smithi067.rdualw (mgr.24569) 2945 : cluster [DBG] pgmap v2540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:29.277634+0000 mgr.smithi067.rdualw (mgr.24569) 2945 : cluster [DBG] pgmap v2540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:31.278775+0000 mgr.smithi067.rdualw (mgr.24569) 2946 : cluster [DBG] pgmap v2541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:31.278775+0000 mgr.smithi067.rdualw (mgr.24569) 2946 : cluster [DBG] pgmap v2541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:33.279579+0000 mgr.smithi067.rdualw (mgr.24569) 2947 : cluster [DBG] pgmap v2542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:33.279579+0000 mgr.smithi067.rdualw (mgr.24569) 2947 : cluster [DBG] pgmap v2542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:53:34.878336+0000 mon.smithi067 (mon.1) 479 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:53:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:53:34.878525+0000 mon.smithi061 (mon.0) 774 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:53:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:53:34.878734+0000 mon.smithi067 (mon.1) 480 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:53:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:53:34.878825+0000 mon.smithi061 (mon.0) 775 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:53:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:53:34.878336+0000 mon.smithi067 (mon.1) 479 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:53:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:53:34.878525+0000 mon.smithi061 (mon.0) 774 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:53:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:53:34.878734+0000 mon.smithi067 (mon.1) 480 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:53:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:53:34.878825+0000 mon.smithi061 (mon.0) 775 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:53:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:35.280337+0000 mgr.smithi067.rdualw (mgr.24569) 2948 : cluster [DBG] pgmap v2543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:53:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:35.280337+0000 mgr.smithi067.rdualw (mgr.24569) 2948 : cluster [DBG] pgmap v2543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:53:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:37.281186+0000 mgr.smithi067.rdualw (mgr.24569) 2949 : cluster [DBG] pgmap v2544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:37.281186+0000 mgr.smithi067.rdualw (mgr.24569) 2949 : cluster [DBG] pgmap v2544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:39.281812+0000 mgr.smithi067.rdualw (mgr.24569) 2950 : cluster [DBG] pgmap v2545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:39.281812+0000 mgr.smithi067.rdualw (mgr.24569) 2950 : cluster [DBG] pgmap v2545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:42.565 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:53:42.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:41.282866+0000 mgr.smithi067.rdualw (mgr.24569) 2951 : cluster [DBG] pgmap v2546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:42.896 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:41.282866+0000 mgr.smithi067.rdualw (mgr.24569) 2951 : cluster [DBG] pgmap v2546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:42.897 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:53:42.897 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (91m) 106s ago 92m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:53:42.897 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (83m) 106s ago 92m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:53:42.897 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (83m) 109s ago 91m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:53:42.898 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (91m) 106s ago 92m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:53:42.898 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (84m) 106s ago 88m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:53:42.898 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (84m) 109s ago 87m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:53:42.898 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (85m) 106s ago 93m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:53:42.898 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (85m) 109s ago 91m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:53:42.899 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (84m) 106s ago 93m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:53:42.899 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (84m) 109s ago 91m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:53:42.899 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (85m) 106s ago 85m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:53:42.899 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (85m) 109s ago 85m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:53:42.900 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (92m) 106s ago 92m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:53:42.900 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (91m) 109s ago 91m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:53:42.900 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (74m) 106s ago 91m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:53:42.900 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (90m) 106s ago 90m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:53:42.900 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (90m) 106s ago 90m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:53:42.901 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (90m) 106s ago 90m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:53:42.901 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (90m) 109s ago 90m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:53:42.901 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (89m) 109s ago 89m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:53:42.901 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (89m) 109s ago 89m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:53:42.902 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (89m) 109s ago 89m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:53:42.902 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (91m) 106s ago 91m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:53:43.281 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:53:43.282 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:53:43.282 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:53:43.282 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:53:43.283 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:53:43.283 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:53:43.283 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:53:43.283 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:53:43.284 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:53:43.284 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:53:43.284 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:53:43.284 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:53:43.284 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:53:43.285 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:53:43.286 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:53:43.286 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:53:43.286 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:53:43.286 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:53:43.287 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:53:43.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:53:42.552523+0000 mgr.smithi067.rdualw (mgr.24569) 2952 : audit [DBG] from='client.36106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:53:43.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:53:43.280002+0000 mon.smithi061 (mon.0) 776 : audit [DBG] from='client.? 172.21.15.61:0/2472793849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:53:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:53:42.552523+0000 mgr.smithi067.rdualw (mgr.24569) 2952 : audit [DBG] from='client.36106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:53:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:53:43.280002+0000 mon.smithi061 (mon.0) 776 : audit [DBG] from='client.? 172.21.15.61:0/2472793849' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:53:44.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:53:42.839087+0000 mgr.smithi067.rdualw (mgr.24569) 2953 : audit [DBG] from='client.36110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:53:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:43.283564+0000 mgr.smithi067.rdualw (mgr.24569) 2954 : cluster [DBG] pgmap v2547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:53:42.839087+0000 mgr.smithi067.rdualw (mgr.24569) 2953 : audit [DBG] from='client.36110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:53:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:43.283564+0000 mgr.smithi067.rdualw (mgr.24569) 2954 : cluster [DBG] pgmap v2547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:45.284282+0000 mgr.smithi067.rdualw (mgr.24569) 2955 : cluster [DBG] pgmap v2548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:53:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:45.284282+0000 mgr.smithi067.rdualw (mgr.24569) 2955 : cluster [DBG] pgmap v2548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:53:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:47.284992+0000 mgr.smithi067.rdualw (mgr.24569) 2956 : cluster [DBG] pgmap v2549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:47.284992+0000 mgr.smithi067.rdualw (mgr.24569) 2956 : cluster [DBG] pgmap v2549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:49.285674+0000 mgr.smithi067.rdualw (mgr.24569) 2957 : cluster [DBG] pgmap v2550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:49.285674+0000 mgr.smithi067.rdualw (mgr.24569) 2957 : cluster [DBG] pgmap v2550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:51.286518+0000 mgr.smithi067.rdualw (mgr.24569) 2958 : cluster [DBG] pgmap v2551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:51.286518+0000 mgr.smithi067.rdualw (mgr.24569) 2958 : cluster [DBG] pgmap v2551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:53.287198+0000 mgr.smithi067.rdualw (mgr.24569) 2959 : cluster [DBG] pgmap v2552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:53.287198+0000 mgr.smithi067.rdualw (mgr.24569) 2959 : cluster [DBG] pgmap v2552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:55.288041+0000 mgr.smithi067.rdualw (mgr.24569) 2960 : cluster [DBG] pgmap v2553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:53:56.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:55.288041+0000 mgr.smithi067.rdualw (mgr.24569) 2960 : cluster [DBG] pgmap v2553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:53:57.532 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:53:57.196856+0000 mon.smithi067 (mon.1) 481 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:53:57.532 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:53:57.198288+0000 mon.smithi067 (mon.1) 482 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:53:57.532 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:53:57.199242+0000 mon.smithi067 (mon.1) 483 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:53:57.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:53:57.196856+0000 mon.smithi067 (mon.1) 481 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:53:57.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:53:57.198288+0000 mon.smithi067 (mon.1) 482 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:53:57.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:53:57.199242+0000 mon.smithi067 (mon.1) 483 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:53:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:53:57.200068+0000 mgr.smithi067.rdualw (mgr.24569) 2961 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:53:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:57.288707+0000 mgr.smithi067.rdualw (mgr.24569) 2962 : cluster [DBG] pgmap v2554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:53:57.555075+0000 mon.smithi061 (mon.0) 777 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:53:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:53:57.568516+0000 mon.smithi061 (mon.0) 778 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:53:58.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:53:57.971089+0000 mon.smithi061 (mon.0) 779 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:53:58.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:53:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:53:57.976886+0000 mon.smithi061 (mon.0) 780 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:53:58.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:53:57.200068+0000 mgr.smithi067.rdualw (mgr.24569) 2961 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:53:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:57.288707+0000 mgr.smithi067.rdualw (mgr.24569) 2962 : cluster [DBG] pgmap v2554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:53:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:53:57.555075+0000 mon.smithi061 (mon.0) 777 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:53:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:53:57.568516+0000 mon.smithi061 (mon.0) 778 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:53:58.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:53:57.971089+0000 mon.smithi061 (mon.0) 779 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:53:58.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:53:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:53:57.976886+0000 mon.smithi061 (mon.0) 780 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:54:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:53:59.289456+0000 mgr.smithi067.rdualw (mgr.24569) 2963 : cluster [DBG] pgmap v2555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:53:59.289456+0000 mgr.smithi067.rdualw (mgr.24569) 2963 : cluster [DBG] pgmap v2555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:01.290336+0000 mgr.smithi067.rdualw (mgr.24569) 2964 : cluster [DBG] pgmap v2556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:01.290336+0000 mgr.smithi067.rdualw (mgr.24569) 2964 : cluster [DBG] pgmap v2556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:03.291010+0000 mgr.smithi067.rdualw (mgr.24569) 2965 : cluster [DBG] pgmap v2557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:03.291010+0000 mgr.smithi067.rdualw (mgr.24569) 2965 : cluster [DBG] pgmap v2557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:05.291975+0000 mgr.smithi067.rdualw (mgr.24569) 2966 : cluster [DBG] pgmap v2558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:54:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:05.291975+0000 mgr.smithi067.rdualw (mgr.24569) 2966 : cluster [DBG] pgmap v2558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:54:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:07.292895+0000 mgr.smithi067.rdualw (mgr.24569) 2967 : cluster [DBG] pgmap v2559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:08.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:07.292895+0000 mgr.smithi067.rdualw (mgr.24569) 2967 : cluster [DBG] pgmap v2559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:09.293722+0000 mgr.smithi067.rdualw (mgr.24569) 2968 : cluster [DBG] pgmap v2560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:09.293722+0000 mgr.smithi067.rdualw (mgr.24569) 2968 : cluster [DBG] pgmap v2560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:11.294693+0000 mgr.smithi067.rdualw (mgr.24569) 2969 : cluster [DBG] pgmap v2561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:11.294693+0000 mgr.smithi067.rdualw (mgr.24569) 2969 : cluster [DBG] pgmap v2561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:13.591 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:54:13.881 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:54:13.881 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (91m) 2m ago 92m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:54:13.882 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (84m) 2m ago 92m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:54:13.882 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (84m) 2m ago 92m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:54:13.882 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (91m) 2m ago 92m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:54:13.882 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (84m) 2m ago 88m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:54:13.883 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (84m) 2m ago 88m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:54:13.883 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (85m) 2m ago 94m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:54:13.883 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (85m) 2m ago 92m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:54:13.883 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (85m) 2m ago 94m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:54:13.884 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (85m) 2m ago 92m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:54:13.884 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (86m) 2m ago 86m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:54:13.884 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (86m) 2m ago 86m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:54:13.884 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (92m) 2m ago 92m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:54:13.885 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (92m) 2m ago 92m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:54:13.885 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (75m) 2m ago 91m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:54:13.885 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (91m) 2m ago 91m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:54:13.885 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (91m) 2m ago 91m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:54:13.885 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (90m) 2m ago 90m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:54:13.886 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (90m) 2m ago 90m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:54:13.886 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (90m) 2m ago 90m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:54:13.886 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (90m) 2m ago 90m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:54:13.886 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (89m) 2m ago 89m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:54:13.886 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (91m) 2m ago 92m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:54:14.221 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:54:14.222 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:54:14.222 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:54:14.222 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:54:14.223 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:54:14.223 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:54:14.223 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:54:14.223 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:54:14.224 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:54:14.224 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:54:14.224 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:54:14.224 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:54:14.225 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:54:14.225 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:54:14.225 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:54:14.225 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:54:14.226 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:54:14.226 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:54:14.226 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:54:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:13.295339+0000 mgr.smithi067.rdualw (mgr.24569) 2970 : cluster [DBG] pgmap v2562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:54:13.576769+0000 mgr.smithi067.rdualw (mgr.24569) 2971 : audit [DBG] from='client.36118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:54:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:54:14.220381+0000 mon.smithi061 (mon.0) 781 : audit [DBG] from='client.? 172.21.15.61:0/930225229' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:54:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:13.295339+0000 mgr.smithi067.rdualw (mgr.24569) 2970 : cluster [DBG] pgmap v2562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:54:13.576769+0000 mgr.smithi067.rdualw (mgr.24569) 2971 : audit [DBG] from='client.36118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:54:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:54:14.220381+0000 mon.smithi061 (mon.0) 781 : audit [DBG] from='client.? 172.21.15.61:0/930225229' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:54:15.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:54:13.863739+0000 mgr.smithi067.rdualw (mgr.24569) 2972 : audit [DBG] from='client.36122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:54:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:54:13.863739+0000 mgr.smithi067.rdualw (mgr.24569) 2972 : audit [DBG] from='client.36122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:54:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:15.296111+0000 mgr.smithi067.rdualw (mgr.24569) 2973 : cluster [DBG] pgmap v2563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:54:16.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:15.296111+0000 mgr.smithi067.rdualw (mgr.24569) 2973 : cluster [DBG] pgmap v2563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:54:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:17.296859+0000 mgr.smithi067.rdualw (mgr.24569) 2974 : cluster [DBG] pgmap v2564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:17.296859+0000 mgr.smithi067.rdualw (mgr.24569) 2974 : cluster [DBG] pgmap v2564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:19.297626+0000 mgr.smithi067.rdualw (mgr.24569) 2975 : cluster [DBG] pgmap v2565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:19.297626+0000 mgr.smithi067.rdualw (mgr.24569) 2975 : cluster [DBG] pgmap v2565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:21.298566+0000 mgr.smithi067.rdualw (mgr.24569) 2976 : cluster [DBG] pgmap v2566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:21.298566+0000 mgr.smithi067.rdualw (mgr.24569) 2976 : cluster [DBG] pgmap v2566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:23.299173+0000 mgr.smithi067.rdualw (mgr.24569) 2977 : cluster [DBG] pgmap v2567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:23.299173+0000 mgr.smithi067.rdualw (mgr.24569) 2977 : cluster [DBG] pgmap v2567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:25.300052+0000 mgr.smithi067.rdualw (mgr.24569) 2978 : cluster [DBG] pgmap v2568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:54:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:25.300052+0000 mgr.smithi067.rdualw (mgr.24569) 2978 : cluster [DBG] pgmap v2568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:54:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:27.300995+0000 mgr.smithi067.rdualw (mgr.24569) 2979 : cluster [DBG] pgmap v2569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:27.300995+0000 mgr.smithi067.rdualw (mgr.24569) 2979 : cluster [DBG] pgmap v2569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:29.301621+0000 mgr.smithi067.rdualw (mgr.24569) 2980 : cluster [DBG] pgmap v2570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:29.301621+0000 mgr.smithi067.rdualw (mgr.24569) 2980 : cluster [DBG] pgmap v2570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:31.302479+0000 mgr.smithi067.rdualw (mgr.24569) 2981 : cluster [DBG] pgmap v2571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:31.302479+0000 mgr.smithi067.rdualw (mgr.24569) 2981 : cluster [DBG] pgmap v2571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:33.303262+0000 mgr.smithi067.rdualw (mgr.24569) 2982 : cluster [DBG] pgmap v2572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:33.303262+0000 mgr.smithi067.rdualw (mgr.24569) 2982 : cluster [DBG] pgmap v2572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:54:34.883497+0000 mon.smithi067 (mon.1) 484 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:54:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:54:34.883593+0000 mon.smithi061 (mon.0) 782 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:54:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:54:34.883786+0000 mon.smithi067 (mon.1) 485 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:54:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:54:34.883901+0000 mon.smithi061 (mon.0) 783 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:54:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:54:34.883497+0000 mon.smithi067 (mon.1) 484 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:54:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:54:34.883593+0000 mon.smithi061 (mon.0) 782 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:54:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:54:34.883786+0000 mon.smithi067 (mon.1) 485 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:54:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:54:34.883901+0000 mon.smithi061 (mon.0) 783 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:54:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:35.304082+0000 mgr.smithi067.rdualw (mgr.24569) 2983 : cluster [DBG] pgmap v2573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:54:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:35.304082+0000 mgr.smithi067.rdualw (mgr.24569) 2983 : cluster [DBG] pgmap v2573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:54:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:37.304954+0000 mgr.smithi067.rdualw (mgr.24569) 2984 : cluster [DBG] pgmap v2574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:37.304954+0000 mgr.smithi067.rdualw (mgr.24569) 2984 : cluster [DBG] pgmap v2574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:39.305585+0000 mgr.smithi067.rdualw (mgr.24569) 2985 : cluster [DBG] pgmap v2575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:39.305585+0000 mgr.smithi067.rdualw (mgr.24569) 2985 : cluster [DBG] pgmap v2575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:42.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:41.306488+0000 mgr.smithi067.rdualw (mgr.24569) 2986 : cluster [DBG] pgmap v2576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:41.306488+0000 mgr.smithi067.rdualw (mgr.24569) 2986 : cluster [DBG] pgmap v2576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:44.531 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:54:44.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:43.307125+0000 mgr.smithi067.rdualw (mgr.24569) 2987 : cluster [DBG] pgmap v2577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:43.307125+0000 mgr.smithi067.rdualw (mgr.24569) 2987 : cluster [DBG] pgmap v2577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:44.826 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:54:44.827 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (92m) 2m ago 93m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:54:44.827 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (84m) 2m ago 93m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:54:44.827 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (84m) 2m ago 92m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:54:44.828 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (92m) 2m ago 93m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:54:44.828 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (85m) 2m ago 89m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:54:44.828 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (85m) 2m ago 89m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:54:44.828 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (86m) 2m ago 94m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:54:44.828 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (86m) 2m ago 92m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:54:44.829 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (85m) 2m ago 94m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:54:44.829 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (85m) 2m ago 92m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:54:44.829 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (86m) 2m ago 86m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:54:44.829 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (86m) 2m ago 86m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:54:44.830 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (93m) 2m ago 93m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:54:44.830 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (92m) 2m ago 92m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:54:44.830 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (75m) 2m ago 92m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:54:44.830 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (91m) 2m ago 91m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:54:44.830 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (91m) 2m ago 91m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:54:44.831 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (91m) 2m ago 91m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:54:44.831 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (91m) 2m ago 91m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:54:44.831 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (90m) 2m ago 90m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:54:44.831 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (90m) 2m ago 90m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:54:44.831 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (90m) 2m ago 90m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:54:44.832 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (92m) 2m ago 93m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:54:45.171 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:54:45.171 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:54:45.171 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:54:45.171 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:54:45.172 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:54:45.172 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:54:45.172 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:54:45.172 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:54:45.173 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:54:45.173 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:54:45.173 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:54:45.173 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:54:45.174 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:54:45.174 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:54:45.174 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:54:45.174 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:54:45.174 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:54:45.175 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:54:45.175 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:54:45.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:54:44.518444+0000 mgr.smithi067.rdualw (mgr.24569) 2988 : audit [DBG] from='client.36130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:54:45.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:54:45.169434+0000 mon.smithi061 (mon.0) 784 : audit [DBG] from='client.? 172.21.15.61:0/365144089' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:54:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:54:44.518444+0000 mgr.smithi067.rdualw (mgr.24569) 2988 : audit [DBG] from='client.36130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:54:45.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:54:45.169434+0000 mon.smithi061 (mon.0) 784 : audit [DBG] from='client.? 172.21.15.61:0/365144089' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:54:46.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:54:44.809126+0000 mgr.smithi067.rdualw (mgr.24569) 2989 : audit [DBG] from='client.36134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:54:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:45.307921+0000 mgr.smithi067.rdualw (mgr.24569) 2990 : cluster [DBG] pgmap v2578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:54:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:54:44.809126+0000 mgr.smithi067.rdualw (mgr.24569) 2989 : audit [DBG] from='client.36134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:54:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:45.307921+0000 mgr.smithi067.rdualw (mgr.24569) 2990 : cluster [DBG] pgmap v2578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:54:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:47.308595+0000 mgr.smithi067.rdualw (mgr.24569) 2991 : cluster [DBG] pgmap v2579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:47.308595+0000 mgr.smithi067.rdualw (mgr.24569) 2991 : cluster [DBG] pgmap v2579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:49.309185+0000 mgr.smithi067.rdualw (mgr.24569) 2992 : cluster [DBG] pgmap v2580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:49.309185+0000 mgr.smithi067.rdualw (mgr.24569) 2992 : cluster [DBG] pgmap v2580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:51.310191+0000 mgr.smithi067.rdualw (mgr.24569) 2993 : cluster [DBG] pgmap v2581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:51.310191+0000 mgr.smithi067.rdualw (mgr.24569) 2993 : cluster [DBG] pgmap v2581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:53.310922+0000 mgr.smithi067.rdualw (mgr.24569) 2994 : cluster [DBG] pgmap v2582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:53.310922+0000 mgr.smithi067.rdualw (mgr.24569) 2994 : cluster [DBG] pgmap v2582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:56.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:55.311595+0000 mgr.smithi067.rdualw (mgr.24569) 2995 : cluster [DBG] pgmap v2583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:54:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:55.311595+0000 mgr.smithi067.rdualw (mgr.24569) 2995 : cluster [DBG] pgmap v2583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:54:58.619 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:57.312279+0000 mgr.smithi067.rdualw (mgr.24569) 2996 : cluster [DBG] pgmap v2584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:58.620 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:54:57.982160+0000 mon.smithi067 (mon.1) 486 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:54:58.620 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:54:57.983585+0000 mon.smithi067 (mon.1) 487 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:54:58.620 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:54:57.984488+0000 mon.smithi067 (mon.1) 488 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:54:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:57.312279+0000 mgr.smithi067.rdualw (mgr.24569) 2996 : cluster [DBG] pgmap v2584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:54:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:54:57.982160+0000 mon.smithi067 (mon.1) 486 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:54:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:54:57.983585+0000 mon.smithi067 (mon.1) 487 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:54:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:54:57.984488+0000 mon.smithi067 (mon.1) 488 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:54:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:54:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:54:57.985326+0000 mgr.smithi067.rdualw (mgr.24569) 2997 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:54:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:54:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:54:57.985326+0000 mgr.smithi067.rdualw (mgr.24569) 2997 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:55:00.628 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:54:59.313048+0000 mgr.smithi067.rdualw (mgr.24569) 2998 : cluster [DBG] pgmap v2585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:54:59.313048+0000 mgr.smithi067.rdualw (mgr.24569) 2998 : cluster [DBG] pgmap v2585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:55:01.313481+0000 mon.smithi061 (mon.0) 785 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:55:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:01.314063+0000 mgr.smithi067.rdualw (mgr.24569) 2999 : cluster [DBG] pgmap v2586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:55:01.728614+0000 mon.smithi061 (mon.0) 786 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:55:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:55:01.735382+0000 mon.smithi061 (mon.0) 787 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:55:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:55:01.313481+0000 mon.smithi061 (mon.0) 785 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:55:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:01.314063+0000 mgr.smithi067.rdualw (mgr.24569) 2999 : cluster [DBG] pgmap v2586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:55:01.728614+0000 mon.smithi061 (mon.0) 786 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:55:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:55:01.735382+0000 mon.smithi061 (mon.0) 787 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:55:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:03.314688+0000 mgr.smithi067.rdualw (mgr.24569) 3000 : cluster [DBG] pgmap v2587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:03.314688+0000 mgr.smithi067.rdualw (mgr.24569) 3000 : cluster [DBG] pgmap v2587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:05.315341+0000 mgr.smithi067.rdualw (mgr.24569) 3001 : cluster [DBG] pgmap v2588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:55:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:05.315341+0000 mgr.smithi067.rdualw (mgr.24569) 3001 : cluster [DBG] pgmap v2588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:55:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:07.316087+0000 mgr.smithi067.rdualw (mgr.24569) 3002 : cluster [DBG] pgmap v2589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:08.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:07.316087+0000 mgr.smithi067.rdualw (mgr.24569) 3002 : cluster [DBG] pgmap v2589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:09.316800+0000 mgr.smithi067.rdualw (mgr.24569) 3003 : cluster [DBG] pgmap v2590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:09.316800+0000 mgr.smithi067.rdualw (mgr.24569) 3003 : cluster [DBG] pgmap v2590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:11.317824+0000 mgr.smithi067.rdualw (mgr.24569) 3004 : cluster [DBG] pgmap v2591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:11.317824+0000 mgr.smithi067.rdualw (mgr.24569) 3004 : cluster [DBG] pgmap v2591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:13.318273+0000 mgr.smithi067.rdualw (mgr.24569) 3005 : cluster [DBG] pgmap v2592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:14.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:13.318273+0000 mgr.smithi067.rdualw (mgr.24569) 3005 : cluster [DBG] pgmap v2592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:15.481 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:55:15.775 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:55:15.776 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (92m) 3m ago 93m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:55:15.776 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (85m) 3m ago 93m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:55:15.776 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (85m) 3m ago 93m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:55:15.776 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (92m) 3m ago 93m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:55:15.777 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (85m) 3m ago 89m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:55:15.777 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (85m) 3m ago 89m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:55:15.777 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (86m) 3m ago 95m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:55:15.777 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (86m) 3m ago 93m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:55:15.778 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (86m) 3m ago 95m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:55:15.778 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (86m) 3m ago 93m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:55:15.778 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (87m) 3m ago 87m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:55:15.778 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (87m) 3m ago 87m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:55:15.778 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (93m) 3m ago 93m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:55:15.779 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (93m) 3m ago 93m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:55:15.779 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (76m) 3m ago 92m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:55:15.779 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (92m) 3m ago 92m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:55:15.779 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (92m) 3m ago 92m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:55:15.780 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (91m) 3m ago 91m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:55:15.780 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (91m) 3m ago 91m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:55:15.780 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (91m) 3m ago 91m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:55:15.780 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (91m) 3m ago 91m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:55:15.780 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (90m) 3m ago 90m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:55:15.781 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (92m) 3m ago 93m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:55:16.119 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:55:16.119 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:55:16.120 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:55:16.120 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:55:16.120 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:55:16.120 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:55:16.121 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:55:16.121 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:55:16.121 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:55:16.121 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:55:16.122 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:55:16.122 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:55:16.123 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:55:16.123 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:55:16.124 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:55:16.124 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:55:16.124 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:55:16.125 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:55:16.125 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:55:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:15.319018+0000 mgr.smithi067.rdualw (mgr.24569) 3006 : cluster [DBG] pgmap v2593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:55:16.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:55:15.467984+0000 mgr.smithi067.rdualw (mgr.24569) 3007 : audit [DBG] from='client.36142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:55:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:15.319018+0000 mgr.smithi067.rdualw (mgr.24569) 3006 : cluster [DBG] pgmap v2593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:55:16.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:55:15.467984+0000 mgr.smithi067.rdualw (mgr.24569) 3007 : audit [DBG] from='client.36142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:55:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:55:15.755388+0000 mgr.smithi067.rdualw (mgr.24569) 3008 : audit [DBG] from='client.36146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:55:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:55:16.117654+0000 mon.smithi061 (mon.0) 788 : audit [DBG] from='client.? 172.21.15.61:0/3629305938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:55:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:55:15.755388+0000 mgr.smithi067.rdualw (mgr.24569) 3008 : audit [DBG] from='client.36146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:55:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:55:16.117654+0000 mon.smithi061 (mon.0) 788 : audit [DBG] from='client.? 172.21.15.61:0/3629305938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:55:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:17.319774+0000 mgr.smithi067.rdualw (mgr.24569) 3009 : cluster [DBG] pgmap v2594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:17.319774+0000 mgr.smithi067.rdualw (mgr.24569) 3009 : cluster [DBG] pgmap v2594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:19.320472+0000 mgr.smithi067.rdualw (mgr.24569) 3010 : cluster [DBG] pgmap v2595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:19.320472+0000 mgr.smithi067.rdualw (mgr.24569) 3010 : cluster [DBG] pgmap v2595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:21.321384+0000 mgr.smithi067.rdualw (mgr.24569) 3011 : cluster [DBG] pgmap v2596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:21.321384+0000 mgr.smithi067.rdualw (mgr.24569) 3011 : cluster [DBG] pgmap v2596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:23.321922+0000 mgr.smithi067.rdualw (mgr.24569) 3012 : cluster [DBG] pgmap v2597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:23.321922+0000 mgr.smithi067.rdualw (mgr.24569) 3012 : cluster [DBG] pgmap v2597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:25.322641+0000 mgr.smithi067.rdualw (mgr.24569) 3013 : cluster [DBG] pgmap v2598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:55:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:25.322641+0000 mgr.smithi067.rdualw (mgr.24569) 3013 : cluster [DBG] pgmap v2598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:55:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:27.323468+0000 mgr.smithi067.rdualw (mgr.24569) 3014 : cluster [DBG] pgmap v2599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:27.323468+0000 mgr.smithi067.rdualw (mgr.24569) 3014 : cluster [DBG] pgmap v2599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:29.324109+0000 mgr.smithi067.rdualw (mgr.24569) 3015 : cluster [DBG] pgmap v2600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:29.324109+0000 mgr.smithi067.rdualw (mgr.24569) 3015 : cluster [DBG] pgmap v2600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:31.324999+0000 mgr.smithi067.rdualw (mgr.24569) 3016 : cluster [DBG] pgmap v2601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:31.324999+0000 mgr.smithi067.rdualw (mgr.24569) 3016 : cluster [DBG] pgmap v2601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:33.325646+0000 mgr.smithi067.rdualw (mgr.24569) 3017 : cluster [DBG] pgmap v2602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:33.325646+0000 mgr.smithi067.rdualw (mgr.24569) 3017 : cluster [DBG] pgmap v2602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:55:34.888541+0000 mon.smithi067 (mon.1) 489 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:55:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:55:34.888917+0000 mon.smithi067 (mon.1) 490 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:55:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:55:34.889024+0000 mon.smithi061 (mon.0) 789 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:55:35.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:55:34.889420+0000 mon.smithi061 (mon.0) 790 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:55:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:55:34.888541+0000 mon.smithi067 (mon.1) 489 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:55:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:55:34.888917+0000 mon.smithi067 (mon.1) 490 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:55:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:55:34.889024+0000 mon.smithi061 (mon.0) 789 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:55:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:55:34.889420+0000 mon.smithi061 (mon.0) 790 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:55:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:35.326504+0000 mgr.smithi067.rdualw (mgr.24569) 3018 : cluster [DBG] pgmap v2603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:55:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:35.326504+0000 mgr.smithi067.rdualw (mgr.24569) 3018 : cluster [DBG] pgmap v2603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:55:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:37.327332+0000 mgr.smithi067.rdualw (mgr.24569) 3019 : cluster [DBG] pgmap v2604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:37.327332+0000 mgr.smithi067.rdualw (mgr.24569) 3019 : cluster [DBG] pgmap v2604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:39.328003+0000 mgr.smithi067.rdualw (mgr.24569) 3020 : cluster [DBG] pgmap v2605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:39.328003+0000 mgr.smithi067.rdualw (mgr.24569) 3020 : cluster [DBG] pgmap v2605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:41.328928+0000 mgr.smithi067.rdualw (mgr.24569) 3021 : cluster [DBG] pgmap v2606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:41.328928+0000 mgr.smithi067.rdualw (mgr.24569) 3021 : cluster [DBG] pgmap v2606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:44.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:43.329546+0000 mgr.smithi067.rdualw (mgr.24569) 3022 : cluster [DBG] pgmap v2607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:43.329546+0000 mgr.smithi067.rdualw (mgr.24569) 3022 : cluster [DBG] pgmap v2607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:45.330344+0000 mgr.smithi067.rdualw (mgr.24569) 3023 : cluster [DBG] pgmap v2608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:55:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:45.330344+0000 mgr.smithi067.rdualw (mgr.24569) 3023 : cluster [DBG] pgmap v2608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:55:46.429 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:55:46.721 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:55:46.722 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (93m) 3m ago 94m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:55:46.722 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (86m) 3m ago 94m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:55:46.722 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (85m) 3m ago 93m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:55:46.722 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (93m) 3m ago 94m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:55:46.723 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (86m) 3m ago 90m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:55:46.723 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (86m) 3m ago 90m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:55:46.723 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (87m) 3m ago 95m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:55:46.723 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (87m) 3m ago 93m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:55:46.724 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (86m) 3m ago 95m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:55:46.724 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (86m) 3m ago 93m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:55:46.724 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (87m) 3m ago 87m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:55:46.725 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (87m) 3m ago 87m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:55:46.725 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (94m) 3m ago 94m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:55:46.726 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (93m) 3m ago 93m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:55:46.726 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (76m) 3m ago 93m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:55:46.726 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (92m) 3m ago 92m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:55:46.727 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (92m) 3m ago 92m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:55:46.727 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (92m) 3m ago 92m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:55:46.728 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (92m) 3m ago 92m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:55:46.728 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (91m) 3m ago 91m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:55:46.728 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (91m) 3m ago 91m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:55:46.728 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (91m) 3m ago 91m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:55:46.729 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (93m) 3m ago 94m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:55:47.063 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:55:47.064 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:55:47.064 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:55:47.064 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:55:47.064 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:55:47.065 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:55:47.065 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:55:47.065 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:55:47.065 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:55:47.065 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:55:47.066 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:55:47.066 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:55:47.066 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:55:47.066 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:55:47.067 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:55:47.067 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:55:47.067 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:55:47.067 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:55:47.068 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:55:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:55:46.416351+0000 mgr.smithi067.rdualw (mgr.24569) 3024 : audit [DBG] from='client.36154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:55:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:55:46.704037+0000 mgr.smithi067.rdualw (mgr.24569) 3025 : audit [DBG] from='client.36158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:55:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:55:46.416351+0000 mgr.smithi067.rdualw (mgr.24569) 3024 : audit [DBG] from='client.36154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:55:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:55:46.704037+0000 mgr.smithi067.rdualw (mgr.24569) 3025 : audit [DBG] from='client.36158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:55:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:55:47.062239+0000 mon.smithi061 (mon.0) 791 : audit [DBG] from='client.? 172.21.15.61:0/3309940630' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:55:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:47.331211+0000 mgr.smithi067.rdualw (mgr.24569) 3026 : cluster [DBG] pgmap v2609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:55:47.062239+0000 mon.smithi061 (mon.0) 791 : audit [DBG] from='client.? 172.21.15.61:0/3309940630' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:55:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:47.331211+0000 mgr.smithi067.rdualw (mgr.24569) 3026 : cluster [DBG] pgmap v2609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:49.331961+0000 mgr.smithi067.rdualw (mgr.24569) 3027 : cluster [DBG] pgmap v2610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:49.331961+0000 mgr.smithi067.rdualw (mgr.24569) 3027 : cluster [DBG] pgmap v2610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:52.659 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:51.332947+0000 mgr.smithi067.rdualw (mgr.24569) 3028 : cluster [DBG] pgmap v2611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:51.332947+0000 mgr.smithi067.rdualw (mgr.24569) 3028 : cluster [DBG] pgmap v2611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:53.333394+0000 mgr.smithi067.rdualw (mgr.24569) 3029 : cluster [DBG] pgmap v2612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:53.333394+0000 mgr.smithi067.rdualw (mgr.24569) 3029 : cluster [DBG] pgmap v2612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:55.334033+0000 mgr.smithi067.rdualw (mgr.24569) 3030 : cluster [DBG] pgmap v2613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:55:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:55.334033+0000 mgr.smithi067.rdualw (mgr.24569) 3030 : cluster [DBG] pgmap v2613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:55:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:55:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:57.334715+0000 mgr.smithi067.rdualw (mgr.24569) 3031 : cluster [DBG] pgmap v2614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:55:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:55:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:57.334715+0000 mgr.smithi067.rdualw (mgr.24569) 3031 : cluster [DBG] pgmap v2614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:55:59.335341+0000 mgr.smithi067.rdualw (mgr.24569) 3032 : cluster [DBG] pgmap v2615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:55:59.335341+0000 mgr.smithi067.rdualw (mgr.24569) 3032 : cluster [DBG] pgmap v2615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:01.336369+0000 mgr.smithi067.rdualw (mgr.24569) 3033 : cluster [DBG] pgmap v2616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:56:01.740084+0000 mon.smithi067 (mon.1) 491 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:56:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:56:01.741572+0000 mon.smithi067 (mon.1) 492 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:56:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:56:01.742504+0000 mon.smithi067 (mon.1) 493 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:56:02.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:56:01.743369+0000 mgr.smithi067.rdualw (mgr.24569) 3034 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:56:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:01.336369+0000 mgr.smithi067.rdualw (mgr.24569) 3033 : cluster [DBG] pgmap v2616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:56:01.740084+0000 mon.smithi067 (mon.1) 491 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:56:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:56:01.741572+0000 mon.smithi067 (mon.1) 492 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:56:02.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:56:01.742504+0000 mon.smithi067 (mon.1) 493 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:56:02.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:56:01.743369+0000 mgr.smithi067.rdualw (mgr.24569) 3034 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:56:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:03.336844+0000 mgr.smithi067.rdualw (mgr.24569) 3035 : cluster [DBG] pgmap v2617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:03.336844+0000 mgr.smithi067.rdualw (mgr.24569) 3035 : cluster [DBG] pgmap v2617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:56:04.659025+0000 mon.smithi061 (mon.0) 792 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:56:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:56:05.052374+0000 mon.smithi061 (mon.0) 793 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:56:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:56:05.058383+0000 mon.smithi061 (mon.0) 794 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:56:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:56:04.659025+0000 mon.smithi061 (mon.0) 792 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:56:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:56:05.052374+0000 mon.smithi061 (mon.0) 793 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:56:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:56:05.058383+0000 mon.smithi061 (mon.0) 794 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:56:07.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:05.337677+0000 mgr.smithi067.rdualw (mgr.24569) 3036 : cluster [DBG] pgmap v2618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:56:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:05.337677+0000 mgr.smithi067.rdualw (mgr.24569) 3036 : cluster [DBG] pgmap v2618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:56:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:07.338281+0000 mgr.smithi067.rdualw (mgr.24569) 3037 : cluster [DBG] pgmap v2619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:07.338281+0000 mgr.smithi067.rdualw (mgr.24569) 3037 : cluster [DBG] pgmap v2619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:09.339091+0000 mgr.smithi067.rdualw (mgr.24569) 3038 : cluster [DBG] pgmap v2620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:09.339091+0000 mgr.smithi067.rdualw (mgr.24569) 3038 : cluster [DBG] pgmap v2620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:11.340098+0000 mgr.smithi067.rdualw (mgr.24569) 3039 : cluster [DBG] pgmap v2621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:11.340098+0000 mgr.smithi067.rdualw (mgr.24569) 3039 : cluster [DBG] pgmap v2621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:13.340665+0000 mgr.smithi067.rdualw (mgr.24569) 3040 : cluster [DBG] pgmap v2622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:13.340665+0000 mgr.smithi067.rdualw (mgr.24569) 3040 : cluster [DBG] pgmap v2622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:15.341514+0000 mgr.smithi067.rdualw (mgr.24569) 3041 : cluster [DBG] pgmap v2623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:56:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:15.341514+0000 mgr.smithi067.rdualw (mgr.24569) 3041 : cluster [DBG] pgmap v2623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:56:17.375 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:56:17.666 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:56:17.666 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (93m) 4m ago 94m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:56:17.667 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (86m) 4m ago 94m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:56:17.667 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (86m) 4m ago 94m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:56:17.667 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (93m) 4m ago 94m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:56:17.667 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (87m) 4m ago 90m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:56:17.667 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (86m) 4m ago 90m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:56:17.668 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (87m) 4m ago 96m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:56:17.668 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (87m) 4m ago 94m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:56:17.668 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (87m) 4m ago 96m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:56:17.668 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (87m) 4m ago 94m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:56:17.669 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (88m) 4m ago 88m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:56:17.669 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (88m) 4m ago 88m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:56:17.669 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (94m) 4m ago 94m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:56:17.669 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (94m) 4m ago 94m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:56:17.669 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (77m) 4m ago 93m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:56:17.670 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (93m) 4m ago 93m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:56:17.670 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (93m) 4m ago 93m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:56:17.670 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (92m) 4m ago 92m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:56:17.670 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (92m) 4m ago 92m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:56:17.671 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (92m) 4m ago 92m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:56:17.671 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (92m) 4m ago 92m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:56:17.671 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (91m) 4m ago 91m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:56:17.671 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (93m) 4m ago 94m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:56:18.063 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:56:18.063 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:56:18.064 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:56:18.064 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:56:18.064 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:56:18.064 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:56:18.065 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:56:18.065 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:56:18.065 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:56:18.065 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:56:18.065 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:56:18.066 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:56:18.066 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:56:18.066 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:56:18.066 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:56:18.067 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:56:18.067 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:56:18.067 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:56:18.067 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:56:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:17.342197+0000 mgr.smithi067.rdualw (mgr.24569) 3042 : cluster [DBG] pgmap v2624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:56:17.360243+0000 mgr.smithi067.rdualw (mgr.24569) 3043 : audit [DBG] from='client.36166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:56:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:56:17.648440+0000 mgr.smithi067.rdualw (mgr.24569) 3044 : audit [DBG] from='client.36170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:56:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:56:18.061703+0000 mon.smithi061 (mon.0) 795 : audit [DBG] from='client.? 172.21.15.61:0/85165773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:56:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:17.342197+0000 mgr.smithi067.rdualw (mgr.24569) 3042 : cluster [DBG] pgmap v2624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:56:17.360243+0000 mgr.smithi067.rdualw (mgr.24569) 3043 : audit [DBG] from='client.36166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:56:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:56:17.648440+0000 mgr.smithi067.rdualw (mgr.24569) 3044 : audit [DBG] from='client.36170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:56:18.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:56:18.061703+0000 mon.smithi061 (mon.0) 795 : audit [DBG] from='client.? 172.21.15.61:0/85165773' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:56:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:19.342781+0000 mgr.smithi067.rdualw (mgr.24569) 3045 : cluster [DBG] pgmap v2625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:19.342781+0000 mgr.smithi067.rdualw (mgr.24569) 3045 : cluster [DBG] pgmap v2625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:21.343664+0000 mgr.smithi067.rdualw (mgr.24569) 3046 : cluster [DBG] pgmap v2626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:21.343664+0000 mgr.smithi067.rdualw (mgr.24569) 3046 : cluster [DBG] pgmap v2626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:23.344197+0000 mgr.smithi067.rdualw (mgr.24569) 3047 : cluster [DBG] pgmap v2627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:23.344197+0000 mgr.smithi067.rdualw (mgr.24569) 3047 : cluster [DBG] pgmap v2627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:25.344961+0000 mgr.smithi067.rdualw (mgr.24569) 3048 : cluster [DBG] pgmap v2628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:56:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:25.344961+0000 mgr.smithi067.rdualw (mgr.24569) 3048 : cluster [DBG] pgmap v2628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:56:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:27.345799+0000 mgr.smithi067.rdualw (mgr.24569) 3049 : cluster [DBG] pgmap v2629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:27.345799+0000 mgr.smithi067.rdualw (mgr.24569) 3049 : cluster [DBG] pgmap v2629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:29.346517+0000 mgr.smithi067.rdualw (mgr.24569) 3050 : cluster [DBG] pgmap v2630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:29.346517+0000 mgr.smithi067.rdualw (mgr.24569) 3050 : cluster [DBG] pgmap v2630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:31.347613+0000 mgr.smithi067.rdualw (mgr.24569) 3051 : cluster [DBG] pgmap v2631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:31.347613+0000 mgr.smithi067.rdualw (mgr.24569) 3051 : cluster [DBG] pgmap v2631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:33.348325+0000 mgr.smithi067.rdualw (mgr.24569) 3052 : cluster [DBG] pgmap v2632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:33.348325+0000 mgr.smithi067.rdualw (mgr.24569) 3052 : cluster [DBG] pgmap v2632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:56:34.894051+0000 mon.smithi067 (mon.1) 494 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:56:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:56:34.894183+0000 mon.smithi061 (mon.0) 796 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:56:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:56:34.894390+0000 mon.smithi067 (mon.1) 495 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:56:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:56:34.894508+0000 mon.smithi061 (mon.0) 797 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:56:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:56:34.894051+0000 mon.smithi067 (mon.1) 494 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:56:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:56:34.894183+0000 mon.smithi061 (mon.0) 796 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:56:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:56:34.894390+0000 mon.smithi067 (mon.1) 495 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:56:35.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:56:34.894508+0000 mon.smithi061 (mon.0) 797 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:56:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:35.349027+0000 mgr.smithi067.rdualw (mgr.24569) 3053 : cluster [DBG] pgmap v2633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:56:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:35.349027+0000 mgr.smithi067.rdualw (mgr.24569) 3053 : cluster [DBG] pgmap v2633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:56:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:37.349651+0000 mgr.smithi067.rdualw (mgr.24569) 3054 : cluster [DBG] pgmap v2634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:37.349651+0000 mgr.smithi067.rdualw (mgr.24569) 3054 : cluster [DBG] pgmap v2634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:39.350480+0000 mgr.smithi067.rdualw (mgr.24569) 3055 : cluster [DBG] pgmap v2635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:39.350480+0000 mgr.smithi067.rdualw (mgr.24569) 3055 : cluster [DBG] pgmap v2635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:42.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:41.351432+0000 mgr.smithi067.rdualw (mgr.24569) 3056 : cluster [DBG] pgmap v2636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:41.351432+0000 mgr.smithi067.rdualw (mgr.24569) 3056 : cluster [DBG] pgmap v2636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:44.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:43.352087+0000 mgr.smithi067.rdualw (mgr.24569) 3057 : cluster [DBG] pgmap v2637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:43.352087+0000 mgr.smithi067.rdualw (mgr.24569) 3057 : cluster [DBG] pgmap v2637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:45.352860+0000 mgr.smithi067.rdualw (mgr.24569) 3058 : cluster [DBG] pgmap v2638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:56:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:45.352860+0000 mgr.smithi067.rdualw (mgr.24569) 3058 : cluster [DBG] pgmap v2638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:56:48.371 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:56:48.668 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:56:48.669 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (94m) 4m ago 95m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:56:48.669 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (87m) 4m ago 95m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:56:48.669 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (86m) 4m ago 94m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:56:48.669 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (94m) 4m ago 95m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:56:48.670 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (87m) 4m ago 91m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:56:48.670 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (87m) 4m ago 91m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:56:48.670 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (88m) 4m ago 96m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:56:48.670 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (88m) 4m ago 94m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:56:48.670 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (87m) 4m ago 96m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:56:48.671 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (87m) 4m ago 94m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:56:48.671 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (88m) 4m ago 88m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:56:48.671 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (88m) 4m ago 88m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:56:48.671 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (95m) 4m ago 95m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:56:48.672 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (94m) 4m ago 94m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:56:48.672 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (77m) 4m ago 94m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:56:48.673 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (93m) 4m ago 93m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:56:48.673 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (93m) 4m ago 93m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:56:48.673 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (93m) 4m ago 93m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:56:48.673 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (93m) 4m ago 93m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:56:48.674 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (92m) 4m ago 92m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:56:48.675 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (92m) 4m ago 92m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:56:48.675 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (92m) 4m ago 92m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:56:48.675 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (94m) 4m ago 95m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:56:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:47.353500+0000 mgr.smithi067.rdualw (mgr.24569) 3059 : cluster [DBG] pgmap v2639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:47.353500+0000 mgr.smithi067.rdualw (mgr.24569) 3059 : cluster [DBG] pgmap v2639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:49.007 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:56:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:56:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:56:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:56:49.008 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:56:49.009 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:56:49.009 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:56:49.009 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:56:49.009 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:56:49.010 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:56:49.010 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:56:49.010 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:56:49.010 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:56:49.010 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:56:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:56:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:56:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:56:49.011 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:56:49.012 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:56:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:56:48.358023+0000 mgr.smithi067.rdualw (mgr.24569) 3060 : audit [DBG] from='client.36178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:56:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:56:48.651229+0000 mgr.smithi067.rdualw (mgr.24569) 3061 : audit [DBG] from='client.36182 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:56:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:56:49.006412+0000 mon.smithi061 (mon.0) 798 : audit [DBG] from='client.? 172.21.15.61:0/2424272639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:56:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:56:48.358023+0000 mgr.smithi067.rdualw (mgr.24569) 3060 : audit [DBG] from='client.36178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:56:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:56:48.651229+0000 mgr.smithi067.rdualw (mgr.24569) 3061 : audit [DBG] from='client.36182 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:56:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:56:49.006412+0000 mon.smithi061 (mon.0) 798 : audit [DBG] from='client.? 172.21.15.61:0/2424272639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:56:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:49.354240+0000 mgr.smithi067.rdualw (mgr.24569) 3062 : cluster [DBG] pgmap v2640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:49.354240+0000 mgr.smithi067.rdualw (mgr.24569) 3062 : cluster [DBG] pgmap v2640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:51.355071+0000 mgr.smithi067.rdualw (mgr.24569) 3063 : cluster [DBG] pgmap v2641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:51.355071+0000 mgr.smithi067.rdualw (mgr.24569) 3063 : cluster [DBG] pgmap v2641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:53.355713+0000 mgr.smithi067.rdualw (mgr.24569) 3064 : cluster [DBG] pgmap v2642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:53.355713+0000 mgr.smithi067.rdualw (mgr.24569) 3064 : cluster [DBG] pgmap v2642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:56.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:55.356614+0000 mgr.smithi067.rdualw (mgr.24569) 3065 : cluster [DBG] pgmap v2643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:56:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:55.356614+0000 mgr.smithi067.rdualw (mgr.24569) 3065 : cluster [DBG] pgmap v2643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:56:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:56:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:57.357228+0000 mgr.smithi067.rdualw (mgr.24569) 3066 : cluster [DBG] pgmap v2644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:56:58.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:56:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:57.357228+0000 mgr.smithi067.rdualw (mgr.24569) 3066 : cluster [DBG] pgmap v2644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:56:59.357927+0000 mgr.smithi067.rdualw (mgr.24569) 3067 : cluster [DBG] pgmap v2645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:56:59.357927+0000 mgr.smithi067.rdualw (mgr.24569) 3067 : cluster [DBG] pgmap v2645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:01.358886+0000 mgr.smithi067.rdualw (mgr.24569) 3068 : cluster [DBG] pgmap v2646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:01.358886+0000 mgr.smithi067.rdualw (mgr.24569) 3068 : cluster [DBG] pgmap v2646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:03.359502+0000 mgr.smithi067.rdualw (mgr.24569) 3069 : cluster [DBG] pgmap v2647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:03.359502+0000 mgr.smithi067.rdualw (mgr.24569) 3069 : cluster [DBG] pgmap v2647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:57:05.062100+0000 mon.smithi067 (mon.1) 496 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:57:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:57:05.063555+0000 mon.smithi067 (mon.1) 497 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:57:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:57:05.064479+0000 mon.smithi067 (mon.1) 498 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:57:06.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:57:05.065322+0000 mgr.smithi067.rdualw (mgr.24569) 3070 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:57:06.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:05.360193+0000 mgr.smithi067.rdualw (mgr.24569) 3071 : cluster [DBG] pgmap v2648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:57:06.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:57:05.470460+0000 mon.smithi061 (mon.0) 799 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:57:06.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:57:05.475933+0000 mon.smithi061 (mon.0) 800 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:57:06.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:57:05.062100+0000 mon.smithi067 (mon.1) 496 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:57:06.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:57:05.063555+0000 mon.smithi067 (mon.1) 497 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:57:06.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:57:05.064479+0000 mon.smithi067 (mon.1) 498 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:57:06.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:57:05.065322+0000 mgr.smithi067.rdualw (mgr.24569) 3070 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:57:06.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:05.360193+0000 mgr.smithi067.rdualw (mgr.24569) 3071 : cluster [DBG] pgmap v2648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:57:06.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:57:05.470460+0000 mon.smithi061 (mon.0) 799 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:57:06.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:57:05.475933+0000 mon.smithi061 (mon.0) 800 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:57:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:07.360792+0000 mgr.smithi067.rdualw (mgr.24569) 3072 : cluster [DBG] pgmap v2649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:07.360792+0000 mgr.smithi067.rdualw (mgr.24569) 3072 : cluster [DBG] pgmap v2649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:09.361426+0000 mgr.smithi067.rdualw (mgr.24569) 3073 : cluster [DBG] pgmap v2650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:09.361426+0000 mgr.smithi067.rdualw (mgr.24569) 3073 : cluster [DBG] pgmap v2650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:11.362410+0000 mgr.smithi067.rdualw (mgr.24569) 3074 : cluster [DBG] pgmap v2651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:11.362410+0000 mgr.smithi067.rdualw (mgr.24569) 3074 : cluster [DBG] pgmap v2651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:13.362954+0000 mgr.smithi067.rdualw (mgr.24569) 3075 : cluster [DBG] pgmap v2652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:13.362954+0000 mgr.smithi067.rdualw (mgr.24569) 3075 : cluster [DBG] pgmap v2652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:15.363765+0000 mgr.smithi067.rdualw (mgr.24569) 3076 : cluster [DBG] pgmap v2653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:57:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:15.363765+0000 mgr.smithi067.rdualw (mgr.24569) 3076 : cluster [DBG] pgmap v2653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:57:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:17.364513+0000 mgr.smithi067.rdualw (mgr.24569) 3077 : cluster [DBG] pgmap v2654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:17.364513+0000 mgr.smithi067.rdualw (mgr.24569) 3077 : cluster [DBG] pgmap v2654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:19.313 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:57:19.604 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:57:19.604 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (94m) 5m ago 95m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:57:19.604 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (87m) 5m ago 95m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:57:19.604 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (87m) 5m ago 95m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:57:19.605 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (94m) 5m ago 95m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:57:19.605 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (88m) 5m ago 91m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:57:19.605 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (87m) 5m ago 91m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:57:19.605 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (89m) 5m ago 97m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:57:19.605 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (88m) 5m ago 95m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:57:19.606 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (88m) 5m ago 97m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:57:19.606 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (88m) 5m ago 95m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:57:19.606 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (89m) 5m ago 89m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:57:19.606 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (89m) 5m ago 89m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:57:19.607 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (95m) 5m ago 95m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:57:19.607 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (95m) 5m ago 95m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:57:19.607 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (78m) 5m ago 94m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:57:19.607 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (94m) 5m ago 94m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:57:19.607 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (94m) 5m ago 94m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:57:19.608 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (93m) 5m ago 93m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:57:19.608 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (93m) 5m ago 93m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:57:19.608 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (93m) 5m ago 93m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:57:19.608 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (93m) 5m ago 93m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:57:19.609 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (92m) 5m ago 92m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:57:19.609 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (94m) 5m ago 95m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:57:20.006 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:57:20.006 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:57:20.006 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:57:20.007 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:57:20.007 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:57:20.007 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:57:20.007 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:57:20.008 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:57:20.008 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:57:20.008 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:57:20.008 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:57:20.009 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:57:20.009 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:57:20.009 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:57:20.009 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:57:20.009 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:57:20.010 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:57:20.010 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:57:20.010 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:57:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:57:19.300495+0000 mgr.smithi067.rdualw (mgr.24569) 3078 : audit [DBG] from='client.36190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:57:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:19.365019+0000 mgr.smithi067.rdualw (mgr.24569) 3079 : cluster [DBG] pgmap v2655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:57:19.586735+0000 mgr.smithi067.rdualw (mgr.24569) 3080 : audit [DBG] from='client.36194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:57:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:57:20.004309+0000 mon.smithi061 (mon.0) 801 : audit [DBG] from='client.? 172.21.15.61:0/2014328821' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:57:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:57:19.300495+0000 mgr.smithi067.rdualw (mgr.24569) 3078 : audit [DBG] from='client.36190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:57:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:19.365019+0000 mgr.smithi067.rdualw (mgr.24569) 3079 : cluster [DBG] pgmap v2655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:57:19.586735+0000 mgr.smithi067.rdualw (mgr.24569) 3080 : audit [DBG] from='client.36194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:57:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:57:20.004309+0000 mon.smithi061 (mon.0) 801 : audit [DBG] from='client.? 172.21.15.61:0/2014328821' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:57:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:21.365905+0000 mgr.smithi067.rdualw (mgr.24569) 3081 : cluster [DBG] pgmap v2656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:21.365905+0000 mgr.smithi067.rdualw (mgr.24569) 3081 : cluster [DBG] pgmap v2656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:24.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:23.366618+0000 mgr.smithi067.rdualw (mgr.24569) 3082 : cluster [DBG] pgmap v2657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:23.366618+0000 mgr.smithi067.rdualw (mgr.24569) 3082 : cluster [DBG] pgmap v2657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:25.367388+0000 mgr.smithi067.rdualw (mgr.24569) 3083 : cluster [DBG] pgmap v2658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:57:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:25.367388+0000 mgr.smithi067.rdualw (mgr.24569) 3083 : cluster [DBG] pgmap v2658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:57:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:27.368105+0000 mgr.smithi067.rdualw (mgr.24569) 3084 : cluster [DBG] pgmap v2659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:27.368105+0000 mgr.smithi067.rdualw (mgr.24569) 3084 : cluster [DBG] pgmap v2659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:29.368700+0000 mgr.smithi067.rdualw (mgr.24569) 3085 : cluster [DBG] pgmap v2660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:29.368700+0000 mgr.smithi067.rdualw (mgr.24569) 3085 : cluster [DBG] pgmap v2660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:31.369497+0000 mgr.smithi067.rdualw (mgr.24569) 3086 : cluster [DBG] pgmap v2661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:31.369497+0000 mgr.smithi067.rdualw (mgr.24569) 3086 : cluster [DBG] pgmap v2661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:33.369991+0000 mgr.smithi067.rdualw (mgr.24569) 3087 : cluster [DBG] pgmap v2662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:33.369991+0000 mgr.smithi067.rdualw (mgr.24569) 3087 : cluster [DBG] pgmap v2662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:57:34.900132+0000 mon.smithi067 (mon.1) 499 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:57:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:57:34.900391+0000 mon.smithi061 (mon.0) 802 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:57:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:57:34.900482+0000 mon.smithi067 (mon.1) 500 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:57:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:57:34.900688+0000 mon.smithi061 (mon.0) 803 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:57:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:57:34.900132+0000 mon.smithi067 (mon.1) 499 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:57:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:57:34.900391+0000 mon.smithi061 (mon.0) 802 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:57:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:57:34.900482+0000 mon.smithi067 (mon.1) 500 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:57:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:57:34.900688+0000 mon.smithi061 (mon.0) 803 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:57:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:35.370791+0000 mgr.smithi067.rdualw (mgr.24569) 3088 : cluster [DBG] pgmap v2663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:57:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:35.370791+0000 mgr.smithi067.rdualw (mgr.24569) 3088 : cluster [DBG] pgmap v2663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:57:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:37.371599+0000 mgr.smithi067.rdualw (mgr.24569) 3089 : cluster [DBG] pgmap v2664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:37.371599+0000 mgr.smithi067.rdualw (mgr.24569) 3089 : cluster [DBG] pgmap v2664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:39.372135+0000 mgr.smithi067.rdualw (mgr.24569) 3090 : cluster [DBG] pgmap v2665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:39.372135+0000 mgr.smithi067.rdualw (mgr.24569) 3090 : cluster [DBG] pgmap v2665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:41.373058+0000 mgr.smithi067.rdualw (mgr.24569) 3091 : cluster [DBG] pgmap v2666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:41.373058+0000 mgr.smithi067.rdualw (mgr.24569) 3091 : cluster [DBG] pgmap v2666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:44.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:43.373575+0000 mgr.smithi067.rdualw (mgr.24569) 3092 : cluster [DBG] pgmap v2667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:43.373575+0000 mgr.smithi067.rdualw (mgr.24569) 3092 : cluster [DBG] pgmap v2667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:45.374426+0000 mgr.smithi067.rdualw (mgr.24569) 3093 : cluster [DBG] pgmap v2668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:57:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:45.374426+0000 mgr.smithi067.rdualw (mgr.24569) 3093 : cluster [DBG] pgmap v2668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:57:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:47.375028+0000 mgr.smithi067.rdualw (mgr.24569) 3094 : cluster [DBG] pgmap v2669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:47.375028+0000 mgr.smithi067.rdualw (mgr.24569) 3094 : cluster [DBG] pgmap v2669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:50.313 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:57:50.605 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:57:50.605 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (95m) 5m ago 96m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:57:50.605 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (88m) 5m ago 96m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:57:50.605 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (87m) 5m ago 95m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:57:50.606 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (95m) 5m ago 96m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:57:50.606 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (88m) 5m ago 92m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:57:50.606 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (88m) 5m ago 92m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:57:50.607 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (89m) 5m ago 97m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:57:50.607 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (89m) 5m ago 95m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:57:50.607 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (89m) 5m ago 97m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:57:50.607 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (88m) 5m ago 95m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:57:50.607 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (89m) 5m ago 89m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:57:50.608 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (89m) 5m ago 89m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:57:50.608 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (96m) 5m ago 96m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:57:50.608 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (95m) 5m ago 95m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:57:50.608 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (78m) 5m ago 95m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:57:50.609 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (95m) 5m ago 95m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:57:50.609 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (94m) 5m ago 94m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:57:50.609 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (94m) 5m ago 94m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:57:50.609 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (94m) 5m ago 94m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:57:50.610 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (93m) 5m ago 93m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:57:50.610 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (93m) 5m ago 93m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:57:50.610 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (93m) 5m ago 93m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:57:50.611 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (95m) 5m ago 96m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:57:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:49.375650+0000 mgr.smithi067.rdualw (mgr.24569) 3095 : cluster [DBG] pgmap v2670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:49.375650+0000 mgr.smithi067.rdualw (mgr.24569) 3095 : cluster [DBG] pgmap v2670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:50.946 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:57:50.947 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:57:50.947 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:57:50.948 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:57:50.948 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:57:50.949 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:57:50.949 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:57:50.950 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:57:50.950 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:57:50.951 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:57:50.952 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:57:50.952 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:57:50.952 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:57:50.953 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:57:50.953 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:57:50.954 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:57:50.954 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:57:50.955 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:57:50.956 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:57:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:57:50.300345+0000 mgr.smithi067.rdualw (mgr.24569) 3096 : audit [DBG] from='client.36202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:57:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:57:50.587667+0000 mgr.smithi067.rdualw (mgr.24569) 3097 : audit [DBG] from='client.36206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:57:51.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:57:50.943941+0000 mon.smithi061 (mon.0) 804 : audit [DBG] from='client.? 172.21.15.61:0/3368963219' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:57:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:57:50.300345+0000 mgr.smithi067.rdualw (mgr.24569) 3096 : audit [DBG] from='client.36202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:57:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:57:50.587667+0000 mgr.smithi067.rdualw (mgr.24569) 3097 : audit [DBG] from='client.36206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:57:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:57:50.943941+0000 mon.smithi061 (mon.0) 804 : audit [DBG] from='client.? 172.21.15.61:0/3368963219' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:57:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:51.376513+0000 mgr.smithi067.rdualw (mgr.24569) 3098 : cluster [DBG] pgmap v2671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:51.376513+0000 mgr.smithi067.rdualw (mgr.24569) 3098 : cluster [DBG] pgmap v2671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:53.377134+0000 mgr.smithi067.rdualw (mgr.24569) 3099 : cluster [DBG] pgmap v2672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:53.377134+0000 mgr.smithi067.rdualw (mgr.24569) 3099 : cluster [DBG] pgmap v2672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:55.377981+0000 mgr.smithi067.rdualw (mgr.24569) 3100 : cluster [DBG] pgmap v2673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:57:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:55.377981+0000 mgr.smithi067.rdualw (mgr.24569) 3100 : cluster [DBG] pgmap v2673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:57:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:57:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:57.378684+0000 mgr.smithi067.rdualw (mgr.24569) 3101 : cluster [DBG] pgmap v2674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:57:58.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:57:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:57.378684+0000 mgr.smithi067.rdualw (mgr.24569) 3101 : cluster [DBG] pgmap v2674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:57:59.379265+0000 mgr.smithi067.rdualw (mgr.24569) 3102 : cluster [DBG] pgmap v2675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:57:59.379265+0000 mgr.smithi067.rdualw (mgr.24569) 3102 : cluster [DBG] pgmap v2675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:01.380250+0000 mgr.smithi067.rdualw (mgr.24569) 3103 : cluster [DBG] pgmap v2676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:01.380250+0000 mgr.smithi067.rdualw (mgr.24569) 3103 : cluster [DBG] pgmap v2676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:03.380772+0000 mgr.smithi067.rdualw (mgr.24569) 3104 : cluster [DBG] pgmap v2677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:03.380772+0000 mgr.smithi067.rdualw (mgr.24569) 3104 : cluster [DBG] pgmap v2677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:05.381487+0000 mgr.smithi067.rdualw (mgr.24569) 3105 : cluster [DBG] pgmap v2678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:58:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:58:05.481630+0000 mon.smithi067 (mon.1) 501 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:58:06.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:58:05.483243+0000 mon.smithi067 (mon.1) 502 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:58:06.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:58:05.484279+0000 mon.smithi067 (mon.1) 503 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:58:06.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:58:05.485239+0000 mgr.smithi067.rdualw (mgr.24569) 3106 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:58:06.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:58:05.898190+0000 mon.smithi061 (mon.0) 805 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:58:06.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:58:05.904502+0000 mon.smithi061 (mon.0) 806 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:58:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:05.381487+0000 mgr.smithi067.rdualw (mgr.24569) 3105 : cluster [DBG] pgmap v2678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:58:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:58:05.481630+0000 mon.smithi067 (mon.1) 501 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:58:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:58:05.483243+0000 mon.smithi067 (mon.1) 502 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:58:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:58:05.484279+0000 mon.smithi067 (mon.1) 503 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:58:06.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:58:05.485239+0000 mgr.smithi067.rdualw (mgr.24569) 3106 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:58:06.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:58:05.898190+0000 mon.smithi061 (mon.0) 805 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:58:06.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:58:05.904502+0000 mon.smithi061 (mon.0) 806 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:58:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:07.382206+0000 mgr.smithi067.rdualw (mgr.24569) 3107 : cluster [DBG] pgmap v2679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:08.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:07.382206+0000 mgr.smithi067.rdualw (mgr.24569) 3107 : cluster [DBG] pgmap v2679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:09.382850+0000 mgr.smithi067.rdualw (mgr.24569) 3108 : cluster [DBG] pgmap v2680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:09.382850+0000 mgr.smithi067.rdualw (mgr.24569) 3108 : cluster [DBG] pgmap v2680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:11.383753+0000 mgr.smithi067.rdualw (mgr.24569) 3109 : cluster [DBG] pgmap v2681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:11.383753+0000 mgr.smithi067.rdualw (mgr.24569) 3109 : cluster [DBG] pgmap v2681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:13.384341+0000 mgr.smithi067.rdualw (mgr.24569) 3110 : cluster [DBG] pgmap v2682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:13.384341+0000 mgr.smithi067.rdualw (mgr.24569) 3110 : cluster [DBG] pgmap v2682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:15.385241+0000 mgr.smithi067.rdualw (mgr.24569) 3111 : cluster [DBG] pgmap v2683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:58:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:15.385241+0000 mgr.smithi067.rdualw (mgr.24569) 3111 : cluster [DBG] pgmap v2683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:58:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:17.385990+0000 mgr.smithi067.rdualw (mgr.24569) 3112 : cluster [DBG] pgmap v2684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:17.385990+0000 mgr.smithi067.rdualw (mgr.24569) 3112 : cluster [DBG] pgmap v2684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:19.386717+0000 mgr.smithi067.rdualw (mgr.24569) 3113 : cluster [DBG] pgmap v2685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:19.386717+0000 mgr.smithi067.rdualw (mgr.24569) 3113 : cluster [DBG] pgmap v2685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:21.254 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:58:21.548 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:58:21.548 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (95m) 6m ago 96m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:58:21.548 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (88m) 6m ago 96m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:58:21.549 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (88m) 6m ago 96m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:58:21.549 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (95m) 6m ago 96m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:58:21.549 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (89m) 6m ago 92m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:58:21.549 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (88m) 6m ago 92m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:58:21.550 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (90m) 6m ago 98m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:58:21.550 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (89m) 6m ago 96m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:58:21.551 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (89m) 6m ago 98m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:58:21.551 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (89m) 6m ago 96m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:58:21.551 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (90m) 6m ago 90m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:58:21.551 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (90m) 6m ago 90m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:58:21.552 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (96m) 6m ago 96m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:58:21.552 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (96m) 6m ago 96m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:58:21.552 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (79m) 6m ago 95m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:58:21.552 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (95m) 6m ago 95m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:58:21.552 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (95m) 6m ago 95m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:58:21.553 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (94m) 6m ago 94m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:58:21.553 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (94m) 6m ago 94m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:58:21.553 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (94m) 6m ago 94m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:58:21.553 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (94m) 6m ago 94m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:58:21.553 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (93m) 6m ago 93m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:58:21.553 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (95m) 6m ago 96m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:58:21.922 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:58:21.922 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:58:21.923 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:58:21.923 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:58:21.923 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:58:21.923 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:58:21.924 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:58:21.924 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:58:21.924 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:58:21.925 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:58:21.925 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:58:21.925 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:58:21.925 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:58:21.925 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:58:21.926 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:58:21.926 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:58:21.926 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:58:21.926 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:58:21.926 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:58:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:58:21.241190+0000 mgr.smithi067.rdualw (mgr.24569) 3114 : audit [DBG] from='client.36214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:58:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:21.387790+0000 mgr.smithi067.rdualw (mgr.24569) 3115 : cluster [DBG] pgmap v2686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:58:21.530246+0000 mgr.smithi067.rdualw (mgr.24569) 3116 : audit [DBG] from='client.36218 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:58:22.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:58:21.920921+0000 mon.smithi061 (mon.0) 807 : audit [DBG] from='client.? 172.21.15.61:0/1878157155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:58:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:58:21.241190+0000 mgr.smithi067.rdualw (mgr.24569) 3114 : audit [DBG] from='client.36214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:58:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:21.387790+0000 mgr.smithi067.rdualw (mgr.24569) 3115 : cluster [DBG] pgmap v2686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:58:21.530246+0000 mgr.smithi067.rdualw (mgr.24569) 3116 : audit [DBG] from='client.36218 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:58:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:58:21.920921+0000 mon.smithi061 (mon.0) 807 : audit [DBG] from='client.? 172.21.15.61:0/1878157155' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:58:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:23.388305+0000 mgr.smithi067.rdualw (mgr.24569) 3117 : cluster [DBG] pgmap v2687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:23.388305+0000 mgr.smithi067.rdualw (mgr.24569) 3117 : cluster [DBG] pgmap v2687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:25.389088+0000 mgr.smithi067.rdualw (mgr.24569) 3118 : cluster [DBG] pgmap v2688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:58:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:25.389088+0000 mgr.smithi067.rdualw (mgr.24569) 3118 : cluster [DBG] pgmap v2688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:58:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:27.389928+0000 mgr.smithi067.rdualw (mgr.24569) 3119 : cluster [DBG] pgmap v2689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:27.389928+0000 mgr.smithi067.rdualw (mgr.24569) 3119 : cluster [DBG] pgmap v2689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:29.390630+0000 mgr.smithi067.rdualw (mgr.24569) 3120 : cluster [DBG] pgmap v2690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:29.390630+0000 mgr.smithi067.rdualw (mgr.24569) 3120 : cluster [DBG] pgmap v2690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:31.391550+0000 mgr.smithi067.rdualw (mgr.24569) 3121 : cluster [DBG] pgmap v2691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:31.391550+0000 mgr.smithi067.rdualw (mgr.24569) 3121 : cluster [DBG] pgmap v2691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:33.392249+0000 mgr.smithi067.rdualw (mgr.24569) 3122 : cluster [DBG] pgmap v2692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:33.392249+0000 mgr.smithi067.rdualw (mgr.24569) 3122 : cluster [DBG] pgmap v2692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:58:34.905543+0000 mon.smithi067 (mon.1) 504 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:58:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:58:34.905636+0000 mon.smithi061 (mon.0) 808 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:58:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:58:34.905809+0000 mon.smithi067 (mon.1) 505 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:58:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:58:34.905931+0000 mon.smithi061 (mon.0) 809 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:58:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:58:34.905543+0000 mon.smithi067 (mon.1) 504 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:58:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:58:34.905636+0000 mon.smithi061 (mon.0) 808 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:58:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:58:34.905809+0000 mon.smithi067 (mon.1) 505 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:58:35.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:58:34.905931+0000 mon.smithi061 (mon.0) 809 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:58:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:35.393083+0000 mgr.smithi067.rdualw (mgr.24569) 3123 : cluster [DBG] pgmap v2693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:58:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:35.393083+0000 mgr.smithi067.rdualw (mgr.24569) 3123 : cluster [DBG] pgmap v2693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:58:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:37.393720+0000 mgr.smithi067.rdualw (mgr.24569) 3124 : cluster [DBG] pgmap v2694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:37.393720+0000 mgr.smithi067.rdualw (mgr.24569) 3124 : cluster [DBG] pgmap v2694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:39.394299+0000 mgr.smithi067.rdualw (mgr.24569) 3125 : cluster [DBG] pgmap v2695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:39.394299+0000 mgr.smithi067.rdualw (mgr.24569) 3125 : cluster [DBG] pgmap v2695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:42.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:41.395173+0000 mgr.smithi067.rdualw (mgr.24569) 3126 : cluster [DBG] pgmap v2696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:41.395173+0000 mgr.smithi067.rdualw (mgr.24569) 3126 : cluster [DBG] pgmap v2696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:43.395817+0000 mgr.smithi067.rdualw (mgr.24569) 3127 : cluster [DBG] pgmap v2697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:43.395817+0000 mgr.smithi067.rdualw (mgr.24569) 3127 : cluster [DBG] pgmap v2697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:45.396530+0000 mgr.smithi067.rdualw (mgr.24569) 3128 : cluster [DBG] pgmap v2698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:58:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:45.396530+0000 mgr.smithi067.rdualw (mgr.24569) 3128 : cluster [DBG] pgmap v2698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:58:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:47.397310+0000 mgr.smithi067.rdualw (mgr.24569) 3129 : cluster [DBG] pgmap v2699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:47.397310+0000 mgr.smithi067.rdualw (mgr.24569) 3129 : cluster [DBG] pgmap v2699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:49.397992+0000 mgr.smithi067.rdualw (mgr.24569) 3130 : cluster [DBG] pgmap v2700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:49.397992+0000 mgr.smithi067.rdualw (mgr.24569) 3130 : cluster [DBG] pgmap v2700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:52.232 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:58:52.524 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:58:52.525 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (96m) 6m ago 97m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:58:52.525 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (89m) 6m ago 97m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:58:52.525 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (88m) 6m ago 97m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:58:52.525 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (96m) 6m ago 97m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:58:52.526 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (89m) 6m ago 93m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:58:52.526 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (89m) 6m ago 93m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:58:52.526 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (90m) 6m ago 98m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:58:52.526 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (90m) 6m ago 96m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:58:52.527 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (90m) 6m ago 98m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:58:52.527 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (89m) 6m ago 96m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:58:52.527 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (90m) 6m ago 90m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:58:52.527 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (90m) 6m ago 90m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:58:52.527 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (97m) 6m ago 97m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:58:52.528 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (96m) 6m ago 96m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:58:52.528 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (79m) 6m ago 96m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:58:52.528 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (96m) 6m ago 96m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:58:52.528 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (95m) 6m ago 95m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:58:52.528 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (95m) 6m ago 95m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:58:52.529 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (95m) 6m ago 95m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:58:52.529 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (95m) 6m ago 95m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:58:52.529 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (94m) 6m ago 94m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:58:52.529 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (94m) 6m ago 94m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:58:52.530 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (96m) 6m ago 97m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:58:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:51.398852+0000 mgr.smithi067.rdualw (mgr.24569) 3131 : cluster [DBG] pgmap v2701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:51.398852+0000 mgr.smithi067.rdualw (mgr.24569) 3131 : cluster [DBG] pgmap v2701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:52.930 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:58:52.930 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:58:52.930 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:58:52.931 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:58:52.931 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:58:52.931 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:58:52.931 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:58:52.931 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:58:52.932 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:58:52.932 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:58:52.932 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:58:52.932 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:58:52.933 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:58:52.933 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:58:52.933 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:58:52.934 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:58:52.934 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:58:52.934 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:58:52.934 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:58:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:58:52.218174+0000 mgr.smithi067.rdualw (mgr.24569) 3132 : audit [DBG] from='client.36226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:58:53.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:58:52.506673+0000 mgr.smithi067.rdualw (mgr.24569) 3133 : audit [DBG] from='client.36230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:58:53.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:58:52.928656+0000 mon.smithi061 (mon.0) 810 : audit [DBG] from='client.? 172.21.15.61:0/2387436147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:58:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:58:52.218174+0000 mgr.smithi067.rdualw (mgr.24569) 3132 : audit [DBG] from='client.36226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:58:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:58:52.506673+0000 mgr.smithi067.rdualw (mgr.24569) 3133 : audit [DBG] from='client.36230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:58:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:58:52.928656+0000 mon.smithi061 (mon.0) 810 : audit [DBG] from='client.? 172.21.15.61:0/2387436147' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:58:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:53.399509+0000 mgr.smithi067.rdualw (mgr.24569) 3134 : cluster [DBG] pgmap v2702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:53.399509+0000 mgr.smithi067.rdualw (mgr.24569) 3134 : cluster [DBG] pgmap v2702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:55.400453+0000 mgr.smithi067.rdualw (mgr.24569) 3135 : cluster [DBG] pgmap v2703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:58:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:55.400453+0000 mgr.smithi067.rdualw (mgr.24569) 3135 : cluster [DBG] pgmap v2703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:58:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:58:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:57.401164+0000 mgr.smithi067.rdualw (mgr.24569) 3136 : cluster [DBG] pgmap v2704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:58:58.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:58:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:57.401164+0000 mgr.smithi067.rdualw (mgr.24569) 3136 : cluster [DBG] pgmap v2704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:58:59.401771+0000 mgr.smithi067.rdualw (mgr.24569) 3137 : cluster [DBG] pgmap v2705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:00.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:58:59.401771+0000 mgr.smithi067.rdualw (mgr.24569) 3137 : cluster [DBG] pgmap v2705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:01.402731+0000 mgr.smithi067.rdualw (mgr.24569) 3138 : cluster [DBG] pgmap v2706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:01.402731+0000 mgr.smithi067.rdualw (mgr.24569) 3138 : cluster [DBG] pgmap v2706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:03.403313+0000 mgr.smithi067.rdualw (mgr.24569) 3139 : cluster [DBG] pgmap v2707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:03.403313+0000 mgr.smithi067.rdualw (mgr.24569) 3139 : cluster [DBG] pgmap v2707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:05.404305+0000 mgr.smithi067.rdualw (mgr.24569) 3140 : cluster [DBG] pgmap v2708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:59:06.565 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:59:05.908491+0000 mon.smithi067 (mon.1) 506 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:59:06.566 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:59:05.909971+0000 mon.smithi067 (mon.1) 507 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:59:06.567 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:59:05.910932+0000 mon.smithi067 (mon.1) 508 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:59:06.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:05.404305+0000 mgr.smithi067.rdualw (mgr.24569) 3140 : cluster [DBG] pgmap v2708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:59:06.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:59:05.908491+0000 mon.smithi067 (mon.1) 506 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T16:59:06.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:59:05.909971+0000 mon.smithi067 (mon.1) 507 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T16:59:06.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:59:05.910932+0000 mon.smithi067 (mon.1) 508 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T16:59:07.581 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T16:59:05.911770+0000 mgr.smithi067.rdualw (mgr.24569) 3141 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:59:07.581 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:59:06.329496+0000 mon.smithi061 (mon.0) 811 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:59:07.581 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:59:06.335511+0000 mon.smithi061 (mon.0) 812 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:59:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T16:59:05.911770+0000 mgr.smithi067.rdualw (mgr.24569) 3141 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T16:59:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:59:06.329496+0000 mon.smithi061 (mon.0) 811 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:59:07.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:59:06.335511+0000 mon.smithi061 (mon.0) 812 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T16:59:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:07.404782+0000 mgr.smithi067.rdualw (mgr.24569) 3142 : cluster [DBG] pgmap v2709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:08.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:07.404782+0000 mgr.smithi067.rdualw (mgr.24569) 3142 : cluster [DBG] pgmap v2709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:09.405379+0000 mgr.smithi067.rdualw (mgr.24569) 3143 : cluster [DBG] pgmap v2710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:09.405379+0000 mgr.smithi067.rdualw (mgr.24569) 3143 : cluster [DBG] pgmap v2710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:11.406352+0000 mgr.smithi067.rdualw (mgr.24569) 3144 : cluster [DBG] pgmap v2711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:11.406352+0000 mgr.smithi067.rdualw (mgr.24569) 3144 : cluster [DBG] pgmap v2711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:13.407117+0000 mgr.smithi067.rdualw (mgr.24569) 3145 : cluster [DBG] pgmap v2712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:13.407117+0000 mgr.smithi067.rdualw (mgr.24569) 3145 : cluster [DBG] pgmap v2712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:15.408044+0000 mgr.smithi067.rdualw (mgr.24569) 3146 : cluster [DBG] pgmap v2713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:59:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:15.408044+0000 mgr.smithi067.rdualw (mgr.24569) 3146 : cluster [DBG] pgmap v2713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:59:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:17.408565+0000 mgr.smithi067.rdualw (mgr.24569) 3147 : cluster [DBG] pgmap v2714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:17.408565+0000 mgr.smithi067.rdualw (mgr.24569) 3147 : cluster [DBG] pgmap v2714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:19.409109+0000 mgr.smithi067.rdualw (mgr.24569) 3148 : cluster [DBG] pgmap v2715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:19.409109+0000 mgr.smithi067.rdualw (mgr.24569) 3148 : cluster [DBG] pgmap v2715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:21.409942+0000 mgr.smithi067.rdualw (mgr.24569) 3149 : cluster [DBG] pgmap v2716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:21.409942+0000 mgr.smithi067.rdualw (mgr.24569) 3149 : cluster [DBG] pgmap v2716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:23.242 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:59:23.606 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:59:23.607 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (96m) 7m ago 98m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:59:23.607 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (89m) 7m ago 97m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:59:23.607 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (89m) 7m ago 97m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:59:23.608 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (96m) 7m ago 97m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:59:23.608 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (90m) 7m ago 93m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:59:23.608 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (89m) 7m ago 93m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:59:23.608 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (91m) 7m ago 99m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:59:23.609 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (90m) 7m ago 97m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:59:23.609 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (90m) 7m ago 99m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:59:23.609 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (90m) 7m ago 97m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:59:23.610 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (91m) 7m ago 91m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:59:23.610 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (91m) 7m ago 91m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:59:23.610 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (97m) 7m ago 97m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:59:23.610 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (97m) 7m ago 97m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:59:23.610 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (80m) 7m ago 96m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:59:23.611 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (96m) 7m ago 96m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:59:23.611 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (96m) 7m ago 96m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:59:23.611 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (96m) 7m ago 96m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:59:23.611 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (95m) 7m ago 95m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:59:23.612 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (95m) 7m ago 95m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:59:23.612 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (95m) 7m ago 95m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:59:23.612 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (95m) 7m ago 95m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:59:23.613 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (96m) 7m ago 97m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:59:23.980 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:59:23.981 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:59:23.981 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:59:23.981 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:59:23.981 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:59:23.982 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:59:23.982 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:59:23.982 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:59:23.982 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:59:23.983 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:59:23.983 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:59:23.983 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:59:23.983 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:59:23.984 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:59:23.984 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:59:23.984 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:59:23.984 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:59:23.984 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:59:23.985 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:59:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:59:23.228620+0000 mgr.smithi067.rdualw (mgr.24569) 3150 : audit [DBG] from='client.36238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:59:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:23.410455+0000 mgr.smithi067.rdualw (mgr.24569) 3151 : cluster [DBG] pgmap v2717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:59:23.588560+0000 mgr.smithi067.rdualw (mgr.24569) 3152 : audit [DBG] from='client.36242 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:59:24.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:59:23.979350+0000 mon.smithi061 (mon.0) 813 : audit [DBG] from='client.? 172.21.15.61:0/4281543615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:59:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:59:23.228620+0000 mgr.smithi067.rdualw (mgr.24569) 3150 : audit [DBG] from='client.36238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:59:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:23.410455+0000 mgr.smithi067.rdualw (mgr.24569) 3151 : cluster [DBG] pgmap v2717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:59:23.588560+0000 mgr.smithi067.rdualw (mgr.24569) 3152 : audit [DBG] from='client.36242 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:59:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:59:23.979350+0000 mon.smithi061 (mon.0) 813 : audit [DBG] from='client.? 172.21.15.61:0/4281543615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:59:26.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:25.411253+0000 mgr.smithi067.rdualw (mgr.24569) 3153 : cluster [DBG] pgmap v2718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:59:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:25.411253+0000 mgr.smithi067.rdualw (mgr.24569) 3153 : cluster [DBG] pgmap v2718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:59:28.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:27.411925+0000 mgr.smithi067.rdualw (mgr.24569) 3154 : cluster [DBG] pgmap v2719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:27.411925+0000 mgr.smithi067.rdualw (mgr.24569) 3154 : cluster [DBG] pgmap v2719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:29.412718+0000 mgr.smithi067.rdualw (mgr.24569) 3155 : cluster [DBG] pgmap v2720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:29.412718+0000 mgr.smithi067.rdualw (mgr.24569) 3155 : cluster [DBG] pgmap v2720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:31.413733+0000 mgr.smithi067.rdualw (mgr.24569) 3156 : cluster [DBG] pgmap v2721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:31.413733+0000 mgr.smithi067.rdualw (mgr.24569) 3156 : cluster [DBG] pgmap v2721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:33.414296+0000 mgr.smithi067.rdualw (mgr.24569) 3157 : cluster [DBG] pgmap v2722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:33.414296+0000 mgr.smithi067.rdualw (mgr.24569) 3157 : cluster [DBG] pgmap v2722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:59:34.910877+0000 mon.smithi067 (mon.1) 509 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:59:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:59:34.911152+0000 mon.smithi067 (mon.1) 510 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:59:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:59:34.911181+0000 mon.smithi061 (mon.0) 814 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:59:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:59:34.911516+0000 mon.smithi061 (mon.0) 815 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:59:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:59:34.910877+0000 mon.smithi067 (mon.1) 509 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:59:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:59:34.911152+0000 mon.smithi067 (mon.1) 510 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:59:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:59:34.911181+0000 mon.smithi061 (mon.0) 814 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T16:59:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:59:34.911516+0000 mon.smithi061 (mon.0) 815 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T16:59:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:35.415152+0000 mgr.smithi067.rdualw (mgr.24569) 3158 : cluster [DBG] pgmap v2723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:59:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:35.415152+0000 mgr.smithi067.rdualw (mgr.24569) 3158 : cluster [DBG] pgmap v2723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:59:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:37.415684+0000 mgr.smithi067.rdualw (mgr.24569) 3159 : cluster [DBG] pgmap v2724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:37.415684+0000 mgr.smithi067.rdualw (mgr.24569) 3159 : cluster [DBG] pgmap v2724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:39.416259+0000 mgr.smithi067.rdualw (mgr.24569) 3160 : cluster [DBG] pgmap v2725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:39.416259+0000 mgr.smithi067.rdualw (mgr.24569) 3160 : cluster [DBG] pgmap v2725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:42.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:41.417202+0000 mgr.smithi067.rdualw (mgr.24569) 3161 : cluster [DBG] pgmap v2726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:41.417202+0000 mgr.smithi067.rdualw (mgr.24569) 3161 : cluster [DBG] pgmap v2726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:44.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:43.417727+0000 mgr.smithi067.rdualw (mgr.24569) 3162 : cluster [DBG] pgmap v2727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:43.417727+0000 mgr.smithi067.rdualw (mgr.24569) 3162 : cluster [DBG] pgmap v2727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:45.418626+0000 mgr.smithi067.rdualw (mgr.24569) 3163 : cluster [DBG] pgmap v2728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:59:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:45.418626+0000 mgr.smithi067.rdualw (mgr.24569) 3163 : cluster [DBG] pgmap v2728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:59:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:47.419378+0000 mgr.smithi067.rdualw (mgr.24569) 3164 : cluster [DBG] pgmap v2729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:47.419378+0000 mgr.smithi067.rdualw (mgr.24569) 3164 : cluster [DBG] pgmap v2729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:49.419980+0000 mgr.smithi067.rdualw (mgr.24569) 3165 : cluster [DBG] pgmap v2730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:49.419980+0000 mgr.smithi067.rdualw (mgr.24569) 3165 : cluster [DBG] pgmap v2730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:51.421106+0000 mgr.smithi067.rdualw (mgr.24569) 3166 : cluster [DBG] pgmap v2731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:51.421106+0000 mgr.smithi067.rdualw (mgr.24569) 3166 : cluster [DBG] pgmap v2731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:54.294 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T16:59:54.647 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T16:59:54.648 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (97m) 7m ago 98m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T16:59:54.648 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (90m) 7m ago 98m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T16:59:54.648 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (89m) 8m ago 98m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T16:59:54.649 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (97m) 7m ago 98m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T16:59:54.649 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (90m) 7m ago 94m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T16:59:54.649 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (90m) 8m ago 94m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T16:59:54.649 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (91m) 7m ago 99m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T16:59:54.650 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (91m) 8m ago 97m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T16:59:54.650 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (91m) 7m ago 99m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T16:59:54.650 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (90m) 8m ago 97m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T16:59:54.650 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (91m) 7m ago 91m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T16:59:54.650 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (91m) 8m ago 91m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T16:59:54.651 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (98m) 7m ago 98m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T16:59:54.651 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (97m) 8m ago 97m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T16:59:54.651 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (80m) 7m ago 97m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T16:59:54.651 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (97m) 7m ago 97m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T16:59:54.652 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (96m) 7m ago 96m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T16:59:54.652 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (96m) 7m ago 96m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T16:59:54.652 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (96m) 8m ago 96m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T16:59:54.652 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (96m) 8m ago 96m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T16:59:54.652 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (95m) 8m ago 95m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T16:59:54.653 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (95m) 8m ago 95m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T16:59:54.653 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (97m) 7m ago 98m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T16:59:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:53.421670+0000 mgr.smithi067.rdualw (mgr.24569) 3167 : cluster [DBG] pgmap v2732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:53.421670+0000 mgr.smithi067.rdualw (mgr.24569) 3167 : cluster [DBG] pgmap v2732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:54.988 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T16:59:54.989 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T16:59:54.989 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T16:59:54.989 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:59:54.989 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T16:59:54.990 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:59:54.990 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:59:54.990 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T16:59:54.990 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T16:59:54.991 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T16:59:54.991 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:59:54.991 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T16:59:54.991 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T16:59:54.992 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T16:59:54.992 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T16:59:54.992 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T16:59:54.992 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T16:59:54.992 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T16:59:54.993 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T16:59:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:59:54.281376+0000 mgr.smithi067.rdualw (mgr.24569) 3168 : audit [DBG] from='client.36250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:59:55.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:59:54.630224+0000 mgr.smithi067.rdualw (mgr.24569) 3169 : audit [DBG] from='client.36254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:59:55.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T16:59:54.987160+0000 mon.smithi061 (mon.0) 816 : audit [DBG] from='client.? 172.21.15.61:0/774125005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:59:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:59:54.281376+0000 mgr.smithi067.rdualw (mgr.24569) 3168 : audit [DBG] from='client.36250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:59:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:59:54.630224+0000 mgr.smithi067.rdualw (mgr.24569) 3169 : audit [DBG] from='client.36254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T16:59:55.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T16:59:54.987160+0000 mon.smithi061 (mon.0) 816 : audit [DBG] from='client.? 172.21.15.61:0/774125005' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T16:59:56.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:55.422681+0000 mgr.smithi067.rdualw (mgr.24569) 3170 : cluster [DBG] pgmap v2733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:59:56.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:55.422681+0000 mgr.smithi067.rdualw (mgr.24569) 3170 : cluster [DBG] pgmap v2733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T16:59:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 16:59:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:57.423224+0000 mgr.smithi067.rdualw (mgr.24569) 3171 : cluster [DBG] pgmap v2734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T16:59:58.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 16:59:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:57.423224+0000 mgr.smithi067.rdualw (mgr.24569) 3171 : cluster [DBG] pgmap v2734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T16:59:59.424036+0000 mgr.smithi067.rdualw (mgr.24569) 3172 : cluster [DBG] pgmap v2735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:00.000159+0000 mon.smithi061 (mon.0) 817 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T17:00:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T16:59:59.424036+0000 mgr.smithi067.rdualw (mgr.24569) 3172 : cluster [DBG] pgmap v2735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:00.000159+0000 mon.smithi061 (mon.0) 817 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T17:00:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:01.424947+0000 mgr.smithi067.rdualw (mgr.24569) 3173 : cluster [DBG] pgmap v2736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:01.424947+0000 mgr.smithi067.rdualw (mgr.24569) 3173 : cluster [DBG] pgmap v2736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:03.425741+0000 mgr.smithi067.rdualw (mgr.24569) 3174 : cluster [DBG] pgmap v2737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:04.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:03.425741+0000 mgr.smithi067.rdualw (mgr.24569) 3174 : cluster [DBG] pgmap v2737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:06.524 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:05.426606+0000 mgr.smithi067.rdualw (mgr.24569) 3175 : cluster [DBG] pgmap v2738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:00:06.535 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:05.426606+0000 mgr.smithi067.rdualw (mgr.24569) 3175 : cluster [DBG] pgmap v2738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:00:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:00:06.339339+0000 mon.smithi067 (mon.1) 511 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:00:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:00:06.340715+0000 mon.smithi067 (mon.1) 512 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:00:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:00:06.341661+0000 mon.smithi067 (mon.1) 513 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:00:07.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:00:06.342506+0000 mgr.smithi067.rdualw (mgr.24569) 3176 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:00:07.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:00:06.761395+0000 mon.smithi061 (mon.0) 818 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:00:07.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:00:06.766968+0000 mon.smithi061 (mon.0) 819 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:00:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:00:06.339339+0000 mon.smithi067 (mon.1) 511 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:00:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:00:06.340715+0000 mon.smithi067 (mon.1) 512 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:00:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:00:06.341661+0000 mon.smithi067 (mon.1) 513 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:00:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:00:06.342506+0000 mgr.smithi067.rdualw (mgr.24569) 3176 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:00:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:00:06.761395+0000 mon.smithi061 (mon.0) 818 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:00:07.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:00:06.766968+0000 mon.smithi061 (mon.0) 819 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:00:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:07.427266+0000 mgr.smithi067.rdualw (mgr.24569) 3177 : cluster [DBG] pgmap v2739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:07.427266+0000 mgr.smithi067.rdualw (mgr.24569) 3177 : cluster [DBG] pgmap v2739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:09.427943+0000 mgr.smithi067.rdualw (mgr.24569) 3178 : cluster [DBG] pgmap v2740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:09.427943+0000 mgr.smithi067.rdualw (mgr.24569) 3178 : cluster [DBG] pgmap v2740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:11.428814+0000 mgr.smithi067.rdualw (mgr.24569) 3179 : cluster [DBG] pgmap v2741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:11.428814+0000 mgr.smithi067.rdualw (mgr.24569) 3179 : cluster [DBG] pgmap v2741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:13.429512+0000 mgr.smithi067.rdualw (mgr.24569) 3180 : cluster [DBG] pgmap v2742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:13.429512+0000 mgr.smithi067.rdualw (mgr.24569) 3180 : cluster [DBG] pgmap v2742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:15.430474+0000 mgr.smithi067.rdualw (mgr.24569) 3181 : cluster [DBG] pgmap v2743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:00:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:15.430474+0000 mgr.smithi067.rdualw (mgr.24569) 3181 : cluster [DBG] pgmap v2743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:00:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:17.431069+0000 mgr.smithi067.rdualw (mgr.24569) 3182 : cluster [DBG] pgmap v2744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:17.431069+0000 mgr.smithi067.rdualw (mgr.24569) 3182 : cluster [DBG] pgmap v2744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:19.431814+0000 mgr.smithi067.rdualw (mgr.24569) 3183 : cluster [DBG] pgmap v2745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:19.431814+0000 mgr.smithi067.rdualw (mgr.24569) 3183 : cluster [DBG] pgmap v2745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:21.432698+0000 mgr.smithi067.rdualw (mgr.24569) 3184 : cluster [DBG] pgmap v2746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:21.432698+0000 mgr.smithi067.rdualw (mgr.24569) 3184 : cluster [DBG] pgmap v2746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:23.433331+0000 mgr.smithi067.rdualw (mgr.24569) 3185 : cluster [DBG] pgmap v2747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:23.433331+0000 mgr.smithi067.rdualw (mgr.24569) 3185 : cluster [DBG] pgmap v2747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:25.297 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:00:25.588 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:00:25.588 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (97m) 8m ago 99m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:00:25.588 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (90m) 8m ago 99m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:00:25.589 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (90m) 8m ago 98m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:00:25.589 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (97m) 8m ago 98m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:00:25.589 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (91m) 8m ago 94m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:00:25.589 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (90m) 8m ago 94m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:00:25.589 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (92m) 8m ago 100m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:00:25.590 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (91m) 8m ago 98m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:00:25.590 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (91m) 8m ago 100m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:00:25.590 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (91m) 8m ago 98m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:00:25.591 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (92m) 8m ago 92m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:00:25.591 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (92m) 8m ago 92m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:00:25.591 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (98m) 8m ago 98m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:00:25.591 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (98m) 8m ago 98m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:00:25.591 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (81m) 8m ago 97m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:00:25.592 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (97m) 8m ago 97m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:00:25.592 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (97m) 8m ago 97m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:00:25.592 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (97m) 8m ago 97m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:00:25.592 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (96m) 8m ago 96m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:00:25.593 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (96m) 8m ago 96m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:00:25.593 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (96m) 8m ago 96m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:00:25.593 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (96m) 8m ago 96m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:00:25.593 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (97m) 8m ago 98m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:00:25.933 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:00:25.933 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:00:25.934 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:00:25.934 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:00:25.934 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:00:25.935 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:00:25.935 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:00:25.935 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:00:25.936 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:00:25.936 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:00:25.936 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:00:25.937 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:00:25.937 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:00:25.938 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:00:25.938 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:00:25.938 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:00:25.939 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:00:25.939 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:00:25.939 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:00:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:00:25.283511+0000 mgr.smithi067.rdualw (mgr.24569) 3186 : audit [DBG] from='client.36262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:00:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:25.434099+0000 mgr.smithi067.rdualw (mgr.24569) 3187 : cluster [DBG] pgmap v2748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:00:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:00:25.570362+0000 mgr.smithi067.rdualw (mgr.24569) 3188 : audit [DBG] from='client.36266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:00:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:00:25.931206+0000 mon.smithi061 (mon.0) 820 : audit [DBG] from='client.? 172.21.15.61:0/2824092560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:00:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:00:25.283511+0000 mgr.smithi067.rdualw (mgr.24569) 3186 : audit [DBG] from='client.36262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:00:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:25.434099+0000 mgr.smithi067.rdualw (mgr.24569) 3187 : cluster [DBG] pgmap v2748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:00:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:00:25.570362+0000 mgr.smithi067.rdualw (mgr.24569) 3188 : audit [DBG] from='client.36266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:00:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:00:25.931206+0000 mon.smithi061 (mon.0) 820 : audit [DBG] from='client.? 172.21.15.61:0/2824092560' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:00:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:27.434614+0000 mgr.smithi067.rdualw (mgr.24569) 3189 : cluster [DBG] pgmap v2749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:27.434614+0000 mgr.smithi067.rdualw (mgr.24569) 3189 : cluster [DBG] pgmap v2749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:29.435253+0000 mgr.smithi067.rdualw (mgr.24569) 3190 : cluster [DBG] pgmap v2750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:29.435253+0000 mgr.smithi067.rdualw (mgr.24569) 3190 : cluster [DBG] pgmap v2750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:31.436322+0000 mgr.smithi067.rdualw (mgr.24569) 3191 : cluster [DBG] pgmap v2751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:31.436322+0000 mgr.smithi067.rdualw (mgr.24569) 3191 : cluster [DBG] pgmap v2751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:33.436885+0000 mgr.smithi067.rdualw (mgr.24569) 3192 : cluster [DBG] pgmap v2752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:33.436885+0000 mgr.smithi067.rdualw (mgr.24569) 3192 : cluster [DBG] pgmap v2752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:00:34.916584+0000 mon.smithi067 (mon.1) 514 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:00:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:00:34.916868+0000 mon.smithi061 (mon.0) 821 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:00:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:00:34.916881+0000 mon.smithi067 (mon.1) 515 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:00:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:00:34.917377+0000 mon.smithi061 (mon.0) 822 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:00:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:00:34.916584+0000 mon.smithi067 (mon.1) 514 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:00:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:00:34.916868+0000 mon.smithi061 (mon.0) 821 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:00:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:00:34.916881+0000 mon.smithi067 (mon.1) 515 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:00:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:00:34.917377+0000 mon.smithi061 (mon.0) 822 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:00:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:35.437881+0000 mgr.smithi067.rdualw (mgr.24569) 3193 : cluster [DBG] pgmap v2753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:00:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:35.437881+0000 mgr.smithi067.rdualw (mgr.24569) 3193 : cluster [DBG] pgmap v2753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:00:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:37.438503+0000 mgr.smithi067.rdualw (mgr.24569) 3194 : cluster [DBG] pgmap v2754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:37.438503+0000 mgr.smithi067.rdualw (mgr.24569) 3194 : cluster [DBG] pgmap v2754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:39.439361+0000 mgr.smithi067.rdualw (mgr.24569) 3195 : cluster [DBG] pgmap v2755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:39.439361+0000 mgr.smithi067.rdualw (mgr.24569) 3195 : cluster [DBG] pgmap v2755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:41.440302+0000 mgr.smithi067.rdualw (mgr.24569) 3196 : cluster [DBG] pgmap v2756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:41.440302+0000 mgr.smithi067.rdualw (mgr.24569) 3196 : cluster [DBG] pgmap v2756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:43.440890+0000 mgr.smithi067.rdualw (mgr.24569) 3197 : cluster [DBG] pgmap v2757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:43.440890+0000 mgr.smithi067.rdualw (mgr.24569) 3197 : cluster [DBG] pgmap v2757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:45.441947+0000 mgr.smithi067.rdualw (mgr.24569) 3198 : cluster [DBG] pgmap v2758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:00:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:45.441947+0000 mgr.smithi067.rdualw (mgr.24569) 3198 : cluster [DBG] pgmap v2758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:00:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:47.442429+0000 mgr.smithi067.rdualw (mgr.24569) 3199 : cluster [DBG] pgmap v2759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:47.442429+0000 mgr.smithi067.rdualw (mgr.24569) 3199 : cluster [DBG] pgmap v2759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:49.443202+0000 mgr.smithi067.rdualw (mgr.24569) 3200 : cluster [DBG] pgmap v2760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:49.443202+0000 mgr.smithi067.rdualw (mgr.24569) 3200 : cluster [DBG] pgmap v2760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:51.444214+0000 mgr.smithi067.rdualw (mgr.24569) 3201 : cluster [DBG] pgmap v2761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:51.444214+0000 mgr.smithi067.rdualw (mgr.24569) 3201 : cluster [DBG] pgmap v2761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:53.444935+0000 mgr.smithi067.rdualw (mgr.24569) 3202 : cluster [DBG] pgmap v2762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:53.444935+0000 mgr.smithi067.rdualw (mgr.24569) 3202 : cluster [DBG] pgmap v2762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:56.242 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:00:56.535 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:00:56.535 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (98m) 9m ago 99m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:00:56.535 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (91m) 9m ago 99m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:00:56.535 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (90m) 9m ago 99m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:00:56.536 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (98m) 9m ago 99m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:00:56.536 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (91m) 9m ago 95m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:00:56.536 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (91m) 9m ago 95m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:00:56.537 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (92m) 9m ago 100m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:00:56.537 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (92m) 9m ago 98m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:00:56.537 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (92m) 9m ago 100m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:00:56.537 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (91m) 9m ago 98m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:00:56.538 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (92m) 9m ago 92m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:00:56.538 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (92m) 9m ago 92m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:00:56.538 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (99m) 9m ago 99m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:00:56.538 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (98m) 9m ago 98m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:00:56.538 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (81m) 9m ago 98m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:00:56.539 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (98m) 9m ago 98m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:00:56.539 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (97m) 9m ago 97m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:00:56.539 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (97m) 9m ago 97m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:00:56.539 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (97m) 9m ago 97m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:00:56.540 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (97m) 9m ago 97m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:00:56.540 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (96m) 9m ago 96m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:00:56.540 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (96m) 9m ago 96m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:00:56.541 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (98m) 9m ago 99m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:00:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:55.445883+0000 mgr.smithi067.rdualw (mgr.24569) 3203 : cluster [DBG] pgmap v2763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:00:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:55.445883+0000 mgr.smithi067.rdualw (mgr.24569) 3203 : cluster [DBG] pgmap v2763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:00:56.874 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:00:56.875 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:00:56.875 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:00:56.875 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:00:56.876 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:00:56.876 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:00:56.876 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:00:56.876 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:00:56.876 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:00:56.877 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:00:56.878 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:00:56.878 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:00:56.879 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:00:56.879 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:00:56.879 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:00:56.879 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:00:56.879 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:00:56.880 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:00:56.881 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:00:57.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:00:56.228897+0000 mgr.smithi067.rdualw (mgr.24569) 3204 : audit [DBG] from='client.36274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:00:57.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:00:56.517700+0000 mgr.smithi067.rdualw (mgr.24569) 3205 : audit [DBG] from='client.36278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:00:57.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:00:56.873543+0000 mon.smithi061 (mon.0) 823 : audit [DBG] from='client.? 172.21.15.61:0/1681271408' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:00:57.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:00:56.228897+0000 mgr.smithi067.rdualw (mgr.24569) 3204 : audit [DBG] from='client.36274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:00:57.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:00:56.517700+0000 mgr.smithi067.rdualw (mgr.24569) 3205 : audit [DBG] from='client.36278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:00:57.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:00:56.873543+0000 mon.smithi061 (mon.0) 823 : audit [DBG] from='client.? 172.21.15.61:0/1681271408' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:00:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:00:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:57.446350+0000 mgr.smithi067.rdualw (mgr.24569) 3206 : cluster [DBG] pgmap v2764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:00:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:00:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:57.446350+0000 mgr.smithi067.rdualw (mgr.24569) 3206 : cluster [DBG] pgmap v2764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:00:59.447123+0000 mgr.smithi067.rdualw (mgr.24569) 3207 : cluster [DBG] pgmap v2765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:00:59.447123+0000 mgr.smithi067.rdualw (mgr.24569) 3207 : cluster [DBG] pgmap v2765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:01.448051+0000 mgr.smithi067.rdualw (mgr.24569) 3208 : cluster [DBG] pgmap v2766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:01.448051+0000 mgr.smithi067.rdualw (mgr.24569) 3208 : cluster [DBG] pgmap v2766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:03.448672+0000 mgr.smithi067.rdualw (mgr.24569) 3209 : cluster [DBG] pgmap v2767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:03.448672+0000 mgr.smithi067.rdualw (mgr.24569) 3209 : cluster [DBG] pgmap v2767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:05.449501+0000 mgr.smithi067.rdualw (mgr.24569) 3210 : cluster [DBG] pgmap v2768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:01:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:05.449501+0000 mgr.smithi067.rdualw (mgr.24569) 3210 : cluster [DBG] pgmap v2768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:01:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:01:06.772774+0000 mon.smithi067 (mon.1) 516 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:01:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:01:06.774255+0000 mon.smithi067 (mon.1) 517 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:01:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:01:06.775168+0000 mon.smithi067 (mon.1) 518 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:01:07.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:01:06.776033+0000 mgr.smithi067.rdualw (mgr.24569) 3211 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:01:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:01:06.772774+0000 mon.smithi067 (mon.1) 516 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:01:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:01:06.774255+0000 mon.smithi067 (mon.1) 517 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:01:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:01:06.775168+0000 mon.smithi067 (mon.1) 518 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:01:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:01:06.776033+0000 mgr.smithi067.rdualw (mgr.24569) 3211 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:01:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:01:07.196917+0000 mon.smithi061 (mon.0) 824 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:01:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:01:07.205701+0000 mon.smithi061 (mon.0) 825 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:01:08.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:07.449973+0000 mgr.smithi067.rdualw (mgr.24569) 3212 : cluster [DBG] pgmap v2769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:01:07.196917+0000 mon.smithi061 (mon.0) 824 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:01:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:01:07.205701+0000 mon.smithi061 (mon.0) 825 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:01:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:07.449973+0000 mgr.smithi067.rdualw (mgr.24569) 3212 : cluster [DBG] pgmap v2769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:09.450553+0000 mgr.smithi067.rdualw (mgr.24569) 3213 : cluster [DBG] pgmap v2770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:09.450553+0000 mgr.smithi067.rdualw (mgr.24569) 3213 : cluster [DBG] pgmap v2770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:11.451480+0000 mgr.smithi067.rdualw (mgr.24569) 3214 : cluster [DBG] pgmap v2771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:11.451480+0000 mgr.smithi067.rdualw (mgr.24569) 3214 : cluster [DBG] pgmap v2771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:13.452055+0000 mgr.smithi067.rdualw (mgr.24569) 3215 : cluster [DBG] pgmap v2772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:13.452055+0000 mgr.smithi067.rdualw (mgr.24569) 3215 : cluster [DBG] pgmap v2772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:15.452924+0000 mgr.smithi067.rdualw (mgr.24569) 3216 : cluster [DBG] pgmap v2773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:01:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:15.452924+0000 mgr.smithi067.rdualw (mgr.24569) 3216 : cluster [DBG] pgmap v2773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:01:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:17.453412+0000 mgr.smithi067.rdualw (mgr.24569) 3217 : cluster [DBG] pgmap v2774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:17.453412+0000 mgr.smithi067.rdualw (mgr.24569) 3217 : cluster [DBG] pgmap v2774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:19.454130+0000 mgr.smithi067.rdualw (mgr.24569) 3218 : cluster [DBG] pgmap v2775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:19.454130+0000 mgr.smithi067.rdualw (mgr.24569) 3218 : cluster [DBG] pgmap v2775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:21.455240+0000 mgr.smithi067.rdualw (mgr.24569) 3219 : cluster [DBG] pgmap v2776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:21.455240+0000 mgr.smithi067.rdualw (mgr.24569) 3219 : cluster [DBG] pgmap v2776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:23.455786+0000 mgr.smithi067.rdualw (mgr.24569) 3220 : cluster [DBG] pgmap v2777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:23.455786+0000 mgr.smithi067.rdualw (mgr.24569) 3220 : cluster [DBG] pgmap v2777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:25.456653+0000 mgr.smithi067.rdualw (mgr.24569) 3221 : cluster [DBG] pgmap v2778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:01:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:25.456653+0000 mgr.smithi067.rdualw (mgr.24569) 3221 : cluster [DBG] pgmap v2778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:01:27.192 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:01:27.483 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:01:27.484 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (98m) 9m ago 100m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:01:27.484 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (91m) 9m ago 100m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:01:27.484 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (91m) 9m ago 99m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:01:27.484 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (98m) 9m ago 99m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:01:27.485 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (92m) 9m ago 95m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:01:27.485 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (91m) 9m ago 95m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:01:27.485 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (93m) 9m ago 101m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:01:27.485 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (92m) 9m ago 99m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:01:27.486 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (92m) 9m ago 101m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:01:27.486 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (92m) 9m ago 99m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:01:27.486 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (93m) 9m ago 93m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:01:27.486 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (93m) 9m ago 93m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:01:27.487 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (99m) 9m ago 99m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:01:27.487 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (99m) 9m ago 99m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:01:27.487 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (82m) 9m ago 98m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:01:27.488 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (98m) 9m ago 98m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:01:27.488 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (98m) 9m ago 98m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:01:27.488 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (98m) 9m ago 98m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:01:27.488 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (97m) 9m ago 97m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:01:27.489 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (97m) 9m ago 97m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:01:27.489 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (97m) 9m ago 97m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:01:27.489 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (97m) 9m ago 97m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:01:27.489 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (98m) 9m ago 99m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:01:27.826 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:01:27.827 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:01:27.827 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:01:27.827 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:01:27.827 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:01:27.828 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:01:27.828 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:01:27.828 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:01:27.828 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:01:27.829 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:01:27.829 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:01:27.829 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:01:27.829 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:01:27.829 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:01:27.830 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:01:27.830 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:01:27.830 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:01:27.830 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:01:27.831 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:01:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:01:27.179556+0000 mgr.smithi067.rdualw (mgr.24569) 3222 : audit [DBG] from='client.36286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:01:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:27.457292+0000 mgr.smithi067.rdualw (mgr.24569) 3223 : cluster [DBG] pgmap v2779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:01:27.466322+0000 mgr.smithi067.rdualw (mgr.24569) 3224 : audit [DBG] from='client.36290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:01:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:01:27.825276+0000 mon.smithi061 (mon.0) 826 : audit [DBG] from='client.? 172.21.15.61:0/573725339' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:01:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:01:27.179556+0000 mgr.smithi067.rdualw (mgr.24569) 3222 : audit [DBG] from='client.36286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:01:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:27.457292+0000 mgr.smithi067.rdualw (mgr.24569) 3223 : cluster [DBG] pgmap v2779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:01:27.466322+0000 mgr.smithi067.rdualw (mgr.24569) 3224 : audit [DBG] from='client.36290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:01:28.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:01:27.825276+0000 mon.smithi061 (mon.0) 826 : audit [DBG] from='client.? 172.21.15.61:0/573725339' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:01:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:29.457907+0000 mgr.smithi067.rdualw (mgr.24569) 3225 : cluster [DBG] pgmap v2780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:29.457907+0000 mgr.smithi067.rdualw (mgr.24569) 3225 : cluster [DBG] pgmap v2780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:31.458882+0000 mgr.smithi067.rdualw (mgr.24569) 3226 : cluster [DBG] pgmap v2781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:31.458882+0000 mgr.smithi067.rdualw (mgr.24569) 3226 : cluster [DBG] pgmap v2781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:33.459468+0000 mgr.smithi067.rdualw (mgr.24569) 3227 : cluster [DBG] pgmap v2782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:33.459468+0000 mgr.smithi067.rdualw (mgr.24569) 3227 : cluster [DBG] pgmap v2782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:01:34.921651+0000 mon.smithi067 (mon.1) 519 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:01:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:01:34.921733+0000 mon.smithi061 (mon.0) 827 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:01:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:01:34.921899+0000 mon.smithi067 (mon.1) 520 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:01:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:01:34.922097+0000 mon.smithi061 (mon.0) 828 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:01:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:01:34.921651+0000 mon.smithi067 (mon.1) 519 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:01:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:01:34.921733+0000 mon.smithi061 (mon.0) 827 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:01:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:01:34.921899+0000 mon.smithi067 (mon.1) 520 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:01:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:01:34.922097+0000 mon.smithi061 (mon.0) 828 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:01:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:35.460478+0000 mgr.smithi067.rdualw (mgr.24569) 3228 : cluster [DBG] pgmap v2783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:01:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:35.460478+0000 mgr.smithi067.rdualw (mgr.24569) 3228 : cluster [DBG] pgmap v2783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:01:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:37.461017+0000 mgr.smithi067.rdualw (mgr.24569) 3229 : cluster [DBG] pgmap v2784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:37.461017+0000 mgr.smithi067.rdualw (mgr.24569) 3229 : cluster [DBG] pgmap v2784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:39.461800+0000 mgr.smithi067.rdualw (mgr.24569) 3230 : cluster [DBG] pgmap v2785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:39.461800+0000 mgr.smithi067.rdualw (mgr.24569) 3230 : cluster [DBG] pgmap v2785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:41.462671+0000 mgr.smithi067.rdualw (mgr.24569) 3231 : cluster [DBG] pgmap v2786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:41.462671+0000 mgr.smithi067.rdualw (mgr.24569) 3231 : cluster [DBG] pgmap v2786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:44.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:43.463202+0000 mgr.smithi067.rdualw (mgr.24569) 3232 : cluster [DBG] pgmap v2787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:43.463202+0000 mgr.smithi067.rdualw (mgr.24569) 3232 : cluster [DBG] pgmap v2787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:45.464058+0000 mgr.smithi067.rdualw (mgr.24569) 3233 : cluster [DBG] pgmap v2788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:01:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:45.464058+0000 mgr.smithi067.rdualw (mgr.24569) 3233 : cluster [DBG] pgmap v2788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:01:48.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:47.464788+0000 mgr.smithi067.rdualw (mgr.24569) 3234 : cluster [DBG] pgmap v2789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:47.464788+0000 mgr.smithi067.rdualw (mgr.24569) 3234 : cluster [DBG] pgmap v2789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:49.465331+0000 mgr.smithi067.rdualw (mgr.24569) 3235 : cluster [DBG] pgmap v2790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:49.465331+0000 mgr.smithi067.rdualw (mgr.24569) 3235 : cluster [DBG] pgmap v2790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:51.466442+0000 mgr.smithi067.rdualw (mgr.24569) 3236 : cluster [DBG] pgmap v2791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:51.466442+0000 mgr.smithi067.rdualw (mgr.24569) 3236 : cluster [DBG] pgmap v2791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:53.467064+0000 mgr.smithi067.rdualw (mgr.24569) 3237 : cluster [DBG] pgmap v2792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:53.467064+0000 mgr.smithi067.rdualw (mgr.24569) 3237 : cluster [DBG] pgmap v2792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:55.467874+0000 mgr.smithi067.rdualw (mgr.24569) 3238 : cluster [DBG] pgmap v2793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:01:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:55.467874+0000 mgr.smithi067.rdualw (mgr.24569) 3238 : cluster [DBG] pgmap v2793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:01:58.134 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:01:58.426 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:01:58.426 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (99m) 10m ago 100m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:01:58.427 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (92m) 10m ago 100m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:01:58.427 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (92m) 10m ago 100m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:01:58.427 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (99m) 10m ago 100m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:01:58.427 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (92m) 10m ago 96m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:01:58.427 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (92m) 10m ago 96m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:01:58.428 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (93m) 10m ago 101m 450M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:01:58.428 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (93m) 10m ago 100m 506M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:01:58.428 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (93m) 10m ago 101m 612M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:01:58.428 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (92m) 10m ago 99m 348M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:01:58.429 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (93m) 10m ago 93m 179M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:01:58.429 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (93m) 10m ago 93m 104M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:01:58.429 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (100m) 10m ago 100m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:01:58.429 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (99m) 10m ago 99m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:01:58.429 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (83m) 10m ago 99m 620M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:01:58.430 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (99m) 10m ago 99m 1432M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:01:58.430 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (98m) 10m ago 98m 865M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:01:58.430 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (98m) 10m ago 98m 1552M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:01:58.430 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (98m) 10m ago 98m 1434M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:01:58.431 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (98m) 10m ago 98m 1676M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:01:58.431 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (97m) 10m ago 97m 1314M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:01:58.431 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (97m) 10m ago 97m 2155M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:01:58.431 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (99m) 10m ago 100m 69.0M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:01:58.766 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:01:58.767 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:01:58.767 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:01:58.767 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:01:58.768 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:01:58.768 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:01:58.768 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:01:58.768 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:01:58.769 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:01:58.769 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:01:58.769 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:01:58.769 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:01:58.770 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:01:58.770 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:01:58.770 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:01:58.770 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:01:58.771 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:01:58.771 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:01:58.771 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:01:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:57.468370+0000 mgr.smithi067.rdualw (mgr.24569) 3239 : cluster [DBG] pgmap v2794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:58.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:57.468370+0000 mgr.smithi067.rdualw (mgr.24569) 3239 : cluster [DBG] pgmap v2794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:01:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:01:58.121335+0000 mgr.smithi067.rdualw (mgr.24569) 3240 : audit [DBG] from='client.36298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:01:59.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:01:58.408839+0000 mgr.smithi067.rdualw (mgr.24569) 3241 : audit [DBG] from='client.36302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:01:59.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:01:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:01:58.765434+0000 mon.smithi061 (mon.0) 829 : audit [DBG] from='client.? 172.21.15.61:0/363661109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:01:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:01:58.121335+0000 mgr.smithi067.rdualw (mgr.24569) 3240 : audit [DBG] from='client.36298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:01:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:01:58.408839+0000 mgr.smithi067.rdualw (mgr.24569) 3241 : audit [DBG] from='client.36302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:01:59.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:01:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:01:58.765434+0000 mon.smithi061 (mon.0) 829 : audit [DBG] from='client.? 172.21.15.61:0/363661109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:02:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:01:59.469115+0000 mgr.smithi067.rdualw (mgr.24569) 3242 : cluster [DBG] pgmap v2795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:01:59.469115+0000 mgr.smithi067.rdualw (mgr.24569) 3242 : cluster [DBG] pgmap v2795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:01.470207+0000 mgr.smithi067.rdualw (mgr.24569) 3243 : cluster [DBG] pgmap v2796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:01.470207+0000 mgr.smithi067.rdualw (mgr.24569) 3243 : cluster [DBG] pgmap v2796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:03.470863+0000 mgr.smithi067.rdualw (mgr.24569) 3244 : cluster [DBG] pgmap v2797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:03.470863+0000 mgr.smithi067.rdualw (mgr.24569) 3244 : cluster [DBG] pgmap v2797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:05.471746+0000 mgr.smithi067.rdualw (mgr.24569) 3245 : cluster [DBG] pgmap v2798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:02:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:05.471746+0000 mgr.smithi067.rdualw (mgr.24569) 3245 : cluster [DBG] pgmap v2798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:02:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:07.211679+0000 mon.smithi067 (mon.1) 521 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:02:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:07.213092+0000 mon.smithi067 (mon.1) 522 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:02:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:07.214007+0000 mon.smithi067 (mon.1) 523 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:02:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:07.211679+0000 mon.smithi067 (mon.1) 521 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:02:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:07.213092+0000 mon.smithi067 (mon.1) 522 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:02:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:07.214007+0000 mon.smithi067 (mon.1) 523 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:02:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:02:07.214834+0000 mgr.smithi067.rdualw (mgr.24569) 3246 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:02:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:07.472280+0000 mgr.smithi067.rdualw (mgr.24569) 3247 : cluster [DBG] pgmap v2799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:02:07.214834+0000 mgr.smithi067.rdualw (mgr.24569) 3246 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:02:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:07.472280+0000 mgr.smithi067.rdualw (mgr.24569) 3247 : cluster [DBG] pgmap v2799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:09.472820+0000 mgr.smithi067.rdualw (mgr.24569) 3248 : cluster [DBG] pgmap v2800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:09.472820+0000 mgr.smithi067.rdualw (mgr.24569) 3248 : cluster [DBG] pgmap v2800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:11.473681+0000 mgr.smithi067.rdualw (mgr.24569) 3249 : cluster [DBG] pgmap v2801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:12.012252+0000 mon.smithi061 (mon.0) 830 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:02:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:12.410693+0000 mon.smithi067 (mon.1) 524 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:02:12.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:12.410772+0000 mon.smithi061 (mon.0) 831 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:02:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:11.473681+0000 mgr.smithi067.rdualw (mgr.24569) 3249 : cluster [DBG] pgmap v2801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:12.012252+0000 mon.smithi061 (mon.0) 830 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:02:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:12.410693+0000 mon.smithi067 (mon.1) 524 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:02:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:12.410772+0000 mon.smithi061 (mon.0) 831 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:02:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:13.474251+0000 mgr.smithi067.rdualw (mgr.24569) 3250 : cluster [DBG] pgmap v2802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:14.337699+0000 mon.smithi061 (mon.0) 832 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:02:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:13.474251+0000 mgr.smithi067.rdualw (mgr.24569) 3250 : cluster [DBG] pgmap v2802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:14.337699+0000 mon.smithi061 (mon.0) 832 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:02:15.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:14.741228+0000 mon.smithi067 (mon.1) 525 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:02:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:14.741547+0000 mon.smithi061 (mon.0) 833 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:02:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:14.746078+0000 mon.smithi061 (mon.0) 834 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:02:15.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:14.752930+0000 mon.smithi061 (mon.0) 835 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:02:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:14.741228+0000 mon.smithi067 (mon.1) 525 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:02:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:14.741547+0000 mon.smithi061 (mon.0) 833 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:02:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:14.746078+0000 mon.smithi061 (mon.0) 834 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:02:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:14.752930+0000 mon.smithi061 (mon.0) 835 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:02:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:15.475170+0000 mgr.smithi067.rdualw (mgr.24569) 3251 : cluster [DBG] pgmap v2803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:02:16.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:15.475170+0000 mgr.smithi067.rdualw (mgr.24569) 3251 : cluster [DBG] pgmap v2803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:02:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:17.475696+0000 mgr.smithi067.rdualw (mgr.24569) 3252 : cluster [DBG] pgmap v2804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:17.475696+0000 mgr.smithi067.rdualw (mgr.24569) 3252 : cluster [DBG] pgmap v2804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:19.476396+0000 mgr.smithi067.rdualw (mgr.24569) 3253 : cluster [DBG] pgmap v2805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:19.476396+0000 mgr.smithi067.rdualw (mgr.24569) 3253 : cluster [DBG] pgmap v2805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:21.477330+0000 mgr.smithi067.rdualw (mgr.24569) 3254 : cluster [DBG] pgmap v2806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:21.477330+0000 mgr.smithi067.rdualw (mgr.24569) 3254 : cluster [DBG] pgmap v2806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:23.477900+0000 mgr.smithi067.rdualw (mgr.24569) 3255 : cluster [DBG] pgmap v2807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:23.477900+0000 mgr.smithi067.rdualw (mgr.24569) 3255 : cluster [DBG] pgmap v2807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:25.478745+0000 mgr.smithi067.rdualw (mgr.24569) 3256 : cluster [DBG] pgmap v2808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:02:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:25.478745+0000 mgr.smithi067.rdualw (mgr.24569) 3256 : cluster [DBG] pgmap v2808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:02:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:27.479454+0000 mgr.smithi067.rdualw (mgr.24569) 3257 : cluster [DBG] pgmap v2809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:27.479454+0000 mgr.smithi067.rdualw (mgr.24569) 3257 : cluster [DBG] pgmap v2809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:29.093 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:02:29.383 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:02:29.384 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (100m) 15s ago 101m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:02:29.384 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (92m) 15s ago 101m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:02:29.384 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (92m) 17s ago 100m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:02:29.384 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (99m) 15s ago 100m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:02:29.385 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (93m) 15s ago 96m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:02:29.385 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (92m) 17s ago 96m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:02:29.385 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (94m) 15s ago 102m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:02:29.385 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (93m) 17s ago 100m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:02:29.386 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (93m) 15s ago 102m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:02:29.386 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (93m) 17s ago 100m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:02:29.386 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (94m) 15s ago 94m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:02:29.386 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (94m) 17s ago 94m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:02:29.386 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (100m) 15s ago 100m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:02:29.387 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (100m) 17s ago 100m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:02:29.387 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (83m) 15s ago 99m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:02:29.387 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (99m) 15s ago 99m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:02:29.387 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (99m) 15s ago 99m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:02:29.388 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (99m) 15s ago 99m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:02:29.388 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (98m) 17s ago 98m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:02:29.388 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (98m) 17s ago 98m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:02:29.388 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (98m) 17s ago 98m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:02:29.388 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (98m) 17s ago 98m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:02:29.389 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (99m) 15s ago 100m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:02:29.731 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:02:29.732 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:02:29.732 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:02:29.732 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:02:29.732 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:02:29.733 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:02:29.733 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:02:29.733 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:02:29.733 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:02:29.734 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:02:29.734 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:02:29.734 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:02:29.734 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:02:29.734 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:02:29.735 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:02:29.735 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:02:29.735 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:02:29.735 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:02:29.736 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:02:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:29.077459+0000 mgr.smithi067.rdualw (mgr.24569) 3258 : audit [DBG] from='client.36310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:02:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:29.366596+0000 mgr.smithi067.rdualw (mgr.24569) 3259 : audit [DBG] from='client.36314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:02:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:29.480089+0000 mgr.smithi067.rdualw (mgr.24569) 3260 : cluster [DBG] pgmap v2810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:29.730395+0000 mon.smithi061 (mon.0) 836 : audit [DBG] from='client.? 172.21.15.61:0/2236681656' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:02:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:29.077459+0000 mgr.smithi067.rdualw (mgr.24569) 3258 : audit [DBG] from='client.36310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:02:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:29.366596+0000 mgr.smithi067.rdualw (mgr.24569) 3259 : audit [DBG] from='client.36314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:02:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:29.480089+0000 mgr.smithi067.rdualw (mgr.24569) 3260 : cluster [DBG] pgmap v2810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:29.730395+0000 mon.smithi061 (mon.0) 836 : audit [DBG] from='client.? 172.21.15.61:0/2236681656' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:02:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:31.481109+0000 mgr.smithi067.rdualw (mgr.24569) 3261 : cluster [DBG] pgmap v2811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:32.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:31.481109+0000 mgr.smithi067.rdualw (mgr.24569) 3261 : cluster [DBG] pgmap v2811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:33.481613+0000 mgr.smithi067.rdualw (mgr.24569) 3262 : cluster [DBG] pgmap v2812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:33.481613+0000 mgr.smithi067.rdualw (mgr.24569) 3262 : cluster [DBG] pgmap v2812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:34.927375+0000 mon.smithi067 (mon.1) 526 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:02:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:34.927658+0000 mon.smithi067 (mon.1) 527 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:02:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:34.927667+0000 mon.smithi061 (mon.0) 837 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:02:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:02:34.928167+0000 mon.smithi061 (mon.0) 838 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:02:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:34.927375+0000 mon.smithi067 (mon.1) 526 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:02:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:34.927658+0000 mon.smithi067 (mon.1) 527 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:02:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:34.927667+0000 mon.smithi061 (mon.0) 837 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:02:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:02:34.928167+0000 mon.smithi061 (mon.0) 838 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:02:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:35.482501+0000 mgr.smithi067.rdualw (mgr.24569) 3263 : cluster [DBG] pgmap v2813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:02:36.933 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:35.482501+0000 mgr.smithi067.rdualw (mgr.24569) 3263 : cluster [DBG] pgmap v2813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:02:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:37.483136+0000 mgr.smithi067.rdualw (mgr.24569) 3264 : cluster [DBG] pgmap v2814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:37.483136+0000 mgr.smithi067.rdualw (mgr.24569) 3264 : cluster [DBG] pgmap v2814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:39.483946+0000 mgr.smithi067.rdualw (mgr.24569) 3265 : cluster [DBG] pgmap v2815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:39.483946+0000 mgr.smithi067.rdualw (mgr.24569) 3265 : cluster [DBG] pgmap v2815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:41.484880+0000 mgr.smithi067.rdualw (mgr.24569) 3266 : cluster [DBG] pgmap v2816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:41.484880+0000 mgr.smithi067.rdualw (mgr.24569) 3266 : cluster [DBG] pgmap v2816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:43.485516+0000 mgr.smithi067.rdualw (mgr.24569) 3267 : cluster [DBG] pgmap v2817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:43.485516+0000 mgr.smithi067.rdualw (mgr.24569) 3267 : cluster [DBG] pgmap v2817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:45.486590+0000 mgr.smithi067.rdualw (mgr.24569) 3268 : cluster [DBG] pgmap v2818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:02:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:45.486590+0000 mgr.smithi067.rdualw (mgr.24569) 3268 : cluster [DBG] pgmap v2818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:02:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:47.487088+0000 mgr.smithi067.rdualw (mgr.24569) 3269 : cluster [DBG] pgmap v2819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:47.487088+0000 mgr.smithi067.rdualw (mgr.24569) 3269 : cluster [DBG] pgmap v2819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:49.487623+0000 mgr.smithi067.rdualw (mgr.24569) 3270 : cluster [DBG] pgmap v2820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:49.487623+0000 mgr.smithi067.rdualw (mgr.24569) 3270 : cluster [DBG] pgmap v2820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:51.488761+0000 mgr.smithi067.rdualw (mgr.24569) 3271 : cluster [DBG] pgmap v2821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:51.488761+0000 mgr.smithi067.rdualw (mgr.24569) 3271 : cluster [DBG] pgmap v2821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:53.489317+0000 mgr.smithi067.rdualw (mgr.24569) 3272 : cluster [DBG] pgmap v2822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:53.489317+0000 mgr.smithi067.rdualw (mgr.24569) 3272 : cluster [DBG] pgmap v2822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:55.490165+0000 mgr.smithi067.rdualw (mgr.24569) 3273 : cluster [DBG] pgmap v2823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:02:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:55.490165+0000 mgr.smithi067.rdualw (mgr.24569) 3273 : cluster [DBG] pgmap v2823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:02:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:02:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:57.490826+0000 mgr.smithi067.rdualw (mgr.24569) 3274 : cluster [DBG] pgmap v2824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:02:58.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:02:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:57.490826+0000 mgr.smithi067.rdualw (mgr.24569) 3274 : cluster [DBG] pgmap v2824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:00.045 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:03:00.368 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:03:00.368 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (100m) 46s ago 101m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:03:00.368 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (93m) 46s ago 101m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:03:00.368 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (93m) 48s ago 101m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:03:00.369 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (100m) 46s ago 101m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:03:00.369 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (93m) 46s ago 97m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:03:00.369 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (93m) 48s ago 97m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:03:00.369 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (94m) 46s ago 102m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:03:00.370 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (94m) 48s ago 101m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:03:00.370 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (94m) 46s ago 102m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:03:00.370 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (94m) 48s ago 100m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:03:00.370 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (94m) 46s ago 94m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:03:00.371 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (94m) 48s ago 94m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:03:00.371 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (101m) 46s ago 101m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:03:00.371 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (100m) 48s ago 100m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:03:00.371 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (84m) 46s ago 100m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:03:00.371 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (100m) 46s ago 100m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:03:00.372 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (99m) 46s ago 99m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:03:00.372 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (99m) 46s ago 99m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:03:00.372 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (99m) 48s ago 99m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:03:00.372 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (99m) 48s ago 99m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:03:00.373 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (98m) 48s ago 98m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:03:00.373 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (98m) 48s ago 98m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:03:00.373 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (100m) 46s ago 101m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:03:00.710 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:03:00.711 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:03:00.711 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:03:00.711 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:03:00.711 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:03:00.711 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:03:00.712 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:03:00.712 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:03:00.712 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:03:00.712 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:03:00.713 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:03:00.713 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:03:00.713 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:03:00.713 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:03:00.713 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:03:00.714 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:03:00.714 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:03:00.714 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:03:00.714 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:03:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:02:59.491522+0000 mgr.smithi067.rdualw (mgr.24569) 3275 : cluster [DBG] pgmap v2825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:02:59.491522+0000 mgr.smithi067.rdualw (mgr.24569) 3275 : cluster [DBG] pgmap v2825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:03:00.032022+0000 mgr.smithi067.rdualw (mgr.24569) 3276 : audit [DBG] from='client.36322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:03:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:03:00.350304+0000 mgr.smithi067.rdualw (mgr.24569) 3277 : audit [DBG] from='client.36326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:03:01.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:03:00.708888+0000 mon.smithi061 (mon.0) 839 : audit [DBG] from='client.? 172.21.15.61:0/1546927602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:03:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:03:00.032022+0000 mgr.smithi067.rdualw (mgr.24569) 3276 : audit [DBG] from='client.36322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:03:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:03:00.350304+0000 mgr.smithi067.rdualw (mgr.24569) 3277 : audit [DBG] from='client.36326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:03:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:03:00.708888+0000 mon.smithi061 (mon.0) 839 : audit [DBG] from='client.? 172.21.15.61:0/1546927602' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:03:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:01.492456+0000 mgr.smithi067.rdualw (mgr.24569) 3278 : cluster [DBG] pgmap v2826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:01.492456+0000 mgr.smithi067.rdualw (mgr.24569) 3278 : cluster [DBG] pgmap v2826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:03.493165+0000 mgr.smithi067.rdualw (mgr.24569) 3279 : cluster [DBG] pgmap v2827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:03.493165+0000 mgr.smithi067.rdualw (mgr.24569) 3279 : cluster [DBG] pgmap v2827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:05.494084+0000 mgr.smithi067.rdualw (mgr.24569) 3280 : cluster [DBG] pgmap v2828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:03:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:05.494084+0000 mgr.smithi067.rdualw (mgr.24569) 3280 : cluster [DBG] pgmap v2828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:03:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:07.494662+0000 mgr.smithi067.rdualw (mgr.24569) 3281 : cluster [DBG] pgmap v2829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:08.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:07.494662+0000 mgr.smithi067.rdualw (mgr.24569) 3281 : cluster [DBG] pgmap v2829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:09.495336+0000 mgr.smithi067.rdualw (mgr.24569) 3282 : cluster [DBG] pgmap v2830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:09.495336+0000 mgr.smithi067.rdualw (mgr.24569) 3282 : cluster [DBG] pgmap v2830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:11.496209+0000 mgr.smithi067.rdualw (mgr.24569) 3283 : cluster [DBG] pgmap v2831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:11.496209+0000 mgr.smithi067.rdualw (mgr.24569) 3283 : cluster [DBG] pgmap v2831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:13.496718+0000 mgr.smithi067.rdualw (mgr.24569) 3284 : cluster [DBG] pgmap v2832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:13.496718+0000 mgr.smithi067.rdualw (mgr.24569) 3284 : cluster [DBG] pgmap v2832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:03:14.757506+0000 mon.smithi067 (mon.1) 528 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:03:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:03:14.758947+0000 mon.smithi067 (mon.1) 529 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:03:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:03:14.759957+0000 mon.smithi067 (mon.1) 530 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:03:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:03:14.760819+0000 mgr.smithi067.rdualw (mgr.24569) 3285 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:03:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:03:15.177600+0000 mon.smithi061 (mon.0) 840 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:03:15.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:03:15.188107+0000 mon.smithi061 (mon.0) 841 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:03:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:03:14.757506+0000 mon.smithi067 (mon.1) 528 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:03:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:03:14.758947+0000 mon.smithi067 (mon.1) 529 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:03:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:03:14.759957+0000 mon.smithi067 (mon.1) 530 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:03:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:03:14.760819+0000 mgr.smithi067.rdualw (mgr.24569) 3285 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:03:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:03:15.177600+0000 mon.smithi061 (mon.0) 840 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:03:16.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:03:15.188107+0000 mon.smithi061 (mon.0) 841 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:03:16.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:15.497444+0000 mgr.smithi067.rdualw (mgr.24569) 3286 : cluster [DBG] pgmap v2833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:03:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:15.497444+0000 mgr.smithi067.rdualw (mgr.24569) 3286 : cluster [DBG] pgmap v2833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:03:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:17.497933+0000 mgr.smithi067.rdualw (mgr.24569) 3287 : cluster [DBG] pgmap v2834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:17.497933+0000 mgr.smithi067.rdualw (mgr.24569) 3287 : cluster [DBG] pgmap v2834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:19.498728+0000 mgr.smithi067.rdualw (mgr.24569) 3288 : cluster [DBG] pgmap v2835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:19.498728+0000 mgr.smithi067.rdualw (mgr.24569) 3288 : cluster [DBG] pgmap v2835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:21.499650+0000 mgr.smithi067.rdualw (mgr.24569) 3289 : cluster [DBG] pgmap v2836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:21.499650+0000 mgr.smithi067.rdualw (mgr.24569) 3289 : cluster [DBG] pgmap v2836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:24.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:23.500088+0000 mgr.smithi067.rdualw (mgr.24569) 3290 : cluster [DBG] pgmap v2837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:23.500088+0000 mgr.smithi067.rdualw (mgr.24569) 3290 : cluster [DBG] pgmap v2837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:25.501071+0000 mgr.smithi067.rdualw (mgr.24569) 3291 : cluster [DBG] pgmap v2838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:03:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:25.501071+0000 mgr.smithi067.rdualw (mgr.24569) 3291 : cluster [DBG] pgmap v2838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:03:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:27.501586+0000 mgr.smithi067.rdualw (mgr.24569) 3292 : cluster [DBG] pgmap v2839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:27.501586+0000 mgr.smithi067.rdualw (mgr.24569) 3292 : cluster [DBG] pgmap v2839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:29.502269+0000 mgr.smithi067.rdualw (mgr.24569) 3293 : cluster [DBG] pgmap v2840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:31.017 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:03:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:29.502269+0000 mgr.smithi067.rdualw (mgr.24569) 3293 : cluster [DBG] pgmap v2840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:31.311 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:03:31.311 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (101m) 76s ago 102m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:03:31.311 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (93m) 76s ago 102m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:03:31.312 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (93m) 79s ago 101m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:03:31.312 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (100m) 76s ago 101m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:03:31.312 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (94m) 76s ago 97m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:03:31.312 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (94m) 79s ago 97m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:03:31.312 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (95m) 76s ago 103m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:03:31.313 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (94m) 79s ago 101m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:03:31.313 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (94m) 76s ago 103m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:03:31.313 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (94m) 79s ago 101m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:03:31.313 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (95m) 76s ago 95m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:03:31.314 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (95m) 79s ago 95m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:03:31.314 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (101m) 76s ago 101m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:03:31.314 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (101m) 79s ago 101m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:03:31.314 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (84m) 76s ago 100m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:03:31.314 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (100m) 76s ago 100m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:03:31.315 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (100m) 76s ago 100m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:03:31.315 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (100m) 76s ago 100m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:03:31.315 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (99m) 79s ago 99m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:03:31.315 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (99m) 79s ago 99m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:03:31.316 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (99m) 79s ago 99m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:03:31.316 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (99m) 79s ago 99m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:03:31.316 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (100m) 76s ago 101m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:03:31.652 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:03:31.652 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:03:31.653 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:03:31.653 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:03:31.653 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:03:31.653 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:03:31.653 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:03:31.654 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:03:31.654 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:03:31.654 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:03:31.655 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:03:31.655 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:03:31.655 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:03:31.655 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:03:31.655 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:03:31.656 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:03:31.656 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:03:31.656 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:03:31.656 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:03:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:03:31.004152+0000 mgr.smithi067.rdualw (mgr.24569) 3294 : audit [DBG] from='client.36334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:03:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:03:31.293268+0000 mgr.smithi067.rdualw (mgr.24569) 3295 : audit [DBG] from='client.36338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:03:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:31.503127+0000 mgr.smithi067.rdualw (mgr.24569) 3296 : cluster [DBG] pgmap v2841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:03:31.651006+0000 mon.smithi061 (mon.0) 842 : audit [DBG] from='client.? 172.21.15.61:0/1623528826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:03:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:03:31.004152+0000 mgr.smithi067.rdualw (mgr.24569) 3294 : audit [DBG] from='client.36334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:03:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:03:31.293268+0000 mgr.smithi067.rdualw (mgr.24569) 3295 : audit [DBG] from='client.36338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:03:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:31.503127+0000 mgr.smithi067.rdualw (mgr.24569) 3296 : cluster [DBG] pgmap v2841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:03:31.651006+0000 mon.smithi061 (mon.0) 842 : audit [DBG] from='client.? 172.21.15.61:0/1623528826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:03:34.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:33.503717+0000 mgr.smithi067.rdualw (mgr.24569) 3297 : cluster [DBG] pgmap v2842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:33.503717+0000 mgr.smithi067.rdualw (mgr.24569) 3297 : cluster [DBG] pgmap v2842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:03:34.932862+0000 mon.smithi067 (mon.1) 531 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:03:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:03:34.932948+0000 mon.smithi061 (mon.0) 843 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:03:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:03:34.933111+0000 mon.smithi067 (mon.1) 532 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:03:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:03:34.933240+0000 mon.smithi061 (mon.0) 844 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:03:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:03:34.932862+0000 mon.smithi067 (mon.1) 531 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:03:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:03:34.932948+0000 mon.smithi061 (mon.0) 843 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:03:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:03:34.933111+0000 mon.smithi067 (mon.1) 532 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:03:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:03:34.933240+0000 mon.smithi061 (mon.0) 844 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:03:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:35.504557+0000 mgr.smithi067.rdualw (mgr.24569) 3298 : cluster [DBG] pgmap v2843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:03:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:35.504557+0000 mgr.smithi067.rdualw (mgr.24569) 3298 : cluster [DBG] pgmap v2843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:03:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:37.505050+0000 mgr.smithi067.rdualw (mgr.24569) 3299 : cluster [DBG] pgmap v2844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:37.505050+0000 mgr.smithi067.rdualw (mgr.24569) 3299 : cluster [DBG] pgmap v2844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:39.505652+0000 mgr.smithi067.rdualw (mgr.24569) 3300 : cluster [DBG] pgmap v2845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:39.505652+0000 mgr.smithi067.rdualw (mgr.24569) 3300 : cluster [DBG] pgmap v2845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:41.506481+0000 mgr.smithi067.rdualw (mgr.24569) 3301 : cluster [DBG] pgmap v2846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:41.506481+0000 mgr.smithi067.rdualw (mgr.24569) 3301 : cluster [DBG] pgmap v2846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:44.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:43.506977+0000 mgr.smithi067.rdualw (mgr.24569) 3302 : cluster [DBG] pgmap v2847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:43.506977+0000 mgr.smithi067.rdualw (mgr.24569) 3302 : cluster [DBG] pgmap v2847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:45.507802+0000 mgr.smithi067.rdualw (mgr.24569) 3303 : cluster [DBG] pgmap v2848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:03:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:45.507802+0000 mgr.smithi067.rdualw (mgr.24569) 3303 : cluster [DBG] pgmap v2848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:03:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:47.508324+0000 mgr.smithi067.rdualw (mgr.24569) 3304 : cluster [DBG] pgmap v2849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:47.508324+0000 mgr.smithi067.rdualw (mgr.24569) 3304 : cluster [DBG] pgmap v2849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:49.508925+0000 mgr.smithi067.rdualw (mgr.24569) 3305 : cluster [DBG] pgmap v2850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:49.508925+0000 mgr.smithi067.rdualw (mgr.24569) 3305 : cluster [DBG] pgmap v2850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:51.509833+0000 mgr.smithi067.rdualw (mgr.24569) 3306 : cluster [DBG] pgmap v2851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:51.509833+0000 mgr.smithi067.rdualw (mgr.24569) 3306 : cluster [DBG] pgmap v2851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:54.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:53.510431+0000 mgr.smithi067.rdualw (mgr.24569) 3307 : cluster [DBG] pgmap v2852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:53.510431+0000 mgr.smithi067.rdualw (mgr.24569) 3307 : cluster [DBG] pgmap v2852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:55.511342+0000 mgr.smithi067.rdualw (mgr.24569) 3308 : cluster [DBG] pgmap v2853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:03:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:55.511342+0000 mgr.smithi067.rdualw (mgr.24569) 3308 : cluster [DBG] pgmap v2853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:03:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:03:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:57.511915+0000 mgr.smithi067.rdualw (mgr.24569) 3309 : cluster [DBG] pgmap v2854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:03:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:03:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:57.511915+0000 mgr.smithi067.rdualw (mgr.24569) 3309 : cluster [DBG] pgmap v2854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:03:59.512494+0000 mgr.smithi067.rdualw (mgr.24569) 3310 : cluster [DBG] pgmap v2855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:03:59.512494+0000 mgr.smithi067.rdualw (mgr.24569) 3310 : cluster [DBG] pgmap v2855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:01.981 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:04:02.283 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:04:02.283 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (101m) 107s ago 102m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:04:02.284 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (94m) 107s ago 102m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:04:02.284 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (94m) 110s ago 102m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:04:02.284 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (101m) 107s ago 102m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:04:02.284 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (94m) 107s ago 98m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:04:02.285 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (94m) 110s ago 98m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:04:02.285 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (95m) 107s ago 103m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:04:02.285 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (95m) 110s ago 102m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:04:02.285 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (95m) 107s ago 103m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:04:02.285 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (95m) 110s ago 101m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:04:02.286 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (95m) 107s ago 95m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:04:02.286 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (95m) 110s ago 95m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:04:02.286 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (102m) 107s ago 102m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:04:02.286 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (101m) 110s ago 101m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:04:02.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (85m) 107s ago 101m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:04:02.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (101m) 107s ago 101m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:04:02.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (100m) 107s ago 100m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:04:02.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (100m) 107s ago 100m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:04:02.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (100m) 110s ago 100m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:04:02.291 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (100m) 110s ago 100m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:04:02.291 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (99m) 110s ago 99m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:04:02.292 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (99m) 110s ago 99m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:04:02.293 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (101m) 107s ago 102m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:04:02.622 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:04:02.622 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:04:02.623 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:04:02.623 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:04:02.623 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:04:02.623 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:04:02.623 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:04:02.624 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:04:02.624 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:04:02.624 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:04:02.624 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:04:02.625 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:04:02.625 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:04:02.625 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:04:02.625 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:04:02.626 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:04:02.626 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:04:02.626 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:04:02.626 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:04:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:01.513435+0000 mgr.smithi067.rdualw (mgr.24569) 3311 : cluster [DBG] pgmap v2856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:01.513435+0000 mgr.smithi067.rdualw (mgr.24569) 3311 : cluster [DBG] pgmap v2856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:04:01.966476+0000 mgr.smithi067.rdualw (mgr.24569) 3312 : audit [DBG] from='client.36346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:04:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:04:02.265718+0000 mgr.smithi067.rdualw (mgr.24569) 3313 : audit [DBG] from='client.36350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:04:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:04:02.620546+0000 mon.smithi061 (mon.0) 845 : audit [DBG] from='client.? 172.21.15.61:0/2886442452' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:04:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:04:01.966476+0000 mgr.smithi067.rdualw (mgr.24569) 3312 : audit [DBG] from='client.36346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:04:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:04:02.265718+0000 mgr.smithi067.rdualw (mgr.24569) 3313 : audit [DBG] from='client.36350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:04:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:04:02.620546+0000 mon.smithi061 (mon.0) 845 : audit [DBG] from='client.? 172.21.15.61:0/2886442452' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:04:04.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:03.514007+0000 mgr.smithi067.rdualw (mgr.24569) 3314 : cluster [DBG] pgmap v2857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:03.514007+0000 mgr.smithi067.rdualw (mgr.24569) 3314 : cluster [DBG] pgmap v2857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:05.515045+0000 mgr.smithi067.rdualw (mgr.24569) 3315 : cluster [DBG] pgmap v2858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:04:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:05.515045+0000 mgr.smithi067.rdualw (mgr.24569) 3315 : cluster [DBG] pgmap v2858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:04:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:07.515660+0000 mgr.smithi067.rdualw (mgr.24569) 3316 : cluster [DBG] pgmap v2859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:07.515660+0000 mgr.smithi067.rdualw (mgr.24569) 3316 : cluster [DBG] pgmap v2859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:09.516265+0000 mgr.smithi067.rdualw (mgr.24569) 3317 : cluster [DBG] pgmap v2860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:09.516265+0000 mgr.smithi067.rdualw (mgr.24569) 3317 : cluster [DBG] pgmap v2860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:11.517116+0000 mgr.smithi067.rdualw (mgr.24569) 3318 : cluster [DBG] pgmap v2861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:11.517116+0000 mgr.smithi067.rdualw (mgr.24569) 3318 : cluster [DBG] pgmap v2861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:14.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:13.517629+0000 mgr.smithi067.rdualw (mgr.24569) 3319 : cluster [DBG] pgmap v2862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:13.517629+0000 mgr.smithi067.rdualw (mgr.24569) 3319 : cluster [DBG] pgmap v2862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:04:15.191990+0000 mon.smithi067 (mon.1) 533 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:04:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:04:15.193467+0000 mon.smithi067 (mon.1) 534 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:04:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:04:15.194491+0000 mon.smithi067 (mon.1) 535 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:04:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:04:15.195415+0000 mgr.smithi067.rdualw (mgr.24569) 3320 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:04:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:15.518348+0000 mgr.smithi067.rdualw (mgr.24569) 3321 : cluster [DBG] pgmap v2863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:04:16.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:04:15.549476+0000 mon.smithi061 (mon.0) 846 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:04:16.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:04:15.566469+0000 mon.smithi061 (mon.0) 847 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:04:16.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:04:15.968900+0000 mon.smithi061 (mon.0) 848 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:04:16.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:04:15.977074+0000 mon.smithi061 (mon.0) 849 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:04:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:04:15.191990+0000 mon.smithi067 (mon.1) 533 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:04:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:04:15.193467+0000 mon.smithi067 (mon.1) 534 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:04:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:04:15.194491+0000 mon.smithi067 (mon.1) 535 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:04:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:04:15.195415+0000 mgr.smithi067.rdualw (mgr.24569) 3320 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:04:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:15.518348+0000 mgr.smithi067.rdualw (mgr.24569) 3321 : cluster [DBG] pgmap v2863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:04:16.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:04:15.549476+0000 mon.smithi061 (mon.0) 846 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:04:16.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:04:15.566469+0000 mon.smithi061 (mon.0) 847 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:04:16.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:04:15.968900+0000 mon.smithi061 (mon.0) 848 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:04:16.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:04:15.977074+0000 mon.smithi061 (mon.0) 849 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:04:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:17.518890+0000 mgr.smithi067.rdualw (mgr.24569) 3322 : cluster [DBG] pgmap v2864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:17.518890+0000 mgr.smithi067.rdualw (mgr.24569) 3322 : cluster [DBG] pgmap v2864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:19.519678+0000 mgr.smithi067.rdualw (mgr.24569) 3323 : cluster [DBG] pgmap v2865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:19.519678+0000 mgr.smithi067.rdualw (mgr.24569) 3323 : cluster [DBG] pgmap v2865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:21.520586+0000 mgr.smithi067.rdualw (mgr.24569) 3324 : cluster [DBG] pgmap v2866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:21.520586+0000 mgr.smithi067.rdualw (mgr.24569) 3324 : cluster [DBG] pgmap v2866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:24.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:23.521241+0000 mgr.smithi067.rdualw (mgr.24569) 3325 : cluster [DBG] pgmap v2867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:23.521241+0000 mgr.smithi067.rdualw (mgr.24569) 3325 : cluster [DBG] pgmap v2867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:25.522130+0000 mgr.smithi067.rdualw (mgr.24569) 3326 : cluster [DBG] pgmap v2868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:04:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:25.522130+0000 mgr.smithi067.rdualw (mgr.24569) 3326 : cluster [DBG] pgmap v2868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:04:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:27.522783+0000 mgr.smithi067.rdualw (mgr.24569) 3327 : cluster [DBG] pgmap v2869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:27.522783+0000 mgr.smithi067.rdualw (mgr.24569) 3327 : cluster [DBG] pgmap v2869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:29.523494+0000 mgr.smithi067.rdualw (mgr.24569) 3328 : cluster [DBG] pgmap v2870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:29.523494+0000 mgr.smithi067.rdualw (mgr.24569) 3328 : cluster [DBG] pgmap v2870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:32.928 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:04:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:31.524598+0000 mgr.smithi067.rdualw (mgr.24569) 3329 : cluster [DBG] pgmap v2871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:31.524598+0000 mgr.smithi067.rdualw (mgr.24569) 3329 : cluster [DBG] pgmap v2871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:33.217 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:04:33.218 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (102m) 2m ago 103m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:04:33.218 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (94m) 2m ago 103m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:04:33.218 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (94m) 2m ago 102m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:04:33.219 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (101m) 2m ago 102m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:04:33.219 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (95m) 2m ago 98m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:04:33.219 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (95m) 2m ago 98m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:04:33.219 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (96m) 2m ago 104m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:04:33.220 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (95m) 2m ago 102m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:04:33.220 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (95m) 2m ago 104m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:04:33.220 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (95m) 2m ago 102m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:04:33.220 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (96m) 2m ago 96m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:04:33.220 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (96m) 2m ago 96m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:04:33.221 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (102m) 2m ago 102m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:04:33.221 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (102m) 2m ago 102m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:04:33.221 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (85m) 2m ago 102m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:04:33.221 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (101m) 2m ago 101m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:04:33.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (101m) 2m ago 101m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:04:33.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (101m) 2m ago 101m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:04:33.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (100m) 2m ago 100m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:04:33.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (100m) 2m ago 100m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:04:33.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (100m) 2m ago 100m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:04:33.223 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (100m) 2m ago 100m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:04:33.223 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (101m) 2m ago 102m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:04:33.585 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:04:33.585 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:04:33.585 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:04:33.586 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:04:33.586 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:04:33.586 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:04:33.586 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:04:33.586 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:04:33.587 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:04:33.587 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:04:33.587 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:04:33.587 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:04:33.588 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:04:33.588 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:04:33.588 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:04:33.588 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:04:33.589 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:04:33.589 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:04:33.589 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:04:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:04:33.583661+0000 mon.smithi061 (mon.0) 850 : audit [DBG] from='client.? 172.21.15.61:0/3018669678' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:04:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:04:33.583661+0000 mon.smithi061 (mon.0) 850 : audit [DBG] from='client.? 172.21.15.61:0/3018669678' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:04:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:04:32.915201+0000 mgr.smithi067.rdualw (mgr.24569) 3330 : audit [DBG] from='client.36358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:04:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:04:33.200028+0000 mgr.smithi067.rdualw (mgr.24569) 3331 : audit [DBG] from='client.36362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:04:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:33.525187+0000 mgr.smithi067.rdualw (mgr.24569) 3332 : cluster [DBG] pgmap v2872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:04:32.915201+0000 mgr.smithi067.rdualw (mgr.24569) 3330 : audit [DBG] from='client.36358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:04:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:04:33.200028+0000 mgr.smithi067.rdualw (mgr.24569) 3331 : audit [DBG] from='client.36362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:04:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:33.525187+0000 mgr.smithi067.rdualw (mgr.24569) 3332 : cluster [DBG] pgmap v2872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:04:34.938832+0000 mon.smithi067 (mon.1) 536 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:04:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:04:34.938976+0000 mon.smithi061 (mon.0) 851 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:04:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:04:34.939087+0000 mon.smithi067 (mon.1) 537 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:04:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:04:34.939318+0000 mon.smithi061 (mon.0) 852 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:04:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:04:34.938832+0000 mon.smithi067 (mon.1) 536 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:04:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:04:34.938976+0000 mon.smithi061 (mon.0) 851 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:04:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:04:34.939087+0000 mon.smithi067 (mon.1) 537 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:04:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:04:34.939318+0000 mon.smithi061 (mon.0) 852 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:04:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:35.526142+0000 mgr.smithi067.rdualw (mgr.24569) 3333 : cluster [DBG] pgmap v2873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:04:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:35.526142+0000 mgr.smithi067.rdualw (mgr.24569) 3333 : cluster [DBG] pgmap v2873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:04:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:37.526862+0000 mgr.smithi067.rdualw (mgr.24569) 3334 : cluster [DBG] pgmap v2874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:37.526862+0000 mgr.smithi067.rdualw (mgr.24569) 3334 : cluster [DBG] pgmap v2874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:39.527615+0000 mgr.smithi067.rdualw (mgr.24569) 3335 : cluster [DBG] pgmap v2875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:39.527615+0000 mgr.smithi067.rdualw (mgr.24569) 3335 : cluster [DBG] pgmap v2875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:41.528695+0000 mgr.smithi067.rdualw (mgr.24569) 3336 : cluster [DBG] pgmap v2876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:41.528695+0000 mgr.smithi067.rdualw (mgr.24569) 3336 : cluster [DBG] pgmap v2876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:43.529271+0000 mgr.smithi067.rdualw (mgr.24569) 3337 : cluster [DBG] pgmap v2877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:43.529271+0000 mgr.smithi067.rdualw (mgr.24569) 3337 : cluster [DBG] pgmap v2877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:45.530263+0000 mgr.smithi067.rdualw (mgr.24569) 3338 : cluster [DBG] pgmap v2878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:04:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:45.530263+0000 mgr.smithi067.rdualw (mgr.24569) 3338 : cluster [DBG] pgmap v2878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:04:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:47.530750+0000 mgr.smithi067.rdualw (mgr.24569) 3339 : cluster [DBG] pgmap v2879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:47.530750+0000 mgr.smithi067.rdualw (mgr.24569) 3339 : cluster [DBG] pgmap v2879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:49.531346+0000 mgr.smithi067.rdualw (mgr.24569) 3340 : cluster [DBG] pgmap v2880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:49.531346+0000 mgr.smithi067.rdualw (mgr.24569) 3340 : cluster [DBG] pgmap v2880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:51.532280+0000 mgr.smithi067.rdualw (mgr.24569) 3341 : cluster [DBG] pgmap v2881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:51.532280+0000 mgr.smithi067.rdualw (mgr.24569) 3341 : cluster [DBG] pgmap v2881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:53.532867+0000 mgr.smithi067.rdualw (mgr.24569) 3342 : cluster [DBG] pgmap v2882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:53.532867+0000 mgr.smithi067.rdualw (mgr.24569) 3342 : cluster [DBG] pgmap v2882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:55.533680+0000 mgr.smithi067.rdualw (mgr.24569) 3343 : cluster [DBG] pgmap v2883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:04:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:55.533680+0000 mgr.smithi067.rdualw (mgr.24569) 3343 : cluster [DBG] pgmap v2883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:04:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:04:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:57.534141+0000 mgr.smithi067.rdualw (mgr.24569) 3344 : cluster [DBG] pgmap v2884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:04:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:04:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:57.534141+0000 mgr.smithi067.rdualw (mgr.24569) 3344 : cluster [DBG] pgmap v2884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:04:59.534899+0000 mgr.smithi067.rdualw (mgr.24569) 3345 : cluster [DBG] pgmap v2885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:04:59.534899+0000 mgr.smithi067.rdualw (mgr.24569) 3345 : cluster [DBG] pgmap v2885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:01.535797+0000 mgr.smithi067.rdualw (mgr.24569) 3346 : cluster [DBG] pgmap v2886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:01.535797+0000 mgr.smithi067.rdualw (mgr.24569) 3346 : cluster [DBG] pgmap v2886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:03.909 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:05:04.200 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:05:04.201 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (102m) 2m ago 103m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:05:04.201 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (95m) 2m ago 103m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:05:04.201 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (95m) 2m ago 103m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:05:04.201 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (102m) 2m ago 103m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:05:04.202 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (95m) 2m ago 99m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:05:04.202 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (95m) 2m ago 99m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:05:04.202 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (96m) 2m ago 104m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:05:04.203 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (96m) 2m ago 103m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:05:04.203 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (96m) 2m ago 104m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:05:04.203 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (96m) 2m ago 103m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:05:04.203 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (97m) 2m ago 97m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:05:04.203 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (96m) 2m ago 96m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:05:04.204 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (103m) 2m ago 103m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:05:04.204 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (102m) 2m ago 102m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:05:04.204 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (86m) 2m ago 102m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:05:04.204 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (102m) 2m ago 102m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:05:04.204 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (101m) 2m ago 101m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:05:04.205 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (101m) 2m ago 101m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:05:04.205 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (101m) 2m ago 101m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:05:04.205 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (101m) 2m ago 101m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:05:04.205 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (100m) 2m ago 100m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:05:04.205 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (100m) 2m ago 100m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:05:04.206 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (102m) 2m ago 103m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:05:04.540 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:05:04.540 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:05:04.540 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:05:04.541 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:05:04.541 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:05:04.541 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:05:04.541 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:05:04.542 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:05:04.542 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:05:04.542 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:05:04.542 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:05:04.542 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:05:04.543 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:05:04.543 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:05:04.543 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:05:04.543 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:05:04.544 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:05:04.544 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:05:04.544 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:05:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:03.536327+0000 mgr.smithi067.rdualw (mgr.24569) 3347 : cluster [DBG] pgmap v2887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:05:04.538665+0000 mon.smithi061 (mon.0) 853 : audit [DBG] from='client.? 172.21.15.61:0/3285864600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:05:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:03.536327+0000 mgr.smithi067.rdualw (mgr.24569) 3347 : cluster [DBG] pgmap v2887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:05:04.538665+0000 mon.smithi061 (mon.0) 853 : audit [DBG] from='client.? 172.21.15.61:0/3285864600' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:05:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:05:03.896312+0000 mgr.smithi067.rdualw (mgr.24569) 3348 : audit [DBG] from='client.36370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:05:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:05:04.182867+0000 mgr.smithi067.rdualw (mgr.24569) 3349 : audit [DBG] from='client.36374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:05:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:05:03.896312+0000 mgr.smithi067.rdualw (mgr.24569) 3348 : audit [DBG] from='client.36370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:05:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:05:04.182867+0000 mgr.smithi067.rdualw (mgr.24569) 3349 : audit [DBG] from='client.36374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:05:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:05.537247+0000 mgr.smithi067.rdualw (mgr.24569) 3350 : cluster [DBG] pgmap v2888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:05:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:05.537247+0000 mgr.smithi067.rdualw (mgr.24569) 3350 : cluster [DBG] pgmap v2888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:05:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:07.537898+0000 mgr.smithi067.rdualw (mgr.24569) 3351 : cluster [DBG] pgmap v2889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:07.537898+0000 mgr.smithi067.rdualw (mgr.24569) 3351 : cluster [DBG] pgmap v2889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:09.538638+0000 mgr.smithi067.rdualw (mgr.24569) 3352 : cluster [DBG] pgmap v2890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:09.538638+0000 mgr.smithi067.rdualw (mgr.24569) 3352 : cluster [DBG] pgmap v2890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:11.539476+0000 mgr.smithi067.rdualw (mgr.24569) 3353 : cluster [DBG] pgmap v2891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:11.539476+0000 mgr.smithi067.rdualw (mgr.24569) 3353 : cluster [DBG] pgmap v2891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:13.540122+0000 mgr.smithi067.rdualw (mgr.24569) 3354 : cluster [DBG] pgmap v2892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:13.540122+0000 mgr.smithi067.rdualw (mgr.24569) 3354 : cluster [DBG] pgmap v2892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:15.540976+0000 mgr.smithi067.rdualw (mgr.24569) 3355 : cluster [DBG] pgmap v2893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:05:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:05:15.981402+0000 mon.smithi067 (mon.1) 538 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:05:16.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:05:15.982857+0000 mon.smithi067 (mon.1) 539 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:05:16.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:05:15.983826+0000 mon.smithi067 (mon.1) 540 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:05:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:15.540976+0000 mgr.smithi067.rdualw (mgr.24569) 3355 : cluster [DBG] pgmap v2893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:05:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:05:15.981402+0000 mon.smithi067 (mon.1) 538 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:05:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:05:15.982857+0000 mon.smithi067 (mon.1) 539 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:05:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:05:15.983826+0000 mon.smithi067 (mon.1) 540 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:05:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:05:15.984677+0000 mgr.smithi067.rdualw (mgr.24569) 3356 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:05:17.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:05:16.401523+0000 mon.smithi061 (mon.0) 854 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:05:17.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:05:16.407093+0000 mon.smithi061 (mon.0) 855 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:05:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:05:15.984677+0000 mgr.smithi067.rdualw (mgr.24569) 3356 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:05:17.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:05:16.401523+0000 mon.smithi061 (mon.0) 854 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:05:17.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:05:16.407093+0000 mon.smithi061 (mon.0) 855 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:05:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:17.541505+0000 mgr.smithi067.rdualw (mgr.24569) 3357 : cluster [DBG] pgmap v2894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:17.541505+0000 mgr.smithi067.rdualw (mgr.24569) 3357 : cluster [DBG] pgmap v2894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:19.542338+0000 mgr.smithi067.rdualw (mgr.24569) 3358 : cluster [DBG] pgmap v2895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:19.542338+0000 mgr.smithi067.rdualw (mgr.24569) 3358 : cluster [DBG] pgmap v2895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:21.543389+0000 mgr.smithi067.rdualw (mgr.24569) 3359 : cluster [DBG] pgmap v2896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:21.543389+0000 mgr.smithi067.rdualw (mgr.24569) 3359 : cluster [DBG] pgmap v2896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:23.543967+0000 mgr.smithi067.rdualw (mgr.24569) 3360 : cluster [DBG] pgmap v2897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:23.543967+0000 mgr.smithi067.rdualw (mgr.24569) 3360 : cluster [DBG] pgmap v2897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:25.545024+0000 mgr.smithi067.rdualw (mgr.24569) 3361 : cluster [DBG] pgmap v2898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:05:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:25.545024+0000 mgr.smithi067.rdualw (mgr.24569) 3361 : cluster [DBG] pgmap v2898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:05:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:27.545505+0000 mgr.smithi067.rdualw (mgr.24569) 3362 : cluster [DBG] pgmap v2899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:27.545505+0000 mgr.smithi067.rdualw (mgr.24569) 3362 : cluster [DBG] pgmap v2899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:29.546200+0000 mgr.smithi067.rdualw (mgr.24569) 3363 : cluster [DBG] pgmap v2900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:29.546200+0000 mgr.smithi067.rdualw (mgr.24569) 3363 : cluster [DBG] pgmap v2900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:31.547148+0000 mgr.smithi067.rdualw (mgr.24569) 3364 : cluster [DBG] pgmap v2901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:31.547148+0000 mgr.smithi067.rdualw (mgr.24569) 3364 : cluster [DBG] pgmap v2901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:34.846 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:05:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:33.547726+0000 mgr.smithi067.rdualw (mgr.24569) 3365 : cluster [DBG] pgmap v2902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:33.547726+0000 mgr.smithi067.rdualw (mgr.24569) 3365 : cluster [DBG] pgmap v2902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:35.138 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:05:35.138 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (103m) 3m ago 104m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:05:35.138 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (95m) 3m ago 104m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:05:35.138 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (95m) 3m ago 103m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:05:35.139 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (102m) 3m ago 104m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:05:35.139 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (96m) 3m ago 99m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:05:35.139 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (96m) 3m ago 99m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:05:35.139 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (97m) 3m ago 105m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:05:35.140 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (96m) 3m ago 103m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:05:35.140 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (96m) 3m ago 105m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:05:35.140 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (96m) 3m ago 103m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:05:35.140 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (97m) 3m ago 97m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:05:35.140 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (97m) 3m ago 97m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:05:35.141 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (103m) 3m ago 103m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:05:35.141 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (103m) 3m ago 103m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:05:35.141 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (86m) 3m ago 103m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:05:35.141 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (102m) 3m ago 102m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:05:35.141 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (102m) 3m ago 102m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:05:35.142 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (102m) 3m ago 102m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:05:35.142 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (101m) 3m ago 101m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:05:35.142 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (101m) 3m ago 101m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:05:35.142 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (101m) 3m ago 101m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:05:35.143 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (101m) 3m ago 101m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:05:35.143 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (102m) 3m ago 103m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:05:35.480 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:05:35.480 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:05:35.481 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:05:35.481 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:05:35.481 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:05:35.481 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:05:35.481 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:05:35.482 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:05:35.482 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:05:35.482 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:05:35.482 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:05:35.483 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:05:35.483 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:05:35.483 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:05:35.483 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:05:35.484 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:05:35.484 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:05:35.484 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:05:35.484 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:05:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:05:34.832632+0000 mgr.smithi067.rdualw (mgr.24569) 3366 : audit [DBG] from='client.36382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:05:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:05:34.944553+0000 mon.smithi067 (mon.1) 541 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:05:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:05:34.944579+0000 mon.smithi061 (mon.0) 856 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:05:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:05:34.944868+0000 mon.smithi067 (mon.1) 542 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:05:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:05:34.944997+0000 mon.smithi061 (mon.0) 857 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:05:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:05:35.478826+0000 mon.smithi061 (mon.0) 858 : audit [DBG] from='client.? 172.21.15.61:0/1631971434' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:05:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:05:34.832632+0000 mgr.smithi067.rdualw (mgr.24569) 3366 : audit [DBG] from='client.36382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:05:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:05:34.944553+0000 mon.smithi067 (mon.1) 541 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:05:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:05:34.944579+0000 mon.smithi061 (mon.0) 856 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:05:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:05:34.944868+0000 mon.smithi067 (mon.1) 542 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:05:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:05:34.944997+0000 mon.smithi061 (mon.0) 857 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:05:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:05:35.478826+0000 mon.smithi061 (mon.0) 858 : audit [DBG] from='client.? 172.21.15.61:0/1631971434' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:05:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:05:35.120465+0000 mgr.smithi067.rdualw (mgr.24569) 3367 : audit [DBG] from='client.36386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:05:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:35.548572+0000 mgr.smithi067.rdualw (mgr.24569) 3368 : cluster [DBG] pgmap v2903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:05:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:05:35.120465+0000 mgr.smithi067.rdualw (mgr.24569) 3367 : audit [DBG] from='client.36386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:05:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:35.548572+0000 mgr.smithi067.rdualw (mgr.24569) 3368 : cluster [DBG] pgmap v2903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:05:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:37.549069+0000 mgr.smithi067.rdualw (mgr.24569) 3369 : cluster [DBG] pgmap v2904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:37.549069+0000 mgr.smithi067.rdualw (mgr.24569) 3369 : cluster [DBG] pgmap v2904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:39.549671+0000 mgr.smithi067.rdualw (mgr.24569) 3370 : cluster [DBG] pgmap v2905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:39.549671+0000 mgr.smithi067.rdualw (mgr.24569) 3370 : cluster [DBG] pgmap v2905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:41.550514+0000 mgr.smithi067.rdualw (mgr.24569) 3371 : cluster [DBG] pgmap v2906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:41.550514+0000 mgr.smithi067.rdualw (mgr.24569) 3371 : cluster [DBG] pgmap v2906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:43.551043+0000 mgr.smithi067.rdualw (mgr.24569) 3372 : cluster [DBG] pgmap v2907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:43.551043+0000 mgr.smithi067.rdualw (mgr.24569) 3372 : cluster [DBG] pgmap v2907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:45.551950+0000 mgr.smithi067.rdualw (mgr.24569) 3373 : cluster [DBG] pgmap v2908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:05:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:45.551950+0000 mgr.smithi067.rdualw (mgr.24569) 3373 : cluster [DBG] pgmap v2908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:05:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:47.552607+0000 mgr.smithi067.rdualw (mgr.24569) 3374 : cluster [DBG] pgmap v2909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:47.552607+0000 mgr.smithi067.rdualw (mgr.24569) 3374 : cluster [DBG] pgmap v2909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:49.553235+0000 mgr.smithi067.rdualw (mgr.24569) 3375 : cluster [DBG] pgmap v2910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:49.553235+0000 mgr.smithi067.rdualw (mgr.24569) 3375 : cluster [DBG] pgmap v2910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:51.554293+0000 mgr.smithi067.rdualw (mgr.24569) 3376 : cluster [DBG] pgmap v2911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:51.554293+0000 mgr.smithi067.rdualw (mgr.24569) 3376 : cluster [DBG] pgmap v2911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:53.554854+0000 mgr.smithi067.rdualw (mgr.24569) 3377 : cluster [DBG] pgmap v2912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:53.554854+0000 mgr.smithi067.rdualw (mgr.24569) 3377 : cluster [DBG] pgmap v2912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:55.555743+0000 mgr.smithi067.rdualw (mgr.24569) 3378 : cluster [DBG] pgmap v2913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:05:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:55.555743+0000 mgr.smithi067.rdualw (mgr.24569) 3378 : cluster [DBG] pgmap v2913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:05:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:05:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:57.556244+0000 mgr.smithi067.rdualw (mgr.24569) 3379 : cluster [DBG] pgmap v2914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:05:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:05:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:57.556244+0000 mgr.smithi067.rdualw (mgr.24569) 3379 : cluster [DBG] pgmap v2914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:05:59.557063+0000 mgr.smithi067.rdualw (mgr.24569) 3380 : cluster [DBG] pgmap v2915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:05:59.557063+0000 mgr.smithi067.rdualw (mgr.24569) 3380 : cluster [DBG] pgmap v2915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:01.558066+0000 mgr.smithi067.rdualw (mgr.24569) 3381 : cluster [DBG] pgmap v2916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:01.558066+0000 mgr.smithi067.rdualw (mgr.24569) 3381 : cluster [DBG] pgmap v2916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:03.558606+0000 mgr.smithi067.rdualw (mgr.24569) 3382 : cluster [DBG] pgmap v2917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:03.558606+0000 mgr.smithi067.rdualw (mgr.24569) 3382 : cluster [DBG] pgmap v2917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:05.788 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:06:06.079 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:06:06.079 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (103m) 3m ago 104m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:06:06.079 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (96m) 3m ago 104m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:06:06.080 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (96m) 3m ago 104m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:06:06.080 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (103m) 3m ago 104m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:06:06.080 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (96m) 3m ago 100m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:06:06.080 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (96m) 3m ago 100m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:06:06.080 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (97m) 3m ago 105m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:06:06.081 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (97m) 3m ago 104m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:06:06.081 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (97m) 3m ago 105m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:06:06.081 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (97m) 3m ago 104m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:06:06.081 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (98m) 3m ago 98m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:06:06.082 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (97m) 3m ago 97m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:06:06.082 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (104m) 3m ago 104m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:06:06.082 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (103m) 3m ago 103m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:06:06.082 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (87m) 3m ago 103m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:06:06.083 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (103m) 3m ago 103m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:06:06.083 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (103m) 3m ago 102m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:06:06.083 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (102m) 3m ago 102m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:06:06.083 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (102m) 3m ago 102m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:06:06.083 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (102m) 3m ago 102m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:06:06.084 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (101m) 3m ago 101m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:06:06.084 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (101m) 3m ago 101m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:06:06.084 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (103m) 3m ago 104m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:06:06.421 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:06:06.422 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:06:06.422 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:06:06.423 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:06:06.423 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:06:06.423 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:06:06.424 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:06:06.424 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:06:06.425 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:06:06.425 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:06:06.426 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:06:06.426 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:06:06.427 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:06:06.427 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:06:06.427 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:06:06.428 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:06:06.428 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:06:06.429 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:06:06.429 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:06:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:05.559371+0000 mgr.smithi067.rdualw (mgr.24569) 3383 : cluster [DBG] pgmap v2918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:06:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:06:05.775752+0000 mgr.smithi067.rdualw (mgr.24569) 3384 : audit [DBG] from='client.36394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:06:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:05.559371+0000 mgr.smithi067.rdualw (mgr.24569) 3383 : cluster [DBG] pgmap v2918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:06:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:06:05.775752+0000 mgr.smithi067.rdualw (mgr.24569) 3384 : audit [DBG] from='client.36394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:06:07.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:06:06.061515+0000 mgr.smithi067.rdualw (mgr.24569) 3385 : audit [DBG] from='client.36398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:06:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:06:06.419785+0000 mon.smithi061 (mon.0) 859 : audit [DBG] from='client.? 172.21.15.61:0/3708784650' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:06:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:06:06.061515+0000 mgr.smithi067.rdualw (mgr.24569) 3385 : audit [DBG] from='client.36398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:06:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:06:06.419785+0000 mon.smithi061 (mon.0) 859 : audit [DBG] from='client.? 172.21.15.61:0/3708784650' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:06:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:07.560152+0000 mgr.smithi067.rdualw (mgr.24569) 3386 : cluster [DBG] pgmap v2919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:07.560152+0000 mgr.smithi067.rdualw (mgr.24569) 3386 : cluster [DBG] pgmap v2919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:09.560942+0000 mgr.smithi067.rdualw (mgr.24569) 3387 : cluster [DBG] pgmap v2920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:09.560942+0000 mgr.smithi067.rdualw (mgr.24569) 3387 : cluster [DBG] pgmap v2920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:11.562010+0000 mgr.smithi067.rdualw (mgr.24569) 3388 : cluster [DBG] pgmap v2921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:11.562010+0000 mgr.smithi067.rdualw (mgr.24569) 3388 : cluster [DBG] pgmap v2921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:13.562741+0000 mgr.smithi067.rdualw (mgr.24569) 3389 : cluster [DBG] pgmap v2922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:13.562741+0000 mgr.smithi067.rdualw (mgr.24569) 3389 : cluster [DBG] pgmap v2922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:15.563707+0000 mgr.smithi067.rdualw (mgr.24569) 3390 : cluster [DBG] pgmap v2923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:06:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:15.563707+0000 mgr.smithi067.rdualw (mgr.24569) 3390 : cluster [DBG] pgmap v2923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:06:17.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:06:16.410977+0000 mon.smithi067 (mon.1) 543 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:06:17.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:06:16.412563+0000 mon.smithi067 (mon.1) 544 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:06:17.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:06:16.413658+0000 mon.smithi067 (mon.1) 545 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:06:17.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:06:16.414496+0000 mgr.smithi067.rdualw (mgr.24569) 3391 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:06:17.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:06:16.831437+0000 mon.smithi061 (mon.0) 860 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:06:17.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:06:16.839002+0000 mon.smithi061 (mon.0) 861 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:06:17.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:06:16.410977+0000 mon.smithi067 (mon.1) 543 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:06:17.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:06:16.412563+0000 mon.smithi067 (mon.1) 544 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:06:17.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:06:16.413658+0000 mon.smithi067 (mon.1) 545 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:06:17.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:06:16.414496+0000 mgr.smithi067.rdualw (mgr.24569) 3391 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:06:17.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:06:16.831437+0000 mon.smithi061 (mon.0) 860 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:06:17.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:06:16.839002+0000 mon.smithi061 (mon.0) 861 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:06:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:17.564356+0000 mgr.smithi067.rdualw (mgr.24569) 3392 : cluster [DBG] pgmap v2924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:17.564356+0000 mgr.smithi067.rdualw (mgr.24569) 3392 : cluster [DBG] pgmap v2924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:19.564956+0000 mgr.smithi067.rdualw (mgr.24569) 3393 : cluster [DBG] pgmap v2925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:19.564956+0000 mgr.smithi067.rdualw (mgr.24569) 3393 : cluster [DBG] pgmap v2925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:21.565860+0000 mgr.smithi067.rdualw (mgr.24569) 3394 : cluster [DBG] pgmap v2926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:21.565860+0000 mgr.smithi067.rdualw (mgr.24569) 3394 : cluster [DBG] pgmap v2926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:23.566367+0000 mgr.smithi067.rdualw (mgr.24569) 3395 : cluster [DBG] pgmap v2927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:23.566367+0000 mgr.smithi067.rdualw (mgr.24569) 3395 : cluster [DBG] pgmap v2927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:25.567248+0000 mgr.smithi067.rdualw (mgr.24569) 3396 : cluster [DBG] pgmap v2928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:06:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:25.567248+0000 mgr.smithi067.rdualw (mgr.24569) 3396 : cluster [DBG] pgmap v2928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:06:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:27.567765+0000 mgr.smithi067.rdualw (mgr.24569) 3397 : cluster [DBG] pgmap v2929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:27.567765+0000 mgr.smithi067.rdualw (mgr.24569) 3397 : cluster [DBG] pgmap v2929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:29.568472+0000 mgr.smithi067.rdualw (mgr.24569) 3398 : cluster [DBG] pgmap v2930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:29.568472+0000 mgr.smithi067.rdualw (mgr.24569) 3398 : cluster [DBG] pgmap v2930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:31.569458+0000 mgr.smithi067.rdualw (mgr.24569) 3399 : cluster [DBG] pgmap v2931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:31.569458+0000 mgr.smithi067.rdualw (mgr.24569) 3399 : cluster [DBG] pgmap v2931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:33.570196+0000 mgr.smithi067.rdualw (mgr.24569) 3400 : cluster [DBG] pgmap v2932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:33.570196+0000 mgr.smithi067.rdualw (mgr.24569) 3400 : cluster [DBG] pgmap v2932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:06:34.949849+0000 mon.smithi067 (mon.1) 546 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:06:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:06:34.950065+0000 mon.smithi061 (mon.0) 862 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:06:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:06:34.950191+0000 mon.smithi067 (mon.1) 547 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:06:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:06:34.950466+0000 mon.smithi061 (mon.0) 863 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:06:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:06:34.949849+0000 mon.smithi067 (mon.1) 546 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:06:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:06:34.950065+0000 mon.smithi061 (mon.0) 862 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:06:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:06:34.950191+0000 mon.smithi067 (mon.1) 547 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:06:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:06:34.950466+0000 mon.smithi061 (mon.0) 863 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:06:36.731 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:06:37.022 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:06:37.023 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (104m) 4m ago 105m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:06:37.023 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (96m) 4m ago 105m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:06:37.023 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (96m) 4m ago 104m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:06:37.024 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (104m) 4m ago 105m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:06:37.024 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (97m) 4m ago 100m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:06:37.024 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (97m) 4m ago 100m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:06:37.024 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (98m) 4m ago 106m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:06:37.025 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (97m) 4m ago 104m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:06:37.025 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (97m) 4m ago 106m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:06:37.025 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (97m) 4m ago 104m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:06:37.025 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (98m) 4m ago 98m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:06:37.026 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (98m) 4m ago 98m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:06:37.026 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (104m) 4m ago 104m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:06:37.026 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (104m) 4m ago 104m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:06:37.026 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (87m) 4m ago 104m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:06:37.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (103m) 4m ago 103m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:06:37.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (103m) 4m ago 103m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:06:37.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (103m) 4m ago 103m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:06:37.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (102m) 4m ago 102m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:06:37.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (102m) 4m ago 102m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:06:37.028 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (102m) 4m ago 102m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:06:37.028 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (102m) 4m ago 102m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:06:37.028 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (103m) 4m ago 104m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:06:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:35.571042+0000 mgr.smithi067.rdualw (mgr.24569) 3401 : cluster [DBG] pgmap v2933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:06:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:35.571042+0000 mgr.smithi067.rdualw (mgr.24569) 3401 : cluster [DBG] pgmap v2933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:06:37.362 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:06:37.362 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:06:37.363 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:06:37.363 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:06:37.363 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:06:37.363 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:06:37.364 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:06:37.364 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:06:37.364 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:06:37.364 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:06:37.365 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:06:37.365 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:06:37.365 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:06:37.365 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:06:37.365 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:06:37.366 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:06:37.366 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:06:37.366 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:06:37.366 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:06:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:06:36.717790+0000 mgr.smithi067.rdualw (mgr.24569) 3402 : audit [DBG] from='client.36406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:06:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:06:37.361004+0000 mon.smithi061 (mon.0) 864 : audit [DBG] from='client.? 172.21.15.61:0/1029858828' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:06:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:06:36.717790+0000 mgr.smithi067.rdualw (mgr.24569) 3402 : audit [DBG] from='client.36406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:06:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:06:37.361004+0000 mon.smithi061 (mon.0) 864 : audit [DBG] from='client.? 172.21.15.61:0/1029858828' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:06:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:06:37.005347+0000 mgr.smithi067.rdualw (mgr.24569) 3403 : audit [DBG] from='client.36410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:06:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:37.571778+0000 mgr.smithi067.rdualw (mgr.24569) 3404 : cluster [DBG] pgmap v2934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:06:37.005347+0000 mgr.smithi067.rdualw (mgr.24569) 3403 : audit [DBG] from='client.36410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:06:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:37.571778+0000 mgr.smithi067.rdualw (mgr.24569) 3404 : cluster [DBG] pgmap v2934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:39.572293+0000 mgr.smithi067.rdualw (mgr.24569) 3405 : cluster [DBG] pgmap v2935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:39.572293+0000 mgr.smithi067.rdualw (mgr.24569) 3405 : cluster [DBG] pgmap v2935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:41.573151+0000 mgr.smithi067.rdualw (mgr.24569) 3406 : cluster [DBG] pgmap v2936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:41.573151+0000 mgr.smithi067.rdualw (mgr.24569) 3406 : cluster [DBG] pgmap v2936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:43.573831+0000 mgr.smithi067.rdualw (mgr.24569) 3407 : cluster [DBG] pgmap v2937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:43.573831+0000 mgr.smithi067.rdualw (mgr.24569) 3407 : cluster [DBG] pgmap v2937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:45.574662+0000 mgr.smithi067.rdualw (mgr.24569) 3408 : cluster [DBG] pgmap v2938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:06:46.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:45.574662+0000 mgr.smithi067.rdualw (mgr.24569) 3408 : cluster [DBG] pgmap v2938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:06:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:47.575144+0000 mgr.smithi067.rdualw (mgr.24569) 3409 : cluster [DBG] pgmap v2939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:47.575144+0000 mgr.smithi067.rdualw (mgr.24569) 3409 : cluster [DBG] pgmap v2939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:49.575722+0000 mgr.smithi067.rdualw (mgr.24569) 3410 : cluster [DBG] pgmap v2940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:49.575722+0000 mgr.smithi067.rdualw (mgr.24569) 3410 : cluster [DBG] pgmap v2940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:51.576591+0000 mgr.smithi067.rdualw (mgr.24569) 3411 : cluster [DBG] pgmap v2941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:51.576591+0000 mgr.smithi067.rdualw (mgr.24569) 3411 : cluster [DBG] pgmap v2941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:53.577242+0000 mgr.smithi067.rdualw (mgr.24569) 3412 : cluster [DBG] pgmap v2942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:53.577242+0000 mgr.smithi067.rdualw (mgr.24569) 3412 : cluster [DBG] pgmap v2942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:55.578071+0000 mgr.smithi067.rdualw (mgr.24569) 3413 : cluster [DBG] pgmap v2943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:06:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:55.578071+0000 mgr.smithi067.rdualw (mgr.24569) 3413 : cluster [DBG] pgmap v2943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:06:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:06:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:57.578568+0000 mgr.smithi067.rdualw (mgr.24569) 3414 : cluster [DBG] pgmap v2944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:06:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:06:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:57.578568+0000 mgr.smithi067.rdualw (mgr.24569) 3414 : cluster [DBG] pgmap v2944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:06:59.579164+0000 mgr.smithi067.rdualw (mgr.24569) 3415 : cluster [DBG] pgmap v2945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:06:59.579164+0000 mgr.smithi067.rdualw (mgr.24569) 3415 : cluster [DBG] pgmap v2945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:01.580089+0000 mgr.smithi067.rdualw (mgr.24569) 3416 : cluster [DBG] pgmap v2946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:01.580089+0000 mgr.smithi067.rdualw (mgr.24569) 3416 : cluster [DBG] pgmap v2946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:03.580702+0000 mgr.smithi067.rdualw (mgr.24569) 3417 : cluster [DBG] pgmap v2947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:03.580702+0000 mgr.smithi067.rdualw (mgr.24569) 3417 : cluster [DBG] pgmap v2947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:05.581754+0000 mgr.smithi067.rdualw (mgr.24569) 3418 : cluster [DBG] pgmap v2948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:07:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:05.581754+0000 mgr.smithi067.rdualw (mgr.24569) 3418 : cluster [DBG] pgmap v2948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:07:07.670 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:07:07.967 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:07:07.967 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (104m) 4m ago 105m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:07:07.967 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (97m) 4m ago 105m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:07:07.967 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (97m) 4m ago 105m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:07:07.968 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (104m) 4m ago 105m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:07:07.968 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (97m) 4m ago 101m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:07:07.968 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (97m) 4m ago 101m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:07:07.968 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (98m) 4m ago 106m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:07:07.969 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (98m) 4m ago 105m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:07:07.969 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (98m) 4m ago 107m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:07:07.969 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (98m) 4m ago 105m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:07:07.969 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (99m) 4m ago 99m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:07:07.969 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (99m) 4m ago 99m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:07:07.970 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (105m) 4m ago 105m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:07:07.970 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (104m) 4m ago 104m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:07:07.970 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (88m) 4m ago 104m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:07:07.970 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (104m) 4m ago 104m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:07:07.971 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (104m) 4m ago 104m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:07:07.971 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (103m) 4m ago 103m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:07:07.971 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (103m) 4m ago 103m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:07:07.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (103m) 4m ago 103m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:07:07.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (103m) 4m ago 103m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:07:07.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (102m) 4m ago 102m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:07:07.972 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (104m) 4m ago 105m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:07:08.383 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:07:08.383 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:07:08.383 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:07:08.384 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:07:08.384 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:07:08.384 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:07:08.385 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:07:08.385 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:07:08.385 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:07:08.386 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:07:08.386 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:07:08.386 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:07:08.386 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:07:08.387 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:07:08.387 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:07:08.387 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:07:08.387 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:07:08.388 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:07:08.388 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:07:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:07.582169+0000 mgr.smithi067.rdualw (mgr.24569) 3419 : cluster [DBG] pgmap v2949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:07:07.656891+0000 mgr.smithi067.rdualw (mgr.24569) 3420 : audit [DBG] from='client.36418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:07:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:07:08.381380+0000 mon.smithi061 (mon.0) 865 : audit [DBG] from='client.? 172.21.15.61:0/2760784166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:07:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:07.582169+0000 mgr.smithi067.rdualw (mgr.24569) 3419 : cluster [DBG] pgmap v2949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:07:07.656891+0000 mgr.smithi067.rdualw (mgr.24569) 3420 : audit [DBG] from='client.36418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:07:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:07:08.381380+0000 mon.smithi061 (mon.0) 865 : audit [DBG] from='client.? 172.21.15.61:0/2760784166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:07:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:07:07.949046+0000 mgr.smithi067.rdualw (mgr.24569) 3421 : audit [DBG] from='client.36422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:07:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:07:07.949046+0000 mgr.smithi067.rdualw (mgr.24569) 3421 : audit [DBG] from='client.36422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:07:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:09.582723+0000 mgr.smithi067.rdualw (mgr.24569) 3422 : cluster [DBG] pgmap v2950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:09.582723+0000 mgr.smithi067.rdualw (mgr.24569) 3422 : cluster [DBG] pgmap v2950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:11.583627+0000 mgr.smithi067.rdualw (mgr.24569) 3423 : cluster [DBG] pgmap v2951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:11.583627+0000 mgr.smithi067.rdualw (mgr.24569) 3423 : cluster [DBG] pgmap v2951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:13.584160+0000 mgr.smithi067.rdualw (mgr.24569) 3424 : cluster [DBG] pgmap v2952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:13.584160+0000 mgr.smithi067.rdualw (mgr.24569) 3424 : cluster [DBG] pgmap v2952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:15.585040+0000 mgr.smithi067.rdualw (mgr.24569) 3425 : cluster [DBG] pgmap v2953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:07:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:15.585040+0000 mgr.smithi067.rdualw (mgr.24569) 3425 : cluster [DBG] pgmap v2953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:07:17.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:07:16.842734+0000 mon.smithi067 (mon.1) 548 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:07:17.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:07:16.844161+0000 mon.smithi067 (mon.1) 549 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:07:17.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:07:16.845071+0000 mon.smithi067 (mon.1) 550 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:07:17.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:07:16.845895+0000 mgr.smithi067.rdualw (mgr.24569) 3426 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:07:17.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:07:16.842734+0000 mon.smithi067 (mon.1) 548 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:07:17.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:07:16.844161+0000 mon.smithi067 (mon.1) 549 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:07:17.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:07:16.845071+0000 mon.smithi067 (mon.1) 550 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:07:17.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:07:16.845895+0000 mgr.smithi067.rdualw (mgr.24569) 3426 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:07:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:07:17.252364+0000 mon.smithi061 (mon.0) 866 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:07:18.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:07:17.258465+0000 mon.smithi061 (mon.0) 867 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:07:18.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:17.585647+0000 mgr.smithi067.rdualw (mgr.24569) 3427 : cluster [DBG] pgmap v2954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:07:17.252364+0000 mon.smithi061 (mon.0) 866 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:07:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:07:17.258465+0000 mon.smithi061 (mon.0) 867 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:07:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:17.585647+0000 mgr.smithi067.rdualw (mgr.24569) 3427 : cluster [DBG] pgmap v2954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:19.586324+0000 mgr.smithi067.rdualw (mgr.24569) 3428 : cluster [DBG] pgmap v2955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:19.586324+0000 mgr.smithi067.rdualw (mgr.24569) 3428 : cluster [DBG] pgmap v2955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:21.587307+0000 mgr.smithi067.rdualw (mgr.24569) 3429 : cluster [DBG] pgmap v2956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:21.587307+0000 mgr.smithi067.rdualw (mgr.24569) 3429 : cluster [DBG] pgmap v2956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:23.588100+0000 mgr.smithi067.rdualw (mgr.24569) 3430 : cluster [DBG] pgmap v2957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:23.588100+0000 mgr.smithi067.rdualw (mgr.24569) 3430 : cluster [DBG] pgmap v2957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:25.588976+0000 mgr.smithi067.rdualw (mgr.24569) 3431 : cluster [DBG] pgmap v2958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:07:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:25.588976+0000 mgr.smithi067.rdualw (mgr.24569) 3431 : cluster [DBG] pgmap v2958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:07:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:27.589567+0000 mgr.smithi067.rdualw (mgr.24569) 3432 : cluster [DBG] pgmap v2959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:27.589567+0000 mgr.smithi067.rdualw (mgr.24569) 3432 : cluster [DBG] pgmap v2959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:31.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:29.590087+0000 mgr.smithi067.rdualw (mgr.24569) 3433 : cluster [DBG] pgmap v2960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:29.590087+0000 mgr.smithi067.rdualw (mgr.24569) 3433 : cluster [DBG] pgmap v2960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:31.591041+0000 mgr.smithi067.rdualw (mgr.24569) 3434 : cluster [DBG] pgmap v2961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:31.591041+0000 mgr.smithi067.rdualw (mgr.24569) 3434 : cluster [DBG] pgmap v2961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:33.591661+0000 mgr.smithi067.rdualw (mgr.24569) 3435 : cluster [DBG] pgmap v2962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:33.591661+0000 mgr.smithi067.rdualw (mgr.24569) 3435 : cluster [DBG] pgmap v2962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:07:34.955012+0000 mon.smithi067 (mon.1) 551 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:07:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:07:34.955121+0000 mon.smithi061 (mon.0) 868 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:07:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:07:34.955273+0000 mon.smithi067 (mon.1) 552 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:07:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:07:34.955428+0000 mon.smithi061 (mon.0) 869 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:07:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:07:34.955012+0000 mon.smithi067 (mon.1) 551 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:07:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:07:34.955121+0000 mon.smithi061 (mon.0) 868 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:07:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:07:34.955273+0000 mon.smithi067 (mon.1) 552 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:07:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:07:34.955428+0000 mon.smithi061 (mon.0) 869 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:07:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:35.592671+0000 mgr.smithi067.rdualw (mgr.24569) 3436 : cluster [DBG] pgmap v2963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:07:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:35.592671+0000 mgr.smithi067.rdualw (mgr.24569) 3436 : cluster [DBG] pgmap v2963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:07:38.709 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:07:39.001 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:07:39.001 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (105m) 5m ago 106m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:07:39.002 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (97m) 5m ago 106m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:07:39.002 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (97m) 5m ago 105m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:07:39.002 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (105m) 5m ago 106m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:07:39.002 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (98m) 5m ago 101m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:07:39.003 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (98m) 5m ago 101m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:07:39.003 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (99m) 5m ago 107m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:07:39.003 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (98m) 5m ago 105m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:07:39.003 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (98m) 5m ago 107m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:07:39.004 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (98m) 5m ago 105m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:07:39.004 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (99m) 5m ago 99m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:07:39.004 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (99m) 5m ago 99m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:07:39.004 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (106m) 5m ago 106m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:07:39.004 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (105m) 5m ago 105m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:07:39.005 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (88m) 5m ago 105m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:07:39.005 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (104m) 5m ago 104m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:07:39.005 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (104m) 5m ago 104m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:07:39.005 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (104m) 5m ago 104m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:07:39.006 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (104m) 5m ago 104m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:07:39.006 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (103m) 5m ago 103m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:07:39.006 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (103m) 5m ago 103m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:07:39.006 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (103m) 5m ago 103m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:07:39.007 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (104m) 5m ago 105m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:07:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:37.593127+0000 mgr.smithi067.rdualw (mgr.24569) 3437 : cluster [DBG] pgmap v2964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:37.593127+0000 mgr.smithi067.rdualw (mgr.24569) 3437 : cluster [DBG] pgmap v2964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:39.340 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:07:39.341 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:07:39.341 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:07:39.342 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:07:39.342 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:07:39.342 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:07:39.343 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:07:39.343 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:07:39.344 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:07:39.344 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:07:39.344 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:07:39.345 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:07:39.345 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:07:39.345 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:07:39.346 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:07:39.346 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:07:39.346 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:07:39.347 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:07:39.347 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:07:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:07:38.696171+0000 mgr.smithi067.rdualw (mgr.24569) 3438 : audit [DBG] from='client.36430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:07:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:07:39.338773+0000 mon.smithi061 (mon.0) 870 : audit [DBG] from='client.? 172.21.15.61:0/1938419432' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:07:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:07:38.696171+0000 mgr.smithi067.rdualw (mgr.24569) 3438 : audit [DBG] from='client.36430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:07:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:07:39.338773+0000 mon.smithi061 (mon.0) 870 : audit [DBG] from='client.? 172.21.15.61:0/1938419432' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:07:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:07:38.983961+0000 mgr.smithi067.rdualw (mgr.24569) 3439 : audit [DBG] from='client.36434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:07:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:39.593694+0000 mgr.smithi067.rdualw (mgr.24569) 3440 : cluster [DBG] pgmap v2965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:07:38.983961+0000 mgr.smithi067.rdualw (mgr.24569) 3439 : audit [DBG] from='client.36434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:07:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:39.593694+0000 mgr.smithi067.rdualw (mgr.24569) 3440 : cluster [DBG] pgmap v2965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:41.594583+0000 mgr.smithi067.rdualw (mgr.24569) 3441 : cluster [DBG] pgmap v2966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:41.594583+0000 mgr.smithi067.rdualw (mgr.24569) 3441 : cluster [DBG] pgmap v2966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:43.595330+0000 mgr.smithi067.rdualw (mgr.24569) 3442 : cluster [DBG] pgmap v2967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:43.595330+0000 mgr.smithi067.rdualw (mgr.24569) 3442 : cluster [DBG] pgmap v2967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:45.596153+0000 mgr.smithi067.rdualw (mgr.24569) 3443 : cluster [DBG] pgmap v2968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:07:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:45.596153+0000 mgr.smithi067.rdualw (mgr.24569) 3443 : cluster [DBG] pgmap v2968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:07:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:47.596728+0000 mgr.smithi067.rdualw (mgr.24569) 3444 : cluster [DBG] pgmap v2969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:47.596728+0000 mgr.smithi067.rdualw (mgr.24569) 3444 : cluster [DBG] pgmap v2969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:49.597443+0000 mgr.smithi067.rdualw (mgr.24569) 3445 : cluster [DBG] pgmap v2970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:49.597443+0000 mgr.smithi067.rdualw (mgr.24569) 3445 : cluster [DBG] pgmap v2970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:51.598330+0000 mgr.smithi067.rdualw (mgr.24569) 3446 : cluster [DBG] pgmap v2971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:51.598330+0000 mgr.smithi067.rdualw (mgr.24569) 3446 : cluster [DBG] pgmap v2971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:53.599076+0000 mgr.smithi067.rdualw (mgr.24569) 3447 : cluster [DBG] pgmap v2972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:53.599076+0000 mgr.smithi067.rdualw (mgr.24569) 3447 : cluster [DBG] pgmap v2972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:55.600121+0000 mgr.smithi067.rdualw (mgr.24569) 3448 : cluster [DBG] pgmap v2973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:07:56.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:55.600121+0000 mgr.smithi067.rdualw (mgr.24569) 3448 : cluster [DBG] pgmap v2973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:07:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:07:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:57.600740+0000 mgr.smithi067.rdualw (mgr.24569) 3449 : cluster [DBG] pgmap v2974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:07:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:07:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:57.600740+0000 mgr.smithi067.rdualw (mgr.24569) 3449 : cluster [DBG] pgmap v2974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:07:59.601596+0000 mgr.smithi067.rdualw (mgr.24569) 3450 : cluster [DBG] pgmap v2975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:07:59.601596+0000 mgr.smithi067.rdualw (mgr.24569) 3450 : cluster [DBG] pgmap v2975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:01.602514+0000 mgr.smithi067.rdualw (mgr.24569) 3451 : cluster [DBG] pgmap v2976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:01.602514+0000 mgr.smithi067.rdualw (mgr.24569) 3451 : cluster [DBG] pgmap v2976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:03.603138+0000 mgr.smithi067.rdualw (mgr.24569) 3452 : cluster [DBG] pgmap v2977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:03.603138+0000 mgr.smithi067.rdualw (mgr.24569) 3452 : cluster [DBG] pgmap v2977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:05.604193+0000 mgr.smithi067.rdualw (mgr.24569) 3453 : cluster [DBG] pgmap v2978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:08:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:05.604193+0000 mgr.smithi067.rdualw (mgr.24569) 3453 : cluster [DBG] pgmap v2978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:08:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:07.604712+0000 mgr.smithi067.rdualw (mgr.24569) 3454 : cluster [DBG] pgmap v2979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:07.604712+0000 mgr.smithi067.rdualw (mgr.24569) 3454 : cluster [DBG] pgmap v2979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:09.646 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:08:09.939 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:08:09.940 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (105m) 5m ago 106m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:08:09.940 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (98m) 5m ago 106m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:08:09.940 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (98m) 5m ago 106m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:08:09.940 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (105m) 5m ago 106m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:08:09.941 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (98m) 5m ago 102m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:08:09.941 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (98m) 5m ago 102m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:08:09.941 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (99m) 5m ago 107m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:08:09.941 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (99m) 5m ago 106m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:08:09.941 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (99m) 5m ago 108m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:08:09.942 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (99m) 5m ago 106m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:08:09.942 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (100m) 5m ago 100m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:08:09.942 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (100m) 5m ago 100m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:08:09.942 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (106m) 5m ago 106m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:08:09.943 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (105m) 5m ago 105m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:08:09.943 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (89m) 5m ago 105m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:08:09.943 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (105m) 5m ago 105m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:08:09.943 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (105m) 5m ago 105m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:08:09.944 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (104m) 5m ago 104m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:08:09.944 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (104m) 5m ago 104m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:08:09.944 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (104m) 5m ago 104m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:08:09.944 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (104m) 5m ago 104m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:08:09.944 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (103m) 5m ago 103m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:08:09.945 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (105m) 5m ago 106m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:08:10.283 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:08:10.284 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:08:10.284 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:08:10.284 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:08:10.285 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:08:10.285 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:08:10.285 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:08:10.285 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:08:10.285 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:08:10.286 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:08:10.286 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:08:10.286 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:08:10.286 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:08:10.287 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:08:10.287 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:08:10.287 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:08:10.288 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:08:10.288 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:08:10.288 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:08:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:09.605258+0000 mgr.smithi067.rdualw (mgr.24569) 3455 : cluster [DBG] pgmap v2980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:08:09.632684+0000 mgr.smithi067.rdualw (mgr.24569) 3456 : audit [DBG] from='client.36442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:08:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:08:10.282330+0000 mon.smithi061 (mon.0) 871 : audit [DBG] from='client.? 172.21.15.61:0/596709601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:08:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:09.605258+0000 mgr.smithi067.rdualw (mgr.24569) 3455 : cluster [DBG] pgmap v2980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:08:09.632684+0000 mgr.smithi067.rdualw (mgr.24569) 3456 : audit [DBG] from='client.36442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:08:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:08:10.282330+0000 mon.smithi061 (mon.0) 871 : audit [DBG] from='client.? 172.21.15.61:0/596709601' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:08:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:08:09.922093+0000 mgr.smithi067.rdualw (mgr.24569) 3457 : audit [DBG] from='client.36446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:08:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:08:09.922093+0000 mgr.smithi067.rdualw (mgr.24569) 3457 : audit [DBG] from='client.36446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:08:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:11.606183+0000 mgr.smithi067.rdualw (mgr.24569) 3458 : cluster [DBG] pgmap v2981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:11.606183+0000 mgr.smithi067.rdualw (mgr.24569) 3458 : cluster [DBG] pgmap v2981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:13.606911+0000 mgr.smithi067.rdualw (mgr.24569) 3459 : cluster [DBG] pgmap v2982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:13.606911+0000 mgr.smithi067.rdualw (mgr.24569) 3459 : cluster [DBG] pgmap v2982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:15.607733+0000 mgr.smithi067.rdualw (mgr.24569) 3460 : cluster [DBG] pgmap v2983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:08:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:15.607733+0000 mgr.smithi067.rdualw (mgr.24569) 3460 : cluster [DBG] pgmap v2983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:08:17.672 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:08:17.261977+0000 mon.smithi067 (mon.1) 553 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:08:17.672 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:08:17.263424+0000 mon.smithi067 (mon.1) 554 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:08:17.673 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:08:17.264347+0000 mon.smithi067 (mon.1) 555 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:08:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:08:17.261977+0000 mon.smithi067 (mon.1) 553 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:08:17.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:08:17.263424+0000 mon.smithi067 (mon.1) 554 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:08:17.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:08:17.264347+0000 mon.smithi067 (mon.1) 555 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:08:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:08:17.265187+0000 mgr.smithi067.rdualw (mgr.24569) 3461 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:08:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:17.608306+0000 mgr.smithi067.rdualw (mgr.24569) 3462 : cluster [DBG] pgmap v2984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:08:17.682276+0000 mon.smithi061 (mon.0) 872 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:08:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:08:17.688934+0000 mon.smithi061 (mon.0) 873 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:08:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:08:17.265187+0000 mgr.smithi067.rdualw (mgr.24569) 3461 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:08:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:17.608306+0000 mgr.smithi067.rdualw (mgr.24569) 3462 : cluster [DBG] pgmap v2984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:08:17.682276+0000 mon.smithi061 (mon.0) 872 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:08:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:08:17.688934+0000 mon.smithi061 (mon.0) 873 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:08:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:19.608897+0000 mgr.smithi067.rdualw (mgr.24569) 3463 : cluster [DBG] pgmap v2985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:19.608897+0000 mgr.smithi067.rdualw (mgr.24569) 3463 : cluster [DBG] pgmap v2985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:21.609889+0000 mgr.smithi067.rdualw (mgr.24569) 3464 : cluster [DBG] pgmap v2986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:21.609889+0000 mgr.smithi067.rdualw (mgr.24569) 3464 : cluster [DBG] pgmap v2986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:23.610650+0000 mgr.smithi067.rdualw (mgr.24569) 3465 : cluster [DBG] pgmap v2987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:23.610650+0000 mgr.smithi067.rdualw (mgr.24569) 3465 : cluster [DBG] pgmap v2987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:25.611531+0000 mgr.smithi067.rdualw (mgr.24569) 3466 : cluster [DBG] pgmap v2988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:08:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:25.611531+0000 mgr.smithi067.rdualw (mgr.24569) 3466 : cluster [DBG] pgmap v2988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:08:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:27.612069+0000 mgr.smithi067.rdualw (mgr.24569) 3467 : cluster [DBG] pgmap v2989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:27.612069+0000 mgr.smithi067.rdualw (mgr.24569) 3467 : cluster [DBG] pgmap v2989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:29.612791+0000 mgr.smithi067.rdualw (mgr.24569) 3468 : cluster [DBG] pgmap v2990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:29.612791+0000 mgr.smithi067.rdualw (mgr.24569) 3468 : cluster [DBG] pgmap v2990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:31.613643+0000 mgr.smithi067.rdualw (mgr.24569) 3469 : cluster [DBG] pgmap v2991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:31.613643+0000 mgr.smithi067.rdualw (mgr.24569) 3469 : cluster [DBG] pgmap v2991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:33.614249+0000 mgr.smithi067.rdualw (mgr.24569) 3470 : cluster [DBG] pgmap v2992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:33.614249+0000 mgr.smithi067.rdualw (mgr.24569) 3470 : cluster [DBG] pgmap v2992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:08:34.960824+0000 mon.smithi067 (mon.1) 556 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:08:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:08:34.961160+0000 mon.smithi067 (mon.1) 557 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:08:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:08:34.961257+0000 mon.smithi061 (mon.0) 874 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:08:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:08:34.961562+0000 mon.smithi061 (mon.0) 875 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:08:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:08:34.960824+0000 mon.smithi067 (mon.1) 556 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:08:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:08:34.961160+0000 mon.smithi067 (mon.1) 557 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:08:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:08:34.961257+0000 mon.smithi061 (mon.0) 874 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:08:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:08:34.961562+0000 mon.smithi061 (mon.0) 875 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:08:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:35.615190+0000 mgr.smithi067.rdualw (mgr.24569) 3471 : cluster [DBG] pgmap v2993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:08:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:35.615190+0000 mgr.smithi067.rdualw (mgr.24569) 3471 : cluster [DBG] pgmap v2993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:08:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:37.615750+0000 mgr.smithi067.rdualw (mgr.24569) 3472 : cluster [DBG] pgmap v2994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:37.615750+0000 mgr.smithi067.rdualw (mgr.24569) 3472 : cluster [DBG] pgmap v2994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:40.594 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:08:40.886 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:08:40.886 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (106m) 6m ago 107m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:08:40.887 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (98m) 6m ago 107m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:08:40.887 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (98m) 6m ago 106m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:08:40.887 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (106m) 6m ago 107m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:08:40.887 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (99m) 6m ago 102m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:08:40.888 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (99m) 6m ago 102m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:08:40.888 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (100m) 6m ago 108m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:08:40.888 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (100m) 6m ago 106m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:08:40.888 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (99m) 6m ago 108m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:08:40.888 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (99m) 6m ago 106m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:08:40.889 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (100m) 6m ago 100m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:08:40.889 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (100m) 6m ago 100m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:08:40.889 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (107m) 6m ago 107m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:08:40.889 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (106m) 6m ago 106m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:08:40.890 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (89m) 6m ago 106m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:08:40.890 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (105m) 6m ago 105m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:08:40.890 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (105m) 6m ago 105m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:08:40.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (105m) 6m ago 105m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:08:40.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (105m) 6m ago 105m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:08:40.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (104m) 6m ago 104m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:08:40.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (104m) 6m ago 104m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:08:40.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (104m) 6m ago 104m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:08:40.892 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (106m) 6m ago 106m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:08:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:39.616459+0000 mgr.smithi067.rdualw (mgr.24569) 3473 : cluster [DBG] pgmap v2995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:39.616459+0000 mgr.smithi067.rdualw (mgr.24569) 3473 : cluster [DBG] pgmap v2995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:41.227 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:08:41.228 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:08:41.228 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:08:41.228 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:08:41.228 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:08:41.229 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:08:41.229 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:08:41.229 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:08:41.229 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:08:41.230 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:08:41.230 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:08:41.230 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:08:41.230 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:08:41.231 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:08:41.231 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:08:41.231 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:08:41.231 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:08:41.231 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:08:41.232 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:08:42.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:08:40.581449+0000 mgr.smithi067.rdualw (mgr.24569) 3474 : audit [DBG] from='client.36454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:08:42.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:08:40.868447+0000 mgr.smithi067.rdualw (mgr.24569) 3475 : audit [DBG] from='client.36458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:08:42.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:08:41.226364+0000 mon.smithi061 (mon.0) 876 : audit [DBG] from='client.? 172.21.15.61:0/1005856442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:08:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:08:40.581449+0000 mgr.smithi067.rdualw (mgr.24569) 3474 : audit [DBG] from='client.36454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:08:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:08:40.868447+0000 mgr.smithi067.rdualw (mgr.24569) 3475 : audit [DBG] from='client.36458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:08:42.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:08:41.226364+0000 mon.smithi061 (mon.0) 876 : audit [DBG] from='client.? 172.21.15.61:0/1005856442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:08:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:41.617196+0000 mgr.smithi067.rdualw (mgr.24569) 3476 : cluster [DBG] pgmap v2996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:41.617196+0000 mgr.smithi067.rdualw (mgr.24569) 3476 : cluster [DBG] pgmap v2996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:43.617742+0000 mgr.smithi067.rdualw (mgr.24569) 3477 : cluster [DBG] pgmap v2997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:43.617742+0000 mgr.smithi067.rdualw (mgr.24569) 3477 : cluster [DBG] pgmap v2997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:45.618749+0000 mgr.smithi067.rdualw (mgr.24569) 3478 : cluster [DBG] pgmap v2998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:08:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:45.618749+0000 mgr.smithi067.rdualw (mgr.24569) 3478 : cluster [DBG] pgmap v2998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:08:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:47.619243+0000 mgr.smithi067.rdualw (mgr.24569) 3479 : cluster [DBG] pgmap v2999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:47.619243+0000 mgr.smithi067.rdualw (mgr.24569) 3479 : cluster [DBG] pgmap v2999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:49.619819+0000 mgr.smithi067.rdualw (mgr.24569) 3480 : cluster [DBG] pgmap v3000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:49.619819+0000 mgr.smithi067.rdualw (mgr.24569) 3480 : cluster [DBG] pgmap v3000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:51.620865+0000 mgr.smithi067.rdualw (mgr.24569) 3481 : cluster [DBG] pgmap v3001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:51.620865+0000 mgr.smithi067.rdualw (mgr.24569) 3481 : cluster [DBG] pgmap v3001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:53.621429+0000 mgr.smithi067.rdualw (mgr.24569) 3482 : cluster [DBG] pgmap v3002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:53.621429+0000 mgr.smithi067.rdualw (mgr.24569) 3482 : cluster [DBG] pgmap v3002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:55.622267+0000 mgr.smithi067.rdualw (mgr.24569) 3483 : cluster [DBG] pgmap v3003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:08:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:55.622267+0000 mgr.smithi067.rdualw (mgr.24569) 3483 : cluster [DBG] pgmap v3003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:08:59.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:08:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:57.622786+0000 mgr.smithi067.rdualw (mgr.24569) 3484 : cluster [DBG] pgmap v3004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:08:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:08:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:57.622786+0000 mgr.smithi067.rdualw (mgr.24569) 3484 : cluster [DBG] pgmap v3004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:08:59.623554+0000 mgr.smithi067.rdualw (mgr.24569) 3485 : cluster [DBG] pgmap v3005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:08:59.623554+0000 mgr.smithi067.rdualw (mgr.24569) 3485 : cluster [DBG] pgmap v3005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:01.624386+0000 mgr.smithi067.rdualw (mgr.24569) 3486 : cluster [DBG] pgmap v3006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:01.624386+0000 mgr.smithi067.rdualw (mgr.24569) 3486 : cluster [DBG] pgmap v3006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:03.624970+0000 mgr.smithi067.rdualw (mgr.24569) 3487 : cluster [DBG] pgmap v3007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:03.624970+0000 mgr.smithi067.rdualw (mgr.24569) 3487 : cluster [DBG] pgmap v3007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:05.625967+0000 mgr.smithi067.rdualw (mgr.24569) 3488 : cluster [DBG] pgmap v3008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:09:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:05.625967+0000 mgr.smithi067.rdualw (mgr.24569) 3488 : cluster [DBG] pgmap v3008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:09:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:07.626527+0000 mgr.smithi067.rdualw (mgr.24569) 3489 : cluster [DBG] pgmap v3009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:07.626527+0000 mgr.smithi067.rdualw (mgr.24569) 3489 : cluster [DBG] pgmap v3009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:09.627295+0000 mgr.smithi067.rdualw (mgr.24569) 3490 : cluster [DBG] pgmap v3010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:09.627295+0000 mgr.smithi067.rdualw (mgr.24569) 3490 : cluster [DBG] pgmap v3010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:11.537 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:09:11.832 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:09:11.832 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (106m) 6m ago 107m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:09:11.832 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (99m) 6m ago 107m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:09:11.832 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (99m) 6m ago 107m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:09:11.833 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (106m) 6m ago 107m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:09:11.833 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (99m) 6m ago 103m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:09:11.833 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (99m) 6m ago 103m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:09:11.833 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (100m) 6m ago 108m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:09:11.834 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (100m) 6m ago 107m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:09:11.834 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (100m) 6m ago 109m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:09:11.834 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (100m) 6m ago 107m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:09:11.834 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (101m) 6m ago 101m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:09:11.835 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (101m) 6m ago 101m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:09:11.835 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (107m) 6m ago 107m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:09:11.835 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (107m) 6m ago 106m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:09:11.835 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (90m) 6m ago 106m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:09:11.836 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (106m) 6m ago 106m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:09:11.836 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (106m) 6m ago 106m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:09:11.836 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (105m) 6m ago 105m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:09:11.836 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (105m) 6m ago 105m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:09:11.837 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (105m) 6m ago 105m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:09:11.837 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (105m) 6m ago 105m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:09:11.837 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (104m) 6m ago 104m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:09:11.837 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (106m) 6m ago 107m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:09:12.171 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:09:12.172 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:09:12.173 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:09:12.173 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:09:12.173 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:09:12.174 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:09:12.174 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:09:12.175 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:09:12.175 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:09:12.175 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:09:12.176 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:09:12.176 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:09:12.176 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:09:12.176 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:09:12.176 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:09:12.177 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:09:12.177 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:09:12.177 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:09:12.178 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:09:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:09:11.522594+0000 mgr.smithi067.rdualw (mgr.24569) 3491 : audit [DBG] from='client.36466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:09:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:11.628077+0000 mgr.smithi067.rdualw (mgr.24569) 3492 : cluster [DBG] pgmap v3011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:09:11.813265+0000 mgr.smithi067.rdualw (mgr.24569) 3493 : audit [DBG] from='client.36470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:09:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:09:12.170149+0000 mon.smithi061 (mon.0) 877 : audit [DBG] from='client.? 172.21.15.61:0/3219637187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:09:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:09:11.522594+0000 mgr.smithi067.rdualw (mgr.24569) 3491 : audit [DBG] from='client.36466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:09:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:11.628077+0000 mgr.smithi067.rdualw (mgr.24569) 3492 : cluster [DBG] pgmap v3011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:09:11.813265+0000 mgr.smithi067.rdualw (mgr.24569) 3493 : audit [DBG] from='client.36470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:09:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:09:12.170149+0000 mon.smithi061 (mon.0) 877 : audit [DBG] from='client.? 172.21.15.61:0/3219637187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:09:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:13.628597+0000 mgr.smithi067.rdualw (mgr.24569) 3494 : cluster [DBG] pgmap v3012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:13.628597+0000 mgr.smithi067.rdualw (mgr.24569) 3494 : cluster [DBG] pgmap v3012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:15.629715+0000 mgr.smithi067.rdualw (mgr.24569) 3495 : cluster [DBG] pgmap v3013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:09:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:15.629715+0000 mgr.smithi067.rdualw (mgr.24569) 3495 : cluster [DBG] pgmap v3013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:09:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:17.630192+0000 mgr.smithi067.rdualw (mgr.24569) 3496 : cluster [DBG] pgmap v3014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:09:17.693067+0000 mon.smithi067 (mon.1) 558 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:09:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:09:17.694484+0000 mon.smithi067 (mon.1) 559 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:09:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:09:17.695381+0000 mon.smithi067 (mon.1) 560 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:09:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:09:17.696209+0000 mgr.smithi067.rdualw (mgr.24569) 3497 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:09:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:09:18.114003+0000 mon.smithi061 (mon.0) 878 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:09:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:09:18.119298+0000 mon.smithi061 (mon.0) 879 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:09:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:17.630192+0000 mgr.smithi067.rdualw (mgr.24569) 3496 : cluster [DBG] pgmap v3014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:09:17.693067+0000 mon.smithi067 (mon.1) 558 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:09:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:09:17.694484+0000 mon.smithi067 (mon.1) 559 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:09:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:09:17.695381+0000 mon.smithi067 (mon.1) 560 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:09:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:09:17.696209+0000 mgr.smithi067.rdualw (mgr.24569) 3497 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:09:19.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:09:18.114003+0000 mon.smithi061 (mon.0) 878 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:09:19.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:09:18.119298+0000 mon.smithi061 (mon.0) 879 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:09:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:19.630901+0000 mgr.smithi067.rdualw (mgr.24569) 3498 : cluster [DBG] pgmap v3015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:19.630901+0000 mgr.smithi067.rdualw (mgr.24569) 3498 : cluster [DBG] pgmap v3015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:21.631817+0000 mgr.smithi067.rdualw (mgr.24569) 3499 : cluster [DBG] pgmap v3016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:23.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:21.631817+0000 mgr.smithi067.rdualw (mgr.24569) 3499 : cluster [DBG] pgmap v3016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:23.632355+0000 mgr.smithi067.rdualw (mgr.24569) 3500 : cluster [DBG] pgmap v3017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:23.632355+0000 mgr.smithi067.rdualw (mgr.24569) 3500 : cluster [DBG] pgmap v3017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:25.633103+0000 mgr.smithi067.rdualw (mgr.24569) 3501 : cluster [DBG] pgmap v3018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:09:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:25.633103+0000 mgr.smithi067.rdualw (mgr.24569) 3501 : cluster [DBG] pgmap v3018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:09:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:27.633645+0000 mgr.smithi067.rdualw (mgr.24569) 3502 : cluster [DBG] pgmap v3019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:27.633645+0000 mgr.smithi067.rdualw (mgr.24569) 3502 : cluster [DBG] pgmap v3019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:29.634419+0000 mgr.smithi067.rdualw (mgr.24569) 3503 : cluster [DBG] pgmap v3020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:29.634419+0000 mgr.smithi067.rdualw (mgr.24569) 3503 : cluster [DBG] pgmap v3020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:31.635230+0000 mgr.smithi067.rdualw (mgr.24569) 3504 : cluster [DBG] pgmap v3021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:31.635230+0000 mgr.smithi067.rdualw (mgr.24569) 3504 : cluster [DBG] pgmap v3021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:33.635832+0000 mgr.smithi067.rdualw (mgr.24569) 3505 : cluster [DBG] pgmap v3022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:33.635832+0000 mgr.smithi067.rdualw (mgr.24569) 3505 : cluster [DBG] pgmap v3022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:09:34.966104+0000 mon.smithi067 (mon.1) 561 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:09:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:09:34.966377+0000 mon.smithi067 (mon.1) 562 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:09:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:09:34.966535+0000 mon.smithi061 (mon.0) 880 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:09:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:09:34.966810+0000 mon.smithi061 (mon.0) 881 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:09:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:09:34.966104+0000 mon.smithi067 (mon.1) 561 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:09:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:09:34.966377+0000 mon.smithi067 (mon.1) 562 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:09:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:09:34.966535+0000 mon.smithi061 (mon.0) 880 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:09:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:09:34.966810+0000 mon.smithi061 (mon.0) 881 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:09:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:35.636806+0000 mgr.smithi067.rdualw (mgr.24569) 3506 : cluster [DBG] pgmap v3023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:09:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:35.636806+0000 mgr.smithi067.rdualw (mgr.24569) 3506 : cluster [DBG] pgmap v3023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:09:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:37.637390+0000 mgr.smithi067.rdualw (mgr.24569) 3507 : cluster [DBG] pgmap v3024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:37.637390+0000 mgr.smithi067.rdualw (mgr.24569) 3507 : cluster [DBG] pgmap v3024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:39.637940+0000 mgr.smithi067.rdualw (mgr.24569) 3508 : cluster [DBG] pgmap v3025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:39.637940+0000 mgr.smithi067.rdualw (mgr.24569) 3508 : cluster [DBG] pgmap v3025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:42.477 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:09:42.772 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:09:42.773 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (107m) 7m ago 108m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:09:42.773 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (99m) 7m ago 108m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:09:42.774 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (99m) 7m ago 107m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:09:42.774 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (107m) 7m ago 108m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:09:42.774 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (100m) 7m ago 104m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:09:42.774 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (100m) 7m ago 103m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:09:42.775 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (101m) 7m ago 109m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:09:42.775 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (101m) 7m ago 107m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:09:42.775 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (100m) 7m ago 109m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:09:42.775 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (100m) 7m ago 107m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:09:42.775 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (101m) 7m ago 101m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:09:42.776 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (101m) 7m ago 101m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:09:42.776 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (108m) 7m ago 108m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:09:42.776 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (107m) 7m ago 107m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:09:42.776 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (90m) 7m ago 107m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:09:42.777 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (106m) 7m ago 106m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:09:42.777 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (106m) 7m ago 106m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:09:42.777 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (106m) 7m ago 106m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:09:42.777 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (106m) 7m ago 106m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:09:42.778 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (105m) 7m ago 105m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:09:42.778 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (105m) 7m ago 105m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:09:42.778 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (105m) 7m ago 105m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:09:42.778 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (107m) 7m ago 107m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:09:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:41.638784+0000 mgr.smithi067.rdualw (mgr.24569) 3509 : cluster [DBG] pgmap v3026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:41.638784+0000 mgr.smithi067.rdualw (mgr.24569) 3509 : cluster [DBG] pgmap v3026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:43.113 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:09:43.114 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:09:43.114 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:09:43.114 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:09:43.114 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:09:43.115 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:09:43.115 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:09:43.115 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:09:43.115 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:09:43.115 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:09:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:09:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:09:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:09:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:09:43.116 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:09:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:09:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:09:43.117 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:09:43.117 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:09:44.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:09:42.463310+0000 mgr.smithi067.rdualw (mgr.24569) 3510 : audit [DBG] from='client.36478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:09:44.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:09:42.754462+0000 mgr.smithi067.rdualw (mgr.24569) 3511 : audit [DBG] from='client.36482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:09:44.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:09:43.112031+0000 mon.smithi061 (mon.0) 882 : audit [DBG] from='client.? 172.21.15.61:0/3035097081' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:09:44.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:09:42.463310+0000 mgr.smithi067.rdualw (mgr.24569) 3510 : audit [DBG] from='client.36478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:09:44.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:09:42.754462+0000 mgr.smithi067.rdualw (mgr.24569) 3511 : audit [DBG] from='client.36482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:09:44.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:09:43.112031+0000 mon.smithi061 (mon.0) 882 : audit [DBG] from='client.? 172.21.15.61:0/3035097081' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:09:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:43.639264+0000 mgr.smithi067.rdualw (mgr.24569) 3512 : cluster [DBG] pgmap v3027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:43.639264+0000 mgr.smithi067.rdualw (mgr.24569) 3512 : cluster [DBG] pgmap v3027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:45.640180+0000 mgr.smithi067.rdualw (mgr.24569) 3513 : cluster [DBG] pgmap v3028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:09:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:45.640180+0000 mgr.smithi067.rdualw (mgr.24569) 3513 : cluster [DBG] pgmap v3028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:09:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:47.640894+0000 mgr.smithi067.rdualw (mgr.24569) 3514 : cluster [DBG] pgmap v3029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:47.640894+0000 mgr.smithi067.rdualw (mgr.24569) 3514 : cluster [DBG] pgmap v3029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:49.641493+0000 mgr.smithi067.rdualw (mgr.24569) 3515 : cluster [DBG] pgmap v3030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:49.641493+0000 mgr.smithi067.rdualw (mgr.24569) 3515 : cluster [DBG] pgmap v3030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:51.642384+0000 mgr.smithi067.rdualw (mgr.24569) 3516 : cluster [DBG] pgmap v3031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:51.642384+0000 mgr.smithi067.rdualw (mgr.24569) 3516 : cluster [DBG] pgmap v3031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:53.642973+0000 mgr.smithi067.rdualw (mgr.24569) 3517 : cluster [DBG] pgmap v3032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:53.642973+0000 mgr.smithi067.rdualw (mgr.24569) 3517 : cluster [DBG] pgmap v3032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:55.643850+0000 mgr.smithi067.rdualw (mgr.24569) 3518 : cluster [DBG] pgmap v3033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:09:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:55.643850+0000 mgr.smithi067.rdualw (mgr.24569) 3518 : cluster [DBG] pgmap v3033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:09:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:09:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:57.644530+0000 mgr.smithi067.rdualw (mgr.24569) 3519 : cluster [DBG] pgmap v3034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:09:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:09:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:57.644530+0000 mgr.smithi067.rdualw (mgr.24569) 3519 : cluster [DBG] pgmap v3034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:09:59.645144+0000 mgr.smithi067.rdualw (mgr.24569) 3520 : cluster [DBG] pgmap v3035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:00.000103+0000 mon.smithi061 (mon.0) 883 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T17:10:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:09:59.645144+0000 mgr.smithi067.rdualw (mgr.24569) 3520 : cluster [DBG] pgmap v3035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:00.000103+0000 mon.smithi061 (mon.0) 883 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T17:10:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:01.645998+0000 mgr.smithi067.rdualw (mgr.24569) 3521 : cluster [DBG] pgmap v3036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:01.645998+0000 mgr.smithi067.rdualw (mgr.24569) 3521 : cluster [DBG] pgmap v3036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:03.646513+0000 mgr.smithi067.rdualw (mgr.24569) 3522 : cluster [DBG] pgmap v3037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:03.646513+0000 mgr.smithi067.rdualw (mgr.24569) 3522 : cluster [DBG] pgmap v3037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:05.647593+0000 mgr.smithi067.rdualw (mgr.24569) 3523 : cluster [DBG] pgmap v3038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:10:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:05.647593+0000 mgr.smithi067.rdualw (mgr.24569) 3523 : cluster [DBG] pgmap v3038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:10:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:07.648076+0000 mgr.smithi067.rdualw (mgr.24569) 3524 : cluster [DBG] pgmap v3039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:07.648076+0000 mgr.smithi067.rdualw (mgr.24569) 3524 : cluster [DBG] pgmap v3039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:09.648678+0000 mgr.smithi067.rdualw (mgr.24569) 3525 : cluster [DBG] pgmap v3040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:09.648678+0000 mgr.smithi067.rdualw (mgr.24569) 3525 : cluster [DBG] pgmap v3040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:11.649511+0000 mgr.smithi067.rdualw (mgr.24569) 3526 : cluster [DBG] pgmap v3041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:11.649511+0000 mgr.smithi067.rdualw (mgr.24569) 3526 : cluster [DBG] pgmap v3041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:13.422 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:10:13.712 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:10:13.712 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (107m) 7m ago 108m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:10:13.713 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (100m) 7m ago 108m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:10:13.713 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (100m) 8m ago 108m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:10:13.713 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (107m) 7m ago 108m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:10:13.714 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (100m) 7m ago 104m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:10:13.714 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (100m) 8m ago 104m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:10:13.714 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (101m) 7m ago 110m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:10:13.715 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (101m) 8m ago 108m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:10:13.715 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (101m) 7m ago 110m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:10:13.715 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (101m) 8m ago 108m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:10:13.716 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (102m) 7m ago 102m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:10:13.716 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (102m) 8m ago 102m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:10:13.716 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (108m) 7m ago 108m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:10:13.718 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (108m) 8m ago 108m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:10:13.719 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (91m) 7m ago 107m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:10:13.719 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (107m) 7m ago 107m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:10:13.719 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (107m) 7m ago 107m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:10:13.720 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (106m) 7m ago 106m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:10:13.720 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (106m) 8m ago 106m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:10:13.721 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (106m) 8m ago 106m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:10:13.721 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (106m) 8m ago 106m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:10:13.722 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (105m) 8m ago 105m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:10:13.723 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (107m) 7m ago 108m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:10:14.050 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:10:14.050 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:10:14.051 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:10:14.052 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:10:14.052 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:10:14.053 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:10:14.053 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:10:14.054 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:10:14.054 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:10:14.054 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:10:14.055 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:10:14.055 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:10:14.056 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:10:14.056 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:10:14.056 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:10:14.057 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:10:14.057 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:10:14.058 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:10:14.058 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:10:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:10:13.408370+0000 mgr.smithi067.rdualw (mgr.24569) 3527 : audit [DBG] from='client.36490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:10:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:13.649990+0000 mgr.smithi067.rdualw (mgr.24569) 3528 : cluster [DBG] pgmap v3042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:10:13.694677+0000 mgr.smithi067.rdualw (mgr.24569) 3529 : audit [DBG] from='client.36494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:10:15.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:10:14.048555+0000 mon.smithi061 (mon.0) 884 : audit [DBG] from='client.? 172.21.15.61:0/3422361474' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:10:15.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:10:13.408370+0000 mgr.smithi067.rdualw (mgr.24569) 3527 : audit [DBG] from='client.36490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:10:15.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:13.649990+0000 mgr.smithi067.rdualw (mgr.24569) 3528 : cluster [DBG] pgmap v3042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:15.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:10:13.694677+0000 mgr.smithi067.rdualw (mgr.24569) 3529 : audit [DBG] from='client.36494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:10:15.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:10:14.048555+0000 mon.smithi061 (mon.0) 884 : audit [DBG] from='client.? 172.21.15.61:0/3422361474' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:10:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:15.650856+0000 mgr.smithi067.rdualw (mgr.24569) 3530 : cluster [DBG] pgmap v3043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:10:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:15.650856+0000 mgr.smithi067.rdualw (mgr.24569) 3530 : cluster [DBG] pgmap v3043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:10:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:17.651602+0000 mgr.smithi067.rdualw (mgr.24569) 3531 : cluster [DBG] pgmap v3044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:10:18.122749+0000 mon.smithi067 (mon.1) 563 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:10:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:10:18.124144+0000 mon.smithi067 (mon.1) 564 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:10:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:10:18.125071+0000 mon.smithi067 (mon.1) 565 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:10:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:10:18.542625+0000 mon.smithi061 (mon.0) 885 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:10:19.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:10:18.548190+0000 mon.smithi061 (mon.0) 886 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:10:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:17.651602+0000 mgr.smithi067.rdualw (mgr.24569) 3531 : cluster [DBG] pgmap v3044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:10:18.122749+0000 mon.smithi067 (mon.1) 563 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:10:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:10:18.124144+0000 mon.smithi067 (mon.1) 564 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:10:19.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:10:18.125071+0000 mon.smithi067 (mon.1) 565 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:10:19.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:10:18.542625+0000 mon.smithi061 (mon.0) 885 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:10:19.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:10:18.548190+0000 mon.smithi061 (mon.0) 886 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:10:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:10:18.125906+0000 mgr.smithi067.rdualw (mgr.24569) 3532 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:10:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:10:18.125906+0000 mgr.smithi067.rdualw (mgr.24569) 3532 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:10:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:19.652149+0000 mgr.smithi067.rdualw (mgr.24569) 3533 : cluster [DBG] pgmap v3045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:19.652149+0000 mgr.smithi067.rdualw (mgr.24569) 3533 : cluster [DBG] pgmap v3045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:21.653038+0000 mgr.smithi067.rdualw (mgr.24569) 3534 : cluster [DBG] pgmap v3046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:21.653038+0000 mgr.smithi067.rdualw (mgr.24569) 3534 : cluster [DBG] pgmap v3046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:23.653487+0000 mgr.smithi067.rdualw (mgr.24569) 3535 : cluster [DBG] pgmap v3047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:23.653487+0000 mgr.smithi067.rdualw (mgr.24569) 3535 : cluster [DBG] pgmap v3047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:25.654654+0000 mgr.smithi067.rdualw (mgr.24569) 3536 : cluster [DBG] pgmap v3048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:10:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:25.654654+0000 mgr.smithi067.rdualw (mgr.24569) 3536 : cluster [DBG] pgmap v3048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:10:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:27.655332+0000 mgr.smithi067.rdualw (mgr.24569) 3537 : cluster [DBG] pgmap v3049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:27.655332+0000 mgr.smithi067.rdualw (mgr.24569) 3537 : cluster [DBG] pgmap v3049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:29.655987+0000 mgr.smithi067.rdualw (mgr.24569) 3538 : cluster [DBG] pgmap v3050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:29.655987+0000 mgr.smithi067.rdualw (mgr.24569) 3538 : cluster [DBG] pgmap v3050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:31.656841+0000 mgr.smithi067.rdualw (mgr.24569) 3539 : cluster [DBG] pgmap v3051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:31.656841+0000 mgr.smithi067.rdualw (mgr.24569) 3539 : cluster [DBG] pgmap v3051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:33.657407+0000 mgr.smithi067.rdualw (mgr.24569) 3540 : cluster [DBG] pgmap v3052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:33.657407+0000 mgr.smithi067.rdualw (mgr.24569) 3540 : cluster [DBG] pgmap v3052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:10:34.972068+0000 mon.smithi067 (mon.1) 566 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:10:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:10:34.972258+0000 mon.smithi061 (mon.0) 887 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:10:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:10:34.972325+0000 mon.smithi067 (mon.1) 567 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:10:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:10:34.972551+0000 mon.smithi061 (mon.0) 888 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:10:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:10:34.972068+0000 mon.smithi067 (mon.1) 566 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:10:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:10:34.972258+0000 mon.smithi061 (mon.0) 887 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:10:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:10:34.972325+0000 mon.smithi067 (mon.1) 567 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:10:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:10:34.972551+0000 mon.smithi061 (mon.0) 888 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:10:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:35.658316+0000 mgr.smithi067.rdualw (mgr.24569) 3541 : cluster [DBG] pgmap v3053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:10:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:35.658316+0000 mgr.smithi067.rdualw (mgr.24569) 3541 : cluster [DBG] pgmap v3053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:10:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:37.659025+0000 mgr.smithi067.rdualw (mgr.24569) 3542 : cluster [DBG] pgmap v3054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:39.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:37.659025+0000 mgr.smithi067.rdualw (mgr.24569) 3542 : cluster [DBG] pgmap v3054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:39.659716+0000 mgr.smithi067.rdualw (mgr.24569) 3543 : cluster [DBG] pgmap v3055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:39.659716+0000 mgr.smithi067.rdualw (mgr.24569) 3543 : cluster [DBG] pgmap v3055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:41.660486+0000 mgr.smithi067.rdualw (mgr.24569) 3544 : cluster [DBG] pgmap v3056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:41.660486+0000 mgr.smithi067.rdualw (mgr.24569) 3544 : cluster [DBG] pgmap v3056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:44.362 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:10:44.650 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:10:44.650 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (108m) 8m ago 109m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:10:44.651 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (100m) 8m ago 109m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:10:44.651 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (100m) 8m ago 108m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:10:44.652 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (108m) 8m ago 109m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:10:44.652 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (101m) 8m ago 105m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:10:44.652 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (101m) 8m ago 105m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:10:44.652 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (102m) 8m ago 110m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:10:44.653 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (102m) 8m ago 108m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:10:44.653 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (101m) 8m ago 110m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:10:44.653 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (101m) 8m ago 108m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:10:44.653 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (102m) 8m ago 102m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:10:44.653 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (102m) 8m ago 102m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:10:44.654 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (109m) 8m ago 109m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:10:44.654 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (108m) 8m ago 108m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:10:44.654 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (91m) 8m ago 108m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:10:44.654 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (107m) 8m ago 107m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:10:44.656 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (107m) 8m ago 107m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:10:44.656 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (107m) 8m ago 107m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:10:44.656 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (107m) 8m ago 107m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:10:44.656 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (106m) 8m ago 106m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:10:44.657 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (106m) 8m ago 106m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:10:44.657 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (106m) 8m ago 106m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:10:44.657 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (108m) 8m ago 109m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:10:45.033 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:10:45.034 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:10:45.034 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:10:45.034 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:10:45.034 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:10:45.035 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:10:45.035 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:10:45.035 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:10:45.036 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:10:45.036 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:10:45.036 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:10:45.036 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:10:45.037 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:10:45.037 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:10:45.037 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:10:45.037 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:10:45.037 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:10:45.038 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:10:45.038 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:10:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:43.661065+0000 mgr.smithi067.rdualw (mgr.24569) 3545 : cluster [DBG] pgmap v3057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:43.661065+0000 mgr.smithi067.rdualw (mgr.24569) 3545 : cluster [DBG] pgmap v3057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:10:44.346206+0000 mgr.smithi067.rdualw (mgr.24569) 3546 : audit [DBG] from='client.36502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:10:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:10:44.632291+0000 mgr.smithi067.rdualw (mgr.24569) 3547 : audit [DBG] from='client.36506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:10:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:10:45.031974+0000 mon.smithi061 (mon.0) 889 : audit [DBG] from='client.? 172.21.15.61:0/3267324940' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:10:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:10:44.346206+0000 mgr.smithi067.rdualw (mgr.24569) 3546 : audit [DBG] from='client.36502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:10:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:10:44.632291+0000 mgr.smithi067.rdualw (mgr.24569) 3547 : audit [DBG] from='client.36506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:10:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:10:45.031974+0000 mon.smithi061 (mon.0) 889 : audit [DBG] from='client.? 172.21.15.61:0/3267324940' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:10:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:45.661937+0000 mgr.smithi067.rdualw (mgr.24569) 3548 : cluster [DBG] pgmap v3058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:10:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:45.661937+0000 mgr.smithi067.rdualw (mgr.24569) 3548 : cluster [DBG] pgmap v3058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:10:48.970 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:47.662559+0000 mgr.smithi067.rdualw (mgr.24569) 3549 : cluster [DBG] pgmap v3059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:47.662559+0000 mgr.smithi067.rdualw (mgr.24569) 3549 : cluster [DBG] pgmap v3059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:49.663062+0000 mgr.smithi067.rdualw (mgr.24569) 3550 : cluster [DBG] pgmap v3060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:49.663062+0000 mgr.smithi067.rdualw (mgr.24569) 3550 : cluster [DBG] pgmap v3060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:51.663972+0000 mgr.smithi067.rdualw (mgr.24569) 3551 : cluster [DBG] pgmap v3061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:51.663972+0000 mgr.smithi067.rdualw (mgr.24569) 3551 : cluster [DBG] pgmap v3061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:53.664476+0000 mgr.smithi067.rdualw (mgr.24569) 3552 : cluster [DBG] pgmap v3062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:53.664476+0000 mgr.smithi067.rdualw (mgr.24569) 3552 : cluster [DBG] pgmap v3062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:55.665438+0000 mgr.smithi067.rdualw (mgr.24569) 3553 : cluster [DBG] pgmap v3063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:10:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:55.665438+0000 mgr.smithi067.rdualw (mgr.24569) 3553 : cluster [DBG] pgmap v3063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:10:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:10:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:57.665927+0000 mgr.smithi067.rdualw (mgr.24569) 3554 : cluster [DBG] pgmap v3064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:10:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:10:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:57.665927+0000 mgr.smithi067.rdualw (mgr.24569) 3554 : cluster [DBG] pgmap v3064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:10:59.666489+0000 mgr.smithi067.rdualw (mgr.24569) 3555 : cluster [DBG] pgmap v3065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:10:59.666489+0000 mgr.smithi067.rdualw (mgr.24569) 3555 : cluster [DBG] pgmap v3065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:01.667349+0000 mgr.smithi067.rdualw (mgr.24569) 3556 : cluster [DBG] pgmap v3066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:01.667349+0000 mgr.smithi067.rdualw (mgr.24569) 3556 : cluster [DBG] pgmap v3066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:03.667838+0000 mgr.smithi067.rdualw (mgr.24569) 3557 : cluster [DBG] pgmap v3067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:03.667838+0000 mgr.smithi067.rdualw (mgr.24569) 3557 : cluster [DBG] pgmap v3067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:05.668643+0000 mgr.smithi067.rdualw (mgr.24569) 3558 : cluster [DBG] pgmap v3068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:11:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:05.668643+0000 mgr.smithi067.rdualw (mgr.24569) 3558 : cluster [DBG] pgmap v3068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:11:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:07.669240+0000 mgr.smithi067.rdualw (mgr.24569) 3559 : cluster [DBG] pgmap v3069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:07.669240+0000 mgr.smithi067.rdualw (mgr.24569) 3559 : cluster [DBG] pgmap v3069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:09.669907+0000 mgr.smithi067.rdualw (mgr.24569) 3560 : cluster [DBG] pgmap v3070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:09.669907+0000 mgr.smithi067.rdualw (mgr.24569) 3560 : cluster [DBG] pgmap v3070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:13.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:11.670735+0000 mgr.smithi067.rdualw (mgr.24569) 3561 : cluster [DBG] pgmap v3071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:11.670735+0000 mgr.smithi067.rdualw (mgr.24569) 3561 : cluster [DBG] pgmap v3071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:13.671381+0000 mgr.smithi067.rdualw (mgr.24569) 3562 : cluster [DBG] pgmap v3072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:13.671381+0000 mgr.smithi067.rdualw (mgr.24569) 3562 : cluster [DBG] pgmap v3072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:15.402 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:11:15.699 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:11:15.700 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (108m) 9m ago 109m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:11:15.700 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (101m) 9m ago 109m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:11:15.700 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (101m) 9m ago 109m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:11:15.700 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (108m) 9m ago 109m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:11:15.701 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (101m) 9m ago 105m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:11:15.702 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (101m) 9m ago 105m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:11:15.703 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (102m) 9m ago 111m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:11:15.703 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (102m) 9m ago 109m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:11:15.703 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (102m) 9m ago 111m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:11:15.703 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (102m) 9m ago 109m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:11:15.704 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (103m) 9m ago 103m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:11:15.704 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (103m) 9m ago 103m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:11:15.704 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (109m) 9m ago 109m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:11:15.704 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (109m) 9m ago 109m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:11:15.705 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (92m) 9m ago 108m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:11:15.705 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (108m) 9m ago 108m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:11:15.705 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (108m) 9m ago 108m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:11:15.705 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (107m) 9m ago 107m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:11:15.705 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (107m) 9m ago 107m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:11:15.706 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (107m) 9m ago 107m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:11:15.706 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (107m) 9m ago 107m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:11:15.706 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (106m) 9m ago 106m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:11:15.706 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (108m) 9m ago 109m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:11:16.040 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:11:16.041 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:11:16.041 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:11:16.041 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:11:16.042 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:11:16.042 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:11:16.043 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:11:16.043 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:11:16.043 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:11:16.043 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:11:16.043 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:11:16.044 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:11:16.044 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:11:16.044 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:11:16.044 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:11:16.045 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:11:16.045 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:11:16.045 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:11:16.045 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:11:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:11:15.387742+0000 mgr.smithi067.rdualw (mgr.24569) 3563 : audit [DBG] from='client.36514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:11:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:15.672206+0000 mgr.smithi067.rdualw (mgr.24569) 3564 : cluster [DBG] pgmap v3073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:11:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:11:15.681935+0000 mgr.smithi067.rdualw (mgr.24569) 3565 : audit [DBG] from='client.36518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:11:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:11:16.039148+0000 mon.smithi061 (mon.0) 890 : audit [DBG] from='client.? 172.21.15.61:0/3667611854' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:11:16.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:11:15.387742+0000 mgr.smithi067.rdualw (mgr.24569) 3563 : audit [DBG] from='client.36514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:11:16.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:15.672206+0000 mgr.smithi067.rdualw (mgr.24569) 3564 : cluster [DBG] pgmap v3073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:11:16.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:11:15.681935+0000 mgr.smithi067.rdualw (mgr.24569) 3565 : audit [DBG] from='client.36518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:11:16.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:11:16.039148+0000 mon.smithi061 (mon.0) 890 : audit [DBG] from='client.? 172.21.15.61:0/3667611854' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:11:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:17.672726+0000 mgr.smithi067.rdualw (mgr.24569) 3566 : cluster [DBG] pgmap v3074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:11:18.551999+0000 mon.smithi067 (mon.1) 568 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:11:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:11:18.553467+0000 mon.smithi067 (mon.1) 569 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:11:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:11:18.554454+0000 mon.smithi067 (mon.1) 570 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:11:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:17.672726+0000 mgr.smithi067.rdualw (mgr.24569) 3566 : cluster [DBG] pgmap v3074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:11:18.551999+0000 mon.smithi067 (mon.1) 568 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:11:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:11:18.553467+0000 mon.smithi067 (mon.1) 569 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:11:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:11:18.554454+0000 mon.smithi067 (mon.1) 570 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:11:20.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:11:18.555313+0000 mgr.smithi067.rdualw (mgr.24569) 3567 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:11:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:11:18.974411+0000 mon.smithi061 (mon.0) 891 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:11:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:11:18.979658+0000 mon.smithi061 (mon.0) 892 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:11:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:11:18.555313+0000 mgr.smithi067.rdualw (mgr.24569) 3567 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:11:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:11:18.974411+0000 mon.smithi061 (mon.0) 891 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:11:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:11:18.979658+0000 mon.smithi061 (mon.0) 892 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:11:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:19.673420+0000 mgr.smithi067.rdualw (mgr.24569) 3568 : cluster [DBG] pgmap v3075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:19.673420+0000 mgr.smithi067.rdualw (mgr.24569) 3568 : cluster [DBG] pgmap v3075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:21.674253+0000 mgr.smithi067.rdualw (mgr.24569) 3569 : cluster [DBG] pgmap v3076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:21.674253+0000 mgr.smithi067.rdualw (mgr.24569) 3569 : cluster [DBG] pgmap v3076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:23.674750+0000 mgr.smithi067.rdualw (mgr.24569) 3570 : cluster [DBG] pgmap v3077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:23.674750+0000 mgr.smithi067.rdualw (mgr.24569) 3570 : cluster [DBG] pgmap v3077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:25.675609+0000 mgr.smithi067.rdualw (mgr.24569) 3571 : cluster [DBG] pgmap v3078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:11:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:25.675609+0000 mgr.smithi067.rdualw (mgr.24569) 3571 : cluster [DBG] pgmap v3078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:11:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:27.676142+0000 mgr.smithi067.rdualw (mgr.24569) 3572 : cluster [DBG] pgmap v3079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:27.676142+0000 mgr.smithi067.rdualw (mgr.24569) 3572 : cluster [DBG] pgmap v3079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:29.676772+0000 mgr.smithi067.rdualw (mgr.24569) 3573 : cluster [DBG] pgmap v3080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:29.676772+0000 mgr.smithi067.rdualw (mgr.24569) 3573 : cluster [DBG] pgmap v3080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:31.677872+0000 mgr.smithi067.rdualw (mgr.24569) 3574 : cluster [DBG] pgmap v3081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:31.677872+0000 mgr.smithi067.rdualw (mgr.24569) 3574 : cluster [DBG] pgmap v3081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:33.678650+0000 mgr.smithi067.rdualw (mgr.24569) 3575 : cluster [DBG] pgmap v3082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:33.678650+0000 mgr.smithi067.rdualw (mgr.24569) 3575 : cluster [DBG] pgmap v3082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:11:34.977780+0000 mon.smithi067 (mon.1) 571 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:11:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:11:34.978040+0000 mon.smithi067 (mon.1) 572 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:11:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:11:34.978133+0000 mon.smithi061 (mon.0) 893 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:11:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:11:34.978469+0000 mon.smithi061 (mon.0) 894 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:11:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:11:34.977780+0000 mon.smithi067 (mon.1) 571 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:11:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:11:34.978040+0000 mon.smithi067 (mon.1) 572 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:11:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:11:34.978133+0000 mon.smithi061 (mon.0) 893 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:11:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:11:34.978469+0000 mon.smithi061 (mon.0) 894 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:11:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:35.679521+0000 mgr.smithi067.rdualw (mgr.24569) 3576 : cluster [DBG] pgmap v3083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:11:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:35.679521+0000 mgr.smithi067.rdualw (mgr.24569) 3576 : cluster [DBG] pgmap v3083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:11:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:37.680108+0000 mgr.smithi067.rdualw (mgr.24569) 3577 : cluster [DBG] pgmap v3084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:37.680108+0000 mgr.smithi067.rdualw (mgr.24569) 3577 : cluster [DBG] pgmap v3084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:39.680916+0000 mgr.smithi067.rdualw (mgr.24569) 3578 : cluster [DBG] pgmap v3085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:39.680916+0000 mgr.smithi067.rdualw (mgr.24569) 3578 : cluster [DBG] pgmap v3085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:41.681755+0000 mgr.smithi067.rdualw (mgr.24569) 3579 : cluster [DBG] pgmap v3086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:41.681755+0000 mgr.smithi067.rdualw (mgr.24569) 3579 : cluster [DBG] pgmap v3086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:43.682422+0000 mgr.smithi067.rdualw (mgr.24569) 3580 : cluster [DBG] pgmap v3087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:43.682422+0000 mgr.smithi067.rdualw (mgr.24569) 3580 : cluster [DBG] pgmap v3087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:46.349 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:11:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:45.683189+0000 mgr.smithi067.rdualw (mgr.24569) 3581 : cluster [DBG] pgmap v3088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:11:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:45.683189+0000 mgr.smithi067.rdualw (mgr.24569) 3581 : cluster [DBG] pgmap v3088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:11:46.702 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:11:46.702 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (109m) 9m ago 110m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:11:46.702 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (102m) 9m ago 110m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:11:46.703 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (101m) 9m ago 109m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:11:46.703 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (109m) 9m ago 110m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:11:46.703 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (102m) 9m ago 106m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:11:46.703 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (102m) 9m ago 106m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:11:46.704 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (103m) 9m ago 111m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:11:46.704 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (103m) 9m ago 109m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:11:46.704 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (102m) 9m ago 111m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:11:46.704 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (102m) 9m ago 109m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:11:46.705 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (103m) 9m ago 103m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:11:46.705 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (103m) 9m ago 103m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:11:46.705 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (110m) 9m ago 110m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:11:46.705 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (109m) 9m ago 109m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:11:46.706 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (92m) 9m ago 109m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:11:46.706 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (108m) 9m ago 108m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:11:46.706 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (108m) 9m ago 108m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:11:46.707 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (108m) 9m ago 108m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:11:46.707 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (108m) 9m ago 108m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:11:46.707 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (107m) 9m ago 107m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:11:46.707 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (107m) 9m ago 107m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:11:46.707 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (107m) 9m ago 107m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:11:46.708 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (109m) 9m ago 110m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:11:47.051 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:11:47.052 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:11:47.052 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:11:47.052 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:11:47.053 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:11:47.053 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:11:47.054 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:11:47.054 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:11:47.055 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:11:47.055 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:11:47.055 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:11:47.056 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:11:47.056 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:11:47.057 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:11:47.057 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:11:47.058 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:11:47.058 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:11:47.059 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:11:47.059 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:11:47.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:11:46.335891+0000 mgr.smithi067.rdualw (mgr.24569) 3582 : audit [DBG] from='client.36526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:11:47.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:11:46.684352+0000 mgr.smithi067.rdualw (mgr.24569) 3583 : audit [DBG] from='client.36530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:11:47.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:11:47.049508+0000 mon.smithi061 (mon.0) 895 : audit [DBG] from='client.? 172.21.15.61:0/1043244421' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:11:47.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:11:46.335891+0000 mgr.smithi067.rdualw (mgr.24569) 3582 : audit [DBG] from='client.36526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:11:47.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:11:46.684352+0000 mgr.smithi067.rdualw (mgr.24569) 3583 : audit [DBG] from='client.36530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:11:47.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:11:47.049508+0000 mon.smithi061 (mon.0) 895 : audit [DBG] from='client.? 172.21.15.61:0/1043244421' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:11:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:47.683781+0000 mgr.smithi067.rdualw (mgr.24569) 3584 : cluster [DBG] pgmap v3089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:47.683781+0000 mgr.smithi067.rdualw (mgr.24569) 3584 : cluster [DBG] pgmap v3089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:49.684290+0000 mgr.smithi067.rdualw (mgr.24569) 3585 : cluster [DBG] pgmap v3090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:49.684290+0000 mgr.smithi067.rdualw (mgr.24569) 3585 : cluster [DBG] pgmap v3090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:51.685329+0000 mgr.smithi067.rdualw (mgr.24569) 3586 : cluster [DBG] pgmap v3091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:51.685329+0000 mgr.smithi067.rdualw (mgr.24569) 3586 : cluster [DBG] pgmap v3091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:53.685869+0000 mgr.smithi067.rdualw (mgr.24569) 3587 : cluster [DBG] pgmap v3092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:53.685869+0000 mgr.smithi067.rdualw (mgr.24569) 3587 : cluster [DBG] pgmap v3092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:55.686907+0000 mgr.smithi067.rdualw (mgr.24569) 3588 : cluster [DBG] pgmap v3093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:11:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:55.686907+0000 mgr.smithi067.rdualw (mgr.24569) 3588 : cluster [DBG] pgmap v3093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:11:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:11:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:57.687370+0000 mgr.smithi067.rdualw (mgr.24569) 3589 : cluster [DBG] pgmap v3094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:11:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:11:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:57.687370+0000 mgr.smithi067.rdualw (mgr.24569) 3589 : cluster [DBG] pgmap v3094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:11:59.687980+0000 mgr.smithi067.rdualw (mgr.24569) 3590 : cluster [DBG] pgmap v3095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:11:59.687980+0000 mgr.smithi067.rdualw (mgr.24569) 3590 : cluster [DBG] pgmap v3095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:01.688964+0000 mgr.smithi067.rdualw (mgr.24569) 3591 : cluster [DBG] pgmap v3096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:01.688964+0000 mgr.smithi067.rdualw (mgr.24569) 3591 : cluster [DBG] pgmap v3096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:03.689578+0000 mgr.smithi067.rdualw (mgr.24569) 3592 : cluster [DBG] pgmap v3097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:03.689578+0000 mgr.smithi067.rdualw (mgr.24569) 3592 : cluster [DBG] pgmap v3097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:05.690607+0000 mgr.smithi067.rdualw (mgr.24569) 3593 : cluster [DBG] pgmap v3098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:12:06.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:05.690607+0000 mgr.smithi067.rdualw (mgr.24569) 3593 : cluster [DBG] pgmap v3098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:12:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:07.691085+0000 mgr.smithi067.rdualw (mgr.24569) 3594 : cluster [DBG] pgmap v3099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:07.691085+0000 mgr.smithi067.rdualw (mgr.24569) 3594 : cluster [DBG] pgmap v3099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:09.691679+0000 mgr.smithi067.rdualw (mgr.24569) 3595 : cluster [DBG] pgmap v3100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:09.691679+0000 mgr.smithi067.rdualw (mgr.24569) 3595 : cluster [DBG] pgmap v3100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:11.692600+0000 mgr.smithi067.rdualw (mgr.24569) 3596 : cluster [DBG] pgmap v3101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:11.692600+0000 mgr.smithi067.rdualw (mgr.24569) 3596 : cluster [DBG] pgmap v3101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:13.693127+0000 mgr.smithi067.rdualw (mgr.24569) 3597 : cluster [DBG] pgmap v3102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:13.693127+0000 mgr.smithi067.rdualw (mgr.24569) 3597 : cluster [DBG] pgmap v3102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:15.693996+0000 mgr.smithi067.rdualw (mgr.24569) 3598 : cluster [DBG] pgmap v3103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:12:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:15.693996+0000 mgr.smithi067.rdualw (mgr.24569) 3598 : cluster [DBG] pgmap v3103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:12:17.357 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:12:17.649 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:12:17.649 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (109m) 10m ago 110m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:12:17.650 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (102m) 10m ago 110m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:12:17.650 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (102m) 10m ago 110m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:12:17.651 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (109m) 10m ago 110m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:12:17.651 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (103m) 10m ago 106m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:12:17.651 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (102m) 10m ago 106m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:12:17.651 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (103m) 10m ago 112m 452M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:12:17.652 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (103m) 10m ago 110m 513M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:12:17.652 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (103m) 10m ago 112m 674M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:12:17.652 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (103m) 10m ago 110m 376M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:12:17.652 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (104m) 10m ago 104m 181M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:12:17.653 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (104m) 10m ago 104m 106M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:12:17.653 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (110m) 10m ago 110m 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:12:17.653 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (110m) 10m ago 110m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:12:17.653 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (93m) 10m ago 109m 648M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:12:17.653 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (109m) 10m ago 109m 1466M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:12:17.654 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (109m) 10m ago 109m 886M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:12:17.654 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (108m) 10m ago 108m 1588M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:12:17.654 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (108m) 10m ago 108m 1466M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:12:17.654 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (108m) 10m ago 108m 1705M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:12:17.655 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (108m) 10m ago 108m 1341M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:12:17.655 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (107m) 10m ago 107m 2187M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:12:17.655 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (109m) 10m ago 110m 71.4M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:12:17.998 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:12:17.999 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:12:17.999 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:12:17.999 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:12:18.000 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:12:18.000 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:12:18.000 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:12:18.000 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:12:18.001 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:12:18.001 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:12:18.001 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:12:18.001 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:12:18.001 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:12:18.002 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:12:18.002 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:12:18.002 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:12:18.002 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:12:18.003 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:12:18.003 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:12:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:17.344361+0000 mgr.smithi067.rdualw (mgr.24569) 3599 : audit [DBG] from='client.36538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:12:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:17.631370+0000 mgr.smithi067.rdualw (mgr.24569) 3600 : audit [DBG] from='client.36542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:12:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:17.694495+0000 mgr.smithi067.rdualw (mgr.24569) 3601 : cluster [DBG] pgmap v3104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:17.997216+0000 mon.smithi061 (mon.0) 896 : audit [DBG] from='client.? 172.21.15.61:0/2110447505' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:12:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:17.344361+0000 mgr.smithi067.rdualw (mgr.24569) 3599 : audit [DBG] from='client.36538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:12:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:17.631370+0000 mgr.smithi067.rdualw (mgr.24569) 3600 : audit [DBG] from='client.36542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:12:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:17.694495+0000 mgr.smithi067.rdualw (mgr.24569) 3601 : cluster [DBG] pgmap v3104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:17.997216+0000 mon.smithi061 (mon.0) 896 : audit [DBG] from='client.? 172.21.15.61:0/2110447505' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:12:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:18.983675+0000 mon.smithi067 (mon.1) 573 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:12:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:18.985196+0000 mon.smithi067 (mon.1) 574 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:12:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:18.986156+0000 mon.smithi067 (mon.1) 575 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:12:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:18.983675+0000 mon.smithi067 (mon.1) 573 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:12:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:18.985196+0000 mon.smithi067 (mon.1) 574 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:12:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:18.986156+0000 mon.smithi067 (mon.1) 575 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:12:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:12:18.987019+0000 mgr.smithi067.rdualw (mgr.24569) 3602 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:12:21.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:19.695219+0000 mgr.smithi067.rdualw (mgr.24569) 3603 : cluster [DBG] pgmap v3105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:12:18.987019+0000 mgr.smithi067.rdualw (mgr.24569) 3602 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:12:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:19.695219+0000 mgr.smithi067.rdualw (mgr.24569) 3603 : cluster [DBG] pgmap v3105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:21.695979+0000 mgr.smithi067.rdualw (mgr.24569) 3604 : cluster [DBG] pgmap v3106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:21.695979+0000 mgr.smithi067.rdualw (mgr.24569) 3604 : cluster [DBG] pgmap v3106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:23.696704+0000 mgr.smithi067.rdualw (mgr.24569) 3605 : cluster [DBG] pgmap v3107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:23.781437+0000 mon.smithi061 (mon.0) 897 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:12:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:24.182282+0000 mon.smithi067 (mon.1) 576 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:12:25.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:24.182485+0000 mon.smithi061 (mon.0) 898 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:12:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:23.696704+0000 mgr.smithi067.rdualw (mgr.24569) 3605 : cluster [DBG] pgmap v3107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:23.781437+0000 mon.smithi061 (mon.0) 897 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:12:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:24.182282+0000 mon.smithi067 (mon.1) 576 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:12:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:24.182485+0000 mon.smithi061 (mon.0) 898 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:12:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:25.697527+0000 mgr.smithi067.rdualw (mgr.24569) 3606 : cluster [DBG] pgmap v3108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:12:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:25.697527+0000 mgr.smithi067.rdualw (mgr.24569) 3606 : cluster [DBG] pgmap v3108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:12:27.713 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:26.411033+0000 mon.smithi061 (mon.0) 899 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:12:27.714 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:26.820959+0000 mon.smithi067 (mon.1) 577 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:12:27.714 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:26.821296+0000 mon.smithi061 (mon.0) 900 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:12:27.714 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:26.828152+0000 mon.smithi061 (mon.0) 901 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:12:27.714 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:26.838373+0000 mon.smithi061 (mon.0) 902 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:12:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:26.411033+0000 mon.smithi061 (mon.0) 899 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:12:27.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:26.820959+0000 mon.smithi067 (mon.1) 577 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:12:27.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:26.821296+0000 mon.smithi061 (mon.0) 900 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:12:27.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:26.828152+0000 mon.smithi061 (mon.0) 901 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:12:27.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:26.838373+0000 mon.smithi061 (mon.0) 902 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:12:28.713 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:27.698276+0000 mgr.smithi067.rdualw (mgr.24569) 3607 : cluster [DBG] pgmap v3109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:27.698276+0000 mgr.smithi067.rdualw (mgr.24569) 3607 : cluster [DBG] pgmap v3109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:29.698959+0000 mgr.smithi067.rdualw (mgr.24569) 3608 : cluster [DBG] pgmap v3110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:29.698959+0000 mgr.smithi067.rdualw (mgr.24569) 3608 : cluster [DBG] pgmap v3110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:31.699799+0000 mgr.smithi067.rdualw (mgr.24569) 3609 : cluster [DBG] pgmap v3111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:31.699799+0000 mgr.smithi067.rdualw (mgr.24569) 3609 : cluster [DBG] pgmap v3111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:33.700466+0000 mgr.smithi067.rdualw (mgr.24569) 3610 : cluster [DBG] pgmap v3112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:33.700466+0000 mgr.smithi067.rdualw (mgr.24569) 3610 : cluster [DBG] pgmap v3112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:34.983507+0000 mon.smithi067 (mon.1) 578 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:12:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:34.983742+0000 mon.smithi061 (mon.0) 903 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:12:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:34.983788+0000 mon.smithi067 (mon.1) 579 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:12:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:34.984231+0000 mon.smithi061 (mon.0) 904 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:12:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:34.983507+0000 mon.smithi067 (mon.1) 578 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:12:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:34.983742+0000 mon.smithi061 (mon.0) 903 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:12:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:34.983788+0000 mon.smithi067 (mon.1) 579 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:12:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:34.984231+0000 mon.smithi061 (mon.0) 904 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:12:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:35.701309+0000 mgr.smithi067.rdualw (mgr.24569) 3611 : cluster [DBG] pgmap v3113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:12:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:35.701309+0000 mgr.smithi067.rdualw (mgr.24569) 3611 : cluster [DBG] pgmap v3113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:12:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:37.701913+0000 mgr.smithi067.rdualw (mgr.24569) 3612 : cluster [DBG] pgmap v3114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:37.701913+0000 mgr.smithi067.rdualw (mgr.24569) 3612 : cluster [DBG] pgmap v3114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:39.702713+0000 mgr.smithi067.rdualw (mgr.24569) 3613 : cluster [DBG] pgmap v3115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:39.702713+0000 mgr.smithi067.rdualw (mgr.24569) 3613 : cluster [DBG] pgmap v3115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:41.703591+0000 mgr.smithi067.rdualw (mgr.24569) 3614 : cluster [DBG] pgmap v3116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:41.703591+0000 mgr.smithi067.rdualw (mgr.24569) 3614 : cluster [DBG] pgmap v3116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:43.704244+0000 mgr.smithi067.rdualw (mgr.24569) 3615 : cluster [DBG] pgmap v3117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:43.704244+0000 mgr.smithi067.rdualw (mgr.24569) 3615 : cluster [DBG] pgmap v3117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:45.705101+0000 mgr.smithi067.rdualw (mgr.24569) 3616 : cluster [DBG] pgmap v3118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:12:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:45.705101+0000 mgr.smithi067.rdualw (mgr.24569) 3616 : cluster [DBG] pgmap v3118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:12:48.305 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:12:48.597 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:12:48.597 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (110m) 22s ago 111m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:12:48.598 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (103m) 22s ago 111m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:12:48.598 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (102m) 24s ago 110m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:12:48.598 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (110m) 22s ago 111m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:12:48.598 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (103m) 22s ago 107m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:12:48.599 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (103m) 24s ago 107m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:12:48.599 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (104m) 22s ago 112m 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:12:48.599 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (104m) 24s ago 110m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:12:48.600 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (103m) 22s ago 112m 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:12:48.600 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (103m) 24s ago 110m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:12:48.600 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (104m) 22s ago 104m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:12:48.600 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (104m) 24s ago 104m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:12:48.601 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (111m) 22s ago 111m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:12:48.601 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (110m) 24s ago 110m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:12:48.601 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (93m) 22s ago 110m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:12:48.601 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (109m) 22s ago 109m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:12:48.602 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (109m) 22s ago 109m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:12:48.602 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (109m) 22s ago 109m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:12:48.602 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (109m) 24s ago 109m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:12:48.602 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (108m) 24s ago 108m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:12:48.603 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (108m) 24s ago 108m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:12:48.603 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (108m) 24s ago 108m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:12:48.603 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (110m) 22s ago 111m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:12:48.941 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:12:48.941 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:12:48.941 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:12:48.941 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:12:48.942 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:12:48.942 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:12:48.942 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:12:48.942 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:12:48.942 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:12:48.943 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:12:48.943 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:12:48.943 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:12:48.943 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:12:48.944 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:12:48.944 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:12:48.944 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:12:48.944 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:12:48.944 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:12:48.945 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:12:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:47.705771+0000 mgr.smithi067.rdualw (mgr.24569) 3617 : cluster [DBG] pgmap v3119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:47.705771+0000 mgr.smithi067.rdualw (mgr.24569) 3617 : cluster [DBG] pgmap v3119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:48.291568+0000 mgr.smithi067.rdualw (mgr.24569) 3618 : audit [DBG] from='client.36550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:12:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:48.579516+0000 mgr.smithi067.rdualw (mgr.24569) 3619 : audit [DBG] from='client.36554 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:12:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:12:48.939349+0000 mon.smithi061 (mon.0) 905 : audit [DBG] from='client.? 172.21.15.61:0/2581801412' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:12:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:48.291568+0000 mgr.smithi067.rdualw (mgr.24569) 3618 : audit [DBG] from='client.36550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:12:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:48.579516+0000 mgr.smithi067.rdualw (mgr.24569) 3619 : audit [DBG] from='client.36554 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:12:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:12:48.939349+0000 mon.smithi061 (mon.0) 905 : audit [DBG] from='client.? 172.21.15.61:0/2581801412' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:12:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:49.706313+0000 mgr.smithi067.rdualw (mgr.24569) 3620 : cluster [DBG] pgmap v3120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:49.706313+0000 mgr.smithi067.rdualw (mgr.24569) 3620 : cluster [DBG] pgmap v3120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:51.707234+0000 mgr.smithi067.rdualw (mgr.24569) 3621 : cluster [DBG] pgmap v3121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:51.707234+0000 mgr.smithi067.rdualw (mgr.24569) 3621 : cluster [DBG] pgmap v3121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:53.707839+0000 mgr.smithi067.rdualw (mgr.24569) 3622 : cluster [DBG] pgmap v3122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:53.707839+0000 mgr.smithi067.rdualw (mgr.24569) 3622 : cluster [DBG] pgmap v3122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:55.708649+0000 mgr.smithi067.rdualw (mgr.24569) 3623 : cluster [DBG] pgmap v3123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:12:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:55.708649+0000 mgr.smithi067.rdualw (mgr.24569) 3623 : cluster [DBG] pgmap v3123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:12:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:12:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:57.709096+0000 mgr.smithi067.rdualw (mgr.24569) 3624 : cluster [DBG] pgmap v3124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:12:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:12:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:57.709096+0000 mgr.smithi067.rdualw (mgr.24569) 3624 : cluster [DBG] pgmap v3124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:12:59.709844+0000 mgr.smithi067.rdualw (mgr.24569) 3625 : cluster [DBG] pgmap v3125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:12:59.709844+0000 mgr.smithi067.rdualw (mgr.24569) 3625 : cluster [DBG] pgmap v3125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:01.710920+0000 mgr.smithi067.rdualw (mgr.24569) 3626 : cluster [DBG] pgmap v3126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:01.710920+0000 mgr.smithi067.rdualw (mgr.24569) 3626 : cluster [DBG] pgmap v3126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:03.711406+0000 mgr.smithi067.rdualw (mgr.24569) 3627 : cluster [DBG] pgmap v3127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:03.711406+0000 mgr.smithi067.rdualw (mgr.24569) 3627 : cluster [DBG] pgmap v3127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:05.712349+0000 mgr.smithi067.rdualw (mgr.24569) 3628 : cluster [DBG] pgmap v3128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:13:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:05.712349+0000 mgr.smithi067.rdualw (mgr.24569) 3628 : cluster [DBG] pgmap v3128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:13:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:07.712965+0000 mgr.smithi067.rdualw (mgr.24569) 3629 : cluster [DBG] pgmap v3129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:07.712965+0000 mgr.smithi067.rdualw (mgr.24569) 3629 : cluster [DBG] pgmap v3129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:09.713596+0000 mgr.smithi067.rdualw (mgr.24569) 3630 : cluster [DBG] pgmap v3130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:09.713596+0000 mgr.smithi067.rdualw (mgr.24569) 3630 : cluster [DBG] pgmap v3130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:13.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:11.714721+0000 mgr.smithi067.rdualw (mgr.24569) 3631 : cluster [DBG] pgmap v3131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:11.714721+0000 mgr.smithi067.rdualw (mgr.24569) 3631 : cluster [DBG] pgmap v3131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:13.715346+0000 mgr.smithi067.rdualw (mgr.24569) 3632 : cluster [DBG] pgmap v3132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:13.715346+0000 mgr.smithi067.rdualw (mgr.24569) 3632 : cluster [DBG] pgmap v3132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:15.716224+0000 mgr.smithi067.rdualw (mgr.24569) 3633 : cluster [DBG] pgmap v3133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:13:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:15.716224+0000 mgr.smithi067.rdualw (mgr.24569) 3633 : cluster [DBG] pgmap v3133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:13:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:17.716829+0000 mgr.smithi067.rdualw (mgr.24569) 3634 : cluster [DBG] pgmap v3134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:17.716829+0000 mgr.smithi067.rdualw (mgr.24569) 3634 : cluster [DBG] pgmap v3134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:19.338 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:13:19.631 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:13:19.632 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (110m) 53s ago 111m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:13:19.632 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (103m) 53s ago 111m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:13:19.632 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (103m) 55s ago 111m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:13:19.632 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (110m) 53s ago 111m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:13:19.633 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (104m) 53s ago 107m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:13:19.633 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (103m) 55s ago 107m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:13:19.633 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (105m) 53s ago 113m 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:13:19.633 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (104m) 55s ago 111m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:13:19.633 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (104m) 53s ago 113m 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:13:19.634 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (104m) 55s ago 111m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:13:19.634 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (105m) 53s ago 105m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:13:19.634 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (105m) 55s ago 105m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:13:19.634 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (111m) 53s ago 111m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:13:19.635 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (111m) 55s ago 111m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:13:19.635 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (94m) 53s ago 110m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:13:19.635 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (110m) 53s ago 110m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:13:19.635 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (110m) 53s ago 110m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:13:19.635 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (109m) 53s ago 109m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:13:19.636 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (109m) 55s ago 109m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:13:19.636 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (109m) 55s ago 109m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:13:19.636 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (109m) 55s ago 109m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:13:19.636 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (108m) 55s ago 108m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:13:19.637 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (110m) 53s ago 111m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:13:19.973 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:13:19.973 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:13:19.974 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:13:19.974 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:13:19.974 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:13:19.975 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:13:19.975 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:13:19.975 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:13:19.976 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:13:19.976 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:13:19.976 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:13:19.977 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:13:19.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:13:19.977 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:13:19.977 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:13:19.978 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:13:19.978 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:13:19.978 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:13:19.979 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:13:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:13:19.321733+0000 mgr.smithi067.rdualw (mgr.24569) 3635 : audit [DBG] from='client.36562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:13:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:13:19.614304+0000 mgr.smithi067.rdualw (mgr.24569) 3636 : audit [DBG] from='client.36566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:13:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:19.717673+0000 mgr.smithi067.rdualw (mgr.24569) 3637 : cluster [DBG] pgmap v3135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:13:19.971908+0000 mon.smithi061 (mon.0) 906 : audit [DBG] from='client.? 172.21.15.61:0/1894567734' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:13:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:13:19.321733+0000 mgr.smithi067.rdualw (mgr.24569) 3635 : audit [DBG] from='client.36562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:13:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:13:19.614304+0000 mgr.smithi067.rdualw (mgr.24569) 3636 : audit [DBG] from='client.36566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:13:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:19.717673+0000 mgr.smithi067.rdualw (mgr.24569) 3637 : cluster [DBG] pgmap v3135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:13:19.971908+0000 mon.smithi061 (mon.0) 906 : audit [DBG] from='client.? 172.21.15.61:0/1894567734' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:13:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:21.718744+0000 mgr.smithi067.rdualw (mgr.24569) 3638 : cluster [DBG] pgmap v3136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:21.718744+0000 mgr.smithi067.rdualw (mgr.24569) 3638 : cluster [DBG] pgmap v3136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:23.719294+0000 mgr.smithi067.rdualw (mgr.24569) 3639 : cluster [DBG] pgmap v3137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:23.719294+0000 mgr.smithi067.rdualw (mgr.24569) 3639 : cluster [DBG] pgmap v3137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:26.557 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:25.720184+0000 mgr.smithi067.rdualw (mgr.24569) 3640 : cluster [DBG] pgmap v3138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:13:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:25.720184+0000 mgr.smithi067.rdualw (mgr.24569) 3640 : cluster [DBG] pgmap v3138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:13:27.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:13:26.843371+0000 mon.smithi067 (mon.1) 580 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:13:27.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:13:26.844829+0000 mon.smithi067 (mon.1) 581 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:13:27.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:13:26.845868+0000 mon.smithi067 (mon.1) 582 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:13:27.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:13:26.846819+0000 mgr.smithi067.rdualw (mgr.24569) 3641 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:13:27.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:13:26.843371+0000 mon.smithi067 (mon.1) 580 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:13:27.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:13:26.844829+0000 mon.smithi067 (mon.1) 581 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:13:27.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:13:26.845868+0000 mon.smithi067 (mon.1) 582 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:13:27.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:13:26.846819+0000 mgr.smithi067.rdualw (mgr.24569) 3641 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:13:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:13:27.262964+0000 mon.smithi061 (mon.0) 907 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:13:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:13:27.268440+0000 mon.smithi061 (mon.0) 908 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:13:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:27.720691+0000 mgr.smithi067.rdualw (mgr.24569) 3642 : cluster [DBG] pgmap v3139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:13:27.262964+0000 mon.smithi061 (mon.0) 907 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:13:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:13:27.268440+0000 mon.smithi061 (mon.0) 908 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:13:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:27.720691+0000 mgr.smithi067.rdualw (mgr.24569) 3642 : cluster [DBG] pgmap v3139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:29.721400+0000 mgr.smithi067.rdualw (mgr.24569) 3643 : cluster [DBG] pgmap v3140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:29.721400+0000 mgr.smithi067.rdualw (mgr.24569) 3643 : cluster [DBG] pgmap v3140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:31.722195+0000 mgr.smithi067.rdualw (mgr.24569) 3644 : cluster [DBG] pgmap v3141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:31.722195+0000 mgr.smithi067.rdualw (mgr.24569) 3644 : cluster [DBG] pgmap v3141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:33.722753+0000 mgr.smithi067.rdualw (mgr.24569) 3645 : cluster [DBG] pgmap v3142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:33.722753+0000 mgr.smithi067.rdualw (mgr.24569) 3645 : cluster [DBG] pgmap v3142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:13:34.989374+0000 mon.smithi067 (mon.1) 583 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:13:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:13:34.989624+0000 mon.smithi067 (mon.1) 584 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:13:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:13:34.989673+0000 mon.smithi061 (mon.0) 909 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:13:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:13:34.990007+0000 mon.smithi061 (mon.0) 910 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:13:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:13:34.989374+0000 mon.smithi067 (mon.1) 583 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:13:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:13:34.989624+0000 mon.smithi067 (mon.1) 584 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:13:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:13:34.989673+0000 mon.smithi061 (mon.0) 909 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:13:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:13:34.990007+0000 mon.smithi061 (mon.0) 910 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:13:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:35.723827+0000 mgr.smithi067.rdualw (mgr.24569) 3646 : cluster [DBG] pgmap v3143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:13:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:35.723827+0000 mgr.smithi067.rdualw (mgr.24569) 3646 : cluster [DBG] pgmap v3143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:13:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:37.724298+0000 mgr.smithi067.rdualw (mgr.24569) 3647 : cluster [DBG] pgmap v3144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:37.724298+0000 mgr.smithi067.rdualw (mgr.24569) 3647 : cluster [DBG] pgmap v3144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:39.725033+0000 mgr.smithi067.rdualw (mgr.24569) 3648 : cluster [DBG] pgmap v3145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:39.725033+0000 mgr.smithi067.rdualw (mgr.24569) 3648 : cluster [DBG] pgmap v3145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:41.726109+0000 mgr.smithi067.rdualw (mgr.24569) 3649 : cluster [DBG] pgmap v3146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:41.726109+0000 mgr.smithi067.rdualw (mgr.24569) 3649 : cluster [DBG] pgmap v3146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:43.726609+0000 mgr.smithi067.rdualw (mgr.24569) 3650 : cluster [DBG] pgmap v3147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:43.726609+0000 mgr.smithi067.rdualw (mgr.24569) 3650 : cluster [DBG] pgmap v3147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:45.727463+0000 mgr.smithi067.rdualw (mgr.24569) 3651 : cluster [DBG] pgmap v3148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:13:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:45.727463+0000 mgr.smithi067.rdualw (mgr.24569) 3651 : cluster [DBG] pgmap v3148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:13:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:47.728074+0000 mgr.smithi067.rdualw (mgr.24569) 3652 : cluster [DBG] pgmap v3149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:47.728074+0000 mgr.smithi067.rdualw (mgr.24569) 3652 : cluster [DBG] pgmap v3149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:50.281 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:13:50.569 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:13:50.569 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (111m) 84s ago 112m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:13:50.570 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (104m) 84s ago 112m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:13:50.570 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (103m) 86s ago 111m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:13:50.570 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (111m) 84s ago 112m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:13:50.570 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (104m) 84s ago 108m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:13:50.570 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (104m) 86s ago 108m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:13:50.571 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (105m) 84s ago 113m 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:13:50.571 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (105m) 86s ago 111m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:13:50.571 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (105m) 84s ago 113m 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:13:50.571 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (104m) 86s ago 111m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:13:50.572 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (105m) 84s ago 105m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:13:50.572 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (105m) 86s ago 105m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:13:50.572 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (112m) 84s ago 112m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:13:50.572 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (111m) 86s ago 111m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:13:50.572 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (94m) 84s ago 111m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:13:50.573 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (111m) 84s ago 111m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:13:50.573 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (110m) 84s ago 110m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:13:50.573 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (110m) 84s ago 110m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:13:50.573 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (110m) 86s ago 110m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:13:50.574 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (109m) 86s ago 109m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:13:50.574 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (109m) 86s ago 109m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:13:50.574 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (109m) 86s ago 109m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:13:50.574 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (111m) 84s ago 112m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:13:50.908 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:13:50.909 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:13:50.909 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:13:50.909 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:13:50.910 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:13:50.910 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:13:50.910 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:13:50.910 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:13:50.910 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:13:50.911 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:13:50.911 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:13:50.911 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:13:50.911 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:13:50.912 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:13:50.912 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:13:50.912 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:13:50.912 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:13:50.913 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:13:50.913 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:13:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:49.728656+0000 mgr.smithi067.rdualw (mgr.24569) 3653 : cluster [DBG] pgmap v3150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:49.728656+0000 mgr.smithi067.rdualw (mgr.24569) 3653 : cluster [DBG] pgmap v3150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:13:50.267436+0000 mgr.smithi067.rdualw (mgr.24569) 3654 : audit [DBG] from='client.36574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:13:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:13:50.551423+0000 mgr.smithi067.rdualw (mgr.24569) 3655 : audit [DBG] from='client.36578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:13:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:13:50.907285+0000 mon.smithi061 (mon.0) 911 : audit [DBG] from='client.? 172.21.15.61:0/798991923' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:13:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:13:50.267436+0000 mgr.smithi067.rdualw (mgr.24569) 3654 : audit [DBG] from='client.36574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:13:52.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:13:50.551423+0000 mgr.smithi067.rdualw (mgr.24569) 3655 : audit [DBG] from='client.36578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:13:52.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:13:50.907285+0000 mon.smithi061 (mon.0) 911 : audit [DBG] from='client.? 172.21.15.61:0/798991923' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:13:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:51.729690+0000 mgr.smithi067.rdualw (mgr.24569) 3656 : cluster [DBG] pgmap v3151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:51.729690+0000 mgr.smithi067.rdualw (mgr.24569) 3656 : cluster [DBG] pgmap v3151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:53.730290+0000 mgr.smithi067.rdualw (mgr.24569) 3657 : cluster [DBG] pgmap v3152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:53.730290+0000 mgr.smithi067.rdualw (mgr.24569) 3657 : cluster [DBG] pgmap v3152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:55.731114+0000 mgr.smithi067.rdualw (mgr.24569) 3658 : cluster [DBG] pgmap v3153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:13:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:55.731114+0000 mgr.smithi067.rdualw (mgr.24569) 3658 : cluster [DBG] pgmap v3153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:13:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:13:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:57.731623+0000 mgr.smithi067.rdualw (mgr.24569) 3659 : cluster [DBG] pgmap v3154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:13:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:13:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:57.731623+0000 mgr.smithi067.rdualw (mgr.24569) 3659 : cluster [DBG] pgmap v3154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:13:59.732222+0000 mgr.smithi067.rdualw (mgr.24569) 3660 : cluster [DBG] pgmap v3155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:13:59.732222+0000 mgr.smithi067.rdualw (mgr.24569) 3660 : cluster [DBG] pgmap v3155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:01.733213+0000 mgr.smithi067.rdualw (mgr.24569) 3661 : cluster [DBG] pgmap v3156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:01.733213+0000 mgr.smithi067.rdualw (mgr.24569) 3661 : cluster [DBG] pgmap v3156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:03.733756+0000 mgr.smithi067.rdualw (mgr.24569) 3662 : cluster [DBG] pgmap v3157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:03.733756+0000 mgr.smithi067.rdualw (mgr.24569) 3662 : cluster [DBG] pgmap v3157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:05.734783+0000 mgr.smithi067.rdualw (mgr.24569) 3663 : cluster [DBG] pgmap v3158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:14:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:05.734783+0000 mgr.smithi067.rdualw (mgr.24569) 3663 : cluster [DBG] pgmap v3158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:14:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:07.735375+0000 mgr.smithi067.rdualw (mgr.24569) 3664 : cluster [DBG] pgmap v3159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:07.735375+0000 mgr.smithi067.rdualw (mgr.24569) 3664 : cluster [DBG] pgmap v3159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:09.736040+0000 mgr.smithi067.rdualw (mgr.24569) 3665 : cluster [DBG] pgmap v3160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:09.736040+0000 mgr.smithi067.rdualw (mgr.24569) 3665 : cluster [DBG] pgmap v3160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:11.736839+0000 mgr.smithi067.rdualw (mgr.24569) 3666 : cluster [DBG] pgmap v3161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:11.736839+0000 mgr.smithi067.rdualw (mgr.24569) 3666 : cluster [DBG] pgmap v3161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:13.737572+0000 mgr.smithi067.rdualw (mgr.24569) 3667 : cluster [DBG] pgmap v3162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:13.737572+0000 mgr.smithi067.rdualw (mgr.24569) 3667 : cluster [DBG] pgmap v3162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:15.738598+0000 mgr.smithi067.rdualw (mgr.24569) 3668 : cluster [DBG] pgmap v3163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:14:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:15.738598+0000 mgr.smithi067.rdualw (mgr.24569) 3668 : cluster [DBG] pgmap v3163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:14:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:17.739275+0000 mgr.smithi067.rdualw (mgr.24569) 3669 : cluster [DBG] pgmap v3164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:17.739275+0000 mgr.smithi067.rdualw (mgr.24569) 3669 : cluster [DBG] pgmap v3164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:19.740060+0000 mgr.smithi067.rdualw (mgr.24569) 3670 : cluster [DBG] pgmap v3165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:21.103 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:19.740060+0000 mgr.smithi067.rdualw (mgr.24569) 3670 : cluster [DBG] pgmap v3165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:21.318 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:14:21.610 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:14:21.611 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (111m) 115s ago 112m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:14:21.611 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (104m) 115s ago 112m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:14:21.611 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (104m) 117s ago 112m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:14:21.611 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (111m) 115s ago 112m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:14:21.612 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (105m) 115s ago 108m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:14:21.612 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (104m) 117s ago 108m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:14:21.615 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (106m) 115s ago 114m 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:14:21.615 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (105m) 117s ago 112m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:14:21.616 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (105m) 115s ago 114m 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:14:21.616 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (105m) 117s ago 112m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:14:21.616 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (106m) 115s ago 106m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:14:21.616 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (106m) 117s ago 106m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:14:21.616 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (112m) 115s ago 112m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:14:21.617 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (112m) 117s ago 112m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:14:21.617 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (95m) 115s ago 111m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:14:21.617 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (111m) 115s ago 111m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:14:21.617 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (111m) 115s ago 111m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:14:21.618 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (110m) 115s ago 110m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:14:21.618 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (110m) 117s ago 110m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:14:21.618 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (110m) 117s ago 110m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:14:21.618 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (110m) 117s ago 110m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:14:21.618 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (109m) 117s ago 109m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:14:21.619 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (111m) 115s ago 112m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:14:21.954 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:14:21.954 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:14:21.955 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:14:21.955 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:14:21.955 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:14:21.955 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:14:21.955 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:14:21.956 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:14:21.956 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:14:21.956 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:14:21.956 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:14:21.957 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:14:21.957 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:14:21.957 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:14:21.957 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:14:21.958 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:14:21.958 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:14:21.958 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:14:21.959 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:14:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:14:21.304740+0000 mgr.smithi067.rdualw (mgr.24569) 3671 : audit [DBG] from='client.36586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:14:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:14:21.592878+0000 mgr.smithi067.rdualw (mgr.24569) 3672 : audit [DBG] from='client.36590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:14:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:21.740966+0000 mgr.smithi067.rdualw (mgr.24569) 3673 : cluster [DBG] pgmap v3166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:23.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:14:21.952603+0000 mon.smithi061 (mon.0) 912 : audit [DBG] from='client.? 172.21.15.61:0/2968760378' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:14:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:14:21.304740+0000 mgr.smithi067.rdualw (mgr.24569) 3671 : audit [DBG] from='client.36586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:14:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:14:21.592878+0000 mgr.smithi067.rdualw (mgr.24569) 3672 : audit [DBG] from='client.36590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:14:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:21.740966+0000 mgr.smithi067.rdualw (mgr.24569) 3673 : cluster [DBG] pgmap v3166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:14:21.952603+0000 mon.smithi061 (mon.0) 912 : audit [DBG] from='client.? 172.21.15.61:0/2968760378' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:14:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:23.741420+0000 mgr.smithi067.rdualw (mgr.24569) 3674 : cluster [DBG] pgmap v3167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:23.741420+0000 mgr.smithi067.rdualw (mgr.24569) 3674 : cluster [DBG] pgmap v3167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:25.742178+0000 mgr.smithi067.rdualw (mgr.24569) 3675 : cluster [DBG] pgmap v3168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:14:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:25.742178+0000 mgr.smithi067.rdualw (mgr.24569) 3675 : cluster [DBG] pgmap v3168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:14:27.732 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:14:27.272465+0000 mon.smithi067 (mon.1) 585 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:14:27.732 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:14:27.274000+0000 mon.smithi067 (mon.1) 586 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:14:27.733 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:14:27.274967+0000 mon.smithi067 (mon.1) 587 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:14:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:14:27.272465+0000 mon.smithi067 (mon.1) 585 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:14:27.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:14:27.274000+0000 mon.smithi067 (mon.1) 586 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:14:27.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:14:27.274967+0000 mon.smithi067 (mon.1) 587 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:14:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:14:27.275854+0000 mgr.smithi067.rdualw (mgr.24569) 3676 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:14:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:14:27.634960+0000 mon.smithi061 (mon.0) 913 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:14:29.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:14:27.644052+0000 mon.smithi061 (mon.0) 914 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:14:29.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:27.742609+0000 mgr.smithi067.rdualw (mgr.24569) 3677 : cluster [DBG] pgmap v3169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:29.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:14:28.046345+0000 mon.smithi061 (mon.0) 915 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:14:29.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:14:28.053159+0000 mon.smithi061 (mon.0) 916 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:14:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:14:27.275854+0000 mgr.smithi067.rdualw (mgr.24569) 3676 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:14:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:14:27.634960+0000 mon.smithi061 (mon.0) 913 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:14:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:14:27.644052+0000 mon.smithi061 (mon.0) 914 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:14:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:27.742609+0000 mgr.smithi067.rdualw (mgr.24569) 3677 : cluster [DBG] pgmap v3169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:14:28.046345+0000 mon.smithi061 (mon.0) 915 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:14:29.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:14:28.053159+0000 mon.smithi061 (mon.0) 916 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:14:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:29.743175+0000 mgr.smithi067.rdualw (mgr.24569) 3678 : cluster [DBG] pgmap v3170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:29.743175+0000 mgr.smithi067.rdualw (mgr.24569) 3678 : cluster [DBG] pgmap v3170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:31.744311+0000 mgr.smithi067.rdualw (mgr.24569) 3679 : cluster [DBG] pgmap v3171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:31.744311+0000 mgr.smithi067.rdualw (mgr.24569) 3679 : cluster [DBG] pgmap v3171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:33.744896+0000 mgr.smithi067.rdualw (mgr.24569) 3680 : cluster [DBG] pgmap v3172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:33.744896+0000 mgr.smithi067.rdualw (mgr.24569) 3680 : cluster [DBG] pgmap v3172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:14:34.995020+0000 mon.smithi067 (mon.1) 588 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:14:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:14:34.995271+0000 mon.smithi067 (mon.1) 589 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:14:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:14:34.995365+0000 mon.smithi061 (mon.0) 917 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:14:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:14:34.995670+0000 mon.smithi061 (mon.0) 918 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:14:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:14:34.995020+0000 mon.smithi067 (mon.1) 588 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:14:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:14:34.995271+0000 mon.smithi067 (mon.1) 589 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:14:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:14:34.995365+0000 mon.smithi061 (mon.0) 917 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:14:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:14:34.995670+0000 mon.smithi061 (mon.0) 918 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:14:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:35.745737+0000 mgr.smithi067.rdualw (mgr.24569) 3681 : cluster [DBG] pgmap v3173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:14:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:35.745737+0000 mgr.smithi067.rdualw (mgr.24569) 3681 : cluster [DBG] pgmap v3173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:14:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:37.746373+0000 mgr.smithi067.rdualw (mgr.24569) 3682 : cluster [DBG] pgmap v3174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:37.746373+0000 mgr.smithi067.rdualw (mgr.24569) 3682 : cluster [DBG] pgmap v3174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:39.747124+0000 mgr.smithi067.rdualw (mgr.24569) 3683 : cluster [DBG] pgmap v3175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:39.747124+0000 mgr.smithi067.rdualw (mgr.24569) 3683 : cluster [DBG] pgmap v3175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:41.748043+0000 mgr.smithi067.rdualw (mgr.24569) 3684 : cluster [DBG] pgmap v3176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:41.748043+0000 mgr.smithi067.rdualw (mgr.24569) 3684 : cluster [DBG] pgmap v3176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:43.748605+0000 mgr.smithi067.rdualw (mgr.24569) 3685 : cluster [DBG] pgmap v3177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:43.748605+0000 mgr.smithi067.rdualw (mgr.24569) 3685 : cluster [DBG] pgmap v3177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:45.749459+0000 mgr.smithi067.rdualw (mgr.24569) 3686 : cluster [DBG] pgmap v3178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:14:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:45.749459+0000 mgr.smithi067.rdualw (mgr.24569) 3686 : cluster [DBG] pgmap v3178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:14:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:47.750079+0000 mgr.smithi067.rdualw (mgr.24569) 3687 : cluster [DBG] pgmap v3179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:47.750079+0000 mgr.smithi067.rdualw (mgr.24569) 3687 : cluster [DBG] pgmap v3179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:49.750847+0000 mgr.smithi067.rdualw (mgr.24569) 3688 : cluster [DBG] pgmap v3180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:49.750847+0000 mgr.smithi067.rdualw (mgr.24569) 3688 : cluster [DBG] pgmap v3180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:52.262 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:14:52.558 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:14:52.559 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (112m) 2m ago 113m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:14:52.559 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (105m) 2m ago 113m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:14:52.559 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (104m) 2m ago 113m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:14:52.559 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (112m) 2m ago 113m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:14:52.560 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (105m) 2m ago 109m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:14:52.560 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (105m) 2m ago 109m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:14:52.560 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (106m) 2m ago 114m 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:14:52.560 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (106m) 2m ago 112m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:14:52.560 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (106m) 2m ago 114m 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:14:52.561 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (105m) 2m ago 112m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:14:52.561 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (106m) 2m ago 106m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:14:52.561 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (106m) 2m ago 106m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:14:52.561 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (113m) 2m ago 113m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:14:52.561 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (112m) 2m ago 112m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:14:52.562 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (95m) 2m ago 112m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:14:52.562 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (112m) 2m ago 112m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:14:52.562 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (111m) 2m ago 111m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:14:52.563 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (111m) 2m ago 111m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:14:52.563 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (111m) 2m ago 111m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:14:52.563 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (111m) 2m ago 111m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:14:52.563 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (110m) 2m ago 110m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:14:52.564 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (110m) 2m ago 110m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:14:52.564 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (112m) 2m ago 113m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:14:52.902 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:14:52.902 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:14:52.903 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:14:52.903 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:14:52.903 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:14:52.903 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:14:52.904 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:14:52.904 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:14:52.904 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:14:52.904 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:14:52.904 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:14:52.905 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:14:52.905 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:14:52.905 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:14:52.905 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:14:52.906 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:14:52.906 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:14:52.906 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:14:52.906 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:14:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:51.751767+0000 mgr.smithi067.rdualw (mgr.24569) 3689 : cluster [DBG] pgmap v3181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:51.751767+0000 mgr.smithi067.rdualw (mgr.24569) 3689 : cluster [DBG] pgmap v3181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:14:52.246525+0000 mgr.smithi067.rdualw (mgr.24569) 3690 : audit [DBG] from='client.36598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:14:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:14:52.540516+0000 mgr.smithi067.rdualw (mgr.24569) 3691 : audit [DBG] from='client.36602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:14:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:14:52.900921+0000 mon.smithi061 (mon.0) 919 : audit [DBG] from='client.? 172.21.15.61:0/3856749078' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:14:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:14:52.246525+0000 mgr.smithi067.rdualw (mgr.24569) 3690 : audit [DBG] from='client.36598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:14:54.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:14:52.540516+0000 mgr.smithi067.rdualw (mgr.24569) 3691 : audit [DBG] from='client.36602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:14:54.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:14:52.900921+0000 mon.smithi061 (mon.0) 919 : audit [DBG] from='client.? 172.21.15.61:0/3856749078' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:14:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:53.752443+0000 mgr.smithi067.rdualw (mgr.24569) 3692 : cluster [DBG] pgmap v3182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:53.752443+0000 mgr.smithi067.rdualw (mgr.24569) 3692 : cluster [DBG] pgmap v3182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:55.753284+0000 mgr.smithi067.rdualw (mgr.24569) 3693 : cluster [DBG] pgmap v3183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:14:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:55.753284+0000 mgr.smithi067.rdualw (mgr.24569) 3693 : cluster [DBG] pgmap v3183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:14:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:14:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:57.753973+0000 mgr.smithi067.rdualw (mgr.24569) 3694 : cluster [DBG] pgmap v3184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:14:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:14:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:57.753973+0000 mgr.smithi067.rdualw (mgr.24569) 3694 : cluster [DBG] pgmap v3184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:14:59.754672+0000 mgr.smithi067.rdualw (mgr.24569) 3695 : cluster [DBG] pgmap v3185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:14:59.754672+0000 mgr.smithi067.rdualw (mgr.24569) 3695 : cluster [DBG] pgmap v3185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:01.755558+0000 mgr.smithi067.rdualw (mgr.24569) 3696 : cluster [DBG] pgmap v3186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:01.755558+0000 mgr.smithi067.rdualw (mgr.24569) 3696 : cluster [DBG] pgmap v3186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:03.756035+0000 mgr.smithi067.rdualw (mgr.24569) 3697 : cluster [DBG] pgmap v3187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:03.756035+0000 mgr.smithi067.rdualw (mgr.24569) 3697 : cluster [DBG] pgmap v3187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:05.757101+0000 mgr.smithi067.rdualw (mgr.24569) 3698 : cluster [DBG] pgmap v3188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:15:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:05.757101+0000 mgr.smithi067.rdualw (mgr.24569) 3698 : cluster [DBG] pgmap v3188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:15:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:07.757639+0000 mgr.smithi067.rdualw (mgr.24569) 3699 : cluster [DBG] pgmap v3189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:07.757639+0000 mgr.smithi067.rdualw (mgr.24569) 3699 : cluster [DBG] pgmap v3189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:09.758338+0000 mgr.smithi067.rdualw (mgr.24569) 3700 : cluster [DBG] pgmap v3190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:09.758338+0000 mgr.smithi067.rdualw (mgr.24569) 3700 : cluster [DBG] pgmap v3190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:11.759312+0000 mgr.smithi067.rdualw (mgr.24569) 3701 : cluster [DBG] pgmap v3191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:11.759312+0000 mgr.smithi067.rdualw (mgr.24569) 3701 : cluster [DBG] pgmap v3191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:13.759959+0000 mgr.smithi067.rdualw (mgr.24569) 3702 : cluster [DBG] pgmap v3192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:13.759959+0000 mgr.smithi067.rdualw (mgr.24569) 3702 : cluster [DBG] pgmap v3192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:15.760786+0000 mgr.smithi067.rdualw (mgr.24569) 3703 : cluster [DBG] pgmap v3193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:15:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:15.760786+0000 mgr.smithi067.rdualw (mgr.24569) 3703 : cluster [DBG] pgmap v3193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:15:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:17.761264+0000 mgr.smithi067.rdualw (mgr.24569) 3704 : cluster [DBG] pgmap v3194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:17.761264+0000 mgr.smithi067.rdualw (mgr.24569) 3704 : cluster [DBG] pgmap v3194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:19.762012+0000 mgr.smithi067.rdualw (mgr.24569) 3705 : cluster [DBG] pgmap v3195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:19.762012+0000 mgr.smithi067.rdualw (mgr.24569) 3705 : cluster [DBG] pgmap v3195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:21.762902+0000 mgr.smithi067.rdualw (mgr.24569) 3706 : cluster [DBG] pgmap v3196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:23.210 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:15:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:21.762902+0000 mgr.smithi067.rdualw (mgr.24569) 3706 : cluster [DBG] pgmap v3196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:23.499 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:15:23.500 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (112m) 2m ago 114m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:15:23.500 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (105m) 2m ago 113m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:15:23.500 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (105m) 2m ago 113m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:15:23.500 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (112m) 2m ago 113m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:15:23.501 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (106m) 2m ago 109m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:15:23.501 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (105m) 2m ago 109m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:15:23.501 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (107m) 2m ago 115m 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:15:23.501 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (106m) 2m ago 113m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:15:23.501 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (106m) 2m ago 115m 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:15:23.502 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (106m) 2m ago 113m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:15:23.502 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (107m) 2m ago 107m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:15:23.502 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (107m) 2m ago 107m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:15:23.502 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (113m) 2m ago 113m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:15:23.503 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (113m) 2m ago 113m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:15:23.503 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (96m) 2m ago 112m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:15:23.503 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (112m) 2m ago 112m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:15:23.503 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (112m) 2m ago 112m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:15:23.504 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (112m) 2m ago 111m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:15:23.504 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (111m) 2m ago 111m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:15:23.504 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (111m) 2m ago 111m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:15:23.504 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (111m) 2m ago 111m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:15:23.504 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (111m) 2m ago 111m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:15:23.505 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (112m) 2m ago 113m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:15:23.842 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:15:23.843 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:15:23.843 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:15:23.843 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:15:23.843 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:15:23.844 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:15:23.844 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:15:23.844 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:15:23.844 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:15:23.845 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:15:23.845 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:15:23.845 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:15:23.845 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:15:23.845 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:15:23.846 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:15:23.846 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:15:23.846 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:15:23.846 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:15:23.847 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:15:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:15:23.197380+0000 mgr.smithi067.rdualw (mgr.24569) 3707 : audit [DBG] from='client.36610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:15:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:15:23.481749+0000 mgr.smithi067.rdualw (mgr.24569) 3708 : audit [DBG] from='client.36614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:15:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:23.763665+0000 mgr.smithi067.rdualw (mgr.24569) 3709 : cluster [DBG] pgmap v3197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:15:23.841112+0000 mon.smithi061 (mon.0) 920 : audit [DBG] from='client.? 172.21.15.61:0/3039656897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:15:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:15:23.197380+0000 mgr.smithi067.rdualw (mgr.24569) 3707 : audit [DBG] from='client.36610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:15:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:15:23.481749+0000 mgr.smithi067.rdualw (mgr.24569) 3708 : audit [DBG] from='client.36614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:15:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:23.763665+0000 mgr.smithi067.rdualw (mgr.24569) 3709 : cluster [DBG] pgmap v3197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:15:23.841112+0000 mon.smithi061 (mon.0) 920 : audit [DBG] from='client.? 172.21.15.61:0/3039656897' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:15:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:25.764550+0000 mgr.smithi067.rdualw (mgr.24569) 3710 : cluster [DBG] pgmap v3198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:15:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:25.764550+0000 mgr.smithi067.rdualw (mgr.24569) 3710 : cluster [DBG] pgmap v3198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:15:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:27.765040+0000 mgr.smithi067.rdualw (mgr.24569) 3711 : cluster [DBG] pgmap v3199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:15:28.056753+0000 mon.smithi067 (mon.1) 590 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:15:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:15:28.058221+0000 mon.smithi067 (mon.1) 591 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:15:29.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:15:28.059254+0000 mon.smithi067 (mon.1) 592 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:15:29.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:15:28.475815+0000 mon.smithi061 (mon.0) 921 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:15:29.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:15:28.483137+0000 mon.smithi061 (mon.0) 922 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:15:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:27.765040+0000 mgr.smithi067.rdualw (mgr.24569) 3711 : cluster [DBG] pgmap v3199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:15:28.056753+0000 mon.smithi067 (mon.1) 590 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:15:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:15:28.058221+0000 mon.smithi067 (mon.1) 591 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:15:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:15:28.059254+0000 mon.smithi067 (mon.1) 592 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:15:29.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:15:28.475815+0000 mon.smithi061 (mon.0) 921 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:15:29.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:15:28.483137+0000 mon.smithi061 (mon.0) 922 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:15:30.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:15:28.060190+0000 mgr.smithi067.rdualw (mgr.24569) 3712 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:15:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:15:28.060190+0000 mgr.smithi067.rdualw (mgr.24569) 3712 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:15:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:29.765728+0000 mgr.smithi067.rdualw (mgr.24569) 3713 : cluster [DBG] pgmap v3200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:29.765728+0000 mgr.smithi067.rdualw (mgr.24569) 3713 : cluster [DBG] pgmap v3200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:31.766775+0000 mgr.smithi067.rdualw (mgr.24569) 3714 : cluster [DBG] pgmap v3201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:31.766775+0000 mgr.smithi067.rdualw (mgr.24569) 3714 : cluster [DBG] pgmap v3201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:33.767371+0000 mgr.smithi067.rdualw (mgr.24569) 3715 : cluster [DBG] pgmap v3202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:33.767371+0000 mgr.smithi067.rdualw (mgr.24569) 3715 : cluster [DBG] pgmap v3202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:15:35.001148+0000 mon.smithi067 (mon.1) 593 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:15:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:15:35.001389+0000 mon.smithi067 (mon.1) 594 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:15:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:15:35.001400+0000 mon.smithi061 (mon.0) 923 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:15:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:15:35.001685+0000 mon.smithi061 (mon.0) 924 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:15:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:15:35.001148+0000 mon.smithi067 (mon.1) 593 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:15:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:15:35.001389+0000 mon.smithi067 (mon.1) 594 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:15:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:15:35.001400+0000 mon.smithi061 (mon.0) 923 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:15:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:15:35.001685+0000 mon.smithi061 (mon.0) 924 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:15:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:35.768251+0000 mgr.smithi067.rdualw (mgr.24569) 3716 : cluster [DBG] pgmap v3203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:15:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:35.768251+0000 mgr.smithi067.rdualw (mgr.24569) 3716 : cluster [DBG] pgmap v3203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:15:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:37.768762+0000 mgr.smithi067.rdualw (mgr.24569) 3717 : cluster [DBG] pgmap v3204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:37.768762+0000 mgr.smithi067.rdualw (mgr.24569) 3717 : cluster [DBG] pgmap v3204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:39.769354+0000 mgr.smithi067.rdualw (mgr.24569) 3718 : cluster [DBG] pgmap v3205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:39.769354+0000 mgr.smithi067.rdualw (mgr.24569) 3718 : cluster [DBG] pgmap v3205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:41.770454+0000 mgr.smithi067.rdualw (mgr.24569) 3719 : cluster [DBG] pgmap v3206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:41.770454+0000 mgr.smithi067.rdualw (mgr.24569) 3719 : cluster [DBG] pgmap v3206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:43.771114+0000 mgr.smithi067.rdualw (mgr.24569) 3720 : cluster [DBG] pgmap v3207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:43.771114+0000 mgr.smithi067.rdualw (mgr.24569) 3720 : cluster [DBG] pgmap v3207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:45.771967+0000 mgr.smithi067.rdualw (mgr.24569) 3721 : cluster [DBG] pgmap v3208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:15:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:45.771967+0000 mgr.smithi067.rdualw (mgr.24569) 3721 : cluster [DBG] pgmap v3208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:15:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:47.772726+0000 mgr.smithi067.rdualw (mgr.24569) 3722 : cluster [DBG] pgmap v3209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:47.772726+0000 mgr.smithi067.rdualw (mgr.24569) 3722 : cluster [DBG] pgmap v3209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:49.773346+0000 mgr.smithi067.rdualw (mgr.24569) 3723 : cluster [DBG] pgmap v3210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:51.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:49.773346+0000 mgr.smithi067.rdualw (mgr.24569) 3723 : cluster [DBG] pgmap v3210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:51.774204+0000 mgr.smithi067.rdualw (mgr.24569) 3724 : cluster [DBG] pgmap v3211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:51.774204+0000 mgr.smithi067.rdualw (mgr.24569) 3724 : cluster [DBG] pgmap v3211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:54.154 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:15:54.450 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:15:54.451 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (113m) 3m ago 114m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:15:54.451 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (106m) 3m ago 114m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:15:54.451 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (105m) 3m ago 114m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:15:54.451 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (113m) 3m ago 114m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:15:54.452 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (106m) 3m ago 110m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:15:54.452 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (106m) 3m ago 110m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:15:54.452 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (107m) 3m ago 115m 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:15:54.452 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (107m) 3m ago 113m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:15:54.453 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (107m) 3m ago 115m 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:15:54.453 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (106m) 3m ago 113m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:15:54.453 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (107m) 3m ago 107m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:15:54.453 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (107m) 3m ago 107m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:15:54.454 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (114m) 3m ago 114m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:15:54.454 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (113m) 3m ago 113m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:15:54.454 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (96m) 3m ago 113m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:15:54.454 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (113m) 3m ago 113m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:15:54.454 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (112m) 3m ago 112m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:15:54.455 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (112m) 3m ago 112m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:15:54.455 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (112m) 3m ago 112m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:15:54.455 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (112m) 3m ago 112m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:15:54.455 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (111m) 3m ago 111m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:15:54.456 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (111m) 3m ago 111m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:15:54.456 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (113m) 3m ago 114m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:15:54.795 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:15:54.796 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:15:54.796 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:15:54.796 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:15:54.796 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:15:54.797 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:15:54.797 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:15:54.797 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:15:54.797 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:15:54.798 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:15:54.798 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:15:54.798 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:15:54.798 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:15:54.799 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:15:54.799 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:15:54.799 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:15:54.799 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:15:54.800 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:15:54.800 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:15:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:53.774836+0000 mgr.smithi067.rdualw (mgr.24569) 3725 : cluster [DBG] pgmap v3212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:15:54.794177+0000 mon.smithi061 (mon.0) 925 : audit [DBG] from='client.? 172.21.15.61:0/2661878411' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:15:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:53.774836+0000 mgr.smithi067.rdualw (mgr.24569) 3725 : cluster [DBG] pgmap v3212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:15:54.794177+0000 mon.smithi061 (mon.0) 925 : audit [DBG] from='client.? 172.21.15.61:0/2661878411' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:15:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:15:54.141257+0000 mgr.smithi067.rdualw (mgr.24569) 3726 : audit [DBG] from='client.36622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:15:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:15:54.432608+0000 mgr.smithi067.rdualw (mgr.24569) 3727 : audit [DBG] from='client.36626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:15:56.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:15:54.141257+0000 mgr.smithi067.rdualw (mgr.24569) 3726 : audit [DBG] from='client.36622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:15:56.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:15:54.432608+0000 mgr.smithi067.rdualw (mgr.24569) 3727 : audit [DBG] from='client.36626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:15:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:55.775808+0000 mgr.smithi067.rdualw (mgr.24569) 3728 : cluster [DBG] pgmap v3213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:15:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:55.775808+0000 mgr.smithi067.rdualw (mgr.24569) 3728 : cluster [DBG] pgmap v3213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:15:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:15:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:57.776315+0000 mgr.smithi067.rdualw (mgr.24569) 3729 : cluster [DBG] pgmap v3214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:15:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:15:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:57.776315+0000 mgr.smithi067.rdualw (mgr.24569) 3729 : cluster [DBG] pgmap v3214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:15:59.776969+0000 mgr.smithi067.rdualw (mgr.24569) 3730 : cluster [DBG] pgmap v3215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:15:59.776969+0000 mgr.smithi067.rdualw (mgr.24569) 3730 : cluster [DBG] pgmap v3215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:01.777876+0000 mgr.smithi067.rdualw (mgr.24569) 3731 : cluster [DBG] pgmap v3216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:01.777876+0000 mgr.smithi067.rdualw (mgr.24569) 3731 : cluster [DBG] pgmap v3216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:03.778802+0000 mgr.smithi067.rdualw (mgr.24569) 3732 : cluster [DBG] pgmap v3217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:03.778802+0000 mgr.smithi067.rdualw (mgr.24569) 3732 : cluster [DBG] pgmap v3217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:05.779649+0000 mgr.smithi067.rdualw (mgr.24569) 3733 : cluster [DBG] pgmap v3218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:16:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:05.779649+0000 mgr.smithi067.rdualw (mgr.24569) 3733 : cluster [DBG] pgmap v3218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:16:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:07.780273+0000 mgr.smithi067.rdualw (mgr.24569) 3734 : cluster [DBG] pgmap v3219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:07.780273+0000 mgr.smithi067.rdualw (mgr.24569) 3734 : cluster [DBG] pgmap v3219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:09.781039+0000 mgr.smithi067.rdualw (mgr.24569) 3735 : cluster [DBG] pgmap v3220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:09.781039+0000 mgr.smithi067.rdualw (mgr.24569) 3735 : cluster [DBG] pgmap v3220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:11.781939+0000 mgr.smithi067.rdualw (mgr.24569) 3736 : cluster [DBG] pgmap v3221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:11.781939+0000 mgr.smithi067.rdualw (mgr.24569) 3736 : cluster [DBG] pgmap v3221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:13.782625+0000 mgr.smithi067.rdualw (mgr.24569) 3737 : cluster [DBG] pgmap v3222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:13.782625+0000 mgr.smithi067.rdualw (mgr.24569) 3737 : cluster [DBG] pgmap v3222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:15.783576+0000 mgr.smithi067.rdualw (mgr.24569) 3738 : cluster [DBG] pgmap v3223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:16:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:15.783576+0000 mgr.smithi067.rdualw (mgr.24569) 3738 : cluster [DBG] pgmap v3223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:16:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:17.784125+0000 mgr.smithi067.rdualw (mgr.24569) 3739 : cluster [DBG] pgmap v3224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:17.784125+0000 mgr.smithi067.rdualw (mgr.24569) 3739 : cluster [DBG] pgmap v3224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:19.784758+0000 mgr.smithi067.rdualw (mgr.24569) 3740 : cluster [DBG] pgmap v3225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:19.784758+0000 mgr.smithi067.rdualw (mgr.24569) 3740 : cluster [DBG] pgmap v3225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:21.785720+0000 mgr.smithi067.rdualw (mgr.24569) 3741 : cluster [DBG] pgmap v3226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:21.785720+0000 mgr.smithi067.rdualw (mgr.24569) 3741 : cluster [DBG] pgmap v3226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:23.786317+0000 mgr.smithi067.rdualw (mgr.24569) 3742 : cluster [DBG] pgmap v3227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:25.102 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:16:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:23.786317+0000 mgr.smithi067.rdualw (mgr.24569) 3742 : cluster [DBG] pgmap v3227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:25.392 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:16:25.393 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (113m) 3m ago 115m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:16:25.393 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (106m) 3m ago 115m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:16:25.393 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (106m) 4m ago 114m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:16:25.393 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (113m) 3m ago 114m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:16:25.393 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (107m) 3m ago 110m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:16:25.394 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (106m) 4m ago 110m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:16:25.394 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (108m) 3m ago 116m 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:16:25.394 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (107m) 4m ago 114m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:16:25.394 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (107m) 3m ago 116m 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:16:25.395 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (107m) 4m ago 114m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:16:25.395 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (108m) 3m ago 108m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:16:25.395 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (108m) 4m ago 108m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:16:25.395 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (114m) 3m ago 114m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:16:25.395 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (114m) 4m ago 114m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:16:25.396 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (97m) 3m ago 113m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:16:25.396 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (113m) 3m ago 113m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:16:25.396 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (113m) 3m ago 113m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:16:25.396 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (113m) 3m ago 113m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:16:25.397 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (112m) 4m ago 112m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:16:25.397 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (112m) 4m ago 112m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:16:25.397 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (112m) 4m ago 112m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:16:25.397 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (112m) 4m ago 112m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:16:25.398 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (113m) 3m ago 114m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:16:25.732 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:16:25.733 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:16:25.733 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:16:25.733 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:16:25.733 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:16:25.734 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:16:25.734 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:16:25.734 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:16:25.734 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:16:25.735 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:16:25.735 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:16:25.735 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:16:25.735 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:16:25.736 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:16:25.736 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:16:25.736 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:16:25.736 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:16:25.736 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:16:25.737 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:16:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:16:25.088687+0000 mgr.smithi067.rdualw (mgr.24569) 3743 : audit [DBG] from='client.36634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:16:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:16:25.374599+0000 mgr.smithi067.rdualw (mgr.24569) 3744 : audit [DBG] from='client.36638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:16:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:16:25.731216+0000 mon.smithi061 (mon.0) 926 : audit [DBG] from='client.? 172.21.15.61:0/2122975914' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:16:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:25.787207+0000 mgr.smithi067.rdualw (mgr.24569) 3745 : cluster [DBG] pgmap v3228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:16:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:16:25.088687+0000 mgr.smithi067.rdualw (mgr.24569) 3743 : audit [DBG] from='client.36634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:16:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:16:25.374599+0000 mgr.smithi067.rdualw (mgr.24569) 3744 : audit [DBG] from='client.36638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:16:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:16:25.731216+0000 mon.smithi061 (mon.0) 926 : audit [DBG] from='client.? 172.21.15.61:0/2122975914' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:16:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:25.787207+0000 mgr.smithi067.rdualw (mgr.24569) 3745 : cluster [DBG] pgmap v3228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:16:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:27.787944+0000 mgr.smithi067.rdualw (mgr.24569) 3746 : cluster [DBG] pgmap v3229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:16:28.487761+0000 mon.smithi067 (mon.1) 595 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:16:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:16:28.489246+0000 mon.smithi067 (mon.1) 596 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:16:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:16:28.490248+0000 mon.smithi067 (mon.1) 597 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:16:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:27.787944+0000 mgr.smithi067.rdualw (mgr.24569) 3746 : cluster [DBG] pgmap v3229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:16:28.487761+0000 mon.smithi067 (mon.1) 595 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:16:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:16:28.489246+0000 mon.smithi067 (mon.1) 596 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:16:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:16:28.490248+0000 mon.smithi067 (mon.1) 597 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:16:30.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:16:28.491092+0000 mgr.smithi067.rdualw (mgr.24569) 3747 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:16:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:16:28.907700+0000 mon.smithi061 (mon.0) 927 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:16:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:16:28.913333+0000 mon.smithi061 (mon.0) 928 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:16:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:16:28.491092+0000 mgr.smithi067.rdualw (mgr.24569) 3747 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:16:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:16:28.907700+0000 mon.smithi061 (mon.0) 927 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:16:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:16:28.913333+0000 mon.smithi061 (mon.0) 928 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:16:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:29.788597+0000 mgr.smithi067.rdualw (mgr.24569) 3748 : cluster [DBG] pgmap v3230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:29.788597+0000 mgr.smithi067.rdualw (mgr.24569) 3748 : cluster [DBG] pgmap v3230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:31.789416+0000 mgr.smithi067.rdualw (mgr.24569) 3749 : cluster [DBG] pgmap v3231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:31.789416+0000 mgr.smithi067.rdualw (mgr.24569) 3749 : cluster [DBG] pgmap v3231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:33.790121+0000 mgr.smithi067.rdualw (mgr.24569) 3750 : cluster [DBG] pgmap v3232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:33.790121+0000 mgr.smithi067.rdualw (mgr.24569) 3750 : cluster [DBG] pgmap v3232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:16:35.006848+0000 mon.smithi067 (mon.1) 598 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:16:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:16:35.007199+0000 mon.smithi067 (mon.1) 599 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:16:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:16:35.007363+0000 mon.smithi061 (mon.0) 929 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:16:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:16:35.007663+0000 mon.smithi061 (mon.0) 930 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:16:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:16:35.006848+0000 mon.smithi067 (mon.1) 598 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:16:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:16:35.007199+0000 mon.smithi067 (mon.1) 599 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:16:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:16:35.007363+0000 mon.smithi061 (mon.0) 929 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:16:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:16:35.007663+0000 mon.smithi061 (mon.0) 930 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:16:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:35.791048+0000 mgr.smithi067.rdualw (mgr.24569) 3751 : cluster [DBG] pgmap v3233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:16:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:35.791048+0000 mgr.smithi067.rdualw (mgr.24569) 3751 : cluster [DBG] pgmap v3233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:16:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:37.791670+0000 mgr.smithi067.rdualw (mgr.24569) 3752 : cluster [DBG] pgmap v3234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:37.791670+0000 mgr.smithi067.rdualw (mgr.24569) 3752 : cluster [DBG] pgmap v3234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:39.792176+0000 mgr.smithi067.rdualw (mgr.24569) 3753 : cluster [DBG] pgmap v3235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:39.792176+0000 mgr.smithi067.rdualw (mgr.24569) 3753 : cluster [DBG] pgmap v3235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:41.792943+0000 mgr.smithi067.rdualw (mgr.24569) 3754 : cluster [DBG] pgmap v3236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:41.792943+0000 mgr.smithi067.rdualw (mgr.24569) 3754 : cluster [DBG] pgmap v3236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:43.793571+0000 mgr.smithi067.rdualw (mgr.24569) 3755 : cluster [DBG] pgmap v3237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:43.793571+0000 mgr.smithi067.rdualw (mgr.24569) 3755 : cluster [DBG] pgmap v3237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:45.794485+0000 mgr.smithi067.rdualw (mgr.24569) 3756 : cluster [DBG] pgmap v3238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:16:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:45.794485+0000 mgr.smithi067.rdualw (mgr.24569) 3756 : cluster [DBG] pgmap v3238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:16:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:47.795066+0000 mgr.smithi067.rdualw (mgr.24569) 3757 : cluster [DBG] pgmap v3239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:47.795066+0000 mgr.smithi067.rdualw (mgr.24569) 3757 : cluster [DBG] pgmap v3239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:49.795692+0000 mgr.smithi067.rdualw (mgr.24569) 3758 : cluster [DBG] pgmap v3240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:51.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:49.795692+0000 mgr.smithi067.rdualw (mgr.24569) 3758 : cluster [DBG] pgmap v3240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:53.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:51.796740+0000 mgr.smithi067.rdualw (mgr.24569) 3759 : cluster [DBG] pgmap v3241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:51.796740+0000 mgr.smithi067.rdualw (mgr.24569) 3759 : cluster [DBG] pgmap v3241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:53.797472+0000 mgr.smithi067.rdualw (mgr.24569) 3760 : cluster [DBG] pgmap v3242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:53.797472+0000 mgr.smithi067.rdualw (mgr.24569) 3760 : cluster [DBG] pgmap v3242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:56.057 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:16:56.350 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:16:56.350 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (114m) 4m ago 115m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:16:56.351 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (107m) 4m ago 115m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:16:56.351 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (106m) 4m ago 115m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:16:56.351 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (114m) 4m ago 115m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:16:56.352 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (107m) 4m ago 111m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:16:56.352 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (107m) 4m ago 111m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:16:56.353 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (108m) 4m ago 116m 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:16:56.353 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (108m) 4m ago 114m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:16:56.354 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (108m) 4m ago 116m 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:16:56.354 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (107m) 4m ago 114m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:16:56.355 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (108m) 4m ago 108m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:16:56.355 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (108m) 4m ago 108m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:16:56.355 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (115m) 4m ago 115m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:16:56.356 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (114m) 4m ago 114m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:16:56.356 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (97m) 4m ago 114m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:16:56.357 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (114m) 4m ago 114m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:16:56.357 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (113m) 4m ago 113m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:16:56.358 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (113m) 4m ago 113m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:16:56.358 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (113m) 4m ago 113m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:16:56.359 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (113m) 4m ago 113m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:16:56.359 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (112m) 4m ago 112m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:16:56.359 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (112m) 4m ago 112m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:16:56.360 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (114m) 4m ago 115m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:16:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:55.798282+0000 mgr.smithi067.rdualw (mgr.24569) 3761 : cluster [DBG] pgmap v3243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:16:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:55.798282+0000 mgr.smithi067.rdualw (mgr.24569) 3761 : cluster [DBG] pgmap v3243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:16:56.689 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:16:56.690 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:16:56.690 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:16:56.690 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:16:56.691 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:16:56.691 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:16:56.691 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:16:56.691 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:16:56.692 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:16:56.692 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:16:56.692 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:16:56.692 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:16:56.693 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:16:56.693 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:16:56.693 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:16:56.693 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:16:56.693 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:16:56.694 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:16:56.694 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:16:57.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:16:56.043761+0000 mgr.smithi067.rdualw (mgr.24569) 3762 : audit [DBG] from='client.36646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:16:57.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:16:56.331980+0000 mgr.smithi067.rdualw (mgr.24569) 3763 : audit [DBG] from='client.36650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:16:57.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:16:56.688330+0000 mon.smithi061 (mon.0) 931 : audit [DBG] from='client.? 172.21.15.61:0/2580241386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:16:57.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:16:56.043761+0000 mgr.smithi067.rdualw (mgr.24569) 3762 : audit [DBG] from='client.36646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:16:57.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:16:56.331980+0000 mgr.smithi067.rdualw (mgr.24569) 3763 : audit [DBG] from='client.36650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:16:57.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:16:56.688330+0000 mon.smithi061 (mon.0) 931 : audit [DBG] from='client.? 172.21.15.61:0/2580241386' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:16:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:16:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:57.798789+0000 mgr.smithi067.rdualw (mgr.24569) 3764 : cluster [DBG] pgmap v3244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:16:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:16:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:57.798789+0000 mgr.smithi067.rdualw (mgr.24569) 3764 : cluster [DBG] pgmap v3244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:16:59.799453+0000 mgr.smithi067.rdualw (mgr.24569) 3765 : cluster [DBG] pgmap v3245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:01.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:16:59.799453+0000 mgr.smithi067.rdualw (mgr.24569) 3765 : cluster [DBG] pgmap v3245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:01.800474+0000 mgr.smithi067.rdualw (mgr.24569) 3766 : cluster [DBG] pgmap v3246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:01.800474+0000 mgr.smithi067.rdualw (mgr.24569) 3766 : cluster [DBG] pgmap v3246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:03.801078+0000 mgr.smithi067.rdualw (mgr.24569) 3767 : cluster [DBG] pgmap v3247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:03.801078+0000 mgr.smithi067.rdualw (mgr.24569) 3767 : cluster [DBG] pgmap v3247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:05.802089+0000 mgr.smithi067.rdualw (mgr.24569) 3768 : cluster [DBG] pgmap v3248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:17:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:05.802089+0000 mgr.smithi067.rdualw (mgr.24569) 3768 : cluster [DBG] pgmap v3248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:17:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:07.802752+0000 mgr.smithi067.rdualw (mgr.24569) 3769 : cluster [DBG] pgmap v3249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:07.802752+0000 mgr.smithi067.rdualw (mgr.24569) 3769 : cluster [DBG] pgmap v3249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:09.803328+0000 mgr.smithi067.rdualw (mgr.24569) 3770 : cluster [DBG] pgmap v3250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:09.803328+0000 mgr.smithi067.rdualw (mgr.24569) 3770 : cluster [DBG] pgmap v3250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:11.804190+0000 mgr.smithi067.rdualw (mgr.24569) 3771 : cluster [DBG] pgmap v3251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:11.804190+0000 mgr.smithi067.rdualw (mgr.24569) 3771 : cluster [DBG] pgmap v3251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:13.804849+0000 mgr.smithi067.rdualw (mgr.24569) 3772 : cluster [DBG] pgmap v3252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:13.804849+0000 mgr.smithi067.rdualw (mgr.24569) 3772 : cluster [DBG] pgmap v3252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:15.805712+0000 mgr.smithi067.rdualw (mgr.24569) 3773 : cluster [DBG] pgmap v3253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:17:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:15.805712+0000 mgr.smithi067.rdualw (mgr.24569) 3773 : cluster [DBG] pgmap v3253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:17:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:17.806382+0000 mgr.smithi067.rdualw (mgr.24569) 3774 : cluster [DBG] pgmap v3254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:17.806382+0000 mgr.smithi067.rdualw (mgr.24569) 3774 : cluster [DBG] pgmap v3254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:19.807129+0000 mgr.smithi067.rdualw (mgr.24569) 3775 : cluster [DBG] pgmap v3255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:21.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:19.807129+0000 mgr.smithi067.rdualw (mgr.24569) 3775 : cluster [DBG] pgmap v3255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:21.807984+0000 mgr.smithi067.rdualw (mgr.24569) 3776 : cluster [DBG] pgmap v3256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:21.807984+0000 mgr.smithi067.rdualw (mgr.24569) 3776 : cluster [DBG] pgmap v3256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:23.808733+0000 mgr.smithi067.rdualw (mgr.24569) 3777 : cluster [DBG] pgmap v3257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:23.808733+0000 mgr.smithi067.rdualw (mgr.24569) 3777 : cluster [DBG] pgmap v3257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:25.809814+0000 mgr.smithi067.rdualw (mgr.24569) 3778 : cluster [DBG] pgmap v3258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:17:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:25.809814+0000 mgr.smithi067.rdualw (mgr.24569) 3778 : cluster [DBG] pgmap v3258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:17:26.995 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:17:27.286 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:17:27.286 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (114m) 5m ago 116m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:17:27.286 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (107m) 5m ago 116m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:17:27.287 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (107m) 5m ago 115m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:17:27.287 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (114m) 5m ago 115m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:17:27.287 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (108m) 5m ago 111m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:17:27.287 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (107m) 5m ago 111m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:17:27.287 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (109m) 5m ago 117m 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:17:27.288 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (108m) 5m ago 115m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:17:27.288 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (108m) 5m ago 117m 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:17:27.288 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (108m) 5m ago 115m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:17:27.288 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (109m) 5m ago 109m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:17:27.289 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (109m) 5m ago 109m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:17:27.289 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (115m) 5m ago 115m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:17:27.289 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (115m) 5m ago 115m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:17:27.289 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (98m) 5m ago 114m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:17:27.289 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (114m) 5m ago 114m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:17:27.290 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (114m) 5m ago 114m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:17:27.290 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (114m) 5m ago 114m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:17:27.290 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (113m) 5m ago 113m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:17:27.290 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (113m) 5m ago 113m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:17:27.291 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (113m) 5m ago 113m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:17:27.291 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (113m) 5m ago 113m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:17:27.291 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (114m) 5m ago 115m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:17:27.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:17:26.981776+0000 mgr.smithi067.rdualw (mgr.24569) 3779 : audit [DBG] from='client.36658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:17:27.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:17:26.981776+0000 mgr.smithi067.rdualw (mgr.24569) 3779 : audit [DBG] from='client.36658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:17:27.626 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:17:27.626 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:17:27.627 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:17:27.627 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:17:27.627 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:17:27.627 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:17:27.628 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:17:27.628 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:17:27.628 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:17:27.628 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:17:27.628 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:17:27.629 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:17:27.629 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:17:27.629 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:17:27.629 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:17:27.630 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:17:27.630 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:17:27.630 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:17:27.630 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:17:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:17:27.268290+0000 mgr.smithi067.rdualw (mgr.24569) 3780 : audit [DBG] from='client.36662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:17:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:17:27.624951+0000 mon.smithi061 (mon.0) 932 : audit [DBG] from='client.? 172.21.15.61:0/3615851438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:17:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:27.810425+0000 mgr.smithi067.rdualw (mgr.24569) 3781 : cluster [DBG] pgmap v3259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:17:27.268290+0000 mgr.smithi067.rdualw (mgr.24569) 3780 : audit [DBG] from='client.36662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:17:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:17:27.624951+0000 mon.smithi061 (mon.0) 932 : audit [DBG] from='client.? 172.21.15.61:0/3615851438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:17:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:27.810425+0000 mgr.smithi067.rdualw (mgr.24569) 3781 : cluster [DBG] pgmap v3259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:29.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:17:28.917015+0000 mon.smithi067 (mon.1) 600 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:17:29.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:17:28.918404+0000 mon.smithi067 (mon.1) 601 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:17:29.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:17:28.919349+0000 mon.smithi067 (mon.1) 602 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:17:29.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:17:28.920203+0000 mgr.smithi067.rdualw (mgr.24569) 3782 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:17:29.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:17:28.917015+0000 mon.smithi067 (mon.1) 600 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:17:29.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:17:28.918404+0000 mon.smithi067 (mon.1) 601 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:17:29.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:17:28.919349+0000 mon.smithi067 (mon.1) 602 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:17:29.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:17:28.920203+0000 mgr.smithi067.rdualw (mgr.24569) 3782 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:17:30.763 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:17:29.341404+0000 mon.smithi061 (mon.0) 933 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:17:30.764 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:17:29.346654+0000 mon.smithi061 (mon.0) 934 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:17:30.764 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:29.811164+0000 mgr.smithi067.rdualw (mgr.24569) 3783 : cluster [DBG] pgmap v3260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:17:29.341404+0000 mon.smithi061 (mon.0) 933 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:17:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:17:29.346654+0000 mon.smithi061 (mon.0) 934 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:17:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:29.811164+0000 mgr.smithi067.rdualw (mgr.24569) 3783 : cluster [DBG] pgmap v3260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:31.812023+0000 mgr.smithi067.rdualw (mgr.24569) 3784 : cluster [DBG] pgmap v3261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:31.812023+0000 mgr.smithi067.rdualw (mgr.24569) 3784 : cluster [DBG] pgmap v3261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:33.812824+0000 mgr.smithi067.rdualw (mgr.24569) 3785 : cluster [DBG] pgmap v3262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:33.812824+0000 mgr.smithi067.rdualw (mgr.24569) 3785 : cluster [DBG] pgmap v3262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:17:35.012103+0000 mon.smithi067 (mon.1) 603 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:17:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:17:35.012462+0000 mon.smithi067 (mon.1) 604 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:17:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:17:35.012602+0000 mon.smithi061 (mon.0) 935 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:17:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:17:35.013070+0000 mon.smithi061 (mon.0) 936 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:17:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:17:35.012103+0000 mon.smithi067 (mon.1) 603 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:17:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:17:35.012462+0000 mon.smithi067 (mon.1) 604 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:17:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:17:35.012602+0000 mon.smithi061 (mon.0) 935 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:17:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:17:35.013070+0000 mon.smithi061 (mon.0) 936 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:17:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:35.813660+0000 mgr.smithi067.rdualw (mgr.24569) 3786 : cluster [DBG] pgmap v3263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:17:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:35.813660+0000 mgr.smithi067.rdualw (mgr.24569) 3786 : cluster [DBG] pgmap v3263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:17:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:37.814270+0000 mgr.smithi067.rdualw (mgr.24569) 3787 : cluster [DBG] pgmap v3264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:37.814270+0000 mgr.smithi067.rdualw (mgr.24569) 3787 : cluster [DBG] pgmap v3264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:39.814894+0000 mgr.smithi067.rdualw (mgr.24569) 3788 : cluster [DBG] pgmap v3265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:39.814894+0000 mgr.smithi067.rdualw (mgr.24569) 3788 : cluster [DBG] pgmap v3265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:41.815736+0000 mgr.smithi067.rdualw (mgr.24569) 3789 : cluster [DBG] pgmap v3266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:41.815736+0000 mgr.smithi067.rdualw (mgr.24569) 3789 : cluster [DBG] pgmap v3266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:43.816284+0000 mgr.smithi067.rdualw (mgr.24569) 3790 : cluster [DBG] pgmap v3267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:43.816284+0000 mgr.smithi067.rdualw (mgr.24569) 3790 : cluster [DBG] pgmap v3267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:45.817193+0000 mgr.smithi067.rdualw (mgr.24569) 3791 : cluster [DBG] pgmap v3268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:17:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:45.817193+0000 mgr.smithi067.rdualw (mgr.24569) 3791 : cluster [DBG] pgmap v3268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:17:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:47.817779+0000 mgr.smithi067.rdualw (mgr.24569) 3792 : cluster [DBG] pgmap v3269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:47.817779+0000 mgr.smithi067.rdualw (mgr.24569) 3792 : cluster [DBG] pgmap v3269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:49.818531+0000 mgr.smithi067.rdualw (mgr.24569) 3793 : cluster [DBG] pgmap v3270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:51.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:49.818531+0000 mgr.smithi067.rdualw (mgr.24569) 3793 : cluster [DBG] pgmap v3270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:51.819365+0000 mgr.smithi067.rdualw (mgr.24569) 3794 : cluster [DBG] pgmap v3271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:51.819365+0000 mgr.smithi067.rdualw (mgr.24569) 3794 : cluster [DBG] pgmap v3271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:53.820002+0000 mgr.smithi067.rdualw (mgr.24569) 3795 : cluster [DBG] pgmap v3272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:53.820002+0000 mgr.smithi067.rdualw (mgr.24569) 3795 : cluster [DBG] pgmap v3272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:55.820895+0000 mgr.smithi067.rdualw (mgr.24569) 3796 : cluster [DBG] pgmap v3273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:17:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:55.820895+0000 mgr.smithi067.rdualw (mgr.24569) 3796 : cluster [DBG] pgmap v3273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:17:57.936 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:17:58.228 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:17:58.229 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (115m) 5m ago 116m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:17:58.229 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (108m) 5m ago 116m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:17:58.229 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (108m) 5m ago 116m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:17:58.230 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (115m) 5m ago 116m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:17:58.230 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (108m) 5m ago 112m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:17:58.230 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (108m) 5m ago 112m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:17:58.231 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (109m) 5m ago 117m 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:17:58.231 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (109m) 5m ago 116m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:17:58.232 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (109m) 5m ago 117m 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:17:58.232 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (108m) 5m ago 115m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:17:58.232 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (109m) 5m ago 109m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:17:58.232 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (109m) 5m ago 109m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:17:58.233 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (116m) 5m ago 116m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:17:58.233 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (115m) 5m ago 115m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:17:58.233 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (99m) 5m ago 115m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:17:58.233 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (115m) 5m ago 115m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:17:58.234 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (114m) 5m ago 114m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:17:58.234 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (114m) 5m ago 114m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:17:58.234 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (114m) 5m ago 114m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:17:58.234 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (114m) 5m ago 114m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:17:58.234 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (113m) 5m ago 113m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:17:58.235 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (113m) 5m ago 113m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:17:58.235 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (115m) 5m ago 116m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:17:58.573 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:17:58.573 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:17:58.573 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:17:58.573 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:17:58.574 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:17:58.574 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:17:58.574 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:17:58.574 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:17:58.575 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:17:58.575 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:17:58.575 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:17:58.575 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:17:58.576 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:17:58.576 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:17:58.576 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:17:58.576 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:17:58.576 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:17:58.577 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:17:58.577 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:17:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:57.821382+0000 mgr.smithi067.rdualw (mgr.24569) 3797 : cluster [DBG] pgmap v3274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:17:57.923120+0000 mgr.smithi067.rdualw (mgr.24569) 3798 : audit [DBG] from='client.36670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:17:59.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:17:58.571133+0000 mon.smithi061 (mon.0) 937 : audit [DBG] from='client.? 172.21.15.61:0/739954373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:17:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:57.821382+0000 mgr.smithi067.rdualw (mgr.24569) 3797 : cluster [DBG] pgmap v3274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:17:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:17:57.923120+0000 mgr.smithi067.rdualw (mgr.24569) 3798 : audit [DBG] from='client.36670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:17:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:17:58.571133+0000 mon.smithi061 (mon.0) 937 : audit [DBG] from='client.? 172.21.15.61:0/739954373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:18:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:17:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:17:58.210760+0000 mgr.smithi067.rdualw (mgr.24569) 3799 : audit [DBG] from='client.36674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:18:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:17:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:17:58.210760+0000 mgr.smithi067.rdualw (mgr.24569) 3799 : audit [DBG] from='client.36674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:18:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:17:59.821959+0000 mgr.smithi067.rdualw (mgr.24569) 3800 : cluster [DBG] pgmap v3275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:01.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:17:59.821959+0000 mgr.smithi067.rdualw (mgr.24569) 3800 : cluster [DBG] pgmap v3275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:01.822987+0000 mgr.smithi067.rdualw (mgr.24569) 3801 : cluster [DBG] pgmap v3276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:03.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:01.822987+0000 mgr.smithi067.rdualw (mgr.24569) 3801 : cluster [DBG] pgmap v3276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:03.823719+0000 mgr.smithi067.rdualw (mgr.24569) 3802 : cluster [DBG] pgmap v3277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:03.823719+0000 mgr.smithi067.rdualw (mgr.24569) 3802 : cluster [DBG] pgmap v3277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:05.824633+0000 mgr.smithi067.rdualw (mgr.24569) 3803 : cluster [DBG] pgmap v3278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:18:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:05.824633+0000 mgr.smithi067.rdualw (mgr.24569) 3803 : cluster [DBG] pgmap v3278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:18:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:07.825247+0000 mgr.smithi067.rdualw (mgr.24569) 3804 : cluster [DBG] pgmap v3279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:07.825247+0000 mgr.smithi067.rdualw (mgr.24569) 3804 : cluster [DBG] pgmap v3279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:09.825842+0000 mgr.smithi067.rdualw (mgr.24569) 3805 : cluster [DBG] pgmap v3280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:09.825842+0000 mgr.smithi067.rdualw (mgr.24569) 3805 : cluster [DBG] pgmap v3280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:11.826806+0000 mgr.smithi067.rdualw (mgr.24569) 3806 : cluster [DBG] pgmap v3281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:11.826806+0000 mgr.smithi067.rdualw (mgr.24569) 3806 : cluster [DBG] pgmap v3281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:13.827552+0000 mgr.smithi067.rdualw (mgr.24569) 3807 : cluster [DBG] pgmap v3282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:13.827552+0000 mgr.smithi067.rdualw (mgr.24569) 3807 : cluster [DBG] pgmap v3282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:15.828333+0000 mgr.smithi067.rdualw (mgr.24569) 3808 : cluster [DBG] pgmap v3283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:18:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:15.828333+0000 mgr.smithi067.rdualw (mgr.24569) 3808 : cluster [DBG] pgmap v3283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:18:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:17.828861+0000 mgr.smithi067.rdualw (mgr.24569) 3809 : cluster [DBG] pgmap v3284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:17.828861+0000 mgr.smithi067.rdualw (mgr.24569) 3809 : cluster [DBG] pgmap v3284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:19.829599+0000 mgr.smithi067.rdualw (mgr.24569) 3810 : cluster [DBG] pgmap v3285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:19.829599+0000 mgr.smithi067.rdualw (mgr.24569) 3810 : cluster [DBG] pgmap v3285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:21.830480+0000 mgr.smithi067.rdualw (mgr.24569) 3811 : cluster [DBG] pgmap v3286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:21.830480+0000 mgr.smithi067.rdualw (mgr.24569) 3811 : cluster [DBG] pgmap v3286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:23.831085+0000 mgr.smithi067.rdualw (mgr.24569) 3812 : cluster [DBG] pgmap v3287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:23.831085+0000 mgr.smithi067.rdualw (mgr.24569) 3812 : cluster [DBG] pgmap v3287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:25.832039+0000 mgr.smithi067.rdualw (mgr.24569) 3813 : cluster [DBG] pgmap v3288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:18:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:25.832039+0000 mgr.smithi067.rdualw (mgr.24569) 3813 : cluster [DBG] pgmap v3288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:18:28.880 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:18:29.086 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:27.832841+0000 mgr.smithi067.rdualw (mgr.24569) 3814 : cluster [DBG] pgmap v3289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:29.175 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:18:29.176 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (116m) 6m ago 117m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:18:29.176 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (108m) 6m ago 117m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:18:29.176 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (108m) 6m ago 116m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:18:29.176 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (115m) 6m ago 116m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:18:29.177 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (109m) 6m ago 112m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:18:29.177 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (108m) 6m ago 112m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:18:29.177 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (110m) 6m ago 118m 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:18:29.177 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (109m) 6m ago 116m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:18:29.177 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (109m) 6m ago 118m 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:18:29.178 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (109m) 6m ago 116m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:18:29.178 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (110m) 6m ago 110m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:18:29.178 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (110m) 6m ago 110m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:18:29.178 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (116m) 6m ago 116m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:18:29.179 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (116m) 6m ago 116m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:18:29.179 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (99m) 6m ago 115m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:18:29.179 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (115m) 6m ago 115m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:18:29.179 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (115m) 6m ago 115m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:18:29.180 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (115m) 6m ago 115m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:18:29.180 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (114m) 6m ago 114m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:18:29.180 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (114m) 6m ago 114m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:18:29.180 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (114m) 6m ago 114m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:18:29.180 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (114m) 6m ago 114m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:18:29.181 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (115m) 6m ago 116m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:18:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:27.832841+0000 mgr.smithi067.rdualw (mgr.24569) 3814 : cluster [DBG] pgmap v3289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:29.517 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:18:29.517 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:18:29.517 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:18:29.517 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:18:29.518 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:18:29.518 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:18:29.518 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:18:29.518 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:18:29.519 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:18:29.519 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:18:29.519 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:18:29.519 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:18:29.520 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:18:29.520 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:18:29.521 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:18:29.521 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:18:29.521 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:18:29.521 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:18:29.521 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:18:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:18:28.867290+0000 mgr.smithi067.rdualw (mgr.24569) 3815 : audit [DBG] from='client.36682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:18:30.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:18:29.350275+0000 mon.smithi067 (mon.1) 605 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:18:30.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:18:29.351740+0000 mon.smithi067 (mon.1) 606 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:18:30.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:18:29.352715+0000 mon.smithi067 (mon.1) 607 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:18:30.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:18:29.515318+0000 mon.smithi061 (mon.0) 938 : audit [DBG] from='client.? 172.21.15.61:0/3968256705' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:18:30.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:18:29.768985+0000 mon.smithi061 (mon.0) 939 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:18:30.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:18:29.774351+0000 mon.smithi061 (mon.0) 940 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:18:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:18:28.867290+0000 mgr.smithi067.rdualw (mgr.24569) 3815 : audit [DBG] from='client.36682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:18:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:18:29.350275+0000 mon.smithi067 (mon.1) 605 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:18:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:18:29.351740+0000 mon.smithi067 (mon.1) 606 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:18:30.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:18:29.352715+0000 mon.smithi067 (mon.1) 607 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:18:30.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:18:29.515318+0000 mon.smithi061 (mon.0) 938 : audit [DBG] from='client.? 172.21.15.61:0/3968256705' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:18:30.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:18:29.768985+0000 mon.smithi061 (mon.0) 939 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:18:30.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:18:29.774351+0000 mon.smithi061 (mon.0) 940 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:18:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:18:29.155827+0000 mgr.smithi067.rdualw (mgr.24569) 3816 : audit [DBG] from='client.36686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:18:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:18:29.353590+0000 mgr.smithi067.rdualw (mgr.24569) 3817 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:18:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:29.833355+0000 mgr.smithi067.rdualw (mgr.24569) 3818 : cluster [DBG] pgmap v3290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:18:29.155827+0000 mgr.smithi067.rdualw (mgr.24569) 3816 : audit [DBG] from='client.36686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:18:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:18:29.353590+0000 mgr.smithi067.rdualw (mgr.24569) 3817 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:18:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:29.833355+0000 mgr.smithi067.rdualw (mgr.24569) 3818 : cluster [DBG] pgmap v3290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:31.834163+0000 mgr.smithi067.rdualw (mgr.24569) 3819 : cluster [DBG] pgmap v3291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:31.834163+0000 mgr.smithi067.rdualw (mgr.24569) 3819 : cluster [DBG] pgmap v3291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:33.834706+0000 mgr.smithi067.rdualw (mgr.24569) 3820 : cluster [DBG] pgmap v3292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:33.834706+0000 mgr.smithi067.rdualw (mgr.24569) 3820 : cluster [DBG] pgmap v3292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:18:35.017757+0000 mon.smithi067 (mon.1) 608 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:18:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:18:35.017985+0000 mon.smithi061 (mon.0) 941 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:18:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:18:35.018056+0000 mon.smithi067 (mon.1) 609 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:18:36.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:18:35.018413+0000 mon.smithi061 (mon.0) 942 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:18:36.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:18:35.017757+0000 mon.smithi067 (mon.1) 608 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:18:36.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:18:35.017985+0000 mon.smithi061 (mon.0) 941 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:18:36.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:18:35.018056+0000 mon.smithi067 (mon.1) 609 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:18:36.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:18:35.018413+0000 mon.smithi061 (mon.0) 942 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:18:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:35.835497+0000 mgr.smithi067.rdualw (mgr.24569) 3821 : cluster [DBG] pgmap v3293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:18:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:35.835497+0000 mgr.smithi067.rdualw (mgr.24569) 3821 : cluster [DBG] pgmap v3293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:18:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:37.836039+0000 mgr.smithi067.rdualw (mgr.24569) 3822 : cluster [DBG] pgmap v3294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:37.836039+0000 mgr.smithi067.rdualw (mgr.24569) 3822 : cluster [DBG] pgmap v3294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:39.836574+0000 mgr.smithi067.rdualw (mgr.24569) 3823 : cluster [DBG] pgmap v3295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:39.836574+0000 mgr.smithi067.rdualw (mgr.24569) 3823 : cluster [DBG] pgmap v3295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:41.837700+0000 mgr.smithi067.rdualw (mgr.24569) 3824 : cluster [DBG] pgmap v3296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:41.837700+0000 mgr.smithi067.rdualw (mgr.24569) 3824 : cluster [DBG] pgmap v3296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:43.838344+0000 mgr.smithi067.rdualw (mgr.24569) 3825 : cluster [DBG] pgmap v3297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:43.838344+0000 mgr.smithi067.rdualw (mgr.24569) 3825 : cluster [DBG] pgmap v3297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:45.839385+0000 mgr.smithi067.rdualw (mgr.24569) 3826 : cluster [DBG] pgmap v3298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:18:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:45.839385+0000 mgr.smithi067.rdualw (mgr.24569) 3826 : cluster [DBG] pgmap v3298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:18:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:47.839950+0000 mgr.smithi067.rdualw (mgr.24569) 3827 : cluster [DBG] pgmap v3299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:47.839950+0000 mgr.smithi067.rdualw (mgr.24569) 3827 : cluster [DBG] pgmap v3299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:49.840507+0000 mgr.smithi067.rdualw (mgr.24569) 3828 : cluster [DBG] pgmap v3300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:51.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:49.840507+0000 mgr.smithi067.rdualw (mgr.24569) 3828 : cluster [DBG] pgmap v3300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:51.841456+0000 mgr.smithi067.rdualw (mgr.24569) 3829 : cluster [DBG] pgmap v3301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:51.841456+0000 mgr.smithi067.rdualw (mgr.24569) 3829 : cluster [DBG] pgmap v3301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:53.842136+0000 mgr.smithi067.rdualw (mgr.24569) 3830 : cluster [DBG] pgmap v3302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:53.842136+0000 mgr.smithi067.rdualw (mgr.24569) 3830 : cluster [DBG] pgmap v3302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:55.842913+0000 mgr.smithi067.rdualw (mgr.24569) 3831 : cluster [DBG] pgmap v3303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:18:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:55.842913+0000 mgr.smithi067.rdualw (mgr.24569) 3831 : cluster [DBG] pgmap v3303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:18:59.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:18:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:57.843475+0000 mgr.smithi067.rdualw (mgr.24569) 3832 : cluster [DBG] pgmap v3304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:18:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:57.843475+0000 mgr.smithi067.rdualw (mgr.24569) 3832 : cluster [DBG] pgmap v3304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:18:59.831 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:19:00.121 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:19:00.281 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (116m) 6m ago 117m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:19:00.282 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (109m) 6m ago 117m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:19:00.282 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (109m) 6m ago 117m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:19:00.283 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (116m) 6m ago 117m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:19:00.283 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (109m) 6m ago 113m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:19:00.283 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (109m) 6m ago 113m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:19:00.283 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (110m) 6m ago 118m 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:19:00.284 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (110m) 6m ago 117m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:19:00.284 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (110m) 6m ago 118m 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:19:00.285 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (109m) 6m ago 116m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:19:00.285 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (110m) 6m ago 110m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:19:00.286 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (110m) 6m ago 110m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:19:00.286 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (117m) 6m ago 117m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:19:00.286 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (116m) 6m ago 116m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:19:00.286 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (100m) 6m ago 116m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:19:00.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (116m) 6m ago 116m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:19:00.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (115m) 6m ago 115m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:19:00.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (115m) 6m ago 115m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:19:00.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (115m) 6m ago 115m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:19:00.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (115m) 6m ago 115m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:19:00.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (114m) 6m ago 114m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:19:00.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (114m) 6m ago 114m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:19:00.288 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (116m) 6m ago 117m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:19:00.466 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:19:00.466 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:19:00.467 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:19:00.467 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:19:00.467 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:19:00.467 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:19:00.467 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:19:00.468 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:19:00.468 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:19:00.468 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:19:00.468 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:19:00.469 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:19:00.469 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:19:00.469 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:19:00.469 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:19:00.470 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:19:00.470 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:19:00.470 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:19:00.470 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:19:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:18:59.813880+0000 mgr.smithi067.rdualw (mgr.24569) 3833 : audit [DBG] from='client.36694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:19:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:18:59.844025+0000 mgr.smithi067.rdualw (mgr.24569) 3834 : cluster [DBG] pgmap v3305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:01.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:19:00.464600+0000 mon.smithi061 (mon.0) 943 : audit [DBG] from='client.? 172.21.15.61:0/2125528212' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:19:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:18:59.813880+0000 mgr.smithi067.rdualw (mgr.24569) 3833 : audit [DBG] from='client.36694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:19:01.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:18:59.844025+0000 mgr.smithi067.rdualw (mgr.24569) 3834 : cluster [DBG] pgmap v3305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:01.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:19:00.464600+0000 mon.smithi061 (mon.0) 943 : audit [DBG] from='client.? 172.21.15.61:0/2125528212' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:19:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:19:00.102918+0000 mgr.smithi067.rdualw (mgr.24569) 3835 : audit [DBG] from='client.36698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:19:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:19:00.102918+0000 mgr.smithi067.rdualw (mgr.24569) 3835 : audit [DBG] from='client.36698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:19:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:01.845119+0000 mgr.smithi067.rdualw (mgr.24569) 3836 : cluster [DBG] pgmap v3306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:01.845119+0000 mgr.smithi067.rdualw (mgr.24569) 3836 : cluster [DBG] pgmap v3306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:03.845780+0000 mgr.smithi067.rdualw (mgr.24569) 3837 : cluster [DBG] pgmap v3307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:03.845780+0000 mgr.smithi067.rdualw (mgr.24569) 3837 : cluster [DBG] pgmap v3307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:05.846617+0000 mgr.smithi067.rdualw (mgr.24569) 3838 : cluster [DBG] pgmap v3308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:19:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:05.846617+0000 mgr.smithi067.rdualw (mgr.24569) 3838 : cluster [DBG] pgmap v3308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:19:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:07.847158+0000 mgr.smithi067.rdualw (mgr.24569) 3839 : cluster [DBG] pgmap v3309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:09.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:07.847158+0000 mgr.smithi067.rdualw (mgr.24569) 3839 : cluster [DBG] pgmap v3309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:09.847698+0000 mgr.smithi067.rdualw (mgr.24569) 3840 : cluster [DBG] pgmap v3310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:09.847698+0000 mgr.smithi067.rdualw (mgr.24569) 3840 : cluster [DBG] pgmap v3310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:11.848824+0000 mgr.smithi067.rdualw (mgr.24569) 3841 : cluster [DBG] pgmap v3311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:11.848824+0000 mgr.smithi067.rdualw (mgr.24569) 3841 : cluster [DBG] pgmap v3311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:13.849392+0000 mgr.smithi067.rdualw (mgr.24569) 3842 : cluster [DBG] pgmap v3312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:13.849392+0000 mgr.smithi067.rdualw (mgr.24569) 3842 : cluster [DBG] pgmap v3312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:15.850361+0000 mgr.smithi067.rdualw (mgr.24569) 3843 : cluster [DBG] pgmap v3313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:19:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:15.850361+0000 mgr.smithi067.rdualw (mgr.24569) 3843 : cluster [DBG] pgmap v3313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:19:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:17.851022+0000 mgr.smithi067.rdualw (mgr.24569) 3844 : cluster [DBG] pgmap v3314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:17.851022+0000 mgr.smithi067.rdualw (mgr.24569) 3844 : cluster [DBG] pgmap v3314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:19.851867+0000 mgr.smithi067.rdualw (mgr.24569) 3845 : cluster [DBG] pgmap v3315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:19.851867+0000 mgr.smithi067.rdualw (mgr.24569) 3845 : cluster [DBG] pgmap v3315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:21.852829+0000 mgr.smithi067.rdualw (mgr.24569) 3846 : cluster [DBG] pgmap v3316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:21.852829+0000 mgr.smithi067.rdualw (mgr.24569) 3846 : cluster [DBG] pgmap v3316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:23.853417+0000 mgr.smithi067.rdualw (mgr.24569) 3847 : cluster [DBG] pgmap v3317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:23.853417+0000 mgr.smithi067.rdualw (mgr.24569) 3847 : cluster [DBG] pgmap v3317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:25.854337+0000 mgr.smithi067.rdualw (mgr.24569) 3848 : cluster [DBG] pgmap v3318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:19:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:25.854337+0000 mgr.smithi067.rdualw (mgr.24569) 3848 : cluster [DBG] pgmap v3318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:19:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:27.854977+0000 mgr.smithi067.rdualw (mgr.24569) 3849 : cluster [DBG] pgmap v3319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:27.854977+0000 mgr.smithi067.rdualw (mgr.24569) 3849 : cluster [DBG] pgmap v3319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:19:29.777722+0000 mon.smithi067 (mon.1) 610 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:19:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:19:29.779094+0000 mon.smithi067 (mon.1) 611 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:19:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:19:29.780019+0000 mon.smithi067 (mon.1) 612 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:19:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:19:29.777722+0000 mon.smithi067 (mon.1) 610 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:19:30.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:19:29.779094+0000 mon.smithi067 (mon.1) 611 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:19:30.444 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:19:29.780019+0000 mon.smithi067 (mon.1) 612 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:19:30.798 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:19:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:19:29.780821+0000 mgr.smithi067.rdualw (mgr.24569) 3850 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:19:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:29.855524+0000 mgr.smithi067.rdualw (mgr.24569) 3851 : cluster [DBG] pgmap v3320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:19:30.239839+0000 mon.smithi061 (mon.0) 944 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:19:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:19:30.253882+0000 mon.smithi061 (mon.0) 945 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:19:31.091 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:19:31.091 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (117m) 7m ago 118m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:19:31.092 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (109m) 7m ago 118m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:19:31.092 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (109m) 7m ago 117m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:19:31.092 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (116m) 7m ago 117m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:19:31.092 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (110m) 7m ago 113m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:19:31.092 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (109m) 7m ago 113m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:19:31.093 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (111m) 7m ago 119m 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:19:31.093 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (110m) 7m ago 117m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:19:31.093 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (110m) 7m ago 119m 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:19:31.093 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (110m) 7m ago 117m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:19:31.094 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (111m) 7m ago 111m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:19:31.094 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (111m) 7m ago 111m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:19:31.094 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (117m) 7m ago 117m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:19:31.094 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (117m) 7m ago 117m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:19:31.095 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (100m) 7m ago 116m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:19:31.095 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (116m) 7m ago 116m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:19:31.095 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (116m) 7m ago 116m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:19:31.095 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (116m) 7m ago 116m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:19:31.095 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (115m) 7m ago 115m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:19:31.096 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (115m) 7m ago 115m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:19:31.096 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (115m) 7m ago 115m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:19:31.096 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (115m) 7m ago 115m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:19:31.096 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (116m) 7m ago 117m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:19:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:19:29.780821+0000 mgr.smithi067.rdualw (mgr.24569) 3850 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:19:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:29.855524+0000 mgr.smithi067.rdualw (mgr.24569) 3851 : cluster [DBG] pgmap v3320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:19:30.239839+0000 mon.smithi061 (mon.0) 944 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:19:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:19:30.253882+0000 mon.smithi061 (mon.0) 945 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:19:31.431 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:19:31.431 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:19:31.432 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:19:31.432 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:19:31.432 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:19:31.432 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:19:31.432 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:19:31.433 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:19:31.433 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:19:31.433 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:19:31.433 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:19:31.434 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:19:31.434 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:19:31.434 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:19:31.434 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:19:31.435 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:19:31.435 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:19:31.435 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:19:31.435 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:19:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:19:30.783549+0000 mgr.smithi067.rdualw (mgr.24569) 3852 : audit [DBG] from='client.36706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:19:32.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:19:31.429723+0000 mon.smithi061 (mon.0) 946 : audit [DBG] from='client.? 172.21.15.61:0/2560704057' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:19:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:19:30.783549+0000 mgr.smithi067.rdualw (mgr.24569) 3852 : audit [DBG] from='client.36706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:19:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:19:31.429723+0000 mon.smithi061 (mon.0) 946 : audit [DBG] from='client.? 172.21.15.61:0/2560704057' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:19:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:19:31.073600+0000 mgr.smithi067.rdualw (mgr.24569) 3853 : audit [DBG] from='client.36710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:19:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:31.856380+0000 mgr.smithi067.rdualw (mgr.24569) 3854 : cluster [DBG] pgmap v3321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:19:31.073600+0000 mgr.smithi067.rdualw (mgr.24569) 3853 : audit [DBG] from='client.36710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:19:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:31.856380+0000 mgr.smithi067.rdualw (mgr.24569) 3854 : cluster [DBG] pgmap v3321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:33.857102+0000 mgr.smithi067.rdualw (mgr.24569) 3855 : cluster [DBG] pgmap v3322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:33.857102+0000 mgr.smithi067.rdualw (mgr.24569) 3855 : cluster [DBG] pgmap v3322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:19:35.023653+0000 mon.smithi067 (mon.1) 613 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:19:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:19:35.023887+0000 mon.smithi067 (mon.1) 614 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:19:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:19:35.024045+0000 mon.smithi061 (mon.0) 947 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:19:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:19:35.024354+0000 mon.smithi061 (mon.0) 948 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:19:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:19:35.023653+0000 mon.smithi067 (mon.1) 613 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:19:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:19:35.023887+0000 mon.smithi067 (mon.1) 614 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:19:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:19:35.024045+0000 mon.smithi061 (mon.0) 947 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:19:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:19:35.024354+0000 mon.smithi061 (mon.0) 948 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:19:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:35.858109+0000 mgr.smithi067.rdualw (mgr.24569) 3856 : cluster [DBG] pgmap v3323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:19:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:35.858109+0000 mgr.smithi067.rdualw (mgr.24569) 3856 : cluster [DBG] pgmap v3323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:19:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:37.858521+0000 mgr.smithi067.rdualw (mgr.24569) 3857 : cluster [DBG] pgmap v3324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:37.858521+0000 mgr.smithi067.rdualw (mgr.24569) 3857 : cluster [DBG] pgmap v3324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:39.859296+0000 mgr.smithi067.rdualw (mgr.24569) 3858 : cluster [DBG] pgmap v3325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:39.859296+0000 mgr.smithi067.rdualw (mgr.24569) 3858 : cluster [DBG] pgmap v3325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:41.860195+0000 mgr.smithi067.rdualw (mgr.24569) 3859 : cluster [DBG] pgmap v3326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:41.860195+0000 mgr.smithi067.rdualw (mgr.24569) 3859 : cluster [DBG] pgmap v3326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:43.860885+0000 mgr.smithi067.rdualw (mgr.24569) 3860 : cluster [DBG] pgmap v3327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:43.860885+0000 mgr.smithi067.rdualw (mgr.24569) 3860 : cluster [DBG] pgmap v3327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:45.861730+0000 mgr.smithi067.rdualw (mgr.24569) 3861 : cluster [DBG] pgmap v3328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:19:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:45.861730+0000 mgr.smithi067.rdualw (mgr.24569) 3861 : cluster [DBG] pgmap v3328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:19:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:47.862302+0000 mgr.smithi067.rdualw (mgr.24569) 3862 : cluster [DBG] pgmap v3329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:47.862302+0000 mgr.smithi067.rdualw (mgr.24569) 3862 : cluster [DBG] pgmap v3329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:49.863049+0000 mgr.smithi067.rdualw (mgr.24569) 3863 : cluster [DBG] pgmap v3330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:49.863049+0000 mgr.smithi067.rdualw (mgr.24569) 3863 : cluster [DBG] pgmap v3330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:51.863979+0000 mgr.smithi067.rdualw (mgr.24569) 3864 : cluster [DBG] pgmap v3331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:51.863979+0000 mgr.smithi067.rdualw (mgr.24569) 3864 : cluster [DBG] pgmap v3331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:53.864597+0000 mgr.smithi067.rdualw (mgr.24569) 3865 : cluster [DBG] pgmap v3332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:53.864597+0000 mgr.smithi067.rdualw (mgr.24569) 3865 : cluster [DBG] pgmap v3332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:55.865531+0000 mgr.smithi067.rdualw (mgr.24569) 3866 : cluster [DBG] pgmap v3333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:19:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:55.865531+0000 mgr.smithi067.rdualw (mgr.24569) 3866 : cluster [DBG] pgmap v3333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:19:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:19:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:57.866105+0000 mgr.smithi067.rdualw (mgr.24569) 3867 : cluster [DBG] pgmap v3334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:19:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:19:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:57.866105+0000 mgr.smithi067.rdualw (mgr.24569) 3867 : cluster [DBG] pgmap v3334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:19:59.866679+0000 mgr.smithi067.rdualw (mgr.24569) 3868 : cluster [DBG] pgmap v3335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:01.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:00.000097+0000 mon.smithi061 (mon.0) 949 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T17:20:01.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:19:59.866679+0000 mgr.smithi067.rdualw (mgr.24569) 3868 : cluster [DBG] pgmap v3335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:01.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:00.000097+0000 mon.smithi061 (mon.0) 949 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T17:20:01.743 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:20:02.059 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:20:02.059 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (117m) 7m ago 118m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:20:02.060 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (110m) 7m ago 118m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:20:02.060 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (110m) 7m ago 118m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:20:02.060 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (117m) 7m ago 118m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:20:02.060 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (110m) 7m ago 114m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:20:02.061 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (110m) 7m ago 114m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:20:02.061 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (111m) 7m ago 119m 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:20:02.061 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (111m) 7m ago 118m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:20:02.061 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (111m) 7m ago 119m 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:20:02.062 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (111m) 7m ago 117m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:20:02.062 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (111m) 7m ago 111m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:20:02.063 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (111m) 7m ago 111m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:20:02.063 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (118m) 7m ago 118m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:20:02.064 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (117m) 7m ago 117m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:20:02.064 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (101m) 7m ago 117m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:20:02.064 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (117m) 7m ago 117m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:20:02.065 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (116m) 7m ago 116m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:20:02.065 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (116m) 7m ago 116m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:20:02.065 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (116m) 7m ago 116m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:20:02.065 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (116m) 7m ago 116m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:20:02.065 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (115m) 7m ago 115m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:20:02.066 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (115m) 7m ago 115m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:20:02.066 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (117m) 7m ago 118m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:20:02.402 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:20:02.402 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:20:02.402 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:20:02.403 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:20:02.403 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:20:02.403 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:20:02.403 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:20:02.404 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:20:02.404 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:20:02.404 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:20:02.404 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:20:02.404 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:20:02.405 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:20:02.405 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:20:02.405 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:20:02.405 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:20:02.406 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:20:02.406 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:20:02.406 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:20:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:20:01.729717+0000 mgr.smithi067.rdualw (mgr.24569) 3869 : audit [DBG] from='client.36718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:20:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:01.867493+0000 mgr.smithi067.rdualw (mgr.24569) 3870 : cluster [DBG] pgmap v3336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:03.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:20:02.400521+0000 mon.smithi061 (mon.0) 950 : audit [DBG] from='client.? 172.21.15.61:0/724317544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:20:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:20:01.729717+0000 mgr.smithi067.rdualw (mgr.24569) 3869 : audit [DBG] from='client.36718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:20:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:01.867493+0000 mgr.smithi067.rdualw (mgr.24569) 3870 : cluster [DBG] pgmap v3336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:03.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:20:02.400521+0000 mon.smithi061 (mon.0) 950 : audit [DBG] from='client.? 172.21.15.61:0/724317544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:20:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:20:02.040668+0000 mgr.smithi067.rdualw (mgr.24569) 3871 : audit [DBG] from='client.36722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:20:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:20:02.040668+0000 mgr.smithi067.rdualw (mgr.24569) 3871 : audit [DBG] from='client.36722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:20:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:03.868224+0000 mgr.smithi067.rdualw (mgr.24569) 3872 : cluster [DBG] pgmap v3337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:03.868224+0000 mgr.smithi067.rdualw (mgr.24569) 3872 : cluster [DBG] pgmap v3337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:05.869221+0000 mgr.smithi067.rdualw (mgr.24569) 3873 : cluster [DBG] pgmap v3338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:20:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:05.869221+0000 mgr.smithi067.rdualw (mgr.24569) 3873 : cluster [DBG] pgmap v3338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:20:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:07.869907+0000 mgr.smithi067.rdualw (mgr.24569) 3874 : cluster [DBG] pgmap v3339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:07.869907+0000 mgr.smithi067.rdualw (mgr.24569) 3874 : cluster [DBG] pgmap v3339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:09.870556+0000 mgr.smithi067.rdualw (mgr.24569) 3875 : cluster [DBG] pgmap v3340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:09.870556+0000 mgr.smithi067.rdualw (mgr.24569) 3875 : cluster [DBG] pgmap v3340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:11.871572+0000 mgr.smithi067.rdualw (mgr.24569) 3876 : cluster [DBG] pgmap v3341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:11.871572+0000 mgr.smithi067.rdualw (mgr.24569) 3876 : cluster [DBG] pgmap v3341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:13.872241+0000 mgr.smithi067.rdualw (mgr.24569) 3877 : cluster [DBG] pgmap v3342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:13.872241+0000 mgr.smithi067.rdualw (mgr.24569) 3877 : cluster [DBG] pgmap v3342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:15.873083+0000 mgr.smithi067.rdualw (mgr.24569) 3878 : cluster [DBG] pgmap v3343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:20:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:15.873083+0000 mgr.smithi067.rdualw (mgr.24569) 3878 : cluster [DBG] pgmap v3343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:20:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:17.873655+0000 mgr.smithi067.rdualw (mgr.24569) 3879 : cluster [DBG] pgmap v3344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:17.873655+0000 mgr.smithi067.rdualw (mgr.24569) 3879 : cluster [DBG] pgmap v3344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:19.874251+0000 mgr.smithi067.rdualw (mgr.24569) 3880 : cluster [DBG] pgmap v3345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:21.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:19.874251+0000 mgr.smithi067.rdualw (mgr.24569) 3880 : cluster [DBG] pgmap v3345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:21.875103+0000 mgr.smithi067.rdualw (mgr.24569) 3881 : cluster [DBG] pgmap v3346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:21.875103+0000 mgr.smithi067.rdualw (mgr.24569) 3881 : cluster [DBG] pgmap v3346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:23.875728+0000 mgr.smithi067.rdualw (mgr.24569) 3882 : cluster [DBG] pgmap v3347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:23.875728+0000 mgr.smithi067.rdualw (mgr.24569) 3882 : cluster [DBG] pgmap v3347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:25.876747+0000 mgr.smithi067.rdualw (mgr.24569) 3883 : cluster [DBG] pgmap v3348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:20:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:25.876747+0000 mgr.smithi067.rdualw (mgr.24569) 3883 : cluster [DBG] pgmap v3348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:20:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:27.877336+0000 mgr.smithi067.rdualw (mgr.24569) 3884 : cluster [DBG] pgmap v3349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:27.877336+0000 mgr.smithi067.rdualw (mgr.24569) 3884 : cluster [DBG] pgmap v3349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:29.878048+0000 mgr.smithi067.rdualw (mgr.24569) 3885 : cluster [DBG] pgmap v3350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:20:30.259330+0000 mon.smithi067 (mon.1) 615 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:20:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:20:30.260759+0000 mon.smithi067 (mon.1) 616 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:20:31.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:20:30.261651+0000 mon.smithi067 (mon.1) 617 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:20:31.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:20:30.678118+0000 mon.smithi061 (mon.0) 951 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:20:31.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:20:30.683289+0000 mon.smithi061 (mon.0) 952 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:20:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:29.878048+0000 mgr.smithi067.rdualw (mgr.24569) 3885 : cluster [DBG] pgmap v3350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:20:30.259330+0000 mon.smithi067 (mon.1) 615 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:20:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:20:30.260759+0000 mon.smithi067 (mon.1) 616 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:20:31.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:20:30.261651+0000 mon.smithi067 (mon.1) 617 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:20:31.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:20:30.678118+0000 mon.smithi061 (mon.0) 951 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:20:31.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:20:30.683289+0000 mon.smithi061 (mon.0) 952 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:20:32.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:20:30.262453+0000 mgr.smithi067.rdualw (mgr.24569) 3886 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:20:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:20:30.262453+0000 mgr.smithi067.rdualw (mgr.24569) 3886 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:20:32.707 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:20:33.046 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:20:33.047 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (118m) 8m ago 119m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:20:33.047 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (110m) 8m ago 119m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:20:33.047 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (110m) 8m ago 118m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:20:33.047 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (117m) 8m ago 118m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:20:33.048 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (111m) 8m ago 114m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:20:33.048 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (111m) 8m ago 114m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:20:33.048 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (112m) 8m ago 2h 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:20:33.048 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (111m) 8m ago 118m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:20:33.048 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (111m) 8m ago 2h 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:20:33.049 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (111m) 8m ago 118m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:20:33.049 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (112m) 8m ago 112m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:20:33.049 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (112m) 8m ago 112m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:20:33.049 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (118m) 8m ago 118m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:20:33.049 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (118m) 8m ago 118m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:20:33.050 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (101m) 8m ago 118m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:20:33.050 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (117m) 8m ago 117m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:20:33.050 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (117m) 8m ago 117m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:20:33.050 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (117m) 8m ago 117m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:20:33.051 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (116m) 8m ago 116m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:20:33.051 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (116m) 8m ago 116m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:20:33.051 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (116m) 8m ago 116m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:20:33.051 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (116m) 8m ago 116m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:20:33.051 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (117m) 8m ago 118m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:20:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:31.879083+0000 mgr.smithi067.rdualw (mgr.24569) 3887 : cluster [DBG] pgmap v3351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:31.879083+0000 mgr.smithi067.rdualw (mgr.24569) 3887 : cluster [DBG] pgmap v3351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:33.467 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:20:33.467 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:20:33.468 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:20:33.468 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:20:33.468 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:20:33.468 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:20:33.469 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:20:33.469 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:20:33.469 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:20:33.469 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:20:33.470 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:20:33.470 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:20:33.470 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:20:33.470 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:20:33.471 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:20:33.471 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:20:33.471 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:20:33.472 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:20:33.472 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:20:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:20:32.693300+0000 mgr.smithi067.rdualw (mgr.24569) 3888 : audit [DBG] from='client.36730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:20:34.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:20:33.028506+0000 mgr.smithi067.rdualw (mgr.24569) 3889 : audit [DBG] from='client.36734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:20:34.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:20:33.465771+0000 mon.smithi061 (mon.0) 953 : audit [DBG] from='client.? 172.21.15.61:0/4019345637' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:20:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:20:32.693300+0000 mgr.smithi067.rdualw (mgr.24569) 3888 : audit [DBG] from='client.36730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:20:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:20:33.028506+0000 mgr.smithi067.rdualw (mgr.24569) 3889 : audit [DBG] from='client.36734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:20:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:20:33.465771+0000 mon.smithi061 (mon.0) 953 : audit [DBG] from='client.? 172.21.15.61:0/4019345637' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:20:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:33.879892+0000 mgr.smithi067.rdualw (mgr.24569) 3890 : cluster [DBG] pgmap v3352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:33.879892+0000 mgr.smithi067.rdualw (mgr.24569) 3890 : cluster [DBG] pgmap v3352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:20:35.029720+0000 mon.smithi067 (mon.1) 618 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:20:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:20:35.029947+0000 mon.smithi061 (mon.0) 954 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:20:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:20:35.029972+0000 mon.smithi067 (mon.1) 619 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:20:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:20:35.030282+0000 mon.smithi061 (mon.0) 955 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:20:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:20:35.029720+0000 mon.smithi067 (mon.1) 618 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:20:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:20:35.029947+0000 mon.smithi061 (mon.0) 954 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:20:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:20:35.029972+0000 mon.smithi067 (mon.1) 619 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:20:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:20:35.030282+0000 mon.smithi061 (mon.0) 955 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:20:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:35.880767+0000 mgr.smithi067.rdualw (mgr.24569) 3891 : cluster [DBG] pgmap v3353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:20:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:35.880767+0000 mgr.smithi067.rdualw (mgr.24569) 3891 : cluster [DBG] pgmap v3353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:20:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:37.881367+0000 mgr.smithi067.rdualw (mgr.24569) 3892 : cluster [DBG] pgmap v3354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:37.881367+0000 mgr.smithi067.rdualw (mgr.24569) 3892 : cluster [DBG] pgmap v3354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:39.882226+0000 mgr.smithi067.rdualw (mgr.24569) 3893 : cluster [DBG] pgmap v3355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:39.882226+0000 mgr.smithi067.rdualw (mgr.24569) 3893 : cluster [DBG] pgmap v3355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:41.883298+0000 mgr.smithi067.rdualw (mgr.24569) 3894 : cluster [DBG] pgmap v3356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:41.883298+0000 mgr.smithi067.rdualw (mgr.24569) 3894 : cluster [DBG] pgmap v3356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:43.883914+0000 mgr.smithi067.rdualw (mgr.24569) 3895 : cluster [DBG] pgmap v3357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:43.883914+0000 mgr.smithi067.rdualw (mgr.24569) 3895 : cluster [DBG] pgmap v3357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:45.884807+0000 mgr.smithi067.rdualw (mgr.24569) 3896 : cluster [DBG] pgmap v3358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:20:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:45.884807+0000 mgr.smithi067.rdualw (mgr.24569) 3896 : cluster [DBG] pgmap v3358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:20:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:47.885401+0000 mgr.smithi067.rdualw (mgr.24569) 3897 : cluster [DBG] pgmap v3359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:47.885401+0000 mgr.smithi067.rdualw (mgr.24569) 3897 : cluster [DBG] pgmap v3359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:49.886190+0000 mgr.smithi067.rdualw (mgr.24569) 3898 : cluster [DBG] pgmap v3360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:51.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:49.886190+0000 mgr.smithi067.rdualw (mgr.24569) 3898 : cluster [DBG] pgmap v3360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:51.887194+0000 mgr.smithi067.rdualw (mgr.24569) 3899 : cluster [DBG] pgmap v3361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:51.887194+0000 mgr.smithi067.rdualw (mgr.24569) 3899 : cluster [DBG] pgmap v3361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:53.887764+0000 mgr.smithi067.rdualw (mgr.24569) 3900 : cluster [DBG] pgmap v3362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:53.887764+0000 mgr.smithi067.rdualw (mgr.24569) 3900 : cluster [DBG] pgmap v3362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:55.888562+0000 mgr.smithi067.rdualw (mgr.24569) 3901 : cluster [DBG] pgmap v3363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:20:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:55.888562+0000 mgr.smithi067.rdualw (mgr.24569) 3901 : cluster [DBG] pgmap v3363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:20:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:20:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:57.889174+0000 mgr.smithi067.rdualw (mgr.24569) 3902 : cluster [DBG] pgmap v3364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:20:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:20:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:57.889174+0000 mgr.smithi067.rdualw (mgr.24569) 3902 : cluster [DBG] pgmap v3364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:20:59.889916+0000 mgr.smithi067.rdualw (mgr.24569) 3903 : cluster [DBG] pgmap v3365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:20:59.889916+0000 mgr.smithi067.rdualw (mgr.24569) 3903 : cluster [DBG] pgmap v3365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:01.890861+0000 mgr.smithi067.rdualw (mgr.24569) 3904 : cluster [DBG] pgmap v3366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:01.890861+0000 mgr.smithi067.rdualw (mgr.24569) 3904 : cluster [DBG] pgmap v3366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:03.779 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:21:04.074 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:21:04.074 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (118m) 8m ago 119m 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:21:04.074 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (111m) 8m ago 119m 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:21:04.075 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (111m) 8m ago 119m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:21:04.075 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (118m) 8m ago 119m 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:21:04.075 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (111m) 8m ago 115m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:21:04.075 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (111m) 8m ago 115m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:21:04.076 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (112m) 8m ago 2h 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:21:04.076 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (112m) 8m ago 119m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:21:04.076 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (112m) 8m ago 2h 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:21:04.076 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (112m) 8m ago 118m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:21:04.076 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (113m) 8m ago 113m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:21:04.077 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (112m) 8m ago 112m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:21:04.077 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (119m) 8m ago 119m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:21:04.077 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (118m) 8m ago 118m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:21:04.077 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (102m) 8m ago 118m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:21:04.078 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (118m) 8m ago 118m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:21:04.078 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (117m) 8m ago 117m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:21:04.078 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (117m) 8m ago 117m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:21:04.078 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (117m) 8m ago 117m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:21:04.078 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (117m) 8m ago 117m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:21:04.079 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (116m) 8m ago 116m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:21:04.079 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (116m) 8m ago 116m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:21:04.079 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (118m) 8m ago 119m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:21:04.414 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:21:04.414 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:21:04.414 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:21:04.415 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:21:04.415 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:21:04.415 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:21:04.415 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:21:04.416 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:21:04.416 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:21:04.416 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:21:04.416 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:21:04.416 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:21:04.417 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:21:04.417 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:21:04.417 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:21:04.417 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:21:04.418 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:21:04.418 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:21:04.418 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:21:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:21:03.765660+0000 mgr.smithi067.rdualw (mgr.24569) 3905 : audit [DBG] from='client.36742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:21:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:03.891471+0000 mgr.smithi067.rdualw (mgr.24569) 3906 : cluster [DBG] pgmap v3367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:21:04.412438+0000 mon.smithi061 (mon.0) 956 : audit [DBG] from='client.? 172.21.15.61:0/95857938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:21:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:21:03.765660+0000 mgr.smithi067.rdualw (mgr.24569) 3905 : audit [DBG] from='client.36742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:21:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:03.891471+0000 mgr.smithi067.rdualw (mgr.24569) 3906 : cluster [DBG] pgmap v3367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:21:04.412438+0000 mon.smithi061 (mon.0) 956 : audit [DBG] from='client.? 172.21.15.61:0/95857938' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:21:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:21:04.056265+0000 mgr.smithi067.rdualw (mgr.24569) 3907 : audit [DBG] from='client.36746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:21:06.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:21:04.056265+0000 mgr.smithi067.rdualw (mgr.24569) 3907 : audit [DBG] from='client.36746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:21:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:05.892390+0000 mgr.smithi067.rdualw (mgr.24569) 3908 : cluster [DBG] pgmap v3368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:21:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:05.892390+0000 mgr.smithi067.rdualw (mgr.24569) 3908 : cluster [DBG] pgmap v3368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:21:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:07.893010+0000 mgr.smithi067.rdualw (mgr.24569) 3909 : cluster [DBG] pgmap v3369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:07.893010+0000 mgr.smithi067.rdualw (mgr.24569) 3909 : cluster [DBG] pgmap v3369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:09.893648+0000 mgr.smithi067.rdualw (mgr.24569) 3910 : cluster [DBG] pgmap v3370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:09.893648+0000 mgr.smithi067.rdualw (mgr.24569) 3910 : cluster [DBG] pgmap v3370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:11.894448+0000 mgr.smithi067.rdualw (mgr.24569) 3911 : cluster [DBG] pgmap v3371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:11.894448+0000 mgr.smithi067.rdualw (mgr.24569) 3911 : cluster [DBG] pgmap v3371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:13.895027+0000 mgr.smithi067.rdualw (mgr.24569) 3912 : cluster [DBG] pgmap v3372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:13.895027+0000 mgr.smithi067.rdualw (mgr.24569) 3912 : cluster [DBG] pgmap v3372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:15.896090+0000 mgr.smithi067.rdualw (mgr.24569) 3913 : cluster [DBG] pgmap v3373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:21:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:15.896090+0000 mgr.smithi067.rdualw (mgr.24569) 3913 : cluster [DBG] pgmap v3373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:21:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:17.896782+0000 mgr.smithi067.rdualw (mgr.24569) 3914 : cluster [DBG] pgmap v3374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:17.896782+0000 mgr.smithi067.rdualw (mgr.24569) 3914 : cluster [DBG] pgmap v3374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:19.897344+0000 mgr.smithi067.rdualw (mgr.24569) 3915 : cluster [DBG] pgmap v3375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:21.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:19.897344+0000 mgr.smithi067.rdualw (mgr.24569) 3915 : cluster [DBG] pgmap v3375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:21.898407+0000 mgr.smithi067.rdualw (mgr.24569) 3916 : cluster [DBG] pgmap v3376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:21.898407+0000 mgr.smithi067.rdualw (mgr.24569) 3916 : cluster [DBG] pgmap v3376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:23.898950+0000 mgr.smithi067.rdualw (mgr.24569) 3917 : cluster [DBG] pgmap v3377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:23.898950+0000 mgr.smithi067.rdualw (mgr.24569) 3917 : cluster [DBG] pgmap v3377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:25.899880+0000 mgr.smithi067.rdualw (mgr.24569) 3918 : cluster [DBG] pgmap v3378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:21:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:25.899880+0000 mgr.smithi067.rdualw (mgr.24569) 3918 : cluster [DBG] pgmap v3378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:21:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:27.900332+0000 mgr.smithi067.rdualw (mgr.24569) 3919 : cluster [DBG] pgmap v3379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:27.900332+0000 mgr.smithi067.rdualw (mgr.24569) 3919 : cluster [DBG] pgmap v3379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:31.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:29.900937+0000 mgr.smithi067.rdualw (mgr.24569) 3920 : cluster [DBG] pgmap v3380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:31.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:21:30.687006+0000 mon.smithi067 (mon.1) 620 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:21:31.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:21:30.688440+0000 mon.smithi067 (mon.1) 621 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:21:31.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:21:30.689354+0000 mon.smithi067 (mon.1) 622 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:21:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:29.900937+0000 mgr.smithi067.rdualw (mgr.24569) 3920 : cluster [DBG] pgmap v3380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:21:30.687006+0000 mon.smithi067 (mon.1) 620 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:21:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:21:30.688440+0000 mon.smithi067 (mon.1) 621 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:21:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:21:30.689354+0000 mon.smithi067 (mon.1) 622 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:21:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:21:30.690192+0000 mgr.smithi067.rdualw (mgr.24569) 3921 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:21:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:21:31.110721+0000 mon.smithi061 (mon.0) 957 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:21:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:21:31.116982+0000 mon.smithi061 (mon.0) 958 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:21:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:21:30.690192+0000 mgr.smithi067.rdualw (mgr.24569) 3921 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:21:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:21:31.110721+0000 mon.smithi061 (mon.0) 957 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:21:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:21:31.116982+0000 mon.smithi061 (mon.0) 958 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:21:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:31.901777+0000 mgr.smithi067.rdualw (mgr.24569) 3922 : cluster [DBG] pgmap v3381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:31.901777+0000 mgr.smithi067.rdualw (mgr.24569) 3922 : cluster [DBG] pgmap v3381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:34.720 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:21:35.020 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:21:35.020 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (119m) 9m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:21:35.021 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (111m) 9m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:21:35.021 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (111m) 9m ago 119m 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:21:35.021 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (118m) 9m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:21:35.022 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (112m) 9m ago 115m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:21:35.022 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (112m) 9m ago 115m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:21:35.022 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (113m) 9m ago 2h 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:21:35.022 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (112m) 9m ago 119m 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:21:35.023 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (112m) 9m ago 2h 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:21:35.023 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (112m) 9m ago 119m 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:21:35.023 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (113m) 9m ago 113m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:21:35.023 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (113m) 9m ago 113m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:21:35.024 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (119m) 9m ago 119m 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:21:35.024 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (119m) 9m ago 119m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:21:35.024 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (102m) 9m ago 119m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:21:35.024 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (118m) 9m ago 118m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:21:35.024 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (118m) 9m ago 118m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:21:35.025 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (118m) 9m ago 118m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:21:35.025 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (117m) 9m ago 117m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:21:35.025 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (117m) 9m ago 117m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:21:35.025 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (117m) 9m ago 117m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:21:35.025 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (117m) 9m ago 117m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:21:35.026 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (118m) 9m ago 119m 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:21:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:33.902310+0000 mgr.smithi067.rdualw (mgr.24569) 3923 : cluster [DBG] pgmap v3382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:33.902310+0000 mgr.smithi067.rdualw (mgr.24569) 3923 : cluster [DBG] pgmap v3382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:35.362 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:21:35.363 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:21:35.363 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:21:35.364 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:21:35.364 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:21:35.364 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:21:35.365 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:21:35.365 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:21:35.366 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:21:35.366 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:21:35.367 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:21:35.367 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:21:35.367 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:21:35.368 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:21:35.368 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:21:35.369 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:21:35.369 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:21:35.370 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:21:35.370 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:21:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:21:34.707671+0000 mgr.smithi067.rdualw (mgr.24569) 3924 : audit [DBG] from='client.36754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:21:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:21:35.002275+0000 mgr.smithi067.rdualw (mgr.24569) 3925 : audit [DBG] from='client.36758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:21:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:21:35.035687+0000 mon.smithi067 (mon.1) 623 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:21:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:21:35.035939+0000 mon.smithi067 (mon.1) 624 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:21:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:21:35.036010+0000 mon.smithi061 (mon.0) 959 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:21:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:21:35.036347+0000 mon.smithi061 (mon.0) 960 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:21:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:21:35.360664+0000 mon.smithi061 (mon.0) 961 : audit [DBG] from='client.? 172.21.15.61:0/3391385203' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:21:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:21:34.707671+0000 mgr.smithi067.rdualw (mgr.24569) 3924 : audit [DBG] from='client.36754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:21:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:21:35.002275+0000 mgr.smithi067.rdualw (mgr.24569) 3925 : audit [DBG] from='client.36758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:21:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:21:35.035687+0000 mon.smithi067 (mon.1) 623 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:21:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:21:35.035939+0000 mon.smithi067 (mon.1) 624 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:21:36.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:21:35.036010+0000 mon.smithi061 (mon.0) 959 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:21:36.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:21:35.036347+0000 mon.smithi061 (mon.0) 960 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:21:36.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:21:35.360664+0000 mon.smithi061 (mon.0) 961 : audit [DBG] from='client.? 172.21.15.61:0/3391385203' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:21:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:35.903206+0000 mgr.smithi067.rdualw (mgr.24569) 3926 : cluster [DBG] pgmap v3383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:21:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:35.903206+0000 mgr.smithi067.rdualw (mgr.24569) 3926 : cluster [DBG] pgmap v3383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:21:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:37.903940+0000 mgr.smithi067.rdualw (mgr.24569) 3927 : cluster [DBG] pgmap v3384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:37.903940+0000 mgr.smithi067.rdualw (mgr.24569) 3927 : cluster [DBG] pgmap v3384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:39.904582+0000 mgr.smithi067.rdualw (mgr.24569) 3928 : cluster [DBG] pgmap v3385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:39.904582+0000 mgr.smithi067.rdualw (mgr.24569) 3928 : cluster [DBG] pgmap v3385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:41.905405+0000 mgr.smithi067.rdualw (mgr.24569) 3929 : cluster [DBG] pgmap v3386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:41.905405+0000 mgr.smithi067.rdualw (mgr.24569) 3929 : cluster [DBG] pgmap v3386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:43.906024+0000 mgr.smithi067.rdualw (mgr.24569) 3930 : cluster [DBG] pgmap v3387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:43.906024+0000 mgr.smithi067.rdualw (mgr.24569) 3930 : cluster [DBG] pgmap v3387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:45.907063+0000 mgr.smithi067.rdualw (mgr.24569) 3931 : cluster [DBG] pgmap v3388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:21:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:45.907063+0000 mgr.smithi067.rdualw (mgr.24569) 3931 : cluster [DBG] pgmap v3388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:21:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:47.907703+0000 mgr.smithi067.rdualw (mgr.24569) 3932 : cluster [DBG] pgmap v3389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:47.907703+0000 mgr.smithi067.rdualw (mgr.24569) 3932 : cluster [DBG] pgmap v3389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:51.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:49.908325+0000 mgr.smithi067.rdualw (mgr.24569) 3933 : cluster [DBG] pgmap v3390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:51.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:49.908325+0000 mgr.smithi067.rdualw (mgr.24569) 3933 : cluster [DBG] pgmap v3390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:51.909269+0000 mgr.smithi067.rdualw (mgr.24569) 3934 : cluster [DBG] pgmap v3391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:51.909269+0000 mgr.smithi067.rdualw (mgr.24569) 3934 : cluster [DBG] pgmap v3391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:53.910019+0000 mgr.smithi067.rdualw (mgr.24569) 3935 : cluster [DBG] pgmap v3392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:53.910019+0000 mgr.smithi067.rdualw (mgr.24569) 3935 : cluster [DBG] pgmap v3392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:55.910897+0000 mgr.smithi067.rdualw (mgr.24569) 3936 : cluster [DBG] pgmap v3393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:21:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:55.910897+0000 mgr.smithi067.rdualw (mgr.24569) 3936 : cluster [DBG] pgmap v3393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:21:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:21:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:57.911361+0000 mgr.smithi067.rdualw (mgr.24569) 3937 : cluster [DBG] pgmap v3394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:21:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:21:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:57.911361+0000 mgr.smithi067.rdualw (mgr.24569) 3937 : cluster [DBG] pgmap v3394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:01.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:21:59.912092+0000 mgr.smithi067.rdualw (mgr.24569) 3938 : cluster [DBG] pgmap v3395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:21:59.912092+0000 mgr.smithi067.rdualw (mgr.24569) 3938 : cluster [DBG] pgmap v3395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:01.913024+0000 mgr.smithi067.rdualw (mgr.24569) 3939 : cluster [DBG] pgmap v3396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:01.913024+0000 mgr.smithi067.rdualw (mgr.24569) 3939 : cluster [DBG] pgmap v3396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:03.913767+0000 mgr.smithi067.rdualw (mgr.24569) 3940 : cluster [DBG] pgmap v3397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:03.913767+0000 mgr.smithi067.rdualw (mgr.24569) 3940 : cluster [DBG] pgmap v3397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:05.688 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:22:05.977 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:22:05.977 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (119m) 9m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:22:05.977 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (112m) 9m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:22:05.978 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (112m) 9m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:22:05.978 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (119m) 9m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:22:05.978 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (112m) 9m ago 116m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:22:05.978 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (112m) 9m ago 116m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:22:05.978 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (113m) 9m ago 2h 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:22:05.979 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (113m) 9m ago 2h 520M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:22:05.980 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (113m) 9m ago 2h 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:22:05.980 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (113m) 9m ago 2h 414M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:22:05.980 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (114m) 9m ago 114m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:22:05.980 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (113m) 9m ago 113m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:22:05.981 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 9m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:22:05.981 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (119m) 9m ago 119m 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:22:05.981 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (103m) 9m ago 119m 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:22:05.981 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (119m) 9m ago 119m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:22:05.982 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (119m) 9m ago 118m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:22:05.982 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (118m) 9m ago 118m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:22:05.982 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (118m) 9m ago 118m 1497M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:22:05.982 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (118m) 9m ago 118m 1733M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:22:05.982 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (117m) 9m ago 117m 1367M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:22:05.983 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (117m) 9m ago 117m 2219M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:22:05.983 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (119m) 9m ago 2h 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:22:06.317 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:22:06.318 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:22:06.318 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:22:06.318 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:22:06.318 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:22:06.319 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:22:06.319 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:22:06.319 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:22:06.319 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:22:06.320 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:22:06.320 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:22:06.320 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:22:06.320 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:22:06.321 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:22:06.321 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:22:06.321 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:22:06.321 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:22:06.321 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:22:06.322 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:22:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:05.672463+0000 mgr.smithi067.rdualw (mgr.24569) 3941 : audit [DBG] from='client.36766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:22:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:05.914733+0000 mgr.smithi067.rdualw (mgr.24569) 3942 : cluster [DBG] pgmap v3398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:22:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:05.959275+0000 mgr.smithi067.rdualw (mgr.24569) 3943 : audit [DBG] from='client.36770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:22:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:05.672463+0000 mgr.smithi067.rdualw (mgr.24569) 3941 : audit [DBG] from='client.36766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:22:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:05.914733+0000 mgr.smithi067.rdualw (mgr.24569) 3942 : cluster [DBG] pgmap v3398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:22:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:05.959275+0000 mgr.smithi067.rdualw (mgr.24569) 3943 : audit [DBG] from='client.36770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:22:07.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:06.316134+0000 mon.smithi061 (mon.0) 962 : audit [DBG] from='client.? 172.21.15.61:0/944711032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:22:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:06.316134+0000 mon.smithi061 (mon.0) 962 : audit [DBG] from='client.? 172.21.15.61:0/944711032' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:22:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:07.915300+0000 mgr.smithi067.rdualw (mgr.24569) 3944 : cluster [DBG] pgmap v3399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:07.915300+0000 mgr.smithi067.rdualw (mgr.24569) 3944 : cluster [DBG] pgmap v3399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:09.915911+0000 mgr.smithi067.rdualw (mgr.24569) 3945 : cluster [DBG] pgmap v3400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:09.915911+0000 mgr.smithi067.rdualw (mgr.24569) 3945 : cluster [DBG] pgmap v3400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:11.916810+0000 mgr.smithi067.rdualw (mgr.24569) 3946 : cluster [DBG] pgmap v3401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:11.916810+0000 mgr.smithi067.rdualw (mgr.24569) 3946 : cluster [DBG] pgmap v3401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:13.917477+0000 mgr.smithi067.rdualw (mgr.24569) 3947 : cluster [DBG] pgmap v3402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:13.917477+0000 mgr.smithi067.rdualw (mgr.24569) 3947 : cluster [DBG] pgmap v3402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:15.918559+0000 mgr.smithi067.rdualw (mgr.24569) 3948 : cluster [DBG] pgmap v3403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:22:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:15.918559+0000 mgr.smithi067.rdualw (mgr.24569) 3948 : cluster [DBG] pgmap v3403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:22:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:17.919127+0000 mgr.smithi067.rdualw (mgr.24569) 3949 : cluster [DBG] pgmap v3404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:17.919127+0000 mgr.smithi067.rdualw (mgr.24569) 3949 : cluster [DBG] pgmap v3404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:21.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:19.919822+0000 mgr.smithi067.rdualw (mgr.24569) 3950 : cluster [DBG] pgmap v3405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:19.919822+0000 mgr.smithi067.rdualw (mgr.24569) 3950 : cluster [DBG] pgmap v3405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:21.920691+0000 mgr.smithi067.rdualw (mgr.24569) 3951 : cluster [DBG] pgmap v3406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:21.920691+0000 mgr.smithi067.rdualw (mgr.24569) 3951 : cluster [DBG] pgmap v3406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:23.921257+0000 mgr.smithi067.rdualw (mgr.24569) 3952 : cluster [DBG] pgmap v3407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:23.921257+0000 mgr.smithi067.rdualw (mgr.24569) 3952 : cluster [DBG] pgmap v3407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:25.922073+0000 mgr.smithi067.rdualw (mgr.24569) 3953 : cluster [DBG] pgmap v3408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:22:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:25.922073+0000 mgr.smithi067.rdualw (mgr.24569) 3953 : cluster [DBG] pgmap v3408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:22:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:27.922610+0000 mgr.smithi067.rdualw (mgr.24569) 3954 : cluster [DBG] pgmap v3409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:27.922610+0000 mgr.smithi067.rdualw (mgr.24569) 3954 : cluster [DBG] pgmap v3409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:31.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:29.923363+0000 mgr.smithi067.rdualw (mgr.24569) 3955 : cluster [DBG] pgmap v3410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:29.923363+0000 mgr.smithi067.rdualw (mgr.24569) 3955 : cluster [DBG] pgmap v3410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:31.120260+0000 mon.smithi067 (mon.1) 625 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:22:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:31.121661+0000 mon.smithi067 (mon.1) 626 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:22:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:31.122628+0000 mon.smithi067 (mon.1) 627 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:22:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:31.120260+0000 mon.smithi067 (mon.1) 625 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:22:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:31.121661+0000 mon.smithi067 (mon.1) 626 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:22:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:31.122628+0000 mon.smithi067 (mon.1) 627 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:22:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:22:31.123440+0000 mgr.smithi067.rdualw (mgr.24569) 3956 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:22:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:31.924359+0000 mgr.smithi067.rdualw (mgr.24569) 3957 : cluster [DBG] pgmap v3411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:22:31.123440+0000 mgr.smithi067.rdualw (mgr.24569) 3956 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:22:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:31.924359+0000 mgr.smithi067.rdualw (mgr.24569) 3957 : cluster [DBG] pgmap v3411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:33.925000+0000 mgr.smithi067.rdualw (mgr.24569) 3958 : cluster [DBG] pgmap v3412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:33.925000+0000 mgr.smithi067.rdualw (mgr.24569) 3958 : cluster [DBG] pgmap v3412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:35.043000+0000 mon.smithi067 (mon.1) 628 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:22:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:35.043188+0000 mon.smithi067 (mon.1) 629 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:22:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:35.043254+0000 mon.smithi061 (mon.0) 963 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:22:36.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:35.043721+0000 mon.smithi061 (mon.0) 964 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:22:36.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:35.820702+0000 mon.smithi061 (mon.0) 965 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:22:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:35.043000+0000 mon.smithi067 (mon.1) 628 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:22:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:35.043188+0000 mon.smithi067 (mon.1) 629 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:22:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:35.043254+0000 mon.smithi061 (mon.0) 963 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:22:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:35.043721+0000 mon.smithi061 (mon.0) 964 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:22:36.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:35.820702+0000 mon.smithi061 (mon.0) 965 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:22:36.651 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:22:36.968 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:22:36.969 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 10m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:22:36.969 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (112m) 10m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:22:36.969 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (112m) 1s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:22:36.969 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 10m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:22:36.970 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (113m) 10m ago 116m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:22:36.970 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (113m) 1s ago 116m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:22:36.970 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (114m) 10m ago 2h 454M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:22:36.970 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (113m) 1s ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:22:36.970 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (113m) 10m ago 2h 737M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:22:36.971 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (113m) 1s ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:22:36.971 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (114m) 10m ago 114m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:22:36.971 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (114m) 1s ago 114m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:22:36.971 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 10m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:22:36.972 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 1s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:22:36.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (103m) 10m ago 2h 676M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:22:36.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (119m) 10m ago 119m 1500M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:22:36.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (119m) 10m ago 119m 907M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:22:36.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (119m) 10m ago 119m 1622M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:22:36.973 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (118m) 1s ago 118m 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:22:36.973 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (118m) 1s ago 118m 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:22:36.973 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (118m) 1s ago 118m 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:22:36.973 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (118m) 1s ago 118m 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:22:36.973 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (119m) 10m ago 2h 73.8M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:22:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:35.925749+0000 mgr.smithi067.rdualw (mgr.24569) 3959 : cluster [DBG] pgmap v3413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:22:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:36.121500+0000 mon.smithi067 (mon.1) 630 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:22:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:36.121788+0000 mon.smithi061 (mon.0) 966 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:22:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:35.925749+0000 mgr.smithi067.rdualw (mgr.24569) 3959 : cluster [DBG] pgmap v3413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:22:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:36.121500+0000 mon.smithi067 (mon.1) 630 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:22:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:36.121788+0000 mon.smithi061 (mon.0) 966 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:22:37.396 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:22:37.397 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:22:37.397 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:22:37.397 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:22:37.398 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:22:37.398 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:22:37.398 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:22:37.399 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:22:37.399 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:22:37.399 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:22:37.400 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:22:37.400 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:22:37.400 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:22:37.401 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:22:37.401 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:22:37.401 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:22:37.402 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:22:37.402 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:22:37.402 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:22:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:36.637193+0000 mgr.smithi067.rdualw (mgr.24569) 3960 : audit [DBG] from='client.36778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:22:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:36.950569+0000 mgr.smithi067.rdualw (mgr.24569) 3961 : audit [DBG] from='client.36782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:22:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:37.394714+0000 mon.smithi061 (mon.0) 967 : audit [DBG] from='client.? 172.21.15.61:0/1041789347' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:22:38.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:36.637193+0000 mgr.smithi067.rdualw (mgr.24569) 3960 : audit [DBG] from='client.36778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:22:38.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:36.950569+0000 mgr.smithi067.rdualw (mgr.24569) 3961 : audit [DBG] from='client.36782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:22:38.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:37.394714+0000 mon.smithi061 (mon.0) 967 : audit [DBG] from='client.? 172.21.15.61:0/1041789347' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:22:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:37.926407+0000 mgr.smithi067.rdualw (mgr.24569) 3962 : cluster [DBG] pgmap v3414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:38.365113+0000 mon.smithi061 (mon.0) 968 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:22:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:38.767718+0000 mon.smithi067 (mon.1) 631 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:22:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:38.768096+0000 mon.smithi061 (mon.0) 969 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:22:39.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:38.773280+0000 mon.smithi061 (mon.0) 970 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:22:39.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:22:38.780188+0000 mon.smithi061 (mon.0) 971 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:22:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:37.926407+0000 mgr.smithi067.rdualw (mgr.24569) 3962 : cluster [DBG] pgmap v3414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:38.365113+0000 mon.smithi061 (mon.0) 968 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:22:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:38.767718+0000 mon.smithi067 (mon.1) 631 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:22:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:38.768096+0000 mon.smithi061 (mon.0) 969 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:22:39.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:38.773280+0000 mon.smithi061 (mon.0) 970 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:22:39.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:22:38.780188+0000 mon.smithi061 (mon.0) 971 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:22:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:39.927129+0000 mgr.smithi067.rdualw (mgr.24569) 3963 : cluster [DBG] pgmap v3415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:39.927129+0000 mgr.smithi067.rdualw (mgr.24569) 3963 : cluster [DBG] pgmap v3415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:41.927950+0000 mgr.smithi067.rdualw (mgr.24569) 3964 : cluster [DBG] pgmap v3416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:41.927950+0000 mgr.smithi067.rdualw (mgr.24569) 3964 : cluster [DBG] pgmap v3416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:43.928549+0000 mgr.smithi067.rdualw (mgr.24569) 3965 : cluster [DBG] pgmap v3417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:43.928549+0000 mgr.smithi067.rdualw (mgr.24569) 3965 : cluster [DBG] pgmap v3417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:45.929349+0000 mgr.smithi067.rdualw (mgr.24569) 3966 : cluster [DBG] pgmap v3418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:22:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:45.929349+0000 mgr.smithi067.rdualw (mgr.24569) 3966 : cluster [DBG] pgmap v3418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:22:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:47.929979+0000 mgr.smithi067.rdualw (mgr.24569) 3967 : cluster [DBG] pgmap v3419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:47.929979+0000 mgr.smithi067.rdualw (mgr.24569) 3967 : cluster [DBG] pgmap v3419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:51.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:49.930575+0000 mgr.smithi067.rdualw (mgr.24569) 3968 : cluster [DBG] pgmap v3420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:51.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:49.930575+0000 mgr.smithi067.rdualw (mgr.24569) 3968 : cluster [DBG] pgmap v3420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:51.931406+0000 mgr.smithi067.rdualw (mgr.24569) 3969 : cluster [DBG] pgmap v3421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:51.931406+0000 mgr.smithi067.rdualw (mgr.24569) 3969 : cluster [DBG] pgmap v3421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:53.931996+0000 mgr.smithi067.rdualw (mgr.24569) 3970 : cluster [DBG] pgmap v3422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:53.931996+0000 mgr.smithi067.rdualw (mgr.24569) 3970 : cluster [DBG] pgmap v3422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:55.932822+0000 mgr.smithi067.rdualw (mgr.24569) 3971 : cluster [DBG] pgmap v3423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:22:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:55.932822+0000 mgr.smithi067.rdualw (mgr.24569) 3971 : cluster [DBG] pgmap v3423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:22:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:22:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:57.933388+0000 mgr.smithi067.rdualw (mgr.24569) 3972 : cluster [DBG] pgmap v3424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:22:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:22:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:57.933388+0000 mgr.smithi067.rdualw (mgr.24569) 3972 : cluster [DBG] pgmap v3424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:22:59.933953+0000 mgr.smithi067.rdualw (mgr.24569) 3973 : cluster [DBG] pgmap v3425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:22:59.933953+0000 mgr.smithi067.rdualw (mgr.24569) 3973 : cluster [DBG] pgmap v3425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:01.934743+0000 mgr.smithi067.rdualw (mgr.24569) 3974 : cluster [DBG] pgmap v3426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:01.934743+0000 mgr.smithi067.rdualw (mgr.24569) 3974 : cluster [DBG] pgmap v3426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:03.935352+0000 mgr.smithi067.rdualw (mgr.24569) 3975 : cluster [DBG] pgmap v3427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:05.606 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:03.935352+0000 mgr.smithi067.rdualw (mgr.24569) 3975 : cluster [DBG] pgmap v3427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:05.936160+0000 mgr.smithi067.rdualw (mgr.24569) 3976 : cluster [DBG] pgmap v3428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:23:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:05.936160+0000 mgr.smithi067.rdualw (mgr.24569) 3976 : cluster [DBG] pgmap v3428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:23:07.738 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:23:08.036 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:23:08.036 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 29s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:23:08.037 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (113m) 29s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:23:08.037 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (113m) 32s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:23:08.037 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 29s ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:23:08.038 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (113m) 29s ago 117m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:23:08.038 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (113m) 32s ago 117m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:23:08.039 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (114m) 29s ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:23:08.039 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (114m) 32s ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:23:08.040 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (114m) 29s ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:23:08.041 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (114m) 32s ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:23:08.041 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (115m) 29s ago 115m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:23:08.041 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (115m) 32s ago 115m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:23:08.041 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 29s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:23:08.042 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 32s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:23:08.042 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (104m) 29s ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:23:08.042 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 29s ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:23:08.042 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 29s ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:23:08.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (119m) 29s ago 119m 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:23:08.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (119m) 32s ago 119m 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:23:08.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (119m) 32s ago 119m 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:23:08.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (119m) 32s ago 119m 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:23:08.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (118m) 32s ago 118m 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:23:08.044 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 29s ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:23:08.379 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:23:08.379 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:23:08.380 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:23:08.380 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:23:08.380 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:23:08.380 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:23:08.381 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:23:08.381 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:23:08.381 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:23:08.381 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:23:08.382 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:23:08.382 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:23:08.382 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:23:08.382 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:23:08.383 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:23:08.383 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:23:08.383 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:23:08.383 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:23:08.383 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:23:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:23:07.723401+0000 mgr.smithi067.rdualw (mgr.24569) 3977 : audit [DBG] from='client.36790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:23:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:07.936755+0000 mgr.smithi067.rdualw (mgr.24569) 3978 : cluster [DBG] pgmap v3429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:23:08.017825+0000 mgr.smithi067.rdualw (mgr.24569) 3979 : audit [DBG] from='client.36794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:23:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:23:08.377885+0000 mon.smithi061 (mon.0) 972 : audit [DBG] from='client.? 172.21.15.61:0/1784005515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:23:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:23:07.723401+0000 mgr.smithi067.rdualw (mgr.24569) 3977 : audit [DBG] from='client.36790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:23:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:07.936755+0000 mgr.smithi067.rdualw (mgr.24569) 3978 : cluster [DBG] pgmap v3429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:23:08.017825+0000 mgr.smithi067.rdualw (mgr.24569) 3979 : audit [DBG] from='client.36794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:23:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:23:08.377885+0000 mon.smithi061 (mon.0) 972 : audit [DBG] from='client.? 172.21.15.61:0/1784005515' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:23:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:09.937446+0000 mgr.smithi067.rdualw (mgr.24569) 3980 : cluster [DBG] pgmap v3430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:09.937446+0000 mgr.smithi067.rdualw (mgr.24569) 3980 : cluster [DBG] pgmap v3430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:11.938417+0000 mgr.smithi067.rdualw (mgr.24569) 3981 : cluster [DBG] pgmap v3431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:11.938417+0000 mgr.smithi067.rdualw (mgr.24569) 3981 : cluster [DBG] pgmap v3431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:13.939115+0000 mgr.smithi067.rdualw (mgr.24569) 3982 : cluster [DBG] pgmap v3432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:13.939115+0000 mgr.smithi067.rdualw (mgr.24569) 3982 : cluster [DBG] pgmap v3432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:15.940066+0000 mgr.smithi067.rdualw (mgr.24569) 3983 : cluster [DBG] pgmap v3433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:23:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:15.940066+0000 mgr.smithi067.rdualw (mgr.24569) 3983 : cluster [DBG] pgmap v3433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:23:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:17.940509+0000 mgr.smithi067.rdualw (mgr.24569) 3984 : cluster [DBG] pgmap v3434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:17.940509+0000 mgr.smithi067.rdualw (mgr.24569) 3984 : cluster [DBG] pgmap v3434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:19.941070+0000 mgr.smithi067.rdualw (mgr.24569) 3985 : cluster [DBG] pgmap v3435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:19.941070+0000 mgr.smithi067.rdualw (mgr.24569) 3985 : cluster [DBG] pgmap v3435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:21.941903+0000 mgr.smithi067.rdualw (mgr.24569) 3986 : cluster [DBG] pgmap v3436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:21.941903+0000 mgr.smithi067.rdualw (mgr.24569) 3986 : cluster [DBG] pgmap v3436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:23.942411+0000 mgr.smithi067.rdualw (mgr.24569) 3987 : cluster [DBG] pgmap v3437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:23.942411+0000 mgr.smithi067.rdualw (mgr.24569) 3987 : cluster [DBG] pgmap v3437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:25.943297+0000 mgr.smithi067.rdualw (mgr.24569) 3988 : cluster [DBG] pgmap v3438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:23:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:25.943297+0000 mgr.smithi067.rdualw (mgr.24569) 3988 : cluster [DBG] pgmap v3438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:23:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:27.943810+0000 mgr.smithi067.rdualw (mgr.24569) 3989 : cluster [DBG] pgmap v3439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:27.943810+0000 mgr.smithi067.rdualw (mgr.24569) 3989 : cluster [DBG] pgmap v3439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:31.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:29.944460+0000 mgr.smithi067.rdualw (mgr.24569) 3990 : cluster [DBG] pgmap v3440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:29.944460+0000 mgr.smithi067.rdualw (mgr.24569) 3990 : cluster [DBG] pgmap v3440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:31.945305+0000 mgr.smithi067.rdualw (mgr.24569) 3991 : cluster [DBG] pgmap v3441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:31.945305+0000 mgr.smithi067.rdualw (mgr.24569) 3991 : cluster [DBG] pgmap v3441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:33.946000+0000 mgr.smithi067.rdualw (mgr.24569) 3992 : cluster [DBG] pgmap v3442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:33.946000+0000 mgr.smithi067.rdualw (mgr.24569) 3992 : cluster [DBG] pgmap v3442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:23:35.048466+0000 mon.smithi067 (mon.1) 632 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:23:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:23:35.048703+0000 mon.smithi061 (mon.0) 973 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:23:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:23:35.048735+0000 mon.smithi067 (mon.1) 633 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:23:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:23:35.048999+0000 mon.smithi061 (mon.0) 974 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:23:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:23:35.048466+0000 mon.smithi067 (mon.1) 632 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:23:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:23:35.048703+0000 mon.smithi061 (mon.0) 973 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:23:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:23:35.048735+0000 mon.smithi067 (mon.1) 633 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:23:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:23:35.048999+0000 mon.smithi061 (mon.0) 974 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:23:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:35.946953+0000 mgr.smithi067.rdualw (mgr.24569) 3993 : cluster [DBG] pgmap v3443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:23:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:35.946953+0000 mgr.smithi067.rdualw (mgr.24569) 3993 : cluster [DBG] pgmap v3443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:23:38.769 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:23:39.079 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:23:39.079 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 60s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:23:39.080 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (113m) 60s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:23:39.080 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (113m) 63s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:23:39.080 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 60s ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:23:39.080 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (114m) 60s ago 117m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:23:39.080 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (114m) 63s ago 117m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:23:39.081 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (115m) 60s ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:23:39.081 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (114m) 63s ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:23:39.081 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (114m) 60s ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:23:39.081 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (114m) 63s ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:23:39.082 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (115m) 60s ago 115m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:23:39.082 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (115m) 63s ago 115m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:23:39.082 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 60s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:23:39.082 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 63s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:23:39.083 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (104m) 60s ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:23:39.083 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 60s ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:23:39.083 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 60s ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:23:39.083 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 60s ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:23:39.084 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 63s ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:23:39.084 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (119m) 63s ago 119m 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:23:39.084 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (119m) 63s ago 119m 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:23:39.084 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (119m) 63s ago 119m 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:23:39.084 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 60s ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:23:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:37.947383+0000 mgr.smithi067.rdualw (mgr.24569) 3994 : cluster [DBG] pgmap v3444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:23:38.784527+0000 mon.smithi067 (mon.1) 634 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:23:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:23:38.786048+0000 mon.smithi067 (mon.1) 635 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:23:39.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:23:38.787007+0000 mon.smithi067 (mon.1) 636 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:23:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:37.947383+0000 mgr.smithi067.rdualw (mgr.24569) 3994 : cluster [DBG] pgmap v3444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:23:38.784527+0000 mon.smithi067 (mon.1) 634 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:23:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:23:38.786048+0000 mon.smithi067 (mon.1) 635 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:23:39.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:23:38.787007+0000 mon.smithi067 (mon.1) 636 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:23:39.450 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:23:39.451 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:23:39.451 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:23:39.451 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:23:39.451 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:23:39.452 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:23:39.452 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:23:39.452 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:23:39.452 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:23:39.452 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:23:39.453 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:23:39.453 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:23:39.453 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:23:39.453 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:23:39.454 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:23:39.454 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:23:39.454 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:23:39.454 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:23:39.454 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:23:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:23:38.755880+0000 mgr.smithi067.rdualw (mgr.24569) 3995 : audit [DBG] from='client.36802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:23:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:23:38.787915+0000 mgr.smithi067.rdualw (mgr.24569) 3996 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:23:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:23:39.061747+0000 mgr.smithi067.rdualw (mgr.24569) 3997 : audit [DBG] from='client.36806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:23:40.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:23:39.207408+0000 mon.smithi061 (mon.0) 975 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:23:40.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:23:39.215754+0000 mon.smithi061 (mon.0) 976 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:23:40.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:23:39.448469+0000 mon.smithi061 (mon.0) 977 : audit [DBG] from='client.? 172.21.15.61:0/1998967438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:23:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:23:38.755880+0000 mgr.smithi067.rdualw (mgr.24569) 3995 : audit [DBG] from='client.36802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:23:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:23:38.787915+0000 mgr.smithi067.rdualw (mgr.24569) 3996 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:23:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:23:39.061747+0000 mgr.smithi067.rdualw (mgr.24569) 3997 : audit [DBG] from='client.36806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:23:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:23:39.207408+0000 mon.smithi061 (mon.0) 975 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:23:40.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:23:39.215754+0000 mon.smithi061 (mon.0) 976 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:23:40.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:23:39.448469+0000 mon.smithi061 (mon.0) 977 : audit [DBG] from='client.? 172.21.15.61:0/1998967438' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:23:41.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:39.947992+0000 mgr.smithi067.rdualw (mgr.24569) 3998 : cluster [DBG] pgmap v3445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:39.947992+0000 mgr.smithi067.rdualw (mgr.24569) 3998 : cluster [DBG] pgmap v3445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:41.948849+0000 mgr.smithi067.rdualw (mgr.24569) 3999 : cluster [DBG] pgmap v3446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:41.948849+0000 mgr.smithi067.rdualw (mgr.24569) 3999 : cluster [DBG] pgmap v3446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:45.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:43.949420+0000 mgr.smithi067.rdualw (mgr.24569) 4000 : cluster [DBG] pgmap v3447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:43.949420+0000 mgr.smithi067.rdualw (mgr.24569) 4000 : cluster [DBG] pgmap v3447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:45.950182+0000 mgr.smithi067.rdualw (mgr.24569) 4001 : cluster [DBG] pgmap v3448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:23:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:45.950182+0000 mgr.smithi067.rdualw (mgr.24569) 4001 : cluster [DBG] pgmap v3448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:23:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:47.950736+0000 mgr.smithi067.rdualw (mgr.24569) 4002 : cluster [DBG] pgmap v3449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:47.950736+0000 mgr.smithi067.rdualw (mgr.24569) 4002 : cluster [DBG] pgmap v3449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:49.951314+0000 mgr.smithi067.rdualw (mgr.24569) 4003 : cluster [DBG] pgmap v3450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:49.951314+0000 mgr.smithi067.rdualw (mgr.24569) 4003 : cluster [DBG] pgmap v3450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:51.952189+0000 mgr.smithi067.rdualw (mgr.24569) 4004 : cluster [DBG] pgmap v3451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:51.952189+0000 mgr.smithi067.rdualw (mgr.24569) 4004 : cluster [DBG] pgmap v3451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:53.952795+0000 mgr.smithi067.rdualw (mgr.24569) 4005 : cluster [DBG] pgmap v3452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:53.952795+0000 mgr.smithi067.rdualw (mgr.24569) 4005 : cluster [DBG] pgmap v3452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:55.953683+0000 mgr.smithi067.rdualw (mgr.24569) 4006 : cluster [DBG] pgmap v3453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:23:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:55.953683+0000 mgr.smithi067.rdualw (mgr.24569) 4006 : cluster [DBG] pgmap v3453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:23:59.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:23:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:57.954337+0000 mgr.smithi067.rdualw (mgr.24569) 4007 : cluster [DBG] pgmap v3454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:23:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:23:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:57.954337+0000 mgr.smithi067.rdualw (mgr.24569) 4007 : cluster [DBG] pgmap v3454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:23:59.955096+0000 mgr.smithi067.rdualw (mgr.24569) 4008 : cluster [DBG] pgmap v3455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:23:59.955096+0000 mgr.smithi067.rdualw (mgr.24569) 4008 : cluster [DBG] pgmap v3455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:01.955913+0000 mgr.smithi067.rdualw (mgr.24569) 4009 : cluster [DBG] pgmap v3456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:01.955913+0000 mgr.smithi067.rdualw (mgr.24569) 4009 : cluster [DBG] pgmap v3456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:03.956461+0000 mgr.smithi067.rdualw (mgr.24569) 4010 : cluster [DBG] pgmap v3457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:03.956461+0000 mgr.smithi067.rdualw (mgr.24569) 4010 : cluster [DBG] pgmap v3457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:05.957420+0000 mgr.smithi067.rdualw (mgr.24569) 4011 : cluster [DBG] pgmap v3458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:24:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:05.957420+0000 mgr.smithi067.rdualw (mgr.24569) 4011 : cluster [DBG] pgmap v3458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:24:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:07.957999+0000 mgr.smithi067.rdualw (mgr.24569) 4012 : cluster [DBG] pgmap v3459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:07.957999+0000 mgr.smithi067.rdualw (mgr.24569) 4012 : cluster [DBG] pgmap v3459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:09.758 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:24:10.053 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:24:10.054 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 91s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:24:10.054 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (114m) 91s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:24:10.054 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (114m) 94s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:24:10.055 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 91s ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:24:10.055 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (114m) 91s ago 118m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:24:10.055 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (114m) 94s ago 118m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:24:10.055 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (115m) 91s ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:24:10.056 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (115m) 94s ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:24:10.056 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (115m) 91s ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:24:10.056 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (115m) 94s ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:24:10.056 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (116m) 91s ago 116m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:24:10.056 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (116m) 94s ago 116m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:24:10.057 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 91s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:24:10.057 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 94s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:24:10.057 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (105m) 91s ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:24:10.057 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 91s ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:24:10.057 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 91s ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:24:10.058 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 91s ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:24:10.058 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 94s ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:24:10.058 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 94s ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:24:10.058 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 94s ago 2h 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:24:10.059 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (119m) 94s ago 119m 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:24:10.059 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 91s ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:24:10.395 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:24:10.395 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:24:10.396 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:24:10.396 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:24:10.396 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:24:10.396 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:24:10.397 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:24:10.397 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:24:10.397 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:24:10.397 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:24:10.398 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:24:10.398 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:24:10.398 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:24:10.398 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:24:10.398 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:24:10.399 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:24:10.399 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:24:10.399 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:24:10.399 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:24:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:24:09.744749+0000 mgr.smithi067.rdualw (mgr.24569) 4013 : audit [DBG] from='client.36814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:24:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:09.958777+0000 mgr.smithi067.rdualw (mgr.24569) 4014 : cluster [DBG] pgmap v3460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:24:10.035362+0000 mgr.smithi067.rdualw (mgr.24569) 4015 : audit [DBG] from='client.36818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:24:11.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:24:10.393171+0000 mon.smithi061 (mon.0) 978 : audit [DBG] from='client.? 172.21.15.61:0/1702726760' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:24:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:24:09.744749+0000 mgr.smithi067.rdualw (mgr.24569) 4013 : audit [DBG] from='client.36814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:24:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:09.958777+0000 mgr.smithi067.rdualw (mgr.24569) 4014 : cluster [DBG] pgmap v3460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:11.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:24:10.035362+0000 mgr.smithi067.rdualw (mgr.24569) 4015 : audit [DBG] from='client.36818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:24:11.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:24:10.393171+0000 mon.smithi061 (mon.0) 978 : audit [DBG] from='client.? 172.21.15.61:0/1702726760' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:24:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:11.959862+0000 mgr.smithi067.rdualw (mgr.24569) 4016 : cluster [DBG] pgmap v3461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:11.959862+0000 mgr.smithi067.rdualw (mgr.24569) 4016 : cluster [DBG] pgmap v3461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:13.960463+0000 mgr.smithi067.rdualw (mgr.24569) 4017 : cluster [DBG] pgmap v3462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:13.960463+0000 mgr.smithi067.rdualw (mgr.24569) 4017 : cluster [DBG] pgmap v3462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:15.961281+0000 mgr.smithi067.rdualw (mgr.24569) 4018 : cluster [DBG] pgmap v3463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:24:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:15.961281+0000 mgr.smithi067.rdualw (mgr.24569) 4018 : cluster [DBG] pgmap v3463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:24:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:17.961996+0000 mgr.smithi067.rdualw (mgr.24569) 4019 : cluster [DBG] pgmap v3464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:17.961996+0000 mgr.smithi067.rdualw (mgr.24569) 4019 : cluster [DBG] pgmap v3464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:21.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:19.962744+0000 mgr.smithi067.rdualw (mgr.24569) 4020 : cluster [DBG] pgmap v3465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:19.962744+0000 mgr.smithi067.rdualw (mgr.24569) 4020 : cluster [DBG] pgmap v3465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:21.963557+0000 mgr.smithi067.rdualw (mgr.24569) 4021 : cluster [DBG] pgmap v3466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:21.963557+0000 mgr.smithi067.rdualw (mgr.24569) 4021 : cluster [DBG] pgmap v3466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:23.964054+0000 mgr.smithi067.rdualw (mgr.24569) 4022 : cluster [DBG] pgmap v3467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:23.964054+0000 mgr.smithi067.rdualw (mgr.24569) 4022 : cluster [DBG] pgmap v3467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:25.964868+0000 mgr.smithi067.rdualw (mgr.24569) 4023 : cluster [DBG] pgmap v3468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:24:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:25.964868+0000 mgr.smithi067.rdualw (mgr.24569) 4023 : cluster [DBG] pgmap v3468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:24:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:27.965555+0000 mgr.smithi067.rdualw (mgr.24569) 4024 : cluster [DBG] pgmap v3469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:27.965555+0000 mgr.smithi067.rdualw (mgr.24569) 4024 : cluster [DBG] pgmap v3469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:31.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:29.966234+0000 mgr.smithi067.rdualw (mgr.24569) 4025 : cluster [DBG] pgmap v3470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:29.966234+0000 mgr.smithi067.rdualw (mgr.24569) 4025 : cluster [DBG] pgmap v3470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:31.967109+0000 mgr.smithi067.rdualw (mgr.24569) 4026 : cluster [DBG] pgmap v3471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:31.967109+0000 mgr.smithi067.rdualw (mgr.24569) 4026 : cluster [DBG] pgmap v3471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:33.967681+0000 mgr.smithi067.rdualw (mgr.24569) 4027 : cluster [DBG] pgmap v3472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:33.967681+0000 mgr.smithi067.rdualw (mgr.24569) 4027 : cluster [DBG] pgmap v3472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:24:35.054391+0000 mon.smithi067 (mon.1) 637 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:24:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:24:35.054620+0000 mon.smithi061 (mon.0) 979 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:24:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:24:35.054680+0000 mon.smithi067 (mon.1) 638 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:24:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:24:35.054934+0000 mon.smithi061 (mon.0) 980 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:24:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:24:35.054391+0000 mon.smithi067 (mon.1) 637 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:24:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:24:35.054620+0000 mon.smithi061 (mon.0) 979 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:24:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:24:35.054680+0000 mon.smithi067 (mon.1) 638 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:24:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:24:35.054934+0000 mon.smithi061 (mon.0) 980 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:24:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:35.968697+0000 mgr.smithi067.rdualw (mgr.24569) 4028 : cluster [DBG] pgmap v3473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:24:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:35.968697+0000 mgr.smithi067.rdualw (mgr.24569) 4028 : cluster [DBG] pgmap v3473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:24:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:37.969198+0000 mgr.smithi067.rdualw (mgr.24569) 4029 : cluster [DBG] pgmap v3474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:37.969198+0000 mgr.smithi067.rdualw (mgr.24569) 4029 : cluster [DBG] pgmap v3474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:24:39.221247+0000 mon.smithi067 (mon.1) 639 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:24:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:24:39.222710+0000 mon.smithi067 (mon.1) 640 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:24:40.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:24:39.223696+0000 mon.smithi067 (mon.1) 641 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:24:40.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:24:39.484622+0000 mon.smithi061 (mon.0) 981 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:24:40.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:24:39.581319+0000 mon.smithi061 (mon.0) 982 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:24:40.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:24:39.988522+0000 mon.smithi061 (mon.0) 983 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:24:40.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:24:39.996370+0000 mon.smithi061 (mon.0) 984 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:24:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:24:39.221247+0000 mon.smithi067 (mon.1) 639 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:24:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:24:39.222710+0000 mon.smithi067 (mon.1) 640 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:24:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:24:39.223696+0000 mon.smithi067 (mon.1) 641 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:24:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:24:39.484622+0000 mon.smithi061 (mon.0) 981 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:24:40.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:24:39.581319+0000 mon.smithi061 (mon.0) 982 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:24:40.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:24:39.988522+0000 mon.smithi061 (mon.0) 983 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:24:40.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:24:39.996370+0000 mon.smithi061 (mon.0) 984 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:24:40.702 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:24:41.001 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:24:41.002 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 2m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:24:41.002 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (114m) 2m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:24:41.002 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (114m) 2m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:24:41.002 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 2m ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:24:41.003 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (115m) 2m ago 119m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:24:41.003 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (115m) 2m ago 118m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:24:41.003 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (116m) 2m ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:24:41.003 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (116m) 2m ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:24:41.003 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (115m) 2m ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:24:41.004 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (115m) 2m ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:24:41.004 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (116m) 2m ago 116m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:24:41.005 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (116m) 2m ago 116m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:24:41.005 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 2m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:24:41.005 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 2m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:24:41.005 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (105m) 2m ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:24:41.006 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 2m ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:24:41.006 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 2m ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:24:41.006 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 2m ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:24:41.006 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 2m ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:24:41.007 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 2m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:24:41.007 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 2m ago 2h 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:24:41.007 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 2m ago 2h 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:24:41.008 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 2m ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:24:41.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:24:39.224599+0000 mgr.smithi067.rdualw (mgr.24569) 4030 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:24:41.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:39.969885+0000 mgr.smithi067.rdualw (mgr.24569) 4031 : cluster [DBG] pgmap v3475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:24:39.224599+0000 mgr.smithi067.rdualw (mgr.24569) 4030 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:24:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:39.969885+0000 mgr.smithi067.rdualw (mgr.24569) 4031 : cluster [DBG] pgmap v3475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:41.409 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:24:41.410 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:24:41.410 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:24:41.410 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:24:41.411 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:24:41.411 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:24:41.411 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:24:41.411 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:24:41.412 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:24:41.412 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:24:41.412 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:24:41.412 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:24:41.413 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:24:41.413 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:24:41.413 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:24:41.413 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:24:41.414 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:24:41.414 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:24:41.414 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:24:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:24:40.688501+0000 mgr.smithi067.rdualw (mgr.24569) 4032 : audit [DBG] from='client.36826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:24:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:24:40.983630+0000 mgr.smithi067.rdualw (mgr.24569) 4033 : audit [DBG] from='client.36830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:24:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:24:41.408201+0000 mon.smithi061 (mon.0) 985 : audit [DBG] from='client.? 172.21.15.61:0/3195900118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:24:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:24:40.688501+0000 mgr.smithi067.rdualw (mgr.24569) 4032 : audit [DBG] from='client.36826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:24:42.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:24:40.983630+0000 mgr.smithi067.rdualw (mgr.24569) 4033 : audit [DBG] from='client.36830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:24:42.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:24:41.408201+0000 mon.smithi061 (mon.0) 985 : audit [DBG] from='client.? 172.21.15.61:0/3195900118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:24:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:41.970907+0000 mgr.smithi067.rdualw (mgr.24569) 4034 : cluster [DBG] pgmap v3476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:41.970907+0000 mgr.smithi067.rdualw (mgr.24569) 4034 : cluster [DBG] pgmap v3476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:43.971646+0000 mgr.smithi067.rdualw (mgr.24569) 4035 : cluster [DBG] pgmap v3477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:43.971646+0000 mgr.smithi067.rdualw (mgr.24569) 4035 : cluster [DBG] pgmap v3477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:45.972492+0000 mgr.smithi067.rdualw (mgr.24569) 4036 : cluster [DBG] pgmap v3478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:24:46.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:45.972492+0000 mgr.smithi067.rdualw (mgr.24569) 4036 : cluster [DBG] pgmap v3478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:24:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:47.973057+0000 mgr.smithi067.rdualw (mgr.24569) 4037 : cluster [DBG] pgmap v3479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:47.973057+0000 mgr.smithi067.rdualw (mgr.24569) 4037 : cluster [DBG] pgmap v3479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:51.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:49.973712+0000 mgr.smithi067.rdualw (mgr.24569) 4038 : cluster [DBG] pgmap v3480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:49.973712+0000 mgr.smithi067.rdualw (mgr.24569) 4038 : cluster [DBG] pgmap v3480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:51.974676+0000 mgr.smithi067.rdualw (mgr.24569) 4039 : cluster [DBG] pgmap v3481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:51.974676+0000 mgr.smithi067.rdualw (mgr.24569) 4039 : cluster [DBG] pgmap v3481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:53.975349+0000 mgr.smithi067.rdualw (mgr.24569) 4040 : cluster [DBG] pgmap v3482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:53.975349+0000 mgr.smithi067.rdualw (mgr.24569) 4040 : cluster [DBG] pgmap v3482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:55.976157+0000 mgr.smithi067.rdualw (mgr.24569) 4041 : cluster [DBG] pgmap v3483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:24:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:55.976157+0000 mgr.smithi067.rdualw (mgr.24569) 4041 : cluster [DBG] pgmap v3483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:24:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:24:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:57.976724+0000 mgr.smithi067.rdualw (mgr.24569) 4042 : cluster [DBG] pgmap v3484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:24:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:24:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:57.976724+0000 mgr.smithi067.rdualw (mgr.24569) 4042 : cluster [DBG] pgmap v3484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:01.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:24:59.977314+0000 mgr.smithi067.rdualw (mgr.24569) 4043 : cluster [DBG] pgmap v3485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:01.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:24:59.977314+0000 mgr.smithi067.rdualw (mgr.24569) 4043 : cluster [DBG] pgmap v3485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:01.978208+0000 mgr.smithi067.rdualw (mgr.24569) 4044 : cluster [DBG] pgmap v3486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:01.978208+0000 mgr.smithi067.rdualw (mgr.24569) 4044 : cluster [DBG] pgmap v3486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:03.978932+0000 mgr.smithi067.rdualw (mgr.24569) 4045 : cluster [DBG] pgmap v3487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:03.978932+0000 mgr.smithi067.rdualw (mgr.24569) 4045 : cluster [DBG] pgmap v3487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:05.979783+0000 mgr.smithi067.rdualw (mgr.24569) 4046 : cluster [DBG] pgmap v3488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:25:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:05.979783+0000 mgr.smithi067.rdualw (mgr.24569) 4046 : cluster [DBG] pgmap v3488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:25:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:07.980399+0000 mgr.smithi067.rdualw (mgr.24569) 4047 : cluster [DBG] pgmap v3489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:07.980399+0000 mgr.smithi067.rdualw (mgr.24569) 4047 : cluster [DBG] pgmap v3489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:09.981001+0000 mgr.smithi067.rdualw (mgr.24569) 4048 : cluster [DBG] pgmap v3490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:09.981001+0000 mgr.smithi067.rdualw (mgr.24569) 4048 : cluster [DBG] pgmap v3490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:11.735 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:25:12.029 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:25:12.029 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 2m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:25:12.030 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (115m) 2m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:25:12.030 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (115m) 2m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:25:12.030 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 2m ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:25:12.030 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (115m) 2m ago 119m 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:25:12.031 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (115m) 2m ago 119m 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:25:12.031 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (116m) 2m ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:25:12.031 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (116m) 2m ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:25:12.031 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (116m) 2m ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:25:12.032 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (116m) 2m ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:25:12.032 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (117m) 2m ago 117m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:25:12.032 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (117m) 2m ago 117m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:25:12.033 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 2m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:25:12.033 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 2m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:25:12.033 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (106m) 2m ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:25:12.033 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 2m ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:25:12.034 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 2m ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:25:12.034 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 2m ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:25:12.034 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 2m ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:25:12.034 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 2m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:25:12.035 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 2m ago 2h 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:25:12.035 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 2m ago 2h 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:25:12.035 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 2m ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:25:12.370 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:25:12.371 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:25:12.371 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:25:12.371 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:25:12.372 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:25:12.372 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:25:12.372 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:25:12.372 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:25:12.373 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:25:12.373 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:25:12.373 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:25:12.373 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:25:12.373 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:25:12.374 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:25:12.374 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:25:12.374 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:25:12.374 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:25:12.375 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:25:12.375 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:25:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:25:11.719211+0000 mgr.smithi067.rdualw (mgr.24569) 4049 : audit [DBG] from='client.36838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:25:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:11.981987+0000 mgr.smithi067.rdualw (mgr.24569) 4050 : cluster [DBG] pgmap v3491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:25:12.011400+0000 mgr.smithi067.rdualw (mgr.24569) 4051 : audit [DBG] from='client.36842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:25:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:25:12.369029+0000 mon.smithi061 (mon.0) 986 : audit [DBG] from='client.? 172.21.15.61:0/1635967448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:25:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:25:11.719211+0000 mgr.smithi067.rdualw (mgr.24569) 4049 : audit [DBG] from='client.36838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:25:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:11.981987+0000 mgr.smithi067.rdualw (mgr.24569) 4050 : cluster [DBG] pgmap v3491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:25:12.011400+0000 mgr.smithi067.rdualw (mgr.24569) 4051 : audit [DBG] from='client.36842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:25:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:25:12.369029+0000 mon.smithi061 (mon.0) 986 : audit [DBG] from='client.? 172.21.15.61:0/1635967448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:25:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:13.982656+0000 mgr.smithi067.rdualw (mgr.24569) 4052 : cluster [DBG] pgmap v3492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:13.982656+0000 mgr.smithi067.rdualw (mgr.24569) 4052 : cluster [DBG] pgmap v3492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:15.983459+0000 mgr.smithi067.rdualw (mgr.24569) 4053 : cluster [DBG] pgmap v3493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:25:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:15.983459+0000 mgr.smithi067.rdualw (mgr.24569) 4053 : cluster [DBG] pgmap v3493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:25:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:17.983944+0000 mgr.smithi067.rdualw (mgr.24569) 4054 : cluster [DBG] pgmap v3494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:17.983944+0000 mgr.smithi067.rdualw (mgr.24569) 4054 : cluster [DBG] pgmap v3494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:21.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:19.984694+0000 mgr.smithi067.rdualw (mgr.24569) 4055 : cluster [DBG] pgmap v3495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:19.984694+0000 mgr.smithi067.rdualw (mgr.24569) 4055 : cluster [DBG] pgmap v3495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:21.985570+0000 mgr.smithi067.rdualw (mgr.24569) 4056 : cluster [DBG] pgmap v3496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:21.985570+0000 mgr.smithi067.rdualw (mgr.24569) 4056 : cluster [DBG] pgmap v3496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:23.986195+0000 mgr.smithi067.rdualw (mgr.24569) 4057 : cluster [DBG] pgmap v3497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:23.986195+0000 mgr.smithi067.rdualw (mgr.24569) 4057 : cluster [DBG] pgmap v3497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:25.987256+0000 mgr.smithi067.rdualw (mgr.24569) 4058 : cluster [DBG] pgmap v3498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:25:26.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:25.987256+0000 mgr.smithi067.rdualw (mgr.24569) 4058 : cluster [DBG] pgmap v3498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:25:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:27.987837+0000 mgr.smithi067.rdualw (mgr.24569) 4059 : cluster [DBG] pgmap v3499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:27.987837+0000 mgr.smithi067.rdualw (mgr.24569) 4059 : cluster [DBG] pgmap v3499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:29.988400+0000 mgr.smithi067.rdualw (mgr.24569) 4060 : cluster [DBG] pgmap v3500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:29.988400+0000 mgr.smithi067.rdualw (mgr.24569) 4060 : cluster [DBG] pgmap v3500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:31.989285+0000 mgr.smithi067.rdualw (mgr.24569) 4061 : cluster [DBG] pgmap v3501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:31.989285+0000 mgr.smithi067.rdualw (mgr.24569) 4061 : cluster [DBG] pgmap v3501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:33.989918+0000 mgr.smithi067.rdualw (mgr.24569) 4062 : cluster [DBG] pgmap v3502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:33.989918+0000 mgr.smithi067.rdualw (mgr.24569) 4062 : cluster [DBG] pgmap v3502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:25:35.060272+0000 mon.smithi067 (mon.1) 642 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:25:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:25:35.060503+0000 mon.smithi061 (mon.0) 987 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:25:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:25:35.060529+0000 mon.smithi067 (mon.1) 643 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:25:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:25:35.060970+0000 mon.smithi061 (mon.0) 988 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:25:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:25:35.060272+0000 mon.smithi067 (mon.1) 642 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:25:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:25:35.060503+0000 mon.smithi061 (mon.0) 987 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:25:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:25:35.060529+0000 mon.smithi067 (mon.1) 643 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:25:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:25:35.060970+0000 mon.smithi061 (mon.0) 988 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:25:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:35.990789+0000 mgr.smithi067.rdualw (mgr.24569) 4063 : cluster [DBG] pgmap v3503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:25:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:35.990789+0000 mgr.smithi067.rdualw (mgr.24569) 4063 : cluster [DBG] pgmap v3503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:25:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:37.991261+0000 mgr.smithi067.rdualw (mgr.24569) 4064 : cluster [DBG] pgmap v3504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:37.991261+0000 mgr.smithi067.rdualw (mgr.24569) 4064 : cluster [DBG] pgmap v3504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:25:40.000056+0000 mon.smithi067 (mon.1) 644 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:25:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:25:40.001490+0000 mon.smithi067 (mon.1) 645 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:25:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:25:40.002404+0000 mon.smithi067 (mon.1) 646 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:25:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:25:40.000056+0000 mon.smithi067 (mon.1) 644 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:25:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:25:40.001490+0000 mon.smithi067 (mon.1) 645 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:25:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:25:40.002404+0000 mon.smithi067 (mon.1) 646 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:25:41.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:39.991849+0000 mgr.smithi067.rdualw (mgr.24569) 4065 : cluster [DBG] pgmap v3505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:41.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:25:40.003248+0000 mgr.smithi067.rdualw (mgr.24569) 4066 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:25:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:39.991849+0000 mgr.smithi067.rdualw (mgr.24569) 4065 : cluster [DBG] pgmap v3505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:25:40.003248+0000 mgr.smithi067.rdualw (mgr.24569) 4066 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:25:42.744 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:25:43.039 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:25:43.039 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 3m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:25:43.040 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (115m) 3m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:25:43.040 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (115m) 3m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:25:43.040 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 3m ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:25:43.040 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (116m) 3m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:25:43.040 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (116m) 3m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:25:43.041 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (117m) 3m ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:25:43.041 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (117m) 3m ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:25:43.041 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (116m) 3m ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:25:43.041 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (116m) 3m ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:25:43.042 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (117m) 3m ago 117m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:25:43.042 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (117m) 3m ago 117m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:25:43.042 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 3m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:25:43.042 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 3m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:25:43.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (106m) 3m ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:25:43.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 3m ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:25:43.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 3m ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:25:43.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 3m ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:25:43.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 3m ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:25:43.044 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 3m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:25:43.044 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 3m ago 2h 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:25:43.044 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 3m ago 2h 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:25:43.044 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 3m ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:25:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:41.992910+0000 mgr.smithi067.rdualw (mgr.24569) 4067 : cluster [DBG] pgmap v3506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:43.389 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:25:43.389 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:25:43.389 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:25:43.390 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:25:43.390 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:25:43.390 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:25:43.390 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:25:43.391 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:25:43.391 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:25:43.391 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:25:43.391 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:25:43.391 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:25:43.392 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:25:43.392 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:25:43.392 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:25:43.392 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:25:43.393 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:25:43.393 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:25:43.393 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:25:43.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:41.992910+0000 mgr.smithi067.rdualw (mgr.24569) 4067 : cluster [DBG] pgmap v3506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:25:42.730201+0000 mgr.smithi067.rdualw (mgr.24569) 4068 : audit [DBG] from='client.36850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:25:44.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:25:43.021414+0000 mgr.smithi067.rdualw (mgr.24569) 4069 : audit [DBG] from='client.36854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:25:44.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:25:43.240666+0000 mon.smithi061 (mon.0) 989 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:25:44.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:25:43.387339+0000 mon.smithi061 (mon.0) 990 : audit [DBG] from='client.? 172.21.15.61:0/1012219514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:25:44.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:25:43.650671+0000 mon.smithi061 (mon.0) 991 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:25:44.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:25:43.659901+0000 mon.smithi061 (mon.0) 992 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:25:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:25:42.730201+0000 mgr.smithi067.rdualw (mgr.24569) 4068 : audit [DBG] from='client.36850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:25:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:25:43.021414+0000 mgr.smithi067.rdualw (mgr.24569) 4069 : audit [DBG] from='client.36854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:25:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:25:43.240666+0000 mon.smithi061 (mon.0) 989 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:25:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:25:43.387339+0000 mon.smithi061 (mon.0) 990 : audit [DBG] from='client.? 172.21.15.61:0/1012219514' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:25:44.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:25:43.650671+0000 mon.smithi061 (mon.0) 991 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:25:44.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:25:43.659901+0000 mon.smithi061 (mon.0) 992 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:25:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:43.993507+0000 mgr.smithi067.rdualw (mgr.24569) 4070 : cluster [DBG] pgmap v3507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:43.993507+0000 mgr.smithi067.rdualw (mgr.24569) 4070 : cluster [DBG] pgmap v3507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:45.994464+0000 mgr.smithi067.rdualw (mgr.24569) 4071 : cluster [DBG] pgmap v3508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:25:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:45.994464+0000 mgr.smithi067.rdualw (mgr.24569) 4071 : cluster [DBG] pgmap v3508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:25:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:47.994927+0000 mgr.smithi067.rdualw (mgr.24569) 4072 : cluster [DBG] pgmap v3509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:47.994927+0000 mgr.smithi067.rdualw (mgr.24569) 4072 : cluster [DBG] pgmap v3509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:51.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:49.995396+0000 mgr.smithi067.rdualw (mgr.24569) 4073 : cluster [DBG] pgmap v3510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:49.995396+0000 mgr.smithi067.rdualw (mgr.24569) 4073 : cluster [DBG] pgmap v3510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:51.996421+0000 mgr.smithi067.rdualw (mgr.24569) 4074 : cluster [DBG] pgmap v3511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:51.996421+0000 mgr.smithi067.rdualw (mgr.24569) 4074 : cluster [DBG] pgmap v3511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:53.997139+0000 mgr.smithi067.rdualw (mgr.24569) 4075 : cluster [DBG] pgmap v3512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:53.997139+0000 mgr.smithi067.rdualw (mgr.24569) 4075 : cluster [DBG] pgmap v3512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:55.998030+0000 mgr.smithi067.rdualw (mgr.24569) 4076 : cluster [DBG] pgmap v3513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:25:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:55.998030+0000 mgr.smithi067.rdualw (mgr.24569) 4076 : cluster [DBG] pgmap v3513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:25:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:25:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:57.998569+0000 mgr.smithi067.rdualw (mgr.24569) 4077 : cluster [DBG] pgmap v3514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:25:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:25:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:57.998569+0000 mgr.smithi067.rdualw (mgr.24569) 4077 : cluster [DBG] pgmap v3514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:01.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:25:59.999205+0000 mgr.smithi067.rdualw (mgr.24569) 4078 : cluster [DBG] pgmap v3515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:25:59.999205+0000 mgr.smithi067.rdualw (mgr.24569) 4078 : cluster [DBG] pgmap v3515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:02.000238+0000 mgr.smithi067.rdualw (mgr.24569) 4079 : cluster [DBG] pgmap v3516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:02.000238+0000 mgr.smithi067.rdualw (mgr.24569) 4079 : cluster [DBG] pgmap v3516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:04.000841+0000 mgr.smithi067.rdualw (mgr.24569) 4080 : cluster [DBG] pgmap v3517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:04.000841+0000 mgr.smithi067.rdualw (mgr.24569) 4080 : cluster [DBG] pgmap v3517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:06.001639+0000 mgr.smithi067.rdualw (mgr.24569) 4081 : cluster [DBG] pgmap v3518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:26:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:06.001639+0000 mgr.smithi067.rdualw (mgr.24569) 4081 : cluster [DBG] pgmap v3518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:26:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:08.002320+0000 mgr.smithi067.rdualw (mgr.24569) 4082 : cluster [DBG] pgmap v3519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:08.002320+0000 mgr.smithi067.rdualw (mgr.24569) 4082 : cluster [DBG] pgmap v3519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:10.003052+0000 mgr.smithi067.rdualw (mgr.24569) 4083 : cluster [DBG] pgmap v3520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:10.003052+0000 mgr.smithi067.rdualw (mgr.24569) 4083 : cluster [DBG] pgmap v3520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:12.004022+0000 mgr.smithi067.rdualw (mgr.24569) 4084 : cluster [DBG] pgmap v3521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:12.004022+0000 mgr.smithi067.rdualw (mgr.24569) 4084 : cluster [DBG] pgmap v3521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:13.695 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:26:13.986 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:26:13.986 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 3m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:26:13.987 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (116m) 3m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:26:13.987 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (116m) 3m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:26:13.987 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 3m ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:26:13.987 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (116m) 3m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:26:13.988 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (116m) 3m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:26:13.988 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (117m) 3m ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:26:13.988 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (117m) 3m ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:26:13.988 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (117m) 3m ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:26:13.989 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (117m) 3m ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:26:13.989 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (118m) 3m ago 118m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:26:13.989 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (118m) 3m ago 118m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:26:13.989 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 3m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:26:13.990 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 3m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:26:13.990 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (107m) 3m ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:26:13.990 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 3m ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:26:13.990 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 3m ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:26:13.991 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 3m ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:26:13.991 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 3m ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:26:13.991 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 3m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:26:13.991 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 3m ago 2h 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:26:13.992 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 3m ago 2h 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:26:13.992 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 3m ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:26:14.324 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:26:14.325 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:26:14.325 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:26:14.325 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:26:14.325 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:26:14.326 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:26:14.326 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:26:14.326 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:26:14.326 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:26:14.327 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:26:14.327 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:26:14.327 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:26:14.327 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:26:14.328 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:26:14.328 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:26:14.328 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:26:14.328 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:26:14.328 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:26:14.329 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:26:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:26:13.681926+0000 mgr.smithi067.rdualw (mgr.24569) 4085 : audit [DBG] from='client.36862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:26:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:26:13.968413+0000 mgr.smithi067.rdualw (mgr.24569) 4086 : audit [DBG] from='client.36866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:26:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:14.004715+0000 mgr.smithi067.rdualw (mgr.24569) 4087 : cluster [DBG] pgmap v3522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:15.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:26:14.323053+0000 mon.smithi061 (mon.0) 993 : audit [DBG] from='client.? 172.21.15.61:0/551980785' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:26:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:26:13.681926+0000 mgr.smithi067.rdualw (mgr.24569) 4085 : audit [DBG] from='client.36862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:26:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:26:13.968413+0000 mgr.smithi067.rdualw (mgr.24569) 4086 : audit [DBG] from='client.36866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:26:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:14.004715+0000 mgr.smithi067.rdualw (mgr.24569) 4087 : cluster [DBG] pgmap v3522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:26:14.323053+0000 mon.smithi061 (mon.0) 993 : audit [DBG] from='client.? 172.21.15.61:0/551980785' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:26:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:16.005738+0000 mgr.smithi067.rdualw (mgr.24569) 4088 : cluster [DBG] pgmap v3523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:26:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:16.005738+0000 mgr.smithi067.rdualw (mgr.24569) 4088 : cluster [DBG] pgmap v3523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:26:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:18.006263+0000 mgr.smithi067.rdualw (mgr.24569) 4089 : cluster [DBG] pgmap v3524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:18.006263+0000 mgr.smithi067.rdualw (mgr.24569) 4089 : cluster [DBG] pgmap v3524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:21.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:20.007067+0000 mgr.smithi067.rdualw (mgr.24569) 4090 : cluster [DBG] pgmap v3525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:20.007067+0000 mgr.smithi067.rdualw (mgr.24569) 4090 : cluster [DBG] pgmap v3525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:22.008077+0000 mgr.smithi067.rdualw (mgr.24569) 4091 : cluster [DBG] pgmap v3526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:23.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:22.008077+0000 mgr.smithi067.rdualw (mgr.24569) 4091 : cluster [DBG] pgmap v3526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:24.008825+0000 mgr.smithi067.rdualw (mgr.24569) 4092 : cluster [DBG] pgmap v3527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:24.008825+0000 mgr.smithi067.rdualw (mgr.24569) 4092 : cluster [DBG] pgmap v3527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:26.009716+0000 mgr.smithi067.rdualw (mgr.24569) 4093 : cluster [DBG] pgmap v3528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:26:26.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:26.009716+0000 mgr.smithi067.rdualw (mgr.24569) 4093 : cluster [DBG] pgmap v3528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:26:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:28.010234+0000 mgr.smithi067.rdualw (mgr.24569) 4094 : cluster [DBG] pgmap v3529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:29.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:28.010234+0000 mgr.smithi067.rdualw (mgr.24569) 4094 : cluster [DBG] pgmap v3529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:30.011011+0000 mgr.smithi067.rdualw (mgr.24569) 4095 : cluster [DBG] pgmap v3530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:31.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:30.011011+0000 mgr.smithi067.rdualw (mgr.24569) 4095 : cluster [DBG] pgmap v3530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:32.012058+0000 mgr.smithi067.rdualw (mgr.24569) 4096 : cluster [DBG] pgmap v3531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:33.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:32.012058+0000 mgr.smithi067.rdualw (mgr.24569) 4096 : cluster [DBG] pgmap v3531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:34.012868+0000 mgr.smithi067.rdualw (mgr.24569) 4097 : cluster [DBG] pgmap v3532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:26:35.065791+0000 mon.smithi067 (mon.1) 647 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:26:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:26:35.066053+0000 mon.smithi067 (mon.1) 648 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:26:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:26:35.066164+0000 mon.smithi061 (mon.0) 994 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:26:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:26:35.066502+0000 mon.smithi061 (mon.0) 995 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:26:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:34.012868+0000 mgr.smithi067.rdualw (mgr.24569) 4097 : cluster [DBG] pgmap v3532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:26:35.065791+0000 mon.smithi067 (mon.1) 647 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:26:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:26:35.066053+0000 mon.smithi067 (mon.1) 648 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:26:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:26:35.066164+0000 mon.smithi061 (mon.0) 994 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:26:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:26:35.066502+0000 mon.smithi061 (mon.0) 995 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:26:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:36.013842+0000 mgr.smithi067.rdualw (mgr.24569) 4098 : cluster [DBG] pgmap v3533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:26:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:36.013842+0000 mgr.smithi067.rdualw (mgr.24569) 4098 : cluster [DBG] pgmap v3533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:26:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:38.014339+0000 mgr.smithi067.rdualw (mgr.24569) 4099 : cluster [DBG] pgmap v3534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:39.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:38.014339+0000 mgr.smithi067.rdualw (mgr.24569) 4099 : cluster [DBG] pgmap v3534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:40.014925+0000 mgr.smithi067.rdualw (mgr.24569) 4100 : cluster [DBG] pgmap v3535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:40.014925+0000 mgr.smithi067.rdualw (mgr.24569) 4100 : cluster [DBG] pgmap v3535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:42.015785+0000 mgr.smithi067.rdualw (mgr.24569) 4101 : cluster [DBG] pgmap v3536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:43.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:42.015785+0000 mgr.smithi067.rdualw (mgr.24569) 4101 : cluster [DBG] pgmap v3536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:44.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:26:43.664678+0000 mon.smithi067 (mon.1) 649 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:26:44.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:26:43.666173+0000 mon.smithi067 (mon.1) 650 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:26:44.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:26:43.667144+0000 mon.smithi067 (mon.1) 651 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:26:44.352 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:26:43.664678+0000 mon.smithi067 (mon.1) 649 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:26:44.353 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:26:43.666173+0000 mon.smithi067 (mon.1) 650 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:26:44.353 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:26:43.667144+0000 mon.smithi067 (mon.1) 651 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:26:44.633 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:26:44.926 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:26:44.926 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 4m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:26:44.926 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (116m) 4m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:26:44.927 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (116m) 4m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:26:44.927 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 4m ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:26:44.927 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (117m) 4m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:26:44.927 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (117m) 4m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:26:44.927 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (118m) 4m ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:26:44.928 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (118m) 4m ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:26:44.928 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (117m) 4m ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:26:44.928 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (117m) 4m ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:26:44.928 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (118m) 4m ago 118m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:26:44.929 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (118m) 4m ago 118m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:26:44.929 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 4m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:26:44.929 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 4m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:26:44.929 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (107m) 4m ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:26:44.929 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 4m ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:26:44.930 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 4m ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:26:44.930 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 4m ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:26:44.930 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 4m ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:26:44.930 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 4m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:26:44.931 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 4m ago 2h 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:26:44.931 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 4m ago 2h 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:26:44.931 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 4m ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:26:45.134 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:26:43.668020+0000 mgr.smithi067.rdualw (mgr.24569) 4102 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:26:45.134 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:44.016331+0000 mgr.smithi067.rdualw (mgr.24569) 4103 : cluster [DBG] pgmap v3537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:45.269 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:26:45.270 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:26:45.270 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:26:45.270 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:26:45.271 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:26:45.271 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:26:45.271 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:26:45.271 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:26:45.271 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:26:45.272 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:26:45.272 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:26:45.272 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:26:45.272 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:26:45.273 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:26:45.273 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:26:45.273 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:26:45.273 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:26:45.274 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:26:45.274 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:26:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:26:43.668020+0000 mgr.smithi067.rdualw (mgr.24569) 4102 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:26:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:44.016331+0000 mgr.smithi067.rdualw (mgr.24569) 4103 : cluster [DBG] pgmap v3537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:46.237 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:26:44.617357+0000 mgr.smithi067.rdualw (mgr.24569) 4104 : audit [DBG] from='client.36874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:26:46.238 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:26:44.908924+0000 mgr.smithi067.rdualw (mgr.24569) 4105 : audit [DBG] from='client.36878 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:26:46.238 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:26:45.268122+0000 mon.smithi061 (mon.0) 996 : audit [DBG] from='client.? 172.21.15.61:0/3652448324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:26:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:26:44.617357+0000 mgr.smithi067.rdualw (mgr.24569) 4104 : audit [DBG] from='client.36874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:26:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:26:44.908924+0000 mgr.smithi067.rdualw (mgr.24569) 4105 : audit [DBG] from='client.36878 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:26:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:26:45.268122+0000 mon.smithi061 (mon.0) 996 : audit [DBG] from='client.? 172.21.15.61:0/3652448324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:26:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:46.017058+0000 mgr.smithi067.rdualw (mgr.24569) 4106 : cluster [DBG] pgmap v3538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:26:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:26:46.571971+0000 mon.smithi061 (mon.0) 997 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:26:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:26:46.863996+0000 mon.smithi061 (mon.0) 998 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:26:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:26:46.869466+0000 mon.smithi061 (mon.0) 999 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:26:47.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:46.017058+0000 mgr.smithi067.rdualw (mgr.24569) 4106 : cluster [DBG] pgmap v3538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:26:47.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:26:46.571971+0000 mon.smithi061 (mon.0) 997 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:26:47.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:26:46.863996+0000 mon.smithi061 (mon.0) 998 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:26:47.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:26:46.869466+0000 mon.smithi061 (mon.0) 999 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:26:49.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:48.017583+0000 mgr.smithi067.rdualw (mgr.24569) 4107 : cluster [DBG] pgmap v3539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:48.017583+0000 mgr.smithi067.rdualw (mgr.24569) 4107 : cluster [DBG] pgmap v3539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:51.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:50.018281+0000 mgr.smithi067.rdualw (mgr.24569) 4108 : cluster [DBG] pgmap v3540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:51.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:50.018281+0000 mgr.smithi067.rdualw (mgr.24569) 4108 : cluster [DBG] pgmap v3540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:52.019273+0000 mgr.smithi067.rdualw (mgr.24569) 4109 : cluster [DBG] pgmap v3541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:53.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:52.019273+0000 mgr.smithi067.rdualw (mgr.24569) 4109 : cluster [DBG] pgmap v3541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:54.019916+0000 mgr.smithi067.rdualw (mgr.24569) 4110 : cluster [DBG] pgmap v3542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:55.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:54.019916+0000 mgr.smithi067.rdualw (mgr.24569) 4110 : cluster [DBG] pgmap v3542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:56.020738+0000 mgr.smithi067.rdualw (mgr.24569) 4111 : cluster [DBG] pgmap v3543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:26:56.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:56.020738+0000 mgr.smithi067.rdualw (mgr.24569) 4111 : cluster [DBG] pgmap v3543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:26:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:26:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:26:58.021350+0000 mgr.smithi067.rdualw (mgr.24569) 4112 : cluster [DBG] pgmap v3544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:26:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:26:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:26:58.021350+0000 mgr.smithi067.rdualw (mgr.24569) 4112 : cluster [DBG] pgmap v3544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:01.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:00.021982+0000 mgr.smithi067.rdualw (mgr.24569) 4113 : cluster [DBG] pgmap v3545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:01.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:00.021982+0000 mgr.smithi067.rdualw (mgr.24569) 4113 : cluster [DBG] pgmap v3545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:02.023011+0000 mgr.smithi067.rdualw (mgr.24569) 4114 : cluster [DBG] pgmap v3546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:03.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:02.023011+0000 mgr.smithi067.rdualw (mgr.24569) 4114 : cluster [DBG] pgmap v3546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:04.023709+0000 mgr.smithi067.rdualw (mgr.24569) 4115 : cluster [DBG] pgmap v3547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:04.023709+0000 mgr.smithi067.rdualw (mgr.24569) 4115 : cluster [DBG] pgmap v3547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:06.024688+0000 mgr.smithi067.rdualw (mgr.24569) 4116 : cluster [DBG] pgmap v3548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:27:06.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:06.024688+0000 mgr.smithi067.rdualw (mgr.24569) 4116 : cluster [DBG] pgmap v3548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:27:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:08.025213+0000 mgr.smithi067.rdualw (mgr.24569) 4117 : cluster [DBG] pgmap v3549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:08.025213+0000 mgr.smithi067.rdualw (mgr.24569) 4117 : cluster [DBG] pgmap v3549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:10.025919+0000 mgr.smithi067.rdualw (mgr.24569) 4118 : cluster [DBG] pgmap v3550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:10.025919+0000 mgr.smithi067.rdualw (mgr.24569) 4118 : cluster [DBG] pgmap v3550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:12.026971+0000 mgr.smithi067.rdualw (mgr.24569) 4119 : cluster [DBG] pgmap v3551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:13.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:12.026971+0000 mgr.smithi067.rdualw (mgr.24569) 4119 : cluster [DBG] pgmap v3551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:14.027718+0000 mgr.smithi067.rdualw (mgr.24569) 4120 : cluster [DBG] pgmap v3552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:15.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:14.027718+0000 mgr.smithi067.rdualw (mgr.24569) 4120 : cluster [DBG] pgmap v3552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:15.576 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:27:15.875 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:27:15.875 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 4m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:27:15.876 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (117m) 4m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:27:15.876 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (117m) 4m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:27:15.876 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 4m ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:27:15.876 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (117m) 4m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:27:15.877 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (117m) 4m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:27:15.877 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (118m) 4m ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:27:15.877 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (118m) 4m ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:27:15.877 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (118m) 4m ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:27:15.877 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (118m) 4m ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:27:15.878 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (119m) 4m ago 119m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:27:15.878 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (119m) 4m ago 119m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:27:15.878 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 4m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:27:15.878 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 4m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:27:15.879 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (108m) 4m ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:27:15.879 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 4m ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:27:15.879 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 4m ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:27:15.879 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 4m ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:27:15.879 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 4m ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:27:15.880 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 4m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:27:15.880 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 4m ago 2h 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:27:15.880 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 4m ago 2h 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:27:15.880 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 4m ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:27:16.219 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:27:16.220 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:27:16.220 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:27:16.220 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:27:16.220 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:27:16.221 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:27:16.221 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:27:16.221 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:27:16.221 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:27:16.221 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:27:16.222 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:27:16.222 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:27:16.222 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:27:16.222 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:27:16.223 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:27:16.223 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:27:16.223 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:27:16.223 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:27:16.223 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:27:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:27:15.562010+0000 mgr.smithi067.rdualw (mgr.24569) 4121 : audit [DBG] from='client.36886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:27:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:27:15.857442+0000 mgr.smithi067.rdualw (mgr.24569) 4122 : audit [DBG] from='client.36890 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:27:16.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:16.028775+0000 mgr.smithi067.rdualw (mgr.24569) 4123 : cluster [DBG] pgmap v3553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:27:16.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:27:16.217998+0000 mon.smithi061 (mon.0) 1000 : audit [DBG] from='client.? 172.21.15.61:0/2689237989' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:27:16.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:27:15.562010+0000 mgr.smithi067.rdualw (mgr.24569) 4121 : audit [DBG] from='client.36886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:27:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:27:15.857442+0000 mgr.smithi067.rdualw (mgr.24569) 4122 : audit [DBG] from='client.36890 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:27:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:16.028775+0000 mgr.smithi067.rdualw (mgr.24569) 4123 : cluster [DBG] pgmap v3553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:27:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:27:16.217998+0000 mon.smithi061 (mon.0) 1000 : audit [DBG] from='client.? 172.21.15.61:0/2689237989' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:27:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:18.029367+0000 mgr.smithi067.rdualw (mgr.24569) 4124 : cluster [DBG] pgmap v3554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:19.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:18.029367+0000 mgr.smithi067.rdualw (mgr.24569) 4124 : cluster [DBG] pgmap v3554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:21.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:20.030049+0000 mgr.smithi067.rdualw (mgr.24569) 4125 : cluster [DBG] pgmap v3555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:21.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:20.030049+0000 mgr.smithi067.rdualw (mgr.24569) 4125 : cluster [DBG] pgmap v3555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:22.030940+0000 mgr.smithi067.rdualw (mgr.24569) 4126 : cluster [DBG] pgmap v3556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:23.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:22.030940+0000 mgr.smithi067.rdualw (mgr.24569) 4126 : cluster [DBG] pgmap v3556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:24.031649+0000 mgr.smithi067.rdualw (mgr.24569) 4127 : cluster [DBG] pgmap v3557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:25.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:24.031649+0000 mgr.smithi067.rdualw (mgr.24569) 4127 : cluster [DBG] pgmap v3557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:26.032718+0000 mgr.smithi067.rdualw (mgr.24569) 4128 : cluster [DBG] pgmap v3558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:27:26.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:26.032718+0000 mgr.smithi067.rdualw (mgr.24569) 4128 : cluster [DBG] pgmap v3558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:27:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:28.033260+0000 mgr.smithi067.rdualw (mgr.24569) 4129 : cluster [DBG] pgmap v3559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:29.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:28.033260+0000 mgr.smithi067.rdualw (mgr.24569) 4129 : cluster [DBG] pgmap v3559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:31.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:30.033948+0000 mgr.smithi067.rdualw (mgr.24569) 4130 : cluster [DBG] pgmap v3560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:31.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:30.033948+0000 mgr.smithi067.rdualw (mgr.24569) 4130 : cluster [DBG] pgmap v3560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:32.034816+0000 mgr.smithi067.rdualw (mgr.24569) 4131 : cluster [DBG] pgmap v3561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:33.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:32.034816+0000 mgr.smithi067.rdualw (mgr.24569) 4131 : cluster [DBG] pgmap v3561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:34.035438+0000 mgr.smithi067.rdualw (mgr.24569) 4132 : cluster [DBG] pgmap v3562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:27:35.071085+0000 mon.smithi067 (mon.1) 652 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:27:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:27:35.071319+0000 mon.smithi067 (mon.1) 653 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:27:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:27:35.071405+0000 mon.smithi061 (mon.0) 1001 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:27:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:27:35.071688+0000 mon.smithi061 (mon.0) 1002 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:27:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:34.035438+0000 mgr.smithi067.rdualw (mgr.24569) 4132 : cluster [DBG] pgmap v3562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:27:35.071085+0000 mon.smithi067 (mon.1) 652 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:27:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:27:35.071319+0000 mon.smithi067 (mon.1) 653 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:27:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:27:35.071405+0000 mon.smithi061 (mon.0) 1001 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:27:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:27:35.071688+0000 mon.smithi061 (mon.0) 1002 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:27:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:36.036229+0000 mgr.smithi067.rdualw (mgr.24569) 4133 : cluster [DBG] pgmap v3563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:27:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:36.036229+0000 mgr.smithi067.rdualw (mgr.24569) 4133 : cluster [DBG] pgmap v3563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:27:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:38.036669+0000 mgr.smithi067.rdualw (mgr.24569) 4134 : cluster [DBG] pgmap v3564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:39.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:38.036669+0000 mgr.smithi067.rdualw (mgr.24569) 4134 : cluster [DBG] pgmap v3564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:41.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:40.037383+0000 mgr.smithi067.rdualw (mgr.24569) 4135 : cluster [DBG] pgmap v3565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:41.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:40.037383+0000 mgr.smithi067.rdualw (mgr.24569) 4135 : cluster [DBG] pgmap v3565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:42.038433+0000 mgr.smithi067.rdualw (mgr.24569) 4136 : cluster [DBG] pgmap v3566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:43.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:42.038433+0000 mgr.smithi067.rdualw (mgr.24569) 4136 : cluster [DBG] pgmap v3566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:44.039051+0000 mgr.smithi067.rdualw (mgr.24569) 4137 : cluster [DBG] pgmap v3567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:45.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:44.039051+0000 mgr.smithi067.rdualw (mgr.24569) 4137 : cluster [DBG] pgmap v3567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:46.608 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:27:46.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:46.039936+0000 mgr.smithi067.rdualw (mgr.24569) 4138 : cluster [DBG] pgmap v3568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:27:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:46.039936+0000 mgr.smithi067.rdualw (mgr.24569) 4138 : cluster [DBG] pgmap v3568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:27:46.902 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:27:46.902 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 5m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:27:46.902 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (118m) 5m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:27:46.903 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (117m) 5m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:27:46.903 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 5m ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:27:46.903 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (118m) 5m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:27:46.903 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (118m) 5m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:27:46.904 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (119m) 5m ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:27:46.904 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (119m) 5m ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:27:46.904 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (118m) 5m ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:27:46.904 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (118m) 5m ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:27:46.905 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (119m) 5m ago 119m 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:27:46.905 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (119m) 5m ago 119m 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:27:46.905 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 5m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:27:46.905 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 5m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:27:46.905 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (108m) 5m ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:27:46.906 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 5m ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:27:46.906 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 5m ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:27:46.906 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 5m ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:27:46.906 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 5m ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:27:46.907 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 5m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:27:46.907 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 5m ago 2h 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:27:46.907 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 5m ago 2h 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:27:46.907 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 5m ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:27:47.268 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:27:47.269 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:27:47.269 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:27:47.269 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:27:47.269 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:27:47.270 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:27:47.270 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:27:47.270 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:27:47.270 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:27:47.271 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:27:47.271 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:27:47.271 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:27:47.271 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:27:47.271 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:27:47.272 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:27:47.272 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:27:47.272 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:27:47.272 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:27:47.273 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:27:47.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:27:46.592240+0000 mgr.smithi067.rdualw (mgr.24569) 4139 : audit [DBG] from='client.36898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:27:47.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:27:46.872939+0000 mon.smithi067 (mon.1) 654 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:27:47.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:27:46.874452+0000 mon.smithi067 (mon.1) 655 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:27:47.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:27:46.875396+0000 mon.smithi067 (mon.1) 656 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:27:47.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:27:46.876272+0000 mgr.smithi067.rdualw (mgr.24569) 4140 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:27:47.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:27:46.881623+0000 mgr.smithi067.rdualw (mgr.24569) 4141 : audit [DBG] from='client.36902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:27:47.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:27:47.267082+0000 mon.smithi061 (mon.0) 1003 : audit [DBG] from='client.? 172.21.15.61:0/650981105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:27:47.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:27:47.301757+0000 mon.smithi061 (mon.0) 1004 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:27:47.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:27:47.307659+0000 mon.smithi061 (mon.0) 1005 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:27:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:27:46.592240+0000 mgr.smithi067.rdualw (mgr.24569) 4139 : audit [DBG] from='client.36898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:27:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:27:46.872939+0000 mon.smithi067 (mon.1) 654 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:27:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:27:46.874452+0000 mon.smithi067 (mon.1) 655 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:27:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:27:46.875396+0000 mon.smithi067 (mon.1) 656 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:27:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:27:46.876272+0000 mgr.smithi067.rdualw (mgr.24569) 4140 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:27:47.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:27:46.881623+0000 mgr.smithi067.rdualw (mgr.24569) 4141 : audit [DBG] from='client.36902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:27:47.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:27:47.267082+0000 mon.smithi061 (mon.0) 1003 : audit [DBG] from='client.? 172.21.15.61:0/650981105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:27:47.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:27:47.301757+0000 mon.smithi061 (mon.0) 1004 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:27:47.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:27:47.307659+0000 mon.smithi061 (mon.0) 1005 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:27:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:48.040431+0000 mgr.smithi067.rdualw (mgr.24569) 4142 : cluster [DBG] pgmap v3569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:48.040431+0000 mgr.smithi067.rdualw (mgr.24569) 4142 : cluster [DBG] pgmap v3569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:51.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:50.041140+0000 mgr.smithi067.rdualw (mgr.24569) 4143 : cluster [DBG] pgmap v3570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:51.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:50.041140+0000 mgr.smithi067.rdualw (mgr.24569) 4143 : cluster [DBG] pgmap v3570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:52.042242+0000 mgr.smithi067.rdualw (mgr.24569) 4144 : cluster [DBG] pgmap v3571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:53.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:52.042242+0000 mgr.smithi067.rdualw (mgr.24569) 4144 : cluster [DBG] pgmap v3571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:55.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:54.042998+0000 mgr.smithi067.rdualw (mgr.24569) 4145 : cluster [DBG] pgmap v3572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:54.042998+0000 mgr.smithi067.rdualw (mgr.24569) 4145 : cluster [DBG] pgmap v3572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:56.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:56.043989+0000 mgr.smithi067.rdualw (mgr.24569) 4146 : cluster [DBG] pgmap v3573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:27:56.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:56.043989+0000 mgr.smithi067.rdualw (mgr.24569) 4146 : cluster [DBG] pgmap v3573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:27:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:27:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:27:58.044698+0000 mgr.smithi067.rdualw (mgr.24569) 4147 : cluster [DBG] pgmap v3574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:27:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:27:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:27:58.044698+0000 mgr.smithi067.rdualw (mgr.24569) 4147 : cluster [DBG] pgmap v3574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:01.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:00.045479+0000 mgr.smithi067.rdualw (mgr.24569) 4148 : cluster [DBG] pgmap v3575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:01.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:00.045479+0000 mgr.smithi067.rdualw (mgr.24569) 4148 : cluster [DBG] pgmap v3575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:02.046345+0000 mgr.smithi067.rdualw (mgr.24569) 4149 : cluster [DBG] pgmap v3576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:03.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:02.046345+0000 mgr.smithi067.rdualw (mgr.24569) 4149 : cluster [DBG] pgmap v3576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:04.047054+0000 mgr.smithi067.rdualw (mgr.24569) 4150 : cluster [DBG] pgmap v3577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:05.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:04.047054+0000 mgr.smithi067.rdualw (mgr.24569) 4150 : cluster [DBG] pgmap v3577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:06.047971+0000 mgr.smithi067.rdualw (mgr.24569) 4151 : cluster [DBG] pgmap v3578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:28:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:06.047971+0000 mgr.smithi067.rdualw (mgr.24569) 4151 : cluster [DBG] pgmap v3578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:28:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:08.048653+0000 mgr.smithi067.rdualw (mgr.24569) 4152 : cluster [DBG] pgmap v3579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:09.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:08.048653+0000 mgr.smithi067.rdualw (mgr.24569) 4152 : cluster [DBG] pgmap v3579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:10.049281+0000 mgr.smithi067.rdualw (mgr.24569) 4153 : cluster [DBG] pgmap v3580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:10.049281+0000 mgr.smithi067.rdualw (mgr.24569) 4153 : cluster [DBG] pgmap v3580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:12.050208+0000 mgr.smithi067.rdualw (mgr.24569) 4154 : cluster [DBG] pgmap v3581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:13.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:12.050208+0000 mgr.smithi067.rdualw (mgr.24569) 4154 : cluster [DBG] pgmap v3581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:14.050950+0000 mgr.smithi067.rdualw (mgr.24569) 4155 : cluster [DBG] pgmap v3582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:15.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:14.050950+0000 mgr.smithi067.rdualw (mgr.24569) 4155 : cluster [DBG] pgmap v3582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:16.051815+0000 mgr.smithi067.rdualw (mgr.24569) 4156 : cluster [DBG] pgmap v3583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:28:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:16.051815+0000 mgr.smithi067.rdualw (mgr.24569) 4156 : cluster [DBG] pgmap v3583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:28:17.631 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:28:17.949 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:28:17.949 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 5m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:28:17.949 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (118m) 5m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:28:17.950 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (118m) 5m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:28:17.950 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 5m ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:28:17.950 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (119m) 5m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:28:17.950 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (118m) 5m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:28:17.951 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 5m ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:28:17.951 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (119m) 5m ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:28:17.952 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (119m) 5m ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:28:17.952 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (119m) 5m ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:28:17.952 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 5m ago 2h 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:28:17.952 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 5m ago 2h 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:28:17.953 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 5m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:28:17.953 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 5m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:28:17.953 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (109m) 5m ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:28:17.953 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 5m ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:28:17.954 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 5m ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:28:17.954 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 5m ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:28:17.954 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 5m ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:28:17.954 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 5m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:28:17.955 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 5m ago 2h 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:28:17.955 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 5m ago 2h 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:28:17.956 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 5m ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:28:18.306 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:28:18.307 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:28:18.307 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:28:18.308 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:28:18.308 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:28:18.308 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:28:18.309 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:28:18.309 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:28:18.309 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:28:18.309 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:28:18.310 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:28:18.310 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:28:18.310 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:28:18.311 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:28:18.311 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:28:18.312 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:28:18.312 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:28:18.312 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:28:18.312 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:28:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:28:17.618053+0000 mgr.smithi067.rdualw (mgr.24569) 4157 : audit [DBG] from='client.36910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:28:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:28:17.931310+0000 mgr.smithi067.rdualw (mgr.24569) 4158 : audit [DBG] from='client.36914 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:28:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:18.052438+0000 mgr.smithi067.rdualw (mgr.24569) 4159 : cluster [DBG] pgmap v3584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:19.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:28:18.304683+0000 mon.smithi061 (mon.0) 1006 : audit [DBG] from='client.? 172.21.15.61:0/1095838545' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:28:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:28:17.618053+0000 mgr.smithi067.rdualw (mgr.24569) 4157 : audit [DBG] from='client.36910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:28:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:28:17.931310+0000 mgr.smithi067.rdualw (mgr.24569) 4158 : audit [DBG] from='client.36914 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:28:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:18.052438+0000 mgr.smithi067.rdualw (mgr.24569) 4159 : cluster [DBG] pgmap v3584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:19.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:28:18.304683+0000 mon.smithi061 (mon.0) 1006 : audit [DBG] from='client.? 172.21.15.61:0/1095838545' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:28:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:20.053044+0000 mgr.smithi067.rdualw (mgr.24569) 4160 : cluster [DBG] pgmap v3585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:21.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:20.053044+0000 mgr.smithi067.rdualw (mgr.24569) 4160 : cluster [DBG] pgmap v3585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:22.053975+0000 mgr.smithi067.rdualw (mgr.24569) 4161 : cluster [DBG] pgmap v3586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:23.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:22.053975+0000 mgr.smithi067.rdualw (mgr.24569) 4161 : cluster [DBG] pgmap v3586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:24.054625+0000 mgr.smithi067.rdualw (mgr.24569) 4162 : cluster [DBG] pgmap v3587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:25.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:24.054625+0000 mgr.smithi067.rdualw (mgr.24569) 4162 : cluster [DBG] pgmap v3587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:26.055503+0000 mgr.smithi067.rdualw (mgr.24569) 4163 : cluster [DBG] pgmap v3588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:28:26.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:26.055503+0000 mgr.smithi067.rdualw (mgr.24569) 4163 : cluster [DBG] pgmap v3588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:28:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:28.056070+0000 mgr.smithi067.rdualw (mgr.24569) 4164 : cluster [DBG] pgmap v3589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:29.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:28.056070+0000 mgr.smithi067.rdualw (mgr.24569) 4164 : cluster [DBG] pgmap v3589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:30.056656+0000 mgr.smithi067.rdualw (mgr.24569) 4165 : cluster [DBG] pgmap v3590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:31.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:30.056656+0000 mgr.smithi067.rdualw (mgr.24569) 4165 : cluster [DBG] pgmap v3590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:32.057715+0000 mgr.smithi067.rdualw (mgr.24569) 4166 : cluster [DBG] pgmap v3591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:33.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:32.057715+0000 mgr.smithi067.rdualw (mgr.24569) 4166 : cluster [DBG] pgmap v3591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:34.058312+0000 mgr.smithi067.rdualw (mgr.24569) 4167 : cluster [DBG] pgmap v3592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:28:35.077907+0000 mon.smithi067 (mon.1) 657 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:28:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:28:35.078188+0000 mon.smithi067 (mon.1) 658 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:28:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:28:35.078237+0000 mon.smithi061 (mon.0) 1007 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:28:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:28:35.078485+0000 mon.smithi061 (mon.0) 1008 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:28:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:34.058312+0000 mgr.smithi067.rdualw (mgr.24569) 4167 : cluster [DBG] pgmap v3592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:28:35.077907+0000 mon.smithi067 (mon.1) 657 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:28:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:28:35.078188+0000 mon.smithi067 (mon.1) 658 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:28:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:28:35.078237+0000 mon.smithi061 (mon.0) 1007 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:28:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:28:35.078485+0000 mon.smithi061 (mon.0) 1008 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:28:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:36.059288+0000 mgr.smithi067.rdualw (mgr.24569) 4168 : cluster [DBG] pgmap v3593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:28:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:36.059288+0000 mgr.smithi067.rdualw (mgr.24569) 4168 : cluster [DBG] pgmap v3593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:28:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:38.059949+0000 mgr.smithi067.rdualw (mgr.24569) 4169 : cluster [DBG] pgmap v3594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:39.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:38.059949+0000 mgr.smithi067.rdualw (mgr.24569) 4169 : cluster [DBG] pgmap v3594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:41.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:40.060703+0000 mgr.smithi067.rdualw (mgr.24569) 4170 : cluster [DBG] pgmap v3595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:40.060703+0000 mgr.smithi067.rdualw (mgr.24569) 4170 : cluster [DBG] pgmap v3595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:42.061551+0000 mgr.smithi067.rdualw (mgr.24569) 4171 : cluster [DBG] pgmap v3596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:43.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:42.061551+0000 mgr.smithi067.rdualw (mgr.24569) 4171 : cluster [DBG] pgmap v3596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:45.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:44.062185+0000 mgr.smithi067.rdualw (mgr.24569) 4172 : cluster [DBG] pgmap v3597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:45.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:44.062185+0000 mgr.smithi067.rdualw (mgr.24569) 4172 : cluster [DBG] pgmap v3597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:46.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:46.063178+0000 mgr.smithi067.rdualw (mgr.24569) 4173 : cluster [DBG] pgmap v3598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:28:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:46.063178+0000 mgr.smithi067.rdualw (mgr.24569) 4173 : cluster [DBG] pgmap v3598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:28:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:28:47.311229+0000 mon.smithi067 (mon.1) 659 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:28:47.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:28:47.312731+0000 mon.smithi067 (mon.1) 660 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:28:47.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:28:47.313716+0000 mon.smithi067 (mon.1) 661 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:28:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:28:47.311229+0000 mon.smithi067 (mon.1) 659 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:28:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:28:47.312731+0000 mon.smithi067 (mon.1) 660 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:28:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:28:47.313716+0000 mon.smithi067 (mon.1) 661 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:28:48.615 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:28:48.909 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:28:48.909 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 6m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:28:48.910 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (119m) 6m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:28:48.910 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (118m) 6m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:28:48.910 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 6m ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:28:48.910 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (119m) 6m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:28:48.911 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (119m) 6m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:28:48.911 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 6m ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:28:48.911 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 6m ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:28:48.911 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 6m ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:28:48.911 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (119m) 6m ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:28:48.912 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 6m ago 2h 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:28:48.912 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 6m ago 2h 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:28:48.912 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 6m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:28:48.912 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 6m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:28:48.913 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (109m) 6m ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:28:48.913 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 6m ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:28:48.914 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 6m ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:28:48.914 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 6m ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:28:48.914 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 6m ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:28:48.914 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 6m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:28:48.915 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 6m ago 2h 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:28:48.915 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 6m ago 2h 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:28:48.915 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 6m ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:28:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:28:47.314583+0000 mgr.smithi067.rdualw (mgr.24569) 4174 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:28:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:28:47.730378+0000 mon.smithi061 (mon.0) 1009 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:28:49.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:28:47.736199+0000 mon.smithi061 (mon.0) 1010 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:28:49.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:48.063633+0000 mgr.smithi067.rdualw (mgr.24569) 4175 : cluster [DBG] pgmap v3599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:28:47.314583+0000 mgr.smithi067.rdualw (mgr.24569) 4174 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:28:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:28:47.730378+0000 mon.smithi061 (mon.0) 1009 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:28:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:28:47.736199+0000 mon.smithi061 (mon.0) 1010 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:28:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:48.063633+0000 mgr.smithi067.rdualw (mgr.24569) 4175 : cluster [DBG] pgmap v3599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:49.249 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:28:49.249 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:28:49.249 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:28:49.250 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:28:49.250 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:28:49.250 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:28:49.250 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:28:49.251 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:28:49.251 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:28:49.251 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:28:49.251 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:28:49.251 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:28:49.252 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:28:49.252 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:28:49.252 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:28:49.252 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:28:49.253 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:28:49.253 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:28:49.253 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:28:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:28:48.601836+0000 mgr.smithi067.rdualw (mgr.24569) 4176 : audit [DBG] from='client.36922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:28:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:28:48.891630+0000 mgr.smithi067.rdualw (mgr.24569) 4177 : audit [DBG] from='client.36926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:28:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:28:49.247597+0000 mon.smithi061 (mon.0) 1011 : audit [DBG] from='client.? 172.21.15.61:0/853824985' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:28:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:28:48.601836+0000 mgr.smithi067.rdualw (mgr.24569) 4176 : audit [DBG] from='client.36922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:28:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:28:48.891630+0000 mgr.smithi067.rdualw (mgr.24569) 4177 : audit [DBG] from='client.36926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:28:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:28:49.247597+0000 mon.smithi061 (mon.0) 1011 : audit [DBG] from='client.? 172.21.15.61:0/853824985' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:28:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:50.064265+0000 mgr.smithi067.rdualw (mgr.24569) 4178 : cluster [DBG] pgmap v3600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:50.064265+0000 mgr.smithi067.rdualw (mgr.24569) 4178 : cluster [DBG] pgmap v3600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:52.065258+0000 mgr.smithi067.rdualw (mgr.24569) 4179 : cluster [DBG] pgmap v3601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:53.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:52.065258+0000 mgr.smithi067.rdualw (mgr.24569) 4179 : cluster [DBG] pgmap v3601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:54.065989+0000 mgr.smithi067.rdualw (mgr.24569) 4180 : cluster [DBG] pgmap v3602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:54.065989+0000 mgr.smithi067.rdualw (mgr.24569) 4180 : cluster [DBG] pgmap v3602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:56.066899+0000 mgr.smithi067.rdualw (mgr.24569) 4181 : cluster [DBG] pgmap v3603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:28:56.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:56.066899+0000 mgr.smithi067.rdualw (mgr.24569) 4181 : cluster [DBG] pgmap v3603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:28:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:28:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:28:58.067482+0000 mgr.smithi067.rdualw (mgr.24569) 4182 : cluster [DBG] pgmap v3604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:28:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:28:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:28:58.067482+0000 mgr.smithi067.rdualw (mgr.24569) 4182 : cluster [DBG] pgmap v3604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:01.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:00.068278+0000 mgr.smithi067.rdualw (mgr.24569) 4183 : cluster [DBG] pgmap v3605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:01.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:00.068278+0000 mgr.smithi067.rdualw (mgr.24569) 4183 : cluster [DBG] pgmap v3605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:03.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:02.069182+0000 mgr.smithi067.rdualw (mgr.24569) 4184 : cluster [DBG] pgmap v3606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:03.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:02.069182+0000 mgr.smithi067.rdualw (mgr.24569) 4184 : cluster [DBG] pgmap v3606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:05.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:04.069806+0000 mgr.smithi067.rdualw (mgr.24569) 4185 : cluster [DBG] pgmap v3607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:05.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:04.069806+0000 mgr.smithi067.rdualw (mgr.24569) 4185 : cluster [DBG] pgmap v3607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:06.070848+0000 mgr.smithi067.rdualw (mgr.24569) 4186 : cluster [DBG] pgmap v3608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:29:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:06.070848+0000 mgr.smithi067.rdualw (mgr.24569) 4186 : cluster [DBG] pgmap v3608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:29:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:08.071363+0000 mgr.smithi067.rdualw (mgr.24569) 4187 : cluster [DBG] pgmap v3609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:09.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:08.071363+0000 mgr.smithi067.rdualw (mgr.24569) 4187 : cluster [DBG] pgmap v3609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:11.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:10.071985+0000 mgr.smithi067.rdualw (mgr.24569) 4188 : cluster [DBG] pgmap v3610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:11.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:10.071985+0000 mgr.smithi067.rdualw (mgr.24569) 4188 : cluster [DBG] pgmap v3610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:13.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:12.072927+0000 mgr.smithi067.rdualw (mgr.24569) 4189 : cluster [DBG] pgmap v3611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:13.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:12.072927+0000 mgr.smithi067.rdualw (mgr.24569) 4189 : cluster [DBG] pgmap v3611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:15.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:14.073682+0000 mgr.smithi067.rdualw (mgr.24569) 4190 : cluster [DBG] pgmap v3612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:15.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:14.073682+0000 mgr.smithi067.rdualw (mgr.24569) 4190 : cluster [DBG] pgmap v3612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:16.074467+0000 mgr.smithi067.rdualw (mgr.24569) 4191 : cluster [DBG] pgmap v3613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:29:16.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:16.074467+0000 mgr.smithi067.rdualw (mgr.24569) 4191 : cluster [DBG] pgmap v3613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:29:19.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:18.075070+0000 mgr.smithi067.rdualw (mgr.24569) 4192 : cluster [DBG] pgmap v3614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:19.558 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:29:19.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:18.075070+0000 mgr.smithi067.rdualw (mgr.24569) 4192 : cluster [DBG] pgmap v3614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:19.850 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:29:19.850 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 6m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:29:19.851 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (119m) 6m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:29:19.851 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (119m) 6m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:29:19.851 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 6m ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:29:19.852 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 6m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:29:19.852 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (119m) 6m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:29:19.852 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 6m ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:29:19.852 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 6m ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:29:19.852 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 6m ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:29:19.853 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 6m ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:29:19.853 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 6m ago 2h 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:29:19.853 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 6m ago 2h 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:29:19.853 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 6m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:29:19.853 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 6m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:29:19.854 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (110m) 6m ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:29:19.854 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 6m ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:29:19.854 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 6m ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:29:19.854 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 6m ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:29:19.855 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 6m ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:29:19.855 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 6m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:29:19.855 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 6m ago 2h 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:29:19.855 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 6m ago 2h 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:29:19.856 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 6m ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:29:20.232 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:29:20.233 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:29:20.233 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:29:20.233 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:29:20.233 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:29:20.233 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:29:20.234 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:29:20.234 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:29:20.234 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:29:20.234 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:29:20.234 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:29:20.235 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:29:20.235 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:29:20.235 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:29:20.235 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:29:20.235 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:29:20.236 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:29:20.236 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:29:20.236 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:29:21.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:29:19.544990+0000 mgr.smithi067.rdualw (mgr.24569) 4193 : audit [DBG] from='client.36934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:29:21.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:29:19.832357+0000 mgr.smithi067.rdualw (mgr.24569) 4194 : audit [DBG] from='client.36938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:29:21.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:20.075757+0000 mgr.smithi067.rdualw (mgr.24569) 4195 : cluster [DBG] pgmap v3615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:21.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:29:20.231035+0000 mon.smithi061 (mon.0) 1012 : audit [DBG] from='client.? 172.21.15.61:0/3218804304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:29:21.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:29:19.544990+0000 mgr.smithi067.rdualw (mgr.24569) 4193 : audit [DBG] from='client.36934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:29:21.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:29:19.832357+0000 mgr.smithi067.rdualw (mgr.24569) 4194 : audit [DBG] from='client.36938 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:29:21.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:20.075757+0000 mgr.smithi067.rdualw (mgr.24569) 4195 : cluster [DBG] pgmap v3615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:21.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:29:20.231035+0000 mon.smithi061 (mon.0) 1012 : audit [DBG] from='client.? 172.21.15.61:0/3218804304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:29:23.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:22.076620+0000 mgr.smithi067.rdualw (mgr.24569) 4196 : cluster [DBG] pgmap v3616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:23.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:22.076620+0000 mgr.smithi067.rdualw (mgr.24569) 4196 : cluster [DBG] pgmap v3616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:25.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:24.077326+0000 mgr.smithi067.rdualw (mgr.24569) 4197 : cluster [DBG] pgmap v3617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:25.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:24.077326+0000 mgr.smithi067.rdualw (mgr.24569) 4197 : cluster [DBG] pgmap v3617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:26.078101+0000 mgr.smithi067.rdualw (mgr.24569) 4198 : cluster [DBG] pgmap v3618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:29:26.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:26.078101+0000 mgr.smithi067.rdualw (mgr.24569) 4198 : cluster [DBG] pgmap v3618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:29:29.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:28.078809+0000 mgr.smithi067.rdualw (mgr.24569) 4199 : cluster [DBG] pgmap v3619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:29.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:28.078809+0000 mgr.smithi067.rdualw (mgr.24569) 4199 : cluster [DBG] pgmap v3619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:31.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:30.079370+0000 mgr.smithi067.rdualw (mgr.24569) 4200 : cluster [DBG] pgmap v3620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:31.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:30.079370+0000 mgr.smithi067.rdualw (mgr.24569) 4200 : cluster [DBG] pgmap v3620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:33.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:32.080314+0000 mgr.smithi067.rdualw (mgr.24569) 4201 : cluster [DBG] pgmap v3621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:33.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:32.080314+0000 mgr.smithi067.rdualw (mgr.24569) 4201 : cluster [DBG] pgmap v3621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:34.080973+0000 mgr.smithi067.rdualw (mgr.24569) 4202 : cluster [DBG] pgmap v3622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:29:35.083318+0000 mon.smithi067 (mon.1) 662 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:29:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:29:35.083604+0000 mon.smithi067 (mon.1) 663 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:29:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:29:35.083781+0000 mon.smithi061 (mon.0) 1013 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:29:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:29:35.084073+0000 mon.smithi061 (mon.0) 1014 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:29:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:34.080973+0000 mgr.smithi067.rdualw (mgr.24569) 4202 : cluster [DBG] pgmap v3622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:29:35.083318+0000 mon.smithi067 (mon.1) 662 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:29:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:29:35.083604+0000 mon.smithi067 (mon.1) 663 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:29:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:29:35.083781+0000 mon.smithi061 (mon.0) 1013 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:29:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:29:35.084073+0000 mon.smithi061 (mon.0) 1014 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:29:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:36.082001+0000 mgr.smithi067.rdualw (mgr.24569) 4203 : cluster [DBG] pgmap v3623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:29:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:36.082001+0000 mgr.smithi067.rdualw (mgr.24569) 4203 : cluster [DBG] pgmap v3623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:29:39.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:38.082523+0000 mgr.smithi067.rdualw (mgr.24569) 4204 : cluster [DBG] pgmap v3624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:39.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:38.082523+0000 mgr.smithi067.rdualw (mgr.24569) 4204 : cluster [DBG] pgmap v3624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:41.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:40.083165+0000 mgr.smithi067.rdualw (mgr.24569) 4205 : cluster [DBG] pgmap v3625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:41.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:40.083165+0000 mgr.smithi067.rdualw (mgr.24569) 4205 : cluster [DBG] pgmap v3625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:43.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:42.084140+0000 mgr.smithi067.rdualw (mgr.24569) 4206 : cluster [DBG] pgmap v3626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:43.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:42.084140+0000 mgr.smithi067.rdualw (mgr.24569) 4206 : cluster [DBG] pgmap v3626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:45.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:44.084872+0000 mgr.smithi067.rdualw (mgr.24569) 4207 : cluster [DBG] pgmap v3627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:45.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:44.084872+0000 mgr.smithi067.rdualw (mgr.24569) 4207 : cluster [DBG] pgmap v3627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:46.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:46.085873+0000 mgr.smithi067.rdualw (mgr.24569) 4208 : cluster [DBG] pgmap v3628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:29:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:46.085873+0000 mgr.smithi067.rdualw (mgr.24569) 4208 : cluster [DBG] pgmap v3628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:29:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:29:47.742431+0000 mon.smithi067 (mon.1) 664 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:29:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:29:47.744581+0000 mon.smithi067 (mon.1) 665 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:29:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:29:47.745630+0000 mon.smithi067 (mon.1) 666 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:29:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:29:47.742431+0000 mon.smithi067 (mon.1) 664 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:29:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:29:47.744581+0000 mon.smithi067 (mon.1) 665 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:29:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:29:47.745630+0000 mon.smithi067 (mon.1) 666 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:29:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:29:47.746587+0000 mgr.smithi067.rdualw (mgr.24569) 4209 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:29:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:48.086338+0000 mgr.smithi067.rdualw (mgr.24569) 4210 : cluster [DBG] pgmap v3629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:29:48.165694+0000 mon.smithi061 (mon.0) 1015 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:29:49.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:29:48.171461+0000 mon.smithi061 (mon.0) 1016 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:29:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:29:47.746587+0000 mgr.smithi067.rdualw (mgr.24569) 4209 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:29:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:48.086338+0000 mgr.smithi067.rdualw (mgr.24569) 4210 : cluster [DBG] pgmap v3629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:29:48.165694+0000 mon.smithi061 (mon.0) 1015 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:29:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:29:48.171461+0000 mon.smithi061 (mon.0) 1016 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:29:50.543 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:29:50.832 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:29:50.833 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 7m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:29:50.833 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 7m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:29:50.833 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (119m) 7m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:29:50.833 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 7m ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:29:50.834 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 7m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:29:50.834 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 7m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:29:50.834 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 7m ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:29:50.834 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 7m ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:29:50.835 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 7m ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:29:50.835 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 7m ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:29:50.835 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 7m ago 2h 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:29:50.835 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 7m ago 2h 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:29:50.836 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 7m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:29:50.836 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 7m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:29:50.836 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (110m) 7m ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:29:50.836 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 7m ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:29:50.837 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 7m ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:29:50.837 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 7m ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:29:50.837 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 7m ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:29:50.837 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 7m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:29:50.838 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 7m ago 2h 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:29:50.838 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 7m ago 2h 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:29:50.838 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 7m ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:29:51.176 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:29:51.177 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:29:51.177 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:29:51.177 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:29:51.177 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:29:51.178 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:29:51.178 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:29:51.178 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:29:51.178 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:29:51.179 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:29:51.179 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:29:51.179 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:29:51.179 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:29:51.179 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:29:51.180 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:29:51.180 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:29:51.180 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:29:51.180 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:29:51.181 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:29:51.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:50.087087+0000 mgr.smithi067.rdualw (mgr.24569) 4211 : cluster [DBG] pgmap v3630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:51.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:50.087087+0000 mgr.smithi067.rdualw (mgr.24569) 4211 : cluster [DBG] pgmap v3630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:29:50.529695+0000 mgr.smithi067.rdualw (mgr.24569) 4212 : audit [DBG] from='client.36946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:29:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:29:50.814732+0000 mgr.smithi067.rdualw (mgr.24569) 4213 : audit [DBG] from='client.36950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:29:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:29:51.175036+0000 mon.smithi061 (mon.0) 1017 : audit [DBG] from='client.? 172.21.15.61:0/3521852164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:29:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:29:50.529695+0000 mgr.smithi067.rdualw (mgr.24569) 4212 : audit [DBG] from='client.36946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:29:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:29:50.814732+0000 mgr.smithi067.rdualw (mgr.24569) 4213 : audit [DBG] from='client.36950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:29:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:29:51.175036+0000 mon.smithi061 (mon.0) 1017 : audit [DBG] from='client.? 172.21.15.61:0/3521852164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:29:53.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:52.088164+0000 mgr.smithi067.rdualw (mgr.24569) 4214 : cluster [DBG] pgmap v3631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:53.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:52.088164+0000 mgr.smithi067.rdualw (mgr.24569) 4214 : cluster [DBG] pgmap v3631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:54.088830+0000 mgr.smithi067.rdualw (mgr.24569) 4215 : cluster [DBG] pgmap v3632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:54.088830+0000 mgr.smithi067.rdualw (mgr.24569) 4215 : cluster [DBG] pgmap v3632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:56.089743+0000 mgr.smithi067.rdualw (mgr.24569) 4216 : cluster [DBG] pgmap v3633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:29:56.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:56.089743+0000 mgr.smithi067.rdualw (mgr.24569) 4216 : cluster [DBG] pgmap v3633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:29:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:29:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:29:58.090452+0000 mgr.smithi067.rdualw (mgr.24569) 4217 : cluster [DBG] pgmap v3634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:29:59.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:29:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:29:58.090452+0000 mgr.smithi067.rdualw (mgr.24569) 4217 : cluster [DBG] pgmap v3634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:00.000104+0000 mon.smithi061 (mon.0) 1018 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T17:30:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:00.000104+0000 mon.smithi061 (mon.0) 1018 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T17:30:01.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:00.091288+0000 mgr.smithi067.rdualw (mgr.24569) 4218 : cluster [DBG] pgmap v3635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:01.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:00.091288+0000 mgr.smithi067.rdualw (mgr.24569) 4218 : cluster [DBG] pgmap v3635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:02.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:02.092242+0000 mgr.smithi067.rdualw (mgr.24569) 4219 : cluster [DBG] pgmap v3636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:02.092242+0000 mgr.smithi067.rdualw (mgr.24569) 4219 : cluster [DBG] pgmap v3636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:05.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:04.092936+0000 mgr.smithi067.rdualw (mgr.24569) 4220 : cluster [DBG] pgmap v3637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:05.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:04.092936+0000 mgr.smithi067.rdualw (mgr.24569) 4220 : cluster [DBG] pgmap v3637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:06.093859+0000 mgr.smithi067.rdualw (mgr.24569) 4221 : cluster [DBG] pgmap v3638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:30:06.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:06.093859+0000 mgr.smithi067.rdualw (mgr.24569) 4221 : cluster [DBG] pgmap v3638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:30:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:08.094373+0000 mgr.smithi067.rdualw (mgr.24569) 4222 : cluster [DBG] pgmap v3639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:09.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:08.094373+0000 mgr.smithi067.rdualw (mgr.24569) 4222 : cluster [DBG] pgmap v3639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:10.095094+0000 mgr.smithi067.rdualw (mgr.24569) 4223 : cluster [DBG] pgmap v3640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:10.095094+0000 mgr.smithi067.rdualw (mgr.24569) 4223 : cluster [DBG] pgmap v3640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:13.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:12.096069+0000 mgr.smithi067.rdualw (mgr.24569) 4224 : cluster [DBG] pgmap v3641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:13.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:12.096069+0000 mgr.smithi067.rdualw (mgr.24569) 4224 : cluster [DBG] pgmap v3641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:14.096807+0000 mgr.smithi067.rdualw (mgr.24569) 4225 : cluster [DBG] pgmap v3642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:14.096807+0000 mgr.smithi067.rdualw (mgr.24569) 4225 : cluster [DBG] pgmap v3642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:16.097632+0000 mgr.smithi067.rdualw (mgr.24569) 4226 : cluster [DBG] pgmap v3643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:30:16.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:16.097632+0000 mgr.smithi067.rdualw (mgr.24569) 4226 : cluster [DBG] pgmap v3643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:30:18.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:18.098253+0000 mgr.smithi067.rdualw (mgr.24569) 4227 : cluster [DBG] pgmap v3644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:18.098253+0000 mgr.smithi067.rdualw (mgr.24569) 4227 : cluster [DBG] pgmap v3644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:20.098910+0000 mgr.smithi067.rdualw (mgr.24569) 4228 : cluster [DBG] pgmap v3645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:20.098910+0000 mgr.smithi067.rdualw (mgr.24569) 4228 : cluster [DBG] pgmap v3645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:21.486 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:30:21.780 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:30:21.780 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 7m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:30:21.780 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 7m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:30:21.780 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 7m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:30:21.781 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 7m ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:30:21.781 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 7m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:30:21.781 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 7m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:30:21.781 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 7m ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:30:21.782 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 7m ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:30:21.782 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 7m ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:30:21.782 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 7m ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:30:21.782 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 7m ago 2h 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:30:21.782 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 7m ago 2h 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:30:21.783 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 7m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:30:21.783 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 7m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:30:21.783 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (111m) 7m ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:30:21.783 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 7m ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:30:21.783 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 7m ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:30:21.784 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 7m ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:30:21.784 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 7m ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:30:21.784 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 7m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:30:21.784 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 7m ago 2h 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:30:21.785 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 7m ago 2h 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:30:21.785 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 7m ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:30:22.118 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:30:22.119 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:30:22.119 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:30:22.119 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:30:22.119 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:30:22.120 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:30:22.120 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:30:22.120 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:30:22.120 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:30:22.121 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:30:22.121 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:30:22.121 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:30:22.121 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:30:22.121 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:30:22.122 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:30:22.122 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:30:22.122 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:30:22.122 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:30:22.123 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:30:22.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:30:21.472744+0000 mgr.smithi067.rdualw (mgr.24569) 4229 : audit [DBG] from='client.36958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:30:22.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:30:21.762348+0000 mgr.smithi067.rdualw (mgr.24569) 4230 : audit [DBG] from='client.36962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:30:22.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:22.099797+0000 mgr.smithi067.rdualw (mgr.24569) 4231 : cluster [DBG] pgmap v3646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:22.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:30:22.116942+0000 mon.smithi061 (mon.0) 1019 : audit [DBG] from='client.? 172.21.15.61:0/1121987527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:30:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:30:21.472744+0000 mgr.smithi067.rdualw (mgr.24569) 4229 : audit [DBG] from='client.36958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:30:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:30:21.762348+0000 mgr.smithi067.rdualw (mgr.24569) 4230 : audit [DBG] from='client.36962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:30:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:22.099797+0000 mgr.smithi067.rdualw (mgr.24569) 4231 : cluster [DBG] pgmap v3646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:30:22.116942+0000 mon.smithi061 (mon.0) 1019 : audit [DBG] from='client.? 172.21.15.61:0/1121987527' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:30:24.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:24.100320+0000 mgr.smithi067.rdualw (mgr.24569) 4232 : cluster [DBG] pgmap v3647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:24.100320+0000 mgr.smithi067.rdualw (mgr.24569) 4232 : cluster [DBG] pgmap v3647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:26.810 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:26.101167+0000 mgr.smithi067.rdualw (mgr.24569) 4233 : cluster [DBG] pgmap v3648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:30:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:26.101167+0000 mgr.smithi067.rdualw (mgr.24569) 4233 : cluster [DBG] pgmap v3648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:30:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:28.101777+0000 mgr.smithi067.rdualw (mgr.24569) 4234 : cluster [DBG] pgmap v3649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:28.101777+0000 mgr.smithi067.rdualw (mgr.24569) 4234 : cluster [DBG] pgmap v3649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:30.102288+0000 mgr.smithi067.rdualw (mgr.24569) 4235 : cluster [DBG] pgmap v3650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:30.102288+0000 mgr.smithi067.rdualw (mgr.24569) 4235 : cluster [DBG] pgmap v3650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:32.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:32.103342+0000 mgr.smithi067.rdualw (mgr.24569) 4236 : cluster [DBG] pgmap v3651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:32.103342+0000 mgr.smithi067.rdualw (mgr.24569) 4236 : cluster [DBG] pgmap v3651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:34.104101+0000 mgr.smithi067.rdualw (mgr.24569) 4237 : cluster [DBG] pgmap v3652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:34.104101+0000 mgr.smithi067.rdualw (mgr.24569) 4237 : cluster [DBG] pgmap v3652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:30:35.088639+0000 mon.smithi067 (mon.1) 667 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:30:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:30:35.088925+0000 mon.smithi061 (mon.0) 1020 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:30:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:30:35.088993+0000 mon.smithi067 (mon.1) 668 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:30:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:30:35.089267+0000 mon.smithi061 (mon.0) 1021 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:30:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:30:35.088639+0000 mon.smithi067 (mon.1) 667 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:30:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:30:35.088925+0000 mon.smithi061 (mon.0) 1020 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:30:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:30:35.088993+0000 mon.smithi067 (mon.1) 668 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:30:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:30:35.089267+0000 mon.smithi061 (mon.0) 1021 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:30:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:36.105024+0000 mgr.smithi067.rdualw (mgr.24569) 4238 : cluster [DBG] pgmap v3653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:30:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:36.105024+0000 mgr.smithi067.rdualw (mgr.24569) 4238 : cluster [DBG] pgmap v3653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:30:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:38.105461+0000 mgr.smithi067.rdualw (mgr.24569) 4239 : cluster [DBG] pgmap v3654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:38.105461+0000 mgr.smithi067.rdualw (mgr.24569) 4239 : cluster [DBG] pgmap v3654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:40.106140+0000 mgr.smithi067.rdualw (mgr.24569) 4240 : cluster [DBG] pgmap v3655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:40.106140+0000 mgr.smithi067.rdualw (mgr.24569) 4240 : cluster [DBG] pgmap v3655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:42.106994+0000 mgr.smithi067.rdualw (mgr.24569) 4241 : cluster [DBG] pgmap v3656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:42.106994+0000 mgr.smithi067.rdualw (mgr.24569) 4241 : cluster [DBG] pgmap v3656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:44.107729+0000 mgr.smithi067.rdualw (mgr.24569) 4242 : cluster [DBG] pgmap v3657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:44.107729+0000 mgr.smithi067.rdualw (mgr.24569) 4242 : cluster [DBG] pgmap v3657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:46.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:46.108822+0000 mgr.smithi067.rdualw (mgr.24569) 4243 : cluster [DBG] pgmap v3658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:30:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:46.108822+0000 mgr.smithi067.rdualw (mgr.24569) 4243 : cluster [DBG] pgmap v3658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:30:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:48.109358+0000 mgr.smithi067.rdualw (mgr.24569) 4244 : cluster [DBG] pgmap v3659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:30:48.175380+0000 mon.smithi067 (mon.1) 669 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:30:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:30:48.176957+0000 mon.smithi067 (mon.1) 670 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:30:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:30:48.178015+0000 mon.smithi067 (mon.1) 671 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:30:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:48.109358+0000 mgr.smithi067.rdualw (mgr.24569) 4244 : cluster [DBG] pgmap v3659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:30:48.175380+0000 mon.smithi067 (mon.1) 669 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:30:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:30:48.176957+0000 mon.smithi067 (mon.1) 670 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:30:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:30:48.178015+0000 mon.smithi067 (mon.1) 671 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:30:49.893 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:30:48.178932+0000 mgr.smithi067.rdualw (mgr.24569) 4245 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:30:49.894 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:30:48.597111+0000 mon.smithi061 (mon.0) 1022 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:30:49.894 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:30:48.602695+0000 mon.smithi061 (mon.0) 1023 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:30:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:30:48.178932+0000 mgr.smithi067.rdualw (mgr.24569) 4245 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:30:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:30:48.597111+0000 mon.smithi061 (mon.0) 1022 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:30:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:30:48.602695+0000 mon.smithi061 (mon.0) 1023 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:30:50.894 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:50.110055+0000 mgr.smithi067.rdualw (mgr.24569) 4246 : cluster [DBG] pgmap v3660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:50.110055+0000 mgr.smithi067.rdualw (mgr.24569) 4246 : cluster [DBG] pgmap v3660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:52.430 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:30:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:52.110975+0000 mgr.smithi067.rdualw (mgr.24569) 4247 : cluster [DBG] pgmap v3661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:52.110975+0000 mgr.smithi067.rdualw (mgr.24569) 4247 : cluster [DBG] pgmap v3661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:52.722 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:30:52.723 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 8m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:30:52.723 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 8m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:30:52.723 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 8m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:30:52.723 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 8m ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:30:52.724 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 8m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:30:52.724 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 8m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:30:52.724 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 8m ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:30:52.724 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 8m ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:30:52.724 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 8m ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:30:52.725 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 8m ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:30:52.725 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 8m ago 2h 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:30:52.725 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 8m ago 2h 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:30:52.725 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 8m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:30:52.725 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 8m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:30:52.726 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (111m) 8m ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:30:52.726 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 8m ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:30:52.726 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 8m ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:30:52.726 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 8m ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:30:52.727 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 8m ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:30:52.727 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 8m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:30:52.727 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 8m ago 2h 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:30:52.728 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 8m ago 2h 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:30:52.728 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 8m ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:30:53.062 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:30:53.063 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:30:53.063 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:30:53.064 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:30:53.064 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:30:53.064 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:30:53.065 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:30:53.065 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:30:53.065 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:30:53.065 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:30:53.066 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:30:53.066 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:30:53.066 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:30:53.066 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:30:53.066 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:30:53.067 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:30:53.067 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:30:53.067 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:30:53.067 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:30:53.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:30:52.416920+0000 mgr.smithi067.rdualw (mgr.24569) 4248 : audit [DBG] from='client.36970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:30:53.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:30:52.704804+0000 mgr.smithi067.rdualw (mgr.24569) 4249 : audit [DBG] from='client.36974 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:30:53.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:30:53.059923+0000 mon.smithi061 (mon.0) 1024 : audit [DBG] from='client.? 172.21.15.61:0/273092670' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:30:53.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:30:52.416920+0000 mgr.smithi067.rdualw (mgr.24569) 4248 : audit [DBG] from='client.36970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:30:53.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:30:52.704804+0000 mgr.smithi067.rdualw (mgr.24569) 4249 : audit [DBG] from='client.36974 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:30:53.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:30:53.059923+0000 mon.smithi061 (mon.0) 1024 : audit [DBG] from='client.? 172.21.15.61:0/273092670' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:30:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:54.111572+0000 mgr.smithi067.rdualw (mgr.24569) 4250 : cluster [DBG] pgmap v3662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:54.111572+0000 mgr.smithi067.rdualw (mgr.24569) 4250 : cluster [DBG] pgmap v3662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:56.112473+0000 mgr.smithi067.rdualw (mgr.24569) 4251 : cluster [DBG] pgmap v3663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:30:56.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:56.112473+0000 mgr.smithi067.rdualw (mgr.24569) 4251 : cluster [DBG] pgmap v3663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:30:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:30:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:30:58.113020+0000 mgr.smithi067.rdualw (mgr.24569) 4252 : cluster [DBG] pgmap v3664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:30:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:30:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:30:58.113020+0000 mgr.smithi067.rdualw (mgr.24569) 4252 : cluster [DBG] pgmap v3664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:00.113640+0000 mgr.smithi067.rdualw (mgr.24569) 4253 : cluster [DBG] pgmap v3665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:00.113640+0000 mgr.smithi067.rdualw (mgr.24569) 4253 : cluster [DBG] pgmap v3665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:02.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:02.114472+0000 mgr.smithi067.rdualw (mgr.24569) 4254 : cluster [DBG] pgmap v3666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:02.114472+0000 mgr.smithi067.rdualw (mgr.24569) 4254 : cluster [DBG] pgmap v3666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:04.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:04.115034+0000 mgr.smithi067.rdualw (mgr.24569) 4255 : cluster [DBG] pgmap v3667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:04.115034+0000 mgr.smithi067.rdualw (mgr.24569) 4255 : cluster [DBG] pgmap v3667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:06.115943+0000 mgr.smithi067.rdualw (mgr.24569) 4256 : cluster [DBG] pgmap v3668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:31:06.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:06.115943+0000 mgr.smithi067.rdualw (mgr.24569) 4256 : cluster [DBG] pgmap v3668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:31:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:08.116407+0000 mgr.smithi067.rdualw (mgr.24569) 4257 : cluster [DBG] pgmap v3669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:08.116407+0000 mgr.smithi067.rdualw (mgr.24569) 4257 : cluster [DBG] pgmap v3669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:10.117025+0000 mgr.smithi067.rdualw (mgr.24569) 4258 : cluster [DBG] pgmap v3670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:10.117025+0000 mgr.smithi067.rdualw (mgr.24569) 4258 : cluster [DBG] pgmap v3670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:12.117961+0000 mgr.smithi067.rdualw (mgr.24569) 4259 : cluster [DBG] pgmap v3671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:12.117961+0000 mgr.smithi067.rdualw (mgr.24569) 4259 : cluster [DBG] pgmap v3671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:14.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:14.118503+0000 mgr.smithi067.rdualw (mgr.24569) 4260 : cluster [DBG] pgmap v3672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:14.118503+0000 mgr.smithi067.rdualw (mgr.24569) 4260 : cluster [DBG] pgmap v3672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:16.119412+0000 mgr.smithi067.rdualw (mgr.24569) 4261 : cluster [DBG] pgmap v3673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:31:16.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:16.119412+0000 mgr.smithi067.rdualw (mgr.24569) 4261 : cluster [DBG] pgmap v3673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:31:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:18.119851+0000 mgr.smithi067.rdualw (mgr.24569) 4262 : cluster [DBG] pgmap v3674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:18.119851+0000 mgr.smithi067.rdualw (mgr.24569) 4262 : cluster [DBG] pgmap v3674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:20.120402+0000 mgr.smithi067.rdualw (mgr.24569) 4263 : cluster [DBG] pgmap v3675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:20.120402+0000 mgr.smithi067.rdualw (mgr.24569) 4263 : cluster [DBG] pgmap v3675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:22.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:22.121360+0000 mgr.smithi067.rdualw (mgr.24569) 4264 : cluster [DBG] pgmap v3676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:22.121360+0000 mgr.smithi067.rdualw (mgr.24569) 4264 : cluster [DBG] pgmap v3676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:23.365 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:31:23.658 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:31:23.658 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 8m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:31:23.658 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 8m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:31:23.659 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 8m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:31:23.659 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 8m ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:31:23.659 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 8m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:31:23.659 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 8m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:31:23.659 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 8m ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:31:23.660 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 8m ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:31:23.660 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 8m ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:31:23.660 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 8m ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:31:23.660 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 8m ago 2h 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:31:23.660 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 8m ago 2h 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:31:23.661 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 8m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:31:23.661 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 8m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:31:23.661 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (112m) 8m ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:31:23.661 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 8m ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:31:23.662 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 8m ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:31:23.662 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 8m ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:31:23.662 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 8m ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:31:23.662 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 8m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:31:23.662 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 8m ago 2h 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:31:23.663 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 8m ago 2h 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:31:23.663 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 8m ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:31:24.001 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:31:24.001 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:31:24.002 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:31:24.002 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:31:24.002 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:31:24.002 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:31:24.003 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:31:24.003 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:31:24.003 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:31:24.003 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:31:24.003 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:31:24.004 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:31:24.004 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:31:24.004 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:31:24.004 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:31:24.005 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:31:24.005 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:31:24.005 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:31:24.005 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:31:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:31:23.999828+0000 mon.smithi061 (mon.0) 1025 : audit [DBG] from='client.? 172.21.15.61:0/2303864166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:31:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:31:23.999828+0000 mon.smithi061 (mon.0) 1025 : audit [DBG] from='client.? 172.21.15.61:0/2303864166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:31:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:31:23.352531+0000 mgr.smithi067.rdualw (mgr.24569) 4265 : audit [DBG] from='client.36982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:31:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:31:23.640431+0000 mgr.smithi067.rdualw (mgr.24569) 4266 : audit [DBG] from='client.36986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:31:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:24.122004+0000 mgr.smithi067.rdualw (mgr.24569) 4267 : cluster [DBG] pgmap v3677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:31:23.352531+0000 mgr.smithi067.rdualw (mgr.24569) 4265 : audit [DBG] from='client.36982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:31:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:31:23.640431+0000 mgr.smithi067.rdualw (mgr.24569) 4266 : audit [DBG] from='client.36986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:31:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:24.122004+0000 mgr.smithi067.rdualw (mgr.24569) 4267 : cluster [DBG] pgmap v3677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:26.123039+0000 mgr.smithi067.rdualw (mgr.24569) 4268 : cluster [DBG] pgmap v3678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:31:26.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:26.123039+0000 mgr.smithi067.rdualw (mgr.24569) 4268 : cluster [DBG] pgmap v3678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:31:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:28.123516+0000 mgr.smithi067.rdualw (mgr.24569) 4269 : cluster [DBG] pgmap v3679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:28.123516+0000 mgr.smithi067.rdualw (mgr.24569) 4269 : cluster [DBG] pgmap v3679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:30.124156+0000 mgr.smithi067.rdualw (mgr.24569) 4270 : cluster [DBG] pgmap v3680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:30.124156+0000 mgr.smithi067.rdualw (mgr.24569) 4270 : cluster [DBG] pgmap v3680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:32.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:32.125039+0000 mgr.smithi067.rdualw (mgr.24569) 4271 : cluster [DBG] pgmap v3681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:32.125039+0000 mgr.smithi067.rdualw (mgr.24569) 4271 : cluster [DBG] pgmap v3681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:34.125633+0000 mgr.smithi067.rdualw (mgr.24569) 4272 : cluster [DBG] pgmap v3682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:34.125633+0000 mgr.smithi067.rdualw (mgr.24569) 4272 : cluster [DBG] pgmap v3682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:31:35.094356+0000 mon.smithi067 (mon.1) 672 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:31:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:31:35.094645+0000 mon.smithi067 (mon.1) 673 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:31:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:31:35.094715+0000 mon.smithi061 (mon.0) 1026 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:31:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:31:35.095018+0000 mon.smithi061 (mon.0) 1027 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:31:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:31:35.094356+0000 mon.smithi067 (mon.1) 672 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:31:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:31:35.094645+0000 mon.smithi067 (mon.1) 673 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:31:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:31:35.094715+0000 mon.smithi061 (mon.0) 1026 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:31:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:31:35.095018+0000 mon.smithi061 (mon.0) 1027 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:31:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:36.126578+0000 mgr.smithi067.rdualw (mgr.24569) 4273 : cluster [DBG] pgmap v3683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:31:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:36.126578+0000 mgr.smithi067.rdualw (mgr.24569) 4273 : cluster [DBG] pgmap v3683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:31:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:38.127066+0000 mgr.smithi067.rdualw (mgr.24569) 4274 : cluster [DBG] pgmap v3684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:38.127066+0000 mgr.smithi067.rdualw (mgr.24569) 4274 : cluster [DBG] pgmap v3684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:40.127681+0000 mgr.smithi067.rdualw (mgr.24569) 4275 : cluster [DBG] pgmap v3685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:40.127681+0000 mgr.smithi067.rdualw (mgr.24569) 4275 : cluster [DBG] pgmap v3685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:42.128730+0000 mgr.smithi067.rdualw (mgr.24569) 4276 : cluster [DBG] pgmap v3686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:42.128730+0000 mgr.smithi067.rdualw (mgr.24569) 4276 : cluster [DBG] pgmap v3686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:44.129497+0000 mgr.smithi067.rdualw (mgr.24569) 4277 : cluster [DBG] pgmap v3687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:44.129497+0000 mgr.smithi067.rdualw (mgr.24569) 4277 : cluster [DBG] pgmap v3687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:46.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:46.130555+0000 mgr.smithi067.rdualw (mgr.24569) 4278 : cluster [DBG] pgmap v3688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:31:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:46.130555+0000 mgr.smithi067.rdualw (mgr.24569) 4278 : cluster [DBG] pgmap v3688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:31:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:48.131117+0000 mgr.smithi067.rdualw (mgr.24569) 4279 : cluster [DBG] pgmap v3689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:48.131117+0000 mgr.smithi067.rdualw (mgr.24569) 4279 : cluster [DBG] pgmap v3689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:31:48.607089+0000 mon.smithi067 (mon.1) 674 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:31:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:31:48.608754+0000 mon.smithi067 (mon.1) 675 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:31:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:31:48.609669+0000 mon.smithi067 (mon.1) 676 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:31:49.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:31:48.610569+0000 mgr.smithi067.rdualw (mgr.24569) 4280 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:31:49.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:31:49.023227+0000 mon.smithi061 (mon.0) 1028 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:31:49.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:31:49.028848+0000 mon.smithi061 (mon.0) 1029 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:31:49.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:31:48.607089+0000 mon.smithi067 (mon.1) 674 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:31:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:31:48.608754+0000 mon.smithi067 (mon.1) 675 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:31:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:31:48.609669+0000 mon.smithi067 (mon.1) 676 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:31:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:31:48.610569+0000 mgr.smithi067.rdualw (mgr.24569) 4280 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:31:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:31:49.023227+0000 mon.smithi061 (mon.0) 1028 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:31:49.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:31:49.028848+0000 mon.smithi061 (mon.0) 1029 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:31:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:50.131883+0000 mgr.smithi067.rdualw (mgr.24569) 4281 : cluster [DBG] pgmap v3690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:50.131883+0000 mgr.smithi067.rdualw (mgr.24569) 4281 : cluster [DBG] pgmap v3690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:52.132858+0000 mgr.smithi067.rdualw (mgr.24569) 4282 : cluster [DBG] pgmap v3691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:52.132858+0000 mgr.smithi067.rdualw (mgr.24569) 4282 : cluster [DBG] pgmap v3691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:54.329 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:31:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:54.133454+0000 mgr.smithi067.rdualw (mgr.24569) 4283 : cluster [DBG] pgmap v3692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:54.133454+0000 mgr.smithi067.rdualw (mgr.24569) 4283 : cluster [DBG] pgmap v3692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:54.619 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:31:54.620 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 9m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:31:54.620 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 9m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:31:54.620 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 9m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:31:54.620 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 9m ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:31:54.620 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 9m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:31:54.621 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 9m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:31:54.621 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 9m ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:31:54.621 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 9m ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:31:54.621 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 9m ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:31:54.622 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 9m ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:31:54.622 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 9m ago 2h 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:31:54.622 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 9m ago 2h 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:31:54.622 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 9m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:31:54.623 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 9m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:31:54.623 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (112m) 9m ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:31:54.623 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 9m ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:31:54.623 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 9m ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:31:54.623 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 9m ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:31:54.624 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 9m ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:31:54.624 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 9m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:31:54.624 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 9m ago 2h 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:31:54.624 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 9m ago 2h 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:31:54.625 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 9m ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:31:54.978 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:31:54.978 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:31:54.978 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:31:54.979 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:31:54.979 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:31:54.979 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:31:54.979 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:31:54.980 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:31:54.980 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:31:54.980 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:31:54.980 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:31:54.980 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:31:54.981 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:31:54.981 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:31:54.981 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:31:54.982 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:31:54.982 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:31:54.982 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:31:54.982 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:31:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:31:54.316369+0000 mgr.smithi067.rdualw (mgr.24569) 4284 : audit [DBG] from='client.36994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:31:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:31:54.601686+0000 mgr.smithi067.rdualw (mgr.24569) 4285 : audit [DBG] from='client.36998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:31:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:31:54.976542+0000 mon.smithi061 (mon.0) 1030 : audit [DBG] from='client.? 172.21.15.61:0/891447057' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:31:55.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:31:54.316369+0000 mgr.smithi067.rdualw (mgr.24569) 4284 : audit [DBG] from='client.36994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:31:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:31:54.601686+0000 mgr.smithi067.rdualw (mgr.24569) 4285 : audit [DBG] from='client.36998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:31:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:31:54.976542+0000 mon.smithi061 (mon.0) 1030 : audit [DBG] from='client.? 172.21.15.61:0/891447057' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:31:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:56.134555+0000 mgr.smithi067.rdualw (mgr.24569) 4286 : cluster [DBG] pgmap v3693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:31:56.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:56.134555+0000 mgr.smithi067.rdualw (mgr.24569) 4286 : cluster [DBG] pgmap v3693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:31:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:31:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:31:58.135222+0000 mgr.smithi067.rdualw (mgr.24569) 4287 : cluster [DBG] pgmap v3694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:31:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:31:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:31:58.135222+0000 mgr.smithi067.rdualw (mgr.24569) 4287 : cluster [DBG] pgmap v3694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:00.135903+0000 mgr.smithi067.rdualw (mgr.24569) 4288 : cluster [DBG] pgmap v3695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:00.135903+0000 mgr.smithi067.rdualw (mgr.24569) 4288 : cluster [DBG] pgmap v3695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:02.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:02.136819+0000 mgr.smithi067.rdualw (mgr.24569) 4289 : cluster [DBG] pgmap v3696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:02.136819+0000 mgr.smithi067.rdualw (mgr.24569) 4289 : cluster [DBG] pgmap v3696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:04.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:04.137478+0000 mgr.smithi067.rdualw (mgr.24569) 4290 : cluster [DBG] pgmap v3697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:04.137478+0000 mgr.smithi067.rdualw (mgr.24569) 4290 : cluster [DBG] pgmap v3697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:06.138329+0000 mgr.smithi067.rdualw (mgr.24569) 4291 : cluster [DBG] pgmap v3698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:32:06.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:06.138329+0000 mgr.smithi067.rdualw (mgr.24569) 4291 : cluster [DBG] pgmap v3698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:32:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:08.138875+0000 mgr.smithi067.rdualw (mgr.24569) 4292 : cluster [DBG] pgmap v3699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:08.138875+0000 mgr.smithi067.rdualw (mgr.24569) 4292 : cluster [DBG] pgmap v3699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:10.139570+0000 mgr.smithi067.rdualw (mgr.24569) 4293 : cluster [DBG] pgmap v3700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:10.139570+0000 mgr.smithi067.rdualw (mgr.24569) 4293 : cluster [DBG] pgmap v3700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:12.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:12.140409+0000 mgr.smithi067.rdualw (mgr.24569) 4294 : cluster [DBG] pgmap v3701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:12.140409+0000 mgr.smithi067.rdualw (mgr.24569) 4294 : cluster [DBG] pgmap v3701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:14.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:14.141002+0000 mgr.smithi067.rdualw (mgr.24569) 4295 : cluster [DBG] pgmap v3702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:14.141002+0000 mgr.smithi067.rdualw (mgr.24569) 4295 : cluster [DBG] pgmap v3702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:16.141867+0000 mgr.smithi067.rdualw (mgr.24569) 4296 : cluster [DBG] pgmap v3703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:32:16.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:16.141867+0000 mgr.smithi067.rdualw (mgr.24569) 4296 : cluster [DBG] pgmap v3703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:32:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:18.142493+0000 mgr.smithi067.rdualw (mgr.24569) 4297 : cluster [DBG] pgmap v3704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:18.142493+0000 mgr.smithi067.rdualw (mgr.24569) 4297 : cluster [DBG] pgmap v3704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:20.143162+0000 mgr.smithi067.rdualw (mgr.24569) 4298 : cluster [DBG] pgmap v3705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:20.143162+0000 mgr.smithi067.rdualw (mgr.24569) 4298 : cluster [DBG] pgmap v3705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:22.144045+0000 mgr.smithi067.rdualw (mgr.24569) 4299 : cluster [DBG] pgmap v3706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:22.144045+0000 mgr.smithi067.rdualw (mgr.24569) 4299 : cluster [DBG] pgmap v3706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:24.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:24.144812+0000 mgr.smithi067.rdualw (mgr.24569) 4300 : cluster [DBG] pgmap v3707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:24.144812+0000 mgr.smithi067.rdualw (mgr.24569) 4300 : cluster [DBG] pgmap v3707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:25.292 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:32:25.583 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:32:25.583 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 9m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:32:25.583 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 9m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:32:25.584 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 9m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:32:25.584 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 9m ago 2h 41.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:32:25.584 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 9m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:32:25.584 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 9m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:32:25.585 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 9m ago 2h 455M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:32:25.585 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 9m ago 2h 527M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:32:25.585 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 9m ago 2h 803M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:32:25.585 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 9m ago 2h 445M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:32:25.585 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 9m ago 2h 183M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:32:25.586 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 9m ago 2h 110M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:32:25.586 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 9m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:32:25.586 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 9m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:32:25.586 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (113m) 9m ago 2h 704M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:32:25.587 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 9m ago 2h 1532M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:32:25.587 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 9m ago 2h 928M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:32:25.587 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 9m ago 2h 1656M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:32:25.588 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 9m ago 2h 1529M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:32:25.588 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 9m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:32:25.588 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 9m ago 2h 1391M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:32:25.589 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 9m ago 2h 2250M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:32:25.589 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 9m ago 2h 76.2M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:32:25.921 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:32:25.921 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:32:25.921 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:32:25.922 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:32:25.922 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:32:25.922 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:32:25.922 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:32:25.923 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:32:25.923 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:32:25.923 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:32:25.923 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:32:25.924 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:32:25.924 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:32:25.924 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:32:25.924 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:32:25.924 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:32:25.925 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:32:25.925 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:32:25.925 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:32:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:25.279329+0000 mgr.smithi067.rdualw (mgr.24569) 4301 : audit [DBG] from='client.37006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:32:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:25.565310+0000 mgr.smithi067.rdualw (mgr.24569) 4302 : audit [DBG] from='client.37010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:32:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:25.919495+0000 mon.smithi061 (mon.0) 1031 : audit [DBG] from='client.? 172.21.15.61:0/3686786842' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:32:26.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:26.145616+0000 mgr.smithi067.rdualw (mgr.24569) 4303 : cluster [DBG] pgmap v3708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:32:26.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:25.279329+0000 mgr.smithi067.rdualw (mgr.24569) 4301 : audit [DBG] from='client.37006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:32:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:25.565310+0000 mgr.smithi067.rdualw (mgr.24569) 4302 : audit [DBG] from='client.37010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:32:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:25.919495+0000 mon.smithi061 (mon.0) 1031 : audit [DBG] from='client.? 172.21.15.61:0/3686786842' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:32:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:26.145616+0000 mgr.smithi067.rdualw (mgr.24569) 4303 : cluster [DBG] pgmap v3708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:32:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:28.146167+0000 mgr.smithi067.rdualw (mgr.24569) 4304 : cluster [DBG] pgmap v3709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:28.146167+0000 mgr.smithi067.rdualw (mgr.24569) 4304 : cluster [DBG] pgmap v3709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:30.146878+0000 mgr.smithi067.rdualw (mgr.24569) 4305 : cluster [DBG] pgmap v3710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:30.146878+0000 mgr.smithi067.rdualw (mgr.24569) 4305 : cluster [DBG] pgmap v3710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:32.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:32.147908+0000 mgr.smithi067.rdualw (mgr.24569) 4306 : cluster [DBG] pgmap v3711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:32.147908+0000 mgr.smithi067.rdualw (mgr.24569) 4306 : cluster [DBG] pgmap v3711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:34.148429+0000 mgr.smithi067.rdualw (mgr.24569) 4307 : cluster [DBG] pgmap v3712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:34.148429+0000 mgr.smithi067.rdualw (mgr.24569) 4307 : cluster [DBG] pgmap v3712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:35.100093+0000 mon.smithi067 (mon.1) 677 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:32:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:35.100331+0000 mon.smithi061 (mon.0) 1032 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:32:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:35.100370+0000 mon.smithi067 (mon.1) 678 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:32:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:35.100633+0000 mon.smithi061 (mon.0) 1033 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:32:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:35.100093+0000 mon.smithi067 (mon.1) 677 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:32:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:35.100331+0000 mon.smithi061 (mon.0) 1032 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:32:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:35.100370+0000 mon.smithi067 (mon.1) 678 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:32:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:35.100633+0000 mon.smithi061 (mon.0) 1033 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:32:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:36.149495+0000 mgr.smithi067.rdualw (mgr.24569) 4308 : cluster [DBG] pgmap v3713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:32:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:36.149495+0000 mgr.smithi067.rdualw (mgr.24569) 4308 : cluster [DBG] pgmap v3713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:32:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:38.150289+0000 mgr.smithi067.rdualw (mgr.24569) 4309 : cluster [DBG] pgmap v3714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:38.150289+0000 mgr.smithi067.rdualw (mgr.24569) 4309 : cluster [DBG] pgmap v3714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:40.151052+0000 mgr.smithi067.rdualw (mgr.24569) 4310 : cluster [DBG] pgmap v3715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:40.151052+0000 mgr.smithi067.rdualw (mgr.24569) 4310 : cluster [DBG] pgmap v3715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:42.152087+0000 mgr.smithi067.rdualw (mgr.24569) 4311 : cluster [DBG] pgmap v3716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:42.152087+0000 mgr.smithi067.rdualw (mgr.24569) 4311 : cluster [DBG] pgmap v3716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:44.152721+0000 mgr.smithi067.rdualw (mgr.24569) 4312 : cluster [DBG] pgmap v3717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:44.152721+0000 mgr.smithi067.rdualw (mgr.24569) 4312 : cluster [DBG] pgmap v3717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:46.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:46.153641+0000 mgr.smithi067.rdualw (mgr.24569) 4313 : cluster [DBG] pgmap v3718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:32:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:46.153641+0000 mgr.smithi067.rdualw (mgr.24569) 4313 : cluster [DBG] pgmap v3718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:32:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:48.154182+0000 mgr.smithi067.rdualw (mgr.24569) 4314 : cluster [DBG] pgmap v3719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:48.154182+0000 mgr.smithi067.rdualw (mgr.24569) 4314 : cluster [DBG] pgmap v3719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:49.032795+0000 mon.smithi067 (mon.1) 679 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:32:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:49.034310+0000 mon.smithi067 (mon.1) 680 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:32:49.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:49.035255+0000 mon.smithi067 (mon.1) 681 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:32:49.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:32:49.036151+0000 mgr.smithi067.rdualw (mgr.24569) 4315 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:32:49.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:49.032795+0000 mon.smithi067 (mon.1) 679 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:32:49.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:49.034310+0000 mon.smithi067 (mon.1) 680 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:32:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:49.035255+0000 mon.smithi067 (mon.1) 681 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:32:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:32:49.036151+0000 mgr.smithi067.rdualw (mgr.24569) 4315 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:32:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:50.154683+0000 mgr.smithi067.rdualw (mgr.24569) 4316 : cluster [DBG] pgmap v3720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:50.154683+0000 mgr.smithi067.rdualw (mgr.24569) 4316 : cluster [DBG] pgmap v3720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:52.155370+0000 mgr.smithi067.rdualw (mgr.24569) 4317 : cluster [DBG] pgmap v3721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:52.155370+0000 mgr.smithi067.rdualw (mgr.24569) 4317 : cluster [DBG] pgmap v3721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:54.915 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:53.630568+0000 mon.smithi061 (mon.0) 1034 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:32:54.915 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:54.031059+0000 mon.smithi067 (mon.1) 682 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:32:54.916 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:54.031378+0000 mon.smithi061 (mon.0) 1035 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:32:54.916 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:54.155866+0000 mgr.smithi067.rdualw (mgr.24569) 4318 : cluster [DBG] pgmap v3722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:53.630568+0000 mon.smithi061 (mon.0) 1034 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:32:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:54.031059+0000 mon.smithi067 (mon.1) 682 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:32:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:54.031378+0000 mon.smithi061 (mon.0) 1035 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:32:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:54.155866+0000 mgr.smithi067.rdualw (mgr.24569) 4318 : cluster [DBG] pgmap v3722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:56.237 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:32:56.596 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:32:56.597 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 0s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:32:56.597 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 0s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:32:56.597 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 2s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:32:56.598 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 0s ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:32:56.598 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 0s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:32:56.598 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 2s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:32:56.598 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 0s ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:32:56.599 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 2s ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:32:56.599 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 0s ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:32:56.599 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 2s ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:32:56.600 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 0s ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:32:56.600 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 2s ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:32:56.600 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 0s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:32:56.600 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 2s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:32:56.600 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (114m) 0s ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:32:56.601 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 0s ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:32:56.601 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 0s ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:32:56.601 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 0s ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:32:56.601 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 2s ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:32:56.601 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 2s ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:32:56.602 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 2s ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:32:56.602 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 2s ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:32:56.602 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 0s ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:32:56.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:56.156838+0000 mgr.smithi067.rdualw (mgr.24569) 4319 : cluster [DBG] pgmap v3723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:32:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:56.245586+0000 mon.smithi061 (mon.0) 1036 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:32:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:56.156838+0000 mgr.smithi067.rdualw (mgr.24569) 4319 : cluster [DBG] pgmap v3723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:32:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:56.245586+0000 mon.smithi061 (mon.0) 1036 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:32:56.950 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:32:56.950 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:32:56.950 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:32:56.951 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:32:56.951 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:32:56.951 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:32:56.951 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:32:56.952 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:32:56.952 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:32:56.953 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:32:56.953 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:32:56.953 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:32:56.953 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:32:56.953 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:32:56.954 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:32:56.954 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:32:56.954 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:32:56.954 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:32:56.955 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:32:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:56.222211+0000 mgr.smithi067.rdualw (mgr.24569) 4320 : audit [DBG] from='client.37018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:32:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:56.578912+0000 mgr.smithi067.rdualw (mgr.24569) 4321 : audit [DBG] from='client.37022 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:32:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:56.700057+0000 mon.smithi067 (mon.1) 683 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:32:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:56.700179+0000 mon.smithi061 (mon.0) 1037 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:32:57.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:56.705070+0000 mon.smithi061 (mon.0) 1038 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:32:57.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:56.712731+0000 mon.smithi061 (mon.0) 1039 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:32:57.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:32:56.948431+0000 mon.smithi061 (mon.0) 1040 : audit [DBG] from='client.? 172.21.15.61:0/2767751979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:32:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:56.222211+0000 mgr.smithi067.rdualw (mgr.24569) 4320 : audit [DBG] from='client.37018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:32:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:56.578912+0000 mgr.smithi067.rdualw (mgr.24569) 4321 : audit [DBG] from='client.37022 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:32:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:56.700057+0000 mon.smithi067 (mon.1) 683 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:32:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:56.700179+0000 mon.smithi061 (mon.0) 1037 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:32:57.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:56.705070+0000 mon.smithi061 (mon.0) 1038 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:32:57.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:56.712731+0000 mon.smithi061 (mon.0) 1039 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:32:57.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:32:56.948431+0000 mon.smithi061 (mon.0) 1040 : audit [DBG] from='client.? 172.21.15.61:0/2767751979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:32:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:32:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:32:58.157337+0000 mgr.smithi067.rdualw (mgr.24569) 4322 : cluster [DBG] pgmap v3724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:32:58.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:32:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:32:58.157337+0000 mgr.smithi067.rdualw (mgr.24569) 4322 : cluster [DBG] pgmap v3724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:00.157983+0000 mgr.smithi067.rdualw (mgr.24569) 4323 : cluster [DBG] pgmap v3725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:00.157983+0000 mgr.smithi067.rdualw (mgr.24569) 4323 : cluster [DBG] pgmap v3725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:02.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:02.159075+0000 mgr.smithi067.rdualw (mgr.24569) 4324 : cluster [DBG] pgmap v3726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:02.159075+0000 mgr.smithi067.rdualw (mgr.24569) 4324 : cluster [DBG] pgmap v3726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:04.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:04.159723+0000 mgr.smithi067.rdualw (mgr.24569) 4325 : cluster [DBG] pgmap v3727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:04.159723+0000 mgr.smithi067.rdualw (mgr.24569) 4325 : cluster [DBG] pgmap v3727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:06.160559+0000 mgr.smithi067.rdualw (mgr.24569) 4326 : cluster [DBG] pgmap v3728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:33:06.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:06.160559+0000 mgr.smithi067.rdualw (mgr.24569) 4326 : cluster [DBG] pgmap v3728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:33:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:08.161169+0000 mgr.smithi067.rdualw (mgr.24569) 4327 : cluster [DBG] pgmap v3729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:08.161169+0000 mgr.smithi067.rdualw (mgr.24569) 4327 : cluster [DBG] pgmap v3729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:10.161759+0000 mgr.smithi067.rdualw (mgr.24569) 4328 : cluster [DBG] pgmap v3730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:10.161759+0000 mgr.smithi067.rdualw (mgr.24569) 4328 : cluster [DBG] pgmap v3730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:12.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:12.162840+0000 mgr.smithi067.rdualw (mgr.24569) 4329 : cluster [DBG] pgmap v3731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:12.162840+0000 mgr.smithi067.rdualw (mgr.24569) 4329 : cluster [DBG] pgmap v3731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:14.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:14.163592+0000 mgr.smithi067.rdualw (mgr.24569) 4330 : cluster [DBG] pgmap v3732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:14.163592+0000 mgr.smithi067.rdualw (mgr.24569) 4330 : cluster [DBG] pgmap v3732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:16.164502+0000 mgr.smithi067.rdualw (mgr.24569) 4331 : cluster [DBG] pgmap v3733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:33:16.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:16.164502+0000 mgr.smithi067.rdualw (mgr.24569) 4331 : cluster [DBG] pgmap v3733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:33:18.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:18.165160+0000 mgr.smithi067.rdualw (mgr.24569) 4332 : cluster [DBG] pgmap v3734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:18.165160+0000 mgr.smithi067.rdualw (mgr.24569) 4332 : cluster [DBG] pgmap v3734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:20.165769+0000 mgr.smithi067.rdualw (mgr.24569) 4333 : cluster [DBG] pgmap v3735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:20.165769+0000 mgr.smithi067.rdualw (mgr.24569) 4333 : cluster [DBG] pgmap v3735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:22.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:22.166815+0000 mgr.smithi067.rdualw (mgr.24569) 4334 : cluster [DBG] pgmap v3736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:22.166815+0000 mgr.smithi067.rdualw (mgr.24569) 4334 : cluster [DBG] pgmap v3736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:24.167430+0000 mgr.smithi067.rdualw (mgr.24569) 4335 : cluster [DBG] pgmap v3737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:24.167430+0000 mgr.smithi067.rdualw (mgr.24569) 4335 : cluster [DBG] pgmap v3737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:26.168425+0000 mgr.smithi067.rdualw (mgr.24569) 4336 : cluster [DBG] pgmap v3738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:33:26.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:26.168425+0000 mgr.smithi067.rdualw (mgr.24569) 4336 : cluster [DBG] pgmap v3738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:33:27.255 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:33:27.548 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:33:27.549 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 31s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:33:27.549 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 31s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:33:27.549 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 33s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:33:27.549 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 31s ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:33:27.550 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 31s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:33:27.550 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 33s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:33:27.550 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 31s ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:33:27.550 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 33s ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:33:27.551 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 31s ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:33:27.551 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 33s ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:33:27.551 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 31s ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:33:27.551 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 33s ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:33:27.552 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 31s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:33:27.552 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 33s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:33:27.552 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (114m) 31s ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:33:27.552 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 31s ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:33:27.553 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 31s ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:33:27.553 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 31s ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:33:27.555 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 33s ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:33:27.555 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 33s ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:33:27.555 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 33s ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:33:27.555 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 33s ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:33:27.556 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 31s ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:33:27.890 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:33:27.890 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:33:27.891 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:33:27.891 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:33:27.891 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:33:27.891 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:33:27.892 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:33:27.892 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:33:27.892 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:33:27.892 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:33:27.893 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:33:27.893 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:33:27.893 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:33:27.893 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:33:27.894 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:33:27.894 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:33:27.894 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:33:27.894 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:33:27.894 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:33:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:33:27.888052+0000 mon.smithi061 (mon.0) 1041 : audit [DBG] from='client.? 172.21.15.61:0/3562581916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:33:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:33:27.888052+0000 mon.smithi061 (mon.0) 1041 : audit [DBG] from='client.? 172.21.15.61:0/3562581916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:33:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:33:27.242504+0000 mgr.smithi067.rdualw (mgr.24569) 4337 : audit [DBG] from='client.37030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:33:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:33:27.530873+0000 mgr.smithi067.rdualw (mgr.24569) 4338 : audit [DBG] from='client.37034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:33:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:28.168977+0000 mgr.smithi067.rdualw (mgr.24569) 4339 : cluster [DBG] pgmap v3739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:33:27.242504+0000 mgr.smithi067.rdualw (mgr.24569) 4337 : audit [DBG] from='client.37030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:33:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:33:27.530873+0000 mgr.smithi067.rdualw (mgr.24569) 4338 : audit [DBG] from='client.37034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:33:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:28.168977+0000 mgr.smithi067.rdualw (mgr.24569) 4339 : cluster [DBG] pgmap v3739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:30.169718+0000 mgr.smithi067.rdualw (mgr.24569) 4340 : cluster [DBG] pgmap v3740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:30.169718+0000 mgr.smithi067.rdualw (mgr.24569) 4340 : cluster [DBG] pgmap v3740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:32.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:32.170739+0000 mgr.smithi067.rdualw (mgr.24569) 4341 : cluster [DBG] pgmap v3741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:32.170739+0000 mgr.smithi067.rdualw (mgr.24569) 4341 : cluster [DBG] pgmap v3741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:34.171480+0000 mgr.smithi067.rdualw (mgr.24569) 4342 : cluster [DBG] pgmap v3742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:34.171480+0000 mgr.smithi067.rdualw (mgr.24569) 4342 : cluster [DBG] pgmap v3742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:33:35.105398+0000 mon.smithi067 (mon.1) 684 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:33:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:33:35.105636+0000 mon.smithi061 (mon.0) 1042 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:33:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:33:35.105701+0000 mon.smithi067 (mon.1) 685 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:33:35.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:33:35.106114+0000 mon.smithi061 (mon.0) 1043 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:33:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:33:35.105398+0000 mon.smithi067 (mon.1) 684 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:33:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:33:35.105636+0000 mon.smithi061 (mon.0) 1042 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:33:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:33:35.105701+0000 mon.smithi067 (mon.1) 685 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:33:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:33:35.106114+0000 mon.smithi061 (mon.0) 1043 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:33:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:36.172395+0000 mgr.smithi067.rdualw (mgr.24569) 4343 : cluster [DBG] pgmap v3743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:33:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:36.172395+0000 mgr.smithi067.rdualw (mgr.24569) 4343 : cluster [DBG] pgmap v3743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:33:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:38.172984+0000 mgr.smithi067.rdualw (mgr.24569) 4344 : cluster [DBG] pgmap v3744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:38.172984+0000 mgr.smithi067.rdualw (mgr.24569) 4344 : cluster [DBG] pgmap v3744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:40.173670+0000 mgr.smithi067.rdualw (mgr.24569) 4345 : cluster [DBG] pgmap v3745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:40.173670+0000 mgr.smithi067.rdualw (mgr.24569) 4345 : cluster [DBG] pgmap v3745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:42.174626+0000 mgr.smithi067.rdualw (mgr.24569) 4346 : cluster [DBG] pgmap v3746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:42.174626+0000 mgr.smithi067.rdualw (mgr.24569) 4346 : cluster [DBG] pgmap v3746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:44.175300+0000 mgr.smithi067.rdualw (mgr.24569) 4347 : cluster [DBG] pgmap v3747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:44.175300+0000 mgr.smithi067.rdualw (mgr.24569) 4347 : cluster [DBG] pgmap v3747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:46.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:46.176208+0000 mgr.smithi067.rdualw (mgr.24569) 4348 : cluster [DBG] pgmap v3748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:33:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:46.176208+0000 mgr.smithi067.rdualw (mgr.24569) 4348 : cluster [DBG] pgmap v3748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:33:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:48.176807+0000 mgr.smithi067.rdualw (mgr.24569) 4349 : cluster [DBG] pgmap v3749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:48.176807+0000 mgr.smithi067.rdualw (mgr.24569) 4349 : cluster [DBG] pgmap v3749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:50.177361+0000 mgr.smithi067.rdualw (mgr.24569) 4350 : cluster [DBG] pgmap v3750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:50.177361+0000 mgr.smithi067.rdualw (mgr.24569) 4350 : cluster [DBG] pgmap v3750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:52.178428+0000 mgr.smithi067.rdualw (mgr.24569) 4351 : cluster [DBG] pgmap v3751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:52.178428+0000 mgr.smithi067.rdualw (mgr.24569) 4351 : cluster [DBG] pgmap v3751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:54.179101+0000 mgr.smithi067.rdualw (mgr.24569) 4352 : cluster [DBG] pgmap v3752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:54.179101+0000 mgr.smithi067.rdualw (mgr.24569) 4352 : cluster [DBG] pgmap v3752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:56.180128+0000 mgr.smithi067.rdualw (mgr.24569) 4353 : cluster [DBG] pgmap v3753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:33:56.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:56.180128+0000 mgr.smithi067.rdualw (mgr.24569) 4353 : cluster [DBG] pgmap v3753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:33:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:33:56.717806+0000 mon.smithi067 (mon.1) 686 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:33:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:33:56.719198+0000 mon.smithi067 (mon.1) 687 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:33:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:33:56.720171+0000 mon.smithi067 (mon.1) 688 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:33:57.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:33:56.721004+0000 mgr.smithi067.rdualw (mgr.24569) 4354 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:33:57.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:33:57.139259+0000 mon.smithi061 (mon.0) 1044 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:33:57.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:33:57.144748+0000 mon.smithi061 (mon.0) 1045 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:33:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:33:56.717806+0000 mon.smithi067 (mon.1) 686 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:33:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:33:56.719198+0000 mon.smithi067 (mon.1) 687 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:33:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:33:56.720171+0000 mon.smithi067 (mon.1) 688 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:33:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:33:56.721004+0000 mgr.smithi067.rdualw (mgr.24569) 4354 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:33:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:33:57.139259+0000 mon.smithi061 (mon.0) 1044 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:33:57.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:33:57.144748+0000 mon.smithi061 (mon.0) 1045 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:33:58.197 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:33:58.490 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:33:58.490 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 62s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:33:58.490 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 62s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:33:58.491 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 64s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:33:58.491 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 62s ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:33:58.491 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 62s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:33:58.491 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 64s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:33:58.492 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 62s ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:33:58.492 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 64s ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:33:58.492 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 62s ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:33:58.492 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 64s ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:33:58.493 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 62s ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:33:58.493 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 64s ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:33:58.493 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 62s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:33:58.493 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 64s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:33:58.494 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (115m) 62s ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:33:58.494 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 62s ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:33:58.494 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 62s ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:33:58.495 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 62s ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:33:58.495 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 64s ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:33:58.495 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 64s ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:33:58.495 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 64s ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:33:58.496 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 64s ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:33:58.496 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 62s ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:33:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:33:58.180607+0000 mgr.smithi067.rdualw (mgr.24569) 4355 : cluster [DBG] pgmap v3754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:33:58.183641+0000 mgr.smithi067.rdualw (mgr.24569) 4356 : audit [DBG] from='client.37042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:33:58.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:33:58.180607+0000 mgr.smithi067.rdualw (mgr.24569) 4355 : cluster [DBG] pgmap v3754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:33:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:33:58.183641+0000 mgr.smithi067.rdualw (mgr.24569) 4356 : audit [DBG] from='client.37042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:33:58.826 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:33:58.826 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:33:58.827 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:33:58.827 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:33:58.827 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:33:58.827 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:33:58.828 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:33:58.828 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:33:58.828 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:33:58.828 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:33:58.828 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:33:58.829 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:33:58.829 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:33:58.830 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:33:58.830 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:33:58.830 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:33:58.830 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:33:58.831 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:33:58.831 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:33:59.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:33:58.471630+0000 mgr.smithi067.rdualw (mgr.24569) 4357 : audit [DBG] from='client.37046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:33:59.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:33:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:33:58.824760+0000 mon.smithi061 (mon.0) 1046 : audit [DBG] from='client.? 172.21.15.61:0/2080457941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:33:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:33:58.471630+0000 mgr.smithi067.rdualw (mgr.24569) 4357 : audit [DBG] from='client.37046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:33:59.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:33:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:33:58.824760+0000 mon.smithi061 (mon.0) 1046 : audit [DBG] from='client.? 172.21.15.61:0/2080457941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:34:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:00.181414+0000 mgr.smithi067.rdualw (mgr.24569) 4358 : cluster [DBG] pgmap v3755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:00.181414+0000 mgr.smithi067.rdualw (mgr.24569) 4358 : cluster [DBG] pgmap v3755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:02.182312+0000 mgr.smithi067.rdualw (mgr.24569) 4359 : cluster [DBG] pgmap v3756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:02.182312+0000 mgr.smithi067.rdualw (mgr.24569) 4359 : cluster [DBG] pgmap v3756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:04.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:04.183076+0000 mgr.smithi067.rdualw (mgr.24569) 4360 : cluster [DBG] pgmap v3757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:04.183076+0000 mgr.smithi067.rdualw (mgr.24569) 4360 : cluster [DBG] pgmap v3757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:06.184056+0000 mgr.smithi067.rdualw (mgr.24569) 4361 : cluster [DBG] pgmap v3758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:34:06.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:06.184056+0000 mgr.smithi067.rdualw (mgr.24569) 4361 : cluster [DBG] pgmap v3758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:34:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:08.184564+0000 mgr.smithi067.rdualw (mgr.24569) 4362 : cluster [DBG] pgmap v3759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:08.184564+0000 mgr.smithi067.rdualw (mgr.24569) 4362 : cluster [DBG] pgmap v3759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:10.185256+0000 mgr.smithi067.rdualw (mgr.24569) 4363 : cluster [DBG] pgmap v3760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:10.185256+0000 mgr.smithi067.rdualw (mgr.24569) 4363 : cluster [DBG] pgmap v3760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:12.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:12.186102+0000 mgr.smithi067.rdualw (mgr.24569) 4364 : cluster [DBG] pgmap v3761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:12.186102+0000 mgr.smithi067.rdualw (mgr.24569) 4364 : cluster [DBG] pgmap v3761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:14.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:14.186871+0000 mgr.smithi067.rdualw (mgr.24569) 4365 : cluster [DBG] pgmap v3762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:14.186871+0000 mgr.smithi067.rdualw (mgr.24569) 4365 : cluster [DBG] pgmap v3762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:16.187857+0000 mgr.smithi067.rdualw (mgr.24569) 4366 : cluster [DBG] pgmap v3763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:34:16.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:16.187857+0000 mgr.smithi067.rdualw (mgr.24569) 4366 : cluster [DBG] pgmap v3763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:34:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:18.188306+0000 mgr.smithi067.rdualw (mgr.24569) 4367 : cluster [DBG] pgmap v3764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:18.188306+0000 mgr.smithi067.rdualw (mgr.24569) 4367 : cluster [DBG] pgmap v3764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:20.188857+0000 mgr.smithi067.rdualw (mgr.24569) 4368 : cluster [DBG] pgmap v3765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:20.188857+0000 mgr.smithi067.rdualw (mgr.24569) 4368 : cluster [DBG] pgmap v3765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:22.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:22.189686+0000 mgr.smithi067.rdualw (mgr.24569) 4369 : cluster [DBG] pgmap v3766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:22.189686+0000 mgr.smithi067.rdualw (mgr.24569) 4369 : cluster [DBG] pgmap v3766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:24.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:24.190401+0000 mgr.smithi067.rdualw (mgr.24569) 4370 : cluster [DBG] pgmap v3767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:24.190401+0000 mgr.smithi067.rdualw (mgr.24569) 4370 : cluster [DBG] pgmap v3767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:26.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:26.191326+0000 mgr.smithi067.rdualw (mgr.24569) 4371 : cluster [DBG] pgmap v3768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:34:26.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:26.191326+0000 mgr.smithi067.rdualw (mgr.24569) 4371 : cluster [DBG] pgmap v3768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:34:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:28.192002+0000 mgr.smithi067.rdualw (mgr.24569) 4372 : cluster [DBG] pgmap v3769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:28.192002+0000 mgr.smithi067.rdualw (mgr.24569) 4372 : cluster [DBG] pgmap v3769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:29.151 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:34:29.444 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:34:29.445 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 93s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:34:29.445 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 93s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:34:29.445 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 95s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:34:29.445 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 93s ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:34:29.446 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 93s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:34:29.446 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 95s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:34:29.446 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 93s ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:34:29.446 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 95s ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:34:29.447 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 93s ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:34:29.447 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 95s ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:34:29.447 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 93s ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:34:29.447 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 95s ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:34:29.448 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 93s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:34:29.448 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 95s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:34:29.448 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (115m) 93s ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:34:29.448 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 93s ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:34:29.448 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 93s ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:34:29.449 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 93s ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:34:29.449 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 95s ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:34:29.449 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 95s ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:34:29.449 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 95s ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:34:29.450 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 95s ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:34:29.450 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 93s ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:34:29.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:34:29.138415+0000 mgr.smithi067.rdualw (mgr.24569) 4373 : audit [DBG] from='client.37054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:34:29.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:34:29.138415+0000 mgr.smithi067.rdualw (mgr.24569) 4373 : audit [DBG] from='client.37054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:34:29.783 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:34:29.784 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:34:29.784 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:34:29.784 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:34:29.784 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:34:29.784 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:34:29.785 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:34:29.785 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:34:29.785 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:34:29.785 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:34:29.786 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:34:29.786 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:34:29.786 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:34:29.786 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:34:29.786 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:34:29.787 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:34:29.787 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:34:29.787 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:34:29.787 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:34:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:34:29.426793+0000 mgr.smithi067.rdualw (mgr.24569) 4374 : audit [DBG] from='client.37058 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:34:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:34:29.781961+0000 mon.smithi061 (mon.0) 1047 : audit [DBG] from='client.? 172.21.15.61:0/4211452796' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:34:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:30.192709+0000 mgr.smithi067.rdualw (mgr.24569) 4375 : cluster [DBG] pgmap v3770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:34:29.426793+0000 mgr.smithi067.rdualw (mgr.24569) 4374 : audit [DBG] from='client.37058 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:34:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:34:29.781961+0000 mon.smithi061 (mon.0) 1047 : audit [DBG] from='client.? 172.21.15.61:0/4211452796' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:34:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:30.192709+0000 mgr.smithi067.rdualw (mgr.24569) 4375 : cluster [DBG] pgmap v3770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:32.193525+0000 mgr.smithi067.rdualw (mgr.24569) 4376 : cluster [DBG] pgmap v3771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:32.193525+0000 mgr.smithi067.rdualw (mgr.24569) 4376 : cluster [DBG] pgmap v3771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:34.194097+0000 mgr.smithi067.rdualw (mgr.24569) 4377 : cluster [DBG] pgmap v3772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:34.194097+0000 mgr.smithi067.rdualw (mgr.24569) 4377 : cluster [DBG] pgmap v3772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:34:35.111132+0000 mon.smithi067 (mon.1) 689 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:34:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:34:35.111319+0000 mon.smithi061 (mon.0) 1048 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:34:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:34:35.111382+0000 mon.smithi067 (mon.1) 690 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:34:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:34:35.111659+0000 mon.smithi061 (mon.0) 1049 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:34:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:34:35.111132+0000 mon.smithi067 (mon.1) 689 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:34:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:34:35.111319+0000 mon.smithi061 (mon.0) 1048 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:34:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:34:35.111382+0000 mon.smithi067 (mon.1) 690 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:34:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:34:35.111659+0000 mon.smithi061 (mon.0) 1049 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:34:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:36.195109+0000 mgr.smithi067.rdualw (mgr.24569) 4378 : cluster [DBG] pgmap v3773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:34:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:36.195109+0000 mgr.smithi067.rdualw (mgr.24569) 4378 : cluster [DBG] pgmap v3773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:34:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:38.195613+0000 mgr.smithi067.rdualw (mgr.24569) 4379 : cluster [DBG] pgmap v3774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:38.195613+0000 mgr.smithi067.rdualw (mgr.24569) 4379 : cluster [DBG] pgmap v3774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:40.196140+0000 mgr.smithi067.rdualw (mgr.24569) 4380 : cluster [DBG] pgmap v3775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:40.196140+0000 mgr.smithi067.rdualw (mgr.24569) 4380 : cluster [DBG] pgmap v3775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:42.197037+0000 mgr.smithi067.rdualw (mgr.24569) 4381 : cluster [DBG] pgmap v3776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:42.197037+0000 mgr.smithi067.rdualw (mgr.24569) 4381 : cluster [DBG] pgmap v3776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:44.197859+0000 mgr.smithi067.rdualw (mgr.24569) 4382 : cluster [DBG] pgmap v3777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:44.197859+0000 mgr.smithi067.rdualw (mgr.24569) 4382 : cluster [DBG] pgmap v3777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:46.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:46.198763+0000 mgr.smithi067.rdualw (mgr.24569) 4383 : cluster [DBG] pgmap v3778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:34:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:46.198763+0000 mgr.smithi067.rdualw (mgr.24569) 4383 : cluster [DBG] pgmap v3778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:34:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:48.199271+0000 mgr.smithi067.rdualw (mgr.24569) 4384 : cluster [DBG] pgmap v3779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:48.199271+0000 mgr.smithi067.rdualw (mgr.24569) 4384 : cluster [DBG] pgmap v3779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:50.199979+0000 mgr.smithi067.rdualw (mgr.24569) 4385 : cluster [DBG] pgmap v3780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:50.199979+0000 mgr.smithi067.rdualw (mgr.24569) 4385 : cluster [DBG] pgmap v3780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:52.200868+0000 mgr.smithi067.rdualw (mgr.24569) 4386 : cluster [DBG] pgmap v3781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:52.200868+0000 mgr.smithi067.rdualw (mgr.24569) 4386 : cluster [DBG] pgmap v3781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:54.201568+0000 mgr.smithi067.rdualw (mgr.24569) 4387 : cluster [DBG] pgmap v3782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:55.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:54.201568+0000 mgr.smithi067.rdualw (mgr.24569) 4387 : cluster [DBG] pgmap v3782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:34:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:56.202363+0000 mgr.smithi067.rdualw (mgr.24569) 4388 : cluster [DBG] pgmap v3783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:34:57.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:34:57.148253+0000 mon.smithi067 (mon.1) 691 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:34:57.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:34:57.149719+0000 mon.smithi067 (mon.1) 692 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:34:57.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:34:57.150657+0000 mon.smithi067 (mon.1) 693 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:34:57.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:34:57.151505+0000 mgr.smithi067.rdualw (mgr.24569) 4389 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:34:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:56.202363+0000 mgr.smithi067.rdualw (mgr.24569) 4388 : cluster [DBG] pgmap v3783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:34:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:34:57.148253+0000 mon.smithi067 (mon.1) 691 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:34:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:34:57.149719+0000 mon.smithi067 (mon.1) 692 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:34:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:34:57.150657+0000 mon.smithi067 (mon.1) 693 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:34:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:34:57.151505+0000 mgr.smithi067.rdualw (mgr.24569) 4389 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:34:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:34:57.510158+0000 mon.smithi061 (mon.0) 1050 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:34:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:34:57.516258+0000 mon.smithi061 (mon.0) 1051 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:34:58.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:34:57.924112+0000 mon.smithi061 (mon.0) 1052 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:34:58.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:34:57.931972+0000 mon.smithi061 (mon.0) 1053 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:34:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:34:57.510158+0000 mon.smithi061 (mon.0) 1050 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:34:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:34:57.516258+0000 mon.smithi061 (mon.0) 1051 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:34:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:34:57.924112+0000 mon.smithi061 (mon.0) 1052 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:34:58.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:34:57.931972+0000 mon.smithi061 (mon.0) 1053 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:35:00.175 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:35:00.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:34:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:34:58.202793+0000 mgr.smithi067.rdualw (mgr.24569) 4390 : cluster [DBG] pgmap v3784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:34:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:34:58.202793+0000 mgr.smithi067.rdualw (mgr.24569) 4390 : cluster [DBG] pgmap v3784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:00.469 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:35:00.469 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 2m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:35:00.470 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 2m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:35:00.470 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 2m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:35:00.470 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 2m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:35:00.470 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 2m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:35:00.471 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 2m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:35:00.471 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 2m ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:35:00.471 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 2m ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:35:00.471 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 2m ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:35:00.472 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 2m ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:35:00.472 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 2m ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:35:00.472 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 2m ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:35:00.472 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 2m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:35:00.473 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 2m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:35:00.473 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (116m) 2m ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:35:00.473 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 2m ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:35:00.473 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 2m ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:35:00.473 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 2m ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:35:00.474 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 2m ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:35:00.474 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 2m ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:35:00.474 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 2m ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:35:00.474 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 2m ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:35:00.475 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 2m ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:35:00.809 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:35:00.810 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:35:00.810 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:35:00.810 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:35:00.811 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:35:00.811 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:35:00.811 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:35:00.811 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:35:00.811 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:35:00.812 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:35:00.812 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:35:00.812 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:35:00.812 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:35:00.813 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:35:00.813 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:35:00.813 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:35:00.813 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:35:00.813 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:35:00.814 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:35:01.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:35:00.161403+0000 mgr.smithi067.rdualw (mgr.24569) 4391 : audit [DBG] from='client.37066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:35:01.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:35:00.808052+0000 mon.smithi061 (mon.0) 1054 : audit [DBG] from='client.? 172.21.15.61:0/1127307284' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:35:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:35:00.161403+0000 mgr.smithi067.rdualw (mgr.24569) 4391 : audit [DBG] from='client.37066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:35:01.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:35:00.808052+0000 mon.smithi061 (mon.0) 1054 : audit [DBG] from='client.? 172.21.15.61:0/1127307284' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:35:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:00.203331+0000 mgr.smithi067.rdualw (mgr.24569) 4392 : cluster [DBG] pgmap v3785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:35:00.451754+0000 mgr.smithi067.rdualw (mgr.24569) 4393 : audit [DBG] from='client.37070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:35:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:00.203331+0000 mgr.smithi067.rdualw (mgr.24569) 4392 : cluster [DBG] pgmap v3785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:02.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:35:00.451754+0000 mgr.smithi067.rdualw (mgr.24569) 4393 : audit [DBG] from='client.37070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:35:04.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:02.204376+0000 mgr.smithi067.rdualw (mgr.24569) 4394 : cluster [DBG] pgmap v3786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:02.204376+0000 mgr.smithi067.rdualw (mgr.24569) 4394 : cluster [DBG] pgmap v3786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:04.204973+0000 mgr.smithi067.rdualw (mgr.24569) 4395 : cluster [DBG] pgmap v3787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:06.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:04.204973+0000 mgr.smithi067.rdualw (mgr.24569) 4395 : cluster [DBG] pgmap v3787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:08.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:06.206013+0000 mgr.smithi067.rdualw (mgr.24569) 4396 : cluster [DBG] pgmap v3788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:35:08.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:06.206013+0000 mgr.smithi067.rdualw (mgr.24569) 4396 : cluster [DBG] pgmap v3788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:35:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:08.206635+0000 mgr.smithi067.rdualw (mgr.24569) 4397 : cluster [DBG] pgmap v3789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:08.206635+0000 mgr.smithi067.rdualw (mgr.24569) 4397 : cluster [DBG] pgmap v3789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:10.207253+0000 mgr.smithi067.rdualw (mgr.24569) 4398 : cluster [DBG] pgmap v3790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:10.207253+0000 mgr.smithi067.rdualw (mgr.24569) 4398 : cluster [DBG] pgmap v3790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:12.208124+0000 mgr.smithi067.rdualw (mgr.24569) 4399 : cluster [DBG] pgmap v3791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:12.208124+0000 mgr.smithi067.rdualw (mgr.24569) 4399 : cluster [DBG] pgmap v3791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:16.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:14.208820+0000 mgr.smithi067.rdualw (mgr.24569) 4400 : cluster [DBG] pgmap v3792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:14.208820+0000 mgr.smithi067.rdualw (mgr.24569) 4400 : cluster [DBG] pgmap v3792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:16.209697+0000 mgr.smithi067.rdualw (mgr.24569) 4401 : cluster [DBG] pgmap v3793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:35:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:16.209697+0000 mgr.smithi067.rdualw (mgr.24569) 4401 : cluster [DBG] pgmap v3793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:35:20.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:18.210233+0000 mgr.smithi067.rdualw (mgr.24569) 4402 : cluster [DBG] pgmap v3794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:18.210233+0000 mgr.smithi067.rdualw (mgr.24569) 4402 : cluster [DBG] pgmap v3794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:20.210807+0000 mgr.smithi067.rdualw (mgr.24569) 4403 : cluster [DBG] pgmap v3795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:20.210807+0000 mgr.smithi067.rdualw (mgr.24569) 4403 : cluster [DBG] pgmap v3795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:22.211741+0000 mgr.smithi067.rdualw (mgr.24569) 4404 : cluster [DBG] pgmap v3796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:22.211741+0000 mgr.smithi067.rdualw (mgr.24569) 4404 : cluster [DBG] pgmap v3796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:24.212313+0000 mgr.smithi067.rdualw (mgr.24569) 4405 : cluster [DBG] pgmap v3797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:24.212313+0000 mgr.smithi067.rdualw (mgr.24569) 4405 : cluster [DBG] pgmap v3797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:26.213179+0000 mgr.smithi067.rdualw (mgr.24569) 4406 : cluster [DBG] pgmap v3798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:35:28.365 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:26.213179+0000 mgr.smithi067.rdualw (mgr.24569) 4406 : cluster [DBG] pgmap v3798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:35:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:28.213711+0000 mgr.smithi067.rdualw (mgr.24569) 4407 : cluster [DBG] pgmap v3799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:28.213711+0000 mgr.smithi067.rdualw (mgr.24569) 4407 : cluster [DBG] pgmap v3799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:31.119 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:35:31.418 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:35:31.418 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 2m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:35:31.419 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 2m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:35:31.419 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 2m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:35:31.419 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 2m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:35:31.419 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 2m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:35:31.420 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 2m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:35:31.420 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 2m ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:35:31.420 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 2m ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:35:31.420 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 2m ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:35:31.421 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 2m ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:35:31.421 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 2m ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:35:31.421 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 2m ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:35:31.421 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 2m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:35:31.421 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 2m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:35:31.422 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (116m) 2m ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:35:31.422 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 2m ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:35:31.422 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 2m ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:35:31.423 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 2m ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:35:31.423 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 2m ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:35:31.424 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 2m ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:35:31.424 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 2m ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:35:31.424 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 2m ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:35:31.424 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 2m ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:35:31.760 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:35:31.761 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:35:31.761 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:35:31.761 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:35:31.761 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:35:31.762 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:35:31.762 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:35:31.762 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:35:31.762 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:35:31.763 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:35:31.763 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:35:31.763 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:35:31.763 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:35:31.763 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:35:31.764 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:35:31.764 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:35:31.764 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:35:31.764 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:35:31.765 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:35:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:30.214464+0000 mgr.smithi067.rdualw (mgr.24569) 4408 : cluster [DBG] pgmap v3800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:35:31.106429+0000 mgr.smithi067.rdualw (mgr.24569) 4409 : audit [DBG] from='client.37078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:35:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:35:31.758129+0000 mon.smithi061 (mon.0) 1055 : audit [DBG] from='client.? 172.21.15.61:0/2705123525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:35:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:30.214464+0000 mgr.smithi067.rdualw (mgr.24569) 4408 : cluster [DBG] pgmap v3800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:35:31.106429+0000 mgr.smithi067.rdualw (mgr.24569) 4409 : audit [DBG] from='client.37078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:35:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:35:31.758129+0000 mon.smithi061 (mon.0) 1055 : audit [DBG] from='client.? 172.21.15.61:0/2705123525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:35:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:35:31.395241+0000 mgr.smithi067.rdualw (mgr.24569) 4410 : audit [DBG] from='client.37082 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:35:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:35:31.395241+0000 mgr.smithi067.rdualw (mgr.24569) 4410 : audit [DBG] from='client.37082 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:35:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:32.215455+0000 mgr.smithi067.rdualw (mgr.24569) 4411 : cluster [DBG] pgmap v3801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:32.215455+0000 mgr.smithi067.rdualw (mgr.24569) 4411 : cluster [DBG] pgmap v3801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:34.216051+0000 mgr.smithi067.rdualw (mgr.24569) 4412 : cluster [DBG] pgmap v3802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:35:35.116909+0000 mon.smithi067 (mon.1) 694 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:35:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:35:35.117068+0000 mon.smithi061 (mon.0) 1056 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:35:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:35:35.117155+0000 mon.smithi067 (mon.1) 695 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:35:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:35:35.117448+0000 mon.smithi061 (mon.0) 1057 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:35:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:34.216051+0000 mgr.smithi067.rdualw (mgr.24569) 4412 : cluster [DBG] pgmap v3802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:35:35.116909+0000 mon.smithi067 (mon.1) 694 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:35:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:35:35.117068+0000 mon.smithi061 (mon.0) 1056 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:35:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:35:35.117155+0000 mon.smithi067 (mon.1) 695 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:35:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:35:35.117448+0000 mon.smithi061 (mon.0) 1057 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:35:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:36.216865+0000 mgr.smithi067.rdualw (mgr.24569) 4413 : cluster [DBG] pgmap v3803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:35:38.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:36.216865+0000 mgr.smithi067.rdualw (mgr.24569) 4413 : cluster [DBG] pgmap v3803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:35:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:38.217409+0000 mgr.smithi067.rdualw (mgr.24569) 4414 : cluster [DBG] pgmap v3804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:38.217409+0000 mgr.smithi067.rdualw (mgr.24569) 4414 : cluster [DBG] pgmap v3804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:42.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:40.218032+0000 mgr.smithi067.rdualw (mgr.24569) 4415 : cluster [DBG] pgmap v3805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:40.218032+0000 mgr.smithi067.rdualw (mgr.24569) 4415 : cluster [DBG] pgmap v3805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:44.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:42.219073+0000 mgr.smithi067.rdualw (mgr.24569) 4416 : cluster [DBG] pgmap v3806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:42.219073+0000 mgr.smithi067.rdualw (mgr.24569) 4416 : cluster [DBG] pgmap v3806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:44.219825+0000 mgr.smithi067.rdualw (mgr.24569) 4417 : cluster [DBG] pgmap v3807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:44.219825+0000 mgr.smithi067.rdualw (mgr.24569) 4417 : cluster [DBG] pgmap v3807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:46.220663+0000 mgr.smithi067.rdualw (mgr.24569) 4418 : cluster [DBG] pgmap v3808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:35:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:46.220663+0000 mgr.smithi067.rdualw (mgr.24569) 4418 : cluster [DBG] pgmap v3808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:35:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:48.221171+0000 mgr.smithi067.rdualw (mgr.24569) 4419 : cluster [DBG] pgmap v3809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:50.320 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:48.221171+0000 mgr.smithi067.rdualw (mgr.24569) 4419 : cluster [DBG] pgmap v3809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:50.221868+0000 mgr.smithi067.rdualw (mgr.24569) 4420 : cluster [DBG] pgmap v3810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:50.221868+0000 mgr.smithi067.rdualw (mgr.24569) 4420 : cluster [DBG] pgmap v3810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:52.222949+0000 mgr.smithi067.rdualw (mgr.24569) 4421 : cluster [DBG] pgmap v3811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:52.222949+0000 mgr.smithi067.rdualw (mgr.24569) 4421 : cluster [DBG] pgmap v3811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:54.223773+0000 mgr.smithi067.rdualw (mgr.24569) 4422 : cluster [DBG] pgmap v3812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:54.223773+0000 mgr.smithi067.rdualw (mgr.24569) 4422 : cluster [DBG] pgmap v3812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:35:58.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:56.224709+0000 mgr.smithi067.rdualw (mgr.24569) 4423 : cluster [DBG] pgmap v3813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:35:58.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:35:57.935565+0000 mon.smithi067 (mon.1) 696 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:35:58.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:35:57.937081+0000 mon.smithi067 (mon.1) 697 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:35:58.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:35:57.938115+0000 mon.smithi067 (mon.1) 698 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:35:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:56.224709+0000 mgr.smithi067.rdualw (mgr.24569) 4423 : cluster [DBG] pgmap v3813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:35:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:35:57.935565+0000 mon.smithi067 (mon.1) 696 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:35:58.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:35:57.937081+0000 mon.smithi067 (mon.1) 697 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:35:58.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:35:57.938115+0000 mon.smithi067 (mon.1) 698 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:35:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:35:57.939029+0000 mgr.smithi067.rdualw (mgr.24569) 4424 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:35:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:35:58.355737+0000 mon.smithi061 (mon.0) 1058 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:35:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:35:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:35:58.363554+0000 mon.smithi061 (mon.0) 1059 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:35:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:35:57.939029+0000 mgr.smithi067.rdualw (mgr.24569) 4424 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:35:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:35:58.355737+0000 mon.smithi061 (mon.0) 1058 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:35:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:35:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:35:58.363554+0000 mon.smithi061 (mon.0) 1059 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:36:00.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:35:58.225365+0000 mgr.smithi067.rdualw (mgr.24569) 4425 : cluster [DBG] pgmap v3814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:35:58.225365+0000 mgr.smithi067.rdualw (mgr.24569) 4425 : cluster [DBG] pgmap v3814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:02.079 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:36:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:00.226149+0000 mgr.smithi067.rdualw (mgr.24569) 4426 : cluster [DBG] pgmap v3815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:02.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:00.226149+0000 mgr.smithi067.rdualw (mgr.24569) 4426 : cluster [DBG] pgmap v3815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:02.370 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:36:02.371 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 3m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:36:02.371 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 3m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:36:02.371 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 3m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:36:02.371 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 3m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:36:02.372 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 3m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:36:02.372 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 3m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:36:02.372 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 3m ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:36:02.372 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 3m ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:36:02.372 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 3m ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:36:02.373 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 3m ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:36:02.373 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 3m ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:36:02.373 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 3m ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:36:02.373 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 3m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:36:02.374 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 3m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:36:02.374 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (117m) 3m ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:36:02.374 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 3m ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:36:02.374 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 3m ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:36:02.375 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 3m ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:36:02.375 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 3m ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:36:02.375 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 3m ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:36:02.375 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 3m ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:36:02.375 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 3m ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:36:02.376 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 3m ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:36:02.712 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:36:02.713 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:36:02.713 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:36:02.713 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:36:02.713 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:36:02.714 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:36:02.714 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:36:02.714 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:36:02.714 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:36:02.715 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:36:02.715 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:36:02.715 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:36:02.715 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:36:02.716 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:36:02.716 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:36:02.716 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:36:02.716 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:36:02.716 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:36:02.717 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:36:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:36:02.065108+0000 mgr.smithi067.rdualw (mgr.24569) 4427 : audit [DBG] from='client.37090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:36:03.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:36:02.711063+0000 mon.smithi061 (mon.0) 1060 : audit [DBG] from='client.? 172.21.15.61:0/4030535261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:36:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:36:02.065108+0000 mgr.smithi067.rdualw (mgr.24569) 4427 : audit [DBG] from='client.37090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:36:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:36:02.711063+0000 mon.smithi061 (mon.0) 1060 : audit [DBG] from='client.? 172.21.15.61:0/4030535261' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:36:04.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:02.227179+0000 mgr.smithi067.rdualw (mgr.24569) 4428 : cluster [DBG] pgmap v3816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:04.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:36:02.352698+0000 mgr.smithi067.rdualw (mgr.24569) 4429 : audit [DBG] from='client.37094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:36:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:02.227179+0000 mgr.smithi067.rdualw (mgr.24569) 4428 : cluster [DBG] pgmap v3816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:04.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:36:02.352698+0000 mgr.smithi067.rdualw (mgr.24569) 4429 : audit [DBG] from='client.37094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:36:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:04.227907+0000 mgr.smithi067.rdualw (mgr.24569) 4430 : cluster [DBG] pgmap v3817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:04.227907+0000 mgr.smithi067.rdualw (mgr.24569) 4430 : cluster [DBG] pgmap v3817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:06.228923+0000 mgr.smithi067.rdualw (mgr.24569) 4431 : cluster [DBG] pgmap v3818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:36:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:06.228923+0000 mgr.smithi067.rdualw (mgr.24569) 4431 : cluster [DBG] pgmap v3818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:36:10.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:08.229580+0000 mgr.smithi067.rdualw (mgr.24569) 4432 : cluster [DBG] pgmap v3819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:10.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:08.229580+0000 mgr.smithi067.rdualw (mgr.24569) 4432 : cluster [DBG] pgmap v3819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:10.230208+0000 mgr.smithi067.rdualw (mgr.24569) 4433 : cluster [DBG] pgmap v3820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:10.230208+0000 mgr.smithi067.rdualw (mgr.24569) 4433 : cluster [DBG] pgmap v3820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:12.231221+0000 mgr.smithi067.rdualw (mgr.24569) 4434 : cluster [DBG] pgmap v3821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:12.231221+0000 mgr.smithi067.rdualw (mgr.24569) 4434 : cluster [DBG] pgmap v3821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:14.231933+0000 mgr.smithi067.rdualw (mgr.24569) 4435 : cluster [DBG] pgmap v3822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:14.231933+0000 mgr.smithi067.rdualw (mgr.24569) 4435 : cluster [DBG] pgmap v3822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:16.232821+0000 mgr.smithi067.rdualw (mgr.24569) 4436 : cluster [DBG] pgmap v3823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:36:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:16.232821+0000 mgr.smithi067.rdualw (mgr.24569) 4436 : cluster [DBG] pgmap v3823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:36:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:18.233303+0000 mgr.smithi067.rdualw (mgr.24569) 4437 : cluster [DBG] pgmap v3824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:18.233303+0000 mgr.smithi067.rdualw (mgr.24569) 4437 : cluster [DBG] pgmap v3824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:22.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:20.234045+0000 mgr.smithi067.rdualw (mgr.24569) 4438 : cluster [DBG] pgmap v3825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:20.234045+0000 mgr.smithi067.rdualw (mgr.24569) 4438 : cluster [DBG] pgmap v3825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:22.234900+0000 mgr.smithi067.rdualw (mgr.24569) 4439 : cluster [DBG] pgmap v3826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:22.234900+0000 mgr.smithi067.rdualw (mgr.24569) 4439 : cluster [DBG] pgmap v3826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:24.235567+0000 mgr.smithi067.rdualw (mgr.24569) 4440 : cluster [DBG] pgmap v3827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:24.235567+0000 mgr.smithi067.rdualw (mgr.24569) 4440 : cluster [DBG] pgmap v3827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:26.236350+0000 mgr.smithi067.rdualw (mgr.24569) 4441 : cluster [DBG] pgmap v3828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:36:28.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:26.236350+0000 mgr.smithi067.rdualw (mgr.24569) 4441 : cluster [DBG] pgmap v3828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:36:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:28.236881+0000 mgr.smithi067.rdualw (mgr.24569) 4442 : cluster [DBG] pgmap v3829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:28.236881+0000 mgr.smithi067.rdualw (mgr.24569) 4442 : cluster [DBG] pgmap v3829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:30.237718+0000 mgr.smithi067.rdualw (mgr.24569) 4443 : cluster [DBG] pgmap v3830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:30.237718+0000 mgr.smithi067.rdualw (mgr.24569) 4443 : cluster [DBG] pgmap v3830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:33.106 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:36:33.398 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:36:33.398 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 3m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:36:33.398 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 3m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:36:33.399 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 3m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:36:33.399 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 3m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:36:33.399 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 3m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:36:33.399 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 3m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:36:33.400 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 3m ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:36:33.400 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 3m ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:36:33.400 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 3m ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:36:33.400 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 3m ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:36:33.400 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 3m ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:36:33.401 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 3m ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:36:33.401 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 3m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:36:33.401 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 3m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:36:33.401 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (117m) 3m ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:36:33.402 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 3m ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:36:33.402 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 3m ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:36:33.403 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 3m ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:36:33.403 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 3m ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:36:33.403 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 3m ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:36:33.403 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 3m ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:36:33.404 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 3m ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:36:33.404 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 3m ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:36:33.748 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:36:33.748 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:36:33.748 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:36:33.749 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:36:33.749 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:36:33.749 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:36:33.749 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:36:33.749 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:36:33.750 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:36:33.756 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:36:33.756 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:36:33.756 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:36:33.757 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:36:33.757 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:36:33.758 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:36:33.758 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:36:33.758 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:36:33.759 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:36:33.759 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:36:34.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:32.238727+0000 mgr.smithi067.rdualw (mgr.24569) 4444 : cluster [DBG] pgmap v3831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:34.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:36:33.090312+0000 mgr.smithi067.rdualw (mgr.24569) 4445 : audit [DBG] from='client.37102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:36:34.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:36:33.746544+0000 mon.smithi061 (mon.0) 1061 : audit [DBG] from='client.? 172.21.15.61:0/1948917639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:36:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:32.238727+0000 mgr.smithi067.rdualw (mgr.24569) 4444 : cluster [DBG] pgmap v3831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:36:33.090312+0000 mgr.smithi067.rdualw (mgr.24569) 4445 : audit [DBG] from='client.37102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:36:34.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:36:33.746544+0000 mon.smithi061 (mon.0) 1061 : audit [DBG] from='client.? 172.21.15.61:0/1948917639' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:36:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:36:33.380017+0000 mgr.smithi067.rdualw (mgr.24569) 4446 : audit [DBG] from='client.37106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:36:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:36:33.380017+0000 mgr.smithi067.rdualw (mgr.24569) 4446 : audit [DBG] from='client.37106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:36:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:34.239503+0000 mgr.smithi067.rdualw (mgr.24569) 4447 : cluster [DBG] pgmap v3832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:36:35.122989+0000 mon.smithi067 (mon.1) 699 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:36:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:36:35.123198+0000 mon.smithi061 (mon.0) 1062 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:36:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:36:35.123341+0000 mon.smithi067 (mon.1) 700 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:36:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:36:35.123687+0000 mon.smithi061 (mon.0) 1063 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:36:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:34.239503+0000 mgr.smithi067.rdualw (mgr.24569) 4447 : cluster [DBG] pgmap v3832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:36:35.122989+0000 mon.smithi067 (mon.1) 699 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:36:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:36:35.123198+0000 mon.smithi061 (mon.0) 1062 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:36:36.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:36:35.123341+0000 mon.smithi067 (mon.1) 700 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:36:36.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:36:35.123687+0000 mon.smithi061 (mon.0) 1063 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:36:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:36.240289+0000 mgr.smithi067.rdualw (mgr.24569) 4448 : cluster [DBG] pgmap v3833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:36:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:36.240289+0000 mgr.smithi067.rdualw (mgr.24569) 4448 : cluster [DBG] pgmap v3833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:36:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:38.240792+0000 mgr.smithi067.rdualw (mgr.24569) 4449 : cluster [DBG] pgmap v3834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:38.240792+0000 mgr.smithi067.rdualw (mgr.24569) 4449 : cluster [DBG] pgmap v3834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:40.241444+0000 mgr.smithi067.rdualw (mgr.24569) 4450 : cluster [DBG] pgmap v3835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:40.241444+0000 mgr.smithi067.rdualw (mgr.24569) 4450 : cluster [DBG] pgmap v3835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:42.242590+0000 mgr.smithi067.rdualw (mgr.24569) 4451 : cluster [DBG] pgmap v3836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:42.242590+0000 mgr.smithi067.rdualw (mgr.24569) 4451 : cluster [DBG] pgmap v3836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:44.243208+0000 mgr.smithi067.rdualw (mgr.24569) 4452 : cluster [DBG] pgmap v3837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:44.243208+0000 mgr.smithi067.rdualw (mgr.24569) 4452 : cluster [DBG] pgmap v3837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:46.244281+0000 mgr.smithi067.rdualw (mgr.24569) 4453 : cluster [DBG] pgmap v3838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:36:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:46.244281+0000 mgr.smithi067.rdualw (mgr.24569) 4453 : cluster [DBG] pgmap v3838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:36:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:48.244984+0000 mgr.smithi067.rdualw (mgr.24569) 4454 : cluster [DBG] pgmap v3839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:48.244984+0000 mgr.smithi067.rdualw (mgr.24569) 4454 : cluster [DBG] pgmap v3839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:50.245668+0000 mgr.smithi067.rdualw (mgr.24569) 4455 : cluster [DBG] pgmap v3840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:50.245668+0000 mgr.smithi067.rdualw (mgr.24569) 4455 : cluster [DBG] pgmap v3840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:52.246709+0000 mgr.smithi067.rdualw (mgr.24569) 4456 : cluster [DBG] pgmap v3841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:52.246709+0000 mgr.smithi067.rdualw (mgr.24569) 4456 : cluster [DBG] pgmap v3841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:54.247339+0000 mgr.smithi067.rdualw (mgr.24569) 4457 : cluster [DBG] pgmap v3842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:54.247339+0000 mgr.smithi067.rdualw (mgr.24569) 4457 : cluster [DBG] pgmap v3842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:36:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:56.248273+0000 mgr.smithi067.rdualw (mgr.24569) 4458 : cluster [DBG] pgmap v3843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:36:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:56.248273+0000 mgr.smithi067.rdualw (mgr.24569) 4458 : cluster [DBG] pgmap v3843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:36:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:36:58.367278+0000 mon.smithi067 (mon.1) 701 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:36:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:36:58.368772+0000 mon.smithi067 (mon.1) 702 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:36:59.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:36:58.369700+0000 mon.smithi067 (mon.1) 703 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:36:59.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:36:58.772021+0000 mon.smithi061 (mon.0) 1064 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:36:59.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:36:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:36:58.777581+0000 mon.smithi061 (mon.0) 1065 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:36:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:36:58.367278+0000 mon.smithi067 (mon.1) 701 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:36:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:36:58.368772+0000 mon.smithi067 (mon.1) 702 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:36:59.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:36:58.369700+0000 mon.smithi067 (mon.1) 703 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:36:59.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:36:58.772021+0000 mon.smithi061 (mon.0) 1064 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:36:59.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:36:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:36:58.777581+0000 mon.smithi061 (mon.0) 1065 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:37:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:36:58.248963+0000 mgr.smithi067.rdualw (mgr.24569) 4459 : cluster [DBG] pgmap v3844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:00.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:36:58.370597+0000 mgr.smithi067.rdualw (mgr.24569) 4460 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:37:00.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:36:58.248963+0000 mgr.smithi067.rdualw (mgr.24569) 4459 : cluster [DBG] pgmap v3844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:00.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:36:58.370597+0000 mgr.smithi067.rdualw (mgr.24569) 4460 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:37:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:00.249762+0000 mgr.smithi067.rdualw (mgr.24569) 4461 : cluster [DBG] pgmap v3845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:00.249762+0000 mgr.smithi067.rdualw (mgr.24569) 4461 : cluster [DBG] pgmap v3845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:04.054 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:37:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:02.250675+0000 mgr.smithi067.rdualw (mgr.24569) 4462 : cluster [DBG] pgmap v3846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:04.347 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:37:04.348 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 4m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:37:04.348 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 4m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:37:04.348 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 4m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:37:04.349 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 4m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:37:04.349 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 4m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:37:04.349 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 4m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:37:04.350 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 4m ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:37:04.350 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 4m ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:37:04.357 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 4m ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:37:04.358 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 4m ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:37:04.358 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 4m ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:37:04.358 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 4m ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:37:04.359 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 4m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:37:04.359 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 4m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:37:04.359 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (118m) 4m ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:37:04.359 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 4m ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:37:04.360 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 4m ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:37:04.360 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 4m ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:37:04.360 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 4m ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:37:04.360 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 4m ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:37:04.361 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 4m ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:37:04.361 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 4m ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:37:04.361 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 4m ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:37:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:02.250675+0000 mgr.smithi067.rdualw (mgr.24569) 4462 : cluster [DBG] pgmap v3846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:04.756 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:37:04.757 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:37:04.757 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:37:04.757 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:37:04.758 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:37:04.758 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:37:04.758 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:37:04.758 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:37:04.759 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:37:04.759 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:37:04.759 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:37:04.760 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:37:04.760 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:37:04.760 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:37:04.761 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:37:04.761 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:37:04.761 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:37:04.761 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:37:04.762 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:37:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:37:04.040743+0000 mgr.smithi067.rdualw (mgr.24569) 4463 : audit [DBG] from='client.37114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:37:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:37:04.755325+0000 mon.smithi061 (mon.0) 1066 : audit [DBG] from='client.? 172.21.15.61:0/1995168111' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:37:05.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:37:04.040743+0000 mgr.smithi067.rdualw (mgr.24569) 4463 : audit [DBG] from='client.37114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:37:05.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:37:04.755325+0000 mon.smithi061 (mon.0) 1066 : audit [DBG] from='client.? 172.21.15.61:0/1995168111' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:37:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:04.251487+0000 mgr.smithi067.rdualw (mgr.24569) 4464 : cluster [DBG] pgmap v3847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:37:04.329712+0000 mgr.smithi067.rdualw (mgr.24569) 4465 : audit [DBG] from='client.37118 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:37:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:04.251487+0000 mgr.smithi067.rdualw (mgr.24569) 4464 : cluster [DBG] pgmap v3847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:37:04.329712+0000 mgr.smithi067.rdualw (mgr.24569) 4465 : audit [DBG] from='client.37118 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:37:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:06.252617+0000 mgr.smithi067.rdualw (mgr.24569) 4466 : cluster [DBG] pgmap v3848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:37:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:06.252617+0000 mgr.smithi067.rdualw (mgr.24569) 4466 : cluster [DBG] pgmap v3848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:37:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:08.253305+0000 mgr.smithi067.rdualw (mgr.24569) 4467 : cluster [DBG] pgmap v3849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:08.253305+0000 mgr.smithi067.rdualw (mgr.24569) 4467 : cluster [DBG] pgmap v3849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:10.253951+0000 mgr.smithi067.rdualw (mgr.24569) 4468 : cluster [DBG] pgmap v3850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:10.253951+0000 mgr.smithi067.rdualw (mgr.24569) 4468 : cluster [DBG] pgmap v3850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:14.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:12.254995+0000 mgr.smithi067.rdualw (mgr.24569) 4469 : cluster [DBG] pgmap v3851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:12.254995+0000 mgr.smithi067.rdualw (mgr.24569) 4469 : cluster [DBG] pgmap v3851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:14.255594+0000 mgr.smithi067.rdualw (mgr.24569) 4470 : cluster [DBG] pgmap v3852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:14.255594+0000 mgr.smithi067.rdualw (mgr.24569) 4470 : cluster [DBG] pgmap v3852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:16.256633+0000 mgr.smithi067.rdualw (mgr.24569) 4471 : cluster [DBG] pgmap v3853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:37:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:16.256633+0000 mgr.smithi067.rdualw (mgr.24569) 4471 : cluster [DBG] pgmap v3853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:37:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:18.257199+0000 mgr.smithi067.rdualw (mgr.24569) 4472 : cluster [DBG] pgmap v3854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:18.257199+0000 mgr.smithi067.rdualw (mgr.24569) 4472 : cluster [DBG] pgmap v3854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:20.257926+0000 mgr.smithi067.rdualw (mgr.24569) 4473 : cluster [DBG] pgmap v3855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:20.257926+0000 mgr.smithi067.rdualw (mgr.24569) 4473 : cluster [DBG] pgmap v3855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:22.258832+0000 mgr.smithi067.rdualw (mgr.24569) 4474 : cluster [DBG] pgmap v3856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:22.258832+0000 mgr.smithi067.rdualw (mgr.24569) 4474 : cluster [DBG] pgmap v3856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:24.259430+0000 mgr.smithi067.rdualw (mgr.24569) 4475 : cluster [DBG] pgmap v3857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:26.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:24.259430+0000 mgr.smithi067.rdualw (mgr.24569) 4475 : cluster [DBG] pgmap v3857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:26.260294+0000 mgr.smithi067.rdualw (mgr.24569) 4476 : cluster [DBG] pgmap v3858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:37:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:26.260294+0000 mgr.smithi067.rdualw (mgr.24569) 4476 : cluster [DBG] pgmap v3858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:37:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:28.260841+0000 mgr.smithi067.rdualw (mgr.24569) 4477 : cluster [DBG] pgmap v3859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:28.260841+0000 mgr.smithi067.rdualw (mgr.24569) 4477 : cluster [DBG] pgmap v3859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:32.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:30.261592+0000 mgr.smithi067.rdualw (mgr.24569) 4478 : cluster [DBG] pgmap v3860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:30.261592+0000 mgr.smithi067.rdualw (mgr.24569) 4478 : cluster [DBG] pgmap v3860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:32.262345+0000 mgr.smithi067.rdualw (mgr.24569) 4479 : cluster [DBG] pgmap v3861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:32.262345+0000 mgr.smithi067.rdualw (mgr.24569) 4479 : cluster [DBG] pgmap v3861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:35.066 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:37:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:37:35.128154+0000 mon.smithi067 (mon.1) 704 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:37:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:37:35.128427+0000 mon.smithi067 (mon.1) 705 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:37:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:37:35.128476+0000 mon.smithi061 (mon.0) 1067 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:37:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:37:35.129062+0000 mon.smithi061 (mon.0) 1068 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:37:35.359 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:37:35.359 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 4m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:37:35.359 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 4m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:37:35.360 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 4m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:37:35.360 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 4m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:37:35.360 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 4m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:37:35.360 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 4m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:37:35.361 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 4m ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:37:35.361 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 4m ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:37:35.361 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 4m ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:37:35.361 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 4m ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:37:35.361 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 4m ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:37:35.362 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 4m ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:37:35.362 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 4m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:37:35.362 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 4m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:37:35.362 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (118m) 4m ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:37:35.363 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 4m ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:37:35.363 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 4m ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:37:35.363 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 4m ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:37:35.363 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 4m ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:37:35.364 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 4m ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:37:35.364 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 4m ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:37:35.364 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 4m ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:37:35.364 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 4m ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:37:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:37:35.128154+0000 mon.smithi067 (mon.1) 704 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:37:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:37:35.128427+0000 mon.smithi067 (mon.1) 705 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:37:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:37:35.128476+0000 mon.smithi061 (mon.0) 1067 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:37:35.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:37:35.129062+0000 mon.smithi061 (mon.0) 1068 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:37:35.701 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:37:35.701 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:37:35.701 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:37:35.702 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:37:35.702 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:37:35.702 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:37:35.702 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:37:35.703 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:37:35.703 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:37:35.704 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:37:35.704 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:37:35.704 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:37:35.704 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:37:35.705 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:37:35.705 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:37:35.705 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:37:35.706 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:37:35.706 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:37:35.706 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:37:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:34.262921+0000 mgr.smithi067.rdualw (mgr.24569) 4480 : cluster [DBG] pgmap v3862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:36.358 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:37:35.053248+0000 mgr.smithi067.rdualw (mgr.24569) 4481 : audit [DBG] from='client.37126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:37:36.359 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:37:35.698661+0000 mon.smithi061 (mon.0) 1069 : audit [DBG] from='client.? 172.21.15.61:0/2044908569' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:37:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:34.262921+0000 mgr.smithi067.rdualw (mgr.24569) 4480 : cluster [DBG] pgmap v3862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:37:35.053248+0000 mgr.smithi067.rdualw (mgr.24569) 4481 : audit [DBG] from='client.37126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:37:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:37:35.698661+0000 mon.smithi061 (mon.0) 1069 : audit [DBG] from='client.? 172.21.15.61:0/2044908569' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:37:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:37:35.341020+0000 mgr.smithi067.rdualw (mgr.24569) 4482 : audit [DBG] from='client.37130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:37:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:37:35.341020+0000 mgr.smithi067.rdualw (mgr.24569) 4482 : audit [DBG] from='client.37130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:37:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:36.263958+0000 mgr.smithi067.rdualw (mgr.24569) 4483 : cluster [DBG] pgmap v3863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:37:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:36.263958+0000 mgr.smithi067.rdualw (mgr.24569) 4483 : cluster [DBG] pgmap v3863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:37:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:38.264458+0000 mgr.smithi067.rdualw (mgr.24569) 4484 : cluster [DBG] pgmap v3864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:38.264458+0000 mgr.smithi067.rdualw (mgr.24569) 4484 : cluster [DBG] pgmap v3864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:40.265104+0000 mgr.smithi067.rdualw (mgr.24569) 4485 : cluster [DBG] pgmap v3865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:40.265104+0000 mgr.smithi067.rdualw (mgr.24569) 4485 : cluster [DBG] pgmap v3865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:44.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:42.266082+0000 mgr.smithi067.rdualw (mgr.24569) 4486 : cluster [DBG] pgmap v3866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:42.266082+0000 mgr.smithi067.rdualw (mgr.24569) 4486 : cluster [DBG] pgmap v3866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:44.266706+0000 mgr.smithi067.rdualw (mgr.24569) 4487 : cluster [DBG] pgmap v3867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:44.266706+0000 mgr.smithi067.rdualw (mgr.24569) 4487 : cluster [DBG] pgmap v3867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:46.267546+0000 mgr.smithi067.rdualw (mgr.24569) 4488 : cluster [DBG] pgmap v3868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:37:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:46.267546+0000 mgr.smithi067.rdualw (mgr.24569) 4488 : cluster [DBG] pgmap v3868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:37:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:48.268294+0000 mgr.smithi067.rdualw (mgr.24569) 4489 : cluster [DBG] pgmap v3869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:48.268294+0000 mgr.smithi067.rdualw (mgr.24569) 4489 : cluster [DBG] pgmap v3869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:50.268947+0000 mgr.smithi067.rdualw (mgr.24569) 4490 : cluster [DBG] pgmap v3870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:50.268947+0000 mgr.smithi067.rdualw (mgr.24569) 4490 : cluster [DBG] pgmap v3870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:52.269857+0000 mgr.smithi067.rdualw (mgr.24569) 4491 : cluster [DBG] pgmap v3871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:52.269857+0000 mgr.smithi067.rdualw (mgr.24569) 4491 : cluster [DBG] pgmap v3871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:54.270470+0000 mgr.smithi067.rdualw (mgr.24569) 4492 : cluster [DBG] pgmap v3872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:54.270470+0000 mgr.smithi067.rdualw (mgr.24569) 4492 : cluster [DBG] pgmap v3872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:37:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:56.271257+0000 mgr.smithi067.rdualw (mgr.24569) 4493 : cluster [DBG] pgmap v3873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:37:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:56.271257+0000 mgr.smithi067.rdualw (mgr.24569) 4493 : cluster [DBG] pgmap v3873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:37:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:37:58.781225+0000 mon.smithi067 (mon.1) 706 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:37:59.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:37:58.782644+0000 mon.smithi067 (mon.1) 707 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:37:59.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:37:58.783559+0000 mon.smithi067 (mon.1) 708 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:37:59.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:37:59.198060+0000 mon.smithi061 (mon.0) 1070 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:37:59.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:37:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:37:59.203435+0000 mon.smithi061 (mon.0) 1071 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:37:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:37:58.781225+0000 mon.smithi067 (mon.1) 706 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:37:59.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:37:58.782644+0000 mon.smithi067 (mon.1) 707 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:37:59.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:37:58.783559+0000 mon.smithi067 (mon.1) 708 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:37:59.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:37:59.198060+0000 mon.smithi061 (mon.0) 1070 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:37:59.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:37:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:37:59.203435+0000 mon.smithi061 (mon.0) 1071 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:38:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:37:58.271817+0000 mgr.smithi067.rdualw (mgr.24569) 4494 : cluster [DBG] pgmap v3874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:37:58.784437+0000 mgr.smithi067.rdualw (mgr.24569) 4495 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:38:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:37:58.271817+0000 mgr.smithi067.rdualw (mgr.24569) 4494 : cluster [DBG] pgmap v3874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:37:58.784437+0000 mgr.smithi067.rdualw (mgr.24569) 4495 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:38:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:00.272459+0000 mgr.smithi067.rdualw (mgr.24569) 4496 : cluster [DBG] pgmap v3875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:00.272459+0000 mgr.smithi067.rdualw (mgr.24569) 4496 : cluster [DBG] pgmap v3875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:02.273438+0000 mgr.smithi067.rdualw (mgr.24569) 4497 : cluster [DBG] pgmap v3876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:02.273438+0000 mgr.smithi067.rdualw (mgr.24569) 4497 : cluster [DBG] pgmap v3876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:06.008 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:38:06.299 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:38:06.300 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 5m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:38:06.300 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 5m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:38:06.300 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 5m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:38:06.300 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 5m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:38:06.300 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 5m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:38:06.301 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 5m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:38:06.301 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 5m ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:38:06.301 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 5m ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:38:06.301 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 5m ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:38:06.302 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 5m ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:38:06.302 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 5m ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:38:06.302 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 5m ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:38:06.302 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 5m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:38:06.302 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 5m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:38:06.303 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (119m) 5m ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:38:06.303 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 5m ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:38:06.303 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 5m ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:38:06.303 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 5m ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:38:06.304 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 5m ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:38:06.304 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 5m ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:38:06.304 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 5m ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:38:06.304 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 5m ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:38:06.304 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 5m ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:38:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:04.274022+0000 mgr.smithi067.rdualw (mgr.24569) 4498 : cluster [DBG] pgmap v3877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:04.274022+0000 mgr.smithi067.rdualw (mgr.24569) 4498 : cluster [DBG] pgmap v3877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:06.643 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:38:06.644 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:38:06.644 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:38:06.644 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:38:06.644 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:38:06.645 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:38:06.645 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:38:06.645 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:38:06.645 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:38:06.645 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:38:06.646 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:38:06.646 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:38:06.647 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:38:06.647 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:38:06.647 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:38:06.647 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:38:06.648 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:38:06.648 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:38:06.648 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:38:07.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:38:05.995385+0000 mgr.smithi067.rdualw (mgr.24569) 4499 : audit [DBG] from='client.37138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:38:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:38:06.642083+0000 mon.smithi061 (mon.0) 1072 : audit [DBG] from='client.? 172.21.15.61:0/1353101830' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:38:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:38:05.995385+0000 mgr.smithi067.rdualw (mgr.24569) 4499 : audit [DBG] from='client.37138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:38:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:38:06.642083+0000 mon.smithi061 (mon.0) 1072 : audit [DBG] from='client.? 172.21.15.61:0/1353101830' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:38:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:06.274848+0000 mgr.smithi067.rdualw (mgr.24569) 4500 : cluster [DBG] pgmap v3878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:38:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:38:06.281580+0000 mgr.smithi067.rdualw (mgr.24569) 4501 : audit [DBG] from='client.37142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:38:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:06.274848+0000 mgr.smithi067.rdualw (mgr.24569) 4500 : cluster [DBG] pgmap v3878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:38:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:38:06.281580+0000 mgr.smithi067.rdualw (mgr.24569) 4501 : audit [DBG] from='client.37142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:38:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:08.275423+0000 mgr.smithi067.rdualw (mgr.24569) 4502 : cluster [DBG] pgmap v3879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:08.275423+0000 mgr.smithi067.rdualw (mgr.24569) 4502 : cluster [DBG] pgmap v3879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:11.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:10.276176+0000 mgr.smithi067.rdualw (mgr.24569) 4503 : cluster [DBG] pgmap v3880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:11.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:10.276176+0000 mgr.smithi067.rdualw (mgr.24569) 4503 : cluster [DBG] pgmap v3880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:13.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:12.277060+0000 mgr.smithi067.rdualw (mgr.24569) 4504 : cluster [DBG] pgmap v3881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:12.277060+0000 mgr.smithi067.rdualw (mgr.24569) 4504 : cluster [DBG] pgmap v3881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:15.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:14.277708+0000 mgr.smithi067.rdualw (mgr.24569) 4505 : cluster [DBG] pgmap v3882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:14.277708+0000 mgr.smithi067.rdualw (mgr.24569) 4505 : cluster [DBG] pgmap v3882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:16.278686+0000 mgr.smithi067.rdualw (mgr.24569) 4506 : cluster [DBG] pgmap v3883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:38:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:16.278686+0000 mgr.smithi067.rdualw (mgr.24569) 4506 : cluster [DBG] pgmap v3883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:38:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:18.279180+0000 mgr.smithi067.rdualw (mgr.24569) 4507 : cluster [DBG] pgmap v3884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:18.279180+0000 mgr.smithi067.rdualw (mgr.24569) 4507 : cluster [DBG] pgmap v3884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:20.280048+0000 mgr.smithi067.rdualw (mgr.24569) 4508 : cluster [DBG] pgmap v3885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:21.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:20.280048+0000 mgr.smithi067.rdualw (mgr.24569) 4508 : cluster [DBG] pgmap v3885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:23.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:22.280781+0000 mgr.smithi067.rdualw (mgr.24569) 4509 : cluster [DBG] pgmap v3886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:22.280781+0000 mgr.smithi067.rdualw (mgr.24569) 4509 : cluster [DBG] pgmap v3886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:25.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:24.281307+0000 mgr.smithi067.rdualw (mgr.24569) 4510 : cluster [DBG] pgmap v3887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:25.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:24.281307+0000 mgr.smithi067.rdualw (mgr.24569) 4510 : cluster [DBG] pgmap v3887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:27.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:26.282247+0000 mgr.smithi067.rdualw (mgr.24569) 4511 : cluster [DBG] pgmap v3888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:38:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:26.282247+0000 mgr.smithi067.rdualw (mgr.24569) 4511 : cluster [DBG] pgmap v3888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:38:29.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:28.282959+0000 mgr.smithi067.rdualw (mgr.24569) 4512 : cluster [DBG] pgmap v3889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:29.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:28.282959+0000 mgr.smithi067.rdualw (mgr.24569) 4512 : cluster [DBG] pgmap v3889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:31.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:30.283643+0000 mgr.smithi067.rdualw (mgr.24569) 4513 : cluster [DBG] pgmap v3890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:31.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:30.283643+0000 mgr.smithi067.rdualw (mgr.24569) 4513 : cluster [DBG] pgmap v3890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:33.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:32.284635+0000 mgr.smithi067.rdualw (mgr.24569) 4514 : cluster [DBG] pgmap v3891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:33.822 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:32.284635+0000 mgr.smithi067.rdualw (mgr.24569) 4514 : cluster [DBG] pgmap v3891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:34.285370+0000 mgr.smithi067.rdualw (mgr.24569) 4515 : cluster [DBG] pgmap v3892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:38:35.133415+0000 mon.smithi067 (mon.1) 709 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:38:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:38:35.133683+0000 mon.smithi067 (mon.1) 710 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:38:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:38:35.133788+0000 mon.smithi061 (mon.0) 1073 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:38:35.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:38:35.134033+0000 mon.smithi061 (mon.0) 1074 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:38:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:34.285370+0000 mgr.smithi067.rdualw (mgr.24569) 4515 : cluster [DBG] pgmap v3892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:38:35.133415+0000 mon.smithi067 (mon.1) 709 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:38:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:38:35.133683+0000 mon.smithi067 (mon.1) 710 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:38:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:38:35.133788+0000 mon.smithi061 (mon.0) 1073 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:38:35.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:38:35.134033+0000 mon.smithi061 (mon.0) 1074 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:38:36.952 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:38:37.274 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:38:37.274 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 5m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:38:37.274 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 5m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:38:37.275 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 5m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:38:37.275 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 5m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:38:37.275 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 5m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:38:37.275 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 5m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:38:37.275 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 5m ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:38:37.276 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 5m ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:38:37.276 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 5m ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:38:37.276 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 5m ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:38:37.276 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 5m ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:38:37.277 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 5m ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:38:37.277 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 5m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:38:37.277 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 5m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:38:37.277 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (119m) 5m ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:38:37.277 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 5m ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:38:37.278 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 5m ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:38:37.278 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 5m ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:38:37.278 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 5m ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:38:37.279 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 5m ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:38:37.279 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 5m ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:38:37.279 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 5m ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:38:37.279 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 5m ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:38:37.663 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:38:37.786 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:38:37.787 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:38:37.787 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:38:37.787 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:38:37.788 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:38:37.788 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:38:37.788 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:38:37.788 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:38:37.789 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:38:37.789 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:38:37.789 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:38:37.789 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:38:37.789 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:38:37.790 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:38:37.790 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:38:37.790 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:38:37.790 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:38:37.791 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:38:37.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:36.286290+0000 mgr.smithi067.rdualw (mgr.24569) 4516 : cluster [DBG] pgmap v3893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:38:37.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:38:36.938703+0000 mgr.smithi067.rdualw (mgr.24569) 4517 : audit [DBG] from='client.37150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:38:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:36.286290+0000 mgr.smithi067.rdualw (mgr.24569) 4516 : cluster [DBG] pgmap v3893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:38:37.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:38:36.938703+0000 mgr.smithi067.rdualw (mgr.24569) 4517 : audit [DBG] from='client.37150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:38:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:38:37.256569+0000 mgr.smithi067.rdualw (mgr.24569) 4518 : audit [DBG] from='client.37154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:38:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:38:37.659829+0000 mon.smithi061 (mon.0) 1075 : audit [DBG] from='client.? 172.21.15.61:0/856213687' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:38:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:38:37.256569+0000 mgr.smithi067.rdualw (mgr.24569) 4518 : audit [DBG] from='client.37154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:38:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:38:37.659829+0000 mon.smithi061 (mon.0) 1075 : audit [DBG] from='client.? 172.21.15.61:0/856213687' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:38:39.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:38.286825+0000 mgr.smithi067.rdualw (mgr.24569) 4519 : cluster [DBG] pgmap v3894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:39.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:38.286825+0000 mgr.smithi067.rdualw (mgr.24569) 4519 : cluster [DBG] pgmap v3894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:41.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:40.287530+0000 mgr.smithi067.rdualw (mgr.24569) 4520 : cluster [DBG] pgmap v3895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:40.287530+0000 mgr.smithi067.rdualw (mgr.24569) 4520 : cluster [DBG] pgmap v3895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:43.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:42.288356+0000 mgr.smithi067.rdualw (mgr.24569) 4521 : cluster [DBG] pgmap v3896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:42.288356+0000 mgr.smithi067.rdualw (mgr.24569) 4521 : cluster [DBG] pgmap v3896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:45.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:44.289160+0000 mgr.smithi067.rdualw (mgr.24569) 4522 : cluster [DBG] pgmap v3897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:44.289160+0000 mgr.smithi067.rdualw (mgr.24569) 4522 : cluster [DBG] pgmap v3897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:46.290106+0000 mgr.smithi067.rdualw (mgr.24569) 4523 : cluster [DBG] pgmap v3898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:38:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:46.290106+0000 mgr.smithi067.rdualw (mgr.24569) 4523 : cluster [DBG] pgmap v3898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:38:49.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:48.290778+0000 mgr.smithi067.rdualw (mgr.24569) 4524 : cluster [DBG] pgmap v3899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:48.290778+0000 mgr.smithi067.rdualw (mgr.24569) 4524 : cluster [DBG] pgmap v3899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:51.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:50.291580+0000 mgr.smithi067.rdualw (mgr.24569) 4525 : cluster [DBG] pgmap v3900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:50.291580+0000 mgr.smithi067.rdualw (mgr.24569) 4525 : cluster [DBG] pgmap v3900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:52.292569+0000 mgr.smithi067.rdualw (mgr.24569) 4526 : cluster [DBG] pgmap v3901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:52.292569+0000 mgr.smithi067.rdualw (mgr.24569) 4526 : cluster [DBG] pgmap v3901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:54.293389+0000 mgr.smithi067.rdualw (mgr.24569) 4527 : cluster [DBG] pgmap v3902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:55.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:54.293389+0000 mgr.smithi067.rdualw (mgr.24569) 4527 : cluster [DBG] pgmap v3902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:56.294219+0000 mgr.smithi067.rdualw (mgr.24569) 4528 : cluster [DBG] pgmap v3903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:38:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:56.294219+0000 mgr.smithi067.rdualw (mgr.24569) 4528 : cluster [DBG] pgmap v3903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:38:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:38:58.294877+0000 mgr.smithi067.rdualw (mgr.24569) 4529 : cluster [DBG] pgmap v3904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:59.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:38:59.206720+0000 mon.smithi067 (mon.1) 711 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:38:59.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:38:59.208206+0000 mon.smithi067 (mon.1) 712 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:38:59.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:38:59.209243+0000 mon.smithi067 (mon.1) 713 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:38:59.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:38:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:38:59.210155+0000 mgr.smithi067.rdualw (mgr.24569) 4530 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:38:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:38:58.294877+0000 mgr.smithi067.rdualw (mgr.24569) 4529 : cluster [DBG] pgmap v3904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:38:59.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:38:59.206720+0000 mon.smithi067 (mon.1) 711 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:38:59.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:38:59.208206+0000 mon.smithi067 (mon.1) 712 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:38:59.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:38:59.209243+0000 mon.smithi067 (mon.1) 713 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:38:59.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:38:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:38:59.210155+0000 mgr.smithi067.rdualw (mgr.24569) 4530 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:39:00.975 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:38:59.628591+0000 mon.smithi061 (mon.0) 1076 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:39:00.976 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:38:59.633982+0000 mon.smithi061 (mon.0) 1077 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:39:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:38:59.628591+0000 mon.smithi061 (mon.0) 1076 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:39:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:38:59.633982+0000 mon.smithi061 (mon.0) 1077 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:39:01.976 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:00.295643+0000 mgr.smithi067.rdualw (mgr.24569) 4531 : cluster [DBG] pgmap v3905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:00.295643+0000 mgr.smithi067.rdualw (mgr.24569) 4531 : cluster [DBG] pgmap v3905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:03.976 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:02.296367+0000 mgr.smithi067.rdualw (mgr.24569) 4532 : cluster [DBG] pgmap v3906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:02.296367+0000 mgr.smithi067.rdualw (mgr.24569) 4532 : cluster [DBG] pgmap v3906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:05.976 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:04.296974+0000 mgr.smithi067.rdualw (mgr.24569) 4533 : cluster [DBG] pgmap v3907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:04.296974+0000 mgr.smithi067.rdualw (mgr.24569) 4533 : cluster [DBG] pgmap v3907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:07.967 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:39:07.976 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:06.297993+0000 mgr.smithi067.rdualw (mgr.24569) 4534 : cluster [DBG] pgmap v3908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:39:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:06.297993+0000 mgr.smithi067.rdualw (mgr.24569) 4534 : cluster [DBG] pgmap v3908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:39:08.261 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:39:08.262 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 6m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:39:08.262 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 6m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:39:08.262 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 6m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:39:08.263 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 6m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:39:08.263 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 6m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:39:08.263 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 6m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:39:08.263 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 6m ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:39:08.264 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 6m ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:39:08.264 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 6m ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:39:08.264 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 6m ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:39:08.264 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 6m ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:39:08.264 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 6m ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:39:08.265 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 6m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:39:08.265 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 6m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:39:08.265 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 6m ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:39:08.266 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 6m ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:39:08.266 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 6m ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:39:08.266 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 6m ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:39:08.266 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 6m ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:39:08.266 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 6m ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:39:08.267 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 6m ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:39:08.267 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 6m ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:39:08.267 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 6m ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:39:08.604 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:39:08.604 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:39:08.605 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:39:08.606 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:39:08.606 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:39:08.608 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:39:08.608 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:39:08.609 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:39:08.609 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:39:08.609 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:39:08.610 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:39:08.610 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:39:08.610 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:39:08.610 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:39:08.611 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:39:08.611 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:39:08.612 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:39:08.612 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:39:08.612 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:39:08.977 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:39:07.954151+0000 mgr.smithi067.rdualw (mgr.24569) 4535 : audit [DBG] from='client.37162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:39:08.977 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:39:08.243899+0000 mgr.smithi067.rdualw (mgr.24569) 4536 : audit [DBG] from='client.37166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:39:08.978 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:39:08.601929+0000 mon.smithi061 (mon.0) 1078 : audit [DBG] from='client.? 172.21.15.61:0/2265367896' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:39:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:39:07.954151+0000 mgr.smithi067.rdualw (mgr.24569) 4535 : audit [DBG] from='client.37162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:39:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:39:08.243899+0000 mgr.smithi067.rdualw (mgr.24569) 4536 : audit [DBG] from='client.37166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:39:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:39:08.601929+0000 mon.smithi061 (mon.0) 1078 : audit [DBG] from='client.? 172.21.15.61:0/2265367896' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:39:09.977 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:08.298476+0000 mgr.smithi067.rdualw (mgr.24569) 4537 : cluster [DBG] pgmap v3909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:08.298476+0000 mgr.smithi067.rdualw (mgr.24569) 4537 : cluster [DBG] pgmap v3909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:11.977 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:10.299269+0000 mgr.smithi067.rdualw (mgr.24569) 4538 : cluster [DBG] pgmap v3910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:10.299269+0000 mgr.smithi067.rdualw (mgr.24569) 4538 : cluster [DBG] pgmap v3910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:13.978 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:12.299975+0000 mgr.smithi067.rdualw (mgr.24569) 4539 : cluster [DBG] pgmap v3911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:12.299975+0000 mgr.smithi067.rdualw (mgr.24569) 4539 : cluster [DBG] pgmap v3911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:15.979 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:14.300602+0000 mgr.smithi067.rdualw (mgr.24569) 4540 : cluster [DBG] pgmap v3912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:14.300602+0000 mgr.smithi067.rdualw (mgr.24569) 4540 : cluster [DBG] pgmap v3912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:17.978 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:16.301521+0000 mgr.smithi067.rdualw (mgr.24569) 4541 : cluster [DBG] pgmap v3913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:39:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:16.301521+0000 mgr.smithi067.rdualw (mgr.24569) 4541 : cluster [DBG] pgmap v3913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:39:19.979 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:18.302162+0000 mgr.smithi067.rdualw (mgr.24569) 4542 : cluster [DBG] pgmap v3914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:18.302162+0000 mgr.smithi067.rdualw (mgr.24569) 4542 : cluster [DBG] pgmap v3914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:21.979 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:20.303154+0000 mgr.smithi067.rdualw (mgr.24569) 4543 : cluster [DBG] pgmap v3915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:20.303154+0000 mgr.smithi067.rdualw (mgr.24569) 4543 : cluster [DBG] pgmap v3915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:23.979 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:22.303871+0000 mgr.smithi067.rdualw (mgr.24569) 4544 : cluster [DBG] pgmap v3916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:22.303871+0000 mgr.smithi067.rdualw (mgr.24569) 4544 : cluster [DBG] pgmap v3916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:25.985 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:24.304701+0000 mgr.smithi067.rdualw (mgr.24569) 4545 : cluster [DBG] pgmap v3917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:24.304701+0000 mgr.smithi067.rdualw (mgr.24569) 4545 : cluster [DBG] pgmap v3917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:27.980 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:26.305628+0000 mgr.smithi067.rdualw (mgr.24569) 4546 : cluster [DBG] pgmap v3918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:39:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:26.305628+0000 mgr.smithi067.rdualw (mgr.24569) 4546 : cluster [DBG] pgmap v3918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:39:29.980 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:28.306430+0000 mgr.smithi067.rdualw (mgr.24569) 4547 : cluster [DBG] pgmap v3919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:28.306430+0000 mgr.smithi067.rdualw (mgr.24569) 4547 : cluster [DBG] pgmap v3919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:31.981 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:30.307447+0000 mgr.smithi067.rdualw (mgr.24569) 4548 : cluster [DBG] pgmap v3920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:30.307447+0000 mgr.smithi067.rdualw (mgr.24569) 4548 : cluster [DBG] pgmap v3920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:33.981 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:32.308362+0000 mgr.smithi067.rdualw (mgr.24569) 4549 : cluster [DBG] pgmap v3921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:32.308362+0000 mgr.smithi067.rdualw (mgr.24569) 4549 : cluster [DBG] pgmap v3921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:35.981 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:34.309089+0000 mgr.smithi067.rdualw (mgr.24569) 4550 : cluster [DBG] pgmap v3922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:35.982 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:39:35.139197+0000 mon.smithi067 (mon.1) 714 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:39:35.982 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:39:35.139382+0000 mon.smithi061 (mon.0) 1079 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:39:35.982 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:39:35.139549+0000 mon.smithi067 (mon.1) 715 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:39:35.983 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:39:35.139659+0000 mon.smithi061 (mon.0) 1080 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:39:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:34.309089+0000 mgr.smithi067.rdualw (mgr.24569) 4550 : cluster [DBG] pgmap v3922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:39:35.139197+0000 mon.smithi067 (mon.1) 714 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:39:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:39:35.139382+0000 mon.smithi061 (mon.0) 1079 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:39:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:39:35.139549+0000 mon.smithi067 (mon.1) 715 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:39:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:39:35.139659+0000 mon.smithi061 (mon.0) 1080 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:39:37.982 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:36.309888+0000 mgr.smithi067.rdualw (mgr.24569) 4551 : cluster [DBG] pgmap v3923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:39:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:36.309888+0000 mgr.smithi067.rdualw (mgr.24569) 4551 : cluster [DBG] pgmap v3923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:39:38.910 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:39:39.233 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:39:39.234 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 6m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:39:39.234 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 6m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:39:39.234 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 6m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:39:39.235 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 6m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:39:39.235 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 6m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:39:39.235 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 6m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:39:39.235 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 6m ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:39:39.235 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 6m ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:39:39.236 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 6m ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:39:39.236 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 6m ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:39:39.236 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 6m ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:39:39.236 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 6m ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:39:39.238 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 6m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:39:39.239 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 6m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:39:39.239 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 6m ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:39:39.239 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 6m ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:39:39.239 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 6m ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:39:39.240 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 6m ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:39:39.240 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 6m ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:39:39.240 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 6m ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:39:39.240 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 6m ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:39:39.240 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 6m ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:39:39.241 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 6m ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:39:39.575 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:39:39.576 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:39:39.576 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:39:39.576 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:39:39.577 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:39:39.577 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:39:39.577 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:39:39.577 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:39:39.577 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:39:39.578 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:39:39.578 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:39:39.578 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:39:39.578 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:39:39.579 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:39:39.579 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:39:39.579 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:39:39.579 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:39:39.579 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:39:39.580 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:39:39.982 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:38.310525+0000 mgr.smithi067.rdualw (mgr.24569) 4552 : cluster [DBG] pgmap v3924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:39.982 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:39:38.897556+0000 mgr.smithi067.rdualw (mgr.24569) 4553 : audit [DBG] from='client.37174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:39:39.983 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:39:39.215394+0000 mgr.smithi067.rdualw (mgr.24569) 4554 : audit [DBG] from='client.37178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:39:39.983 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:39:39.574356+0000 mon.smithi061 (mon.0) 1081 : audit [DBG] from='client.? 172.21.15.61:0/3526793545' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:39:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:38.310525+0000 mgr.smithi067.rdualw (mgr.24569) 4552 : cluster [DBG] pgmap v3924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:39:38.897556+0000 mgr.smithi067.rdualw (mgr.24569) 4553 : audit [DBG] from='client.37174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:39:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:39:39.215394+0000 mgr.smithi067.rdualw (mgr.24569) 4554 : audit [DBG] from='client.37178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:39:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:39:39.574356+0000 mon.smithi061 (mon.0) 1081 : audit [DBG] from='client.? 172.21.15.61:0/3526793545' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:39:41.983 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:40.311455+0000 mgr.smithi067.rdualw (mgr.24569) 4555 : cluster [DBG] pgmap v3925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:40.311455+0000 mgr.smithi067.rdualw (mgr.24569) 4555 : cluster [DBG] pgmap v3925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:43.983 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:42.312095+0000 mgr.smithi067.rdualw (mgr.24569) 4556 : cluster [DBG] pgmap v3926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:42.312095+0000 mgr.smithi067.rdualw (mgr.24569) 4556 : cluster [DBG] pgmap v3926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:45.984 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:44.312733+0000 mgr.smithi067.rdualw (mgr.24569) 4557 : cluster [DBG] pgmap v3927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:44.312733+0000 mgr.smithi067.rdualw (mgr.24569) 4557 : cluster [DBG] pgmap v3927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:47.984 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:46.313706+0000 mgr.smithi067.rdualw (mgr.24569) 4558 : cluster [DBG] pgmap v3928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:39:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:46.313706+0000 mgr.smithi067.rdualw (mgr.24569) 4558 : cluster [DBG] pgmap v3928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:39:49.984 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:48.314371+0000 mgr.smithi067.rdualw (mgr.24569) 4559 : cluster [DBG] pgmap v3929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:48.314371+0000 mgr.smithi067.rdualw (mgr.24569) 4559 : cluster [DBG] pgmap v3929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:51.985 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:50.315322+0000 mgr.smithi067.rdualw (mgr.24569) 4560 : cluster [DBG] pgmap v3930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:50.315322+0000 mgr.smithi067.rdualw (mgr.24569) 4560 : cluster [DBG] pgmap v3930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:53.985 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:52.316089+0000 mgr.smithi067.rdualw (mgr.24569) 4561 : cluster [DBG] pgmap v3931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:52.316089+0000 mgr.smithi067.rdualw (mgr.24569) 4561 : cluster [DBG] pgmap v3931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:55.985 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:54.316886+0000 mgr.smithi067.rdualw (mgr.24569) 4562 : cluster [DBG] pgmap v3932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:54.316886+0000 mgr.smithi067.rdualw (mgr.24569) 4562 : cluster [DBG] pgmap v3932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:57.985 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:56.317881+0000 mgr.smithi067.rdualw (mgr.24569) 4563 : cluster [DBG] pgmap v3933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:39:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:56.317881+0000 mgr.smithi067.rdualw (mgr.24569) 4563 : cluster [DBG] pgmap v3933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:39:59.986 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:39:58.318556+0000 mgr.smithi067.rdualw (mgr.24569) 4564 : cluster [DBG] pgmap v3934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:39:59.986 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:39:59.637975+0000 mon.smithi067 (mon.1) 716 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:39:59.986 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:39:59.639541+0000 mon.smithi067 (mon.1) 717 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:39:59.987 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:39:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:39:59.640518+0000 mon.smithi067 (mon.1) 718 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:40:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:39:58.318556+0000 mgr.smithi067.rdualw (mgr.24569) 4564 : cluster [DBG] pgmap v3934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:39:59.637975+0000 mon.smithi067 (mon.1) 716 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:40:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:39:59.639541+0000 mon.smithi067 (mon.1) 717 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:40:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:39:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:39:59.640518+0000 mon.smithi067 (mon.1) 718 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:40:00.986 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:39:59.641422+0000 mgr.smithi067.rdualw (mgr.24569) 4565 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:40:00.986 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:00.000102+0000 mon.smithi061 (mon.0) 1082 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T17:40:00.986 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:40:00.058264+0000 mon.smithi061 (mon.0) 1083 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:40:00.987 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:40:00.063891+0000 mon.smithi061 (mon.0) 1084 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:40:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:39:59.641422+0000 mgr.smithi067.rdualw (mgr.24569) 4565 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:40:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:00.000102+0000 mon.smithi061 (mon.0) 1082 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T17:40:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:40:00.058264+0000 mon.smithi061 (mon.0) 1083 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:40:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:40:00.063891+0000 mon.smithi061 (mon.0) 1084 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:40:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:00.319421+0000 mgr.smithi067.rdualw (mgr.24569) 4566 : cluster [DBG] pgmap v3935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:00.319421+0000 mgr.smithi067.rdualw (mgr.24569) 4566 : cluster [DBG] pgmap v3935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:02.320257+0000 mgr.smithi067.rdualw (mgr.24569) 4567 : cluster [DBG] pgmap v3936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:02.320257+0000 mgr.smithi067.rdualw (mgr.24569) 4567 : cluster [DBG] pgmap v3936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:04.320959+0000 mgr.smithi067.rdualw (mgr.24569) 4568 : cluster [DBG] pgmap v3937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:04.320959+0000 mgr.smithi067.rdualw (mgr.24569) 4568 : cluster [DBG] pgmap v3937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:06.321900+0000 mgr.smithi067.rdualw (mgr.24569) 4569 : cluster [DBG] pgmap v3938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:40:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:06.321900+0000 mgr.smithi067.rdualw (mgr.24569) 4569 : cluster [DBG] pgmap v3938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:40:09.886 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:40:10.182 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:40:10.829 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 7m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:40:10.829 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 7m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:40:10.829 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 7m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:40:10.830 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 7m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:40:10.830 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 7m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:40:10.830 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 7m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:40:10.830 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 7m ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:40:10.831 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 7m ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:40:10.831 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 7m ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:40:10.831 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 7m ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:40:10.844 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 7m ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:40:10.844 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 7m ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:40:10.845 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 7m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:40:10.845 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 7m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:40:10.845 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 7m ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:40:10.846 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 7m ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:40:10.846 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 7m ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:40:10.846 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 7m ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:40:10.847 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 7m ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:40:10.847 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 7m ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:40:10.847 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 7m ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:40:10.847 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 7m ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:40:10.847 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 7m ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:40:10.849 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:08.322480+0000 mgr.smithi067.rdualw (mgr.24569) 4570 : cluster [DBG] pgmap v3939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:10.849 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:08.322480+0000 mgr.smithi067.rdualw (mgr.24569) 4570 : cluster [DBG] pgmap v3939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:10.849 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:40:10.850 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:40:10.850 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:40:10.850 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:40:10.851 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:40:10.851 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:40:10.851 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:40:10.851 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:40:10.852 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:40:10.852 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:40:10.853 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:40:10.853 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:40:10.854 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:40:10.854 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:40:10.855 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:40:10.855 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:40:10.856 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:40:10.856 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:40:10.856 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:40:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:40:09.872379+0000 mgr.smithi067.rdualw (mgr.24569) 4571 : audit [DBG] from='client.37186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:40:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:40:10.162887+0000 mgr.smithi067.rdualw (mgr.24569) 4572 : audit [DBG] from='client.37190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:40:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:40:10.523300+0000 mon.smithi061 (mon.0) 1085 : audit [DBG] from='client.? 172.21.15.61:0/3439323821' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:40:11.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:40:09.872379+0000 mgr.smithi067.rdualw (mgr.24569) 4571 : audit [DBG] from='client.37186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:40:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:40:10.162887+0000 mgr.smithi067.rdualw (mgr.24569) 4572 : audit [DBG] from='client.37190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:40:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:40:10.523300+0000 mon.smithi061 (mon.0) 1085 : audit [DBG] from='client.? 172.21.15.61:0/3439323821' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:40:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:10.323304+0000 mgr.smithi067.rdualw (mgr.24569) 4573 : cluster [DBG] pgmap v3940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:10.323304+0000 mgr.smithi067.rdualw (mgr.24569) 4573 : cluster [DBG] pgmap v3940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:12.324182+0000 mgr.smithi067.rdualw (mgr.24569) 4574 : cluster [DBG] pgmap v3941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:12.324182+0000 mgr.smithi067.rdualw (mgr.24569) 4574 : cluster [DBG] pgmap v3941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:16.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:14.324879+0000 mgr.smithi067.rdualw (mgr.24569) 4575 : cluster [DBG] pgmap v3942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:14.324879+0000 mgr.smithi067.rdualw (mgr.24569) 4575 : cluster [DBG] pgmap v3942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:16.325914+0000 mgr.smithi067.rdualw (mgr.24569) 4576 : cluster [DBG] pgmap v3943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:40:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:16.325914+0000 mgr.smithi067.rdualw (mgr.24569) 4576 : cluster [DBG] pgmap v3943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:40:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:18.326414+0000 mgr.smithi067.rdualw (mgr.24569) 4577 : cluster [DBG] pgmap v3944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:18.326414+0000 mgr.smithi067.rdualw (mgr.24569) 4577 : cluster [DBG] pgmap v3944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:20.327150+0000 mgr.smithi067.rdualw (mgr.24569) 4578 : cluster [DBG] pgmap v3945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:20.327150+0000 mgr.smithi067.rdualw (mgr.24569) 4578 : cluster [DBG] pgmap v3945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:22.327815+0000 mgr.smithi067.rdualw (mgr.24569) 4579 : cluster [DBG] pgmap v3946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:22.327815+0000 mgr.smithi067.rdualw (mgr.24569) 4579 : cluster [DBG] pgmap v3946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:24.328583+0000 mgr.smithi067.rdualw (mgr.24569) 4580 : cluster [DBG] pgmap v3947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:24.328583+0000 mgr.smithi067.rdualw (mgr.24569) 4580 : cluster [DBG] pgmap v3947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:26.329416+0000 mgr.smithi067.rdualw (mgr.24569) 4581 : cluster [DBG] pgmap v3948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:40:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:26.329416+0000 mgr.smithi067.rdualw (mgr.24569) 4581 : cluster [DBG] pgmap v3948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:40:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:28.329948+0000 mgr.smithi067.rdualw (mgr.24569) 4582 : cluster [DBG] pgmap v3949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:28.329948+0000 mgr.smithi067.rdualw (mgr.24569) 4582 : cluster [DBG] pgmap v3949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:32.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:30.330720+0000 mgr.smithi067.rdualw (mgr.24569) 4583 : cluster [DBG] pgmap v3950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:30.330720+0000 mgr.smithi067.rdualw (mgr.24569) 4583 : cluster [DBG] pgmap v3950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:32.331508+0000 mgr.smithi067.rdualw (mgr.24569) 4584 : cluster [DBG] pgmap v3951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:32.331508+0000 mgr.smithi067.rdualw (mgr.24569) 4584 : cluster [DBG] pgmap v3951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:34.332332+0000 mgr.smithi067.rdualw (mgr.24569) 4585 : cluster [DBG] pgmap v3952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:40:35.144903+0000 mon.smithi067 (mon.1) 719 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:40:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:40:35.145144+0000 mon.smithi061 (mon.0) 1086 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:40:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:40:35.145239+0000 mon.smithi067 (mon.1) 720 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:40:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:40:35.145501+0000 mon.smithi061 (mon.0) 1087 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:40:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:34.332332+0000 mgr.smithi067.rdualw (mgr.24569) 4585 : cluster [DBG] pgmap v3952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:40:35.144903+0000 mon.smithi067 (mon.1) 719 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:40:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:40:35.145144+0000 mon.smithi061 (mon.0) 1086 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:40:36.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:40:35.145239+0000 mon.smithi067 (mon.1) 720 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:40:36.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:40:35.145501+0000 mon.smithi061 (mon.0) 1087 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:40:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:36.333372+0000 mgr.smithi067.rdualw (mgr.24569) 4586 : cluster [DBG] pgmap v3953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:40:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:36.333372+0000 mgr.smithi067.rdualw (mgr.24569) 4586 : cluster [DBG] pgmap v3953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:40:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:38.333999+0000 mgr.smithi067.rdualw (mgr.24569) 4587 : cluster [DBG] pgmap v3954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:38.333999+0000 mgr.smithi067.rdualw (mgr.24569) 4587 : cluster [DBG] pgmap v3954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:40.856 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:40:41.148 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:40:41.323 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 7m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:40:41.324 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 7m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:40:41.324 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 7m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:40:41.324 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 7m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:40:41.324 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 7m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:40:41.325 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 7m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:40:41.325 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 7m ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:40:41.325 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 7m ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:40:41.325 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 7m ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:40:41.326 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 7m ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:40:41.326 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 7m ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:40:41.326 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 7m ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:40:41.326 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 7m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:40:41.327 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 7m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:40:41.327 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 7m ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:40:41.327 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 7m ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:40:41.327 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 7m ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:40:41.327 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 7m ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:40:41.328 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 7m ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:40:41.328 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 7m ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:40:41.328 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 7m ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:40:41.328 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 7m ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:40:41.329 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 7m ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:40:41.599 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:40:41.600 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:40:41.600 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:40:41.600 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:40:41.600 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:40:41.601 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:40:41.601 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:40:41.601 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:40:41.601 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:40:41.601 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:40:41.602 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:40:41.602 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:40:41.602 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:40:41.602 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:40:41.603 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:40:41.603 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:40:41.603 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:40:41.603 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:40:41.603 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:40:42.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:40.334819+0000 mgr.smithi067.rdualw (mgr.24569) 4588 : cluster [DBG] pgmap v3955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:42.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:40:40.842847+0000 mgr.smithi067.rdualw (mgr.24569) 4589 : audit [DBG] from='client.37198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:40:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:40:41.130595+0000 mgr.smithi067.rdualw (mgr.24569) 4590 : audit [DBG] from='client.37202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:40:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:40:41.598440+0000 mon.smithi061 (mon.0) 1088 : audit [DBG] from='client.? 172.21.15.61:0/116756979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:40:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:40.334819+0000 mgr.smithi067.rdualw (mgr.24569) 4588 : cluster [DBG] pgmap v3955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:40:40.842847+0000 mgr.smithi067.rdualw (mgr.24569) 4589 : audit [DBG] from='client.37198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:40:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:40:41.130595+0000 mgr.smithi067.rdualw (mgr.24569) 4590 : audit [DBG] from='client.37202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:40:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:40:41.598440+0000 mon.smithi061 (mon.0) 1088 : audit [DBG] from='client.? 172.21.15.61:0/116756979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:40:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:42.335410+0000 mgr.smithi067.rdualw (mgr.24569) 4591 : cluster [DBG] pgmap v3956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:42.335410+0000 mgr.smithi067.rdualw (mgr.24569) 4591 : cluster [DBG] pgmap v3956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:44.336082+0000 mgr.smithi067.rdualw (mgr.24569) 4592 : cluster [DBG] pgmap v3957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:44.336082+0000 mgr.smithi067.rdualw (mgr.24569) 4592 : cluster [DBG] pgmap v3957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:46.336951+0000 mgr.smithi067.rdualw (mgr.24569) 4593 : cluster [DBG] pgmap v3958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:40:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:46.336951+0000 mgr.smithi067.rdualw (mgr.24569) 4593 : cluster [DBG] pgmap v3958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:40:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:48.337503+0000 mgr.smithi067.rdualw (mgr.24569) 4594 : cluster [DBG] pgmap v3959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:48.337503+0000 mgr.smithi067.rdualw (mgr.24569) 4594 : cluster [DBG] pgmap v3959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:50.338385+0000 mgr.smithi067.rdualw (mgr.24569) 4595 : cluster [DBG] pgmap v3960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:50.338385+0000 mgr.smithi067.rdualw (mgr.24569) 4595 : cluster [DBG] pgmap v3960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:52.339063+0000 mgr.smithi067.rdualw (mgr.24569) 4596 : cluster [DBG] pgmap v3961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:52.339063+0000 mgr.smithi067.rdualw (mgr.24569) 4596 : cluster [DBG] pgmap v3961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:56.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:54.339744+0000 mgr.smithi067.rdualw (mgr.24569) 4597 : cluster [DBG] pgmap v3962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:54.339744+0000 mgr.smithi067.rdualw (mgr.24569) 4597 : cluster [DBG] pgmap v3962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:40:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:40:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:56.340561+0000 mgr.smithi067.rdualw (mgr.24569) 4598 : cluster [DBG] pgmap v3963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:40:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:40:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:56.340561+0000 mgr.smithi067.rdualw (mgr.24569) 4598 : cluster [DBG] pgmap v3963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:41:00.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:40:58.341244+0000 mgr.smithi067.rdualw (mgr.24569) 4599 : cluster [DBG] pgmap v3964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:00.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:41:00.067590+0000 mon.smithi067 (mon.1) 721 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:41:00.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:41:00.069083+0000 mon.smithi067 (mon.1) 722 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:41:00.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:41:00.069995+0000 mon.smithi067 (mon.1) 723 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:41:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:40:58.341244+0000 mgr.smithi067.rdualw (mgr.24569) 4599 : cluster [DBG] pgmap v3964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:41:00.067590+0000 mon.smithi067 (mon.1) 721 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:41:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:41:00.069083+0000 mon.smithi067 (mon.1) 722 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:41:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:41:00.069995+0000 mon.smithi067 (mon.1) 723 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:41:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:41:00.070807+0000 mgr.smithi067.rdualw (mgr.24569) 4600 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:41:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:41:00.483344+0000 mon.smithi061 (mon.0) 1089 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:41:01.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:41:00.491153+0000 mon.smithi061 (mon.0) 1090 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:41:01.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:41:00.070807+0000 mgr.smithi067.rdualw (mgr.24569) 4600 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:41:01.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:41:00.483344+0000 mon.smithi061 (mon.0) 1089 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:41:01.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:41:00.491153+0000 mon.smithi061 (mon.0) 1090 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:41:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:00.342194+0000 mgr.smithi067.rdualw (mgr.24569) 4601 : cluster [DBG] pgmap v3965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:00.342194+0000 mgr.smithi067.rdualw (mgr.24569) 4601 : cluster [DBG] pgmap v3965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:02.342745+0000 mgr.smithi067.rdualw (mgr.24569) 4602 : cluster [DBG] pgmap v3966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:02.342745+0000 mgr.smithi067.rdualw (mgr.24569) 4602 : cluster [DBG] pgmap v3966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:04.343297+0000 mgr.smithi067.rdualw (mgr.24569) 4603 : cluster [DBG] pgmap v3967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:04.343297+0000 mgr.smithi067.rdualw (mgr.24569) 4603 : cluster [DBG] pgmap v3967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:06.344321+0000 mgr.smithi067.rdualw (mgr.24569) 4604 : cluster [DBG] pgmap v3968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:41:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:06.344321+0000 mgr.smithi067.rdualw (mgr.24569) 4604 : cluster [DBG] pgmap v3968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:41:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:08.345019+0000 mgr.smithi067.rdualw (mgr.24569) 4605 : cluster [DBG] pgmap v3969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:08.345019+0000 mgr.smithi067.rdualw (mgr.24569) 4605 : cluster [DBG] pgmap v3969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:11.915 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:41:12.208 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:41:12.209 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 8m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:41:12.209 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 8m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:41:12.209 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 8m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:41:12.209 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 8m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:41:12.209 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 8m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:41:12.210 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 8m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:41:12.210 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 8m ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:41:12.210 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 8m ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:41:12.210 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 8m ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:41:12.211 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 8m ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:41:12.211 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 8m ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:41:12.211 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 8m ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:41:12.211 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 8m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:41:12.212 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 8m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:41:12.212 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 8m ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:41:12.212 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 8m ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:41:12.212 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 8m ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:41:12.213 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 8m ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:41:12.213 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 8m ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:41:12.213 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 8m ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:41:12.213 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 8m ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:41:12.214 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 8m ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:41:12.214 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 8m ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:41:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:10.345862+0000 mgr.smithi067.rdualw (mgr.24569) 4606 : cluster [DBG] pgmap v3970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:12.556 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:41:12.556 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:41:12.556 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:41:12.556 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:41:12.557 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:41:12.557 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:41:12.557 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:41:12.557 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:41:12.558 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:41:12.558 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:41:12.558 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:41:12.558 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:41:12.559 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:41:12.559 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:41:12.559 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:41:12.559 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:41:12.560 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:41:12.560 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:41:12.560 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:41:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:10.345862+0000 mgr.smithi067.rdualw (mgr.24569) 4606 : cluster [DBG] pgmap v3970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:41:11.902802+0000 mgr.smithi067.rdualw (mgr.24569) 4607 : audit [DBG] from='client.37210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:41:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:41:12.191134+0000 mgr.smithi067.rdualw (mgr.24569) 4608 : audit [DBG] from='client.37214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:41:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:41:12.554818+0000 mon.smithi061 (mon.0) 1091 : audit [DBG] from='client.? 172.21.15.61:0/1666514468' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:41:13.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:41:11.902802+0000 mgr.smithi067.rdualw (mgr.24569) 4607 : audit [DBG] from='client.37210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:41:13.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:41:12.191134+0000 mgr.smithi067.rdualw (mgr.24569) 4608 : audit [DBG] from='client.37214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:41:13.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:41:12.554818+0000 mon.smithi061 (mon.0) 1091 : audit [DBG] from='client.? 172.21.15.61:0/1666514468' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:41:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:12.346381+0000 mgr.smithi067.rdualw (mgr.24569) 4609 : cluster [DBG] pgmap v3971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:12.346381+0000 mgr.smithi067.rdualw (mgr.24569) 4609 : cluster [DBG] pgmap v3971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:14.346965+0000 mgr.smithi067.rdualw (mgr.24569) 4610 : cluster [DBG] pgmap v3972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:14.346965+0000 mgr.smithi067.rdualw (mgr.24569) 4610 : cluster [DBG] pgmap v3972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:16.347849+0000 mgr.smithi067.rdualw (mgr.24569) 4611 : cluster [DBG] pgmap v3973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:41:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:16.347849+0000 mgr.smithi067.rdualw (mgr.24569) 4611 : cluster [DBG] pgmap v3973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:41:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:18.348344+0000 mgr.smithi067.rdualw (mgr.24569) 4612 : cluster [DBG] pgmap v3974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:18.348344+0000 mgr.smithi067.rdualw (mgr.24569) 4612 : cluster [DBG] pgmap v3974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:20.349330+0000 mgr.smithi067.rdualw (mgr.24569) 4613 : cluster [DBG] pgmap v3975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:20.349330+0000 mgr.smithi067.rdualw (mgr.24569) 4613 : cluster [DBG] pgmap v3975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:22.350071+0000 mgr.smithi067.rdualw (mgr.24569) 4614 : cluster [DBG] pgmap v3976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:22.350071+0000 mgr.smithi067.rdualw (mgr.24569) 4614 : cluster [DBG] pgmap v3976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:24.350749+0000 mgr.smithi067.rdualw (mgr.24569) 4615 : cluster [DBG] pgmap v3977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:24.350749+0000 mgr.smithi067.rdualw (mgr.24569) 4615 : cluster [DBG] pgmap v3977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:26.351828+0000 mgr.smithi067.rdualw (mgr.24569) 4616 : cluster [DBG] pgmap v3978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:41:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:26.351828+0000 mgr.smithi067.rdualw (mgr.24569) 4616 : cluster [DBG] pgmap v3978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:41:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:28.352498+0000 mgr.smithi067.rdualw (mgr.24569) 4617 : cluster [DBG] pgmap v3979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:28.352498+0000 mgr.smithi067.rdualw (mgr.24569) 4617 : cluster [DBG] pgmap v3979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:30.353312+0000 mgr.smithi067.rdualw (mgr.24569) 4618 : cluster [DBG] pgmap v3980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:30.353312+0000 mgr.smithi067.rdualw (mgr.24569) 4618 : cluster [DBG] pgmap v3980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:32.353891+0000 mgr.smithi067.rdualw (mgr.24569) 4619 : cluster [DBG] pgmap v3981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:32.353891+0000 mgr.smithi067.rdualw (mgr.24569) 4619 : cluster [DBG] pgmap v3981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:41:35.150192+0000 mon.smithi067 (mon.1) 724 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:41:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:41:35.150467+0000 mon.smithi067 (mon.1) 725 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:41:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:41:35.150534+0000 mon.smithi061 (mon.0) 1092 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:41:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:41:35.150767+0000 mon.smithi061 (mon.0) 1093 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:41:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:41:35.150192+0000 mon.smithi067 (mon.1) 724 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:41:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:41:35.150467+0000 mon.smithi067 (mon.1) 725 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:41:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:41:35.150534+0000 mon.smithi061 (mon.0) 1092 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:41:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:41:35.150767+0000 mon.smithi061 (mon.0) 1093 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:41:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:34.354715+0000 mgr.smithi067.rdualw (mgr.24569) 4620 : cluster [DBG] pgmap v3982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:34.354715+0000 mgr.smithi067.rdualw (mgr.24569) 4620 : cluster [DBG] pgmap v3982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:36.355501+0000 mgr.smithi067.rdualw (mgr.24569) 4621 : cluster [DBG] pgmap v3983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:41:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:36.355501+0000 mgr.smithi067.rdualw (mgr.24569) 4621 : cluster [DBG] pgmap v3983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:41:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:38.355991+0000 mgr.smithi067.rdualw (mgr.24569) 4622 : cluster [DBG] pgmap v3984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:38.355991+0000 mgr.smithi067.rdualw (mgr.24569) 4622 : cluster [DBG] pgmap v3984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:42.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:40.356732+0000 mgr.smithi067.rdualw (mgr.24569) 4623 : cluster [DBG] pgmap v3985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:40.356732+0000 mgr.smithi067.rdualw (mgr.24569) 4623 : cluster [DBG] pgmap v3985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:42.867 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:41:43.159 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:41:43.160 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 8m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:41:43.160 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 8m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:41:43.160 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 8m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:41:43.160 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 8m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:41:43.160 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 8m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:41:43.161 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 8m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:41:43.161 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 8m ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:41:43.161 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 8m ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:41:43.161 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 8m ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:41:43.161 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 8m ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:41:43.162 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 8m ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:41:43.162 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 8m ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:41:43.162 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 8m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:41:43.162 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 8m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:41:43.163 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 8m ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:41:43.163 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 8m ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:41:43.163 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 8m ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:41:43.163 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 8m ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:41:43.163 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 8m ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:41:43.164 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 8m ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:41:43.164 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 8m ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:41:43.164 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 8m ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:41:43.164 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 8m ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:41:43.497 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:41:43.497 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:41:43.497 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:41:43.498 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:41:43.498 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:41:43.498 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:41:43.499 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:41:43.499 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:41:43.499 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:41:43.499 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:41:43.500 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:41:43.500 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:41:43.500 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:41:43.500 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:41:43.500 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:41:43.501 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:41:43.501 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:41:43.501 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:41:43.501 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:41:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:42.357318+0000 mgr.smithi067.rdualw (mgr.24569) 4624 : cluster [DBG] pgmap v3986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:41:42.854504+0000 mgr.smithi067.rdualw (mgr.24569) 4625 : audit [DBG] from='client.37222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:41:44.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:41:43.142258+0000 mgr.smithi067.rdualw (mgr.24569) 4626 : audit [DBG] from='client.37226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:41:44.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:41:43.496092+0000 mon.smithi061 (mon.0) 1094 : audit [DBG] from='client.? 172.21.15.61:0/1172826882' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:41:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:42.357318+0000 mgr.smithi067.rdualw (mgr.24569) 4624 : cluster [DBG] pgmap v3986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:41:42.854504+0000 mgr.smithi067.rdualw (mgr.24569) 4625 : audit [DBG] from='client.37222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:41:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:41:43.142258+0000 mgr.smithi067.rdualw (mgr.24569) 4626 : audit [DBG] from='client.37226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:41:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:41:43.496092+0000 mon.smithi061 (mon.0) 1094 : audit [DBG] from='client.? 172.21.15.61:0/1172826882' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:41:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:44.357922+0000 mgr.smithi067.rdualw (mgr.24569) 4627 : cluster [DBG] pgmap v3987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:44.357922+0000 mgr.smithi067.rdualw (mgr.24569) 4627 : cluster [DBG] pgmap v3987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:46.359001+0000 mgr.smithi067.rdualw (mgr.24569) 4628 : cluster [DBG] pgmap v3988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:41:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:46.359001+0000 mgr.smithi067.rdualw (mgr.24569) 4628 : cluster [DBG] pgmap v3988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:41:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:48.359522+0000 mgr.smithi067.rdualw (mgr.24569) 4629 : cluster [DBG] pgmap v3989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:48.359522+0000 mgr.smithi067.rdualw (mgr.24569) 4629 : cluster [DBG] pgmap v3989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:50.360298+0000 mgr.smithi067.rdualw (mgr.24569) 4630 : cluster [DBG] pgmap v3990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:50.360298+0000 mgr.smithi067.rdualw (mgr.24569) 4630 : cluster [DBG] pgmap v3990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:52.360866+0000 mgr.smithi067.rdualw (mgr.24569) 4631 : cluster [DBG] pgmap v3991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:52.360866+0000 mgr.smithi067.rdualw (mgr.24569) 4631 : cluster [DBG] pgmap v3991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:54.361520+0000 mgr.smithi067.rdualw (mgr.24569) 4632 : cluster [DBG] pgmap v3992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:54.361520+0000 mgr.smithi067.rdualw (mgr.24569) 4632 : cluster [DBG] pgmap v3992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:41:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:41:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:56.362394+0000 mgr.smithi067.rdualw (mgr.24569) 4633 : cluster [DBG] pgmap v3993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:41:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:41:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:56.362394+0000 mgr.smithi067.rdualw (mgr.24569) 4633 : cluster [DBG] pgmap v3993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:42:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:41:58.362882+0000 mgr.smithi067.rdualw (mgr.24569) 4634 : cluster [DBG] pgmap v3994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:41:58.362882+0000 mgr.smithi067.rdualw (mgr.24569) 4634 : cluster [DBG] pgmap v3994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:01.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:00.363760+0000 mgr.smithi067.rdualw (mgr.24569) 4635 : cluster [DBG] pgmap v3995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:42:00.494642+0000 mon.smithi067 (mon.1) 726 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:42:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:42:00.496171+0000 mon.smithi067 (mon.1) 727 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:42:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:42:00.497227+0000 mon.smithi067 (mon.1) 728 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:42:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:42:00.498159+0000 mgr.smithi067.rdualw (mgr.24569) 4636 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:42:01.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:42:00.917533+0000 mon.smithi061 (mon.0) 1095 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:42:01.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:42:00.925422+0000 mon.smithi061 (mon.0) 1096 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:42:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:00.363760+0000 mgr.smithi067.rdualw (mgr.24569) 4635 : cluster [DBG] pgmap v3995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:42:00.494642+0000 mon.smithi067 (mon.1) 726 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:42:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:42:00.496171+0000 mon.smithi067 (mon.1) 727 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:42:01.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:42:00.497227+0000 mon.smithi067 (mon.1) 728 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:42:01.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:42:00.498159+0000 mgr.smithi067.rdualw (mgr.24569) 4636 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:42:01.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:42:00.917533+0000 mon.smithi061 (mon.0) 1095 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:42:01.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:42:00.925422+0000 mon.smithi061 (mon.0) 1096 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:42:03.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:02.364328+0000 mgr.smithi067.rdualw (mgr.24569) 4637 : cluster [DBG] pgmap v3996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:03.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:02.364328+0000 mgr.smithi067.rdualw (mgr.24569) 4637 : cluster [DBG] pgmap v3996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:05.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:04.364959+0000 mgr.smithi067.rdualw (mgr.24569) 4638 : cluster [DBG] pgmap v3997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:04.364959+0000 mgr.smithi067.rdualw (mgr.24569) 4638 : cluster [DBG] pgmap v3997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:06.366062+0000 mgr.smithi067.rdualw (mgr.24569) 4639 : cluster [DBG] pgmap v3998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:42:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:06.366062+0000 mgr.smithi067.rdualw (mgr.24569) 4639 : cluster [DBG] pgmap v3998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:42:09.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:08.366661+0000 mgr.smithi067.rdualw (mgr.24569) 4640 : cluster [DBG] pgmap v3999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:08.366661+0000 mgr.smithi067.rdualw (mgr.24569) 4640 : cluster [DBG] pgmap v3999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:10.367523+0000 mgr.smithi067.rdualw (mgr.24569) 4641 : cluster [DBG] pgmap v4000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:11.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:10.367523+0000 mgr.smithi067.rdualw (mgr.24569) 4641 : cluster [DBG] pgmap v4000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:13.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:12.368128+0000 mgr.smithi067.rdualw (mgr.24569) 4642 : cluster [DBG] pgmap v4001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:12.368128+0000 mgr.smithi067.rdualw (mgr.24569) 4642 : cluster [DBG] pgmap v4001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:13.824 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:42:14.120 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:42:14.121 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 9m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:42:14.121 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 9m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:42:14.121 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 9m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:42:14.121 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 9m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:42:14.122 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 9m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:42:14.122 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 9m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:42:14.122 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 9m ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:42:14.122 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 9m ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:42:14.122 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 9m ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:42:14.123 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 9m ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:42:14.123 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 9m ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:42:14.123 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 9m ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:42:14.123 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 9m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:42:14.124 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 9m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:42:14.124 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 9m ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:42:14.124 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 9m ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:42:14.124 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 9m ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:42:14.124 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 9m ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:42:14.125 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 9m ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:42:14.125 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 9m ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:42:14.125 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 9m ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:42:14.125 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 9m ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:42:14.126 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 9m ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:42:14.468 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:42:14.469 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:42:14.469 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:42:14.469 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:42:14.469 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:42:14.469 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:42:14.470 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:42:14.470 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:42:14.470 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:42:14.470 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:42:14.471 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:42:14.471 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:42:14.471 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:42:14.471 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:42:14.471 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:42:14.472 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:42:14.472 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:42:14.472 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:42:14.472 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:42:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:42:13.811080+0000 mgr.smithi067.rdualw (mgr.24569) 4643 : audit [DBG] from='client.37234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:42:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:42:14.103358+0000 mgr.smithi067.rdualw (mgr.24569) 4644 : audit [DBG] from='client.37238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:42:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:42:14.467486+0000 mon.smithi061 (mon.0) 1097 : audit [DBG] from='client.? 172.21.15.61:0/3913411163' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:42:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:42:13.811080+0000 mgr.smithi067.rdualw (mgr.24569) 4643 : audit [DBG] from='client.37234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:42:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:42:14.103358+0000 mgr.smithi067.rdualw (mgr.24569) 4644 : audit [DBG] from='client.37238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:42:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:42:14.467486+0000 mon.smithi061 (mon.0) 1097 : audit [DBG] from='client.? 172.21.15.61:0/3913411163' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:42:15.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:14.368850+0000 mgr.smithi067.rdualw (mgr.24569) 4645 : cluster [DBG] pgmap v4002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:14.368850+0000 mgr.smithi067.rdualw (mgr.24569) 4645 : cluster [DBG] pgmap v4002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:16.369778+0000 mgr.smithi067.rdualw (mgr.24569) 4646 : cluster [DBG] pgmap v4003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:42:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:16.369778+0000 mgr.smithi067.rdualw (mgr.24569) 4646 : cluster [DBG] pgmap v4003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:42:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:18.370496+0000 mgr.smithi067.rdualw (mgr.24569) 4647 : cluster [DBG] pgmap v4004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:18.370496+0000 mgr.smithi067.rdualw (mgr.24569) 4647 : cluster [DBG] pgmap v4004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:20.371456+0000 mgr.smithi067.rdualw (mgr.24569) 4648 : cluster [DBG] pgmap v4005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:21.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:20.371456+0000 mgr.smithi067.rdualw (mgr.24569) 4648 : cluster [DBG] pgmap v4005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:22.371937+0000 mgr.smithi067.rdualw (mgr.24569) 4649 : cluster [DBG] pgmap v4006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:22.371937+0000 mgr.smithi067.rdualw (mgr.24569) 4649 : cluster [DBG] pgmap v4006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:25.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:24.372491+0000 mgr.smithi067.rdualw (mgr.24569) 4650 : cluster [DBG] pgmap v4007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:25.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:24.372491+0000 mgr.smithi067.rdualw (mgr.24569) 4650 : cluster [DBG] pgmap v4007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:26.373563+0000 mgr.smithi067.rdualw (mgr.24569) 4651 : cluster [DBG] pgmap v4008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:42:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:26.373563+0000 mgr.smithi067.rdualw (mgr.24569) 4651 : cluster [DBG] pgmap v4008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:42:29.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:28.374111+0000 mgr.smithi067.rdualw (mgr.24569) 4652 : cluster [DBG] pgmap v4009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:29.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:28.374111+0000 mgr.smithi067.rdualw (mgr.24569) 4652 : cluster [DBG] pgmap v4009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:31.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:30.375035+0000 mgr.smithi067.rdualw (mgr.24569) 4653 : cluster [DBG] pgmap v4010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:31.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:30.375035+0000 mgr.smithi067.rdualw (mgr.24569) 4653 : cluster [DBG] pgmap v4010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:33.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:32.375707+0000 mgr.smithi067.rdualw (mgr.24569) 4654 : cluster [DBG] pgmap v4011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:33.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:32.375707+0000 mgr.smithi067.rdualw (mgr.24569) 4654 : cluster [DBG] pgmap v4011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:34.376278+0000 mgr.smithi067.rdualw (mgr.24569) 4655 : cluster [DBG] pgmap v4012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:42:35.156015+0000 mon.smithi067 (mon.1) 729 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:42:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:42:35.156348+0000 mon.smithi061 (mon.0) 1098 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:42:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:42:35.156379+0000 mon.smithi067 (mon.1) 730 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:42:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:42:35.156655+0000 mon.smithi061 (mon.0) 1099 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:42:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:34.376278+0000 mgr.smithi067.rdualw (mgr.24569) 4655 : cluster [DBG] pgmap v4012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:42:35.156015+0000 mon.smithi067 (mon.1) 729 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:42:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:42:35.156348+0000 mon.smithi061 (mon.0) 1098 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:42:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:42:35.156379+0000 mon.smithi067 (mon.1) 730 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:42:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:42:35.156655+0000 mon.smithi061 (mon.0) 1099 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:42:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:36.377349+0000 mgr.smithi067.rdualw (mgr.24569) 4656 : cluster [DBG] pgmap v4013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:42:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:36.377349+0000 mgr.smithi067.rdualw (mgr.24569) 4656 : cluster [DBG] pgmap v4013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:42:39.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:38.377893+0000 mgr.smithi067.rdualw (mgr.24569) 4657 : cluster [DBG] pgmap v4014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:39.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:38.377893+0000 mgr.smithi067.rdualw (mgr.24569) 4657 : cluster [DBG] pgmap v4014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:41.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:40.378765+0000 mgr.smithi067.rdualw (mgr.24569) 4658 : cluster [DBG] pgmap v4015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:40.378765+0000 mgr.smithi067.rdualw (mgr.24569) 4658 : cluster [DBG] pgmap v4015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:43.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:42.379426+0000 mgr.smithi067.rdualw (mgr.24569) 4659 : cluster [DBG] pgmap v4016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:42.379426+0000 mgr.smithi067.rdualw (mgr.24569) 4659 : cluster [DBG] pgmap v4016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:44.778 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:42:45.068 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:42:45.068 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 9m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:42:45.069 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 9m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:42:45.069 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 9m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:42:45.069 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 9m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:42:45.069 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 9m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:42:45.070 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 9m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:42:45.070 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 9m ago 2h 457M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:42:45.070 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 9m ago 2h 534M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:42:45.070 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 9m ago 2h 867M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:42:45.071 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 9m ago 2h 492M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:42:45.071 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 9m ago 2h 185M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:42:45.071 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 9m ago 2h 112M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:42:45.071 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 9m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:42:45.071 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 9m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:42:45.072 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 9m ago 2h 731M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:42:45.072 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 9m ago 2h 1566M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:42:45.072 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 9m ago 2h 949M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:42:45.072 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 9m ago 2h 1691M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:42:45.073 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 9m ago 2h 1561M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:42:45.073 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 9m ago 2h 1788M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:42:45.073 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 9m ago 2h 1417M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:42:45.073 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 9m ago 2h 2282M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:42:45.074 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 9m ago 2h 78.6M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:42:45.409 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:42:45.409 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:42:45.410 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:42:45.410 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:42:45.410 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:42:45.410 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:42:45.411 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:42:45.411 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:42:45.411 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:42:45.411 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:42:45.411 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:42:45.412 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:42:45.412 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:42:45.412 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:42:45.412 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:42:45.413 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:42:45.413 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:42:45.413 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:42:45.413 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:42:45.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:44.380169+0000 mgr.smithi067.rdualw (mgr.24569) 4660 : cluster [DBG] pgmap v4017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:45.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:42:44.765168+0000 mgr.smithi067.rdualw (mgr.24569) 4661 : audit [DBG] from='client.37246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:42:45.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:42:45.051175+0000 mgr.smithi067.rdualw (mgr.24569) 4662 : audit [DBG] from='client.37250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:42:45.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:42:45.408456+0000 mon.smithi061 (mon.0) 1100 : audit [DBG] from='client.? 172.21.15.61:0/1428854011' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:42:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:44.380169+0000 mgr.smithi067.rdualw (mgr.24569) 4660 : cluster [DBG] pgmap v4017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:45.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:42:44.765168+0000 mgr.smithi067.rdualw (mgr.24569) 4661 : audit [DBG] from='client.37246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:42:45.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:42:45.051175+0000 mgr.smithi067.rdualw (mgr.24569) 4662 : audit [DBG] from='client.37250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:42:45.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:42:45.408456+0000 mon.smithi061 (mon.0) 1100 : audit [DBG] from='client.? 172.21.15.61:0/1428854011' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:42:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:46.380979+0000 mgr.smithi067.rdualw (mgr.24569) 4663 : cluster [DBG] pgmap v4018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:42:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:46.380979+0000 mgr.smithi067.rdualw (mgr.24569) 4663 : cluster [DBG] pgmap v4018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:42:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:48.381681+0000 mgr.smithi067.rdualw (mgr.24569) 4664 : cluster [DBG] pgmap v4019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:48.381681+0000 mgr.smithi067.rdualw (mgr.24569) 4664 : cluster [DBG] pgmap v4019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:50.382615+0000 mgr.smithi067.rdualw (mgr.24569) 4665 : cluster [DBG] pgmap v4020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:52.014 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:50.382615+0000 mgr.smithi067.rdualw (mgr.24569) 4665 : cluster [DBG] pgmap v4020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:52.383277+0000 mgr.smithi067.rdualw (mgr.24569) 4666 : cluster [DBG] pgmap v4021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:54.014 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:52.383277+0000 mgr.smithi067.rdualw (mgr.24569) 4666 : cluster [DBG] pgmap v4021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:54.383827+0000 mgr.smithi067.rdualw (mgr.24569) 4667 : cluster [DBG] pgmap v4022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:56.015 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:54.383827+0000 mgr.smithi067.rdualw (mgr.24569) 4667 : cluster [DBG] pgmap v4022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:42:58.015 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:56.384684+0000 mgr.smithi067.rdualw (mgr.24569) 4668 : cluster [DBG] pgmap v4023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:42:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:56.384684+0000 mgr.smithi067.rdualw (mgr.24569) 4668 : cluster [DBG] pgmap v4023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:43:00.015 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:42:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:42:58.385187+0000 mgr.smithi067.rdualw (mgr.24569) 4669 : cluster [DBG] pgmap v4024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:42:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:42:58.385187+0000 mgr.smithi067.rdualw (mgr.24569) 4669 : cluster [DBG] pgmap v4024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:02.016 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:00.386008+0000 mgr.smithi067.rdualw (mgr.24569) 4670 : cluster [DBG] pgmap v4025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:02.017 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:00.929288+0000 mon.smithi067 (mon.1) 731 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:43:02.017 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:00.930736+0000 mon.smithi067 (mon.1) 732 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:43:02.017 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:00.931659+0000 mon.smithi067 (mon.1) 733 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:43:02.018 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:43:00.932483+0000 mgr.smithi067.rdualw (mgr.24569) 4671 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:43:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:00.386008+0000 mgr.smithi067.rdualw (mgr.24569) 4670 : cluster [DBG] pgmap v4025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:00.929288+0000 mon.smithi067 (mon.1) 731 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:43:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:00.930736+0000 mon.smithi067 (mon.1) 732 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:43:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:00.931659+0000 mon.smithi067 (mon.1) 733 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:43:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:43:00.932483+0000 mgr.smithi067.rdualw (mgr.24569) 4671 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:43:04.016 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:02.386665+0000 mgr.smithi067.rdualw (mgr.24569) 4672 : cluster [DBG] pgmap v4026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:02.386665+0000 mgr.smithi067.rdualw (mgr.24569) 4672 : cluster [DBG] pgmap v4026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:06.016 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:04.387384+0000 mgr.smithi067.rdualw (mgr.24569) 4673 : cluster [DBG] pgmap v4027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:06.017 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:05.433037+0000 mon.smithi061 (mon.0) 1101 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:43:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:04.387384+0000 mgr.smithi067.rdualw (mgr.24569) 4673 : cluster [DBG] pgmap v4027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:05.433037+0000 mon.smithi061 (mon.0) 1101 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:43:07.017 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:05.834490+0000 mon.smithi067 (mon.1) 734 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:43:07.017 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:05.834817+0000 mon.smithi061 (mon.0) 1102 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:43:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:05.834490+0000 mon.smithi067 (mon.1) 734 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:43:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:05.834817+0000 mon.smithi061 (mon.0) 1102 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:43:08.016 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:06.388187+0000 mgr.smithi067.rdualw (mgr.24569) 4674 : cluster [DBG] pgmap v4028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:43:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:06.388187+0000 mgr.smithi067.rdualw (mgr.24569) 4674 : cluster [DBG] pgmap v4028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:43:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:08.227842+0000 mon.smithi061 (mon.0) 1103 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:43:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:08.631428+0000 mon.smithi067 (mon.1) 735 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:43:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:08.631865+0000 mon.smithi061 (mon.0) 1104 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:43:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:08.636782+0000 mon.smithi061 (mon.0) 1105 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:43:09.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:08.644709+0000 mon.smithi061 (mon.0) 1106 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:43:09.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:08.227842+0000 mon.smithi061 (mon.0) 1103 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:43:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:08.631428+0000 mon.smithi067 (mon.1) 735 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:43:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:08.631865+0000 mon.smithi061 (mon.0) 1104 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:43:09.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:08.636782+0000 mon.smithi061 (mon.0) 1105 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:43:09.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:08.644709+0000 mon.smithi061 (mon.0) 1106 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:43:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:08.388690+0000 mgr.smithi067.rdualw (mgr.24569) 4675 : cluster [DBG] pgmap v4029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:08.388690+0000 mgr.smithi067.rdualw (mgr.24569) 4675 : cluster [DBG] pgmap v4029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:10.389566+0000 mgr.smithi067.rdualw (mgr.24569) 4676 : cluster [DBG] pgmap v4030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:10.389566+0000 mgr.smithi067.rdualw (mgr.24569) 4676 : cluster [DBG] pgmap v4030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:12.390201+0000 mgr.smithi067.rdualw (mgr.24569) 4677 : cluster [DBG] pgmap v4031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:12.390201+0000 mgr.smithi067.rdualw (mgr.24569) 4677 : cluster [DBG] pgmap v4031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:15.716 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:43:16.009 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:43:16.010 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 7s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:43:16.010 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 7s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:43:16.010 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 10s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:43:16.011 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 7s ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:43:16.011 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 7s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:43:16.011 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 10s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:43:16.011 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 7s ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:43:16.012 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 10s ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:43:16.012 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 7s ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:43:16.012 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 10s ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:43:16.012 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 7s ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:43:16.013 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 10s ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:43:16.013 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 7s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:43:16.013 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 10s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:43:16.013 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 7s ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:43:16.013 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 7s ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:43:16.014 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 7s ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:43:16.014 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 7s ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:43:16.014 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 10s ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:43:16.014 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 10s ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:43:16.015 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 10s ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:43:16.015 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 10s ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:43:16.015 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 7s ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:43:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:14.390782+0000 mgr.smithi067.rdualw (mgr.24569) 4678 : cluster [DBG] pgmap v4032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:16.351 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:43:16.352 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:43:16.352 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:43:16.352 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:43:16.352 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:43:16.353 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:43:16.353 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:43:16.353 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:43:16.353 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:43:16.354 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:43:16.354 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:43:16.354 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:43:16.354 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:43:16.355 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:43:16.355 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:43:16.355 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:43:16.355 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:43:16.355 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:43:16.356 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:43:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:14.390782+0000 mgr.smithi067.rdualw (mgr.24569) 4678 : cluster [DBG] pgmap v4032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:15.703434+0000 mgr.smithi067.rdualw (mgr.24569) 4679 : audit [DBG] from='client.37258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:43:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:15.993007+0000 mgr.smithi067.rdualw (mgr.24569) 4680 : audit [DBG] from='client.37262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:43:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:16.350793+0000 mon.smithi061 (mon.0) 1107 : audit [DBG] from='client.? 172.21.15.61:0/3831360454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:43:17.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:15.703434+0000 mgr.smithi067.rdualw (mgr.24569) 4679 : audit [DBG] from='client.37258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:43:17.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:15.993007+0000 mgr.smithi067.rdualw (mgr.24569) 4680 : audit [DBG] from='client.37262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:43:17.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:16.350793+0000 mon.smithi061 (mon.0) 1107 : audit [DBG] from='client.? 172.21.15.61:0/3831360454' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:43:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:16.391790+0000 mgr.smithi067.rdualw (mgr.24569) 4681 : cluster [DBG] pgmap v4033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:43:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:16.391790+0000 mgr.smithi067.rdualw (mgr.24569) 4681 : cluster [DBG] pgmap v4033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:43:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:18.392282+0000 mgr.smithi067.rdualw (mgr.24569) 4682 : cluster [DBG] pgmap v4034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:18.392282+0000 mgr.smithi067.rdualw (mgr.24569) 4682 : cluster [DBG] pgmap v4034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:20.393234+0000 mgr.smithi067.rdualw (mgr.24569) 4683 : cluster [DBG] pgmap v4035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:20.393234+0000 mgr.smithi067.rdualw (mgr.24569) 4683 : cluster [DBG] pgmap v4035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:22.393808+0000 mgr.smithi067.rdualw (mgr.24569) 4684 : cluster [DBG] pgmap v4036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:22.393808+0000 mgr.smithi067.rdualw (mgr.24569) 4684 : cluster [DBG] pgmap v4036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:24.394579+0000 mgr.smithi067.rdualw (mgr.24569) 4685 : cluster [DBG] pgmap v4037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:24.394579+0000 mgr.smithi067.rdualw (mgr.24569) 4685 : cluster [DBG] pgmap v4037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:26.395418+0000 mgr.smithi067.rdualw (mgr.24569) 4686 : cluster [DBG] pgmap v4038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:43:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:26.395418+0000 mgr.smithi067.rdualw (mgr.24569) 4686 : cluster [DBG] pgmap v4038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:43:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:28.395935+0000 mgr.smithi067.rdualw (mgr.24569) 4687 : cluster [DBG] pgmap v4039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:28.395935+0000 mgr.smithi067.rdualw (mgr.24569) 4687 : cluster [DBG] pgmap v4039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:30.396812+0000 mgr.smithi067.rdualw (mgr.24569) 4688 : cluster [DBG] pgmap v4040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:30.396812+0000 mgr.smithi067.rdualw (mgr.24569) 4688 : cluster [DBG] pgmap v4040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:32.397307+0000 mgr.smithi067.rdualw (mgr.24569) 4689 : cluster [DBG] pgmap v4041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:34.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:32.397307+0000 mgr.smithi067.rdualw (mgr.24569) 4689 : cluster [DBG] pgmap v4041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:35.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:35.161968+0000 mon.smithi067 (mon.1) 736 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:43:35.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:35.162248+0000 mon.smithi067 (mon.1) 737 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:43:35.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:35.162507+0000 mon.smithi061 (mon.0) 1108 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:43:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:35.162818+0000 mon.smithi061 (mon.0) 1109 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:43:35.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:35.161968+0000 mon.smithi067 (mon.1) 736 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:43:35.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:35.162248+0000 mon.smithi067 (mon.1) 737 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:43:35.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:35.162507+0000 mon.smithi061 (mon.0) 1108 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:43:35.571 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:35.162818+0000 mon.smithi061 (mon.0) 1109 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:43:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:34.397930+0000 mgr.smithi067.rdualw (mgr.24569) 4690 : cluster [DBG] pgmap v4042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:34.397930+0000 mgr.smithi067.rdualw (mgr.24569) 4690 : cluster [DBG] pgmap v4042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:36.398739+0000 mgr.smithi067.rdualw (mgr.24569) 4691 : cluster [DBG] pgmap v4043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:43:38.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:36.398739+0000 mgr.smithi067.rdualw (mgr.24569) 4691 : cluster [DBG] pgmap v4043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:43:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:38.399451+0000 mgr.smithi067.rdualw (mgr.24569) 4692 : cluster [DBG] pgmap v4044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:38.399451+0000 mgr.smithi067.rdualw (mgr.24569) 4692 : cluster [DBG] pgmap v4044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:40.400343+0000 mgr.smithi067.rdualw (mgr.24569) 4693 : cluster [DBG] pgmap v4045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:40.400343+0000 mgr.smithi067.rdualw (mgr.24569) 4693 : cluster [DBG] pgmap v4045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:42.400985+0000 mgr.smithi067.rdualw (mgr.24569) 4694 : cluster [DBG] pgmap v4046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:42.400985+0000 mgr.smithi067.rdualw (mgr.24569) 4694 : cluster [DBG] pgmap v4046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:44.401612+0000 mgr.smithi067.rdualw (mgr.24569) 4695 : cluster [DBG] pgmap v4047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:44.401612+0000 mgr.smithi067.rdualw (mgr.24569) 4695 : cluster [DBG] pgmap v4047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:46.660 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:43:46.994 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:43:46.994 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 38s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:43:46.994 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 38s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:43:46.995 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 41s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:43:46.995 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 38s ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:43:46.995 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 38s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:43:46.995 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 41s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:43:46.996 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 38s ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:43:46.996 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 41s ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:43:46.996 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 38s ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:43:46.996 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 41s ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:43:46.996 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 38s ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:43:46.997 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 41s ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:43:46.997 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 38s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:43:46.997 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 41s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:43:46.997 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 38s ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:43:46.998 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 38s ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:43:46.998 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 38s ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:43:46.998 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 38s ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:43:46.998 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 41s ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:43:46.999 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 41s ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:43:46.999 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 41s ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:43:46.999 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 41s ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:43:46.999 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 38s ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:43:47.334 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:43:47.336 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:43:47.336 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:43:47.336 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:43:47.336 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:43:47.337 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:43:47.337 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:43:47.337 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:43:47.337 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:43:47.338 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:43:47.338 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:43:47.338 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:43:47.339 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:43:47.339 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:43:47.339 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:43:47.339 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:43:47.340 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:43:47.340 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:43:47.340 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:43:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:46.402456+0000 mgr.smithi067.rdualw (mgr.24569) 4696 : cluster [DBG] pgmap v4048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:43:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:46.647561+0000 mgr.smithi067.rdualw (mgr.24569) 4697 : audit [DBG] from='client.37270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:43:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:46.976998+0000 mgr.smithi067.rdualw (mgr.24569) 4698 : audit [DBG] from='client.37274 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:43:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:43:47.333721+0000 mon.smithi061 (mon.0) 1110 : audit [DBG] from='client.? 172.21.15.61:0/931949874' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:43:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:46.402456+0000 mgr.smithi067.rdualw (mgr.24569) 4696 : cluster [DBG] pgmap v4048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:43:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:46.647561+0000 mgr.smithi067.rdualw (mgr.24569) 4697 : audit [DBG] from='client.37270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:43:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:46.976998+0000 mgr.smithi067.rdualw (mgr.24569) 4698 : audit [DBG] from='client.37274 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:43:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:43:47.333721+0000 mon.smithi061 (mon.0) 1110 : audit [DBG] from='client.? 172.21.15.61:0/931949874' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:43:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:48.403000+0000 mgr.smithi067.rdualw (mgr.24569) 4699 : cluster [DBG] pgmap v4049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:48.403000+0000 mgr.smithi067.rdualw (mgr.24569) 4699 : cluster [DBG] pgmap v4049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:50.403767+0000 mgr.smithi067.rdualw (mgr.24569) 4700 : cluster [DBG] pgmap v4050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:50.403767+0000 mgr.smithi067.rdualw (mgr.24569) 4700 : cluster [DBG] pgmap v4050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:52.404445+0000 mgr.smithi067.rdualw (mgr.24569) 4701 : cluster [DBG] pgmap v4051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:52.404445+0000 mgr.smithi067.rdualw (mgr.24569) 4701 : cluster [DBG] pgmap v4051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:55.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:54.405104+0000 mgr.smithi067.rdualw (mgr.24569) 4702 : cluster [DBG] pgmap v4052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:54.405104+0000 mgr.smithi067.rdualw (mgr.24569) 4702 : cluster [DBG] pgmap v4052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:56.405847+0000 mgr.smithi067.rdualw (mgr.24569) 4703 : cluster [DBG] pgmap v4053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:43:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:56.405847+0000 mgr.smithi067.rdualw (mgr.24569) 4703 : cluster [DBG] pgmap v4053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:43:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:43:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:43:58.406296+0000 mgr.smithi067.rdualw (mgr.24569) 4704 : cluster [DBG] pgmap v4054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:43:59.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:43:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:43:58.406296+0000 mgr.smithi067.rdualw (mgr.24569) 4704 : cluster [DBG] pgmap v4054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:01.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:00.407138+0000 mgr.smithi067.rdualw (mgr.24569) 4705 : cluster [DBG] pgmap v4055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:00.407138+0000 mgr.smithi067.rdualw (mgr.24569) 4705 : cluster [DBG] pgmap v4055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:03.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:02.407637+0000 mgr.smithi067.rdualw (mgr.24569) 4706 : cluster [DBG] pgmap v4056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:03.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:02.407637+0000 mgr.smithi067.rdualw (mgr.24569) 4706 : cluster [DBG] pgmap v4056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:05.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:04.408188+0000 mgr.smithi067.rdualw (mgr.24569) 4707 : cluster [DBG] pgmap v4057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:05.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:04.408188+0000 mgr.smithi067.rdualw (mgr.24569) 4707 : cluster [DBG] pgmap v4057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:06.409276+0000 mgr.smithi067.rdualw (mgr.24569) 4708 : cluster [DBG] pgmap v4058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:44:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:06.409276+0000 mgr.smithi067.rdualw (mgr.24569) 4708 : cluster [DBG] pgmap v4058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:44:09.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:08.409792+0000 mgr.smithi067.rdualw (mgr.24569) 4709 : cluster [DBG] pgmap v4059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:09.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:44:08.651562+0000 mon.smithi067 (mon.1) 738 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:44:09.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:44:08.653116+0000 mon.smithi067 (mon.1) 739 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:44:09.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:44:08.654132+0000 mon.smithi067 (mon.1) 740 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:44:09.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:44:08.655052+0000 mgr.smithi067.rdualw (mgr.24569) 4710 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:44:09.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:44:09.065897+0000 mon.smithi061 (mon.0) 1111 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:44:09.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:44:09.071409+0000 mon.smithi061 (mon.0) 1112 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:44:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:08.409792+0000 mgr.smithi067.rdualw (mgr.24569) 4709 : cluster [DBG] pgmap v4059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:44:08.651562+0000 mon.smithi067 (mon.1) 738 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:44:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:44:08.653116+0000 mon.smithi067 (mon.1) 739 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:44:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:44:08.654132+0000 mon.smithi067 (mon.1) 740 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:44:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:44:08.655052+0000 mgr.smithi067.rdualw (mgr.24569) 4710 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:44:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:44:09.065897+0000 mon.smithi061 (mon.0) 1111 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:44:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:44:09.071409+0000 mon.smithi061 (mon.0) 1112 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:44:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:10.410868+0000 mgr.smithi067.rdualw (mgr.24569) 4711 : cluster [DBG] pgmap v4060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:11.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:10.410868+0000 mgr.smithi067.rdualw (mgr.24569) 4711 : cluster [DBG] pgmap v4060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:13.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:12.411434+0000 mgr.smithi067.rdualw (mgr.24569) 4712 : cluster [DBG] pgmap v4061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:12.411434+0000 mgr.smithi067.rdualw (mgr.24569) 4712 : cluster [DBG] pgmap v4061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:15.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:14.412069+0000 mgr.smithi067.rdualw (mgr.24569) 4713 : cluster [DBG] pgmap v4062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:14.412069+0000 mgr.smithi067.rdualw (mgr.24569) 4713 : cluster [DBG] pgmap v4062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:17.644 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:44:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:16.412904+0000 mgr.smithi067.rdualw (mgr.24569) 4714 : cluster [DBG] pgmap v4063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:44:17.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:16.412904+0000 mgr.smithi067.rdualw (mgr.24569) 4714 : cluster [DBG] pgmap v4063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:44:17.933 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:44:17.934 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 69s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:44:17.934 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 69s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:44:17.934 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 72s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:44:17.935 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 69s ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:44:17.935 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 69s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:44:17.935 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 72s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:44:17.935 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 69s ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:44:17.936 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 72s ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:44:17.936 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 69s ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:44:17.936 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 72s ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:44:17.936 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 69s ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:44:17.937 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 72s ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:44:17.937 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 69s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:44:17.937 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 72s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:44:17.937 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 69s ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:44:17.937 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 69s ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:44:17.938 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 69s ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:44:17.938 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 69s ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:44:17.938 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 72s ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:44:17.939 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 72s ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:44:17.939 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 72s ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:44:17.939 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 72s ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:44:17.939 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 69s ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:44:18.277 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:44:18.277 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:44:18.278 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:44:18.278 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:44:18.278 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:44:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:44:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:44:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:44:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:44:18.279 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:44:18.280 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:44:18.280 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:44:18.280 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:44:18.280 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:44:18.280 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:44:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:44:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:44:18.281 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:44:18.281 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:44:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:44:17.631354+0000 mgr.smithi067.rdualw (mgr.24569) 4715 : audit [DBG] from='client.37282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:44:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:44:17.916618+0000 mgr.smithi067.rdualw (mgr.24569) 4716 : audit [DBG] from='client.37286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:44:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:44:18.276752+0000 mon.smithi061 (mon.0) 1113 : audit [DBG] from='client.? 172.21.15.61:0/2470401781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:44:18.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:44:17.631354+0000 mgr.smithi067.rdualw (mgr.24569) 4715 : audit [DBG] from='client.37282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:44:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:44:17.916618+0000 mgr.smithi067.rdualw (mgr.24569) 4716 : audit [DBG] from='client.37286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:44:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:44:18.276752+0000 mon.smithi061 (mon.0) 1113 : audit [DBG] from='client.? 172.21.15.61:0/2470401781' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:44:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:18.413697+0000 mgr.smithi067.rdualw (mgr.24569) 4717 : cluster [DBG] pgmap v4064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:19.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:18.413697+0000 mgr.smithi067.rdualw (mgr.24569) 4717 : cluster [DBG] pgmap v4064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:20.414496+0000 mgr.smithi067.rdualw (mgr.24569) 4718 : cluster [DBG] pgmap v4065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:21.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:20.414496+0000 mgr.smithi067.rdualw (mgr.24569) 4718 : cluster [DBG] pgmap v4065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:22.414997+0000 mgr.smithi067.rdualw (mgr.24569) 4719 : cluster [DBG] pgmap v4066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:22.414997+0000 mgr.smithi067.rdualw (mgr.24569) 4719 : cluster [DBG] pgmap v4066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:25.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:24.415505+0000 mgr.smithi067.rdualw (mgr.24569) 4720 : cluster [DBG] pgmap v4067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:25.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:24.415505+0000 mgr.smithi067.rdualw (mgr.24569) 4720 : cluster [DBG] pgmap v4067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:26.416455+0000 mgr.smithi067.rdualw (mgr.24569) 4721 : cluster [DBG] pgmap v4068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:44:27.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:26.416455+0000 mgr.smithi067.rdualw (mgr.24569) 4721 : cluster [DBG] pgmap v4068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:44:29.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:28.416997+0000 mgr.smithi067.rdualw (mgr.24569) 4722 : cluster [DBG] pgmap v4069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:29.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:28.416997+0000 mgr.smithi067.rdualw (mgr.24569) 4722 : cluster [DBG] pgmap v4069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:31.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:30.418003+0000 mgr.smithi067.rdualw (mgr.24569) 4723 : cluster [DBG] pgmap v4070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:31.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:30.418003+0000 mgr.smithi067.rdualw (mgr.24569) 4723 : cluster [DBG] pgmap v4070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:33.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:32.418529+0000 mgr.smithi067.rdualw (mgr.24569) 4724 : cluster [DBG] pgmap v4071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:33.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:32.418529+0000 mgr.smithi067.rdualw (mgr.24569) 4724 : cluster [DBG] pgmap v4071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:34.419090+0000 mgr.smithi067.rdualw (mgr.24569) 4725 : cluster [DBG] pgmap v4072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:44:35.167711+0000 mon.smithi067 (mon.1) 741 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:44:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:44:35.167955+0000 mon.smithi067 (mon.1) 742 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:44:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:44:35.168098+0000 mon.smithi061 (mon.0) 1114 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:44:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:44:35.168359+0000 mon.smithi061 (mon.0) 1115 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:44:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:34.419090+0000 mgr.smithi067.rdualw (mgr.24569) 4725 : cluster [DBG] pgmap v4072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:44:35.167711+0000 mon.smithi067 (mon.1) 741 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:44:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:44:35.167955+0000 mon.smithi067 (mon.1) 742 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:44:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:44:35.168098+0000 mon.smithi061 (mon.0) 1114 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:44:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:44:35.168359+0000 mon.smithi061 (mon.0) 1115 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:44:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:36.419940+0000 mgr.smithi067.rdualw (mgr.24569) 4726 : cluster [DBG] pgmap v4073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:44:37.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:36.419940+0000 mgr.smithi067.rdualw (mgr.24569) 4726 : cluster [DBG] pgmap v4073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:44:39.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:38.420481+0000 mgr.smithi067.rdualw (mgr.24569) 4727 : cluster [DBG] pgmap v4074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:39.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:38.420481+0000 mgr.smithi067.rdualw (mgr.24569) 4727 : cluster [DBG] pgmap v4074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:40.421445+0000 mgr.smithi067.rdualw (mgr.24569) 4728 : cluster [DBG] pgmap v4075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:42.032 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:40.421445+0000 mgr.smithi067.rdualw (mgr.24569) 4728 : cluster [DBG] pgmap v4075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:42.421992+0000 mgr.smithi067.rdualw (mgr.24569) 4729 : cluster [DBG] pgmap v4076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:44.032 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:42.421992+0000 mgr.smithi067.rdualw (mgr.24569) 4729 : cluster [DBG] pgmap v4076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:44.422558+0000 mgr.smithi067.rdualw (mgr.24569) 4730 : cluster [DBG] pgmap v4077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:46.033 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:44.422558+0000 mgr.smithi067.rdualw (mgr.24569) 4730 : cluster [DBG] pgmap v4077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:46.423426+0000 mgr.smithi067.rdualw (mgr.24569) 4731 : cluster [DBG] pgmap v4078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:44:48.033 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:46.423426+0000 mgr.smithi067.rdualw (mgr.24569) 4731 : cluster [DBG] pgmap v4078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:44:48.584 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:44:48.881 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:44:48.882 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 100s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:44:48.882 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 100s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:44:48.882 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 103s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:44:48.882 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 100s ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:44:48.883 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 100s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:44:48.883 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 103s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:44:48.883 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 100s ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:44:48.883 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 103s ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:44:48.883 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 100s ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:44:48.884 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 103s ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:44:48.884 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 100s ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:44:48.884 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 103s ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:44:48.884 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 100s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:44:48.885 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 103s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:44:48.885 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 100s ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:44:48.885 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 100s ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:44:48.885 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 100s ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:44:48.885 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 100s ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:44:48.886 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 103s ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:44:48.886 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 103s ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:44:48.886 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 103s ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:44:48.886 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 103s ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:44:48.887 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 100s ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:44:49.220 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:44:49.220 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:44:49.220 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:44:49.220 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:44:49.221 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:44:49.221 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:44:49.221 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:44:49.221 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:44:49.222 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:44:49.222 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:44:49.222 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:44:49.222 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:44:49.223 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:44:49.223 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:44:49.223 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:44:49.223 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:44:49.224 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:44:49.224 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:44:49.224 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:44:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:48.424049+0000 mgr.smithi067.rdualw (mgr.24569) 4732 : cluster [DBG] pgmap v4079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:44:48.572096+0000 mgr.smithi067.rdualw (mgr.24569) 4733 : audit [DBG] from='client.37294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:44:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:44:48.864073+0000 mgr.smithi067.rdualw (mgr.24569) 4734 : audit [DBG] from='client.37298 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:44:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:44:49.219329+0000 mon.smithi061 (mon.0) 1116 : audit [DBG] from='client.? 172.21.15.61:0/1265529562' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:44:50.033 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:48.424049+0000 mgr.smithi067.rdualw (mgr.24569) 4732 : cluster [DBG] pgmap v4079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:50.034 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:44:48.572096+0000 mgr.smithi067.rdualw (mgr.24569) 4733 : audit [DBG] from='client.37294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:44:50.034 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:44:48.864073+0000 mgr.smithi067.rdualw (mgr.24569) 4734 : audit [DBG] from='client.37298 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:44:50.034 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:44:49.219329+0000 mon.smithi061 (mon.0) 1116 : audit [DBG] from='client.? 172.21.15.61:0/1265529562' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:44:52.033 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:50.425079+0000 mgr.smithi067.rdualw (mgr.24569) 4735 : cluster [DBG] pgmap v4080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:50.425079+0000 mgr.smithi067.rdualw (mgr.24569) 4735 : cluster [DBG] pgmap v4080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:54.034 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:52.425756+0000 mgr.smithi067.rdualw (mgr.24569) 4736 : cluster [DBG] pgmap v4081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:52.425756+0000 mgr.smithi067.rdualw (mgr.24569) 4736 : cluster [DBG] pgmap v4081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:56.034 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:54.426489+0000 mgr.smithi067.rdualw (mgr.24569) 4737 : cluster [DBG] pgmap v4082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:54.426489+0000 mgr.smithi067.rdualw (mgr.24569) 4737 : cluster [DBG] pgmap v4082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:44:58.034 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:56.427375+0000 mgr.smithi067.rdualw (mgr.24569) 4738 : cluster [DBG] pgmap v4083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:44:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:56.427375+0000 mgr.smithi067.rdualw (mgr.24569) 4738 : cluster [DBG] pgmap v4083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:45:00.035 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:44:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:44:58.428018+0000 mgr.smithi067.rdualw (mgr.24569) 4739 : cluster [DBG] pgmap v4084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:00.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:44:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:44:58.428018+0000 mgr.smithi067.rdualw (mgr.24569) 4739 : cluster [DBG] pgmap v4084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:02.035 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:00.428895+0000 mgr.smithi067.rdualw (mgr.24569) 4740 : cluster [DBG] pgmap v4085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:00.428895+0000 mgr.smithi067.rdualw (mgr.24569) 4740 : cluster [DBG] pgmap v4085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:04.035 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:02.429651+0000 mgr.smithi067.rdualw (mgr.24569) 4741 : cluster [DBG] pgmap v4086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:04.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:02.429651+0000 mgr.smithi067.rdualw (mgr.24569) 4741 : cluster [DBG] pgmap v4086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:06.036 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:04.430367+0000 mgr.smithi067.rdualw (mgr.24569) 4742 : cluster [DBG] pgmap v4087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:04.430367+0000 mgr.smithi067.rdualw (mgr.24569) 4742 : cluster [DBG] pgmap v4087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:08.036 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:06.431257+0000 mgr.smithi067.rdualw (mgr.24569) 4743 : cluster [DBG] pgmap v4088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:45:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:06.431257+0000 mgr.smithi067.rdualw (mgr.24569) 4743 : cluster [DBG] pgmap v4088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:45:10.037 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:08.431706+0000 mgr.smithi067.rdualw (mgr.24569) 4744 : cluster [DBG] pgmap v4089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:10.037 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:45:09.076488+0000 mon.smithi067 (mon.1) 743 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:45:10.037 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:45:09.078002+0000 mon.smithi067 (mon.1) 744 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:45:10.038 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:45:09.078984+0000 mon.smithi067 (mon.1) 745 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:45:10.038 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:45:09.079851+0000 mgr.smithi067.rdualw (mgr.24569) 4745 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:45:10.038 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:45:09.435053+0000 mon.smithi061 (mon.0) 1117 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:45:10.038 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:45:09.451254+0000 mon.smithi061 (mon.0) 1118 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:45:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:08.431706+0000 mgr.smithi067.rdualw (mgr.24569) 4744 : cluster [DBG] pgmap v4089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:45:09.076488+0000 mon.smithi067 (mon.1) 743 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:45:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:45:09.078002+0000 mon.smithi067 (mon.1) 744 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:45:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:45:09.078984+0000 mon.smithi067 (mon.1) 745 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:45:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:45:09.079851+0000 mgr.smithi067.rdualw (mgr.24569) 4745 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:45:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:45:09.435053+0000 mon.smithi061 (mon.0) 1117 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:45:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:45:09.451254+0000 mon.smithi061 (mon.0) 1118 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:45:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:45:09.851568+0000 mon.smithi061 (mon.0) 1119 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:45:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:45:09.857141+0000 mon.smithi061 (mon.0) 1120 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:45:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:45:09.851568+0000 mon.smithi061 (mon.0) 1119 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:45:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:45:09.857141+0000 mon.smithi061 (mon.0) 1120 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:45:12.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:10.432749+0000 mgr.smithi067.rdualw (mgr.24569) 4746 : cluster [DBG] pgmap v4090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:12.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:10.432749+0000 mgr.smithi067.rdualw (mgr.24569) 4746 : cluster [DBG] pgmap v4090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:12.433273+0000 mgr.smithi067.rdualw (mgr.24569) 4747 : cluster [DBG] pgmap v4091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:14.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:12.433273+0000 mgr.smithi067.rdualw (mgr.24569) 4747 : cluster [DBG] pgmap v4091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:14.433988+0000 mgr.smithi067.rdualw (mgr.24569) 4748 : cluster [DBG] pgmap v4092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:16.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:14.433988+0000 mgr.smithi067.rdualw (mgr.24569) 4748 : cluster [DBG] pgmap v4092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:16.434890+0000 mgr.smithi067.rdualw (mgr.24569) 4749 : cluster [DBG] pgmap v4093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:45:18.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:16.434890+0000 mgr.smithi067.rdualw (mgr.24569) 4749 : cluster [DBG] pgmap v4093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:45:19.528 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:45:19.818 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:45:19.819 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 2m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:45:19.819 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 2m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:45:19.819 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 2m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:45:19.820 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 2m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:45:19.820 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 2m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:45:19.821 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 2m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:45:19.821 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 2m ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:45:19.821 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 2m ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:45:19.821 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 2m ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:45:19.821 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 2m ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:45:19.822 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 2m ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:45:19.822 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 2m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:45:19.822 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 2m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:45:19.822 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 2m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:45:19.823 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 2m ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:45:19.823 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 2m ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:45:19.823 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 2m ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:45:19.823 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 2m ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:45:19.823 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 2m ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:45:19.824 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 2m ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:45:19.824 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 2m ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:45:19.824 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 2m ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:45:19.824 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 2m ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:45:20.158 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:45:20.158 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:45:20.159 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:45:20.159 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:45:20.159 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:45:20.159 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:45:20.159 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:45:20.160 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:45:20.160 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:45:20.160 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:45:20.160 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:45:20.160 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:45:20.161 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:45:20.161 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:45:20.161 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:45:20.161 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:45:20.161 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:45:20.162 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:45:20.162 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:45:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:18.435371+0000 mgr.smithi067.rdualw (mgr.24569) 4750 : cluster [DBG] pgmap v4094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:20.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:18.435371+0000 mgr.smithi067.rdualw (mgr.24569) 4750 : cluster [DBG] pgmap v4094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:45:19.515838+0000 mgr.smithi067.rdualw (mgr.24569) 4751 : audit [DBG] from='client.37306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:45:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:45:19.801435+0000 mgr.smithi067.rdualw (mgr.24569) 4752 : audit [DBG] from='client.37310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:45:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:45:20.157650+0000 mon.smithi061 (mon.0) 1121 : audit [DBG] from='client.? 172.21.15.61:0/1546226075' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:45:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:45:19.515838+0000 mgr.smithi067.rdualw (mgr.24569) 4751 : audit [DBG] from='client.37306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:45:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:45:19.801435+0000 mgr.smithi067.rdualw (mgr.24569) 4752 : audit [DBG] from='client.37310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:45:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:45:20.157650+0000 mon.smithi061 (mon.0) 1121 : audit [DBG] from='client.? 172.21.15.61:0/1546226075' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:45:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:20.436196+0000 mgr.smithi067.rdualw (mgr.24569) 4753 : cluster [DBG] pgmap v4095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:22.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:20.436196+0000 mgr.smithi067.rdualw (mgr.24569) 4753 : cluster [DBG] pgmap v4095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:22.436904+0000 mgr.smithi067.rdualw (mgr.24569) 4754 : cluster [DBG] pgmap v4096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:24.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:22.436904+0000 mgr.smithi067.rdualw (mgr.24569) 4754 : cluster [DBG] pgmap v4096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:24.437615+0000 mgr.smithi067.rdualw (mgr.24569) 4755 : cluster [DBG] pgmap v4097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:26.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:24.437615+0000 mgr.smithi067.rdualw (mgr.24569) 4755 : cluster [DBG] pgmap v4097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:26.438583+0000 mgr.smithi067.rdualw (mgr.24569) 4756 : cluster [DBG] pgmap v4098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:45:28.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:26.438583+0000 mgr.smithi067.rdualw (mgr.24569) 4756 : cluster [DBG] pgmap v4098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:45:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:28.439137+0000 mgr.smithi067.rdualw (mgr.24569) 4757 : cluster [DBG] pgmap v4099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:30.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:28.439137+0000 mgr.smithi067.rdualw (mgr.24569) 4757 : cluster [DBG] pgmap v4099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:30.440031+0000 mgr.smithi067.rdualw (mgr.24569) 4758 : cluster [DBG] pgmap v4100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:30.440031+0000 mgr.smithi067.rdualw (mgr.24569) 4758 : cluster [DBG] pgmap v4100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:32.440527+0000 mgr.smithi067.rdualw (mgr.24569) 4759 : cluster [DBG] pgmap v4101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:34.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:32.440527+0000 mgr.smithi067.rdualw (mgr.24569) 4759 : cluster [DBG] pgmap v4101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:34.441318+0000 mgr.smithi067.rdualw (mgr.24569) 4760 : cluster [DBG] pgmap v4102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:45:35.172891+0000 mon.smithi067 (mon.1) 746 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:45:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:45:35.173130+0000 mon.smithi067 (mon.1) 747 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:45:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:45:35.173360+0000 mon.smithi061 (mon.0) 1122 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:45:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:45:35.173699+0000 mon.smithi061 (mon.0) 1123 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:45:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:34.441318+0000 mgr.smithi067.rdualw (mgr.24569) 4760 : cluster [DBG] pgmap v4102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:45:35.172891+0000 mon.smithi067 (mon.1) 746 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:45:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:45:35.173130+0000 mon.smithi067 (mon.1) 747 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:45:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:45:35.173360+0000 mon.smithi061 (mon.0) 1122 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:45:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:45:35.173699+0000 mon.smithi061 (mon.0) 1123 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:45:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:36.442336+0000 mgr.smithi067.rdualw (mgr.24569) 4761 : cluster [DBG] pgmap v4103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:45:38.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:36.442336+0000 mgr.smithi067.rdualw (mgr.24569) 4761 : cluster [DBG] pgmap v4103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:45:40.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:38.442828+0000 mgr.smithi067.rdualw (mgr.24569) 4762 : cluster [DBG] pgmap v4104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:38.442828+0000 mgr.smithi067.rdualw (mgr.24569) 4762 : cluster [DBG] pgmap v4104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:42.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:40.443804+0000 mgr.smithi067.rdualw (mgr.24569) 4763 : cluster [DBG] pgmap v4105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:40.443804+0000 mgr.smithi067.rdualw (mgr.24569) 4763 : cluster [DBG] pgmap v4105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:44.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:42.444342+0000 mgr.smithi067.rdualw (mgr.24569) 4764 : cluster [DBG] pgmap v4106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:44.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:42.444342+0000 mgr.smithi067.rdualw (mgr.24569) 4764 : cluster [DBG] pgmap v4106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:44.445078+0000 mgr.smithi067.rdualw (mgr.24569) 4765 : cluster [DBG] pgmap v4107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:46.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:44.445078+0000 mgr.smithi067.rdualw (mgr.24569) 4765 : cluster [DBG] pgmap v4107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:46.446124+0000 mgr.smithi067.rdualw (mgr.24569) 4766 : cluster [DBG] pgmap v4108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:45:48.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:46.446124+0000 mgr.smithi067.rdualw (mgr.24569) 4766 : cluster [DBG] pgmap v4108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:45:50.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:48.446695+0000 mgr.smithi067.rdualw (mgr.24569) 4767 : cluster [DBG] pgmap v4109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:48.446695+0000 mgr.smithi067.rdualw (mgr.24569) 4767 : cluster [DBG] pgmap v4109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:50.467 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:45:50.757 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:45:50.758 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 2m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:45:50.758 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 2m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:45:50.758 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 2m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:45:50.759 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 2m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:45:50.759 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 2m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:45:50.759 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 2m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:45:50.759 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 2m ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:45:50.760 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 2m ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:45:50.760 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 2m ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:45:50.760 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 2m ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:45:50.760 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 2m ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:45:50.761 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 2m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:45:50.761 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 2m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:45:50.761 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 2m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:45:50.761 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 2m ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:45:50.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 2m ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:45:50.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 2m ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:45:50.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 2m ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:45:50.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 2m ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:45:50.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 2m ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:45:50.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 2m ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:45:50.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 2m ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:45:50.763 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 2m ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:45:51.099 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:45:51.100 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:45:51.100 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:45:51.100 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:45:51.100 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:45:51.101 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:45:51.101 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:45:51.101 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:45:51.101 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:45:51.101 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:45:51.102 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:45:51.102 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:45:51.102 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:45:51.102 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:45:51.103 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:45:51.103 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:45:51.103 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:45:51.103 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:45:51.103 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:45:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:50.447715+0000 mgr.smithi067.rdualw (mgr.24569) 4768 : cluster [DBG] pgmap v4110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:45:50.454791+0000 mgr.smithi067.rdualw (mgr.24569) 4769 : audit [DBG] from='client.37318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:45:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:45:50.740991+0000 mgr.smithi067.rdualw (mgr.24569) 4770 : audit [DBG] from='client.37322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:45:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:45:51.098830+0000 mon.smithi061 (mon.0) 1124 : audit [DBG] from='client.? 172.21.15.61:0/445368610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:45:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:50.447715+0000 mgr.smithi067.rdualw (mgr.24569) 4768 : cluster [DBG] pgmap v4110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:45:50.454791+0000 mgr.smithi067.rdualw (mgr.24569) 4769 : audit [DBG] from='client.37318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:45:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:45:50.740991+0000 mgr.smithi067.rdualw (mgr.24569) 4770 : audit [DBG] from='client.37322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:45:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:45:51.098830+0000 mon.smithi061 (mon.0) 1124 : audit [DBG] from='client.? 172.21.15.61:0/445368610' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:45:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:52.448389+0000 mgr.smithi067.rdualw (mgr.24569) 4771 : cluster [DBG] pgmap v4111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:54.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:52.448389+0000 mgr.smithi067.rdualw (mgr.24569) 4771 : cluster [DBG] pgmap v4111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:54.448973+0000 mgr.smithi067.rdualw (mgr.24569) 4772 : cluster [DBG] pgmap v4112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:54.448973+0000 mgr.smithi067.rdualw (mgr.24569) 4772 : cluster [DBG] pgmap v4112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:45:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:56.449779+0000 mgr.smithi067.rdualw (mgr.24569) 4773 : cluster [DBG] pgmap v4113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:45:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:56.449779+0000 mgr.smithi067.rdualw (mgr.24569) 4773 : cluster [DBG] pgmap v4113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:46:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:45:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:45:58.450275+0000 mgr.smithi067.rdualw (mgr.24569) 4774 : cluster [DBG] pgmap v4114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:00.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:45:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:45:58.450275+0000 mgr.smithi067.rdualw (mgr.24569) 4774 : cluster [DBG] pgmap v4114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:02.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:00.451267+0000 mgr.smithi067.rdualw (mgr.24569) 4775 : cluster [DBG] pgmap v4115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:02.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:00.451267+0000 mgr.smithi067.rdualw (mgr.24569) 4775 : cluster [DBG] pgmap v4115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:02.451894+0000 mgr.smithi067.rdualw (mgr.24569) 4776 : cluster [DBG] pgmap v4116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:04.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:02.451894+0000 mgr.smithi067.rdualw (mgr.24569) 4776 : cluster [DBG] pgmap v4116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:04.452729+0000 mgr.smithi067.rdualw (mgr.24569) 4777 : cluster [DBG] pgmap v4117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:06.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:04.452729+0000 mgr.smithi067.rdualw (mgr.24569) 4777 : cluster [DBG] pgmap v4117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:08.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:06.453747+0000 mgr.smithi067.rdualw (mgr.24569) 4778 : cluster [DBG] pgmap v4118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:46:08.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:06.453747+0000 mgr.smithi067.rdualw (mgr.24569) 4778 : cluster [DBG] pgmap v4118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:46:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:08.454308+0000 mgr.smithi067.rdualw (mgr.24569) 4779 : cluster [DBG] pgmap v4119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:46:09.861084+0000 mon.smithi067 (mon.1) 748 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:46:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:46:09.862549+0000 mon.smithi067 (mon.1) 749 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:46:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:46:09.863465+0000 mon.smithi067 (mon.1) 750 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:46:10.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:08.454308+0000 mgr.smithi067.rdualw (mgr.24569) 4779 : cluster [DBG] pgmap v4119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:46:09.861084+0000 mon.smithi067 (mon.1) 748 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:46:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:46:09.862549+0000 mon.smithi067 (mon.1) 749 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:46:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:46:09.863465+0000 mon.smithi067 (mon.1) 750 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:46:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:46:09.864305+0000 mgr.smithi067.rdualw (mgr.24569) 4780 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:46:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:46:10.282065+0000 mon.smithi061 (mon.0) 1125 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:46:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:46:10.287638+0000 mon.smithi061 (mon.0) 1126 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:46:11.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:46:09.864305+0000 mgr.smithi067.rdualw (mgr.24569) 4780 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:46:11.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:46:10.282065+0000 mon.smithi061 (mon.0) 1125 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:46:11.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:46:10.287638+0000 mon.smithi061 (mon.0) 1126 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:46:12.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:10.455159+0000 mgr.smithi067.rdualw (mgr.24569) 4781 : cluster [DBG] pgmap v4120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:12.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:10.455159+0000 mgr.smithi067.rdualw (mgr.24569) 4781 : cluster [DBG] pgmap v4120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:14.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:12.455687+0000 mgr.smithi067.rdualw (mgr.24569) 4782 : cluster [DBG] pgmap v4121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:12.455687+0000 mgr.smithi067.rdualw (mgr.24569) 4782 : cluster [DBG] pgmap v4121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:14.456275+0000 mgr.smithi067.rdualw (mgr.24569) 4783 : cluster [DBG] pgmap v4122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:14.456275+0000 mgr.smithi067.rdualw (mgr.24569) 4783 : cluster [DBG] pgmap v4122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:18.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:16.457167+0000 mgr.smithi067.rdualw (mgr.24569) 4784 : cluster [DBG] pgmap v4123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:46:18.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:16.457167+0000 mgr.smithi067.rdualw (mgr.24569) 4784 : cluster [DBG] pgmap v4123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:46:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:18.457893+0000 mgr.smithi067.rdualw (mgr.24569) 4785 : cluster [DBG] pgmap v4124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:20.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:18.457893+0000 mgr.smithi067.rdualw (mgr.24569) 4785 : cluster [DBG] pgmap v4124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:21.410 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:46:21.703 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:46:21.703 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 3m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:46:21.703 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 3m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:46:21.704 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 3m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:46:21.704 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 3m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:46:21.704 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 3m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:46:21.704 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 3m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:46:21.705 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 3m ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:46:21.705 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 3m ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:46:21.705 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 3m ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:46:21.705 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 3m ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:46:21.705 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 3m ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:46:21.706 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 3m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:46:21.706 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 3m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:46:21.706 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 3m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:46:21.706 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 3m ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:46:21.706 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 3m ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:46:21.707 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 3m ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:46:21.707 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 3m ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:46:21.707 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 3m ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:46:21.707 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 3m ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:46:21.708 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 3m ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:46:21.708 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 3m ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:46:21.708 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 3m ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:46:22.046 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:46:22.046 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:46:22.046 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:46:22.046 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:46:22.047 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:46:22.047 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:46:22.047 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:46:22.047 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:46:22.048 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:46:22.048 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:46:22.048 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:46:22.048 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:46:22.048 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:46:22.049 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:46:22.049 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:46:22.049 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:46:22.049 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:46:22.050 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:46:22.050 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:46:22.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:20.458801+0000 mgr.smithi067.rdualw (mgr.24569) 4786 : cluster [DBG] pgmap v4125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:46:22.045366+0000 mon.smithi061 (mon.0) 1127 : audit [DBG] from='client.? 172.21.15.61:0/2265929814' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:46:22.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:20.458801+0000 mgr.smithi067.rdualw (mgr.24569) 4786 : cluster [DBG] pgmap v4125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:46:22.045366+0000 mon.smithi061 (mon.0) 1127 : audit [DBG] from='client.? 172.21.15.61:0/2265929814' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:46:23.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:46:21.397886+0000 mgr.smithi067.rdualw (mgr.24569) 4787 : audit [DBG] from='client.37330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:46:23.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:46:21.686245+0000 mgr.smithi067.rdualw (mgr.24569) 4788 : audit [DBG] from='client.37334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:46:23.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:46:21.397886+0000 mgr.smithi067.rdualw (mgr.24569) 4787 : audit [DBG] from='client.37330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:46:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:46:21.686245+0000 mgr.smithi067.rdualw (mgr.24569) 4788 : audit [DBG] from='client.37334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:46:24.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:22.459478+0000 mgr.smithi067.rdualw (mgr.24569) 4789 : cluster [DBG] pgmap v4126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:24.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:22.459478+0000 mgr.smithi067.rdualw (mgr.24569) 4789 : cluster [DBG] pgmap v4126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:26.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:24.460228+0000 mgr.smithi067.rdualw (mgr.24569) 4790 : cluster [DBG] pgmap v4127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:26.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:24.460228+0000 mgr.smithi067.rdualw (mgr.24569) 4790 : cluster [DBG] pgmap v4127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:26.461124+0000 mgr.smithi067.rdualw (mgr.24569) 4791 : cluster [DBG] pgmap v4128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:46:28.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:26.461124+0000 mgr.smithi067.rdualw (mgr.24569) 4791 : cluster [DBG] pgmap v4128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:46:30.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:28.461665+0000 mgr.smithi067.rdualw (mgr.24569) 4792 : cluster [DBG] pgmap v4129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:30.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:28.461665+0000 mgr.smithi067.rdualw (mgr.24569) 4792 : cluster [DBG] pgmap v4129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:30.462484+0000 mgr.smithi067.rdualw (mgr.24569) 4793 : cluster [DBG] pgmap v4130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:32.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:30.462484+0000 mgr.smithi067.rdualw (mgr.24569) 4793 : cluster [DBG] pgmap v4130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:32.462972+0000 mgr.smithi067.rdualw (mgr.24569) 4794 : cluster [DBG] pgmap v4131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:32.462972+0000 mgr.smithi067.rdualw (mgr.24569) 4794 : cluster [DBG] pgmap v4131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:46:35.178321+0000 mon.smithi067 (mon.1) 751 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:46:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:46:35.178630+0000 mon.smithi067 (mon.1) 752 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:46:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:46:35.178803+0000 mon.smithi061 (mon.0) 1128 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:46:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:46:35.179372+0000 mon.smithi061 (mon.0) 1129 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:46:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:46:35.178321+0000 mon.smithi067 (mon.1) 751 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:46:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:46:35.178630+0000 mon.smithi067 (mon.1) 752 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:46:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:46:35.178803+0000 mon.smithi061 (mon.0) 1128 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:46:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:46:35.179372+0000 mon.smithi061 (mon.0) 1129 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:46:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:34.463612+0000 mgr.smithi067.rdualw (mgr.24569) 4795 : cluster [DBG] pgmap v4132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:36.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:34.463612+0000 mgr.smithi067.rdualw (mgr.24569) 4795 : cluster [DBG] pgmap v4132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:37.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:36.464712+0000 mgr.smithi067.rdualw (mgr.24569) 4796 : cluster [DBG] pgmap v4133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:46:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:36.464712+0000 mgr.smithi067.rdualw (mgr.24569) 4796 : cluster [DBG] pgmap v4133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:46:39.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:38.465198+0000 mgr.smithi067.rdualw (mgr.24569) 4797 : cluster [DBG] pgmap v4134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:39.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:38.465198+0000 mgr.smithi067.rdualw (mgr.24569) 4797 : cluster [DBG] pgmap v4134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:41.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:40.466272+0000 mgr.smithi067.rdualw (mgr.24569) 4798 : cluster [DBG] pgmap v4135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:41.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:40.466272+0000 mgr.smithi067.rdualw (mgr.24569) 4798 : cluster [DBG] pgmap v4135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:43.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:42.466831+0000 mgr.smithi067.rdualw (mgr.24569) 4799 : cluster [DBG] pgmap v4136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:43.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:42.466831+0000 mgr.smithi067.rdualw (mgr.24569) 4799 : cluster [DBG] pgmap v4136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:45.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:44.467415+0000 mgr.smithi067.rdualw (mgr.24569) 4800 : cluster [DBG] pgmap v4137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:45.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:44.467415+0000 mgr.smithi067.rdualw (mgr.24569) 4800 : cluster [DBG] pgmap v4137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:47.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:46.468222+0000 mgr.smithi067.rdualw (mgr.24569) 4801 : cluster [DBG] pgmap v4138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:46:47.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:46.468222+0000 mgr.smithi067.rdualw (mgr.24569) 4801 : cluster [DBG] pgmap v4138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:46:49.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:48.468813+0000 mgr.smithi067.rdualw (mgr.24569) 4802 : cluster [DBG] pgmap v4139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:49.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:48.468813+0000 mgr.smithi067.rdualw (mgr.24569) 4802 : cluster [DBG] pgmap v4139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:51.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:50.469614+0000 mgr.smithi067.rdualw (mgr.24569) 4803 : cluster [DBG] pgmap v4140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:51.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:50.469614+0000 mgr.smithi067.rdualw (mgr.24569) 4803 : cluster [DBG] pgmap v4140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:52.354 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:46:52.648 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:46:52.648 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 3m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:46:52.648 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 3m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:46:52.649 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 3m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:46:52.649 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 3m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:46:52.649 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 3m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:46:52.649 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 3m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:46:52.649 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 3m ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:46:52.650 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 3m ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:46:52.650 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 3m ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:46:52.650 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 3m ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:46:52.650 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 3m ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:46:52.651 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 3m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:46:52.651 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 3m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:46:52.651 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 3m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:46:52.651 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 3m ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:46:52.652 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 3m ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:46:52.652 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 3m ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:46:52.652 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 3m ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:46:52.652 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 3m ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:46:52.653 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 3m ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:46:52.653 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 3m ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:46:52.653 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 3m ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:46:52.653 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 3m ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:46:53.028 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:46:53.028 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:46:53.029 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:46:53.029 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:46:53.029 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:46:53.029 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:46:53.030 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:46:53.030 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:46:53.030 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:46:53.030 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:46:53.031 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:46:53.031 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:46:53.031 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:46:53.031 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:46:53.031 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:46:53.032 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:46:53.032 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:46:53.032 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:46:53.032 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:46:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:46:52.342083+0000 mgr.smithi067.rdualw (mgr.24569) 4804 : audit [DBG] from='client.37342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:46:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:52.470286+0000 mgr.smithi067.rdualw (mgr.24569) 4805 : cluster [DBG] pgmap v4141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:46:52.631350+0000 mgr.smithi067.rdualw (mgr.24569) 4806 : audit [DBG] from='client.37346 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:46:53.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:46:53.027860+0000 mon.smithi061 (mon.0) 1130 : audit [DBG] from='client.? 172.21.15.61:0/369528612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:46:53.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:46:52.342083+0000 mgr.smithi067.rdualw (mgr.24569) 4804 : audit [DBG] from='client.37342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:46:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:52.470286+0000 mgr.smithi067.rdualw (mgr.24569) 4805 : cluster [DBG] pgmap v4141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:46:52.631350+0000 mgr.smithi067.rdualw (mgr.24569) 4806 : audit [DBG] from='client.37346 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:46:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:46:53.027860+0000 mon.smithi061 (mon.0) 1130 : audit [DBG] from='client.? 172.21.15.61:0/369528612' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:46:55.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:54.470912+0000 mgr.smithi067.rdualw (mgr.24569) 4807 : cluster [DBG] pgmap v4142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:55.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:54.470912+0000 mgr.smithi067.rdualw (mgr.24569) 4807 : cluster [DBG] pgmap v4142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:57.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:56.471817+0000 mgr.smithi067.rdualw (mgr.24569) 4808 : cluster [DBG] pgmap v4143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:46:57.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:56.471817+0000 mgr.smithi067.rdualw (mgr.24569) 4808 : cluster [DBG] pgmap v4143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:46:59.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:46:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:46:58.472432+0000 mgr.smithi067.rdualw (mgr.24569) 4809 : cluster [DBG] pgmap v4144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:46:59.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:46:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:46:58.472432+0000 mgr.smithi067.rdualw (mgr.24569) 4809 : cluster [DBG] pgmap v4144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:01.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:00.473361+0000 mgr.smithi067.rdualw (mgr.24569) 4810 : cluster [DBG] pgmap v4145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:00.473361+0000 mgr.smithi067.rdualw (mgr.24569) 4810 : cluster [DBG] pgmap v4145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:03.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:02.473961+0000 mgr.smithi067.rdualw (mgr.24569) 4811 : cluster [DBG] pgmap v4146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:02.473961+0000 mgr.smithi067.rdualw (mgr.24569) 4811 : cluster [DBG] pgmap v4146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:04.474592+0000 mgr.smithi067.rdualw (mgr.24569) 4812 : cluster [DBG] pgmap v4147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:06.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:04.474592+0000 mgr.smithi067.rdualw (mgr.24569) 4812 : cluster [DBG] pgmap v4147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:06.475390+0000 mgr.smithi067.rdualw (mgr.24569) 4813 : cluster [DBG] pgmap v4148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:47:08.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:06.475390+0000 mgr.smithi067.rdualw (mgr.24569) 4813 : cluster [DBG] pgmap v4148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:47:10.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:08.475873+0000 mgr.smithi067.rdualw (mgr.24569) 4814 : cluster [DBG] pgmap v4149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:10.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:08.475873+0000 mgr.smithi067.rdualw (mgr.24569) 4814 : cluster [DBG] pgmap v4149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:47:10.293401+0000 mon.smithi067 (mon.1) 753 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:47:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:47:10.294902+0000 mon.smithi067 (mon.1) 754 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:47:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:47:10.295873+0000 mon.smithi067 (mon.1) 755 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:47:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:47:10.296773+0000 mgr.smithi067.rdualw (mgr.24569) 4815 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:47:11.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:47:10.293401+0000 mon.smithi067 (mon.1) 753 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:47:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:47:10.294902+0000 mon.smithi067 (mon.1) 754 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:47:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:47:10.295873+0000 mon.smithi067 (mon.1) 755 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:47:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:47:10.296773+0000 mgr.smithi067.rdualw (mgr.24569) 4815 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:47:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:10.476652+0000 mgr.smithi067.rdualw (mgr.24569) 4816 : cluster [DBG] pgmap v4150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:47:10.711312+0000 mon.smithi061 (mon.0) 1131 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:47:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:47:10.719031+0000 mon.smithi061 (mon.0) 1132 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:47:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:10.476652+0000 mgr.smithi067.rdualw (mgr.24569) 4816 : cluster [DBG] pgmap v4150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:47:10.711312+0000 mon.smithi061 (mon.0) 1131 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:47:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:47:10.719031+0000 mon.smithi061 (mon.0) 1132 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:47:14.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:12.477145+0000 mgr.smithi067.rdualw (mgr.24569) 4817 : cluster [DBG] pgmap v4151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:14.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:12.477145+0000 mgr.smithi067.rdualw (mgr.24569) 4817 : cluster [DBG] pgmap v4151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:16.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:14.477717+0000 mgr.smithi067.rdualw (mgr.24569) 4818 : cluster [DBG] pgmap v4152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:16.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:14.477717+0000 mgr.smithi067.rdualw (mgr.24569) 4818 : cluster [DBG] pgmap v4152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:18.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:16.478622+0000 mgr.smithi067.rdualw (mgr.24569) 4819 : cluster [DBG] pgmap v4153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:47:18.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:16.478622+0000 mgr.smithi067.rdualw (mgr.24569) 4819 : cluster [DBG] pgmap v4153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:47:20.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:18.479126+0000 mgr.smithi067.rdualw (mgr.24569) 4820 : cluster [DBG] pgmap v4154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:20.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:18.479126+0000 mgr.smithi067.rdualw (mgr.24569) 4820 : cluster [DBG] pgmap v4154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:20.479895+0000 mgr.smithi067.rdualw (mgr.24569) 4821 : cluster [DBG] pgmap v4155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:20.479895+0000 mgr.smithi067.rdualw (mgr.24569) 4821 : cluster [DBG] pgmap v4155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:23.334 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:47:23.633 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:47:23.633 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 4m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:47:23.633 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 4m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:47:23.633 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 4m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:47:23.634 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 4m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:47:23.634 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 4m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:47:23.634 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 4m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:47:23.634 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 4m ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:47:23.635 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 4m ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:47:23.635 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 4m ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:47:23.635 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 4m ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:47:23.635 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 4m ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:47:23.635 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 4m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:47:23.636 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 4m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:47:23.636 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 4m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:47:23.636 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 4m ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:47:23.636 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 4m ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:47:23.637 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 4m ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:47:23.637 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 4m ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:47:23.637 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 4m ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:47:23.637 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 4m ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:47:23.637 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 4m ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:47:23.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 4m ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:47:23.638 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 4m ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:47:23.975 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:47:23.976 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:47:23.976 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:47:23.976 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:47:23.976 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:47:23.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:47:23.977 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:47:23.977 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:47:23.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:47:23.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:47:23.978 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:47:23.978 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:47:23.978 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:47:23.978 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:47:23.979 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:47:23.979 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:47:23.979 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:47:23.979 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:47:23.979 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:47:24.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:22.480613+0000 mgr.smithi067.rdualw (mgr.24569) 4822 : cluster [DBG] pgmap v4156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:24.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:47:23.322335+0000 mgr.smithi067.rdualw (mgr.24569) 4823 : audit [DBG] from='client.37354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:47:24.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:22.480613+0000 mgr.smithi067.rdualw (mgr.24569) 4822 : cluster [DBG] pgmap v4156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:47:23.322335+0000 mgr.smithi067.rdualw (mgr.24569) 4823 : audit [DBG] from='client.37354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:47:25.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:47:23.615932+0000 mgr.smithi067.rdualw (mgr.24569) 4824 : audit [DBG] from='client.37358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:47:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:47:23.975220+0000 mon.smithi061 (mon.0) 1133 : audit [DBG] from='client.? 172.21.15.61:0/3078693873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:47:25.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:47:23.615932+0000 mgr.smithi067.rdualw (mgr.24569) 4824 : audit [DBG] from='client.37358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:47:25.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:47:23.975220+0000 mon.smithi061 (mon.0) 1133 : audit [DBG] from='client.? 172.21.15.61:0/3078693873' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:47:26.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:24.481208+0000 mgr.smithi067.rdualw (mgr.24569) 4825 : cluster [DBG] pgmap v4157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:26.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:24.481208+0000 mgr.smithi067.rdualw (mgr.24569) 4825 : cluster [DBG] pgmap v4157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:28.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:26.482108+0000 mgr.smithi067.rdualw (mgr.24569) 4826 : cluster [DBG] pgmap v4158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:47:28.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:26.482108+0000 mgr.smithi067.rdualw (mgr.24569) 4826 : cluster [DBG] pgmap v4158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:47:30.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:28.482703+0000 mgr.smithi067.rdualw (mgr.24569) 4827 : cluster [DBG] pgmap v4159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:28.482703+0000 mgr.smithi067.rdualw (mgr.24569) 4827 : cluster [DBG] pgmap v4159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:30.483607+0000 mgr.smithi067.rdualw (mgr.24569) 4828 : cluster [DBG] pgmap v4160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:30.483607+0000 mgr.smithi067.rdualw (mgr.24569) 4828 : cluster [DBG] pgmap v4160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:34.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:32.484313+0000 mgr.smithi067.rdualw (mgr.24569) 4829 : cluster [DBG] pgmap v4161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:34.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:32.484313+0000 mgr.smithi067.rdualw (mgr.24569) 4829 : cluster [DBG] pgmap v4161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:34.485080+0000 mgr.smithi067.rdualw (mgr.24569) 4830 : cluster [DBG] pgmap v4162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:47:35.183696+0000 mon.smithi067 (mon.1) 756 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:47:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:47:35.184046+0000 mon.smithi067 (mon.1) 757 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:47:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:47:35.184082+0000 mon.smithi061 (mon.0) 1134 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:47:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:47:35.184469+0000 mon.smithi061 (mon.0) 1135 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:47:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:34.485080+0000 mgr.smithi067.rdualw (mgr.24569) 4830 : cluster [DBG] pgmap v4162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:47:35.183696+0000 mon.smithi067 (mon.1) 756 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:47:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:47:35.184046+0000 mon.smithi067 (mon.1) 757 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:47:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:47:35.184082+0000 mon.smithi061 (mon.0) 1134 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:47:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:47:35.184469+0000 mon.smithi061 (mon.0) 1135 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:47:38.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:36.486034+0000 mgr.smithi067.rdualw (mgr.24569) 4831 : cluster [DBG] pgmap v4163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:47:38.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:36.486034+0000 mgr.smithi067.rdualw (mgr.24569) 4831 : cluster [DBG] pgmap v4163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:47:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:38.486506+0000 mgr.smithi067.rdualw (mgr.24569) 4832 : cluster [DBG] pgmap v4164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:40.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:38.486506+0000 mgr.smithi067.rdualw (mgr.24569) 4832 : cluster [DBG] pgmap v4164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:40.487361+0000 mgr.smithi067.rdualw (mgr.24569) 4833 : cluster [DBG] pgmap v4165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:40.487361+0000 mgr.smithi067.rdualw (mgr.24569) 4833 : cluster [DBG] pgmap v4165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:44.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:42.487991+0000 mgr.smithi067.rdualw (mgr.24569) 4834 : cluster [DBG] pgmap v4166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:44.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:42.487991+0000 mgr.smithi067.rdualw (mgr.24569) 4834 : cluster [DBG] pgmap v4166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:46.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:44.488587+0000 mgr.smithi067.rdualw (mgr.24569) 4835 : cluster [DBG] pgmap v4167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:46.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:44.488587+0000 mgr.smithi067.rdualw (mgr.24569) 4835 : cluster [DBG] pgmap v4167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:48.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:46.489426+0000 mgr.smithi067.rdualw (mgr.24569) 4836 : cluster [DBG] pgmap v4168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:47:48.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:46.489426+0000 mgr.smithi067.rdualw (mgr.24569) 4836 : cluster [DBG] pgmap v4168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:47:50.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:48.489990+0000 mgr.smithi067.rdualw (mgr.24569) 4837 : cluster [DBG] pgmap v4169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:50.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:48.489990+0000 mgr.smithi067.rdualw (mgr.24569) 4837 : cluster [DBG] pgmap v4169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:50.491012+0000 mgr.smithi067.rdualw (mgr.24569) 4838 : cluster [DBG] pgmap v4170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:50.491012+0000 mgr.smithi067.rdualw (mgr.24569) 4838 : cluster [DBG] pgmap v4170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:54.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:52.491546+0000 mgr.smithi067.rdualw (mgr.24569) 4839 : cluster [DBG] pgmap v4171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:54.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:52.491546+0000 mgr.smithi067.rdualw (mgr.24569) 4839 : cluster [DBG] pgmap v4171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:54.285 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:47:54.576 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:47:54.576 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 4m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:47:54.577 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 4m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:47:54.577 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 4m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:47:54.577 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 4m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:47:54.577 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 4m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:47:54.577 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 4m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:47:54.578 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 4m ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:47:54.578 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 4m ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:47:54.578 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 4m ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:47:54.578 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 4m ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:47:54.579 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 4m ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:47:54.579 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 4m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:47:54.579 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 4m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:47:54.579 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 4m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:47:54.580 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 4m ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:47:54.580 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 4m ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:47:54.580 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 4m ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:47:54.580 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 4m ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:47:54.581 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 4m ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:47:54.581 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 4m ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:47:54.581 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 4m ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:47:54.581 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 4m ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:47:54.581 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 4m ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:47:54.931 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:47:54.932 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:47:54.932 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:47:54.932 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:47:54.932 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:47:54.933 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:47:54.933 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:47:54.933 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:47:54.933 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:47:54.934 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:47:54.934 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:47:54.934 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:47:54.934 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:47:54.935 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:47:54.935 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:47:54.935 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:47:54.936 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:47:54.936 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:47:54.936 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:47:55.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:47:54.273094+0000 mgr.smithi067.rdualw (mgr.24569) 4840 : audit [DBG] from='client.37366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:47:55.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:47:54.273094+0000 mgr.smithi067.rdualw (mgr.24569) 4840 : audit [DBG] from='client.37366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:47:56.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:54.492197+0000 mgr.smithi067.rdualw (mgr.24569) 4841 : cluster [DBG] pgmap v4172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:47:54.559608+0000 mgr.smithi067.rdualw (mgr.24569) 4842 : audit [DBG] from='client.37370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:47:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:47:54.931192+0000 mon.smithi061 (mon.0) 1136 : audit [DBG] from='client.? 172.21.15.61:0/3593588101' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:47:56.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:54.492197+0000 mgr.smithi067.rdualw (mgr.24569) 4841 : cluster [DBG] pgmap v4172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:47:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:47:54.559608+0000 mgr.smithi067.rdualw (mgr.24569) 4842 : audit [DBG] from='client.37370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:47:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:47:54.931192+0000 mon.smithi061 (mon.0) 1136 : audit [DBG] from='client.? 172.21.15.61:0/3593588101' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:47:58.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:56.493212+0000 mgr.smithi067.rdualw (mgr.24569) 4843 : cluster [DBG] pgmap v4173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:47:58.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:56.493212+0000 mgr.smithi067.rdualw (mgr.24569) 4843 : cluster [DBG] pgmap v4173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:48:00.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:47:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:47:58.493728+0000 mgr.smithi067.rdualw (mgr.24569) 4844 : cluster [DBG] pgmap v4174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:00.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:47:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:47:58.493728+0000 mgr.smithi067.rdualw (mgr.24569) 4844 : cluster [DBG] pgmap v4174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:00.494701+0000 mgr.smithi067.rdualw (mgr.24569) 4845 : cluster [DBG] pgmap v4175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:00.494701+0000 mgr.smithi067.rdualw (mgr.24569) 4845 : cluster [DBG] pgmap v4175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:02.495204+0000 mgr.smithi067.rdualw (mgr.24569) 4846 : cluster [DBG] pgmap v4176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:04.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:02.495204+0000 mgr.smithi067.rdualw (mgr.24569) 4846 : cluster [DBG] pgmap v4176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:06.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:04.495831+0000 mgr.smithi067.rdualw (mgr.24569) 4847 : cluster [DBG] pgmap v4177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:06.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:04.495831+0000 mgr.smithi067.rdualw (mgr.24569) 4847 : cluster [DBG] pgmap v4177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:06.496803+0000 mgr.smithi067.rdualw (mgr.24569) 4848 : cluster [DBG] pgmap v4178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:48:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:06.496803+0000 mgr.smithi067.rdualw (mgr.24569) 4848 : cluster [DBG] pgmap v4178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:48:10.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:08.497472+0000 mgr.smithi067.rdualw (mgr.24569) 4849 : cluster [DBG] pgmap v4179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:10.069 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:08.497472+0000 mgr.smithi067.rdualw (mgr.24569) 4849 : cluster [DBG] pgmap v4179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:11.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:10.498325+0000 mgr.smithi067.rdualw (mgr.24569) 4850 : cluster [DBG] pgmap v4180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:48:10.722388+0000 mon.smithi067 (mon.1) 758 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:48:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:48:10.723843+0000 mon.smithi067 (mon.1) 759 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:48:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:48:10.724817+0000 mon.smithi067 (mon.1) 760 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:48:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:48:10.725684+0000 mgr.smithi067.rdualw (mgr.24569) 4851 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:48:11.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:48:11.141298+0000 mon.smithi061 (mon.0) 1137 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:48:11.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:48:11.149388+0000 mon.smithi061 (mon.0) 1138 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:48:11.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:10.498325+0000 mgr.smithi067.rdualw (mgr.24569) 4850 : cluster [DBG] pgmap v4180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:11.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:48:10.722388+0000 mon.smithi067 (mon.1) 758 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:48:11.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:48:10.723843+0000 mon.smithi067 (mon.1) 759 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:48:11.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:48:10.724817+0000 mon.smithi067 (mon.1) 760 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:48:11.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:48:10.725684+0000 mgr.smithi067.rdualw (mgr.24569) 4851 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:48:11.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:48:11.141298+0000 mon.smithi061 (mon.0) 1137 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:48:11.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:48:11.149388+0000 mon.smithi061 (mon.0) 1138 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:48:13.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:12.498902+0000 mgr.smithi067.rdualw (mgr.24569) 4852 : cluster [DBG] pgmap v4181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:12.498902+0000 mgr.smithi067.rdualw (mgr.24569) 4852 : cluster [DBG] pgmap v4181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:15.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:14.499556+0000 mgr.smithi067.rdualw (mgr.24569) 4853 : cluster [DBG] pgmap v4182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:15.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:14.499556+0000 mgr.smithi067.rdualw (mgr.24569) 4853 : cluster [DBG] pgmap v4182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:17.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:16.500383+0000 mgr.smithi067.rdualw (mgr.24569) 4854 : cluster [DBG] pgmap v4183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:48:17.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:16.500383+0000 mgr.smithi067.rdualw (mgr.24569) 4854 : cluster [DBG] pgmap v4183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:48:19.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:18.500914+0000 mgr.smithi067.rdualw (mgr.24569) 4855 : cluster [DBG] pgmap v4184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:19.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:18.500914+0000 mgr.smithi067.rdualw (mgr.24569) 4855 : cluster [DBG] pgmap v4184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:21.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:20.501796+0000 mgr.smithi067.rdualw (mgr.24569) 4856 : cluster [DBG] pgmap v4185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:21.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:20.501796+0000 mgr.smithi067.rdualw (mgr.24569) 4856 : cluster [DBG] pgmap v4185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:22.502271+0000 mgr.smithi067.rdualw (mgr.24569) 4857 : cluster [DBG] pgmap v4186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:23.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:22.502271+0000 mgr.smithi067.rdualw (mgr.24569) 4857 : cluster [DBG] pgmap v4186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:25.239 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:48:25.532 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:48:25.532 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 5m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:48:25.532 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 5m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:48:25.533 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 5m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:48:25.533 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 5m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:48:25.533 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 5m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:48:25.533 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 5m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:48:25.534 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 5m ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:48:25.534 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 5m ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:48:25.534 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 5m ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:48:25.534 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 5m ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:48:25.535 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 5m ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:48:25.535 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 5m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:48:25.535 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 5m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:48:25.535 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 5m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:48:25.535 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 5m ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:48:25.536 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 5m ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:48:25.536 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 5m ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:48:25.536 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 5m ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:48:25.536 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 5m ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:48:25.537 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 5m ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:48:25.537 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 5m ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:48:25.537 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 5m ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:48:25.537 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 5m ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:48:25.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:24.502832+0000 mgr.smithi067.rdualw (mgr.24569) 4858 : cluster [DBG] pgmap v4187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:25.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:48:25.227465+0000 mgr.smithi067.rdualw (mgr.24569) 4859 : audit [DBG] from='client.37378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:48:25.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:24.502832+0000 mgr.smithi067.rdualw (mgr.24569) 4858 : cluster [DBG] pgmap v4187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:25.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:48:25.227465+0000 mgr.smithi067.rdualw (mgr.24569) 4859 : audit [DBG] from='client.37378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:48:25.878 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:48:25.879 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:48:25.879 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:48:25.879 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:48:25.879 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:48:25.880 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:48:25.880 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:48:25.880 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:48:25.880 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:48:25.881 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:48:25.881 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:48:25.881 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:48:25.881 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:48:25.881 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:48:25.882 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:48:25.882 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:48:25.882 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:48:25.882 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:48:25.883 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:48:26.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:48:25.515347+0000 mgr.smithi067.rdualw (mgr.24569) 4860 : audit [DBG] from='client.37382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:48:26.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:48:25.877968+0000 mon.smithi061 (mon.0) 1139 : audit [DBG] from='client.? 172.21.15.61:0/181962736' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:48:26.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:48:25.515347+0000 mgr.smithi067.rdualw (mgr.24569) 4860 : audit [DBG] from='client.37382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:48:26.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:48:25.877968+0000 mon.smithi061 (mon.0) 1139 : audit [DBG] from='client.? 172.21.15.61:0/181962736' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:48:27.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:26.503695+0000 mgr.smithi067.rdualw (mgr.24569) 4861 : cluster [DBG] pgmap v4188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:48:27.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:26.503695+0000 mgr.smithi067.rdualw (mgr.24569) 4861 : cluster [DBG] pgmap v4188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:48:29.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:28.504146+0000 mgr.smithi067.rdualw (mgr.24569) 4862 : cluster [DBG] pgmap v4189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:29.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:28.504146+0000 mgr.smithi067.rdualw (mgr.24569) 4862 : cluster [DBG] pgmap v4189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:31.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:30.505109+0000 mgr.smithi067.rdualw (mgr.24569) 4863 : cluster [DBG] pgmap v4190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:30.505109+0000 mgr.smithi067.rdualw (mgr.24569) 4863 : cluster [DBG] pgmap v4190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:33.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:32.505913+0000 mgr.smithi067.rdualw (mgr.24569) 4864 : cluster [DBG] pgmap v4191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:34.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:32.505913+0000 mgr.smithi067.rdualw (mgr.24569) 4864 : cluster [DBG] pgmap v4191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:34.506518+0000 mgr.smithi067.rdualw (mgr.24569) 4865 : cluster [DBG] pgmap v4192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:48:35.189394+0000 mon.smithi067 (mon.1) 761 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:48:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:48:35.189706+0000 mon.smithi067 (mon.1) 762 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:48:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:48:35.189814+0000 mon.smithi061 (mon.0) 1140 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:48:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:48:35.190130+0000 mon.smithi061 (mon.0) 1141 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:48:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:34.506518+0000 mgr.smithi067.rdualw (mgr.24569) 4865 : cluster [DBG] pgmap v4192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:48:35.189394+0000 mon.smithi067 (mon.1) 761 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:48:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:48:35.189706+0000 mon.smithi067 (mon.1) 762 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:48:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:48:35.189814+0000 mon.smithi061 (mon.0) 1140 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:48:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:48:35.190130+0000 mon.smithi061 (mon.0) 1141 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:48:37.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:36.507397+0000 mgr.smithi067.rdualw (mgr.24569) 4866 : cluster [DBG] pgmap v4193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:48:38.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:36.507397+0000 mgr.smithi067.rdualw (mgr.24569) 4866 : cluster [DBG] pgmap v4193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:48:39.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:38.508120+0000 mgr.smithi067.rdualw (mgr.24569) 4867 : cluster [DBG] pgmap v4194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:38.508120+0000 mgr.smithi067.rdualw (mgr.24569) 4867 : cluster [DBG] pgmap v4194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:40.509115+0000 mgr.smithi067.rdualw (mgr.24569) 4868 : cluster [DBG] pgmap v4195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:40.509115+0000 mgr.smithi067.rdualw (mgr.24569) 4868 : cluster [DBG] pgmap v4195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:44.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:42.509841+0000 mgr.smithi067.rdualw (mgr.24569) 4869 : cluster [DBG] pgmap v4196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:44.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:42.509841+0000 mgr.smithi067.rdualw (mgr.24569) 4869 : cluster [DBG] pgmap v4196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:46.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:44.510492+0000 mgr.smithi067.rdualw (mgr.24569) 4870 : cluster [DBG] pgmap v4197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:44.510492+0000 mgr.smithi067.rdualw (mgr.24569) 4870 : cluster [DBG] pgmap v4197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:48.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:46.511416+0000 mgr.smithi067.rdualw (mgr.24569) 4871 : cluster [DBG] pgmap v4198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:48:48.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:46.511416+0000 mgr.smithi067.rdualw (mgr.24569) 4871 : cluster [DBG] pgmap v4198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:48:50.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:48.512127+0000 mgr.smithi067.rdualw (mgr.24569) 4872 : cluster [DBG] pgmap v4199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:50.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:48.512127+0000 mgr.smithi067.rdualw (mgr.24569) 4872 : cluster [DBG] pgmap v4199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:50.512982+0000 mgr.smithi067.rdualw (mgr.24569) 4873 : cluster [DBG] pgmap v4200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:50.512982+0000 mgr.smithi067.rdualw (mgr.24569) 4873 : cluster [DBG] pgmap v4200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:54.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:52.513509+0000 mgr.smithi067.rdualw (mgr.24569) 4874 : cluster [DBG] pgmap v4201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:54.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:52.513509+0000 mgr.smithi067.rdualw (mgr.24569) 4874 : cluster [DBG] pgmap v4201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:56.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:54.514196+0000 mgr.smithi067.rdualw (mgr.24569) 4875 : cluster [DBG] pgmap v4202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:56.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:54.514196+0000 mgr.smithi067.rdualw (mgr.24569) 4875 : cluster [DBG] pgmap v4202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:48:56.188 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:48:56.485 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:48:56.486 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 5m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:48:56.486 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 5m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:48:56.486 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 5m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:48:56.486 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 5m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:48:56.487 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 5m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:48:56.487 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 5m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:48:56.487 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 5m ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:48:56.487 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 5m ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:48:56.488 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 5m ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:48:56.488 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 5m ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:48:56.488 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 5m ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:48:56.488 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 5m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:48:56.488 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 5m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:48:56.489 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 5m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:48:56.489 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 5m ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:48:56.489 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 5m ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:48:56.489 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 5m ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:48:56.490 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 5m ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:48:56.490 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 5m ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:48:56.490 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 5m ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:48:56.490 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 5m ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:48:56.490 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 5m ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:48:56.491 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 5m ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:48:56.831 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:48:56.831 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:48:56.832 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:48:56.832 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:48:56.832 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:48:56.832 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:48:56.833 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:48:56.833 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:48:56.833 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:48:56.833 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:48:56.834 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:48:56.834 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:48:56.834 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:48:56.834 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:48:56.835 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:48:56.835 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:48:56.835 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:48:56.835 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:48:56.836 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:48:57.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:48:56.173488+0000 mgr.smithi067.rdualw (mgr.24569) 4876 : audit [DBG] from='client.37390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:48:57.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:48:56.173488+0000 mgr.smithi067.rdualw (mgr.24569) 4876 : audit [DBG] from='client.37390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:48:58.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:48:56.469152+0000 mgr.smithi067.rdualw (mgr.24569) 4877 : audit [DBG] from='client.37394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:48:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:56.515015+0000 mgr.smithi067.rdualw (mgr.24569) 4878 : cluster [DBG] pgmap v4203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:48:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:48:56.830581+0000 mon.smithi061 (mon.0) 1142 : audit [DBG] from='client.? 172.21.15.61:0/3752528012' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:48:58.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:48:56.469152+0000 mgr.smithi067.rdualw (mgr.24569) 4877 : audit [DBG] from='client.37394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:48:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:56.515015+0000 mgr.smithi067.rdualw (mgr.24569) 4878 : cluster [DBG] pgmap v4203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:48:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:48:56.830581+0000 mon.smithi061 (mon.0) 1142 : audit [DBG] from='client.? 172.21.15.61:0/3752528012' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:49:00.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:48:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:48:58.515430+0000 mgr.smithi067.rdualw (mgr.24569) 4879 : cluster [DBG] pgmap v4204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:00.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:48:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:48:58.515430+0000 mgr.smithi067.rdualw (mgr.24569) 4879 : cluster [DBG] pgmap v4204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:00.516495+0000 mgr.smithi067.rdualw (mgr.24569) 4880 : cluster [DBG] pgmap v4205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:00.516495+0000 mgr.smithi067.rdualw (mgr.24569) 4880 : cluster [DBG] pgmap v4205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:04.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:02.517118+0000 mgr.smithi067.rdualw (mgr.24569) 4881 : cluster [DBG] pgmap v4206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:04.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:02.517118+0000 mgr.smithi067.rdualw (mgr.24569) 4881 : cluster [DBG] pgmap v4206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:06.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:04.517784+0000 mgr.smithi067.rdualw (mgr.24569) 4882 : cluster [DBG] pgmap v4207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:06.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:04.517784+0000 mgr.smithi067.rdualw (mgr.24569) 4882 : cluster [DBG] pgmap v4207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:08.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:06.518724+0000 mgr.smithi067.rdualw (mgr.24569) 4883 : cluster [DBG] pgmap v4208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:49:08.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:06.518724+0000 mgr.smithi067.rdualw (mgr.24569) 4883 : cluster [DBG] pgmap v4208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:49:10.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:08.519168+0000 mgr.smithi067.rdualw (mgr.24569) 4884 : cluster [DBG] pgmap v4209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:10.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:08.519168+0000 mgr.smithi067.rdualw (mgr.24569) 4884 : cluster [DBG] pgmap v4209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:10.520248+0000 mgr.smithi067.rdualw (mgr.24569) 4885 : cluster [DBG] pgmap v4210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:49:11.155120+0000 mon.smithi067 (mon.1) 763 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:49:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:49:11.156666+0000 mon.smithi067 (mon.1) 764 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:49:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:49:11.157634+0000 mon.smithi067 (mon.1) 765 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:49:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:49:11.158485+0000 mgr.smithi067.rdualw (mgr.24569) 4886 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:49:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:49:11.572987+0000 mon.smithi061 (mon.0) 1143 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:49:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:49:11.578395+0000 mon.smithi061 (mon.0) 1144 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:49:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:10.520248+0000 mgr.smithi067.rdualw (mgr.24569) 4885 : cluster [DBG] pgmap v4210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:49:11.155120+0000 mon.smithi067 (mon.1) 763 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:49:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:49:11.156666+0000 mon.smithi067 (mon.1) 764 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:49:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:49:11.157634+0000 mon.smithi067 (mon.1) 765 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:49:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:49:11.158485+0000 mgr.smithi067.rdualw (mgr.24569) 4886 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:49:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:49:11.572987+0000 mon.smithi061 (mon.0) 1143 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:49:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:49:11.578395+0000 mon.smithi061 (mon.0) 1144 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:49:14.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:12.520849+0000 mgr.smithi067.rdualw (mgr.24569) 4887 : cluster [DBG] pgmap v4211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:14.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:12.520849+0000 mgr.smithi067.rdualw (mgr.24569) 4887 : cluster [DBG] pgmap v4211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:14.521654+0000 mgr.smithi067.rdualw (mgr.24569) 4888 : cluster [DBG] pgmap v4212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:16.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:14.521654+0000 mgr.smithi067.rdualw (mgr.24569) 4888 : cluster [DBG] pgmap v4212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:18.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:16.522609+0000 mgr.smithi067.rdualw (mgr.24569) 4889 : cluster [DBG] pgmap v4213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:49:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:16.522609+0000 mgr.smithi067.rdualw (mgr.24569) 4889 : cluster [DBG] pgmap v4213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:49:20.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:18.523264+0000 mgr.smithi067.rdualw (mgr.24569) 4890 : cluster [DBG] pgmap v4214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:20.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:18.523264+0000 mgr.smithi067.rdualw (mgr.24569) 4890 : cluster [DBG] pgmap v4214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:20.524290+0000 mgr.smithi067.rdualw (mgr.24569) 4891 : cluster [DBG] pgmap v4215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:20.524290+0000 mgr.smithi067.rdualw (mgr.24569) 4891 : cluster [DBG] pgmap v4215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:24.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:22.525045+0000 mgr.smithi067.rdualw (mgr.24569) 4892 : cluster [DBG] pgmap v4216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:24.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:22.525045+0000 mgr.smithi067.rdualw (mgr.24569) 4892 : cluster [DBG] pgmap v4216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:26.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:24.525854+0000 mgr.smithi067.rdualw (mgr.24569) 4893 : cluster [DBG] pgmap v4217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:26.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:24.525854+0000 mgr.smithi067.rdualw (mgr.24569) 4893 : cluster [DBG] pgmap v4217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:27.140 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:49:27.429 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:49:27.429 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 6m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:49:27.429 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 6m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:49:27.430 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 6m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:49:27.430 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 6m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:49:27.430 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 6m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:49:27.430 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 6m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:49:27.431 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 6m ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:49:27.431 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 6m ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:49:27.431 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 6m ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:49:27.431 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 6m ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:49:27.432 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 6m ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:49:27.432 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 6m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:49:27.432 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 6m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:49:27.432 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 6m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:49:27.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 6m ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:49:27.433 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 6m ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:49:27.433 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 6m ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:49:27.433 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 6m ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:49:27.433 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 6m ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:49:27.434 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 6m ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:49:27.434 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 6m ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:49:27.434 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 6m ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:49:27.434 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 6m ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:49:27.777 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:49:27.777 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:49:27.778 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:49:27.778 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:49:27.778 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:49:27.778 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:49:27.779 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:49:27.779 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:49:27.779 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:49:27.779 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:49:27.780 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:49:27.780 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:49:27.780 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:49:27.780 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:49:27.781 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:49:27.781 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:49:27.781 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:49:27.781 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:49:27.781 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:49:28.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:26.526893+0000 mgr.smithi067.rdualw (mgr.24569) 4894 : cluster [DBG] pgmap v4218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:49:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:49:27.127608+0000 mgr.smithi067.rdualw (mgr.24569) 4895 : audit [DBG] from='client.37402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:49:28.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:26.526893+0000 mgr.smithi067.rdualw (mgr.24569) 4894 : cluster [DBG] pgmap v4218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:49:28.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:49:27.127608+0000 mgr.smithi067.rdualw (mgr.24569) 4895 : audit [DBG] from='client.37402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:49:29.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:49:27.412721+0000 mgr.smithi067.rdualw (mgr.24569) 4896 : audit [DBG] from='client.37406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:49:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:49:27.777130+0000 mon.smithi061 (mon.0) 1145 : audit [DBG] from='client.? 172.21.15.61:0/2601673299' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:49:29.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:49:27.412721+0000 mgr.smithi067.rdualw (mgr.24569) 4896 : audit [DBG] from='client.37406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:49:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:49:27.777130+0000 mon.smithi061 (mon.0) 1145 : audit [DBG] from='client.? 172.21.15.61:0/2601673299' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:49:30.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:28.527512+0000 mgr.smithi067.rdualw (mgr.24569) 4897 : cluster [DBG] pgmap v4219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:30.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:28.527512+0000 mgr.smithi067.rdualw (mgr.24569) 4897 : cluster [DBG] pgmap v4219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:31.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:30.528306+0000 mgr.smithi067.rdualw (mgr.24569) 4898 : cluster [DBG] pgmap v4220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:31.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:30.528306+0000 mgr.smithi067.rdualw (mgr.24569) 4898 : cluster [DBG] pgmap v4220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:33.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:32.528968+0000 mgr.smithi067.rdualw (mgr.24569) 4899 : cluster [DBG] pgmap v4221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:33.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:32.528968+0000 mgr.smithi067.rdualw (mgr.24569) 4899 : cluster [DBG] pgmap v4221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:34.529615+0000 mgr.smithi067.rdualw (mgr.24569) 4900 : cluster [DBG] pgmap v4222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:49:35.195439+0000 mon.smithi067 (mon.1) 766 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:49:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:49:35.195772+0000 mon.smithi067 (mon.1) 767 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:49:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:49:35.196102+0000 mon.smithi061 (mon.0) 1146 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:49:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:49:35.196455+0000 mon.smithi061 (mon.0) 1147 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:49:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:34.529615+0000 mgr.smithi067.rdualw (mgr.24569) 4900 : cluster [DBG] pgmap v4222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:49:35.195439+0000 mon.smithi067 (mon.1) 766 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:49:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:49:35.195772+0000 mon.smithi067 (mon.1) 767 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:49:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:49:35.196102+0000 mon.smithi061 (mon.0) 1146 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:49:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:49:35.196455+0000 mon.smithi061 (mon.0) 1147 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:49:37.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:36.530398+0000 mgr.smithi067.rdualw (mgr.24569) 4901 : cluster [DBG] pgmap v4223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:49:37.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:36.530398+0000 mgr.smithi067.rdualw (mgr.24569) 4901 : cluster [DBG] pgmap v4223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:49:39.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:38.530954+0000 mgr.smithi067.rdualw (mgr.24569) 4902 : cluster [DBG] pgmap v4224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:39.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:38.530954+0000 mgr.smithi067.rdualw (mgr.24569) 4902 : cluster [DBG] pgmap v4224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:41.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:40.531750+0000 mgr.smithi067.rdualw (mgr.24569) 4903 : cluster [DBG] pgmap v4225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:41.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:40.531750+0000 mgr.smithi067.rdualw (mgr.24569) 4903 : cluster [DBG] pgmap v4225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:43.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:42.532222+0000 mgr.smithi067.rdualw (mgr.24569) 4904 : cluster [DBG] pgmap v4226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:43.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:42.532222+0000 mgr.smithi067.rdualw (mgr.24569) 4904 : cluster [DBG] pgmap v4226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:45.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:44.532799+0000 mgr.smithi067.rdualw (mgr.24569) 4905 : cluster [DBG] pgmap v4227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:45.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:44.532799+0000 mgr.smithi067.rdualw (mgr.24569) 4905 : cluster [DBG] pgmap v4227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:47.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:46.533699+0000 mgr.smithi067.rdualw (mgr.24569) 4906 : cluster [DBG] pgmap v4228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:49:47.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:46.533699+0000 mgr.smithi067.rdualw (mgr.24569) 4906 : cluster [DBG] pgmap v4228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:49:49.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:48.534285+0000 mgr.smithi067.rdualw (mgr.24569) 4907 : cluster [DBG] pgmap v4229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:49.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:48.534285+0000 mgr.smithi067.rdualw (mgr.24569) 4907 : cluster [DBG] pgmap v4229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:51.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:50.535062+0000 mgr.smithi067.rdualw (mgr.24569) 4908 : cluster [DBG] pgmap v4230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:51.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:50.535062+0000 mgr.smithi067.rdualw (mgr.24569) 4908 : cluster [DBG] pgmap v4230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:54.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:52.535700+0000 mgr.smithi067.rdualw (mgr.24569) 4909 : cluster [DBG] pgmap v4231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:54.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:52.535700+0000 mgr.smithi067.rdualw (mgr.24569) 4909 : cluster [DBG] pgmap v4231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:56.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:54.536412+0000 mgr.smithi067.rdualw (mgr.24569) 4910 : cluster [DBG] pgmap v4232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:56.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:54.536412+0000 mgr.smithi067.rdualw (mgr.24569) 4910 : cluster [DBG] pgmap v4232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:49:58.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:56.537464+0000 mgr.smithi067.rdualw (mgr.24569) 4911 : cluster [DBG] pgmap v4233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:49:58.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:56.537464+0000 mgr.smithi067.rdualw (mgr.24569) 4911 : cluster [DBG] pgmap v4233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:49:58.084 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:49:58.378 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:49:58.378 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 6m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:49:58.378 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 6m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:49:58.379 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 6m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:49:58.379 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 6m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:49:58.379 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 6m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:49:58.379 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 6m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:49:58.380 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 6m ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:49:58.380 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 6m ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:49:58.380 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 6m ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:49:58.380 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 6m ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:49:58.380 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 6m ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:49:58.381 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 6m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:49:58.381 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 6m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:49:58.381 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 6m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:49:58.381 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 6m ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:49:58.382 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 6m ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:49:58.382 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 6m ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:49:58.382 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 6m ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:49:58.382 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 6m ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:49:58.383 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 6m ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:49:58.383 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 6m ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:49:58.383 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 6m ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:49:58.383 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 6m ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:49:58.724 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:49:58.724 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:49:58.724 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:49:58.725 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:49:58.725 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:49:58.725 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:49:58.725 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:49:58.726 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:49:58.726 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:49:58.726 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:49:58.726 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:49:58.727 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:49:58.727 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:49:58.727 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:49:58.727 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:49:58.728 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:49:58.728 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:49:58.728 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:49:58.729 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:49:59.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:49:58.071800+0000 mgr.smithi067.rdualw (mgr.24569) 4912 : audit [DBG] from='client.37414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:49:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:49:58.360886+0000 mgr.smithi067.rdualw (mgr.24569) 4913 : audit [DBG] from='client.37418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:49:59.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:49:58.071800+0000 mgr.smithi067.rdualw (mgr.24569) 4912 : audit [DBG] from='client.37414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:49:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:49:58.360886+0000 mgr.smithi067.rdualw (mgr.24569) 4913 : audit [DBG] from='client.37418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:50:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:49:58.538029+0000 mgr.smithi067.rdualw (mgr.24569) 4914 : cluster [DBG] pgmap v4234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:49:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:49:58.723675+0000 mon.smithi061 (mon.0) 1148 : audit [DBG] from='client.? 172.21.15.61:0/4112542242' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:50:00.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:49:58.538029+0000 mgr.smithi067.rdualw (mgr.24569) 4914 : cluster [DBG] pgmap v4234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:00.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:49:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:49:58.723675+0000 mon.smithi061 (mon.0) 1148 : audit [DBG] from='client.? 172.21.15.61:0/4112542242' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:50:01.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:00.000105+0000 mon.smithi061 (mon.0) 1149 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T17:50:01.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:00.000105+0000 mon.smithi061 (mon.0) 1149 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T17:50:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:00.538849+0000 mgr.smithi067.rdualw (mgr.24569) 4915 : cluster [DBG] pgmap v4235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:00.538849+0000 mgr.smithi067.rdualw (mgr.24569) 4915 : cluster [DBG] pgmap v4235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:04.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:02.539473+0000 mgr.smithi067.rdualw (mgr.24569) 4916 : cluster [DBG] pgmap v4236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:04.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:02.539473+0000 mgr.smithi067.rdualw (mgr.24569) 4916 : cluster [DBG] pgmap v4236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:06.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:04.540052+0000 mgr.smithi067.rdualw (mgr.24569) 4917 : cluster [DBG] pgmap v4237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:06.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:04.540052+0000 mgr.smithi067.rdualw (mgr.24569) 4917 : cluster [DBG] pgmap v4237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:08.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:06.540896+0000 mgr.smithi067.rdualw (mgr.24569) 4918 : cluster [DBG] pgmap v4238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:50:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:06.540896+0000 mgr.smithi067.rdualw (mgr.24569) 4918 : cluster [DBG] pgmap v4238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:50:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:08.541342+0000 mgr.smithi067.rdualw (mgr.24569) 4919 : cluster [DBG] pgmap v4239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:10.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:08.541342+0000 mgr.smithi067.rdualw (mgr.24569) 4919 : cluster [DBG] pgmap v4239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:11.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:10.542199+0000 mgr.smithi067.rdualw (mgr.24569) 4920 : cluster [DBG] pgmap v4240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:11.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:10.542199+0000 mgr.smithi067.rdualw (mgr.24569) 4920 : cluster [DBG] pgmap v4240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:50:11.581838+0000 mon.smithi067 (mon.1) 768 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:50:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:50:11.583389+0000 mon.smithi067 (mon.1) 769 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:50:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:50:11.584330+0000 mon.smithi067 (mon.1) 770 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:50:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:50:11.585200+0000 mgr.smithi067.rdualw (mgr.24569) 4921 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:50:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:50:11.989737+0000 mon.smithi061 (mon.0) 1150 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:50:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:50:11.995186+0000 mon.smithi061 (mon.0) 1151 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:50:12.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:50:11.581838+0000 mon.smithi067 (mon.1) 768 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:50:12.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:50:11.583389+0000 mon.smithi067 (mon.1) 769 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:50:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:50:11.584330+0000 mon.smithi067 (mon.1) 770 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:50:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:50:11.585200+0000 mgr.smithi067.rdualw (mgr.24569) 4921 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:50:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:50:11.989737+0000 mon.smithi061 (mon.0) 1150 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:50:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:50:11.995186+0000 mon.smithi061 (mon.0) 1151 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:50:13.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:12.542619+0000 mgr.smithi067.rdualw (mgr.24569) 4922 : cluster [DBG] pgmap v4241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:13.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:12.542619+0000 mgr.smithi067.rdualw (mgr.24569) 4922 : cluster [DBG] pgmap v4241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:16.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:14.543186+0000 mgr.smithi067.rdualw (mgr.24569) 4923 : cluster [DBG] pgmap v4242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:16.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:14.543186+0000 mgr.smithi067.rdualw (mgr.24569) 4923 : cluster [DBG] pgmap v4242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:18.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:16.544053+0000 mgr.smithi067.rdualw (mgr.24569) 4924 : cluster [DBG] pgmap v4243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:50:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:16.544053+0000 mgr.smithi067.rdualw (mgr.24569) 4924 : cluster [DBG] pgmap v4243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:50:20.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:18.544623+0000 mgr.smithi067.rdualw (mgr.24569) 4925 : cluster [DBG] pgmap v4244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:20.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:18.544623+0000 mgr.smithi067.rdualw (mgr.24569) 4925 : cluster [DBG] pgmap v4244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:21.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:20.545445+0000 mgr.smithi067.rdualw (mgr.24569) 4926 : cluster [DBG] pgmap v4245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:21.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:20.545445+0000 mgr.smithi067.rdualw (mgr.24569) 4926 : cluster [DBG] pgmap v4245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:24.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:22.546003+0000 mgr.smithi067.rdualw (mgr.24569) 4927 : cluster [DBG] pgmap v4246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:24.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:22.546003+0000 mgr.smithi067.rdualw (mgr.24569) 4927 : cluster [DBG] pgmap v4246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:26.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:24.546651+0000 mgr.smithi067.rdualw (mgr.24569) 4928 : cluster [DBG] pgmap v4247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:26.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:24.546651+0000 mgr.smithi067.rdualw (mgr.24569) 4928 : cluster [DBG] pgmap v4247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:28.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:26.547673+0000 mgr.smithi067.rdualw (mgr.24569) 4929 : cluster [DBG] pgmap v4248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:50:28.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:26.547673+0000 mgr.smithi067.rdualw (mgr.24569) 4929 : cluster [DBG] pgmap v4248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:50:29.033 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:50:29.325 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:50:29.325 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 7m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:50:29.326 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 7m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:50:29.326 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 7m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:50:29.326 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 7m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:50:29.326 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 7m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:50:29.327 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 7m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:50:29.327 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 7m ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:50:29.327 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 7m ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:50:29.327 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 7m ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:50:29.327 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 7m ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:50:29.328 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 7m ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:50:29.328 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 7m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:50:29.328 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 7m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:50:29.328 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 7m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:50:29.329 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 7m ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:50:29.329 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 7m ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:50:29.329 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 7m ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:50:29.329 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 7m ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:50:29.329 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 7m ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:50:29.330 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 7m ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:50:29.330 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 7m ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:50:29.330 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 7m ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:50:29.330 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 7m ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:50:29.667 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:50:29.667 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:50:29.668 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:50:29.668 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:50:29.668 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:50:29.668 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:50:29.668 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:50:29.669 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:50:29.669 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:50:29.669 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:50:29.670 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:50:29.670 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:50:29.670 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:50:29.670 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:50:29.671 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:50:29.671 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:50:29.671 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:50:29.671 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:50:29.671 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:50:30.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:28.548156+0000 mgr.smithi067.rdualw (mgr.24569) 4930 : cluster [DBG] pgmap v4249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:30.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:50:29.020502+0000 mgr.smithi067.rdualw (mgr.24569) 4931 : audit [DBG] from='client.37426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:50:30.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:50:29.308577+0000 mgr.smithi067.rdualw (mgr.24569) 4932 : audit [DBG] from='client.37430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:50:30.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:28.548156+0000 mgr.smithi067.rdualw (mgr.24569) 4930 : cluster [DBG] pgmap v4249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:30.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:50:29.020502+0000 mgr.smithi067.rdualw (mgr.24569) 4931 : audit [DBG] from='client.37426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:50:30.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:50:29.308577+0000 mgr.smithi067.rdualw (mgr.24569) 4932 : audit [DBG] from='client.37430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:50:31.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:50:29.666912+0000 mon.smithi061 (mon.0) 1152 : audit [DBG] from='client.? 172.21.15.61:0/3224645701' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:50:31.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:50:29.666912+0000 mon.smithi061 (mon.0) 1152 : audit [DBG] from='client.? 172.21.15.61:0/3224645701' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:50:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:30.549075+0000 mgr.smithi067.rdualw (mgr.24569) 4933 : cluster [DBG] pgmap v4250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:30.549075+0000 mgr.smithi067.rdualw (mgr.24569) 4933 : cluster [DBG] pgmap v4250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:34.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:32.549743+0000 mgr.smithi067.rdualw (mgr.24569) 4934 : cluster [DBG] pgmap v4251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:34.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:32.549743+0000 mgr.smithi067.rdualw (mgr.24569) 4934 : cluster [DBG] pgmap v4251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:34.550316+0000 mgr.smithi067.rdualw (mgr.24569) 4935 : cluster [DBG] pgmap v4252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:50:35.201366+0000 mon.smithi067 (mon.1) 771 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:50:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:50:35.201756+0000 mon.smithi067 (mon.1) 772 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:50:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:50:35.201801+0000 mon.smithi061 (mon.0) 1153 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:50:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:50:35.202179+0000 mon.smithi061 (mon.0) 1154 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:50:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:34.550316+0000 mgr.smithi067.rdualw (mgr.24569) 4935 : cluster [DBG] pgmap v4252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:50:35.201366+0000 mon.smithi067 (mon.1) 771 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:50:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:50:35.201756+0000 mon.smithi067 (mon.1) 772 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:50:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:50:35.201801+0000 mon.smithi061 (mon.0) 1153 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:50:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:50:35.202179+0000 mon.smithi061 (mon.0) 1154 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:50:38.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:36.551129+0000 mgr.smithi067.rdualw (mgr.24569) 4936 : cluster [DBG] pgmap v4253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:50:38.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:36.551129+0000 mgr.smithi067.rdualw (mgr.24569) 4936 : cluster [DBG] pgmap v4253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:50:40.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:38.551740+0000 mgr.smithi067.rdualw (mgr.24569) 4937 : cluster [DBG] pgmap v4254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:40.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:38.551740+0000 mgr.smithi067.rdualw (mgr.24569) 4937 : cluster [DBG] pgmap v4254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:41.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:40.552548+0000 mgr.smithi067.rdualw (mgr.24569) 4938 : cluster [DBG] pgmap v4255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:40.552548+0000 mgr.smithi067.rdualw (mgr.24569) 4938 : cluster [DBG] pgmap v4255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:44.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:42.553059+0000 mgr.smithi067.rdualw (mgr.24569) 4939 : cluster [DBG] pgmap v4256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:44.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:42.553059+0000 mgr.smithi067.rdualw (mgr.24569) 4939 : cluster [DBG] pgmap v4256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:46.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:44.553650+0000 mgr.smithi067.rdualw (mgr.24569) 4940 : cluster [DBG] pgmap v4257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:46.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:44.553650+0000 mgr.smithi067.rdualw (mgr.24569) 4940 : cluster [DBG] pgmap v4257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:48.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:46.554497+0000 mgr.smithi067.rdualw (mgr.24569) 4941 : cluster [DBG] pgmap v4258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:50:48.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:46.554497+0000 mgr.smithi067.rdualw (mgr.24569) 4941 : cluster [DBG] pgmap v4258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:50:50.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:48.555052+0000 mgr.smithi067.rdualw (mgr.24569) 4942 : cluster [DBG] pgmap v4259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:50.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:48.555052+0000 mgr.smithi067.rdualw (mgr.24569) 4942 : cluster [DBG] pgmap v4259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:51.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:50.556016+0000 mgr.smithi067.rdualw (mgr.24569) 4943 : cluster [DBG] pgmap v4260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:50.556016+0000 mgr.smithi067.rdualw (mgr.24569) 4943 : cluster [DBG] pgmap v4260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:54.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:52.556562+0000 mgr.smithi067.rdualw (mgr.24569) 4944 : cluster [DBG] pgmap v4261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:54.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:52.556562+0000 mgr.smithi067.rdualw (mgr.24569) 4944 : cluster [DBG] pgmap v4261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:56.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:54.557160+0000 mgr.smithi067.rdualw (mgr.24569) 4945 : cluster [DBG] pgmap v4262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:56.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:54.557160+0000 mgr.smithi067.rdualw (mgr.24569) 4945 : cluster [DBG] pgmap v4262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:50:58.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:56.558081+0000 mgr.smithi067.rdualw (mgr.24569) 4946 : cluster [DBG] pgmap v4263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:50:58.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:56.558081+0000 mgr.smithi067.rdualw (mgr.24569) 4946 : cluster [DBG] pgmap v4263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:50:59.976 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:51:00.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:50:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:50:58.558777+0000 mgr.smithi067.rdualw (mgr.24569) 4947 : cluster [DBG] pgmap v4264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:00.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:50:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:50:58.558777+0000 mgr.smithi067.rdualw (mgr.24569) 4947 : cluster [DBG] pgmap v4264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:00.266 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:51:00.267 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 7m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:51:00.267 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 7m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:51:00.267 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 7m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:51:00.268 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 7m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:51:00.268 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 7m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:51:00.268 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 7m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:51:00.268 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 7m ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:51:00.269 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 7m ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:51:00.269 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 7m ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:51:00.269 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 7m ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:51:00.269 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 7m ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:51:00.269 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 7m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:51:00.270 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 7m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:51:00.270 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 7m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:51:00.270 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 7m ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:51:00.271 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 7m ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:51:00.271 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 7m ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:51:00.271 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 7m ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:51:00.272 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 7m ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:51:00.273 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 7m ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:51:00.273 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 7m ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:51:00.273 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 7m ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:51:00.274 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 7m ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:51:00.608 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:51:00.609 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:51:00.609 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:51:00.609 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:51:00.610 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:51:00.610 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:51:00.610 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:51:00.610 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:51:00.611 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:51:00.611 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:51:00.611 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:51:00.611 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:51:00.611 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:51:00.612 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:51:00.612 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:51:00.612 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:51:00.612 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:51:00.613 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:51:00.613 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:51:01.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:50:59.963569+0000 mgr.smithi067.rdualw (mgr.24569) 4948 : audit [DBG] from='client.37438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:51:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:51:00.250628+0000 mgr.smithi067.rdualw (mgr.24569) 4949 : audit [DBG] from='client.37442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:51:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:51:00.608501+0000 mon.smithi061 (mon.0) 1155 : audit [DBG] from='client.? 172.21.15.61:0/4016606153' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:51:01.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:50:59.963569+0000 mgr.smithi067.rdualw (mgr.24569) 4948 : audit [DBG] from='client.37438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:51:01.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:51:00.250628+0000 mgr.smithi067.rdualw (mgr.24569) 4949 : audit [DBG] from='client.37442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:51:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:51:00.608501+0000 mon.smithi061 (mon.0) 1155 : audit [DBG] from='client.? 172.21.15.61:0/4016606153' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:51:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:00.559633+0000 mgr.smithi067.rdualw (mgr.24569) 4950 : cluster [DBG] pgmap v4265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:00.559633+0000 mgr.smithi067.rdualw (mgr.24569) 4950 : cluster [DBG] pgmap v4265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:04.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:02.560376+0000 mgr.smithi067.rdualw (mgr.24569) 4951 : cluster [DBG] pgmap v4266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:04.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:02.560376+0000 mgr.smithi067.rdualw (mgr.24569) 4951 : cluster [DBG] pgmap v4266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:06.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:04.561177+0000 mgr.smithi067.rdualw (mgr.24569) 4952 : cluster [DBG] pgmap v4267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:06.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:04.561177+0000 mgr.smithi067.rdualw (mgr.24569) 4952 : cluster [DBG] pgmap v4267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:08.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:06.562050+0000 mgr.smithi067.rdualw (mgr.24569) 4953 : cluster [DBG] pgmap v4268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:51:08.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:06.562050+0000 mgr.smithi067.rdualw (mgr.24569) 4953 : cluster [DBG] pgmap v4268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:51:10.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:08.562697+0000 mgr.smithi067.rdualw (mgr.24569) 4954 : cluster [DBG] pgmap v4269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:10.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:08.562697+0000 mgr.smithi067.rdualw (mgr.24569) 4954 : cluster [DBG] pgmap v4269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:11.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:10.563837+0000 mgr.smithi067.rdualw (mgr.24569) 4955 : cluster [DBG] pgmap v4270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:10.563837+0000 mgr.smithi067.rdualw (mgr.24569) 4955 : cluster [DBG] pgmap v4270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:12.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:51:11.998878+0000 mon.smithi067 (mon.1) 773 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:51:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:51:12.000461+0000 mon.smithi067 (mon.1) 774 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:51:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:51:12.001446+0000 mon.smithi067 (mon.1) 775 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:51:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:51:12.002332+0000 mgr.smithi067.rdualw (mgr.24569) 4956 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:51:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:51:12.418778+0000 mon.smithi061 (mon.0) 1156 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:51:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:51:12.424607+0000 mon.smithi061 (mon.0) 1157 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:51:13.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:51:11.998878+0000 mon.smithi067 (mon.1) 773 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:51:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:51:12.000461+0000 mon.smithi067 (mon.1) 774 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:51:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:51:12.001446+0000 mon.smithi067 (mon.1) 775 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:51:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:51:12.002332+0000 mgr.smithi067.rdualw (mgr.24569) 4956 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:51:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:51:12.418778+0000 mon.smithi061 (mon.0) 1156 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:51:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:51:12.424607+0000 mon.smithi061 (mon.0) 1157 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:51:14.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:12.564244+0000 mgr.smithi067.rdualw (mgr.24569) 4957 : cluster [DBG] pgmap v4271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:14.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:12.564244+0000 mgr.smithi067.rdualw (mgr.24569) 4957 : cluster [DBG] pgmap v4271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:16.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:14.564822+0000 mgr.smithi067.rdualw (mgr.24569) 4958 : cluster [DBG] pgmap v4272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:16.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:14.564822+0000 mgr.smithi067.rdualw (mgr.24569) 4958 : cluster [DBG] pgmap v4272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:18.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:16.565781+0000 mgr.smithi067.rdualw (mgr.24569) 4959 : cluster [DBG] pgmap v4273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:51:18.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:16.565781+0000 mgr.smithi067.rdualw (mgr.24569) 4959 : cluster [DBG] pgmap v4273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:51:20.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:18.566301+0000 mgr.smithi067.rdualw (mgr.24569) 4960 : cluster [DBG] pgmap v4274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:20.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:18.566301+0000 mgr.smithi067.rdualw (mgr.24569) 4960 : cluster [DBG] pgmap v4274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:21.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:20.567303+0000 mgr.smithi067.rdualw (mgr.24569) 4961 : cluster [DBG] pgmap v4275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:20.567303+0000 mgr.smithi067.rdualw (mgr.24569) 4961 : cluster [DBG] pgmap v4275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:24.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:22.567882+0000 mgr.smithi067.rdualw (mgr.24569) 4962 : cluster [DBG] pgmap v4276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:24.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:22.567882+0000 mgr.smithi067.rdualw (mgr.24569) 4962 : cluster [DBG] pgmap v4276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:26.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:24.568574+0000 mgr.smithi067.rdualw (mgr.24569) 4963 : cluster [DBG] pgmap v4277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:26.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:24.568574+0000 mgr.smithi067.rdualw (mgr.24569) 4963 : cluster [DBG] pgmap v4277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:28.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:26.569598+0000 mgr.smithi067.rdualw (mgr.24569) 4964 : cluster [DBG] pgmap v4278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:51:28.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:26.569598+0000 mgr.smithi067.rdualw (mgr.24569) 4964 : cluster [DBG] pgmap v4278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:51:30.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:28.570042+0000 mgr.smithi067.rdualw (mgr.24569) 4965 : cluster [DBG] pgmap v4279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:30.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:28.570042+0000 mgr.smithi067.rdualw (mgr.24569) 4965 : cluster [DBG] pgmap v4279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:30.947 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:51:31.238 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:51:31.238 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 8m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:51:31.239 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 8m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:51:31.239 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 8m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:51:31.239 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 8m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:51:31.239 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 8m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:51:31.240 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 8m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:51:31.240 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 8m ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:51:31.240 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 8m ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:51:31.240 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 8m ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:51:31.240 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 8m ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:51:31.241 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 8m ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:51:31.241 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 8m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:51:31.241 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 8m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:51:31.241 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 8m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:51:31.242 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 8m ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:51:31.242 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 8m ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:51:31.242 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 8m ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:51:31.242 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 8m ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:51:31.242 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 8m ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:51:31.243 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 8m ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:51:31.243 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 8m ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:51:31.243 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 8m ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:51:31.243 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 8m ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:51:31.657 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:51:31.657 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:51:31.657 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:51:31.658 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:51:31.658 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:51:31.658 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:51:31.658 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:51:31.659 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:51:31.659 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:51:31.659 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:51:31.660 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:51:31.660 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:51:31.660 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:51:31.660 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:51:31.661 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:51:31.661 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:51:31.661 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:51:31.661 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:51:31.662 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:51:31.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:30.571048+0000 mgr.smithi067.rdualw (mgr.24569) 4966 : cluster [DBG] pgmap v4280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:31.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:51:30.934912+0000 mgr.smithi067.rdualw (mgr.24569) 4967 : audit [DBG] from='client.37450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:51:31.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:51:31.221848+0000 mgr.smithi067.rdualw (mgr.24569) 4968 : audit [DBG] from='client.37454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:51:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:30.571048+0000 mgr.smithi067.rdualw (mgr.24569) 4966 : cluster [DBG] pgmap v4280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:51:30.934912+0000 mgr.smithi067.rdualw (mgr.24569) 4967 : audit [DBG] from='client.37450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:51:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:51:31.221848+0000 mgr.smithi067.rdualw (mgr.24569) 4968 : audit [DBG] from='client.37454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:51:32.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:51:31.656838+0000 mon.smithi061 (mon.0) 1158 : audit [DBG] from='client.? 172.21.15.61:0/210868845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:51:33.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:51:31.656838+0000 mon.smithi061 (mon.0) 1158 : audit [DBG] from='client.? 172.21.15.61:0/210868845' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:51:34.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:32.571732+0000 mgr.smithi067.rdualw (mgr.24569) 4969 : cluster [DBG] pgmap v4281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:34.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:32.571732+0000 mgr.smithi067.rdualw (mgr.24569) 4969 : cluster [DBG] pgmap v4281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:34.572313+0000 mgr.smithi067.rdualw (mgr.24569) 4970 : cluster [DBG] pgmap v4282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:51:35.207377+0000 mon.smithi067 (mon.1) 776 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:51:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:51:35.207656+0000 mon.smithi067 (mon.1) 777 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:51:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:51:35.207774+0000 mon.smithi061 (mon.0) 1159 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:51:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:51:35.208064+0000 mon.smithi061 (mon.0) 1160 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:51:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:34.572313+0000 mgr.smithi067.rdualw (mgr.24569) 4970 : cluster [DBG] pgmap v4282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:51:35.207377+0000 mon.smithi067 (mon.1) 776 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:51:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:51:35.207656+0000 mon.smithi067 (mon.1) 777 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:51:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:51:35.207774+0000 mon.smithi061 (mon.0) 1159 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:51:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:51:35.208064+0000 mon.smithi061 (mon.0) 1160 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:51:38.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:36.573223+0000 mgr.smithi067.rdualw (mgr.24569) 4971 : cluster [DBG] pgmap v4283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:51:38.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:36.573223+0000 mgr.smithi067.rdualw (mgr.24569) 4971 : cluster [DBG] pgmap v4283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:51:40.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:38.573984+0000 mgr.smithi067.rdualw (mgr.24569) 4972 : cluster [DBG] pgmap v4284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:40.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:38.573984+0000 mgr.smithi067.rdualw (mgr.24569) 4972 : cluster [DBG] pgmap v4284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:41.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:40.574957+0000 mgr.smithi067.rdualw (mgr.24569) 4973 : cluster [DBG] pgmap v4285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:40.574957+0000 mgr.smithi067.rdualw (mgr.24569) 4973 : cluster [DBG] pgmap v4285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:44.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:42.575484+0000 mgr.smithi067.rdualw (mgr.24569) 4974 : cluster [DBG] pgmap v4286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:44.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:42.575484+0000 mgr.smithi067.rdualw (mgr.24569) 4974 : cluster [DBG] pgmap v4286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:46.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:44.576235+0000 mgr.smithi067.rdualw (mgr.24569) 4975 : cluster [DBG] pgmap v4287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:46.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:44.576235+0000 mgr.smithi067.rdualw (mgr.24569) 4975 : cluster [DBG] pgmap v4287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:48.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:46.577229+0000 mgr.smithi067.rdualw (mgr.24569) 4976 : cluster [DBG] pgmap v4288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:51:48.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:46.577229+0000 mgr.smithi067.rdualw (mgr.24569) 4976 : cluster [DBG] pgmap v4288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:51:50.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:48.577881+0000 mgr.smithi067.rdualw (mgr.24569) 4977 : cluster [DBG] pgmap v4289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:50.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:48.577881+0000 mgr.smithi067.rdualw (mgr.24569) 4977 : cluster [DBG] pgmap v4289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:51.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:50.579017+0000 mgr.smithi067.rdualw (mgr.24569) 4978 : cluster [DBG] pgmap v4290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:50.579017+0000 mgr.smithi067.rdualw (mgr.24569) 4978 : cluster [DBG] pgmap v4290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:54.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:52.579742+0000 mgr.smithi067.rdualw (mgr.24569) 4979 : cluster [DBG] pgmap v4291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:54.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:52.579742+0000 mgr.smithi067.rdualw (mgr.24569) 4979 : cluster [DBG] pgmap v4291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:56.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:54.580356+0000 mgr.smithi067.rdualw (mgr.24569) 4980 : cluster [DBG] pgmap v4292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:56.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:54.580356+0000 mgr.smithi067.rdualw (mgr.24569) 4980 : cluster [DBG] pgmap v4292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:51:58.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:56.581141+0000 mgr.smithi067.rdualw (mgr.24569) 4981 : cluster [DBG] pgmap v4293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:51:58.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:56.581141+0000 mgr.smithi067.rdualw (mgr.24569) 4981 : cluster [DBG] pgmap v4293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:52:00.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:51:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:51:58.581897+0000 mgr.smithi067.rdualw (mgr.24569) 4982 : cluster [DBG] pgmap v4294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:51:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:51:58.581897+0000 mgr.smithi067.rdualw (mgr.24569) 4982 : cluster [DBG] pgmap v4294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:00.582903+0000 mgr.smithi067.rdualw (mgr.24569) 4983 : cluster [DBG] pgmap v4295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:01.987 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:52:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:00.582903+0000 mgr.smithi067.rdualw (mgr.24569) 4983 : cluster [DBG] pgmap v4295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:02.283 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:52:02.284 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 8m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:52:02.284 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 8m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:52:02.284 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 8m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:52:02.284 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 8m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:52:02.284 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 8m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:52:02.285 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 8m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:52:02.285 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 8m ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:52:02.285 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 8m ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:52:02.285 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 8m ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:52:02.286 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 8m ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:52:02.286 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 8m ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:52:02.286 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 8m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:52:02.287 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 8m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:52:02.287 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 8m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:52:02.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 8m ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:52:02.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 8m ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:52:02.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 8m ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:52:02.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 8m ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:52:02.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 8m ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:52:02.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 8m ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:52:02.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 8m ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:52:02.289 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 8m ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:52:02.289 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 8m ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:52:02.628 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:52:02.629 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:52:02.629 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:52:02.629 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:52:02.629 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:52:02.630 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:52:02.630 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:52:02.630 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:52:02.630 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:52:02.631 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:52:02.631 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:52:02.632 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:52:02.632 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:52:02.632 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:52:02.632 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:52:02.632 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:52:02.633 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:52:02.633 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:52:02.633 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:52:02.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:52:01.975725+0000 mgr.smithi067.rdualw (mgr.24569) 4984 : audit [DBG] from='client.37462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:52:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:52:02.266302+0000 mgr.smithi067.rdualw (mgr.24569) 4985 : audit [DBG] from='client.37466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:52:03.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:52:01.975725+0000 mgr.smithi067.rdualw (mgr.24569) 4984 : audit [DBG] from='client.37462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:52:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:52:02.266302+0000 mgr.smithi067.rdualw (mgr.24569) 4985 : audit [DBG] from='client.37466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:52:04.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:02.583494+0000 mgr.smithi067.rdualw (mgr.24569) 4986 : cluster [DBG] pgmap v4296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:04.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:52:02.628076+0000 mon.smithi061 (mon.0) 1161 : audit [DBG] from='client.? 172.21.15.61:0/2230348580' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:52:04.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:02.583494+0000 mgr.smithi067.rdualw (mgr.24569) 4986 : cluster [DBG] pgmap v4296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:04.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:52:02.628076+0000 mon.smithi061 (mon.0) 1161 : audit [DBG] from='client.? 172.21.15.61:0/2230348580' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:52:06.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:04.584243+0000 mgr.smithi067.rdualw (mgr.24569) 4987 : cluster [DBG] pgmap v4297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:06.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:04.584243+0000 mgr.smithi067.rdualw (mgr.24569) 4987 : cluster [DBG] pgmap v4297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:08.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:06.585077+0000 mgr.smithi067.rdualw (mgr.24569) 4988 : cluster [DBG] pgmap v4298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:52:08.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:06.585077+0000 mgr.smithi067.rdualw (mgr.24569) 4988 : cluster [DBG] pgmap v4298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:52:10.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:08.585651+0000 mgr.smithi067.rdualw (mgr.24569) 4989 : cluster [DBG] pgmap v4299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:10.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:08.585651+0000 mgr.smithi067.rdualw (mgr.24569) 4989 : cluster [DBG] pgmap v4299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:10.586678+0000 mgr.smithi067.rdualw (mgr.24569) 4990 : cluster [DBG] pgmap v4300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:10.586678+0000 mgr.smithi067.rdualw (mgr.24569) 4990 : cluster [DBG] pgmap v4300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:13.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:52:12.428168+0000 mon.smithi067 (mon.1) 778 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:52:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:52:12.429651+0000 mon.smithi067 (mon.1) 779 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:52:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:52:12.430615+0000 mon.smithi067 (mon.1) 780 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:52:13.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:52:12.428168+0000 mon.smithi067 (mon.1) 778 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:52:13.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:52:12.429651+0000 mon.smithi067 (mon.1) 779 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:52:13.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:52:12.430615+0000 mon.smithi067 (mon.1) 780 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:52:14.110 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:52:12.431462+0000 mgr.smithi067.rdualw (mgr.24569) 4991 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:52:14.341 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:12.587094+0000 mgr.smithi067.rdualw (mgr.24569) 4992 : cluster [DBG] pgmap v4301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:14.341 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:52:12.846700+0000 mon.smithi061 (mon.0) 1162 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:52:14.341 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:52:12.851897+0000 mon.smithi061 (mon.0) 1163 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:52:14.342 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:52:12.431462+0000 mgr.smithi067.rdualw (mgr.24569) 4991 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:52:14.343 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:12.587094+0000 mgr.smithi067.rdualw (mgr.24569) 4992 : cluster [DBG] pgmap v4301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:14.343 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:52:12.846700+0000 mon.smithi061 (mon.0) 1162 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:52:14.343 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:52:12.851897+0000 mon.smithi061 (mon.0) 1163 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:52:16.110 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:14.587779+0000 mgr.smithi067.rdualw (mgr.24569) 4993 : cluster [DBG] pgmap v4302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:16.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:14.587779+0000 mgr.smithi067.rdualw (mgr.24569) 4993 : cluster [DBG] pgmap v4302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:18.110 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:16.588781+0000 mgr.smithi067.rdualw (mgr.24569) 4994 : cluster [DBG] pgmap v4303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:52:18.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:16.588781+0000 mgr.smithi067.rdualw (mgr.24569) 4994 : cluster [DBG] pgmap v4303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:52:20.111 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:18.589370+0000 mgr.smithi067.rdualw (mgr.24569) 4995 : cluster [DBG] pgmap v4304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:20.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:18.589370+0000 mgr.smithi067.rdualw (mgr.24569) 4995 : cluster [DBG] pgmap v4304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:20.590344+0000 mgr.smithi067.rdualw (mgr.24569) 4996 : cluster [DBG] pgmap v4305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:20.590344+0000 mgr.smithi067.rdualw (mgr.24569) 4996 : cluster [DBG] pgmap v4305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:24.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:22.590840+0000 mgr.smithi067.rdualw (mgr.24569) 4997 : cluster [DBG] pgmap v4306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:24.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:22.590840+0000 mgr.smithi067.rdualw (mgr.24569) 4997 : cluster [DBG] pgmap v4306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:26.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:24.591403+0000 mgr.smithi067.rdualw (mgr.24569) 4998 : cluster [DBG] pgmap v4307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:26.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:24.591403+0000 mgr.smithi067.rdualw (mgr.24569) 4998 : cluster [DBG] pgmap v4307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:28.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:26.592311+0000 mgr.smithi067.rdualw (mgr.24569) 4999 : cluster [DBG] pgmap v4308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:52:28.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:26.592311+0000 mgr.smithi067.rdualw (mgr.24569) 4999 : cluster [DBG] pgmap v4308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:52:30.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:28.592845+0000 mgr.smithi067.rdualw (mgr.24569) 5000 : cluster [DBG] pgmap v4309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:30.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:28.592845+0000 mgr.smithi067.rdualw (mgr.24569) 5000 : cluster [DBG] pgmap v4309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:30.593771+0000 mgr.smithi067.rdualw (mgr.24569) 5001 : cluster [DBG] pgmap v4310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:30.593771+0000 mgr.smithi067.rdualw (mgr.24569) 5001 : cluster [DBG] pgmap v4310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:32.935 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:52:33.228 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:52:33.229 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 9m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:52:33.229 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 9m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:52:33.229 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 9m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:52:33.229 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 9m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:52:33.230 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 9m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:52:33.230 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 9m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:52:33.230 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 9m ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:52:33.230 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 9m ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:52:33.231 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 9m ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:52:33.231 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 9m ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:52:33.231 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 9m ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:52:33.231 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 9m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:52:33.231 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 9m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:52:33.232 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 9m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:52:33.232 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 9m ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:52:33.232 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 9m ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:52:33.232 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 9m ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:52:33.233 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 9m ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:52:33.233 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 9m ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:52:33.233 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 9m ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:52:33.233 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 9m ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:52:33.233 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 9m ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:52:33.234 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 9m ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:52:33.644 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:52:33.645 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:52:33.646 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:52:33.646 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:52:33.646 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:52:33.647 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:52:33.647 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:52:33.647 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:52:33.647 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:52:33.648 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:52:33.648 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:52:33.648 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:52:33.648 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:52:33.649 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:52:33.649 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:52:33.649 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:52:33.649 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:52:33.649 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:52:33.650 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:52:34.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:32.594257+0000 mgr.smithi067.rdualw (mgr.24569) 5002 : cluster [DBG] pgmap v4311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:52:32.923223+0000 mgr.smithi067.rdualw (mgr.24569) 5003 : audit [DBG] from='client.37474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:52:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:52:33.212502+0000 mgr.smithi067.rdualw (mgr.24569) 5004 : audit [DBG] from='client.37478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:52:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:52:33.644129+0000 mon.smithi061 (mon.0) 1164 : audit [DBG] from='client.? 172.21.15.61:0/1370033224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:52:34.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:32.594257+0000 mgr.smithi067.rdualw (mgr.24569) 5002 : cluster [DBG] pgmap v4311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:34.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:52:32.923223+0000 mgr.smithi067.rdualw (mgr.24569) 5003 : audit [DBG] from='client.37474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:52:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:52:33.212502+0000 mgr.smithi067.rdualw (mgr.24569) 5004 : audit [DBG] from='client.37478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:52:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:52:33.644129+0000 mon.smithi061 (mon.0) 1164 : audit [DBG] from='client.? 172.21.15.61:0/1370033224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:52:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:34.595006+0000 mgr.smithi067.rdualw (mgr.24569) 5005 : cluster [DBG] pgmap v4312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:52:35.212570+0000 mon.smithi067 (mon.1) 781 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:52:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:52:35.212930+0000 mon.smithi067 (mon.1) 782 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:52:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:52:35.212977+0000 mon.smithi061 (mon.0) 1165 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:52:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:52:35.213385+0000 mon.smithi061 (mon.0) 1166 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:52:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:34.595006+0000 mgr.smithi067.rdualw (mgr.24569) 5005 : cluster [DBG] pgmap v4312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:52:35.212570+0000 mon.smithi067 (mon.1) 781 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:52:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:52:35.212930+0000 mon.smithi067 (mon.1) 782 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:52:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:52:35.212977+0000 mon.smithi061 (mon.0) 1165 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:52:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:52:35.213385+0000 mon.smithi061 (mon.0) 1166 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:52:38.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:36.595883+0000 mgr.smithi067.rdualw (mgr.24569) 5006 : cluster [DBG] pgmap v4313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:52:38.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:36.595883+0000 mgr.smithi067.rdualw (mgr.24569) 5006 : cluster [DBG] pgmap v4313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:52:40.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:38.596526+0000 mgr.smithi067.rdualw (mgr.24569) 5007 : cluster [DBG] pgmap v4314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:40.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:38.596526+0000 mgr.smithi067.rdualw (mgr.24569) 5007 : cluster [DBG] pgmap v4314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:40.597455+0000 mgr.smithi067.rdualw (mgr.24569) 5008 : cluster [DBG] pgmap v4315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:40.597455+0000 mgr.smithi067.rdualw (mgr.24569) 5008 : cluster [DBG] pgmap v4315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:44.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:42.598160+0000 mgr.smithi067.rdualw (mgr.24569) 5009 : cluster [DBG] pgmap v4316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:44.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:42.598160+0000 mgr.smithi067.rdualw (mgr.24569) 5009 : cluster [DBG] pgmap v4316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:46.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:44.598930+0000 mgr.smithi067.rdualw (mgr.24569) 5010 : cluster [DBG] pgmap v4317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:46.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:44.598930+0000 mgr.smithi067.rdualw (mgr.24569) 5010 : cluster [DBG] pgmap v4317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:48.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:46.599848+0000 mgr.smithi067.rdualw (mgr.24569) 5011 : cluster [DBG] pgmap v4318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:52:48.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:46.599848+0000 mgr.smithi067.rdualw (mgr.24569) 5011 : cluster [DBG] pgmap v4318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:52:50.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:48.600364+0000 mgr.smithi067.rdualw (mgr.24569) 5012 : cluster [DBG] pgmap v4319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:50.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:48.600364+0000 mgr.smithi067.rdualw (mgr.24569) 5012 : cluster [DBG] pgmap v4319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:50.601389+0000 mgr.smithi067.rdualw (mgr.24569) 5013 : cluster [DBG] pgmap v4320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:50.601389+0000 mgr.smithi067.rdualw (mgr.24569) 5013 : cluster [DBG] pgmap v4320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:54.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:52.601878+0000 mgr.smithi067.rdualw (mgr.24569) 5014 : cluster [DBG] pgmap v4321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:54.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:52.601878+0000 mgr.smithi067.rdualw (mgr.24569) 5014 : cluster [DBG] pgmap v4321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:54.602634+0000 mgr.smithi067.rdualw (mgr.24569) 5015 : cluster [DBG] pgmap v4322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:56.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:54.602634+0000 mgr.smithi067.rdualw (mgr.24569) 5015 : cluster [DBG] pgmap v4322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:52:58.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:56.603569+0000 mgr.smithi067.rdualw (mgr.24569) 5016 : cluster [DBG] pgmap v4323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:52:58.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:56.603569+0000 mgr.smithi067.rdualw (mgr.24569) 5016 : cluster [DBG] pgmap v4323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:53:00.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:52:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:52:58.604297+0000 mgr.smithi067.rdualw (mgr.24569) 5017 : cluster [DBG] pgmap v4324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:00.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:52:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:52:58.604297+0000 mgr.smithi067.rdualw (mgr.24569) 5017 : cluster [DBG] pgmap v4324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:00.605342+0000 mgr.smithi067.rdualw (mgr.24569) 5018 : cluster [DBG] pgmap v4325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:00.605342+0000 mgr.smithi067.rdualw (mgr.24569) 5018 : cluster [DBG] pgmap v4325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:03.953 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:53:04.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:02.605944+0000 mgr.smithi067.rdualw (mgr.24569) 5019 : cluster [DBG] pgmap v4326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:04.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:02.605944+0000 mgr.smithi067.rdualw (mgr.24569) 5019 : cluster [DBG] pgmap v4326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:04.244 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:53:04.245 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 9m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:53:04.245 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 9m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:53:04.245 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 9m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:53:04.246 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 9m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:53:04.246 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 9m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:53:04.246 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 9m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:53:04.246 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 9m ago 2h 459M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:53:04.247 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 9m ago 2h 541M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:53:04.247 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 9m ago 2h 911M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:53:04.247 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 9m ago 2h 483M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:53:04.247 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 9m ago 2h 186M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:53:04.247 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 9m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:53:04.248 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 9m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:53:04.248 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 9m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:53:04.248 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 9m ago 2h 759M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:53:04.248 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 9m ago 2h 1600M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:53:04.249 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 9m ago 2h 971M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:53:04.249 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 9m ago 2h 1726M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:53:04.249 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 9m ago 2h 1594M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:53:04.249 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 9m ago 2h 1817M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:53:04.250 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 9m ago 2h 1443M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:53:04.250 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 9m ago 2h 2314M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:53:04.250 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 9m ago 2h 83.1M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:53:04.587 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:53:04.587 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:53:04.588 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:53:04.588 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:53:04.588 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:53:04.588 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:53:04.589 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:53:04.589 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:53:04.589 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:53:04.589 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:53:04.589 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:53:04.590 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:53:04.590 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:53:04.590 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:53:04.590 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:53:04.591 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:53:04.591 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:53:04.591 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:53:04.591 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:53:05.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:03.941289+0000 mgr.smithi067.rdualw (mgr.24569) 5020 : audit [DBG] from='client.37486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:53:05.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:04.228304+0000 mgr.smithi067.rdualw (mgr.24569) 5021 : audit [DBG] from='client.37490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:53:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:04.587258+0000 mon.smithi061 (mon.0) 1167 : audit [DBG] from='client.? 172.21.15.61:0/3036688546' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:53:05.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:03.941289+0000 mgr.smithi067.rdualw (mgr.24569) 5020 : audit [DBG] from='client.37486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:53:05.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:04.228304+0000 mgr.smithi067.rdualw (mgr.24569) 5021 : audit [DBG] from='client.37490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:53:05.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:04.587258+0000 mon.smithi061 (mon.0) 1167 : audit [DBG] from='client.? 172.21.15.61:0/3036688546' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:53:06.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:04.606610+0000 mgr.smithi067.rdualw (mgr.24569) 5022 : cluster [DBG] pgmap v4327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:06.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:04.606610+0000 mgr.smithi067.rdualw (mgr.24569) 5022 : cluster [DBG] pgmap v4327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:08.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:06.607569+0000 mgr.smithi067.rdualw (mgr.24569) 5023 : cluster [DBG] pgmap v4328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:53:08.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:06.607569+0000 mgr.smithi067.rdualw (mgr.24569) 5023 : cluster [DBG] pgmap v4328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:53:10.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:08.608073+0000 mgr.smithi067.rdualw (mgr.24569) 5024 : cluster [DBG] pgmap v4329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:10.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:08.608073+0000 mgr.smithi067.rdualw (mgr.24569) 5024 : cluster [DBG] pgmap v4329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:10.608949+0000 mgr.smithi067.rdualw (mgr.24569) 5025 : cluster [DBG] pgmap v4330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:10.608949+0000 mgr.smithi067.rdualw (mgr.24569) 5025 : cluster [DBG] pgmap v4330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:14.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:12.609591+0000 mgr.smithi067.rdualw (mgr.24569) 5026 : cluster [DBG] pgmap v4331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:12.855291+0000 mon.smithi067 (mon.1) 783 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:53:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:12.856736+0000 mon.smithi067 (mon.1) 784 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:53:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:12.857706+0000 mon.smithi067 (mon.1) 785 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:53:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:53:12.858602+0000 mgr.smithi067.rdualw (mgr.24569) 5027 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:53:14.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:12.609591+0000 mgr.smithi067.rdualw (mgr.24569) 5026 : cluster [DBG] pgmap v4331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:14.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:12.855291+0000 mon.smithi067 (mon.1) 783 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:53:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:12.856736+0000 mon.smithi067 (mon.1) 784 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:53:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:12.857706+0000 mon.smithi067 (mon.1) 785 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:53:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:53:12.858602+0000 mgr.smithi067.rdualw (mgr.24569) 5027 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:53:16.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:14.610094+0000 mgr.smithi067.rdualw (mgr.24569) 5028 : cluster [DBG] pgmap v4332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:16.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:14.610094+0000 mgr.smithi067.rdualw (mgr.24569) 5028 : cluster [DBG] pgmap v4332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:18.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:16.611040+0000 mgr.smithi067.rdualw (mgr.24569) 5029 : cluster [DBG] pgmap v4333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:53:18.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:17.655907+0000 mon.smithi061 (mon.0) 1168 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:53:18.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:16.611040+0000 mgr.smithi067.rdualw (mgr.24569) 5029 : cluster [DBG] pgmap v4333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:53:18.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:17.655907+0000 mon.smithi061 (mon.0) 1168 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:53:19.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:18.056348+0000 mon.smithi067 (mon.1) 786 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:53:19.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:18.056917+0000 mon.smithi061 (mon.0) 1169 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:53:19.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:18.056348+0000 mon.smithi067 (mon.1) 786 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:53:19.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:18.056917+0000 mon.smithi061 (mon.0) 1169 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:53:20.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:18.611451+0000 mgr.smithi067.rdualw (mgr.24569) 5030 : cluster [DBG] pgmap v4334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:20.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:18.611451+0000 mgr.smithi067.rdualw (mgr.24569) 5030 : cluster [DBG] pgmap v4334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:21.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:20.148834+0000 mon.smithi061 (mon.0) 1170 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:53:21.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:20.563367+0000 mon.smithi067 (mon.1) 787 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:53:21.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:20.563980+0000 mon.smithi061 (mon.0) 1171 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:53:21.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:20.568688+0000 mon.smithi061 (mon.0) 1172 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:53:21.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:20.578859+0000 mon.smithi061 (mon.0) 1173 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:53:21.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:20.148834+0000 mon.smithi061 (mon.0) 1170 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:53:21.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:20.563367+0000 mon.smithi067 (mon.1) 787 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:53:21.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:20.563980+0000 mon.smithi061 (mon.0) 1171 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T17:53:21.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:20.568688+0000 mon.smithi061 (mon.0) 1172 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:53:21.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:20.578859+0000 mon.smithi061 (mon.0) 1173 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:53:22.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:20.612400+0000 mgr.smithi067.rdualw (mgr.24569) 5031 : cluster [DBG] pgmap v4335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:22.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:20.612400+0000 mgr.smithi067.rdualw (mgr.24569) 5031 : cluster [DBG] pgmap v4335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:24.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:22.613082+0000 mgr.smithi067.rdualw (mgr.24569) 5032 : cluster [DBG] pgmap v4336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:24.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:22.613082+0000 mgr.smithi067.rdualw (mgr.24569) 5032 : cluster [DBG] pgmap v4336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:26.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:24.613912+0000 mgr.smithi067.rdualw (mgr.24569) 5033 : cluster [DBG] pgmap v4337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:26.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:24.613912+0000 mgr.smithi067.rdualw (mgr.24569) 5033 : cluster [DBG] pgmap v4337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:28.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:26.614781+0000 mgr.smithi067.rdualw (mgr.24569) 5034 : cluster [DBG] pgmap v4338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:53:28.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:26.614781+0000 mgr.smithi067.rdualw (mgr.24569) 5034 : cluster [DBG] pgmap v4338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:53:30.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:28.615374+0000 mgr.smithi067.rdualw (mgr.24569) 5035 : cluster [DBG] pgmap v4339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:30.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:28.615374+0000 mgr.smithi067.rdualw (mgr.24569) 5035 : cluster [DBG] pgmap v4339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:30.616320+0000 mgr.smithi067.rdualw (mgr.24569) 5036 : cluster [DBG] pgmap v4340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:30.616320+0000 mgr.smithi067.rdualw (mgr.24569) 5036 : cluster [DBG] pgmap v4340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:34.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:32.616895+0000 mgr.smithi067.rdualw (mgr.24569) 5037 : cluster [DBG] pgmap v4341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:34.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:32.616895+0000 mgr.smithi067.rdualw (mgr.24569) 5037 : cluster [DBG] pgmap v4341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:34.896 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:53:35.188 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:53:35.188 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 15s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:53:35.188 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 15s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:53:35.189 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 17s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:53:35.189 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 15s ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:53:35.189 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 15s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:53:35.189 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 17s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:53:35.190 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 15s ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:53:35.190 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 17s ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:53:35.190 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 15s ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:53:35.190 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 17s ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:53:35.191 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 15s ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:53:35.191 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 17s ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:53:35.191 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 15s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:53:35.191 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 17s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:53:35.192 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 15s ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:53:35.192 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 15s ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:53:35.192 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 15s ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:53:35.192 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 15s ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:53:35.192 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 17s ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:53:35.193 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 17s ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:53:35.193 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 17s ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:53:35.193 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 17s ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:53:35.193 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 15s ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:53:35.529 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:53:35.530 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:53:35.530 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:53:35.530 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:53:35.530 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:53:35.531 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:53:35.531 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:53:35.531 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:53:35.531 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:53:35.532 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:53:35.532 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:53:35.532 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:53:35.532 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:53:35.533 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:53:35.533 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:53:35.533 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:53:35.533 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:53:35.533 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:53:35.534 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:53:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:34.617615+0000 mgr.smithi067.rdualw (mgr.24569) 5038 : cluster [DBG] pgmap v4342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:34.883315+0000 mgr.smithi067.rdualw (mgr.24569) 5039 : audit [DBG] from='client.37498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:53:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:35.171748+0000 mgr.smithi067.rdualw (mgr.24569) 5040 : audit [DBG] from='client.37502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:53:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:35.218395+0000 mon.smithi067 (mon.1) 788 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:53:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:35.218704+0000 mon.smithi067 (mon.1) 789 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:53:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:35.218796+0000 mon.smithi061 (mon.0) 1174 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:53:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:35.219053+0000 mon.smithi061 (mon.0) 1175 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:53:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:53:35.529515+0000 mon.smithi061 (mon.0) 1176 : audit [DBG] from='client.? 172.21.15.61:0/1395410653' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:53:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:34.617615+0000 mgr.smithi067.rdualw (mgr.24569) 5038 : cluster [DBG] pgmap v4342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:34.883315+0000 mgr.smithi067.rdualw (mgr.24569) 5039 : audit [DBG] from='client.37498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:53:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:35.171748+0000 mgr.smithi067.rdualw (mgr.24569) 5040 : audit [DBG] from='client.37502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:53:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:35.218395+0000 mon.smithi067 (mon.1) 788 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:53:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:35.218704+0000 mon.smithi067 (mon.1) 789 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:53:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:35.218796+0000 mon.smithi061 (mon.0) 1174 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:53:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:35.219053+0000 mon.smithi061 (mon.0) 1175 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:53:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:53:35.529515+0000 mon.smithi061 (mon.0) 1176 : audit [DBG] from='client.? 172.21.15.61:0/1395410653' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:53:38.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:36.618471+0000 mgr.smithi067.rdualw (mgr.24569) 5041 : cluster [DBG] pgmap v4343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:53:38.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:36.618471+0000 mgr.smithi067.rdualw (mgr.24569) 5041 : cluster [DBG] pgmap v4343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:53:40.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:38.619002+0000 mgr.smithi067.rdualw (mgr.24569) 5042 : cluster [DBG] pgmap v4344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:40.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:38.619002+0000 mgr.smithi067.rdualw (mgr.24569) 5042 : cluster [DBG] pgmap v4344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:40.619845+0000 mgr.smithi067.rdualw (mgr.24569) 5043 : cluster [DBG] pgmap v4345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:40.619845+0000 mgr.smithi067.rdualw (mgr.24569) 5043 : cluster [DBG] pgmap v4345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:44.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:42.620393+0000 mgr.smithi067.rdualw (mgr.24569) 5044 : cluster [DBG] pgmap v4346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:44.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:42.620393+0000 mgr.smithi067.rdualw (mgr.24569) 5044 : cluster [DBG] pgmap v4346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:46.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:44.621121+0000 mgr.smithi067.rdualw (mgr.24569) 5045 : cluster [DBG] pgmap v4347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:46.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:44.621121+0000 mgr.smithi067.rdualw (mgr.24569) 5045 : cluster [DBG] pgmap v4347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:48.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:46.622113+0000 mgr.smithi067.rdualw (mgr.24569) 5046 : cluster [DBG] pgmap v4348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:53:48.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:46.622113+0000 mgr.smithi067.rdualw (mgr.24569) 5046 : cluster [DBG] pgmap v4348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:53:50.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:48.622618+0000 mgr.smithi067.rdualw (mgr.24569) 5047 : cluster [DBG] pgmap v4349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:50.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:48.622618+0000 mgr.smithi067.rdualw (mgr.24569) 5047 : cluster [DBG] pgmap v4349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:50.623459+0000 mgr.smithi067.rdualw (mgr.24569) 5048 : cluster [DBG] pgmap v4350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:50.623459+0000 mgr.smithi067.rdualw (mgr.24569) 5048 : cluster [DBG] pgmap v4350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:54.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:52.624115+0000 mgr.smithi067.rdualw (mgr.24569) 5049 : cluster [DBG] pgmap v4351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:54.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:52.624115+0000 mgr.smithi067.rdualw (mgr.24569) 5049 : cluster [DBG] pgmap v4351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:56.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:54.624849+0000 mgr.smithi067.rdualw (mgr.24569) 5050 : cluster [DBG] pgmap v4352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:56.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:54.624849+0000 mgr.smithi067.rdualw (mgr.24569) 5050 : cluster [DBG] pgmap v4352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:53:58.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:56.625726+0000 mgr.smithi067.rdualw (mgr.24569) 5051 : cluster [DBG] pgmap v4353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:53:58.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:56.625726+0000 mgr.smithi067.rdualw (mgr.24569) 5051 : cluster [DBG] pgmap v4353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:54:00.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:53:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:53:58.626257+0000 mgr.smithi067.rdualw (mgr.24569) 5052 : cluster [DBG] pgmap v4354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:00.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:53:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:53:58.626257+0000 mgr.smithi067.rdualw (mgr.24569) 5052 : cluster [DBG] pgmap v4354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:00.627160+0000 mgr.smithi067.rdualw (mgr.24569) 5053 : cluster [DBG] pgmap v4355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:00.627160+0000 mgr.smithi067.rdualw (mgr.24569) 5053 : cluster [DBG] pgmap v4355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:04.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:02.627729+0000 mgr.smithi067.rdualw (mgr.24569) 5054 : cluster [DBG] pgmap v4356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:04.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:02.627729+0000 mgr.smithi067.rdualw (mgr.24569) 5054 : cluster [DBG] pgmap v4356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:05.835 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:54:06.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:04.628276+0000 mgr.smithi067.rdualw (mgr.24569) 5055 : cluster [DBG] pgmap v4357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:06.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:04.628276+0000 mgr.smithi067.rdualw (mgr.24569) 5055 : cluster [DBG] pgmap v4357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:06.125 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:54:06.125 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 45s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:54:06.126 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 45s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:54:06.126 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 48s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:54:06.126 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 45s ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:54:06.126 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 45s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:54:06.127 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 48s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:54:06.127 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 45s ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:54:06.127 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 48s ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:54:06.127 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 45s ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:54:06.128 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 48s ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:54:06.128 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 45s ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:54:06.128 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 48s ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:54:06.128 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 45s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:54:06.128 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 48s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:54:06.129 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 45s ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:54:06.129 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 45s ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:54:06.129 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 45s ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:54:06.129 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 45s ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:54:06.129 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 48s ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:54:06.130 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 48s ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:54:06.130 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 48s ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:54:06.130 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 48s ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:54:06.130 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 45s ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:54:06.509 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:54:06.509 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:54:06.509 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:54:06.509 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:54:06.510 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:54:06.510 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:54:06.510 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:54:06.510 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:54:06.511 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:54:06.511 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:54:06.511 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:54:06.511 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:54:06.512 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:54:06.512 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:54:06.512 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:54:06.512 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:54:06.512 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:54:06.513 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:54:06.513 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:54:07.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:54:05.823819+0000 mgr.smithi067.rdualw (mgr.24569) 5056 : audit [DBG] from='client.46575 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:54:07.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:54:06.109119+0000 mgr.smithi067.rdualw (mgr.24569) 5057 : audit [DBG] from='client.37514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:54:07.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:54:06.508909+0000 mon.smithi061 (mon.0) 1177 : audit [DBG] from='client.? 172.21.15.61:0/1479694061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:54:07.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:54:05.823819+0000 mgr.smithi067.rdualw (mgr.24569) 5056 : audit [DBG] from='client.46575 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:54:07.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:54:06.109119+0000 mgr.smithi067.rdualw (mgr.24569) 5057 : audit [DBG] from='client.37514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:54:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:54:06.508909+0000 mon.smithi061 (mon.0) 1177 : audit [DBG] from='client.? 172.21.15.61:0/1479694061' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:54:08.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:06.629164+0000 mgr.smithi067.rdualw (mgr.24569) 5058 : cluster [DBG] pgmap v4358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:54:08.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:06.629164+0000 mgr.smithi067.rdualw (mgr.24569) 5058 : cluster [DBG] pgmap v4358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:54:10.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:08.629723+0000 mgr.smithi067.rdualw (mgr.24569) 5059 : cluster [DBG] pgmap v4359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:10.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:08.629723+0000 mgr.smithi067.rdualw (mgr.24569) 5059 : cluster [DBG] pgmap v4359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:10.630744+0000 mgr.smithi067.rdualw (mgr.24569) 5060 : cluster [DBG] pgmap v4360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:10.630744+0000 mgr.smithi067.rdualw (mgr.24569) 5060 : cluster [DBG] pgmap v4360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:14.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:12.631285+0000 mgr.smithi067.rdualw (mgr.24569) 5061 : cluster [DBG] pgmap v4361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:14.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:12.631285+0000 mgr.smithi067.rdualw (mgr.24569) 5061 : cluster [DBG] pgmap v4361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:16.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:14.631838+0000 mgr.smithi067.rdualw (mgr.24569) 5062 : cluster [DBG] pgmap v4362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:16.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:14.631838+0000 mgr.smithi067.rdualw (mgr.24569) 5062 : cluster [DBG] pgmap v4362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:18.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:16.632692+0000 mgr.smithi067.rdualw (mgr.24569) 5063 : cluster [DBG] pgmap v4363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:54:18.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:16.632692+0000 mgr.smithi067.rdualw (mgr.24569) 5063 : cluster [DBG] pgmap v4363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:54:20.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:18.633392+0000 mgr.smithi067.rdualw (mgr.24569) 5064 : cluster [DBG] pgmap v4364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:20.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:18.633392+0000 mgr.smithi067.rdualw (mgr.24569) 5064 : cluster [DBG] pgmap v4364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:54:20.585502+0000 mon.smithi067 (mon.1) 790 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:54:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:54:20.587015+0000 mon.smithi067 (mon.1) 791 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:54:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:54:20.588079+0000 mon.smithi067 (mon.1) 792 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:54:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:54:20.588913+0000 mgr.smithi067.rdualw (mgr.24569) 5065 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:54:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:20.634257+0000 mgr.smithi067.rdualw (mgr.24569) 5066 : cluster [DBG] pgmap v4365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:54:21.008788+0000 mon.smithi061 (mon.0) 1178 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:54:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:54:21.016981+0000 mon.smithi061 (mon.0) 1179 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:54:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:54:20.585502+0000 mon.smithi067 (mon.1) 790 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:54:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:54:20.587015+0000 mon.smithi067 (mon.1) 791 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:54:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:54:20.588079+0000 mon.smithi067 (mon.1) 792 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:54:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:54:20.588913+0000 mgr.smithi067.rdualw (mgr.24569) 5065 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:54:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:20.634257+0000 mgr.smithi067.rdualw (mgr.24569) 5066 : cluster [DBG] pgmap v4365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:54:21.008788+0000 mon.smithi061 (mon.0) 1178 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:54:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:54:21.016981+0000 mon.smithi061 (mon.0) 1179 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:54:24.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:22.635008+0000 mgr.smithi067.rdualw (mgr.24569) 5067 : cluster [DBG] pgmap v4366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:24.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:22.635008+0000 mgr.smithi067.rdualw (mgr.24569) 5067 : cluster [DBG] pgmap v4366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:26.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:24.635599+0000 mgr.smithi067.rdualw (mgr.24569) 5068 : cluster [DBG] pgmap v4367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:26.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:24.635599+0000 mgr.smithi067.rdualw (mgr.24569) 5068 : cluster [DBG] pgmap v4367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:28.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:26.636629+0000 mgr.smithi067.rdualw (mgr.24569) 5069 : cluster [DBG] pgmap v4368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:54:28.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:26.636629+0000 mgr.smithi067.rdualw (mgr.24569) 5069 : cluster [DBG] pgmap v4368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:54:30.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:28.637071+0000 mgr.smithi067.rdualw (mgr.24569) 5070 : cluster [DBG] pgmap v4369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:30.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:28.637071+0000 mgr.smithi067.rdualw (mgr.24569) 5070 : cluster [DBG] pgmap v4369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:30.638136+0000 mgr.smithi067.rdualw (mgr.24569) 5071 : cluster [DBG] pgmap v4370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:30.638136+0000 mgr.smithi067.rdualw (mgr.24569) 5071 : cluster [DBG] pgmap v4370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:34.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:32.638723+0000 mgr.smithi067.rdualw (mgr.24569) 5072 : cluster [DBG] pgmap v4371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:34.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:32.638723+0000 mgr.smithi067.rdualw (mgr.24569) 5072 : cluster [DBG] pgmap v4371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:34.639216+0000 mgr.smithi067.rdualw (mgr.24569) 5073 : cluster [DBG] pgmap v4372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:54:35.223718+0000 mon.smithi067 (mon.1) 793 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:54:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:54:35.224133+0000 mon.smithi061 (mon.0) 1180 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:54:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:54:35.224374+0000 mon.smithi067 (mon.1) 794 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:54:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:54:35.224613+0000 mon.smithi061 (mon.0) 1181 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:54:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:34.639216+0000 mgr.smithi067.rdualw (mgr.24569) 5073 : cluster [DBG] pgmap v4372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:54:35.223718+0000 mon.smithi067 (mon.1) 793 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:54:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:54:35.224133+0000 mon.smithi061 (mon.0) 1180 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:54:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:54:35.224374+0000 mon.smithi067 (mon.1) 794 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:54:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:54:35.224613+0000 mon.smithi061 (mon.0) 1181 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:54:36.822 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:54:37.123 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:54:37.123 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 76s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:54:37.124 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 76s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:54:37.124 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 79s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:54:37.124 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 76s ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:54:37.124 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 76s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:54:37.125 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 79s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:54:37.125 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 76s ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:54:37.125 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 79s ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:54:37.125 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 76s ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:54:37.126 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 79s ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:54:37.126 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 76s ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:54:37.127 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 79s ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:54:37.127 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 76s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:54:37.127 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 79s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:54:37.127 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 76s ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:54:37.127 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 76s ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:54:37.128 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 76s ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:54:37.128 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 76s ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:54:37.128 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 79s ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:54:37.128 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 79s ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:54:37.129 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 79s ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:54:37.129 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 79s ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:54:37.129 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 76s ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:54:37.575 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:54:37.575 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:54:37.576 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:54:37.576 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:54:37.576 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:54:37.576 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:54:37.577 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:54:37.577 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:54:37.577 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:54:37.577 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:54:37.578 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:54:37.578 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:54:37.578 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:54:37.578 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:54:37.579 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:54:37.579 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:54:37.579 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:54:37.579 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:54:37.579 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:54:38.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:36.640117+0000 mgr.smithi067.rdualw (mgr.24569) 5074 : cluster [DBG] pgmap v4373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:54:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:54:36.809904+0000 mgr.smithi067.rdualw (mgr.24569) 5075 : audit [DBG] from='client.37522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:54:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:54:37.107104+0000 mgr.smithi067.rdualw (mgr.24569) 5076 : audit [DBG] from='client.37526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:54:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:54:37.575407+0000 mon.smithi061 (mon.0) 1182 : audit [DBG] from='client.? 172.21.15.61:0/3105664441' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:54:38.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:36.640117+0000 mgr.smithi067.rdualw (mgr.24569) 5074 : cluster [DBG] pgmap v4373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:54:38.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:54:36.809904+0000 mgr.smithi067.rdualw (mgr.24569) 5075 : audit [DBG] from='client.37522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:54:38.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:54:37.107104+0000 mgr.smithi067.rdualw (mgr.24569) 5076 : audit [DBG] from='client.37526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:54:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:54:37.575407+0000 mon.smithi061 (mon.0) 1182 : audit [DBG] from='client.? 172.21.15.61:0/3105664441' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:54:40.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:38.640663+0000 mgr.smithi067.rdualw (mgr.24569) 5077 : cluster [DBG] pgmap v4374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:40.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:38.640663+0000 mgr.smithi067.rdualw (mgr.24569) 5077 : cluster [DBG] pgmap v4374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:40.641559+0000 mgr.smithi067.rdualw (mgr.24569) 5078 : cluster [DBG] pgmap v4375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:40.641559+0000 mgr.smithi067.rdualw (mgr.24569) 5078 : cluster [DBG] pgmap v4375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:44.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:42.642091+0000 mgr.smithi067.rdualw (mgr.24569) 5079 : cluster [DBG] pgmap v4376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:44.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:42.642091+0000 mgr.smithi067.rdualw (mgr.24569) 5079 : cluster [DBG] pgmap v4376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:44.642811+0000 mgr.smithi067.rdualw (mgr.24569) 5080 : cluster [DBG] pgmap v4377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:46.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:44.642811+0000 mgr.smithi067.rdualw (mgr.24569) 5080 : cluster [DBG] pgmap v4377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:48.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:46.643709+0000 mgr.smithi067.rdualw (mgr.24569) 5081 : cluster [DBG] pgmap v4378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:54:48.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:46.643709+0000 mgr.smithi067.rdualw (mgr.24569) 5081 : cluster [DBG] pgmap v4378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:54:50.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:48.644274+0000 mgr.smithi067.rdualw (mgr.24569) 5082 : cluster [DBG] pgmap v4379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:50.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:48.644274+0000 mgr.smithi067.rdualw (mgr.24569) 5082 : cluster [DBG] pgmap v4379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:50.645344+0000 mgr.smithi067.rdualw (mgr.24569) 5083 : cluster [DBG] pgmap v4380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:52.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:50.645344+0000 mgr.smithi067.rdualw (mgr.24569) 5083 : cluster [DBG] pgmap v4380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:54.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:52.645839+0000 mgr.smithi067.rdualw (mgr.24569) 5084 : cluster [DBG] pgmap v4381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:54.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:52.645839+0000 mgr.smithi067.rdualw (mgr.24569) 5084 : cluster [DBG] pgmap v4381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:56.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:54.646571+0000 mgr.smithi067.rdualw (mgr.24569) 5085 : cluster [DBG] pgmap v4382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:54.646571+0000 mgr.smithi067.rdualw (mgr.24569) 5085 : cluster [DBG] pgmap v4382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:54:58.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:56.647430+0000 mgr.smithi067.rdualw (mgr.24569) 5086 : cluster [DBG] pgmap v4383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:54:58.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:56.647430+0000 mgr.smithi067.rdualw (mgr.24569) 5086 : cluster [DBG] pgmap v4383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:55:00.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:54:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:54:58.648003+0000 mgr.smithi067.rdualw (mgr.24569) 5087 : cluster [DBG] pgmap v4384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:00.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:54:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:54:58.648003+0000 mgr.smithi067.rdualw (mgr.24569) 5087 : cluster [DBG] pgmap v4384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:00.648891+0000 mgr.smithi067.rdualw (mgr.24569) 5088 : cluster [DBG] pgmap v4385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:00.648891+0000 mgr.smithi067.rdualw (mgr.24569) 5088 : cluster [DBG] pgmap v4385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:04.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:02.649439+0000 mgr.smithi067.rdualw (mgr.24569) 5089 : cluster [DBG] pgmap v4386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:04.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:02.649439+0000 mgr.smithi067.rdualw (mgr.24569) 5089 : cluster [DBG] pgmap v4386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:06.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:04.649950+0000 mgr.smithi067.rdualw (mgr.24569) 5090 : cluster [DBG] pgmap v4387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:04.649950+0000 mgr.smithi067.rdualw (mgr.24569) 5090 : cluster [DBG] pgmap v4387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:07.891 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:55:08.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:06.650733+0000 mgr.smithi067.rdualw (mgr.24569) 5091 : cluster [DBG] pgmap v4388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:55:08.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:06.650733+0000 mgr.smithi067.rdualw (mgr.24569) 5091 : cluster [DBG] pgmap v4388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:55:08.187 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:55:08.188 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 108s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:55:08.188 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 108s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:55:08.188 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 110s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:55:08.188 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 108s ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:55:08.188 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 108s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:55:08.189 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 110s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:55:08.189 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 108s ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:55:08.189 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 110s ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:55:08.189 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 108s ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:55:08.190 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 110s ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:55:08.190 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 108s ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:55:08.190 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 110s ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:55:08.190 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 108s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:55:08.190 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 110s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:55:08.191 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 108s ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:55:08.191 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 108s ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:55:08.191 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 108s ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:55:08.191 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 108s ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:55:08.192 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 110s ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:55:08.192 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 110s ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:55:08.192 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 110s ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:55:08.192 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 110s ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:55:08.192 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 108s ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:55:08.533 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:55:08.533 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:55:08.533 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:55:08.534 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:55:08.534 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:55:08.534 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:55:08.534 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:55:08.535 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:55:08.535 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:55:08.535 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:55:08.536 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:55:08.536 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:55:08.536 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:55:08.536 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:55:08.537 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:55:08.537 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:55:08.537 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:55:08.537 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:55:08.537 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:55:09.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:55:07.879622+0000 mgr.smithi067.rdualw (mgr.24569) 5092 : audit [DBG] from='client.37534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:55:09.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:55:08.171283+0000 mgr.smithi067.rdualw (mgr.24569) 5093 : audit [DBG] from='client.37538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:55:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:55:08.532757+0000 mon.smithi061 (mon.0) 1183 : audit [DBG] from='client.? 172.21.15.61:0/4001661644' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:55:09.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:55:07.879622+0000 mgr.smithi067.rdualw (mgr.24569) 5092 : audit [DBG] from='client.37534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:55:09.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:55:08.171283+0000 mgr.smithi067.rdualw (mgr.24569) 5093 : audit [DBG] from='client.37538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:55:09.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:55:08.532757+0000 mon.smithi061 (mon.0) 1183 : audit [DBG] from='client.? 172.21.15.61:0/4001661644' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:55:10.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:08.651351+0000 mgr.smithi067.rdualw (mgr.24569) 5094 : cluster [DBG] pgmap v4389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:10.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:08.651351+0000 mgr.smithi067.rdualw (mgr.24569) 5094 : cluster [DBG] pgmap v4389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:10.652211+0000 mgr.smithi067.rdualw (mgr.24569) 5095 : cluster [DBG] pgmap v4390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:10.652211+0000 mgr.smithi067.rdualw (mgr.24569) 5095 : cluster [DBG] pgmap v4390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:14.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:12.652745+0000 mgr.smithi067.rdualw (mgr.24569) 5096 : cluster [DBG] pgmap v4391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:14.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:12.652745+0000 mgr.smithi067.rdualw (mgr.24569) 5096 : cluster [DBG] pgmap v4391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:16.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:14.653567+0000 mgr.smithi067.rdualw (mgr.24569) 5097 : cluster [DBG] pgmap v4392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:16.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:14.653567+0000 mgr.smithi067.rdualw (mgr.24569) 5097 : cluster [DBG] pgmap v4392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:18.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:16.654560+0000 mgr.smithi067.rdualw (mgr.24569) 5098 : cluster [DBG] pgmap v4393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:55:18.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:16.654560+0000 mgr.smithi067.rdualw (mgr.24569) 5098 : cluster [DBG] pgmap v4393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:55:20.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:18.655218+0000 mgr.smithi067.rdualw (mgr.24569) 5099 : cluster [DBG] pgmap v4394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:18.655218+0000 mgr.smithi067.rdualw (mgr.24569) 5099 : cluster [DBG] pgmap v4394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:20.656215+0000 mgr.smithi067.rdualw (mgr.24569) 5100 : cluster [DBG] pgmap v4395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:55:21.022422+0000 mon.smithi067 (mon.1) 795 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:55:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:55:21.023835+0000 mon.smithi067 (mon.1) 796 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:55:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:55:21.024745+0000 mon.smithi067 (mon.1) 797 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:55:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:55:21.025590+0000 mgr.smithi067.rdualw (mgr.24569) 5101 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:55:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:55:21.384854+0000 mon.smithi061 (mon.0) 1184 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:55:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:55:21.391728+0000 mon.smithi061 (mon.0) 1185 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:55:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:20.656215+0000 mgr.smithi067.rdualw (mgr.24569) 5100 : cluster [DBG] pgmap v4395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:55:21.022422+0000 mon.smithi067 (mon.1) 795 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:55:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:55:21.023835+0000 mon.smithi067 (mon.1) 796 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:55:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:55:21.024745+0000 mon.smithi067 (mon.1) 797 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:55:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:55:21.025590+0000 mgr.smithi067.rdualw (mgr.24569) 5101 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:55:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:55:21.384854+0000 mon.smithi061 (mon.0) 1184 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:55:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:55:21.391728+0000 mon.smithi061 (mon.0) 1185 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:55:23.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:55:21.795309+0000 mon.smithi061 (mon.0) 1186 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:55:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:55:21.801352+0000 mon.smithi061 (mon.0) 1187 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:55:23.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:55:21.795309+0000 mon.smithi061 (mon.0) 1186 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:55:23.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:55:21.801352+0000 mon.smithi061 (mon.0) 1187 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:55:24.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:22.656756+0000 mgr.smithi067.rdualw (mgr.24569) 5102 : cluster [DBG] pgmap v4396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:24.142 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:22.656756+0000 mgr.smithi067.rdualw (mgr.24569) 5102 : cluster [DBG] pgmap v4396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:26.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:24.657427+0000 mgr.smithi067.rdualw (mgr.24569) 5103 : cluster [DBG] pgmap v4397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:26.143 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:24.657427+0000 mgr.smithi067.rdualw (mgr.24569) 5103 : cluster [DBG] pgmap v4397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:28.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:26.658502+0000 mgr.smithi067.rdualw (mgr.24569) 5104 : cluster [DBG] pgmap v4398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:55:28.143 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:26.658502+0000 mgr.smithi067.rdualw (mgr.24569) 5104 : cluster [DBG] pgmap v4398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:55:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:28.658945+0000 mgr.smithi067.rdualw (mgr.24569) 5105 : cluster [DBG] pgmap v4399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:30.143 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:28.658945+0000 mgr.smithi067.rdualw (mgr.24569) 5105 : cluster [DBG] pgmap v4399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:30.659876+0000 mgr.smithi067.rdualw (mgr.24569) 5106 : cluster [DBG] pgmap v4400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:30.659876+0000 mgr.smithi067.rdualw (mgr.24569) 5106 : cluster [DBG] pgmap v4400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:34.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:32.660400+0000 mgr.smithi067.rdualw (mgr.24569) 5107 : cluster [DBG] pgmap v4401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:34.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:32.660400+0000 mgr.smithi067.rdualw (mgr.24569) 5107 : cluster [DBG] pgmap v4401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:34.661109+0000 mgr.smithi067.rdualw (mgr.24569) 5108 : cluster [DBG] pgmap v4402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:55:35.228656+0000 mon.smithi067 (mon.1) 798 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:55:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:55:35.229036+0000 mon.smithi061 (mon.0) 1188 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:55:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:55:35.229887+0000 mon.smithi067 (mon.1) 799 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:55:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:55:35.230148+0000 mon.smithi061 (mon.0) 1189 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:55:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:34.661109+0000 mgr.smithi067.rdualw (mgr.24569) 5108 : cluster [DBG] pgmap v4402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:55:35.228656+0000 mon.smithi067 (mon.1) 798 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:55:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:55:35.229036+0000 mon.smithi061 (mon.0) 1188 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:55:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:55:35.229887+0000 mon.smithi067 (mon.1) 799 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:55:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:55:35.230148+0000 mon.smithi061 (mon.0) 1189 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:55:38.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:36.662016+0000 mgr.smithi067.rdualw (mgr.24569) 5109 : cluster [DBG] pgmap v4403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:55:38.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:36.662016+0000 mgr.smithi067.rdualw (mgr.24569) 5109 : cluster [DBG] pgmap v4403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:55:38.842 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:55:39.130 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:55:39.130 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 2m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:55:39.131 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 2m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:55:39.131 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 2m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:55:39.131 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 2m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:55:39.131 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 2m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:55:39.131 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 2m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:55:39.132 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 2m ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:55:39.132 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 2m ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:55:39.132 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 2m ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:55:39.132 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 2m ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:55:39.133 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 2m ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:55:39.133 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 2m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:55:39.133 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 2m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:55:39.133 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 2m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:55:39.134 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 2m ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:55:39.134 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 2m ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:55:39.134 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 2m ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:55:39.134 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 2m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:55:39.134 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 2m ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:55:39.135 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 2m ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:55:39.135 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 2m ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:55:39.135 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 2m ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:55:39.135 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 2m ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:55:39.473 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:55:39.474 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:55:39.474 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:55:39.474 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:55:39.475 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:55:39.475 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:55:39.475 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:55:39.475 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:55:39.476 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:55:39.476 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:55:39.476 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:55:39.476 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:55:39.476 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:55:39.477 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:55:39.477 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:55:39.477 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:55:39.477 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:55:39.477 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:55:39.478 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:55:40.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:38.662526+0000 mgr.smithi067.rdualw (mgr.24569) 5110 : cluster [DBG] pgmap v4404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:55:38.830456+0000 mgr.smithi067.rdualw (mgr.24569) 5111 : audit [DBG] from='client.37546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:55:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:55:39.114260+0000 mgr.smithi067.rdualw (mgr.24569) 5112 : audit [DBG] from='client.37550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:55:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:55:39.473848+0000 mon.smithi061 (mon.0) 1190 : audit [DBG] from='client.? 172.21.15.61:0/1930192402' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:55:40.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:38.662526+0000 mgr.smithi067.rdualw (mgr.24569) 5110 : cluster [DBG] pgmap v4404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:40.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:55:38.830456+0000 mgr.smithi067.rdualw (mgr.24569) 5111 : audit [DBG] from='client.37546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:55:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:55:39.114260+0000 mgr.smithi067.rdualw (mgr.24569) 5112 : audit [DBG] from='client.37550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:55:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:55:39.473848+0000 mon.smithi061 (mon.0) 1190 : audit [DBG] from='client.? 172.21.15.61:0/1930192402' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:55:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:40.663362+0000 mgr.smithi067.rdualw (mgr.24569) 5113 : cluster [DBG] pgmap v4405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:40.663362+0000 mgr.smithi067.rdualw (mgr.24569) 5113 : cluster [DBG] pgmap v4405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:44.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:42.663826+0000 mgr.smithi067.rdualw (mgr.24569) 5114 : cluster [DBG] pgmap v4406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:44.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:42.663826+0000 mgr.smithi067.rdualw (mgr.24569) 5114 : cluster [DBG] pgmap v4406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:46.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:44.664405+0000 mgr.smithi067.rdualw (mgr.24569) 5115 : cluster [DBG] pgmap v4407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:46.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:44.664405+0000 mgr.smithi067.rdualw (mgr.24569) 5115 : cluster [DBG] pgmap v4407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:48.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:46.665233+0000 mgr.smithi067.rdualw (mgr.24569) 5116 : cluster [DBG] pgmap v4408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:55:48.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:46.665233+0000 mgr.smithi067.rdualw (mgr.24569) 5116 : cluster [DBG] pgmap v4408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:55:50.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:48.665955+0000 mgr.smithi067.rdualw (mgr.24569) 5117 : cluster [DBG] pgmap v4409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:50.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:48.665955+0000 mgr.smithi067.rdualw (mgr.24569) 5117 : cluster [DBG] pgmap v4409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:50.666980+0000 mgr.smithi067.rdualw (mgr.24569) 5118 : cluster [DBG] pgmap v4410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:50.666980+0000 mgr.smithi067.rdualw (mgr.24569) 5118 : cluster [DBG] pgmap v4410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:54.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:52.667520+0000 mgr.smithi067.rdualw (mgr.24569) 5119 : cluster [DBG] pgmap v4411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:54.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:52.667520+0000 mgr.smithi067.rdualw (mgr.24569) 5119 : cluster [DBG] pgmap v4411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:56.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:54.668165+0000 mgr.smithi067.rdualw (mgr.24569) 5120 : cluster [DBG] pgmap v4412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:56.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:54.668165+0000 mgr.smithi067.rdualw (mgr.24569) 5120 : cluster [DBG] pgmap v4412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:55:58.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:56.669133+0000 mgr.smithi067.rdualw (mgr.24569) 5121 : cluster [DBG] pgmap v4413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:55:58.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:56.669133+0000 mgr.smithi067.rdualw (mgr.24569) 5121 : cluster [DBG] pgmap v4413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:56:00.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:55:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:55:58.669704+0000 mgr.smithi067.rdualw (mgr.24569) 5122 : cluster [DBG] pgmap v4414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:00.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:55:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:55:58.669704+0000 mgr.smithi067.rdualw (mgr.24569) 5122 : cluster [DBG] pgmap v4414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:00.670496+0000 mgr.smithi067.rdualw (mgr.24569) 5123 : cluster [DBG] pgmap v4415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:00.670496+0000 mgr.smithi067.rdualw (mgr.24569) 5123 : cluster [DBG] pgmap v4415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:04.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:02.671087+0000 mgr.smithi067.rdualw (mgr.24569) 5124 : cluster [DBG] pgmap v4416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:04.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:02.671087+0000 mgr.smithi067.rdualw (mgr.24569) 5124 : cluster [DBG] pgmap v4416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:06.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:04.671718+0000 mgr.smithi067.rdualw (mgr.24569) 5125 : cluster [DBG] pgmap v4417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:06.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:04.671718+0000 mgr.smithi067.rdualw (mgr.24569) 5125 : cluster [DBG] pgmap v4417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:08.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:06.672584+0000 mgr.smithi067.rdualw (mgr.24569) 5126 : cluster [DBG] pgmap v4418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:56:08.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:06.672584+0000 mgr.smithi067.rdualw (mgr.24569) 5126 : cluster [DBG] pgmap v4418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:56:09.796 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:56:10.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:08.673062+0000 mgr.smithi067.rdualw (mgr.24569) 5127 : cluster [DBG] pgmap v4419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:10.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:08.673062+0000 mgr.smithi067.rdualw (mgr.24569) 5127 : cluster [DBG] pgmap v4419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:10.089 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:56:10.090 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 2m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:56:10.090 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 2m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:56:10.090 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 2m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:56:10.091 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 2m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:56:10.091 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 2m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:56:10.091 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 2m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:56:10.091 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 2m ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:56:10.091 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 2m ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:56:10.092 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 2m ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:56:10.092 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 2m ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:56:10.092 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 2m ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:56:10.092 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 2m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:56:10.093 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 2m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:56:10.093 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 2m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:56:10.093 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 2m ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:56:10.093 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 2m ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:56:10.093 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 2m ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:56:10.094 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 2m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:56:10.094 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 2m ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:56:10.094 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 2m ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:56:10.094 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 2m ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:56:10.095 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 2m ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:56:10.095 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 2m ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:56:10.445 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:56:10.445 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:56:10.446 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:56:10.446 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:56:10.446 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:56:10.446 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:56:10.447 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:56:10.447 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:56:10.447 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:56:10.447 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:56:10.447 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:56:10.448 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:56:10.448 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:56:10.448 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:56:10.448 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:56:10.449 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:56:10.449 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:56:10.449 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:56:10.449 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:56:11.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:56:09.780472+0000 mgr.smithi067.rdualw (mgr.24569) 5128 : audit [DBG] from='client.37558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:56:11.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:56:10.073751+0000 mgr.smithi067.rdualw (mgr.24569) 5129 : audit [DBG] from='client.37562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:56:11.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:56:10.445413+0000 mon.smithi061 (mon.0) 1191 : audit [DBG] from='client.? 172.21.15.61:0/962075871' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:56:11.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:56:09.780472+0000 mgr.smithi067.rdualw (mgr.24569) 5128 : audit [DBG] from='client.37558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:56:11.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:56:10.073751+0000 mgr.smithi067.rdualw (mgr.24569) 5129 : audit [DBG] from='client.37562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:56:11.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:56:10.445413+0000 mon.smithi061 (mon.0) 1191 : audit [DBG] from='client.? 172.21.15.61:0/962075871' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:56:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:10.674145+0000 mgr.smithi067.rdualw (mgr.24569) 5130 : cluster [DBG] pgmap v4420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:10.674145+0000 mgr.smithi067.rdualw (mgr.24569) 5130 : cluster [DBG] pgmap v4420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:14.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:12.674773+0000 mgr.smithi067.rdualw (mgr.24569) 5131 : cluster [DBG] pgmap v4421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:14.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:12.674773+0000 mgr.smithi067.rdualw (mgr.24569) 5131 : cluster [DBG] pgmap v4421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:16.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:14.675462+0000 mgr.smithi067.rdualw (mgr.24569) 5132 : cluster [DBG] pgmap v4422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:16.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:14.675462+0000 mgr.smithi067.rdualw (mgr.24569) 5132 : cluster [DBG] pgmap v4422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:18.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:16.676323+0000 mgr.smithi067.rdualw (mgr.24569) 5133 : cluster [DBG] pgmap v4423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:56:18.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:16.676323+0000 mgr.smithi067.rdualw (mgr.24569) 5133 : cluster [DBG] pgmap v4423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:56:20.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:18.677006+0000 mgr.smithi067.rdualw (mgr.24569) 5134 : cluster [DBG] pgmap v4424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:20.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:18.677006+0000 mgr.smithi067.rdualw (mgr.24569) 5134 : cluster [DBG] pgmap v4424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:20.677956+0000 mgr.smithi067.rdualw (mgr.24569) 5135 : cluster [DBG] pgmap v4425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:20.677956+0000 mgr.smithi067.rdualw (mgr.24569) 5135 : cluster [DBG] pgmap v4425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:22.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:56:21.804875+0000 mon.smithi067 (mon.1) 800 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:56:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:56:21.806238+0000 mon.smithi067 (mon.1) 801 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:56:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:56:21.807181+0000 mon.smithi067 (mon.1) 802 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:56:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:56:21.808076+0000 mgr.smithi067.rdualw (mgr.24569) 5136 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:56:23.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:56:21.804875+0000 mon.smithi067 (mon.1) 800 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:56:23.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:56:21.806238+0000 mon.smithi067 (mon.1) 801 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:56:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:56:21.807181+0000 mon.smithi067 (mon.1) 802 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:56:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:56:21.808076+0000 mgr.smithi067.rdualw (mgr.24569) 5136 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:56:23.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:22.678624+0000 mgr.smithi067.rdualw (mgr.24569) 5137 : cluster [DBG] pgmap v4426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:24.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:22.678624+0000 mgr.smithi067.rdualw (mgr.24569) 5137 : cluster [DBG] pgmap v4426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:26.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:24.679149+0000 mgr.smithi067.rdualw (mgr.24569) 5138 : cluster [DBG] pgmap v4427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:26.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:56:25.019173+0000 mon.smithi061 (mon.0) 1192 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:56:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:56:25.445751+0000 mon.smithi061 (mon.0) 1193 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:56:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:56:25.452825+0000 mon.smithi061 (mon.0) 1194 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:56:26.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:24.679149+0000 mgr.smithi067.rdualw (mgr.24569) 5138 : cluster [DBG] pgmap v4427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:26.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:56:25.019173+0000 mon.smithi061 (mon.0) 1192 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:56:26.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:56:25.445751+0000 mon.smithi061 (mon.0) 1193 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:56:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:56:25.452825+0000 mon.smithi061 (mon.0) 1194 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:56:28.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:26.679980+0000 mgr.smithi067.rdualw (mgr.24569) 5139 : cluster [DBG] pgmap v4428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:56:28.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:26.679980+0000 mgr.smithi067.rdualw (mgr.24569) 5139 : cluster [DBG] pgmap v4428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:56:30.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:28.680702+0000 mgr.smithi067.rdualw (mgr.24569) 5140 : cluster [DBG] pgmap v4429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:30.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:28.680702+0000 mgr.smithi067.rdualw (mgr.24569) 5140 : cluster [DBG] pgmap v4429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:30.681593+0000 mgr.smithi067.rdualw (mgr.24569) 5141 : cluster [DBG] pgmap v4430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:30.681593+0000 mgr.smithi067.rdualw (mgr.24569) 5141 : cluster [DBG] pgmap v4430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:34.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:32.682277+0000 mgr.smithi067.rdualw (mgr.24569) 5142 : cluster [DBG] pgmap v4431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:34.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:32.682277+0000 mgr.smithi067.rdualw (mgr.24569) 5142 : cluster [DBG] pgmap v4431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:34.682880+0000 mgr.smithi067.rdualw (mgr.24569) 5143 : cluster [DBG] pgmap v4432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:56:35.236849+0000 mon.smithi067 (mon.1) 803 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:56:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:56:35.237117+0000 mon.smithi067 (mon.1) 804 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:56:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:56:35.237221+0000 mon.smithi061 (mon.0) 1195 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:56:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:56:35.237608+0000 mon.smithi061 (mon.0) 1196 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:56:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:34.682880+0000 mgr.smithi067.rdualw (mgr.24569) 5143 : cluster [DBG] pgmap v4432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:56:35.236849+0000 mon.smithi067 (mon.1) 803 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:56:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:56:35.237117+0000 mon.smithi067 (mon.1) 804 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:56:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:56:35.237221+0000 mon.smithi061 (mon.0) 1195 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:56:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:56:35.237608+0000 mon.smithi061 (mon.0) 1196 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:56:38.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:36.683763+0000 mgr.smithi067.rdualw (mgr.24569) 5144 : cluster [DBG] pgmap v4433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:56:38.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:36.683763+0000 mgr.smithi067.rdualw (mgr.24569) 5144 : cluster [DBG] pgmap v4433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:56:40.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:38.684384+0000 mgr.smithi067.rdualw (mgr.24569) 5145 : cluster [DBG] pgmap v4434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:40.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:38.684384+0000 mgr.smithi067.rdualw (mgr.24569) 5145 : cluster [DBG] pgmap v4434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:40.758 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:56:41.053 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:56:41.053 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 3m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:56:41.054 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 3m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:56:41.054 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 3m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:56:41.054 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 3m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:56:41.054 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 3m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:56:41.054 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 3m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:56:41.055 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 3m ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:56:41.055 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 3m ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:56:41.055 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 3m ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:56:41.055 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 3m ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:56:41.056 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 3m ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:56:41.056 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 3m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:56:41.056 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 3m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:56:41.056 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 3m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:56:41.057 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 3m ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:56:41.057 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 3m ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:56:41.057 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 3m ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:56:41.057 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 3m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:56:41.057 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 3m ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:56:41.058 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 3m ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:56:41.058 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 3m ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:56:41.058 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 3m ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:56:41.058 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 3m ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:56:41.395 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:56:41.396 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:56:41.396 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:56:41.396 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:56:41.397 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:56:41.397 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:56:41.397 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:56:41.397 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:56:41.397 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:56:41.398 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:56:41.398 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:56:41.398 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:56:41.398 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:56:41.399 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:56:41.399 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:56:41.399 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:56:41.399 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:56:41.400 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:56:41.400 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:56:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:40.685343+0000 mgr.smithi067.rdualw (mgr.24569) 5146 : cluster [DBG] pgmap v4435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:56:40.746130+0000 mgr.smithi067.rdualw (mgr.24569) 5147 : audit [DBG] from='client.37570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:56:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:56:41.037544+0000 mgr.smithi067.rdualw (mgr.24569) 5148 : audit [DBG] from='client.37574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:56:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:56:41.395781+0000 mon.smithi061 (mon.0) 1197 : audit [DBG] from='client.? 172.21.15.61:0/642716315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:56:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:40.685343+0000 mgr.smithi067.rdualw (mgr.24569) 5146 : cluster [DBG] pgmap v4435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:42.117 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:56:40.746130+0000 mgr.smithi067.rdualw (mgr.24569) 5147 : audit [DBG] from='client.37570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:56:42.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:56:41.037544+0000 mgr.smithi067.rdualw (mgr.24569) 5148 : audit [DBG] from='client.37574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:56:42.118 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:56:41.395781+0000 mon.smithi061 (mon.0) 1197 : audit [DBG] from='client.? 172.21.15.61:0/642716315' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:56:44.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:42.686012+0000 mgr.smithi067.rdualw (mgr.24569) 5149 : cluster [DBG] pgmap v4436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:44.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:42.686012+0000 mgr.smithi067.rdualw (mgr.24569) 5149 : cluster [DBG] pgmap v4436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:46.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:44.686680+0000 mgr.smithi067.rdualw (mgr.24569) 5150 : cluster [DBG] pgmap v4437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:46.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:44.686680+0000 mgr.smithi067.rdualw (mgr.24569) 5150 : cluster [DBG] pgmap v4437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:48.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:46.687705+0000 mgr.smithi067.rdualw (mgr.24569) 5151 : cluster [DBG] pgmap v4438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:56:48.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:46.687705+0000 mgr.smithi067.rdualw (mgr.24569) 5151 : cluster [DBG] pgmap v4438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:56:50.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:48.688169+0000 mgr.smithi067.rdualw (mgr.24569) 5152 : cluster [DBG] pgmap v4439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:50.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:48.688169+0000 mgr.smithi067.rdualw (mgr.24569) 5152 : cluster [DBG] pgmap v4439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:50.689111+0000 mgr.smithi067.rdualw (mgr.24569) 5153 : cluster [DBG] pgmap v4440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:50.689111+0000 mgr.smithi067.rdualw (mgr.24569) 5153 : cluster [DBG] pgmap v4440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:54.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:52.689767+0000 mgr.smithi067.rdualw (mgr.24569) 5154 : cluster [DBG] pgmap v4441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:54.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:52.689767+0000 mgr.smithi067.rdualw (mgr.24569) 5154 : cluster [DBG] pgmap v4441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:56.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:54.690399+0000 mgr.smithi067.rdualw (mgr.24569) 5155 : cluster [DBG] pgmap v4442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:56.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:54.690399+0000 mgr.smithi067.rdualw (mgr.24569) 5155 : cluster [DBG] pgmap v4442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:56:58.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:56.691233+0000 mgr.smithi067.rdualw (mgr.24569) 5156 : cluster [DBG] pgmap v4443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:56:58.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:56.691233+0000 mgr.smithi067.rdualw (mgr.24569) 5156 : cluster [DBG] pgmap v4443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:57:00.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:56:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:56:58.691881+0000 mgr.smithi067.rdualw (mgr.24569) 5157 : cluster [DBG] pgmap v4444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:00.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:56:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:56:58.691881+0000 mgr.smithi067.rdualw (mgr.24569) 5157 : cluster [DBG] pgmap v4444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:00.692757+0000 mgr.smithi067.rdualw (mgr.24569) 5158 : cluster [DBG] pgmap v4445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:00.692757+0000 mgr.smithi067.rdualw (mgr.24569) 5158 : cluster [DBG] pgmap v4445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:04.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:02.693309+0000 mgr.smithi067.rdualw (mgr.24569) 5159 : cluster [DBG] pgmap v4446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:04.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:02.693309+0000 mgr.smithi067.rdualw (mgr.24569) 5159 : cluster [DBG] pgmap v4446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:06.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:04.693908+0000 mgr.smithi067.rdualw (mgr.24569) 5160 : cluster [DBG] pgmap v4447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:06.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:04.693908+0000 mgr.smithi067.rdualw (mgr.24569) 5160 : cluster [DBG] pgmap v4447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:08.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:06.694733+0000 mgr.smithi067.rdualw (mgr.24569) 5161 : cluster [DBG] pgmap v4448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:57:08.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:06.694733+0000 mgr.smithi067.rdualw (mgr.24569) 5161 : cluster [DBG] pgmap v4448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:57:10.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:08.695363+0000 mgr.smithi067.rdualw (mgr.24569) 5162 : cluster [DBG] pgmap v4449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:08.695363+0000 mgr.smithi067.rdualw (mgr.24569) 5162 : cluster [DBG] pgmap v4449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:11.704 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:57:12.022 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:57:12.023 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 3m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:57:12.023 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 3m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:57:12.023 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 3m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:57:12.023 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 3m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:57:12.024 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 3m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:57:12.024 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 3m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:57:12.024 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 3m ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:57:12.024 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 3m ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:57:12.024 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 3m ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:57:12.025 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 3m ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:57:12.025 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 3m ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:57:12.025 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 3m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:57:12.025 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 3m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:57:12.026 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 3m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:57:12.026 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 3m ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:57:12.026 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 3m ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:57:12.026 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 3m ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:57:12.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 3m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:57:12.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 3m ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:57:12.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 3m ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:57:12.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 3m ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:57:12.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 3m ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:57:12.028 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 3m ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:57:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:10.696232+0000 mgr.smithi067.rdualw (mgr.24569) 5163 : cluster [DBG] pgmap v4450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:10.696232+0000 mgr.smithi067.rdualw (mgr.24569) 5163 : cluster [DBG] pgmap v4450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:12.391 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:57:12.392 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:57:12.392 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:57:12.392 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:57:12.393 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:57:12.393 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:57:12.393 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:57:12.393 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:57:12.393 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:57:12.394 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:57:12.394 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:57:12.394 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:57:12.394 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:57:12.395 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:57:12.395 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:57:12.395 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:57:12.395 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:57:12.395 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:57:12.396 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:57:13.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:57:11.691766+0000 mgr.smithi067.rdualw (mgr.24569) 5164 : audit [DBG] from='client.37582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:57:13.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:57:12.006062+0000 mgr.smithi067.rdualw (mgr.24569) 5165 : audit [DBG] from='client.37586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:57:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:57:12.391690+0000 mon.smithi061 (mon.0) 1198 : audit [DBG] from='client.? 172.21.15.61:0/2545796067' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:57:13.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:57:11.691766+0000 mgr.smithi067.rdualw (mgr.24569) 5164 : audit [DBG] from='client.37582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:57:13.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:57:12.006062+0000 mgr.smithi067.rdualw (mgr.24569) 5165 : audit [DBG] from='client.37586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:57:13.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:57:12.391690+0000 mon.smithi061 (mon.0) 1198 : audit [DBG] from='client.? 172.21.15.61:0/2545796067' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:57:14.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:12.696930+0000 mgr.smithi067.rdualw (mgr.24569) 5166 : cluster [DBG] pgmap v4451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:14.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:12.696930+0000 mgr.smithi067.rdualw (mgr.24569) 5166 : cluster [DBG] pgmap v4451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:16.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:14.697642+0000 mgr.smithi067.rdualw (mgr.24569) 5167 : cluster [DBG] pgmap v4452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:16.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:14.697642+0000 mgr.smithi067.rdualw (mgr.24569) 5167 : cluster [DBG] pgmap v4452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:18.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:16.698624+0000 mgr.smithi067.rdualw (mgr.24569) 5168 : cluster [DBG] pgmap v4453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:57:18.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:16.698624+0000 mgr.smithi067.rdualw (mgr.24569) 5168 : cluster [DBG] pgmap v4453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:57:20.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:18.699346+0000 mgr.smithi067.rdualw (mgr.24569) 5169 : cluster [DBG] pgmap v4454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:20.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:18.699346+0000 mgr.smithi067.rdualw (mgr.24569) 5169 : cluster [DBG] pgmap v4454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:20.700329+0000 mgr.smithi067.rdualw (mgr.24569) 5170 : cluster [DBG] pgmap v4455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:20.700329+0000 mgr.smithi067.rdualw (mgr.24569) 5170 : cluster [DBG] pgmap v4455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:24.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:22.700974+0000 mgr.smithi067.rdualw (mgr.24569) 5171 : cluster [DBG] pgmap v4456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:24.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:22.700974+0000 mgr.smithi067.rdualw (mgr.24569) 5171 : cluster [DBG] pgmap v4456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:26.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:24.701527+0000 mgr.smithi067.rdualw (mgr.24569) 5172 : cluster [DBG] pgmap v4457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:26.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:57:25.457423+0000 mon.smithi067 (mon.1) 805 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:57:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:57:25.458854+0000 mon.smithi067 (mon.1) 806 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:57:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:57:25.459781+0000 mon.smithi067 (mon.1) 807 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:57:26.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:24.701527+0000 mgr.smithi067.rdualw (mgr.24569) 5172 : cluster [DBG] pgmap v4457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:26.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:57:25.457423+0000 mon.smithi067 (mon.1) 805 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:57:26.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:57:25.458854+0000 mon.smithi067 (mon.1) 806 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:57:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:57:25.459781+0000 mon.smithi067 (mon.1) 807 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:57:27.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:57:25.460648+0000 mgr.smithi067.rdualw (mgr.24569) 5173 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:57:27.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:57:25.460648+0000 mgr.smithi067.rdualw (mgr.24569) 5173 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:57:27.999 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:26.702244+0000 mgr.smithi067.rdualw (mgr.24569) 5174 : cluster [DBG] pgmap v4458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:57:28.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:26.702244+0000 mgr.smithi067.rdualw (mgr.24569) 5174 : cluster [DBG] pgmap v4458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:57:29.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:57:28.278440+0000 mon.smithi061 (mon.0) 1199 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:57:29.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:57:28.680601+0000 mon.smithi061 (mon.0) 1200 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:57:29.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:57:28.686576+0000 mon.smithi061 (mon.0) 1201 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:57:29.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:57:28.278440+0000 mon.smithi061 (mon.0) 1199 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:57:29.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:57:28.680601+0000 mon.smithi061 (mon.0) 1200 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:57:29.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:57:28.686576+0000 mon.smithi061 (mon.0) 1201 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:57:30.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:28.702651+0000 mgr.smithi067.rdualw (mgr.24569) 5175 : cluster [DBG] pgmap v4459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:30.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:28.702651+0000 mgr.smithi067.rdualw (mgr.24569) 5175 : cluster [DBG] pgmap v4459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:30.703445+0000 mgr.smithi067.rdualw (mgr.24569) 5176 : cluster [DBG] pgmap v4460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:30.703445+0000 mgr.smithi067.rdualw (mgr.24569) 5176 : cluster [DBG] pgmap v4460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:34.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:32.703972+0000 mgr.smithi067.rdualw (mgr.24569) 5177 : cluster [DBG] pgmap v4461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:34.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:32.703972+0000 mgr.smithi067.rdualw (mgr.24569) 5177 : cluster [DBG] pgmap v4461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:34.704563+0000 mgr.smithi067.rdualw (mgr.24569) 5178 : cluster [DBG] pgmap v4462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:57:35.242026+0000 mon.smithi067 (mon.1) 808 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:57:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:57:35.242285+0000 mon.smithi067 (mon.1) 809 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:57:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:57:35.242371+0000 mon.smithi061 (mon.0) 1202 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:57:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:57:35.242664+0000 mon.smithi061 (mon.0) 1203 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:57:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:34.704563+0000 mgr.smithi067.rdualw (mgr.24569) 5178 : cluster [DBG] pgmap v4462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:57:35.242026+0000 mon.smithi067 (mon.1) 808 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:57:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:57:35.242285+0000 mon.smithi067 (mon.1) 809 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:57:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:57:35.242371+0000 mon.smithi061 (mon.0) 1202 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:57:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:57:35.242664+0000 mon.smithi061 (mon.0) 1203 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:57:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:36.705599+0000 mgr.smithi067.rdualw (mgr.24569) 5179 : cluster [DBG] pgmap v4463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:57:38.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:36.705599+0000 mgr.smithi067.rdualw (mgr.24569) 5179 : cluster [DBG] pgmap v4463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:57:40.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:38.706160+0000 mgr.smithi067.rdualw (mgr.24569) 5180 : cluster [DBG] pgmap v4464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:40.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:38.706160+0000 mgr.smithi067.rdualw (mgr.24569) 5180 : cluster [DBG] pgmap v4464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:40.707230+0000 mgr.smithi067.rdualw (mgr.24569) 5181 : cluster [DBG] pgmap v4465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:40.707230+0000 mgr.smithi067.rdualw (mgr.24569) 5181 : cluster [DBG] pgmap v4465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:42.700 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:57:42.991 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:57:42.992 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 4m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:57:42.992 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 4m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:57:42.992 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 4m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:57:42.992 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 4m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:57:42.993 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 4m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:57:42.993 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 4m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:57:42.993 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 4m ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:57:42.994 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 4m ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:57:42.994 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 4m ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:57:42.994 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 4m ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:57:42.994 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 4m ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:57:42.995 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 4m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:57:42.995 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 4m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:57:42.995 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 4m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:57:42.995 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 4m ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:57:42.995 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 4m ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:57:42.996 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 4m ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:57:42.996 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 4m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:57:42.996 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 4m ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:57:42.996 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 4m ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:57:42.997 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 4m ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:57:42.997 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 4m ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:57:42.997 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 4m ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:57:43.330 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:57:43.331 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:57:43.331 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:57:43.331 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:57:43.331 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:57:43.332 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:57:43.332 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:57:43.332 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:57:43.332 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:57:43.332 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:57:43.333 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:57:43.333 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:57:43.333 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:57:43.333 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:57:43.334 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:57:43.334 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:57:43.334 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:57:43.334 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:57:43.334 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:57:44.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:57:42.686352+0000 mgr.smithi067.rdualw (mgr.24569) 5182 : audit [DBG] from='client.37594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:57:44.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:42.707765+0000 mgr.smithi067.rdualw (mgr.24569) 5183 : cluster [DBG] pgmap v4466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:57:42.975587+0000 mgr.smithi067.rdualw (mgr.24569) 5184 : audit [DBG] from='client.37598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:57:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:57:43.330704+0000 mon.smithi061 (mon.0) 1204 : audit [DBG] from='client.? 172.21.15.61:0/1741086491' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:57:44.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:57:42.686352+0000 mgr.smithi067.rdualw (mgr.24569) 5182 : audit [DBG] from='client.37594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:57:44.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:42.707765+0000 mgr.smithi067.rdualw (mgr.24569) 5183 : cluster [DBG] pgmap v4466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:44.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:57:42.975587+0000 mgr.smithi067.rdualw (mgr.24569) 5184 : audit [DBG] from='client.37598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:57:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:57:43.330704+0000 mon.smithi061 (mon.0) 1204 : audit [DBG] from='client.? 172.21.15.61:0/1741086491' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:57:46.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:44.708409+0000 mgr.smithi067.rdualw (mgr.24569) 5185 : cluster [DBG] pgmap v4467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:46.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:44.708409+0000 mgr.smithi067.rdualw (mgr.24569) 5185 : cluster [DBG] pgmap v4467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:48.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:46.709295+0000 mgr.smithi067.rdualw (mgr.24569) 5186 : cluster [DBG] pgmap v4468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:57:48.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:46.709295+0000 mgr.smithi067.rdualw (mgr.24569) 5186 : cluster [DBG] pgmap v4468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:57:50.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:48.710013+0000 mgr.smithi067.rdualw (mgr.24569) 5187 : cluster [DBG] pgmap v4469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:50.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:48.710013+0000 mgr.smithi067.rdualw (mgr.24569) 5187 : cluster [DBG] pgmap v4469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:50.710814+0000 mgr.smithi067.rdualw (mgr.24569) 5188 : cluster [DBG] pgmap v4470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:50.710814+0000 mgr.smithi067.rdualw (mgr.24569) 5188 : cluster [DBG] pgmap v4470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:54.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:52.711298+0000 mgr.smithi067.rdualw (mgr.24569) 5189 : cluster [DBG] pgmap v4471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:54.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:52.711298+0000 mgr.smithi067.rdualw (mgr.24569) 5189 : cluster [DBG] pgmap v4471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:56.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:54.711963+0000 mgr.smithi067.rdualw (mgr.24569) 5190 : cluster [DBG] pgmap v4472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:56.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:54.711963+0000 mgr.smithi067.rdualw (mgr.24569) 5190 : cluster [DBG] pgmap v4472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:57:58.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:56.712866+0000 mgr.smithi067.rdualw (mgr.24569) 5191 : cluster [DBG] pgmap v4473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:57:58.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:56.712866+0000 mgr.smithi067.rdualw (mgr.24569) 5191 : cluster [DBG] pgmap v4473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:58:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:57:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:57:58.713442+0000 mgr.smithi067.rdualw (mgr.24569) 5192 : cluster [DBG] pgmap v4474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:00.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:57:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:57:58.713442+0000 mgr.smithi067.rdualw (mgr.24569) 5192 : cluster [DBG] pgmap v4474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:00.714364+0000 mgr.smithi067.rdualw (mgr.24569) 5193 : cluster [DBG] pgmap v4475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:00.714364+0000 mgr.smithi067.rdualw (mgr.24569) 5193 : cluster [DBG] pgmap v4475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:04.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:02.714932+0000 mgr.smithi067.rdualw (mgr.24569) 5194 : cluster [DBG] pgmap v4476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:04.268 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:02.714932+0000 mgr.smithi067.rdualw (mgr.24569) 5194 : cluster [DBG] pgmap v4476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:06.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:04.715557+0000 mgr.smithi067.rdualw (mgr.24569) 5195 : cluster [DBG] pgmap v4477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:06.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:04.715557+0000 mgr.smithi067.rdualw (mgr.24569) 5195 : cluster [DBG] pgmap v4477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:08.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:06.716395+0000 mgr.smithi067.rdualw (mgr.24569) 5196 : cluster [DBG] pgmap v4478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:58:08.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:06.716395+0000 mgr.smithi067.rdualw (mgr.24569) 5196 : cluster [DBG] pgmap v4478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:58:10.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:08.717075+0000 mgr.smithi067.rdualw (mgr.24569) 5197 : cluster [DBG] pgmap v4479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:10.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:08.717075+0000 mgr.smithi067.rdualw (mgr.24569) 5197 : cluster [DBG] pgmap v4479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:10.718126+0000 mgr.smithi067.rdualw (mgr.24569) 5198 : cluster [DBG] pgmap v4480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:10.718126+0000 mgr.smithi067.rdualw (mgr.24569) 5198 : cluster [DBG] pgmap v4480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:13.635 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:58:13.929 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:58:13.929 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 4m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:58:13.929 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 4m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:58:13.930 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 4m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:58:13.930 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 4m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:58:13.930 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 4m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:58:13.931 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 4m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:58:13.931 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 4m ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:58:13.931 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 4m ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:58:13.932 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 4m ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:58:13.932 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 4m ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:58:13.932 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 4m ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:58:13.933 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 4m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:58:13.933 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 4m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:58:13.933 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 4m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:58:13.933 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 4m ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:58:13.933 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 4m ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:58:13.934 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 4m ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:58:13.934 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 4m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:58:13.934 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 4m ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:58:13.934 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 4m ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:58:13.935 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 4m ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:58:13.935 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 4m ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:58:13.935 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 4m ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:58:14.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:12.718637+0000 mgr.smithi067.rdualw (mgr.24569) 5199 : cluster [DBG] pgmap v4481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:14.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:12.718637+0000 mgr.smithi067.rdualw (mgr.24569) 5199 : cluster [DBG] pgmap v4481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:14.316 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:58:14.317 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:58:14.317 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:58:14.317 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:58:14.317 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:58:14.318 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:58:14.318 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:58:14.319 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:58:14.319 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:58:14.319 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:58:14.319 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:58:14.320 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:58:14.320 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:58:14.320 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:58:14.320 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:58:14.321 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:58:14.321 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:58:14.321 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:58:14.321 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:58:15.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:58:13.624002+0000 mgr.smithi067.rdualw (mgr.24569) 5200 : audit [DBG] from='client.37606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:58:15.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:58:13.912574+0000 mgr.smithi067.rdualw (mgr.24569) 5201 : audit [DBG] from='client.37610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:58:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:58:14.316583+0000 mon.smithi061 (mon.0) 1205 : audit [DBG] from='client.? 172.21.15.61:0/1331023395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:58:15.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:58:13.624002+0000 mgr.smithi067.rdualw (mgr.24569) 5200 : audit [DBG] from='client.37606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:58:15.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:58:13.912574+0000 mgr.smithi067.rdualw (mgr.24569) 5201 : audit [DBG] from='client.37610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:58:15.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:58:14.316583+0000 mon.smithi061 (mon.0) 1205 : audit [DBG] from='client.? 172.21.15.61:0/1331023395' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:58:16.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:14.719325+0000 mgr.smithi067.rdualw (mgr.24569) 5202 : cluster [DBG] pgmap v4482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:16.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:14.719325+0000 mgr.smithi067.rdualw (mgr.24569) 5202 : cluster [DBG] pgmap v4482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:18.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:16.720344+0000 mgr.smithi067.rdualw (mgr.24569) 5203 : cluster [DBG] pgmap v4483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:58:18.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:16.720344+0000 mgr.smithi067.rdualw (mgr.24569) 5203 : cluster [DBG] pgmap v4483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:58:20.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:18.720895+0000 mgr.smithi067.rdualw (mgr.24569) 5204 : cluster [DBG] pgmap v4484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:20.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:18.720895+0000 mgr.smithi067.rdualw (mgr.24569) 5204 : cluster [DBG] pgmap v4484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:20.721813+0000 mgr.smithi067.rdualw (mgr.24569) 5205 : cluster [DBG] pgmap v4485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:20.721813+0000 mgr.smithi067.rdualw (mgr.24569) 5205 : cluster [DBG] pgmap v4485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:24.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:22.722366+0000 mgr.smithi067.rdualw (mgr.24569) 5206 : cluster [DBG] pgmap v4486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:24.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:22.722366+0000 mgr.smithi067.rdualw (mgr.24569) 5206 : cluster [DBG] pgmap v4486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:26.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:24.722942+0000 mgr.smithi067.rdualw (mgr.24569) 5207 : cluster [DBG] pgmap v4487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:26.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:24.722942+0000 mgr.smithi067.rdualw (mgr.24569) 5207 : cluster [DBG] pgmap v4487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:28.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:26.723774+0000 mgr.smithi067.rdualw (mgr.24569) 5208 : cluster [DBG] pgmap v4488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:58:28.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:26.723774+0000 mgr.smithi067.rdualw (mgr.24569) 5208 : cluster [DBG] pgmap v4488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:58:29.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:58:28.692670+0000 mon.smithi067 (mon.1) 810 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:58:29.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:58:28.694132+0000 mon.smithi067 (mon.1) 811 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:58:29.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:58:28.695121+0000 mon.smithi067 (mon.1) 812 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:58:29.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:58:28.692670+0000 mon.smithi067 (mon.1) 810 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:58:29.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:58:28.694132+0000 mon.smithi067 (mon.1) 811 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:58:29.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:58:28.695121+0000 mon.smithi067 (mon.1) 812 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:58:30.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:58:28.695982+0000 mgr.smithi067.rdualw (mgr.24569) 5209 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:58:30.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:28.724287+0000 mgr.smithi067.rdualw (mgr.24569) 5210 : cluster [DBG] pgmap v4489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:58:29.119700+0000 mon.smithi061 (mon.0) 1206 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:58:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:58:29.125869+0000 mon.smithi061 (mon.0) 1207 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:58:30.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:58:28.695982+0000 mgr.smithi067.rdualw (mgr.24569) 5209 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:58:30.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:28.724287+0000 mgr.smithi067.rdualw (mgr.24569) 5210 : cluster [DBG] pgmap v4489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:30.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:58:29.119700+0000 mon.smithi061 (mon.0) 1206 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:58:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:58:29.125869+0000 mon.smithi061 (mon.0) 1207 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:58:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:30.725215+0000 mgr.smithi067.rdualw (mgr.24569) 5211 : cluster [DBG] pgmap v4490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:32.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:30.725215+0000 mgr.smithi067.rdualw (mgr.24569) 5211 : cluster [DBG] pgmap v4490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:34.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:32.725823+0000 mgr.smithi067.rdualw (mgr.24569) 5212 : cluster [DBG] pgmap v4491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:34.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:32.725823+0000 mgr.smithi067.rdualw (mgr.24569) 5212 : cluster [DBG] pgmap v4491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:34.726594+0000 mgr.smithi067.rdualw (mgr.24569) 5213 : cluster [DBG] pgmap v4492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:58:35.247780+0000 mon.smithi067 (mon.1) 813 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:58:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:58:35.248022+0000 mon.smithi067 (mon.1) 814 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:58:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:58:35.248348+0000 mon.smithi061 (mon.0) 1208 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:58:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:58:35.248647+0000 mon.smithi061 (mon.0) 1209 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:58:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:34.726594+0000 mgr.smithi067.rdualw (mgr.24569) 5213 : cluster [DBG] pgmap v4492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:58:35.247780+0000 mon.smithi067 (mon.1) 813 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:58:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:58:35.248022+0000 mon.smithi067 (mon.1) 814 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:58:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:58:35.248348+0000 mon.smithi061 (mon.0) 1208 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:58:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:58:35.248647+0000 mon.smithi061 (mon.0) 1209 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:58:38.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:36.727376+0000 mgr.smithi067.rdualw (mgr.24569) 5214 : cluster [DBG] pgmap v4493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:58:38.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:36.727376+0000 mgr.smithi067.rdualw (mgr.24569) 5214 : cluster [DBG] pgmap v4493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:58:40.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:38.727854+0000 mgr.smithi067.rdualw (mgr.24569) 5215 : cluster [DBG] pgmap v4494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:40.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:38.727854+0000 mgr.smithi067.rdualw (mgr.24569) 5215 : cluster [DBG] pgmap v4494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:40.728826+0000 mgr.smithi067.rdualw (mgr.24569) 5216 : cluster [DBG] pgmap v4495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:40.728826+0000 mgr.smithi067.rdualw (mgr.24569) 5216 : cluster [DBG] pgmap v4495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:44.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:42.729488+0000 mgr.smithi067.rdualw (mgr.24569) 5217 : cluster [DBG] pgmap v4496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:44.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:42.729488+0000 mgr.smithi067.rdualw (mgr.24569) 5217 : cluster [DBG] pgmap v4496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:44.627 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:58:44.917 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:58:44.917 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 5m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:58:44.918 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 5m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:58:44.918 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 5m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:58:44.918 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 5m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:58:44.918 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 5m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:58:44.919 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 5m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:58:44.919 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 5m ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:58:44.919 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 5m ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:58:44.919 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 5m ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:58:44.919 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 5m ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:58:44.920 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 5m ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:58:44.920 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 5m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:58:44.920 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 5m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:58:44.920 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 5m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:58:44.920 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 5m ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:58:44.921 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 5m ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:58:44.921 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 5m ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:58:44.921 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 5m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:58:44.922 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 5m ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:58:44.922 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 5m ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:58:44.922 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 5m ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:58:44.922 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 5m ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:58:44.923 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 5m ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:58:45.258 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:58:45.258 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:58:45.259 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:58:45.259 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:58:45.259 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:58:45.259 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:58:45.260 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:58:45.260 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:58:45.260 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:58:45.260 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:58:45.260 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:58:45.261 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:58:45.261 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:58:45.261 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:58:45.261 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:58:45.261 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:58:45.262 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:58:45.262 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:58:45.262 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:58:46.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:58:44.614629+0000 mgr.smithi067.rdualw (mgr.24569) 5218 : audit [DBG] from='client.37618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:58:46.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:44.730133+0000 mgr.smithi067.rdualw (mgr.24569) 5219 : cluster [DBG] pgmap v4497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:58:44.900867+0000 mgr.smithi067.rdualw (mgr.24569) 5220 : audit [DBG] from='client.37622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:58:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:58:45.258434+0000 mon.smithi061 (mon.0) 1210 : audit [DBG] from='client.? 172.21.15.61:0/2314276950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:58:46.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:58:44.614629+0000 mgr.smithi067.rdualw (mgr.24569) 5218 : audit [DBG] from='client.37618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:58:46.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:44.730133+0000 mgr.smithi067.rdualw (mgr.24569) 5219 : cluster [DBG] pgmap v4497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:46.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:58:44.900867+0000 mgr.smithi067.rdualw (mgr.24569) 5220 : audit [DBG] from='client.37622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:58:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:58:45.258434+0000 mon.smithi061 (mon.0) 1210 : audit [DBG] from='client.? 172.21.15.61:0/2314276950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:58:48.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:46.731087+0000 mgr.smithi067.rdualw (mgr.24569) 5221 : cluster [DBG] pgmap v4498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:58:48.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:46.731087+0000 mgr.smithi067.rdualw (mgr.24569) 5221 : cluster [DBG] pgmap v4498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:58:50.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:48.731612+0000 mgr.smithi067.rdualw (mgr.24569) 5222 : cluster [DBG] pgmap v4499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:50.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:48.731612+0000 mgr.smithi067.rdualw (mgr.24569) 5222 : cluster [DBG] pgmap v4499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:50.732480+0000 mgr.smithi067.rdualw (mgr.24569) 5223 : cluster [DBG] pgmap v4500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:50.732480+0000 mgr.smithi067.rdualw (mgr.24569) 5223 : cluster [DBG] pgmap v4500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:54.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:52.733215+0000 mgr.smithi067.rdualw (mgr.24569) 5224 : cluster [DBG] pgmap v4501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:54.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:52.733215+0000 mgr.smithi067.rdualw (mgr.24569) 5224 : cluster [DBG] pgmap v4501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:56.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:54.733867+0000 mgr.smithi067.rdualw (mgr.24569) 5225 : cluster [DBG] pgmap v4502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:54.733867+0000 mgr.smithi067.rdualw (mgr.24569) 5225 : cluster [DBG] pgmap v4502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:58:58.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:56.735045+0000 mgr.smithi067.rdualw (mgr.24569) 5226 : cluster [DBG] pgmap v4503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:58:58.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:56.735045+0000 mgr.smithi067.rdualw (mgr.24569) 5226 : cluster [DBG] pgmap v4503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:59:00.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:58:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:58:58.735757+0000 mgr.smithi067.rdualw (mgr.24569) 5227 : cluster [DBG] pgmap v4504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:00.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:58:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:58:58.735757+0000 mgr.smithi067.rdualw (mgr.24569) 5227 : cluster [DBG] pgmap v4504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:00.736624+0000 mgr.smithi067.rdualw (mgr.24569) 5228 : cluster [DBG] pgmap v4505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:00.736624+0000 mgr.smithi067.rdualw (mgr.24569) 5228 : cluster [DBG] pgmap v4505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:04.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:02.737220+0000 mgr.smithi067.rdualw (mgr.24569) 5229 : cluster [DBG] pgmap v4506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:04.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:02.737220+0000 mgr.smithi067.rdualw (mgr.24569) 5229 : cluster [DBG] pgmap v4506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:06.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:04.738044+0000 mgr.smithi067.rdualw (mgr.24569) 5230 : cluster [DBG] pgmap v4507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:06.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:04.738044+0000 mgr.smithi067.rdualw (mgr.24569) 5230 : cluster [DBG] pgmap v4507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:08.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:06.738994+0000 mgr.smithi067.rdualw (mgr.24569) 5231 : cluster [DBG] pgmap v4508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:59:08.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:06.738994+0000 mgr.smithi067.rdualw (mgr.24569) 5231 : cluster [DBG] pgmap v4508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:59:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:08.739524+0000 mgr.smithi067.rdualw (mgr.24569) 5232 : cluster [DBG] pgmap v4509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:10.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:08.739524+0000 mgr.smithi067.rdualw (mgr.24569) 5232 : cluster [DBG] pgmap v4509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:10.740633+0000 mgr.smithi067.rdualw (mgr.24569) 5233 : cluster [DBG] pgmap v4510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:10.740633+0000 mgr.smithi067.rdualw (mgr.24569) 5233 : cluster [DBG] pgmap v4510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:14.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:12.741327+0000 mgr.smithi067.rdualw (mgr.24569) 5234 : cluster [DBG] pgmap v4511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:14.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:12.741327+0000 mgr.smithi067.rdualw (mgr.24569) 5234 : cluster [DBG] pgmap v4511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:15.565 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:59:15.857 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:59:15.858 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 5m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:59:15.858 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 5m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:59:15.858 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 5m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:59:15.859 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 5m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:59:15.859 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 5m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:59:15.859 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 5m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:59:15.860 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 5m ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:59:15.860 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 5m ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:59:15.860 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 5m ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:59:15.860 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 5m ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:59:15.861 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 5m ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:59:15.861 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 5m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:59:15.861 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 5m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:59:15.862 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 5m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:59:15.862 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 5m ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:59:15.862 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 5m ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:59:15.862 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 5m ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:59:15.863 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 5m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:59:15.863 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 5m ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:59:15.863 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 5m ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:59:15.863 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 5m ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:59:15.863 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 5m ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:59:15.864 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 5m ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:59:16.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:14.742176+0000 mgr.smithi067.rdualw (mgr.24569) 5235 : cluster [DBG] pgmap v4512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:16.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:14.742176+0000 mgr.smithi067.rdualw (mgr.24569) 5235 : cluster [DBG] pgmap v4512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:16.197 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:59:16.197 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:59:16.198 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:59:16.198 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:59:16.198 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:59:16.198 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:59:16.199 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:59:16.199 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:59:16.199 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:59:16.199 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:59:16.200 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:59:16.200 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:59:16.200 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:59:16.200 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:59:16.201 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:59:16.201 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:59:16.201 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:59:16.201 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:59:16.201 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:59:17.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:59:15.553867+0000 mgr.smithi067.rdualw (mgr.24569) 5236 : audit [DBG] from='client.37630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:59:17.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:59:15.841403+0000 mgr.smithi067.rdualw (mgr.24569) 5237 : audit [DBG] from='client.37634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:59:17.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:59:16.197534+0000 mon.smithi061 (mon.0) 1211 : audit [DBG] from='client.? 172.21.15.61:0/1595012743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:59:17.183 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:59:15.553867+0000 mgr.smithi067.rdualw (mgr.24569) 5236 : audit [DBG] from='client.37630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:59:17.183 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:59:15.841403+0000 mgr.smithi067.rdualw (mgr.24569) 5237 : audit [DBG] from='client.37634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:59:17.184 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:59:16.197534+0000 mon.smithi061 (mon.0) 1211 : audit [DBG] from='client.? 172.21.15.61:0/1595012743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:59:18.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:16.743311+0000 mgr.smithi067.rdualw (mgr.24569) 5238 : cluster [DBG] pgmap v4513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:59:18.180 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:16.743311+0000 mgr.smithi067.rdualw (mgr.24569) 5238 : cluster [DBG] pgmap v4513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:59:20.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:18.743880+0000 mgr.smithi067.rdualw (mgr.24569) 5239 : cluster [DBG] pgmap v4514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:20.181 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:18.743880+0000 mgr.smithi067.rdualw (mgr.24569) 5239 : cluster [DBG] pgmap v4514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:20.744917+0000 mgr.smithi067.rdualw (mgr.24569) 5240 : cluster [DBG] pgmap v4515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:20.744917+0000 mgr.smithi067.rdualw (mgr.24569) 5240 : cluster [DBG] pgmap v4515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:24.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:22.745423+0000 mgr.smithi067.rdualw (mgr.24569) 5241 : cluster [DBG] pgmap v4516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:24.181 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:22.745423+0000 mgr.smithi067.rdualw (mgr.24569) 5241 : cluster [DBG] pgmap v4516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:26.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:24.746146+0000 mgr.smithi067.rdualw (mgr.24569) 5242 : cluster [DBG] pgmap v4517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:26.182 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:24.746146+0000 mgr.smithi067.rdualw (mgr.24569) 5242 : cluster [DBG] pgmap v4517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:28.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:26.747153+0000 mgr.smithi067.rdualw (mgr.24569) 5243 : cluster [DBG] pgmap v4518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:59:28.182 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:26.747153+0000 mgr.smithi067.rdualw (mgr.24569) 5243 : cluster [DBG] pgmap v4518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:59:30.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:28.747907+0000 mgr.smithi067.rdualw (mgr.24569) 5244 : cluster [DBG] pgmap v4519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:30.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:59:29.129659+0000 mon.smithi067 (mon.1) 815 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:59:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:59:29.131074+0000 mon.smithi067 (mon.1) 816 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:59:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:59:29.131980+0000 mon.smithi067 (mon.1) 817 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:59:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T17:59:29.132815+0000 mgr.smithi067.rdualw (mgr.24569) 5245 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:59:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:59:29.549408+0000 mon.smithi061 (mon.0) 1212 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:59:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:59:29.557489+0000 mon.smithi061 (mon.0) 1213 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:59:30.182 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:28.747907+0000 mgr.smithi067.rdualw (mgr.24569) 5244 : cluster [DBG] pgmap v4519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:30.183 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:59:29.129659+0000 mon.smithi067 (mon.1) 815 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T17:59:30.183 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:59:29.131074+0000 mon.smithi067 (mon.1) 816 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T17:59:30.183 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:59:29.131980+0000 mon.smithi067 (mon.1) 817 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T17:59:30.183 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T17:59:29.132815+0000 mgr.smithi067.rdualw (mgr.24569) 5245 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T17:59:30.184 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:59:29.549408+0000 mon.smithi061 (mon.0) 1212 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:59:30.184 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:59:29.557489+0000 mon.smithi061 (mon.0) 1213 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T17:59:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:30.748763+0000 mgr.smithi067.rdualw (mgr.24569) 5246 : cluster [DBG] pgmap v4520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:30.748763+0000 mgr.smithi067.rdualw (mgr.24569) 5246 : cluster [DBG] pgmap v4520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:34.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:32.749237+0000 mgr.smithi067.rdualw (mgr.24569) 5247 : cluster [DBG] pgmap v4521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:34.183 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:32.749237+0000 mgr.smithi067.rdualw (mgr.24569) 5247 : cluster [DBG] pgmap v4521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:34.749784+0000 mgr.smithi067.rdualw (mgr.24569) 5248 : cluster [DBG] pgmap v4522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:59:35.253570+0000 mon.smithi067 (mon.1) 818 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:59:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:59:35.253816+0000 mon.smithi067 (mon.1) 819 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:59:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:59:35.253972+0000 mon.smithi061 (mon.0) 1214 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:59:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:59:35.254190+0000 mon.smithi061 (mon.0) 1215 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:59:36.183 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:34.749784+0000 mgr.smithi067.rdualw (mgr.24569) 5248 : cluster [DBG] pgmap v4522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:36.183 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:59:35.253570+0000 mon.smithi067 (mon.1) 818 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:59:36.184 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:59:35.253816+0000 mon.smithi067 (mon.1) 819 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:59:36.184 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:59:35.253972+0000 mon.smithi061 (mon.0) 1214 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T17:59:36.184 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:59:35.254190+0000 mon.smithi061 (mon.0) 1215 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T17:59:38.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:36.750789+0000 mgr.smithi067.rdualw (mgr.24569) 5249 : cluster [DBG] pgmap v4523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:59:38.183 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:36.750789+0000 mgr.smithi067.rdualw (mgr.24569) 5249 : cluster [DBG] pgmap v4523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:59:40.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:38.751332+0000 mgr.smithi067.rdualw (mgr.24569) 5250 : cluster [DBG] pgmap v4524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:40.184 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:38.751332+0000 mgr.smithi067.rdualw (mgr.24569) 5250 : cluster [DBG] pgmap v4524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:40.752171+0000 mgr.smithi067.rdualw (mgr.24569) 5251 : cluster [DBG] pgmap v4525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:40.752171+0000 mgr.smithi067.rdualw (mgr.24569) 5251 : cluster [DBG] pgmap v4525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:44.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:42.752803+0000 mgr.smithi067.rdualw (mgr.24569) 5252 : cluster [DBG] pgmap v4526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:44.184 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:42.752803+0000 mgr.smithi067.rdualw (mgr.24569) 5252 : cluster [DBG] pgmap v4526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:46.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:44.753500+0000 mgr.smithi067.rdualw (mgr.24569) 5253 : cluster [DBG] pgmap v4527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:46.185 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:44.753500+0000 mgr.smithi067.rdualw (mgr.24569) 5253 : cluster [DBG] pgmap v4527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:46.501 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T17:59:46.789 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T17:59:46.790 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 6m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T17:59:46.790 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 6m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T17:59:46.790 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 6m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T17:59:46.791 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 6m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T17:59:46.791 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 6m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T17:59:46.791 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 6m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T17:59:46.791 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 6m ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T17:59:46.791 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 6m ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T17:59:46.792 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 6m ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T17:59:46.792 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 6m ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T17:59:46.792 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 6m ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T17:59:46.792 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 6m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T17:59:46.793 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 6m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T17:59:46.793 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 6m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T17:59:46.793 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 6m ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T17:59:46.793 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 6m ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T17:59:46.793 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 6m ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T17:59:46.794 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 6m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T17:59:46.794 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 6m ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T17:59:46.795 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 6m ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T17:59:46.795 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 6m ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T17:59:46.795 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 6m ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T17:59:46.795 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 6m ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T17:59:47.182 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T17:59:47.183 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T17:59:47.183 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T17:59:47.184 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:59:47.184 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T17:59:47.185 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:59:47.185 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:59:47.186 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T17:59:47.186 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T17:59:47.187 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T17:59:47.187 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:59:47.187 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T17:59:47.188 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T17:59:47.188 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T17:59:47.189 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T17:59:47.189 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T17:59:47.190 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T17:59:47.190 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T17:59:47.191 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T17:59:48.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:59:46.488943+0000 mgr.smithi067.rdualw (mgr.24569) 5254 : audit [DBG] from='client.37642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:59:48.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:46.754451+0000 mgr.smithi067.rdualw (mgr.24569) 5255 : cluster [DBG] pgmap v4528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:59:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:59:46.773531+0000 mgr.smithi067.rdualw (mgr.24569) 5256 : audit [DBG] from='client.37646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:59:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T17:59:47.181214+0000 mon.smithi061 (mon.0) 1216 : audit [DBG] from='client.? 172.21.15.61:0/166750060' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:59:48.185 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:59:46.488943+0000 mgr.smithi067.rdualw (mgr.24569) 5254 : audit [DBG] from='client.37642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:59:48.185 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:46.754451+0000 mgr.smithi067.rdualw (mgr.24569) 5255 : cluster [DBG] pgmap v4528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:59:48.186 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:59:46.773531+0000 mgr.smithi067.rdualw (mgr.24569) 5256 : audit [DBG] from='client.37646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T17:59:48.186 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T17:59:47.181214+0000 mon.smithi061 (mon.0) 1216 : audit [DBG] from='client.? 172.21.15.61:0/166750060' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T17:59:50.185 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:48.755106+0000 mgr.smithi067.rdualw (mgr.24569) 5257 : cluster [DBG] pgmap v4529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:50.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:48.755106+0000 mgr.smithi067.rdualw (mgr.24569) 5257 : cluster [DBG] pgmap v4529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:50.755955+0000 mgr.smithi067.rdualw (mgr.24569) 5258 : cluster [DBG] pgmap v4530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:50.755955+0000 mgr.smithi067.rdualw (mgr.24569) 5258 : cluster [DBG] pgmap v4530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:54.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:52.756707+0000 mgr.smithi067.rdualw (mgr.24569) 5259 : cluster [DBG] pgmap v4531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:54.186 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:52.756707+0000 mgr.smithi067.rdualw (mgr.24569) 5259 : cluster [DBG] pgmap v4531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:56.186 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:54.757315+0000 mgr.smithi067.rdualw (mgr.24569) 5260 : cluster [DBG] pgmap v4532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:54.757315+0000 mgr.smithi067.rdualw (mgr.24569) 5260 : cluster [DBG] pgmap v4532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T17:59:58.187 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:56.758300+0000 mgr.smithi067.rdualw (mgr.24569) 5261 : cluster [DBG] pgmap v4533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T17:59:58.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:56.758300+0000 mgr.smithi067.rdualw (mgr.24569) 5261 : cluster [DBG] pgmap v4533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:00:00.187 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 17:59:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T17:59:58.759048+0000 mgr.smithi067.rdualw (mgr.24569) 5262 : cluster [DBG] pgmap v4534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:00.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 17:59:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T17:59:58.759048+0000 mgr.smithi067.rdualw (mgr.24569) 5262 : cluster [DBG] pgmap v4534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:01.187 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:00.000100+0000 mon.smithi061 (mon.0) 1217 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T18:00:01.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:00.000100+0000 mon.smithi061 (mon.0) 1217 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T18:00:02.188 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:00.759834+0000 mgr.smithi067.rdualw (mgr.24569) 5263 : cluster [DBG] pgmap v4535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:02.397 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:00.759834+0000 mgr.smithi067.rdualw (mgr.24569) 5263 : cluster [DBG] pgmap v4535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:04.188 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:02.760498+0000 mgr.smithi067.rdualw (mgr.24569) 5264 : cluster [DBG] pgmap v4536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:04.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:02.760498+0000 mgr.smithi067.rdualw (mgr.24569) 5264 : cluster [DBG] pgmap v4536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:06.188 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:04.761035+0000 mgr.smithi067.rdualw (mgr.24569) 5265 : cluster [DBG] pgmap v4537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:06.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:04.761035+0000 mgr.smithi067.rdualw (mgr.24569) 5265 : cluster [DBG] pgmap v4537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:08.189 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:06.761919+0000 mgr.smithi067.rdualw (mgr.24569) 5266 : cluster [DBG] pgmap v4538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:00:08.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:06.761919+0000 mgr.smithi067.rdualw (mgr.24569) 5266 : cluster [DBG] pgmap v4538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:00:10.189 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:08.762415+0000 mgr.smithi067.rdualw (mgr.24569) 5267 : cluster [DBG] pgmap v4539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:10.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:08.762415+0000 mgr.smithi067.rdualw (mgr.24569) 5267 : cluster [DBG] pgmap v4539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:10.763403+0000 mgr.smithi067.rdualw (mgr.24569) 5268 : cluster [DBG] pgmap v4540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:10.763403+0000 mgr.smithi067.rdualw (mgr.24569) 5268 : cluster [DBG] pgmap v4540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:14.189 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:12.764059+0000 mgr.smithi067.rdualw (mgr.24569) 5269 : cluster [DBG] pgmap v4541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:14.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:12.764059+0000 mgr.smithi067.rdualw (mgr.24569) 5269 : cluster [DBG] pgmap v4541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:16.190 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:14.764691+0000 mgr.smithi067.rdualw (mgr.24569) 5270 : cluster [DBG] pgmap v4542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:16.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:14.764691+0000 mgr.smithi067.rdualw (mgr.24569) 5270 : cluster [DBG] pgmap v4542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:17.489 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:00:17.780 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:00:17.781 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 6m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:00:17.781 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 6m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:00:17.782 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 7m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:00:17.782 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 6m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:00:17.782 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 6m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:00:17.782 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 7m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:00:17.783 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 6m ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:00:17.783 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 7m ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:00:17.783 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 6m ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:00:17.783 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 7m ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:00:17.783 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 6m ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:00:17.784 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 7m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:00:17.784 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 6m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:00:17.784 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 7m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:00:17.784 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 6m ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:00:17.785 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 6m ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:00:17.785 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 6m ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:00:17.785 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 6m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:00:17.785 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 7m ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:00:17.785 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 7m ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:00:17.786 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 7m ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:00:17.786 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 7m ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:00:17.786 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 6m ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:00:18.126 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:00:18.126 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:00:18.127 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:00:18.127 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:00:18.127 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:00:18.127 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:00:18.128 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:00:18.128 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:00:18.128 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:00:18.128 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:00:18.128 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:00:18.129 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:00:18.129 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:00:18.129 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:00:18.129 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:00:18.130 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:00:18.130 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:00:18.130 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:00:18.131 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:00:18.190 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:16.765528+0000 mgr.smithi067.rdualw (mgr.24569) 5271 : cluster [DBG] pgmap v4543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:00:18.191 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:00:17.476984+0000 mgr.smithi067.rdualw (mgr.24569) 5272 : audit [DBG] from='client.37654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:00:18.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:16.765528+0000 mgr.smithi067.rdualw (mgr.24569) 5271 : cluster [DBG] pgmap v4543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:00:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:00:17.476984+0000 mgr.smithi067.rdualw (mgr.24569) 5272 : audit [DBG] from='client.37654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:00:19.191 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:00:17.764862+0000 mgr.smithi067.rdualw (mgr.24569) 5273 : audit [DBG] from='client.37658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:00:19.191 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:00:18.126540+0000 mon.smithi061 (mon.0) 1218 : audit [DBG] from='client.? 172.21.15.61:0/2490854031' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:00:19.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:00:17.764862+0000 mgr.smithi067.rdualw (mgr.24569) 5273 : audit [DBG] from='client.37658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:00:19.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:00:18.126540+0000 mon.smithi061 (mon.0) 1218 : audit [DBG] from='client.? 172.21.15.61:0/2490854031' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:00:20.191 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:18.766317+0000 mgr.smithi067.rdualw (mgr.24569) 5274 : cluster [DBG] pgmap v4544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:20.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:18.766317+0000 mgr.smithi067.rdualw (mgr.24569) 5274 : cluster [DBG] pgmap v4544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:20.767347+0000 mgr.smithi067.rdualw (mgr.24569) 5275 : cluster [DBG] pgmap v4545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:20.767347+0000 mgr.smithi067.rdualw (mgr.24569) 5275 : cluster [DBG] pgmap v4545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:24.191 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:22.767847+0000 mgr.smithi067.rdualw (mgr.24569) 5276 : cluster [DBG] pgmap v4546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:22.767847+0000 mgr.smithi067.rdualw (mgr.24569) 5276 : cluster [DBG] pgmap v4546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:26.192 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:24.768585+0000 mgr.smithi067.rdualw (mgr.24569) 5277 : cluster [DBG] pgmap v4547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:26.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:24.768585+0000 mgr.smithi067.rdualw (mgr.24569) 5277 : cluster [DBG] pgmap v4547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:28.192 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:26.769612+0000 mgr.smithi067.rdualw (mgr.24569) 5278 : cluster [DBG] pgmap v4548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:00:28.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:26.769612+0000 mgr.smithi067.rdualw (mgr.24569) 5278 : cluster [DBG] pgmap v4548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:00:30.192 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:28.770090+0000 mgr.smithi067.rdualw (mgr.24569) 5279 : cluster [DBG] pgmap v4549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:30.193 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:00:29.560853+0000 mon.smithi067 (mon.1) 820 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:00:30.194 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:00:29.562305+0000 mon.smithi067 (mon.1) 821 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:00:30.194 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:00:29.563242+0000 mon.smithi067 (mon.1) 822 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:00:30.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:28.770090+0000 mgr.smithi067.rdualw (mgr.24569) 5279 : cluster [DBG] pgmap v4549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:30.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:00:29.560853+0000 mon.smithi067 (mon.1) 820 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:00:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:00:29.562305+0000 mon.smithi067 (mon.1) 821 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:00:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:00:29.563242+0000 mon.smithi067 (mon.1) 822 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:00:31.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:00:29.564080+0000 mgr.smithi067.rdualw (mgr.24569) 5280 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:00:31.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:00:29.976317+0000 mon.smithi061 (mon.0) 1219 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:00:31.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:00:29.981538+0000 mon.smithi061 (mon.0) 1220 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:00:31.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:00:29.564080+0000 mgr.smithi067.rdualw (mgr.24569) 5280 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:00:31.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:00:29.976317+0000 mon.smithi061 (mon.0) 1219 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:00:31.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:00:29.981538+0000 mon.smithi061 (mon.0) 1220 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:00:32.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:30.771102+0000 mgr.smithi067.rdualw (mgr.24569) 5281 : cluster [DBG] pgmap v4550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:32.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:30.771102+0000 mgr.smithi067.rdualw (mgr.24569) 5281 : cluster [DBG] pgmap v4550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:34.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:32.771695+0000 mgr.smithi067.rdualw (mgr.24569) 5282 : cluster [DBG] pgmap v4551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:34.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:32.771695+0000 mgr.smithi067.rdualw (mgr.24569) 5282 : cluster [DBG] pgmap v4551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:36.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:34.772426+0000 mgr.smithi067.rdualw (mgr.24569) 5283 : cluster [DBG] pgmap v4552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:36.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:00:35.259609+0000 mon.smithi067 (mon.1) 823 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:00:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:00:35.259862+0000 mon.smithi067 (mon.1) 824 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:00:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:00:35.260006+0000 mon.smithi061 (mon.0) 1221 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:00:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:00:35.260266+0000 mon.smithi061 (mon.0) 1222 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:00:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:34.772426+0000 mgr.smithi067.rdualw (mgr.24569) 5283 : cluster [DBG] pgmap v4552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:00:35.259609+0000 mon.smithi067 (mon.1) 823 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:00:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:00:35.259862+0000 mon.smithi067 (mon.1) 824 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:00:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:00:35.260006+0000 mon.smithi061 (mon.0) 1221 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:00:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:00:35.260266+0000 mon.smithi061 (mon.0) 1222 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:00:38.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:36.773346+0000 mgr.smithi067.rdualw (mgr.24569) 5284 : cluster [DBG] pgmap v4553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:00:38.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:36.773346+0000 mgr.smithi067.rdualw (mgr.24569) 5284 : cluster [DBG] pgmap v4553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:00:40.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:38.774038+0000 mgr.smithi067.rdualw (mgr.24569) 5285 : cluster [DBG] pgmap v4554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:40.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:38.774038+0000 mgr.smithi067.rdualw (mgr.24569) 5285 : cluster [DBG] pgmap v4554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:40.775160+0000 mgr.smithi067.rdualw (mgr.24569) 5286 : cluster [DBG] pgmap v4555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:40.775160+0000 mgr.smithi067.rdualw (mgr.24569) 5286 : cluster [DBG] pgmap v4555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:44.195 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:42.775702+0000 mgr.smithi067.rdualw (mgr.24569) 5287 : cluster [DBG] pgmap v4556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:44.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:42.775702+0000 mgr.smithi067.rdualw (mgr.24569) 5287 : cluster [DBG] pgmap v4556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:46.195 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:44.776260+0000 mgr.smithi067.rdualw (mgr.24569) 5288 : cluster [DBG] pgmap v4557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:46.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:44.776260+0000 mgr.smithi067.rdualw (mgr.24569) 5288 : cluster [DBG] pgmap v4557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:48.203 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:46.777112+0000 mgr.smithi067.rdualw (mgr.24569) 5289 : cluster [DBG] pgmap v4558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:00:48.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:46.777112+0000 mgr.smithi067.rdualw (mgr.24569) 5289 : cluster [DBG] pgmap v4558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:00:48.442 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:00:48.735 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:00:48.736 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 7m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:00:48.736 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 7m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:00:48.736 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 7m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:00:48.736 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 7m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:00:48.737 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 7m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:00:48.737 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 7m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:00:48.737 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 7m ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:00:48.737 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 7m ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:00:48.738 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 7m ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:00:48.738 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 7m ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:00:48.738 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 7m ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:00:48.738 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 7m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:00:48.739 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 7m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:00:48.739 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 7m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:00:48.739 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 7m ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:00:48.739 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 7m ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:00:48.739 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 7m ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:00:48.740 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 7m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:00:48.740 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 7m ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:00:48.740 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 7m ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:00:48.740 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 7m ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:00:48.741 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 7m ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:00:48.741 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 7m ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:00:49.158 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:00:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:00:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:00:49.159 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:00:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:00:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:00:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:00:49.160 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:00:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:00:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:00:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:00:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:00:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:00:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:00:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:00:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:00:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:00:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:00:49.163 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:00:49.195 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:00:48.430357+0000 mgr.smithi067.rdualw (mgr.24569) 5290 : audit [DBG] from='client.37666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:00:49.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:00:48.430357+0000 mgr.smithi067.rdualw (mgr.24569) 5290 : audit [DBG] from='client.37666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:00:50.195 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:00:48.719716+0000 mgr.smithi067.rdualw (mgr.24569) 5291 : audit [DBG] from='client.37670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:00:50.196 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:48.777734+0000 mgr.smithi067.rdualw (mgr.24569) 5292 : cluster [DBG] pgmap v4559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:50.196 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:00:49.158614+0000 mon.smithi061 (mon.0) 1223 : audit [DBG] from='client.? 172.21.15.61:0/3253629115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:00:50.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:00:48.719716+0000 mgr.smithi067.rdualw (mgr.24569) 5291 : audit [DBG] from='client.37670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:00:50.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:48.777734+0000 mgr.smithi067.rdualw (mgr.24569) 5292 : cluster [DBG] pgmap v4559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:50.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:00:49.158614+0000 mon.smithi061 (mon.0) 1223 : audit [DBG] from='client.? 172.21.15.61:0/3253629115' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:00:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:50.778771+0000 mgr.smithi067.rdualw (mgr.24569) 5293 : cluster [DBG] pgmap v4560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:50.778771+0000 mgr.smithi067.rdualw (mgr.24569) 5293 : cluster [DBG] pgmap v4560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:54.196 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:52.779432+0000 mgr.smithi067.rdualw (mgr.24569) 5294 : cluster [DBG] pgmap v4561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:54.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:52.779432+0000 mgr.smithi067.rdualw (mgr.24569) 5294 : cluster [DBG] pgmap v4561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:56.196 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:54.780178+0000 mgr.smithi067.rdualw (mgr.24569) 5295 : cluster [DBG] pgmap v4562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:54.780178+0000 mgr.smithi067.rdualw (mgr.24569) 5295 : cluster [DBG] pgmap v4562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:00:58.197 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:56.781130+0000 mgr.smithi067.rdualw (mgr.24569) 5296 : cluster [DBG] pgmap v4563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:00:58.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:56.781130+0000 mgr.smithi067.rdualw (mgr.24569) 5296 : cluster [DBG] pgmap v4563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:01:00.197 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:00:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:00:58.781707+0000 mgr.smithi067.rdualw (mgr.24569) 5297 : cluster [DBG] pgmap v4564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:00.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:00:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:00:58.781707+0000 mgr.smithi067.rdualw (mgr.24569) 5297 : cluster [DBG] pgmap v4564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:01.904 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:00.782780+0000 mgr.smithi067.rdualw (mgr.24569) 5298 : cluster [DBG] pgmap v4565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:00.782780+0000 mgr.smithi067.rdualw (mgr.24569) 5298 : cluster [DBG] pgmap v4565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:04.198 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:02.783387+0000 mgr.smithi067.rdualw (mgr.24569) 5299 : cluster [DBG] pgmap v4566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:04.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:02.783387+0000 mgr.smithi067.rdualw (mgr.24569) 5299 : cluster [DBG] pgmap v4566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:06.198 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:04.784008+0000 mgr.smithi067.rdualw (mgr.24569) 5300 : cluster [DBG] pgmap v4567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:06.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:04.784008+0000 mgr.smithi067.rdualw (mgr.24569) 5300 : cluster [DBG] pgmap v4567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:08.198 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:06.785009+0000 mgr.smithi067.rdualw (mgr.24569) 5301 : cluster [DBG] pgmap v4568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:01:08.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:06.785009+0000 mgr.smithi067.rdualw (mgr.24569) 5301 : cluster [DBG] pgmap v4568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:01:10.199 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:08.785670+0000 mgr.smithi067.rdualw (mgr.24569) 5302 : cluster [DBG] pgmap v4569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:10.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:08.785670+0000 mgr.smithi067.rdualw (mgr.24569) 5302 : cluster [DBG] pgmap v4569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:10.786476+0000 mgr.smithi067.rdualw (mgr.24569) 5303 : cluster [DBG] pgmap v4570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:10.786476+0000 mgr.smithi067.rdualw (mgr.24569) 5303 : cluster [DBG] pgmap v4570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:14.199 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:12.787251+0000 mgr.smithi067.rdualw (mgr.24569) 5304 : cluster [DBG] pgmap v4571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:14.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:12.787251+0000 mgr.smithi067.rdualw (mgr.24569) 5304 : cluster [DBG] pgmap v4571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:16.200 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:14.787939+0000 mgr.smithi067.rdualw (mgr.24569) 5305 : cluster [DBG] pgmap v4572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:16.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:14.787939+0000 mgr.smithi067.rdualw (mgr.24569) 5305 : cluster [DBG] pgmap v4572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:18.200 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:16.788872+0000 mgr.smithi067.rdualw (mgr.24569) 5306 : cluster [DBG] pgmap v4573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:01:18.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:16.788872+0000 mgr.smithi067.rdualw (mgr.24569) 5306 : cluster [DBG] pgmap v4573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:01:19.471 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:01:19.758 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:01:19.759 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 7m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:01:19.759 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 7m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:01:19.759 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 8m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:01:19.760 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 7m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:01:19.760 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 7m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:01:19.760 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 8m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:01:19.760 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 7m ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:01:19.761 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 8m ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:01:19.761 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 7m ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:01:19.761 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 8m ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:01:19.761 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 7m ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:01:19.761 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 8m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:01:19.762 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 7m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:01:19.762 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 8m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:01:19.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 7m ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:01:19.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 7m ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:01:19.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 7m ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:01:19.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 7m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:01:19.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 8m ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:01:19.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 8m ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:01:19.764 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 8m ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:01:19.764 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 8m ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:01:19.764 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 7m ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:01:20.164 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:01:20.164 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:01:20.165 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:01:20.165 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:01:20.165 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:01:20.165 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:01:20.165 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:01:20.166 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:01:20.168 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:01:20.168 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:01:20.169 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:01:20.169 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:01:20.169 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:01:20.169 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:01:20.170 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:01:20.170 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:01:20.170 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:01:20.170 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:01:20.170 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:01:20.201 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:18.789519+0000 mgr.smithi067.rdualw (mgr.24569) 5307 : cluster [DBG] pgmap v4574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:20.201 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:01:19.458463+0000 mgr.smithi067.rdualw (mgr.24569) 5308 : audit [DBG] from='client.37678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:01:20.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:18.789519+0000 mgr.smithi067.rdualw (mgr.24569) 5307 : cluster [DBG] pgmap v4574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:20.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:01:19.458463+0000 mgr.smithi067.rdualw (mgr.24569) 5308 : audit [DBG] from='client.37678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:01:21.201 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:01:19.742938+0000 mgr.smithi067.rdualw (mgr.24569) 5309 : audit [DBG] from='client.37682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:01:21.201 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:01:20.164425+0000 mon.smithi061 (mon.0) 1224 : audit [DBG] from='client.? 172.21.15.61:0/3876316231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:01:21.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:01:19.742938+0000 mgr.smithi067.rdualw (mgr.24569) 5309 : audit [DBG] from='client.37682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:01:21.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:01:20.164425+0000 mon.smithi061 (mon.0) 1224 : audit [DBG] from='client.? 172.21.15.61:0/3876316231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:01:22.201 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:20.790420+0000 mgr.smithi067.rdualw (mgr.24569) 5310 : cluster [DBG] pgmap v4575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:22.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:20.790420+0000 mgr.smithi067.rdualw (mgr.24569) 5310 : cluster [DBG] pgmap v4575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:24.201 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:22.791114+0000 mgr.smithi067.rdualw (mgr.24569) 5311 : cluster [DBG] pgmap v4576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:24.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:22.791114+0000 mgr.smithi067.rdualw (mgr.24569) 5311 : cluster [DBG] pgmap v4576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:26.203 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:24.791786+0000 mgr.smithi067.rdualw (mgr.24569) 5312 : cluster [DBG] pgmap v4577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:26.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:24.791786+0000 mgr.smithi067.rdualw (mgr.24569) 5312 : cluster [DBG] pgmap v4577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:28.202 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:26.792636+0000 mgr.smithi067.rdualw (mgr.24569) 5313 : cluster [DBG] pgmap v4578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:01:28.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:26.792636+0000 mgr.smithi067.rdualw (mgr.24569) 5313 : cluster [DBG] pgmap v4578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:01:30.203 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:28.793078+0000 mgr.smithi067.rdualw (mgr.24569) 5314 : cluster [DBG] pgmap v4579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:30.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:28.793078+0000 mgr.smithi067.rdualw (mgr.24569) 5314 : cluster [DBG] pgmap v4579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:31.203 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:01:29.985053+0000 mon.smithi067 (mon.1) 825 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:01:31.203 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:01:29.986497+0000 mon.smithi067 (mon.1) 826 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:01:31.203 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:01:29.987396+0000 mon.smithi067 (mon.1) 827 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:01:31.204 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:01:29.988237+0000 mgr.smithi067.rdualw (mgr.24569) 5315 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:01:31.204 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:01:30.404615+0000 mon.smithi061 (mon.0) 1225 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:01:31.204 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:01:30.409951+0000 mon.smithi061 (mon.0) 1226 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:01:31.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:01:29.985053+0000 mon.smithi067 (mon.1) 825 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:01:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:01:29.986497+0000 mon.smithi067 (mon.1) 826 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:01:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:01:29.987396+0000 mon.smithi067 (mon.1) 827 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:01:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:01:29.988237+0000 mgr.smithi067.rdualw (mgr.24569) 5315 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:01:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:01:30.404615+0000 mon.smithi061 (mon.0) 1225 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:01:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:01:30.409951+0000 mon.smithi061 (mon.0) 1226 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:01:32.202 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:30.793952+0000 mgr.smithi067.rdualw (mgr.24569) 5316 : cluster [DBG] pgmap v4580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:32.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:30.793952+0000 mgr.smithi067.rdualw (mgr.24569) 5316 : cluster [DBG] pgmap v4580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:34.203 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:32.794587+0000 mgr.smithi067.rdualw (mgr.24569) 5317 : cluster [DBG] pgmap v4581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:34.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:32.794587+0000 mgr.smithi067.rdualw (mgr.24569) 5317 : cluster [DBG] pgmap v4581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:36.203 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:34.795095+0000 mgr.smithi067.rdualw (mgr.24569) 5318 : cluster [DBG] pgmap v4582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:36.204 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:01:35.264516+0000 mon.smithi067 (mon.1) 828 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:01:36.205 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:01:35.264845+0000 mon.smithi061 (mon.0) 1227 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:01:36.205 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:01:35.264944+0000 mon.smithi067 (mon.1) 829 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:01:36.205 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:01:35.265118+0000 mon.smithi061 (mon.0) 1228 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:01:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:34.795095+0000 mgr.smithi067.rdualw (mgr.24569) 5318 : cluster [DBG] pgmap v4582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:01:35.264516+0000 mon.smithi067 (mon.1) 828 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:01:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:01:35.264845+0000 mon.smithi061 (mon.0) 1227 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:01:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:01:35.264944+0000 mon.smithi067 (mon.1) 829 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:01:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:01:35.265118+0000 mon.smithi061 (mon.0) 1228 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:01:38.204 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:36.795959+0000 mgr.smithi067.rdualw (mgr.24569) 5319 : cluster [DBG] pgmap v4583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:01:38.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:36.795959+0000 mgr.smithi067.rdualw (mgr.24569) 5319 : cluster [DBG] pgmap v4583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:01:40.207 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:38.796471+0000 mgr.smithi067.rdualw (mgr.24569) 5320 : cluster [DBG] pgmap v4584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:40.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:38.796471+0000 mgr.smithi067.rdualw (mgr.24569) 5320 : cluster [DBG] pgmap v4584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:40.797329+0000 mgr.smithi067.rdualw (mgr.24569) 5321 : cluster [DBG] pgmap v4585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:40.797329+0000 mgr.smithi067.rdualw (mgr.24569) 5321 : cluster [DBG] pgmap v4585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:44.206 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:42.797860+0000 mgr.smithi067.rdualw (mgr.24569) 5322 : cluster [DBG] pgmap v4586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:44.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:42.797860+0000 mgr.smithi067.rdualw (mgr.24569) 5322 : cluster [DBG] pgmap v4586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:46.205 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:44.798637+0000 mgr.smithi067.rdualw (mgr.24569) 5323 : cluster [DBG] pgmap v4587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:46.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:44.798637+0000 mgr.smithi067.rdualw (mgr.24569) 5323 : cluster [DBG] pgmap v4587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:48.206 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:46.799450+0000 mgr.smithi067.rdualw (mgr.24569) 5324 : cluster [DBG] pgmap v4588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:01:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:46.799450+0000 mgr.smithi067.rdualw (mgr.24569) 5324 : cluster [DBG] pgmap v4588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:01:50.206 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:48.799887+0000 mgr.smithi067.rdualw (mgr.24569) 5325 : cluster [DBG] pgmap v4589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:50.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:48.799887+0000 mgr.smithi067.rdualw (mgr.24569) 5325 : cluster [DBG] pgmap v4589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:50.474 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:01:50.807 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:01:50.807 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 8m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:01:50.807 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 8m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:01:50.808 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 8m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:01:50.808 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 8m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:01:50.808 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 8m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:01:50.808 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 8m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:01:50.808 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 8m ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:01:50.809 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 8m ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:01:50.809 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 8m ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:01:50.809 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 8m ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:01:50.809 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 8m ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:01:50.810 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 8m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:01:50.810 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 8m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:01:50.810 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 8m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:01:50.810 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 8m ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:01:50.810 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 8m ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:01:50.811 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 8m ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:01:50.811 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 8m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:01:50.811 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 8m ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:01:50.811 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 8m ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:01:50.812 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 8m ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:01:50.812 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 8m ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:01:50.812 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 8m ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:01:51.147 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:01:51.147 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:01:51.147 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:01:51.148 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:01:51.148 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:01:51.148 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:01:51.148 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:01:51.149 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:01:51.149 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:01:51.149 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:01:51.149 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:01:51.150 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:01:51.150 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:01:51.150 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:01:51.150 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:01:51.151 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:01:51.151 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:01:51.151 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:01:51.151 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:01:51.206 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:01:50.462564+0000 mgr.smithi067.rdualw (mgr.24569) 5326 : audit [DBG] from='client.37690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:01:51.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:01:50.462564+0000 mgr.smithi067.rdualw (mgr.24569) 5326 : audit [DBG] from='client.37690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:01:52.206 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:01:50.791135+0000 mgr.smithi067.rdualw (mgr.24569) 5327 : audit [DBG] from='client.37694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:01:52.206 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:50.800718+0000 mgr.smithi067.rdualw (mgr.24569) 5328 : cluster [DBG] pgmap v4590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:52.207 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:01:51.147241+0000 mon.smithi061 (mon.0) 1229 : audit [DBG] from='client.? 172.21.15.61:0/312402234' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:01:52.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:01:50.791135+0000 mgr.smithi067.rdualw (mgr.24569) 5327 : audit [DBG] from='client.37694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:01:52.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:50.800718+0000 mgr.smithi067.rdualw (mgr.24569) 5328 : cluster [DBG] pgmap v4590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:52.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:01:51.147241+0000 mon.smithi061 (mon.0) 1229 : audit [DBG] from='client.? 172.21.15.61:0/312402234' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:01:54.206 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:52.801253+0000 mgr.smithi067.rdualw (mgr.24569) 5329 : cluster [DBG] pgmap v4591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:54.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:52.801253+0000 mgr.smithi067.rdualw (mgr.24569) 5329 : cluster [DBG] pgmap v4591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:56.207 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:54.802015+0000 mgr.smithi067.rdualw (mgr.24569) 5330 : cluster [DBG] pgmap v4592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:54.802015+0000 mgr.smithi067.rdualw (mgr.24569) 5330 : cluster [DBG] pgmap v4592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:01:58.207 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:56.802972+0000 mgr.smithi067.rdualw (mgr.24569) 5331 : cluster [DBG] pgmap v4593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:01:58.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:56.802972+0000 mgr.smithi067.rdualw (mgr.24569) 5331 : cluster [DBG] pgmap v4593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:02:00.207 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:01:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:01:58.803481+0000 mgr.smithi067.rdualw (mgr.24569) 5332 : cluster [DBG] pgmap v4594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:00.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:01:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:01:58.803481+0000 mgr.smithi067.rdualw (mgr.24569) 5332 : cluster [DBG] pgmap v4594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:00.804295+0000 mgr.smithi067.rdualw (mgr.24569) 5333 : cluster [DBG] pgmap v4595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:00.804295+0000 mgr.smithi067.rdualw (mgr.24569) 5333 : cluster [DBG] pgmap v4595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:04.208 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:02.805006+0000 mgr.smithi067.rdualw (mgr.24569) 5334 : cluster [DBG] pgmap v4596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:04.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:02.805006+0000 mgr.smithi067.rdualw (mgr.24569) 5334 : cluster [DBG] pgmap v4596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:06.208 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:04.805583+0000 mgr.smithi067.rdualw (mgr.24569) 5335 : cluster [DBG] pgmap v4597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:06.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:04.805583+0000 mgr.smithi067.rdualw (mgr.24569) 5335 : cluster [DBG] pgmap v4597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:08.208 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:06.806350+0000 mgr.smithi067.rdualw (mgr.24569) 5336 : cluster [DBG] pgmap v4598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:02:08.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:06.806350+0000 mgr.smithi067.rdualw (mgr.24569) 5336 : cluster [DBG] pgmap v4598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:02:10.209 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:08.807018+0000 mgr.smithi067.rdualw (mgr.24569) 5337 : cluster [DBG] pgmap v4599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:10.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:08.807018+0000 mgr.smithi067.rdualw (mgr.24569) 5337 : cluster [DBG] pgmap v4599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:10.807945+0000 mgr.smithi067.rdualw (mgr.24569) 5338 : cluster [DBG] pgmap v4600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:10.807945+0000 mgr.smithi067.rdualw (mgr.24569) 5338 : cluster [DBG] pgmap v4600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:14.209 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:12.808607+0000 mgr.smithi067.rdualw (mgr.24569) 5339 : cluster [DBG] pgmap v4601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:14.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:12.808607+0000 mgr.smithi067.rdualw (mgr.24569) 5339 : cluster [DBG] pgmap v4601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:16.210 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:14.809280+0000 mgr.smithi067.rdualw (mgr.24569) 5340 : cluster [DBG] pgmap v4602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:16.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:14.809280+0000 mgr.smithi067.rdualw (mgr.24569) 5340 : cluster [DBG] pgmap v4602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:18.210 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:16.810207+0000 mgr.smithi067.rdualw (mgr.24569) 5341 : cluster [DBG] pgmap v4603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:02:18.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:16.810207+0000 mgr.smithi067.rdualw (mgr.24569) 5341 : cluster [DBG] pgmap v4603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:02:20.210 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:18.810766+0000 mgr.smithi067.rdualw (mgr.24569) 5342 : cluster [DBG] pgmap v4604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:20.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:18.810766+0000 mgr.smithi067.rdualw (mgr.24569) 5342 : cluster [DBG] pgmap v4604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:21.455 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:02:21.750 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:02:21.751 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 9m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:02:21.751 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 9m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:02:21.751 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 9m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:02:21.752 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 9m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:02:21.752 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 9m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:02:21.752 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 9m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:02:21.752 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 9m ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:02:21.752 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 9m ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:02:21.753 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 9m ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:02:21.753 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 9m ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:02:21.753 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 9m ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:02:21.753 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 9m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:02:21.754 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 9m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:02:21.754 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 9m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:02:21.754 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 9m ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:02:21.754 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 9m ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:02:21.754 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 9m ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:02:21.755 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 9m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:02:21.755 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 9m ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:02:21.755 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 9m ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:02:21.755 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 9m ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:02:21.756 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 9m ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:02:21.756 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 9m ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:02:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:20.811621+0000 mgr.smithi067.rdualw (mgr.24569) 5343 : cluster [DBG] pgmap v4605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:02:21.443124+0000 mgr.smithi067.rdualw (mgr.24569) 5344 : audit [DBG] from='client.37702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:02:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:20.811621+0000 mgr.smithi067.rdualw (mgr.24569) 5343 : cluster [DBG] pgmap v4605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:02:21.443124+0000 mgr.smithi067.rdualw (mgr.24569) 5344 : audit [DBG] from='client.37702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:02:22.095 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:02:22.095 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:02:22.095 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:02:22.096 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:02:22.096 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:02:22.096 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:02:22.096 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:02:22.097 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:02:22.097 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:02:22.097 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:02:22.097 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:02:22.098 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:02:22.098 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:02:22.098 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:02:22.098 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:02:22.098 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:02:22.099 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:02:22.099 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:02:22.099 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:02:23.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:02:21.734753+0000 mgr.smithi067.rdualw (mgr.24569) 5345 : audit [DBG] from='client.37706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:02:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:02:22.095556+0000 mon.smithi061 (mon.0) 1230 : audit [DBG] from='client.? 172.21.15.61:0/3047994002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:02:23.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:02:21.734753+0000 mgr.smithi067.rdualw (mgr.24569) 5345 : audit [DBG] from='client.37706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:02:23.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:02:22.095556+0000 mon.smithi061 (mon.0) 1230 : audit [DBG] from='client.? 172.21.15.61:0/3047994002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:02:24.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:22.812243+0000 mgr.smithi067.rdualw (mgr.24569) 5346 : cluster [DBG] pgmap v4606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:24.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:22.812243+0000 mgr.smithi067.rdualw (mgr.24569) 5346 : cluster [DBG] pgmap v4606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:26.211 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:24.812855+0000 mgr.smithi067.rdualw (mgr.24569) 5347 : cluster [DBG] pgmap v4607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:26.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:24.812855+0000 mgr.smithi067.rdualw (mgr.24569) 5347 : cluster [DBG] pgmap v4607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:28.212 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:26.813876+0000 mgr.smithi067.rdualw (mgr.24569) 5348 : cluster [DBG] pgmap v4608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:02:28.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:26.813876+0000 mgr.smithi067.rdualw (mgr.24569) 5348 : cluster [DBG] pgmap v4608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:02:30.212 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:28.814486+0000 mgr.smithi067.rdualw (mgr.24569) 5349 : cluster [DBG] pgmap v4609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:30.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:28.814486+0000 mgr.smithi067.rdualw (mgr.24569) 5349 : cluster [DBG] pgmap v4609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:31.213 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:02:30.413423+0000 mon.smithi067 (mon.1) 830 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:02:31.214 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:02:30.414829+0000 mon.smithi067 (mon.1) 831 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:02:31.215 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:02:30.415770+0000 mon.smithi067 (mon.1) 832 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:02:31.215 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:02:30.416625+0000 mgr.smithi067.rdualw (mgr.24569) 5350 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:02:31.216 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:02:30.834143+0000 mon.smithi061 (mon.0) 1231 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:02:31.216 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:02:30.842239+0000 mon.smithi061 (mon.0) 1232 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:02:31.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:02:30.413423+0000 mon.smithi067 (mon.1) 830 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:02:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:02:30.414829+0000 mon.smithi067 (mon.1) 831 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:02:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:02:30.415770+0000 mon.smithi067 (mon.1) 832 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:02:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:02:30.416625+0000 mgr.smithi067.rdualw (mgr.24569) 5350 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:02:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:02:30.834143+0000 mon.smithi061 (mon.0) 1231 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:02:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:02:30.842239+0000 mon.smithi061 (mon.0) 1232 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:02:32.212 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:30.815250+0000 mgr.smithi067.rdualw (mgr.24569) 5351 : cluster [DBG] pgmap v4610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:32.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:30.815250+0000 mgr.smithi067.rdualw (mgr.24569) 5351 : cluster [DBG] pgmap v4610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:34.213 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:32.815882+0000 mgr.smithi067.rdualw (mgr.24569) 5352 : cluster [DBG] pgmap v4611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:34.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:32.815882+0000 mgr.smithi067.rdualw (mgr.24569) 5352 : cluster [DBG] pgmap v4611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:36.213 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:34.816606+0000 mgr.smithi067.rdualw (mgr.24569) 5353 : cluster [DBG] pgmap v4612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:36.213 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:02:35.270631+0000 mon.smithi067 (mon.1) 833 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:02:36.214 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:02:35.271004+0000 mon.smithi067 (mon.1) 834 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:02:36.214 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:02:35.271115+0000 mon.smithi061 (mon.0) 1233 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:02:36.214 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:02:35.271457+0000 mon.smithi061 (mon.0) 1234 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:02:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:34.816606+0000 mgr.smithi067.rdualw (mgr.24569) 5353 : cluster [DBG] pgmap v4612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:02:35.270631+0000 mon.smithi067 (mon.1) 833 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:02:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:02:35.271004+0000 mon.smithi067 (mon.1) 834 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:02:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:02:35.271115+0000 mon.smithi061 (mon.0) 1233 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:02:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:02:35.271457+0000 mon.smithi061 (mon.0) 1234 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:02:38.213 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:36.817502+0000 mgr.smithi067.rdualw (mgr.24569) 5354 : cluster [DBG] pgmap v4613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:02:38.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:36.817502+0000 mgr.smithi067.rdualw (mgr.24569) 5354 : cluster [DBG] pgmap v4613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:02:40.213 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:38.818285+0000 mgr.smithi067.rdualw (mgr.24569) 5355 : cluster [DBG] pgmap v4614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:40.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:38.818285+0000 mgr.smithi067.rdualw (mgr.24569) 5355 : cluster [DBG] pgmap v4614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:40.819185+0000 mgr.smithi067.rdualw (mgr.24569) 5356 : cluster [DBG] pgmap v4615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:42.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:40.819185+0000 mgr.smithi067.rdualw (mgr.24569) 5356 : cluster [DBG] pgmap v4615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:44.214 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:42.819839+0000 mgr.smithi067.rdualw (mgr.24569) 5357 : cluster [DBG] pgmap v4616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:44.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:42.819839+0000 mgr.smithi067.rdualw (mgr.24569) 5357 : cluster [DBG] pgmap v4616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:46.214 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:44.820519+0000 mgr.smithi067.rdualw (mgr.24569) 5358 : cluster [DBG] pgmap v4617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:46.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:44.820519+0000 mgr.smithi067.rdualw (mgr.24569) 5358 : cluster [DBG] pgmap v4617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:48.215 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:46.821391+0000 mgr.smithi067.rdualw (mgr.24569) 5359 : cluster [DBG] pgmap v4618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:02:48.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:46.821391+0000 mgr.smithi067.rdualw (mgr.24569) 5359 : cluster [DBG] pgmap v4618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:02:50.215 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:48.821880+0000 mgr.smithi067.rdualw (mgr.24569) 5360 : cluster [DBG] pgmap v4619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:48.821880+0000 mgr.smithi067.rdualw (mgr.24569) 5360 : cluster [DBG] pgmap v4619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:50.822758+0000 mgr.smithi067.rdualw (mgr.24569) 5361 : cluster [DBG] pgmap v4620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:50.822758+0000 mgr.smithi067.rdualw (mgr.24569) 5361 : cluster [DBG] pgmap v4620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:52.403 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:02:52.696 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:02:52.697 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 9m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:02:52.697 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 9m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:02:52.697 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 9m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:02:52.698 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 9m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:02:52.698 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 9m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:02:52.698 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 9m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:02:52.698 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 9m ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:02:52.699 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 9m ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:02:52.699 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 9m ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:02:52.699 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 9m ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:02:52.699 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 9m ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:02:52.700 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 9m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:02:52.700 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 9m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:02:52.700 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 9m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:02:52.700 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 9m ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:02:52.701 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 9m ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:02:52.701 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 9m ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:02:52.701 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 9m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:02:52.701 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 9m ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:02:52.701 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 9m ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:02:52.702 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 9m ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:02:52.702 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 9m ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:02:52.702 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 9m ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:02:53.037 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:02:53.038 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:02:53.038 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:02:53.038 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:02:53.038 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:02:53.039 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:02:53.039 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:02:53.039 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:02:53.039 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:02:53.039 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:02:53.040 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:02:53.040 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:02:53.040 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:02:53.040 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:02:53.040 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:02:53.041 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:02:53.041 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:02:53.041 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:02:53.041 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:02:53.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:02:52.391716+0000 mgr.smithi067.rdualw (mgr.24569) 5362 : audit [DBG] from='client.37714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:02:53.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:02:52.391716+0000 mgr.smithi067.rdualw (mgr.24569) 5362 : audit [DBG] from='client.37714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:02:54.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:02:52.680632+0000 mgr.smithi067.rdualw (mgr.24569) 5363 : audit [DBG] from='client.37718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:02:54.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:52.823233+0000 mgr.smithi067.rdualw (mgr.24569) 5364 : cluster [DBG] pgmap v4621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:02:53.037651+0000 mon.smithi061 (mon.0) 1235 : audit [DBG] from='client.? 172.21.15.61:0/4156916166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:02:54.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:02:52.680632+0000 mgr.smithi067.rdualw (mgr.24569) 5363 : audit [DBG] from='client.37718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:02:54.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:52.823233+0000 mgr.smithi067.rdualw (mgr.24569) 5364 : cluster [DBG] pgmap v4621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:54.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:02:53.037651+0000 mon.smithi061 (mon.0) 1235 : audit [DBG] from='client.? 172.21.15.61:0/4156916166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:02:56.216 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:54.823819+0000 mgr.smithi067.rdualw (mgr.24569) 5365 : cluster [DBG] pgmap v4622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:54.823819+0000 mgr.smithi067.rdualw (mgr.24569) 5365 : cluster [DBG] pgmap v4622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:02:58.217 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:56.824860+0000 mgr.smithi067.rdualw (mgr.24569) 5366 : cluster [DBG] pgmap v4623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:02:58.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:56.824860+0000 mgr.smithi067.rdualw (mgr.24569) 5366 : cluster [DBG] pgmap v4623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:03:00.217 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:02:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:02:58.825659+0000 mgr.smithi067.rdualw (mgr.24569) 5367 : cluster [DBG] pgmap v4624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:02:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:02:58.825659+0000 mgr.smithi067.rdualw (mgr.24569) 5367 : cluster [DBG] pgmap v4624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:00.826620+0000 mgr.smithi067.rdualw (mgr.24569) 5368 : cluster [DBG] pgmap v4625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:00.826620+0000 mgr.smithi067.rdualw (mgr.24569) 5368 : cluster [DBG] pgmap v4625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:04.217 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:02.827214+0000 mgr.smithi067.rdualw (mgr.24569) 5369 : cluster [DBG] pgmap v4626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:04.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:02.827214+0000 mgr.smithi067.rdualw (mgr.24569) 5369 : cluster [DBG] pgmap v4626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:06.218 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:04.827771+0000 mgr.smithi067.rdualw (mgr.24569) 5370 : cluster [DBG] pgmap v4627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:06.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:04.827771+0000 mgr.smithi067.rdualw (mgr.24569) 5370 : cluster [DBG] pgmap v4627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:08.218 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:06.828635+0000 mgr.smithi067.rdualw (mgr.24569) 5371 : cluster [DBG] pgmap v4628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:03:08.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:06.828635+0000 mgr.smithi067.rdualw (mgr.24569) 5371 : cluster [DBG] pgmap v4628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:03:10.218 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:08.829086+0000 mgr.smithi067.rdualw (mgr.24569) 5372 : cluster [DBG] pgmap v4629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:10.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:08.829086+0000 mgr.smithi067.rdualw (mgr.24569) 5372 : cluster [DBG] pgmap v4629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:10.830119+0000 mgr.smithi067.rdualw (mgr.24569) 5373 : cluster [DBG] pgmap v4630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:10.830119+0000 mgr.smithi067.rdualw (mgr.24569) 5373 : cluster [DBG] pgmap v4630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:14.219 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:12.830872+0000 mgr.smithi067.rdualw (mgr.24569) 5374 : cluster [DBG] pgmap v4631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:14.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:12.830872+0000 mgr.smithi067.rdualw (mgr.24569) 5374 : cluster [DBG] pgmap v4631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:16.219 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:14.831519+0000 mgr.smithi067.rdualw (mgr.24569) 5375 : cluster [DBG] pgmap v4632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:16.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:14.831519+0000 mgr.smithi067.rdualw (mgr.24569) 5375 : cluster [DBG] pgmap v4632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:18.220 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:16.832397+0000 mgr.smithi067.rdualw (mgr.24569) 5376 : cluster [DBG] pgmap v4633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:03:18.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:16.832397+0000 mgr.smithi067.rdualw (mgr.24569) 5376 : cluster [DBG] pgmap v4633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:03:20.220 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:18.832850+0000 mgr.smithi067.rdualw (mgr.24569) 5377 : cluster [DBG] pgmap v4634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:20.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:18.832850+0000 mgr.smithi067.rdualw (mgr.24569) 5377 : cluster [DBG] pgmap v4634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:20.833850+0000 mgr.smithi067.rdualw (mgr.24569) 5378 : cluster [DBG] pgmap v4635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:20.833850+0000 mgr.smithi067.rdualw (mgr.24569) 5378 : cluster [DBG] pgmap v4635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:23.344 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:03:23.637 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:03:23.637 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 10m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:03:23.638 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 10m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:03:23.638 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 10m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:03:23.638 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 10m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:03:23.638 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 10m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:03:23.639 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 10m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:03:23.639 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 10m ago 2h 461M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:03:23.639 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 10m ago 2h 548M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:03:23.639 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 10m ago 2h 973M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:03:23.640 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 10m ago 2h 515M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:03:23.640 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 10m ago 2h 187M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:03:23.640 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 10m ago 2h 115M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:03:23.640 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 10m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:03:23.641 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 10m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:03:23.641 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 10m ago 2h 787M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:03:23.641 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 10m ago 2h 1634M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:03:23.641 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 10m ago 2h 992M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:03:23.641 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 10m ago 2h 1760M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:03:23.642 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 10m ago 2h 1626M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:03:23.642 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 10m ago 2h 1845M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:03:23.642 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 10m ago 2h 1468M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:03:23.642 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 10m ago 2h 2344M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:03:23.643 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 10m ago 2h 85.5M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:03:23.976 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:03:23.977 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:03:23.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:03:23.977 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:03:23.977 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:03:23.978 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:03:23.978 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:03:23.978 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:03:23.978 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:03:23.979 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:03:23.979 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:03:23.979 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:03:23.979 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:03:23.980 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:03:23.980 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:03:23.980 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:03:23.980 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:03:23.980 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:03:23.981 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:03:24.221 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:22.834436+0000 mgr.smithi067.rdualw (mgr.24569) 5379 : cluster [DBG] pgmap v4636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:24.221 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:23.332585+0000 mgr.smithi067.rdualw (mgr.24569) 5380 : audit [DBG] from='client.37726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:03:24.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:22.834436+0000 mgr.smithi067.rdualw (mgr.24569) 5379 : cluster [DBG] pgmap v4636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:24.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:23.332585+0000 mgr.smithi067.rdualw (mgr.24569) 5380 : audit [DBG] from='client.37726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:03:25.221 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:23.621180+0000 mgr.smithi067.rdualw (mgr.24569) 5381 : audit [DBG] from='client.37730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:03:25.221 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:23.976811+0000 mon.smithi061 (mon.0) 1236 : audit [DBG] from='client.? 172.21.15.61:0/309482439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:03:25.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:23.621180+0000 mgr.smithi067.rdualw (mgr.24569) 5381 : audit [DBG] from='client.37730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:03:25.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:23.976811+0000 mon.smithi061 (mon.0) 1236 : audit [DBG] from='client.? 172.21.15.61:0/309482439' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:03:26.221 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:24.835129+0000 mgr.smithi067.rdualw (mgr.24569) 5382 : cluster [DBG] pgmap v4637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:26.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:24.835129+0000 mgr.smithi067.rdualw (mgr.24569) 5382 : cluster [DBG] pgmap v4637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:28.221 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:26.835986+0000 mgr.smithi067.rdualw (mgr.24569) 5383 : cluster [DBG] pgmap v4638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:03:28.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:26.835986+0000 mgr.smithi067.rdualw (mgr.24569) 5383 : cluster [DBG] pgmap v4638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:03:30.222 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:28.836665+0000 mgr.smithi067.rdualw (mgr.24569) 5384 : cluster [DBG] pgmap v4639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:30.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:28.836665+0000 mgr.smithi067.rdualw (mgr.24569) 5384 : cluster [DBG] pgmap v4639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:30.837662+0000 mgr.smithi067.rdualw (mgr.24569) 5385 : cluster [DBG] pgmap v4640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:30.845806+0000 mon.smithi067 (mon.1) 835 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:03:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:30.847313+0000 mon.smithi067 (mon.1) 836 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:03:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:30.848318+0000 mon.smithi067 (mon.1) 837 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:03:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:03:30.849225+0000 mgr.smithi067.rdualw (mgr.24569) 5386 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:03:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:30.837662+0000 mgr.smithi067.rdualw (mgr.24569) 5385 : cluster [DBG] pgmap v4640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:30.845806+0000 mon.smithi067 (mon.1) 835 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:03:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:30.847313+0000 mon.smithi067 (mon.1) 836 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:03:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:30.848318+0000 mon.smithi067 (mon.1) 837 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:03:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:03:30.849225+0000 mgr.smithi067.rdualw (mgr.24569) 5386 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:03:34.222 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:32.838077+0000 mgr.smithi067.rdualw (mgr.24569) 5387 : cluster [DBG] pgmap v4641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:34.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:32.838077+0000 mgr.smithi067.rdualw (mgr.24569) 5387 : cluster [DBG] pgmap v4641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:34.838784+0000 mgr.smithi067.rdualw (mgr.24569) 5388 : cluster [DBG] pgmap v4642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:35.239824+0000 mon.smithi061 (mon.0) 1237 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:03:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:35.275480+0000 mon.smithi067 (mon.1) 838 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:03:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:35.275760+0000 mon.smithi067 (mon.1) 839 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:03:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:35.275792+0000 mon.smithi061 (mon.0) 1238 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:03:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:35.276320+0000 mon.smithi061 (mon.0) 1239 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:03:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:35.641746+0000 mon.smithi067 (mon.1) 840 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:03:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:35.642120+0000 mon.smithi061 (mon.0) 1240 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:03:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:34.838784+0000 mgr.smithi067.rdualw (mgr.24569) 5388 : cluster [DBG] pgmap v4642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:35.239824+0000 mon.smithi061 (mon.0) 1237 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:03:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:35.275480+0000 mon.smithi067 (mon.1) 838 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:03:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:35.275760+0000 mon.smithi067 (mon.1) 839 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:03:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:35.275792+0000 mon.smithi061 (mon.0) 1238 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:03:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:35.276320+0000 mon.smithi061 (mon.0) 1239 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:03:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:35.641746+0000 mon.smithi067 (mon.1) 840 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:03:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:35.642120+0000 mon.smithi061 (mon.0) 1240 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:03:38.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:36.839828+0000 mgr.smithi067.rdualw (mgr.24569) 5389 : cluster [DBG] pgmap v4643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:03:38.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:37.964734+0000 mon.smithi061 (mon.0) 1241 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:03:38.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:36.839828+0000 mgr.smithi067.rdualw (mgr.24569) 5389 : cluster [DBG] pgmap v4643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:03:38.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:37.964734+0000 mon.smithi061 (mon.0) 1241 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:03:39.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:38.371203+0000 mon.smithi067 (mon.1) 841 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:03:39.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:38.371610+0000 mon.smithi061 (mon.0) 1242 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:03:39.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:38.376299+0000 mon.smithi061 (mon.0) 1243 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:03:39.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:38.385486+0000 mon.smithi061 (mon.0) 1244 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:03:39.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:38.371203+0000 mon.smithi067 (mon.1) 841 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:03:39.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:38.371610+0000 mon.smithi061 (mon.0) 1242 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:03:39.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:38.376299+0000 mon.smithi061 (mon.0) 1243 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:03:39.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:38.385486+0000 mon.smithi061 (mon.0) 1244 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:03:40.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:38.840301+0000 mgr.smithi067.rdualw (mgr.24569) 5390 : cluster [DBG] pgmap v4644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:40.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:38.840301+0000 mgr.smithi067.rdualw (mgr.24569) 5390 : cluster [DBG] pgmap v4644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:40.841151+0000 mgr.smithi067.rdualw (mgr.24569) 5391 : cluster [DBG] pgmap v4645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:40.841151+0000 mgr.smithi067.rdualw (mgr.24569) 5391 : cluster [DBG] pgmap v4645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:44.224 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:42.841644+0000 mgr.smithi067.rdualw (mgr.24569) 5392 : cluster [DBG] pgmap v4646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:44.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:42.841644+0000 mgr.smithi067.rdualw (mgr.24569) 5392 : cluster [DBG] pgmap v4646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:46.224 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:44.842205+0000 mgr.smithi067.rdualw (mgr.24569) 5393 : cluster [DBG] pgmap v4647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:46.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:44.842205+0000 mgr.smithi067.rdualw (mgr.24569) 5393 : cluster [DBG] pgmap v4647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:48.225 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:46.843017+0000 mgr.smithi067.rdualw (mgr.24569) 5394 : cluster [DBG] pgmap v4648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:03:48.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:46.843017+0000 mgr.smithi067.rdualw (mgr.24569) 5394 : cluster [DBG] pgmap v4648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:03:50.225 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:48.843501+0000 mgr.smithi067.rdualw (mgr.24569) 5395 : cluster [DBG] pgmap v4649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:50.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:48.843501+0000 mgr.smithi067.rdualw (mgr.24569) 5395 : cluster [DBG] pgmap v4649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:50.844402+0000 mgr.smithi067.rdualw (mgr.24569) 5396 : cluster [DBG] pgmap v4650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:50.844402+0000 mgr.smithi067.rdualw (mgr.24569) 5396 : cluster [DBG] pgmap v4650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:54.225 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:52.844915+0000 mgr.smithi067.rdualw (mgr.24569) 5397 : cluster [DBG] pgmap v4651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:54.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:52.844915+0000 mgr.smithi067.rdualw (mgr.24569) 5397 : cluster [DBG] pgmap v4651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:54.372 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:03:54.663 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:03:54.663 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 16s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:03:54.664 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 16s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:03:54.664 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 19s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:03:54.664 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 16s ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:03:54.665 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 16s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:03:54.665 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 19s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:03:54.665 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 16s ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:03:54.665 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 19s ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:03:54.666 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 16s ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:03:54.666 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 19s ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:03:54.666 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 16s ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:03:54.666 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 19s ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:03:54.667 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 16s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:03:54.667 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 19s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:03:54.667 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 16s ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:03:54.667 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 16s ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:03:54.667 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 16s ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:03:54.668 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 16s ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:03:54.668 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 19s ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:03:54.668 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 19s ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:03:54.668 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 19s ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:03:54.668 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 19s ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:03:54.669 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 16s ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:03:55.013 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:03:55.013 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:03:55.014 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:03:55.014 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:03:55.014 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:03:55.014 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:03:55.015 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:03:55.015 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:03:55.015 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:03:55.015 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:03:55.015 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:03:55.016 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:03:55.016 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:03:55.016 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:03:55.016 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:03:55.017 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:03:55.017 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:03:55.017 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:03:55.017 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:03:55.226 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:54.359791+0000 mgr.smithi067.rdualw (mgr.24569) 5398 : audit [DBG] from='client.37738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:03:55.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:54.359791+0000 mgr.smithi067.rdualw (mgr.24569) 5398 : audit [DBG] from='client.37738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:03:56.226 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:54.647281+0000 mgr.smithi067.rdualw (mgr.24569) 5399 : audit [DBG] from='client.37742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:03:56.226 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:54.845638+0000 mgr.smithi067.rdualw (mgr.24569) 5400 : cluster [DBG] pgmap v4652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:56.227 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:03:55.012776+0000 mon.smithi061 (mon.0) 1245 : audit [DBG] from='client.? 172.21.15.61:0/3712356896' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:03:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:54.647281+0000 mgr.smithi067.rdualw (mgr.24569) 5399 : audit [DBG] from='client.37742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:03:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:54.845638+0000 mgr.smithi067.rdualw (mgr.24569) 5400 : cluster [DBG] pgmap v4652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:03:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:03:55.012776+0000 mon.smithi061 (mon.0) 1245 : audit [DBG] from='client.? 172.21.15.61:0/3712356896' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:03:58.226 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:56.846590+0000 mgr.smithi067.rdualw (mgr.24569) 5401 : cluster [DBG] pgmap v4653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:03:58.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:56.846590+0000 mgr.smithi067.rdualw (mgr.24569) 5401 : cluster [DBG] pgmap v4653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:04:00.226 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:03:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:03:58.847103+0000 mgr.smithi067.rdualw (mgr.24569) 5402 : cluster [DBG] pgmap v4654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:00.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:03:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:03:58.847103+0000 mgr.smithi067.rdualw (mgr.24569) 5402 : cluster [DBG] pgmap v4654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:00.848066+0000 mgr.smithi067.rdualw (mgr.24569) 5403 : cluster [DBG] pgmap v4655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:00.848066+0000 mgr.smithi067.rdualw (mgr.24569) 5403 : cluster [DBG] pgmap v4655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:04.227 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:02.848624+0000 mgr.smithi067.rdualw (mgr.24569) 5404 : cluster [DBG] pgmap v4656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:04.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:02.848624+0000 mgr.smithi067.rdualw (mgr.24569) 5404 : cluster [DBG] pgmap v4656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:06.227 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:04.849309+0000 mgr.smithi067.rdualw (mgr.24569) 5405 : cluster [DBG] pgmap v4657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:06.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:04.849309+0000 mgr.smithi067.rdualw (mgr.24569) 5405 : cluster [DBG] pgmap v4657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:08.227 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:06.850150+0000 mgr.smithi067.rdualw (mgr.24569) 5406 : cluster [DBG] pgmap v4658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:04:08.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:06.850150+0000 mgr.smithi067.rdualw (mgr.24569) 5406 : cluster [DBG] pgmap v4658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:04:10.228 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:08.850756+0000 mgr.smithi067.rdualw (mgr.24569) 5407 : cluster [DBG] pgmap v4659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:10.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:08.850756+0000 mgr.smithi067.rdualw (mgr.24569) 5407 : cluster [DBG] pgmap v4659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:10.851749+0000 mgr.smithi067.rdualw (mgr.24569) 5408 : cluster [DBG] pgmap v4660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:12.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:10.851749+0000 mgr.smithi067.rdualw (mgr.24569) 5408 : cluster [DBG] pgmap v4660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:14.228 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:12.852424+0000 mgr.smithi067.rdualw (mgr.24569) 5409 : cluster [DBG] pgmap v4661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:14.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:12.852424+0000 mgr.smithi067.rdualw (mgr.24569) 5409 : cluster [DBG] pgmap v4661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:16.229 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:14.853073+0000 mgr.smithi067.rdualw (mgr.24569) 5410 : cluster [DBG] pgmap v4662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:16.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:14.853073+0000 mgr.smithi067.rdualw (mgr.24569) 5410 : cluster [DBG] pgmap v4662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:18.229 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:16.853880+0000 mgr.smithi067.rdualw (mgr.24569) 5411 : cluster [DBG] pgmap v4663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:04:18.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:16.853880+0000 mgr.smithi067.rdualw (mgr.24569) 5411 : cluster [DBG] pgmap v4663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:04:20.229 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:18.854580+0000 mgr.smithi067.rdualw (mgr.24569) 5412 : cluster [DBG] pgmap v4664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:20.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:18.854580+0000 mgr.smithi067.rdualw (mgr.24569) 5412 : cluster [DBG] pgmap v4664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:20.855472+0000 mgr.smithi067.rdualw (mgr.24569) 5413 : cluster [DBG] pgmap v4665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:20.855472+0000 mgr.smithi067.rdualw (mgr.24569) 5413 : cluster [DBG] pgmap v4665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:24.230 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:22.856072+0000 mgr.smithi067.rdualw (mgr.24569) 5414 : cluster [DBG] pgmap v4666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:24.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:22.856072+0000 mgr.smithi067.rdualw (mgr.24569) 5414 : cluster [DBG] pgmap v4666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:25.318 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:04:25.610 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:04:25.611 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 47s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:04:25.611 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 47s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:04:25.611 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 50s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:04:25.611 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 47s ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:04:25.612 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 47s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:04:25.612 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 50s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:04:25.612 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 47s ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:04:25.612 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 50s ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:04:25.613 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 47s ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:04:25.613 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 50s ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:04:25.613 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 47s ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:04:25.613 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 50s ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:04:25.613 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 47s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:04:25.614 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 50s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:04:25.614 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 47s ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:04:25.614 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 47s ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:04:25.614 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 47s ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:04:25.615 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 47s ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:04:25.615 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 50s ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:04:25.615 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 50s ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:04:25.615 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 50s ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:04:25.615 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 50s ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:04:25.616 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 47s ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:04:25.952 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:04:25.953 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:04:25.953 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:04:25.954 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:04:25.954 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:04:25.955 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:04:25.955 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:04:25.956 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:04:25.956 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:04:25.957 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:04:25.957 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:04:25.958 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:04:25.958 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:04:25.959 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:04:25.959 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:04:25.959 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:04:25.960 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:04:25.960 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:04:25.960 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:04:26.230 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:24.856660+0000 mgr.smithi067.rdualw (mgr.24569) 5415 : cluster [DBG] pgmap v4667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:26.231 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:04:25.306857+0000 mgr.smithi067.rdualw (mgr.24569) 5416 : audit [DBG] from='client.37750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:04:26.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:24.856660+0000 mgr.smithi067.rdualw (mgr.24569) 5415 : cluster [DBG] pgmap v4667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:26.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:04:25.306857+0000 mgr.smithi067.rdualw (mgr.24569) 5416 : audit [DBG] from='client.37750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:04:27.230 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:04:25.594880+0000 mgr.smithi067.rdualw (mgr.24569) 5417 : audit [DBG] from='client.37754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:04:27.231 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:04:25.952842+0000 mon.smithi061 (mon.0) 1246 : audit [DBG] from='client.? 172.21.15.61:0/1352713511' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:04:27.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:04:25.594880+0000 mgr.smithi067.rdualw (mgr.24569) 5417 : audit [DBG] from='client.37754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:04:27.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:04:25.952842+0000 mon.smithi061 (mon.0) 1246 : audit [DBG] from='client.? 172.21.15.61:0/1352713511' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:04:28.231 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:26.857722+0000 mgr.smithi067.rdualw (mgr.24569) 5418 : cluster [DBG] pgmap v4668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:04:28.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:26.857722+0000 mgr.smithi067.rdualw (mgr.24569) 5418 : cluster [DBG] pgmap v4668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:04:30.231 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:28.858349+0000 mgr.smithi067.rdualw (mgr.24569) 5419 : cluster [DBG] pgmap v4669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:30.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:28.858349+0000 mgr.smithi067.rdualw (mgr.24569) 5419 : cluster [DBG] pgmap v4669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:30.859320+0000 mgr.smithi067.rdualw (mgr.24569) 5420 : cluster [DBG] pgmap v4670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:32.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:30.859320+0000 mgr.smithi067.rdualw (mgr.24569) 5420 : cluster [DBG] pgmap v4670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:34.232 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:32.860026+0000 mgr.smithi067.rdualw (mgr.24569) 5421 : cluster [DBG] pgmap v4671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:34.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:32.860026+0000 mgr.smithi067.rdualw (mgr.24569) 5421 : cluster [DBG] pgmap v4671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:36.232 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:34.860841+0000 mgr.smithi067.rdualw (mgr.24569) 5422 : cluster [DBG] pgmap v4672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:36.233 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:04:35.281560+0000 mon.smithi067 (mon.1) 842 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:04:36.233 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:04:35.281810+0000 mon.smithi067 (mon.1) 843 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:04:36.233 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:04:35.282127+0000 mon.smithi061 (mon.0) 1247 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:04:36.234 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:04:35.282426+0000 mon.smithi061 (mon.0) 1248 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:04:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:34.860841+0000 mgr.smithi067.rdualw (mgr.24569) 5422 : cluster [DBG] pgmap v4672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:04:35.281560+0000 mon.smithi067 (mon.1) 842 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:04:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:04:35.281810+0000 mon.smithi067 (mon.1) 843 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:04:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:04:35.282127+0000 mon.smithi061 (mon.0) 1247 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:04:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:04:35.282426+0000 mon.smithi061 (mon.0) 1248 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:04:38.232 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:36.861767+0000 mgr.smithi067.rdualw (mgr.24569) 5423 : cluster [DBG] pgmap v4673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:04:38.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:36.861767+0000 mgr.smithi067.rdualw (mgr.24569) 5423 : cluster [DBG] pgmap v4673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:04:39.233 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:04:38.390391+0000 mon.smithi067 (mon.1) 844 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:04:39.233 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:04:38.391900+0000 mon.smithi067 (mon.1) 845 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:04:39.233 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:04:38.392818+0000 mon.smithi067 (mon.1) 846 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:04:39.234 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:04:38.393661+0000 mgr.smithi067.rdualw (mgr.24569) 5424 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:04:39.234 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:04:38.814255+0000 mon.smithi061 (mon.0) 1249 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:04:39.234 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:04:38.820264+0000 mon.smithi061 (mon.0) 1250 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:04:39.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:04:38.390391+0000 mon.smithi067 (mon.1) 844 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:04:39.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:04:38.391900+0000 mon.smithi067 (mon.1) 845 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:04:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:04:38.392818+0000 mon.smithi067 (mon.1) 846 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:04:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:04:38.393661+0000 mgr.smithi067.rdualw (mgr.24569) 5424 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:04:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:04:38.814255+0000 mon.smithi061 (mon.0) 1249 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:04:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:04:38.820264+0000 mon.smithi061 (mon.0) 1250 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:04:40.233 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:38.862465+0000 mgr.smithi067.rdualw (mgr.24569) 5425 : cluster [DBG] pgmap v4674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:40.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:38.862465+0000 mgr.smithi067.rdualw (mgr.24569) 5425 : cluster [DBG] pgmap v4674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:40.863326+0000 mgr.smithi067.rdualw (mgr.24569) 5426 : cluster [DBG] pgmap v4675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:40.863326+0000 mgr.smithi067.rdualw (mgr.24569) 5426 : cluster [DBG] pgmap v4675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:44.233 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:42.863837+0000 mgr.smithi067.rdualw (mgr.24569) 5427 : cluster [DBG] pgmap v4676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:44.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:42.863837+0000 mgr.smithi067.rdualw (mgr.24569) 5427 : cluster [DBG] pgmap v4676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:46.234 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:44.864466+0000 mgr.smithi067.rdualw (mgr.24569) 5428 : cluster [DBG] pgmap v4677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:46.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:44.864466+0000 mgr.smithi067.rdualw (mgr.24569) 5428 : cluster [DBG] pgmap v4677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:48.234 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:46.865361+0000 mgr.smithi067.rdualw (mgr.24569) 5429 : cluster [DBG] pgmap v4678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:04:48.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:46.865361+0000 mgr.smithi067.rdualw (mgr.24569) 5429 : cluster [DBG] pgmap v4678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:04:50.234 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:48.865958+0000 mgr.smithi067.rdualw (mgr.24569) 5430 : cluster [DBG] pgmap v4679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:50.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:48.865958+0000 mgr.smithi067.rdualw (mgr.24569) 5430 : cluster [DBG] pgmap v4679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:50.867009+0000 mgr.smithi067.rdualw (mgr.24569) 5431 : cluster [DBG] pgmap v4680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:50.867009+0000 mgr.smithi067.rdualw (mgr.24569) 5431 : cluster [DBG] pgmap v4680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:54.235 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:52.867519+0000 mgr.smithi067.rdualw (mgr.24569) 5432 : cluster [DBG] pgmap v4681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:54.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:52.867519+0000 mgr.smithi067.rdualw (mgr.24569) 5432 : cluster [DBG] pgmap v4681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:56.235 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:54.868235+0000 mgr.smithi067.rdualw (mgr.24569) 5433 : cluster [DBG] pgmap v4682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:56.265 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:04:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:54.868235+0000 mgr.smithi067.rdualw (mgr.24569) 5433 : cluster [DBG] pgmap v4682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:04:56.566 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:04:56.566 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 78s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:04:56.567 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 78s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:04:56.567 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 81s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:04:56.567 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 78s ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:04:56.567 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 78s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:04:56.568 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 81s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:04:56.568 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 78s ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:04:56.568 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 81s ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:04:56.568 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 78s ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:04:56.568 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 81s ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:04:56.569 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 78s ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:04:56.569 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 81s ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:04:56.569 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 78s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:04:56.569 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 81s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:04:56.569 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 78s ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:04:56.570 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 78s ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:04:56.570 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 78s ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:04:56.570 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 78s ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:04:56.570 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 81s ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:04:56.570 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 81s ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:04:56.571 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 81s ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:04:56.571 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 81s ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:04:56.571 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 78s ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:04:56.905 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:04:56.906 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:04:56.906 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:04:56.906 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:04:56.906 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:04:56.907 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:04:56.907 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:04:56.908 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:04:56.908 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:04:56.908 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:04:56.909 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:04:56.909 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:04:56.909 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:04:56.909 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:04:56.909 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:04:56.910 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:04:56.910 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:04:56.910 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:04:56.910 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:04:57.235 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:04:56.253431+0000 mgr.smithi067.rdualw (mgr.24569) 5434 : audit [DBG] from='client.37762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:04:57.236 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:04:56.905728+0000 mon.smithi061 (mon.0) 1251 : audit [DBG] from='client.? 172.21.15.61:0/3188029816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:04:57.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:04:56.253431+0000 mgr.smithi067.rdualw (mgr.24569) 5434 : audit [DBG] from='client.37762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:04:57.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:04:56.905728+0000 mon.smithi061 (mon.0) 1251 : audit [DBG] from='client.? 172.21.15.61:0/3188029816' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:04:58.236 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:04:56.550376+0000 mgr.smithi067.rdualw (mgr.24569) 5435 : audit [DBG] from='client.37766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:04:58.236 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:56.869070+0000 mgr.smithi067.rdualw (mgr.24569) 5436 : cluster [DBG] pgmap v4683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:04:58.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:04:56.550376+0000 mgr.smithi067.rdualw (mgr.24569) 5435 : audit [DBG] from='client.37766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:04:58.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:56.869070+0000 mgr.smithi067.rdualw (mgr.24569) 5436 : cluster [DBG] pgmap v4683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:05:00.236 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:04:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:04:58.869675+0000 mgr.smithi067.rdualw (mgr.24569) 5437 : cluster [DBG] pgmap v4684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:00.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:04:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:04:58.869675+0000 mgr.smithi067.rdualw (mgr.24569) 5437 : cluster [DBG] pgmap v4684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:00.870526+0000 mgr.smithi067.rdualw (mgr.24569) 5438 : cluster [DBG] pgmap v4685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:00.870526+0000 mgr.smithi067.rdualw (mgr.24569) 5438 : cluster [DBG] pgmap v4685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:04.236 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:02.871075+0000 mgr.smithi067.rdualw (mgr.24569) 5439 : cluster [DBG] pgmap v4686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:04.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:02.871075+0000 mgr.smithi067.rdualw (mgr.24569) 5439 : cluster [DBG] pgmap v4686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:06.236 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:04.871930+0000 mgr.smithi067.rdualw (mgr.24569) 5440 : cluster [DBG] pgmap v4687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:06.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:04.871930+0000 mgr.smithi067.rdualw (mgr.24569) 5440 : cluster [DBG] pgmap v4687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:08.237 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:06.872857+0000 mgr.smithi067.rdualw (mgr.24569) 5441 : cluster [DBG] pgmap v4688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:05:08.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:06.872857+0000 mgr.smithi067.rdualw (mgr.24569) 5441 : cluster [DBG] pgmap v4688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:05:10.237 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:08.873407+0000 mgr.smithi067.rdualw (mgr.24569) 5442 : cluster [DBG] pgmap v4689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:10.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:08.873407+0000 mgr.smithi067.rdualw (mgr.24569) 5442 : cluster [DBG] pgmap v4689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:10.874299+0000 mgr.smithi067.rdualw (mgr.24569) 5443 : cluster [DBG] pgmap v4690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:10.874299+0000 mgr.smithi067.rdualw (mgr.24569) 5443 : cluster [DBG] pgmap v4690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:14.238 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:12.874991+0000 mgr.smithi067.rdualw (mgr.24569) 5444 : cluster [DBG] pgmap v4691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:14.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:12.874991+0000 mgr.smithi067.rdualw (mgr.24569) 5444 : cluster [DBG] pgmap v4691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:16.239 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:14.875640+0000 mgr.smithi067.rdualw (mgr.24569) 5445 : cluster [DBG] pgmap v4692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:16.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:14.875640+0000 mgr.smithi067.rdualw (mgr.24569) 5445 : cluster [DBG] pgmap v4692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:18.239 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:16.876608+0000 mgr.smithi067.rdualw (mgr.24569) 5446 : cluster [DBG] pgmap v4693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:05:18.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:16.876608+0000 mgr.smithi067.rdualw (mgr.24569) 5446 : cluster [DBG] pgmap v4693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:05:20.240 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:18.877385+0000 mgr.smithi067.rdualw (mgr.24569) 5447 : cluster [DBG] pgmap v4694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:20.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:18.877385+0000 mgr.smithi067.rdualw (mgr.24569) 5447 : cluster [DBG] pgmap v4694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:20.878341+0000 mgr.smithi067.rdualw (mgr.24569) 5448 : cluster [DBG] pgmap v4695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:20.878341+0000 mgr.smithi067.rdualw (mgr.24569) 5448 : cluster [DBG] pgmap v4695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:24.240 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:22.879058+0000 mgr.smithi067.rdualw (mgr.24569) 5449 : cluster [DBG] pgmap v4696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:24.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:22.879058+0000 mgr.smithi067.rdualw (mgr.24569) 5449 : cluster [DBG] pgmap v4696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:26.240 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:24.879756+0000 mgr.smithi067.rdualw (mgr.24569) 5450 : cluster [DBG] pgmap v4697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:26.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:24.879756+0000 mgr.smithi067.rdualw (mgr.24569) 5450 : cluster [DBG] pgmap v4697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:27.295 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:05:27.583 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:05:27.583 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 109s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:05:27.584 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 109s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:05:27.584 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 112s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:05:27.585 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 109s ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:05:27.585 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 109s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:05:27.586 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 112s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:05:27.586 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 109s ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:05:27.587 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 112s ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:05:27.587 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 109s ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:05:27.588 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 112s ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:05:27.588 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 109s ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:05:27.589 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 112s ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:05:27.589 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 109s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:05:27.590 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 112s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:05:27.590 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 109s ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:05:27.590 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 109s ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:05:27.591 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 109s ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:05:27.591 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 109s ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:05:27.592 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 112s ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:05:27.592 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 112s ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:05:27.593 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 112s ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:05:27.593 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 112s ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:05:27.594 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 109s ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:05:27.989 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:05:27.989 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:05:27.990 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:05:27.990 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:05:27.990 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:05:27.991 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:05:27.991 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:05:27.991 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:05:27.991 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:05:27.991 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:05:27.992 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:05:27.992 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:05:27.992 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:05:27.992 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:05:27.993 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:05:27.993 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:05:27.993 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:05:27.993 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:05:27.993 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:05:28.241 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:26.880889+0000 mgr.smithi067.rdualw (mgr.24569) 5451 : cluster [DBG] pgmap v4698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:05:28.241 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:05:27.282739+0000 mgr.smithi067.rdualw (mgr.24569) 5452 : audit [DBG] from='client.37774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:05:28.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:26.880889+0000 mgr.smithi067.rdualw (mgr.24569) 5451 : cluster [DBG] pgmap v4698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:05:28.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:05:27.282739+0000 mgr.smithi067.rdualw (mgr.24569) 5452 : audit [DBG] from='client.37774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:05:29.241 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:05:27.567113+0000 mgr.smithi067.rdualw (mgr.24569) 5453 : audit [DBG] from='client.37778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:05:29.242 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:05:27.989356+0000 mon.smithi061 (mon.0) 1252 : audit [DBG] from='client.? 172.21.15.61:0/133397862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:05:29.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:05:27.567113+0000 mgr.smithi067.rdualw (mgr.24569) 5453 : audit [DBG] from='client.37778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:05:29.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:05:27.989356+0000 mon.smithi061 (mon.0) 1252 : audit [DBG] from='client.? 172.21.15.61:0/133397862' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:05:30.241 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:28.881586+0000 mgr.smithi067.rdualw (mgr.24569) 5454 : cluster [DBG] pgmap v4699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:28.881586+0000 mgr.smithi067.rdualw (mgr.24569) 5454 : cluster [DBG] pgmap v4699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:32.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:30.882651+0000 mgr.smithi067.rdualw (mgr.24569) 5455 : cluster [DBG] pgmap v4700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:30.882651+0000 mgr.smithi067.rdualw (mgr.24569) 5455 : cluster [DBG] pgmap v4700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:34.242 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:32.883172+0000 mgr.smithi067.rdualw (mgr.24569) 5456 : cluster [DBG] pgmap v4701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:34.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:32.883172+0000 mgr.smithi067.rdualw (mgr.24569) 5456 : cluster [DBG] pgmap v4701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:36.242 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:34.883938+0000 mgr.smithi067.rdualw (mgr.24569) 5457 : cluster [DBG] pgmap v4702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:36.243 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:05:35.286858+0000 mon.smithi067 (mon.1) 847 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:05:36.243 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:05:35.287132+0000 mon.smithi067 (mon.1) 848 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:05:36.243 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:05:35.287167+0000 mon.smithi061 (mon.0) 1253 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:05:36.244 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:05:35.287488+0000 mon.smithi061 (mon.0) 1254 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:05:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:34.883938+0000 mgr.smithi067.rdualw (mgr.24569) 5457 : cluster [DBG] pgmap v4702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:05:35.286858+0000 mon.smithi067 (mon.1) 847 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:05:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:05:35.287132+0000 mon.smithi067 (mon.1) 848 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:05:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:05:35.287167+0000 mon.smithi061 (mon.0) 1253 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:05:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:05:35.287488+0000 mon.smithi061 (mon.0) 1254 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:05:38.242 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:36.884798+0000 mgr.smithi067.rdualw (mgr.24569) 5458 : cluster [DBG] pgmap v4703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:05:38.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:36.884798+0000 mgr.smithi067.rdualw (mgr.24569) 5458 : cluster [DBG] pgmap v4703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:05:39.243 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:05:38.823739+0000 mon.smithi067 (mon.1) 849 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:05:39.243 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:05:38.825182+0000 mon.smithi067 (mon.1) 850 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:05:39.244 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:05:38.826125+0000 mon.smithi067 (mon.1) 851 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:05:39.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:05:38.823739+0000 mon.smithi067 (mon.1) 849 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:05:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:05:38.825182+0000 mon.smithi067 (mon.1) 850 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:05:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:05:38.826125+0000 mon.smithi067 (mon.1) 851 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:05:40.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:05:38.826979+0000 mgr.smithi067.rdualw (mgr.24569) 5459 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:05:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:38.885337+0000 mgr.smithi067.rdualw (mgr.24569) 5460 : cluster [DBG] pgmap v4704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:05:39.191491+0000 mon.smithi061 (mon.0) 1255 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:05:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:05:39.195220+0000 mon.smithi061 (mon.0) 1256 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:05:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:05:39.596829+0000 mon.smithi061 (mon.0) 1257 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:05:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:05:39.602162+0000 mon.smithi061 (mon.0) 1258 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:05:40.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:05:38.826979+0000 mgr.smithi067.rdualw (mgr.24569) 5459 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:05:40.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:38.885337+0000 mgr.smithi067.rdualw (mgr.24569) 5460 : cluster [DBG] pgmap v4704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:05:39.191491+0000 mon.smithi061 (mon.0) 1255 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:05:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:05:39.195220+0000 mon.smithi061 (mon.0) 1256 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:05:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:05:39.596829+0000 mon.smithi061 (mon.0) 1257 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:05:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:05:39.602162+0000 mon.smithi061 (mon.0) 1258 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:05:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:40.886159+0000 mgr.smithi067.rdualw (mgr.24569) 5461 : cluster [DBG] pgmap v4705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:40.886159+0000 mgr.smithi067.rdualw (mgr.24569) 5461 : cluster [DBG] pgmap v4705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:44.243 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:42.886663+0000 mgr.smithi067.rdualw (mgr.24569) 5462 : cluster [DBG] pgmap v4706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:44.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:42.886663+0000 mgr.smithi067.rdualw (mgr.24569) 5462 : cluster [DBG] pgmap v4706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:46.244 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:44.887270+0000 mgr.smithi067.rdualw (mgr.24569) 5463 : cluster [DBG] pgmap v4707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:46.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:44.887270+0000 mgr.smithi067.rdualw (mgr.24569) 5463 : cluster [DBG] pgmap v4707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:48.244 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:46.888097+0000 mgr.smithi067.rdualw (mgr.24569) 5464 : cluster [DBG] pgmap v4708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:05:48.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:46.888097+0000 mgr.smithi067.rdualw (mgr.24569) 5464 : cluster [DBG] pgmap v4708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:05:50.244 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:48.888608+0000 mgr.smithi067.rdualw (mgr.24569) 5465 : cluster [DBG] pgmap v4709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:50.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:48.888608+0000 mgr.smithi067.rdualw (mgr.24569) 5465 : cluster [DBG] pgmap v4709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:50.889430+0000 mgr.smithi067.rdualw (mgr.24569) 5466 : cluster [DBG] pgmap v4710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:52.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:50.889430+0000 mgr.smithi067.rdualw (mgr.24569) 5466 : cluster [DBG] pgmap v4710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:54.245 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:52.889974+0000 mgr.smithi067.rdualw (mgr.24569) 5467 : cluster [DBG] pgmap v4711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:54.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:52.889974+0000 mgr.smithi067.rdualw (mgr.24569) 5467 : cluster [DBG] pgmap v4711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:56.245 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:54.890703+0000 mgr.smithi067.rdualw (mgr.24569) 5468 : cluster [DBG] pgmap v4712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:54.890703+0000 mgr.smithi067.rdualw (mgr.24569) 5468 : cluster [DBG] pgmap v4712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:05:58.246 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:56.891701+0000 mgr.smithi067.rdualw (mgr.24569) 5469 : cluster [DBG] pgmap v4713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:05:58.295 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:05:58.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:56.891701+0000 mgr.smithi067.rdualw (mgr.24569) 5469 : cluster [DBG] pgmap v4713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:05:58.586 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:05:58.587 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 2m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:05:58.588 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 2m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:05:58.588 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 2m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:05:58.588 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 2m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:05:58.588 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 2m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:05:58.589 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 2m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:05:58.589 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 2m ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:05:58.589 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 2m ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:05:58.589 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 2m ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:05:58.590 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 2m ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:05:58.590 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 2m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:05:58.590 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 2m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:05:58.590 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 2m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:05:58.591 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 2m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:05:58.591 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 2m ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:05:58.591 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 2m ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:05:58.591 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 2m ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:05:58.591 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 2m ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:05:58.592 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 2m ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:05:58.592 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 2m ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:05:58.592 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 2m ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:05:58.592 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 2m ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:05:58.593 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 2m ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:05:58.928 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:05:58.929 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:05:58.929 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:05:58.929 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:05:58.929 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:05:58.930 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:05:58.930 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:05:58.930 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:05:58.930 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:05:58.931 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:05:58.931 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:05:58.931 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:05:58.931 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:05:58.931 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:05:58.932 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:05:58.932 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:05:58.932 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:05:58.932 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:05:58.932 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:05:59.246 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:05:58.282845+0000 mgr.smithi067.rdualw (mgr.24569) 5470 : audit [DBG] from='client.37786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:05:59.246 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:05:58.928442+0000 mon.smithi061 (mon.0) 1259 : audit [DBG] from='client.? 172.21.15.61:0/1960002015' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:05:59.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:05:58.282845+0000 mgr.smithi067.rdualw (mgr.24569) 5470 : audit [DBG] from='client.37786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:05:59.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:05:58.928442+0000 mon.smithi061 (mon.0) 1259 : audit [DBG] from='client.? 172.21.15.61:0/1960002015' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:06:00.246 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:05:58.570263+0000 mgr.smithi067.rdualw (mgr.24569) 5471 : audit [DBG] from='client.37790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:06:00.246 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:05:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:05:58.892252+0000 mgr.smithi067.rdualw (mgr.24569) 5472 : cluster [DBG] pgmap v4714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:00.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:05:58.570263+0000 mgr.smithi067.rdualw (mgr.24569) 5471 : audit [DBG] from='client.37790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:06:00.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:05:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:05:58.892252+0000 mgr.smithi067.rdualw (mgr.24569) 5472 : cluster [DBG] pgmap v4714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:00.893205+0000 mgr.smithi067.rdualw (mgr.24569) 5473 : cluster [DBG] pgmap v4715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:00.893205+0000 mgr.smithi067.rdualw (mgr.24569) 5473 : cluster [DBG] pgmap v4715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:04.247 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:02.893724+0000 mgr.smithi067.rdualw (mgr.24569) 5474 : cluster [DBG] pgmap v4716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:04.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:02.893724+0000 mgr.smithi067.rdualw (mgr.24569) 5474 : cluster [DBG] pgmap v4716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:06.247 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:04.894404+0000 mgr.smithi067.rdualw (mgr.24569) 5475 : cluster [DBG] pgmap v4717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:06.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:04.894404+0000 mgr.smithi067.rdualw (mgr.24569) 5475 : cluster [DBG] pgmap v4717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:08.247 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:06.895285+0000 mgr.smithi067.rdualw (mgr.24569) 5476 : cluster [DBG] pgmap v4718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:06:08.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:06.895285+0000 mgr.smithi067.rdualw (mgr.24569) 5476 : cluster [DBG] pgmap v4718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:06:10.248 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:08.895847+0000 mgr.smithi067.rdualw (mgr.24569) 5477 : cluster [DBG] pgmap v4719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:10.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:08.895847+0000 mgr.smithi067.rdualw (mgr.24569) 5477 : cluster [DBG] pgmap v4719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:10.896821+0000 mgr.smithi067.rdualw (mgr.24569) 5478 : cluster [DBG] pgmap v4720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:12.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:10.896821+0000 mgr.smithi067.rdualw (mgr.24569) 5478 : cluster [DBG] pgmap v4720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:14.248 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:12.897412+0000 mgr.smithi067.rdualw (mgr.24569) 5479 : cluster [DBG] pgmap v4721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:12.897412+0000 mgr.smithi067.rdualw (mgr.24569) 5479 : cluster [DBG] pgmap v4721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:16.249 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:14.897987+0000 mgr.smithi067.rdualw (mgr.24569) 5480 : cluster [DBG] pgmap v4722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:16.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:14.897987+0000 mgr.smithi067.rdualw (mgr.24569) 5480 : cluster [DBG] pgmap v4722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:18.249 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:16.898888+0000 mgr.smithi067.rdualw (mgr.24569) 5481 : cluster [DBG] pgmap v4723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:06:18.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:16.898888+0000 mgr.smithi067.rdualw (mgr.24569) 5481 : cluster [DBG] pgmap v4723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:06:20.249 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:18.899585+0000 mgr.smithi067.rdualw (mgr.24569) 5482 : cluster [DBG] pgmap v4724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:20.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:18.899585+0000 mgr.smithi067.rdualw (mgr.24569) 5482 : cluster [DBG] pgmap v4724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:20.900335+0000 mgr.smithi067.rdualw (mgr.24569) 5483 : cluster [DBG] pgmap v4725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:22.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:20.900335+0000 mgr.smithi067.rdualw (mgr.24569) 5483 : cluster [DBG] pgmap v4725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:24.250 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:22.900888+0000 mgr.smithi067.rdualw (mgr.24569) 5484 : cluster [DBG] pgmap v4726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:24.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:22.900888+0000 mgr.smithi067.rdualw (mgr.24569) 5484 : cluster [DBG] pgmap v4726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:26.250 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:24.901763+0000 mgr.smithi067.rdualw (mgr.24569) 5485 : cluster [DBG] pgmap v4727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:26.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:24.901763+0000 mgr.smithi067.rdualw (mgr.24569) 5485 : cluster [DBG] pgmap v4727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:28.251 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:26.902732+0000 mgr.smithi067.rdualw (mgr.24569) 5486 : cluster [DBG] pgmap v4728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:06:28.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:26.902732+0000 mgr.smithi067.rdualw (mgr.24569) 5486 : cluster [DBG] pgmap v4728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:06:29.239 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:06:29.530 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:06:29.530 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 2m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:06:29.531 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 2m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:06:29.531 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 2m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:06:29.531 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 2m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:06:29.532 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 2m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:06:29.532 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 2m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:06:29.533 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 2m ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:06:29.533 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 2m ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:06:29.533 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 2m ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:06:29.534 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 2m ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:06:29.534 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 2m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:06:29.534 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 2m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:06:29.535 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 2m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:06:29.535 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 2m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:06:29.536 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 2m ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:06:29.536 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 2m ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:06:29.537 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 2m ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:06:29.537 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 2m ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:06:29.537 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 2m ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:06:29.538 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 2m ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:06:29.538 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 2m ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:06:29.539 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 2m ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:06:29.539 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 2m ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:06:29.872 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:06:29.872 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:06:29.872 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:06:29.873 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:06:29.873 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:06:29.873 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:06:29.873 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:06:29.874 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:06:29.874 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:06:29.874 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:06:29.874 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:06:29.875 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:06:29.875 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:06:29.875 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:06:29.875 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:06:29.875 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:06:29.876 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:06:29.876 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:06:29.876 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:06:30.251 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:28.903461+0000 mgr.smithi067.rdualw (mgr.24569) 5487 : cluster [DBG] pgmap v4729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:30.252 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:06:29.227449+0000 mgr.smithi067.rdualw (mgr.24569) 5488 : audit [DBG] from='client.37798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:06:30.252 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:06:29.514507+0000 mgr.smithi067.rdualw (mgr.24569) 5489 : audit [DBG] from='client.37802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:06:30.252 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:06:29.872417+0000 mon.smithi061 (mon.0) 1260 : audit [DBG] from='client.? 172.21.15.61:0/1469982402' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:06:30.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:28.903461+0000 mgr.smithi067.rdualw (mgr.24569) 5487 : cluster [DBG] pgmap v4729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:30.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:06:29.227449+0000 mgr.smithi067.rdualw (mgr.24569) 5488 : audit [DBG] from='client.37798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:06:30.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:06:29.514507+0000 mgr.smithi067.rdualw (mgr.24569) 5489 : audit [DBG] from='client.37802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:06:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:06:29.872417+0000 mon.smithi061 (mon.0) 1260 : audit [DBG] from='client.? 172.21.15.61:0/1469982402' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:06:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:30.904269+0000 mgr.smithi067.rdualw (mgr.24569) 5490 : cluster [DBG] pgmap v4730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:30.904269+0000 mgr.smithi067.rdualw (mgr.24569) 5490 : cluster [DBG] pgmap v4730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:34.252 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:32.904818+0000 mgr.smithi067.rdualw (mgr.24569) 5491 : cluster [DBG] pgmap v4731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:34.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:32.904818+0000 mgr.smithi067.rdualw (mgr.24569) 5491 : cluster [DBG] pgmap v4731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:36.252 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:34.905603+0000 mgr.smithi067.rdualw (mgr.24569) 5492 : cluster [DBG] pgmap v4732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:36.253 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:06:35.292679+0000 mon.smithi067 (mon.1) 852 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:06:36.253 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:06:35.292927+0000 mon.smithi067 (mon.1) 853 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:06:36.253 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:06:35.292999+0000 mon.smithi061 (mon.0) 1261 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:06:36.254 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:06:35.293359+0000 mon.smithi061 (mon.0) 1262 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:06:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:34.905603+0000 mgr.smithi067.rdualw (mgr.24569) 5492 : cluster [DBG] pgmap v4732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:06:35.292679+0000 mon.smithi067 (mon.1) 852 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:06:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:06:35.292927+0000 mon.smithi067 (mon.1) 853 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:06:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:06:35.292999+0000 mon.smithi061 (mon.0) 1261 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:06:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:06:35.293359+0000 mon.smithi061 (mon.0) 1262 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:06:38.253 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:36.906617+0000 mgr.smithi067.rdualw (mgr.24569) 5493 : cluster [DBG] pgmap v4733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:06:38.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:36.906617+0000 mgr.smithi067.rdualw (mgr.24569) 5493 : cluster [DBG] pgmap v4733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:06:40.253 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:38.907266+0000 mgr.smithi067.rdualw (mgr.24569) 5494 : cluster [DBG] pgmap v4734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:40.253 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:06:39.606093+0000 mon.smithi067 (mon.1) 854 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:06:40.254 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:06:39.607603+0000 mon.smithi067 (mon.1) 855 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:06:40.254 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:06:39.608576+0000 mon.smithi067 (mon.1) 856 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:06:40.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:38.907266+0000 mgr.smithi067.rdualw (mgr.24569) 5494 : cluster [DBG] pgmap v4734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:40.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:06:39.606093+0000 mon.smithi067 (mon.1) 854 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:06:40.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:06:39.607603+0000 mon.smithi067 (mon.1) 855 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:06:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:06:39.608576+0000 mon.smithi067 (mon.1) 856 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:06:41.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:06:39.609415+0000 mgr.smithi067.rdualw (mgr.24569) 5495 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:06:41.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:06:40.025855+0000 mon.smithi061 (mon.0) 1263 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:06:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:06:40.031581+0000 mon.smithi061 (mon.0) 1264 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:06:41.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:06:39.609415+0000 mgr.smithi067.rdualw (mgr.24569) 5495 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:06:41.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:06:40.025855+0000 mon.smithi061 (mon.0) 1263 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:06:41.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:06:40.031581+0000 mon.smithi061 (mon.0) 1264 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:06:42.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:40.908301+0000 mgr.smithi067.rdualw (mgr.24569) 5496 : cluster [DBG] pgmap v4735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:42.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:40.908301+0000 mgr.smithi067.rdualw (mgr.24569) 5496 : cluster [DBG] pgmap v4735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:44.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:42.908985+0000 mgr.smithi067.rdualw (mgr.24569) 5497 : cluster [DBG] pgmap v4736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:44.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:42.908985+0000 mgr.smithi067.rdualw (mgr.24569) 5497 : cluster [DBG] pgmap v4736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:46.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:44.909635+0000 mgr.smithi067.rdualw (mgr.24569) 5498 : cluster [DBG] pgmap v4737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:46.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:44.909635+0000 mgr.smithi067.rdualw (mgr.24569) 5498 : cluster [DBG] pgmap v4737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:48.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:46.910618+0000 mgr.smithi067.rdualw (mgr.24569) 5499 : cluster [DBG] pgmap v4738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:06:48.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:46.910618+0000 mgr.smithi067.rdualw (mgr.24569) 5499 : cluster [DBG] pgmap v4738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:06:50.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:48.911239+0000 mgr.smithi067.rdualw (mgr.24569) 5500 : cluster [DBG] pgmap v4739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:50.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:48.911239+0000 mgr.smithi067.rdualw (mgr.24569) 5500 : cluster [DBG] pgmap v4739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:50.912174+0000 mgr.smithi067.rdualw (mgr.24569) 5501 : cluster [DBG] pgmap v4740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:52.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:50.912174+0000 mgr.smithi067.rdualw (mgr.24569) 5501 : cluster [DBG] pgmap v4740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:54.255 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:52.912780+0000 mgr.smithi067.rdualw (mgr.24569) 5502 : cluster [DBG] pgmap v4741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:54.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:52.912780+0000 mgr.smithi067.rdualw (mgr.24569) 5502 : cluster [DBG] pgmap v4741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:56.255 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:54.913451+0000 mgr.smithi067.rdualw (mgr.24569) 5503 : cluster [DBG] pgmap v4742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:54.913451+0000 mgr.smithi067.rdualw (mgr.24569) 5503 : cluster [DBG] pgmap v4742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:06:58.256 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:56.914389+0000 mgr.smithi067.rdualw (mgr.24569) 5504 : cluster [DBG] pgmap v4743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:06:58.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:56.914389+0000 mgr.smithi067.rdualw (mgr.24569) 5504 : cluster [DBG] pgmap v4743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:07:00.181 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:07:00.256 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:06:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:06:58.914925+0000 mgr.smithi067.rdualw (mgr.24569) 5505 : cluster [DBG] pgmap v4744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:00.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:06:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:06:58.914925+0000 mgr.smithi067.rdualw (mgr.24569) 5505 : cluster [DBG] pgmap v4744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:00.473 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:07:00.474 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 3m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:07:00.474 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 3m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:07:00.474 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 3m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:07:00.475 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 3m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:07:00.475 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 3m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:07:00.475 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 3m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:07:00.475 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 3m ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:07:00.476 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 3m ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:07:00.476 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 3m ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:07:00.476 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 3m ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:07:00.476 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 3m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:07:00.476 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 3m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:07:00.477 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 3m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:07:00.477 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 3m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:07:00.477 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 3m ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:07:00.477 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 3m ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:07:00.478 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 3m ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:07:00.478 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 3m ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:07:00.478 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 3m ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:07:00.478 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 3m ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:07:00.478 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 3m ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:07:00.479 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 3m ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:07:00.479 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 3m ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:07:00.825 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:07:00.825 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:07:00.825 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:07:00.826 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:07:00.826 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:07:00.826 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:07:00.827 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:07:00.827 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:07:00.827 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:07:00.827 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:07:00.827 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:07:00.828 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:07:00.828 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:07:00.828 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:07:00.828 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:07:00.829 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:07:00.829 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:07:00.829 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:07:00.829 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:07:01.256 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:07:00.169061+0000 mgr.smithi067.rdualw (mgr.24569) 5506 : audit [DBG] from='client.46789 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:07:01.257 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:07:00.458086+0000 mgr.smithi067.rdualw (mgr.24569) 5507 : audit [DBG] from='client.37814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:07:01.257 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:07:00.825268+0000 mon.smithi061 (mon.0) 1265 : audit [DBG] from='client.? 172.21.15.61:0/4243117922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:07:01.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:07:00.169061+0000 mgr.smithi067.rdualw (mgr.24569) 5506 : audit [DBG] from='client.46789 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:07:01.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:07:00.458086+0000 mgr.smithi067.rdualw (mgr.24569) 5507 : audit [DBG] from='client.37814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:07:01.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:07:00.825268+0000 mon.smithi061 (mon.0) 1265 : audit [DBG] from='client.? 172.21.15.61:0/4243117922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:07:02.256 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:00.915758+0000 mgr.smithi067.rdualw (mgr.24569) 5508 : cluster [DBG] pgmap v4745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:02.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:00.915758+0000 mgr.smithi067.rdualw (mgr.24569) 5508 : cluster [DBG] pgmap v4745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:04.257 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:02.916341+0000 mgr.smithi067.rdualw (mgr.24569) 5509 : cluster [DBG] pgmap v4746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:04.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:02.916341+0000 mgr.smithi067.rdualw (mgr.24569) 5509 : cluster [DBG] pgmap v4746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:06.257 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:04.917098+0000 mgr.smithi067.rdualw (mgr.24569) 5510 : cluster [DBG] pgmap v4747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:06.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:04.917098+0000 mgr.smithi067.rdualw (mgr.24569) 5510 : cluster [DBG] pgmap v4747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:08.257 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:06.918032+0000 mgr.smithi067.rdualw (mgr.24569) 5511 : cluster [DBG] pgmap v4748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:07:08.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:06.918032+0000 mgr.smithi067.rdualw (mgr.24569) 5511 : cluster [DBG] pgmap v4748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:07:10.258 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:08.918704+0000 mgr.smithi067.rdualw (mgr.24569) 5512 : cluster [DBG] pgmap v4749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:11.085 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:08.918704+0000 mgr.smithi067.rdualw (mgr.24569) 5512 : cluster [DBG] pgmap v4749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:10.919804+0000 mgr.smithi067.rdualw (mgr.24569) 5513 : cluster [DBG] pgmap v4750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:10.919804+0000 mgr.smithi067.rdualw (mgr.24569) 5513 : cluster [DBG] pgmap v4750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:14.259 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:12.920297+0000 mgr.smithi067.rdualw (mgr.24569) 5514 : cluster [DBG] pgmap v4751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:14.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:12.920297+0000 mgr.smithi067.rdualw (mgr.24569) 5514 : cluster [DBG] pgmap v4751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:16.259 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:14.921096+0000 mgr.smithi067.rdualw (mgr.24569) 5515 : cluster [DBG] pgmap v4752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:16.319 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:14.921096+0000 mgr.smithi067.rdualw (mgr.24569) 5515 : cluster [DBG] pgmap v4752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:18.259 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:16.921970+0000 mgr.smithi067.rdualw (mgr.24569) 5516 : cluster [DBG] pgmap v4753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:07:18.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:16.921970+0000 mgr.smithi067.rdualw (mgr.24569) 5516 : cluster [DBG] pgmap v4753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:07:20.259 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:18.922715+0000 mgr.smithi067.rdualw (mgr.24569) 5517 : cluster [DBG] pgmap v4754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:20.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:18.922715+0000 mgr.smithi067.rdualw (mgr.24569) 5517 : cluster [DBG] pgmap v4754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:20.923791+0000 mgr.smithi067.rdualw (mgr.24569) 5518 : cluster [DBG] pgmap v4755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:22.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:20.923791+0000 mgr.smithi067.rdualw (mgr.24569) 5518 : cluster [DBG] pgmap v4755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:24.261 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:22.924339+0000 mgr.smithi067.rdualw (mgr.24569) 5519 : cluster [DBG] pgmap v4756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:24.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:22.924339+0000 mgr.smithi067.rdualw (mgr.24569) 5519 : cluster [DBG] pgmap v4756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:26.261 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:24.924930+0000 mgr.smithi067.rdualw (mgr.24569) 5520 : cluster [DBG] pgmap v4757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:26.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:24.924930+0000 mgr.smithi067.rdualw (mgr.24569) 5520 : cluster [DBG] pgmap v4757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:28.261 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:26.926000+0000 mgr.smithi067.rdualw (mgr.24569) 5521 : cluster [DBG] pgmap v4758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:07:28.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:26.926000+0000 mgr.smithi067.rdualw (mgr.24569) 5521 : cluster [DBG] pgmap v4758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:07:30.261 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:28.926819+0000 mgr.smithi067.rdualw (mgr.24569) 5522 : cluster [DBG] pgmap v4759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:30.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:28.926819+0000 mgr.smithi067.rdualw (mgr.24569) 5522 : cluster [DBG] pgmap v4759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:31.134 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:07:31.478 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:07:31.479 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 3m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:07:31.480 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 3m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:07:31.480 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 3m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:07:31.480 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 3m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:07:31.481 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 3m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:07:31.481 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 3m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:07:31.481 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 3m ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:07:31.481 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 3m ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:07:31.482 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 3m ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:07:31.482 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 3m ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:07:31.482 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 3m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:07:31.482 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 3m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:07:31.482 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 3m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:07:31.483 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 3m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:07:31.483 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 3m ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:07:31.483 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 3m ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:07:31.483 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 3m ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:07:31.484 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 3m ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:07:31.484 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 3m ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:07:31.484 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 3m ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:07:31.484 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 3m ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:07:31.484 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 3m ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:07:31.485 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 3m ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:07:31.823 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:07:31.823 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:07:31.823 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:07:31.824 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:07:31.824 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:07:31.824 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:07:31.824 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:07:31.825 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:07:31.825 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:07:31.825 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:07:31.825 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:07:31.825 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:07:31.826 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:07:31.826 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:07:31.826 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:07:31.826 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:07:31.827 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:07:31.827 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:07:31.828 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:07:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:30.927636+0000 mgr.smithi067.rdualw (mgr.24569) 5523 : cluster [DBG] pgmap v4760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:07:31.122235+0000 mgr.smithi067.rdualw (mgr.24569) 5524 : audit [DBG] from='client.37822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:07:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:07:31.462706+0000 mgr.smithi067.rdualw (mgr.24569) 5525 : audit [DBG] from='client.37826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:07:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:30.927636+0000 mgr.smithi067.rdualw (mgr.24569) 5523 : cluster [DBG] pgmap v4760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:07:31.122235+0000 mgr.smithi067.rdualw (mgr.24569) 5524 : audit [DBG] from='client.37822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:07:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:07:31.462706+0000 mgr.smithi067.rdualw (mgr.24569) 5525 : audit [DBG] from='client.37826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:07:33.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:07:31.823220+0000 mon.smithi061 (mon.0) 1266 : audit [DBG] from='client.? 172.21.15.61:0/3655108410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:07:33.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:07:31.823220+0000 mon.smithi061 (mon.0) 1266 : audit [DBG] from='client.? 172.21.15.61:0/3655108410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:07:34.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:32.928217+0000 mgr.smithi067.rdualw (mgr.24569) 5526 : cluster [DBG] pgmap v4761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:34.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:32.928217+0000 mgr.smithi067.rdualw (mgr.24569) 5526 : cluster [DBG] pgmap v4761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:36.263 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:34.928837+0000 mgr.smithi067.rdualw (mgr.24569) 5527 : cluster [DBG] pgmap v4762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:36.263 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:07:35.298764+0000 mon.smithi067 (mon.1) 857 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:07:36.263 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:07:35.299018+0000 mon.smithi067 (mon.1) 858 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:07:36.264 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:07:35.299130+0000 mon.smithi061 (mon.0) 1267 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:07:36.264 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:07:35.299629+0000 mon.smithi061 (mon.0) 1268 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:07:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:34.928837+0000 mgr.smithi067.rdualw (mgr.24569) 5527 : cluster [DBG] pgmap v4762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:07:35.298764+0000 mon.smithi067 (mon.1) 857 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:07:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:07:35.299018+0000 mon.smithi067 (mon.1) 858 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:07:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:07:35.299130+0000 mon.smithi061 (mon.0) 1267 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:07:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:07:35.299629+0000 mon.smithi061 (mon.0) 1268 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:07:38.262 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:36.929847+0000 mgr.smithi067.rdualw (mgr.24569) 5528 : cluster [DBG] pgmap v4763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:07:38.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:36.929847+0000 mgr.smithi067.rdualw (mgr.24569) 5528 : cluster [DBG] pgmap v4763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:07:40.263 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:38.930614+0000 mgr.smithi067.rdualw (mgr.24569) 5529 : cluster [DBG] pgmap v4764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:40.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:38.930614+0000 mgr.smithi067.rdualw (mgr.24569) 5529 : cluster [DBG] pgmap v4764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:41.263 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:07:40.037553+0000 mon.smithi067 (mon.1) 859 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:07:41.264 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:07:40.038989+0000 mon.smithi067 (mon.1) 860 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:07:41.265 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:07:40.039938+0000 mon.smithi067 (mon.1) 861 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:07:41.265 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:07:40.040764+0000 mgr.smithi067.rdualw (mgr.24569) 5530 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:07:41.267 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:07:40.454546+0000 mon.smithi061 (mon.0) 1269 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:07:41.267 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:07:40.460426+0000 mon.smithi061 (mon.0) 1270 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:07:41.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:07:40.037553+0000 mon.smithi067 (mon.1) 859 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:07:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:07:40.038989+0000 mon.smithi067 (mon.1) 860 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:07:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:07:40.039938+0000 mon.smithi067 (mon.1) 861 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:07:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:07:40.040764+0000 mgr.smithi067.rdualw (mgr.24569) 5530 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:07:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:07:40.454546+0000 mon.smithi061 (mon.0) 1269 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:07:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:07:40.460426+0000 mon.smithi061 (mon.0) 1270 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:07:42.263 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:40.931487+0000 mgr.smithi067.rdualw (mgr.24569) 5531 : cluster [DBG] pgmap v4765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:42.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:40.931487+0000 mgr.smithi067.rdualw (mgr.24569) 5531 : cluster [DBG] pgmap v4765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:44.263 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:42.932083+0000 mgr.smithi067.rdualw (mgr.24569) 5532 : cluster [DBG] pgmap v4766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:44.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:42.932083+0000 mgr.smithi067.rdualw (mgr.24569) 5532 : cluster [DBG] pgmap v4766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:46.264 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:44.932731+0000 mgr.smithi067.rdualw (mgr.24569) 5533 : cluster [DBG] pgmap v4767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:46.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:44.932731+0000 mgr.smithi067.rdualw (mgr.24569) 5533 : cluster [DBG] pgmap v4767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:48.264 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:46.933740+0000 mgr.smithi067.rdualw (mgr.24569) 5534 : cluster [DBG] pgmap v4768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:07:48.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:46.933740+0000 mgr.smithi067.rdualw (mgr.24569) 5534 : cluster [DBG] pgmap v4768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:07:50.264 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:48.934378+0000 mgr.smithi067.rdualw (mgr.24569) 5535 : cluster [DBG] pgmap v4769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:50.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:48.934378+0000 mgr.smithi067.rdualw (mgr.24569) 5535 : cluster [DBG] pgmap v4769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:50.935289+0000 mgr.smithi067.rdualw (mgr.24569) 5536 : cluster [DBG] pgmap v4770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:50.935289+0000 mgr.smithi067.rdualw (mgr.24569) 5536 : cluster [DBG] pgmap v4770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:54.265 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:52.935843+0000 mgr.smithi067.rdualw (mgr.24569) 5537 : cluster [DBG] pgmap v4771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:54.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:52.935843+0000 mgr.smithi067.rdualw (mgr.24569) 5537 : cluster [DBG] pgmap v4771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:56.265 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:54.936436+0000 mgr.smithi067.rdualw (mgr.24569) 5538 : cluster [DBG] pgmap v4772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:54.936436+0000 mgr.smithi067.rdualw (mgr.24569) 5538 : cluster [DBG] pgmap v4772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:07:58.266 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:56.937393+0000 mgr.smithi067.rdualw (mgr.24569) 5539 : cluster [DBG] pgmap v4773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:07:58.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:07:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:56.937393+0000 mgr.smithi067.rdualw (mgr.24569) 5539 : cluster [DBG] pgmap v4773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:08:00.266 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:07:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:07:58.938091+0000 mgr.smithi067.rdualw (mgr.24569) 5540 : cluster [DBG] pgmap v4774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:00.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:07:58.938091+0000 mgr.smithi067.rdualw (mgr.24569) 5540 : cluster [DBG] pgmap v4774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:00.938919+0000 mgr.smithi067.rdualw (mgr.24569) 5541 : cluster [DBG] pgmap v4775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:02.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:00.938919+0000 mgr.smithi067.rdualw (mgr.24569) 5541 : cluster [DBG] pgmap v4775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:02.140 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:08:02.432 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:08:02.432 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 4m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:08:02.433 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 4m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:08:02.433 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 4m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:08:02.433 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 4m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:08:02.434 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 4m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:08:02.434 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 4m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:08:02.435 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 4m ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:08:02.435 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 4m ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:08:02.435 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 4m ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:08:02.435 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 4m ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:08:02.435 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 4m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:08:02.436 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 4m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:08:02.436 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 4m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:08:02.436 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 4m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:08:02.436 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 4m ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:08:02.437 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 4m ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:08:02.437 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 4m ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:08:02.437 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 4m ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:08:02.438 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 4m ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:08:02.438 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 4m ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:08:02.439 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 4m ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:08:02.439 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 4m ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:08:02.439 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 4m ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:08:02.775 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:08:02.775 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:08:02.775 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:08:02.776 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:08:02.776 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:08:02.777 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:08:02.777 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:08:02.777 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:08:02.778 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:08:02.779 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:08:02.779 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:08:02.780 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:08:02.780 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:08:02.780 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:08:02.781 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:08:02.781 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:08:02.781 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:08:02.782 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:08:02.782 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:08:03.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:08:02.124716+0000 mgr.smithi067.rdualw (mgr.24569) 5542 : audit [DBG] from='client.37834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:08:03.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:08:02.416113+0000 mgr.smithi067.rdualw (mgr.24569) 5543 : audit [DBG] from='client.37838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:08:03.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:08:02.124716+0000 mgr.smithi067.rdualw (mgr.24569) 5542 : audit [DBG] from='client.37834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:08:03.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:08:02.416113+0000 mgr.smithi067.rdualw (mgr.24569) 5543 : audit [DBG] from='client.37838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:08:04.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:08:02.775070+0000 mon.smithi061 (mon.0) 1271 : audit [DBG] from='client.? 172.21.15.61:0/3744972911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:08:04.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:02.939410+0000 mgr.smithi067.rdualw (mgr.24569) 5544 : cluster [DBG] pgmap v4776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:04.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:08:02.775070+0000 mon.smithi061 (mon.0) 1271 : audit [DBG] from='client.? 172.21.15.61:0/3744972911' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:08:04.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:02.939410+0000 mgr.smithi067.rdualw (mgr.24569) 5544 : cluster [DBG] pgmap v4776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:06.267 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:04.940044+0000 mgr.smithi067.rdualw (mgr.24569) 5545 : cluster [DBG] pgmap v4777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:06.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:04.940044+0000 mgr.smithi067.rdualw (mgr.24569) 5545 : cluster [DBG] pgmap v4777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:08.267 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:06.940930+0000 mgr.smithi067.rdualw (mgr.24569) 5546 : cluster [DBG] pgmap v4778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:08:08.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:06.940930+0000 mgr.smithi067.rdualw (mgr.24569) 5546 : cluster [DBG] pgmap v4778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:08:10.268 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:08.941647+0000 mgr.smithi067.rdualw (mgr.24569) 5547 : cluster [DBG] pgmap v4779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:10.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:08.941647+0000 mgr.smithi067.rdualw (mgr.24569) 5547 : cluster [DBG] pgmap v4779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:10.942672+0000 mgr.smithi067.rdualw (mgr.24569) 5548 : cluster [DBG] pgmap v4780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:12.300 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:10.942672+0000 mgr.smithi067.rdualw (mgr.24569) 5548 : cluster [DBG] pgmap v4780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:14.268 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:12.943176+0000 mgr.smithi067.rdualw (mgr.24569) 5549 : cluster [DBG] pgmap v4781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:14.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:12.943176+0000 mgr.smithi067.rdualw (mgr.24569) 5549 : cluster [DBG] pgmap v4781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:16.269 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:14.943956+0000 mgr.smithi067.rdualw (mgr.24569) 5550 : cluster [DBG] pgmap v4782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:16.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:14.943956+0000 mgr.smithi067.rdualw (mgr.24569) 5550 : cluster [DBG] pgmap v4782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:18.269 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:16.944992+0000 mgr.smithi067.rdualw (mgr.24569) 5551 : cluster [DBG] pgmap v4783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:08:18.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:16.944992+0000 mgr.smithi067.rdualw (mgr.24569) 5551 : cluster [DBG] pgmap v4783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:08:20.269 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:18.945675+0000 mgr.smithi067.rdualw (mgr.24569) 5552 : cluster [DBG] pgmap v4784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:20.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:18.945675+0000 mgr.smithi067.rdualw (mgr.24569) 5552 : cluster [DBG] pgmap v4784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:20.946493+0000 mgr.smithi067.rdualw (mgr.24569) 5553 : cluster [DBG] pgmap v4785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:20.946493+0000 mgr.smithi067.rdualw (mgr.24569) 5553 : cluster [DBG] pgmap v4785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:24.270 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:22.947165+0000 mgr.smithi067.rdualw (mgr.24569) 5554 : cluster [DBG] pgmap v4786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:24.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:22.947165+0000 mgr.smithi067.rdualw (mgr.24569) 5554 : cluster [DBG] pgmap v4786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:26.270 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:24.947894+0000 mgr.smithi067.rdualw (mgr.24569) 5555 : cluster [DBG] pgmap v4787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:26.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:24.947894+0000 mgr.smithi067.rdualw (mgr.24569) 5555 : cluster [DBG] pgmap v4787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:28.272 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:26.948692+0000 mgr.smithi067.rdualw (mgr.24569) 5556 : cluster [DBG] pgmap v4788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:08:28.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:26.948692+0000 mgr.smithi067.rdualw (mgr.24569) 5556 : cluster [DBG] pgmap v4788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:08:30.271 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:28.949422+0000 mgr.smithi067.rdualw (mgr.24569) 5557 : cluster [DBG] pgmap v4789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:30.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:28.949422+0000 mgr.smithi067.rdualw (mgr.24569) 5557 : cluster [DBG] pgmap v4789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:30.950488+0000 mgr.smithi067.rdualw (mgr.24569) 5558 : cluster [DBG] pgmap v4790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:30.950488+0000 mgr.smithi067.rdualw (mgr.24569) 5558 : cluster [DBG] pgmap v4790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:33.082 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:08:33.401 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:08:33.402 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 4m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:08:33.402 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 4m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:08:33.402 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 4m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:08:33.402 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 4m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:08:33.402 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 4m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:08:33.403 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 4m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:08:33.403 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 4m ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:08:33.403 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 4m ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:08:33.403 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 4m ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:08:33.404 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 4m ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:08:33.404 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 4m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:08:33.404 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 4m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:08:33.404 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 4m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:08:33.405 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 4m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:08:33.405 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 4m ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:08:33.405 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 4m ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:08:33.405 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 4m ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:08:33.405 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 4m ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:08:33.406 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 4m ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:08:33.406 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 4m ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:08:33.406 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 4m ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:08:33.407 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 4m ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:08:33.407 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 4m ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:08:33.744 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:08:33.744 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:08:33.745 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:08:33.745 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:08:33.745 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:08:33.745 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:08:33.746 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:08:33.746 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:08:33.746 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:08:33.746 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:08:33.747 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:08:33.747 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:08:33.747 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:08:33.747 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:08:33.748 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:08:33.748 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:08:33.748 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:08:33.748 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:08:33.748 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:08:34.272 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:32.951155+0000 mgr.smithi067.rdualw (mgr.24569) 5559 : cluster [DBG] pgmap v4791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:34.272 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:08:33.070675+0000 mgr.smithi067.rdualw (mgr.24569) 5560 : audit [DBG] from='client.37846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:08:34.273 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:08:33.385775+0000 mgr.smithi067.rdualw (mgr.24569) 5561 : audit [DBG] from='client.37850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:08:34.273 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:08:33.744639+0000 mon.smithi061 (mon.0) 1272 : audit [DBG] from='client.? 172.21.15.61:0/2918883149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:08:34.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:32.951155+0000 mgr.smithi067.rdualw (mgr.24569) 5559 : cluster [DBG] pgmap v4791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:08:33.070675+0000 mgr.smithi067.rdualw (mgr.24569) 5560 : audit [DBG] from='client.37846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:08:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:08:33.385775+0000 mgr.smithi067.rdualw (mgr.24569) 5561 : audit [DBG] from='client.37850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:08:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:08:33.744639+0000 mon.smithi061 (mon.0) 1272 : audit [DBG] from='client.? 172.21.15.61:0/2918883149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:08:36.273 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:34.951945+0000 mgr.smithi067.rdualw (mgr.24569) 5562 : cluster [DBG] pgmap v4792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:36.273 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:08:35.304952+0000 mon.smithi067 (mon.1) 862 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:08:36.273 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:08:35.305305+0000 mon.smithi067 (mon.1) 863 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:08:36.274 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:08:35.305385+0000 mon.smithi061 (mon.0) 1273 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:08:36.274 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:08:35.305718+0000 mon.smithi061 (mon.0) 1274 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:08:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:34.951945+0000 mgr.smithi067.rdualw (mgr.24569) 5562 : cluster [DBG] pgmap v4792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:08:35.304952+0000 mon.smithi067 (mon.1) 862 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:08:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:08:35.305305+0000 mon.smithi067 (mon.1) 863 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:08:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:08:35.305385+0000 mon.smithi061 (mon.0) 1273 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:08:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:08:35.305718+0000 mon.smithi061 (mon.0) 1274 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:08:38.272 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:36.952775+0000 mgr.smithi067.rdualw (mgr.24569) 5563 : cluster [DBG] pgmap v4793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:08:38.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:36.952775+0000 mgr.smithi067.rdualw (mgr.24569) 5563 : cluster [DBG] pgmap v4793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:08:40.272 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:38.953468+0000 mgr.smithi067.rdualw (mgr.24569) 5564 : cluster [DBG] pgmap v4794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:40.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:38.953468+0000 mgr.smithi067.rdualw (mgr.24569) 5564 : cluster [DBG] pgmap v4794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:41.273 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:08:40.463830+0000 mon.smithi067 (mon.1) 864 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:08:41.273 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:08:40.465336+0000 mon.smithi067 (mon.1) 865 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:08:41.273 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:08:40.466258+0000 mon.smithi067 (mon.1) 866 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:08:41.274 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:08:40.467087+0000 mgr.smithi067.rdualw (mgr.24569) 5565 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:08:41.274 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:08:40.880877+0000 mon.smithi061 (mon.0) 1275 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:08:41.275 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:08:40.886563+0000 mon.smithi061 (mon.0) 1276 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:08:41.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:08:40.463830+0000 mon.smithi067 (mon.1) 864 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:08:41.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:08:40.465336+0000 mon.smithi067 (mon.1) 865 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:08:41.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:08:40.466258+0000 mon.smithi067 (mon.1) 866 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:08:41.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:08:40.467087+0000 mgr.smithi067.rdualw (mgr.24569) 5565 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:08:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:08:40.880877+0000 mon.smithi061 (mon.0) 1275 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:08:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:08:40.886563+0000 mon.smithi061 (mon.0) 1276 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:08:42.273 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:40.954114+0000 mgr.smithi067.rdualw (mgr.24569) 5566 : cluster [DBG] pgmap v4795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:42.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:40.954114+0000 mgr.smithi067.rdualw (mgr.24569) 5566 : cluster [DBG] pgmap v4795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:44.273 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:42.954601+0000 mgr.smithi067.rdualw (mgr.24569) 5567 : cluster [DBG] pgmap v4796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:44.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:42.954601+0000 mgr.smithi067.rdualw (mgr.24569) 5567 : cluster [DBG] pgmap v4796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:46.274 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:44.955325+0000 mgr.smithi067.rdualw (mgr.24569) 5568 : cluster [DBG] pgmap v4797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:46.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:44.955325+0000 mgr.smithi067.rdualw (mgr.24569) 5568 : cluster [DBG] pgmap v4797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:48.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:46.956197+0000 mgr.smithi067.rdualw (mgr.24569) 5569 : cluster [DBG] pgmap v4798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:08:48.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:46.956197+0000 mgr.smithi067.rdualw (mgr.24569) 5569 : cluster [DBG] pgmap v4798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:08:50.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:48.956983+0000 mgr.smithi067.rdualw (mgr.24569) 5570 : cluster [DBG] pgmap v4799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:50.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:48.956983+0000 mgr.smithi067.rdualw (mgr.24569) 5570 : cluster [DBG] pgmap v4799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:50.958083+0000 mgr.smithi067.rdualw (mgr.24569) 5571 : cluster [DBG] pgmap v4800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:52.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:50.958083+0000 mgr.smithi067.rdualw (mgr.24569) 5571 : cluster [DBG] pgmap v4800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:54.275 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:52.958768+0000 mgr.smithi067.rdualw (mgr.24569) 5572 : cluster [DBG] pgmap v4801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:54.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:52.958768+0000 mgr.smithi067.rdualw (mgr.24569) 5572 : cluster [DBG] pgmap v4801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:56.275 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:54.959570+0000 mgr.smithi067.rdualw (mgr.24569) 5573 : cluster [DBG] pgmap v4802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:54.959570+0000 mgr.smithi067.rdualw (mgr.24569) 5573 : cluster [DBG] pgmap v4802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:08:58.276 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:08:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:56.960692+0000 mgr.smithi067.rdualw (mgr.24569) 5574 : cluster [DBG] pgmap v4803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:08:58.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:08:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:56.960692+0000 mgr.smithi067.rdualw (mgr.24569) 5574 : cluster [DBG] pgmap v4803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:09:00.276 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:08:58.961450+0000 mgr.smithi067.rdualw (mgr.24569) 5575 : cluster [DBG] pgmap v4804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:00.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:08:58.961450+0000 mgr.smithi067.rdualw (mgr.24569) 5575 : cluster [DBG] pgmap v4804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:00.962440+0000 mgr.smithi067.rdualw (mgr.24569) 5576 : cluster [DBG] pgmap v4805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:00.962440+0000 mgr.smithi067.rdualw (mgr.24569) 5576 : cluster [DBG] pgmap v4805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:04.049 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:09:04.277 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:02.962958+0000 mgr.smithi067.rdualw (mgr.24569) 5577 : cluster [DBG] pgmap v4806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:04.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:02.962958+0000 mgr.smithi067.rdualw (mgr.24569) 5577 : cluster [DBG] pgmap v4806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:04.339 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:09:04.339 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 5m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:09:04.340 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 5m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:09:04.340 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 5m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:09:04.340 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 5m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:09:04.340 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 5m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:09:04.341 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 5m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:09:04.341 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 5m ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:09:04.341 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 5m ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:09:04.341 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 5m ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:09:04.342 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 5m ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:09:04.342 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 5m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:09:04.342 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 5m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:09:04.342 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 5m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:09:04.342 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 5m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:09:04.343 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 5m ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:09:04.343 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 5m ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:09:04.343 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 5m ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:09:04.343 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 5m ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:09:04.344 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 5m ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:09:04.344 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 5m ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:09:04.345 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 5m ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:09:04.345 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 5m ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:09:04.345 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 5m ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:09:04.705 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:09:04.706 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:09:04.706 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:09:04.707 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:09:04.707 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:09:04.707 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:09:04.708 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:09:04.708 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:09:04.709 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:09:04.709 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:09:04.710 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:09:04.710 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:09:04.711 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:09:04.711 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:09:04.711 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:09:04.712 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:09:04.712 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:09:04.712 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:09:04.713 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:09:05.277 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:09:04.037338+0000 mgr.smithi067.rdualw (mgr.24569) 5578 : audit [DBG] from='client.37858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:09:05.277 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:09:04.323285+0000 mgr.smithi067.rdualw (mgr.24569) 5579 : audit [DBG] from='client.37862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:09:05.278 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:09:04.705496+0000 mon.smithi061 (mon.0) 1277 : audit [DBG] from='client.? 172.21.15.61:0/3706953134' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:09:05.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:09:04.037338+0000 mgr.smithi067.rdualw (mgr.24569) 5578 : audit [DBG] from='client.37858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:09:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:09:04.323285+0000 mgr.smithi067.rdualw (mgr.24569) 5579 : audit [DBG] from='client.37862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:09:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:09:04.705496+0000 mon.smithi061 (mon.0) 1277 : audit [DBG] from='client.? 172.21.15.61:0/3706953134' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:09:06.277 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:04.963637+0000 mgr.smithi067.rdualw (mgr.24569) 5580 : cluster [DBG] pgmap v4807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:06.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:04.963637+0000 mgr.smithi067.rdualw (mgr.24569) 5580 : cluster [DBG] pgmap v4807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:08.277 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:06.964463+0000 mgr.smithi067.rdualw (mgr.24569) 5581 : cluster [DBG] pgmap v4808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:09:08.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:06.964463+0000 mgr.smithi067.rdualw (mgr.24569) 5581 : cluster [DBG] pgmap v4808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:09:10.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:08.965170+0000 mgr.smithi067.rdualw (mgr.24569) 5582 : cluster [DBG] pgmap v4809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:08.965170+0000 mgr.smithi067.rdualw (mgr.24569) 5582 : cluster [DBG] pgmap v4809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:10.966038+0000 mgr.smithi067.rdualw (mgr.24569) 5583 : cluster [DBG] pgmap v4810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:10.966038+0000 mgr.smithi067.rdualw (mgr.24569) 5583 : cluster [DBG] pgmap v4810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:14.278 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:12.966503+0000 mgr.smithi067.rdualw (mgr.24569) 5584 : cluster [DBG] pgmap v4811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:14.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:12.966503+0000 mgr.smithi067.rdualw (mgr.24569) 5584 : cluster [DBG] pgmap v4811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:16.279 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:14.967225+0000 mgr.smithi067.rdualw (mgr.24569) 5585 : cluster [DBG] pgmap v4812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:16.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:14.967225+0000 mgr.smithi067.rdualw (mgr.24569) 5585 : cluster [DBG] pgmap v4812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:18.279 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:16.968104+0000 mgr.smithi067.rdualw (mgr.24569) 5586 : cluster [DBG] pgmap v4813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:09:18.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:16.968104+0000 mgr.smithi067.rdualw (mgr.24569) 5586 : cluster [DBG] pgmap v4813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:09:20.279 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:18.968737+0000 mgr.smithi067.rdualw (mgr.24569) 5587 : cluster [DBG] pgmap v4814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:20.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:18.968737+0000 mgr.smithi067.rdualw (mgr.24569) 5587 : cluster [DBG] pgmap v4814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:20.969780+0000 mgr.smithi067.rdualw (mgr.24569) 5588 : cluster [DBG] pgmap v4815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:20.969780+0000 mgr.smithi067.rdualw (mgr.24569) 5588 : cluster [DBG] pgmap v4815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:24.280 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:22.970484+0000 mgr.smithi067.rdualw (mgr.24569) 5589 : cluster [DBG] pgmap v4816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:24.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:22.970484+0000 mgr.smithi067.rdualw (mgr.24569) 5589 : cluster [DBG] pgmap v4816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:26.280 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:24.971029+0000 mgr.smithi067.rdualw (mgr.24569) 5590 : cluster [DBG] pgmap v4817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:26.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:24.971029+0000 mgr.smithi067.rdualw (mgr.24569) 5590 : cluster [DBG] pgmap v4817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:28.281 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:26.972078+0000 mgr.smithi067.rdualw (mgr.24569) 5591 : cluster [DBG] pgmap v4818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:09:28.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:26.972078+0000 mgr.smithi067.rdualw (mgr.24569) 5591 : cluster [DBG] pgmap v4818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:09:30.281 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:28.972672+0000 mgr.smithi067.rdualw (mgr.24569) 5592 : cluster [DBG] pgmap v4819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:30.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:28.972672+0000 mgr.smithi067.rdualw (mgr.24569) 5592 : cluster [DBG] pgmap v4819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:30.973594+0000 mgr.smithi067.rdualw (mgr.24569) 5593 : cluster [DBG] pgmap v4820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:30.973594+0000 mgr.smithi067.rdualw (mgr.24569) 5593 : cluster [DBG] pgmap v4820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:34.282 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:32.974041+0000 mgr.smithi067.rdualw (mgr.24569) 5594 : cluster [DBG] pgmap v4821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:34.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:32.974041+0000 mgr.smithi067.rdualw (mgr.24569) 5594 : cluster [DBG] pgmap v4821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:35.012 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:09:35.306 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:09:35.307 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 5m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:09:35.307 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 5m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:09:35.307 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 6m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:09:35.307 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 5m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:09:35.308 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 5m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:09:35.308 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 6m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:09:35.308 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 5m ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:09:35.308 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 6m ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:09:35.309 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 5m ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:09:35.309 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 6m ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:09:35.309 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 5m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:09:35.309 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 6m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:09:35.309 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 5m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:09:35.310 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 6m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:09:35.310 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 5m ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:09:35.310 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 5m ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:09:35.310 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 5m ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:09:35.311 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 5m ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:09:35.311 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 6m ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:09:35.311 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 6m ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:09:35.311 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 6m ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:09:35.311 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 6m ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:09:35.312 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 5m ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:09:35.652 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:09:35.653 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:09:35.653 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:09:35.654 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:09:35.654 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:09:35.654 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:09:35.654 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:09:35.655 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:09:35.655 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:09:35.655 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:09:35.655 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:09:35.655 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:09:35.656 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:09:35.656 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:09:35.656 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:09:35.656 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:09:35.656 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:09:35.657 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:09:35.657 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:09:36.282 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:34.974686+0000 mgr.smithi067.rdualw (mgr.24569) 5595 : cluster [DBG] pgmap v4822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:36.283 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:09:35.000807+0000 mgr.smithi067.rdualw (mgr.24569) 5596 : audit [DBG] from='client.37870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:09:36.283 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:09:35.289686+0000 mgr.smithi067.rdualw (mgr.24569) 5597 : audit [DBG] from='client.37874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:09:36.283 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:09:35.312567+0000 mon.smithi067 (mon.1) 867 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:09:36.284 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:09:35.312818+0000 mon.smithi067 (mon.1) 868 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:09:36.284 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:09:35.313019+0000 mon.smithi061 (mon.0) 1278 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:09:36.285 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:09:35.313516+0000 mon.smithi061 (mon.0) 1279 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:09:36.285 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:09:35.652914+0000 mon.smithi061 (mon.0) 1280 : audit [DBG] from='client.? 172.21.15.61:0/4087358491' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:09:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:34.974686+0000 mgr.smithi067.rdualw (mgr.24569) 5595 : cluster [DBG] pgmap v4822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:09:35.000807+0000 mgr.smithi067.rdualw (mgr.24569) 5596 : audit [DBG] from='client.37870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:09:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:09:35.289686+0000 mgr.smithi067.rdualw (mgr.24569) 5597 : audit [DBG] from='client.37874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:09:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:09:35.312567+0000 mon.smithi067 (mon.1) 867 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:09:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:09:35.312818+0000 mon.smithi067 (mon.1) 868 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:09:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:09:35.313019+0000 mon.smithi061 (mon.0) 1278 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:09:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:09:35.313516+0000 mon.smithi061 (mon.0) 1279 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:09:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:09:35.652914+0000 mon.smithi061 (mon.0) 1280 : audit [DBG] from='client.? 172.21.15.61:0/4087358491' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:09:38.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:36.975732+0000 mgr.smithi067.rdualw (mgr.24569) 5598 : cluster [DBG] pgmap v4823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:09:38.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:36.975732+0000 mgr.smithi067.rdualw (mgr.24569) 5598 : cluster [DBG] pgmap v4823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:09:40.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:38.976311+0000 mgr.smithi067.rdualw (mgr.24569) 5599 : cluster [DBG] pgmap v4824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:40.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:38.976311+0000 mgr.smithi067.rdualw (mgr.24569) 5599 : cluster [DBG] pgmap v4824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:09:40.889992+0000 mon.smithi067 (mon.1) 869 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:09:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:09:40.891473+0000 mon.smithi067 (mon.1) 870 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:09:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:09:40.892453+0000 mon.smithi067 (mon.1) 871 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:09:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:09:40.893343+0000 mgr.smithi067.rdualw (mgr.24569) 5600 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:09:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:40.977091+0000 mgr.smithi067.rdualw (mgr.24569) 5601 : cluster [DBG] pgmap v4825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:09:41.299997+0000 mon.smithi061 (mon.0) 1281 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:09:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:09:41.305754+0000 mon.smithi061 (mon.0) 1282 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:09:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:09:40.889992+0000 mon.smithi067 (mon.1) 869 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:09:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:09:40.891473+0000 mon.smithi067 (mon.1) 870 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:09:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:09:40.892453+0000 mon.smithi067 (mon.1) 871 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:09:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:09:40.893343+0000 mgr.smithi067.rdualw (mgr.24569) 5600 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:09:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:40.977091+0000 mgr.smithi067.rdualw (mgr.24569) 5601 : cluster [DBG] pgmap v4825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:09:41.299997+0000 mon.smithi061 (mon.0) 1281 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:09:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:09:41.305754+0000 mon.smithi061 (mon.0) 1282 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:09:44.283 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:42.977630+0000 mgr.smithi067.rdualw (mgr.24569) 5602 : cluster [DBG] pgmap v4826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:44.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:42.977630+0000 mgr.smithi067.rdualw (mgr.24569) 5602 : cluster [DBG] pgmap v4826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:46.284 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:44.978165+0000 mgr.smithi067.rdualw (mgr.24569) 5603 : cluster [DBG] pgmap v4827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:46.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:44.978165+0000 mgr.smithi067.rdualw (mgr.24569) 5603 : cluster [DBG] pgmap v4827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:48.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:46.979079+0000 mgr.smithi067.rdualw (mgr.24569) 5604 : cluster [DBG] pgmap v4828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:09:48.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:46.979079+0000 mgr.smithi067.rdualw (mgr.24569) 5604 : cluster [DBG] pgmap v4828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:09:50.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:48.979801+0000 mgr.smithi067.rdualw (mgr.24569) 5605 : cluster [DBG] pgmap v4829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:50.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:48.979801+0000 mgr.smithi067.rdualw (mgr.24569) 5605 : cluster [DBG] pgmap v4829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:50.980786+0000 mgr.smithi067.rdualw (mgr.24569) 5606 : cluster [DBG] pgmap v4830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:50.980786+0000 mgr.smithi067.rdualw (mgr.24569) 5606 : cluster [DBG] pgmap v4830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:54.285 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:52.981248+0000 mgr.smithi067.rdualw (mgr.24569) 5607 : cluster [DBG] pgmap v4831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:54.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:52.981248+0000 mgr.smithi067.rdualw (mgr.24569) 5607 : cluster [DBG] pgmap v4831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:56.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:54.981887+0000 mgr.smithi067.rdualw (mgr.24569) 5608 : cluster [DBG] pgmap v4832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:54.981887+0000 mgr.smithi067.rdualw (mgr.24569) 5608 : cluster [DBG] pgmap v4832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:09:58.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:09:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:56.982875+0000 mgr.smithi067.rdualw (mgr.24569) 5609 : cluster [DBG] pgmap v4833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:09:58.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:09:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:56.982875+0000 mgr.smithi067.rdualw (mgr.24569) 5609 : cluster [DBG] pgmap v4833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:10:00.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:09:58.983424+0000 mgr.smithi067.rdualw (mgr.24569) 5610 : cluster [DBG] pgmap v4834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:00.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:00.000098+0000 mon.smithi061 (mon.0) 1283 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T18:10:00.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:09:58.983424+0000 mgr.smithi067.rdualw (mgr.24569) 5610 : cluster [DBG] pgmap v4834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:00.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:00.000098+0000 mon.smithi061 (mon.0) 1283 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T18:10:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:00.984281+0000 mgr.smithi067.rdualw (mgr.24569) 5611 : cluster [DBG] pgmap v4835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:00.984281+0000 mgr.smithi067.rdualw (mgr.24569) 5611 : cluster [DBG] pgmap v4835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:04.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:02.984759+0000 mgr.smithi067.rdualw (mgr.24569) 5612 : cluster [DBG] pgmap v4836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:04.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:02.984759+0000 mgr.smithi067.rdualw (mgr.24569) 5612 : cluster [DBG] pgmap v4836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:05.959 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:10:06.250 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:10:06.250 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 6m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:10:06.251 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 6m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:10:06.251 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 6m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:10:06.252 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 6m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:10:06.252 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 6m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:10:06.253 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 6m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:10:06.253 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 6m ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:10:06.253 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 6m ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:10:06.254 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 6m ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:10:06.254 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 6m ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:10:06.255 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 6m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:10:06.255 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 6m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:10:06.255 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 6m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:10:06.256 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 6m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:10:06.256 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 6m ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:10:06.256 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 6m ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:10:06.257 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 6m ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:10:06.259 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 6m ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:10:06.259 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 6m ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:10:06.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 6m ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:10:06.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 6m ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:10:06.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 6m ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:10:06.261 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 6m ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:10:06.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:04.985590+0000 mgr.smithi067.rdualw (mgr.24569) 5613 : cluster [DBG] pgmap v4837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:06.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:04.985590+0000 mgr.smithi067.rdualw (mgr.24569) 5613 : cluster [DBG] pgmap v4837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:06.588 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:10:06.588 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:10:06.588 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:10:06.589 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:10:06.589 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:10:06.589 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:10:06.589 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:10:06.589 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:10:06.590 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:10:06.590 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:10:06.590 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:10:06.590 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:10:06.590 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:10:06.591 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:10:06.591 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:10:06.591 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:10:06.591 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:10:06.592 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:10:06.592 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:10:07.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:10:05.948033+0000 mgr.smithi067.rdualw (mgr.24569) 5614 : audit [DBG] from='client.37882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:10:07.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:10:06.233984+0000 mgr.smithi067.rdualw (mgr.24569) 5615 : audit [DBG] from='client.37886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:10:07.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:10:06.588349+0000 mon.smithi061 (mon.0) 1284 : audit [DBG] from='client.? 172.21.15.61:0/1870145746' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:10:07.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:10:05.948033+0000 mgr.smithi067.rdualw (mgr.24569) 5614 : audit [DBG] from='client.37882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:10:07.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:10:06.233984+0000 mgr.smithi067.rdualw (mgr.24569) 5615 : audit [DBG] from='client.37886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:10:07.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:10:06.588349+0000 mon.smithi061 (mon.0) 1284 : audit [DBG] from='client.? 172.21.15.61:0/1870145746' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:10:08.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:06.986396+0000 mgr.smithi067.rdualw (mgr.24569) 5616 : cluster [DBG] pgmap v4838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:10:08.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:06.986396+0000 mgr.smithi067.rdualw (mgr.24569) 5616 : cluster [DBG] pgmap v4838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:10:10.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:08.987134+0000 mgr.smithi067.rdualw (mgr.24569) 5617 : cluster [DBG] pgmap v4839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:10.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:08.987134+0000 mgr.smithi067.rdualw (mgr.24569) 5617 : cluster [DBG] pgmap v4839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:10.988175+0000 mgr.smithi067.rdualw (mgr.24569) 5618 : cluster [DBG] pgmap v4840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:10.988175+0000 mgr.smithi067.rdualw (mgr.24569) 5618 : cluster [DBG] pgmap v4840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:14.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:12.988799+0000 mgr.smithi067.rdualw (mgr.24569) 5619 : cluster [DBG] pgmap v4841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:14.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:12.988799+0000 mgr.smithi067.rdualw (mgr.24569) 5619 : cluster [DBG] pgmap v4841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:16.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:14.989513+0000 mgr.smithi067.rdualw (mgr.24569) 5620 : cluster [DBG] pgmap v4842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:16.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:14.989513+0000 mgr.smithi067.rdualw (mgr.24569) 5620 : cluster [DBG] pgmap v4842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:18.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:16.990432+0000 mgr.smithi067.rdualw (mgr.24569) 5621 : cluster [DBG] pgmap v4843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:10:18.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:16.990432+0000 mgr.smithi067.rdualw (mgr.24569) 5621 : cluster [DBG] pgmap v4843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:10:20.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:18.991179+0000 mgr.smithi067.rdualw (mgr.24569) 5622 : cluster [DBG] pgmap v4844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:20.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:18.991179+0000 mgr.smithi067.rdualw (mgr.24569) 5622 : cluster [DBG] pgmap v4844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:20.992112+0000 mgr.smithi067.rdualw (mgr.24569) 5623 : cluster [DBG] pgmap v4845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:22.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:20.992112+0000 mgr.smithi067.rdualw (mgr.24569) 5623 : cluster [DBG] pgmap v4845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:24.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:22.992762+0000 mgr.smithi067.rdualw (mgr.24569) 5624 : cluster [DBG] pgmap v4846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:24.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:22.992762+0000 mgr.smithi067.rdualw (mgr.24569) 5624 : cluster [DBG] pgmap v4846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:26.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:24.993396+0000 mgr.smithi067.rdualw (mgr.24569) 5625 : cluster [DBG] pgmap v4847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:26.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:24.993396+0000 mgr.smithi067.rdualw (mgr.24569) 5625 : cluster [DBG] pgmap v4847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:28.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:26.994326+0000 mgr.smithi067.rdualw (mgr.24569) 5626 : cluster [DBG] pgmap v4848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:10:28.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:26.994326+0000 mgr.smithi067.rdualw (mgr.24569) 5626 : cluster [DBG] pgmap v4848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:10:30.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:28.994885+0000 mgr.smithi067.rdualw (mgr.24569) 5627 : cluster [DBG] pgmap v4849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:30.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:28.994885+0000 mgr.smithi067.rdualw (mgr.24569) 5627 : cluster [DBG] pgmap v4849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:30.995805+0000 mgr.smithi067.rdualw (mgr.24569) 5628 : cluster [DBG] pgmap v4850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:30.995805+0000 mgr.smithi067.rdualw (mgr.24569) 5628 : cluster [DBG] pgmap v4850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:34.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:32.996356+0000 mgr.smithi067.rdualw (mgr.24569) 5629 : cluster [DBG] pgmap v4851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:34.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:32.996356+0000 mgr.smithi067.rdualw (mgr.24569) 5629 : cluster [DBG] pgmap v4851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:34.997093+0000 mgr.smithi067.rdualw (mgr.24569) 5630 : cluster [DBG] pgmap v4852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:10:35.318837+0000 mon.smithi067 (mon.1) 872 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:10:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:10:35.319091+0000 mon.smithi067 (mon.1) 873 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:10:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:10:35.319217+0000 mon.smithi061 (mon.0) 1285 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:10:36.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:10:35.319515+0000 mon.smithi061 (mon.0) 1286 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:10:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:34.997093+0000 mgr.smithi067.rdualw (mgr.24569) 5630 : cluster [DBG] pgmap v4852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:10:35.318837+0000 mon.smithi067 (mon.1) 872 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:10:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:10:35.319091+0000 mon.smithi067 (mon.1) 873 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:10:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:10:35.319217+0000 mon.smithi061 (mon.0) 1285 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:10:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:10:35.319515+0000 mon.smithi061 (mon.0) 1286 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:10:36.898 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:10:37.197 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:10:37.198 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 6m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:10:37.198 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 6m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:10:37.199 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 7m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:10:37.199 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 6m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:10:37.200 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 6m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:10:37.200 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 7m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:10:37.201 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 6m ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:10:37.201 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 7m ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:10:37.202 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 6m ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:10:37.202 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 7m ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:10:37.203 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 6m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:10:37.203 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 7m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:10:37.204 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 6m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:10:37.204 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 7m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:10:37.204 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 6m ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:10:37.205 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 6m ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:10:37.205 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 6m ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:10:37.206 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 6m ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:10:37.206 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 7m ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:10:37.207 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 7m ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:10:37.207 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 7m ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:10:37.208 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 7m ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:10:37.208 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 6m ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:10:37.540 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:10:37.540 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:10:37.541 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:10:37.541 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:10:37.541 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:10:37.541 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:10:37.542 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:10:37.542 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:10:37.542 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:10:37.542 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:10:37.543 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:10:37.543 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:10:37.543 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:10:37.543 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:10:37.543 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:10:37.544 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:10:37.544 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:10:37.544 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:10:37.544 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:10:38.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:10:36.887014+0000 mgr.smithi067.rdualw (mgr.24569) 5631 : audit [DBG] from='client.37894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:10:38.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:36.998085+0000 mgr.smithi067.rdualw (mgr.24569) 5632 : cluster [DBG] pgmap v4853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:10:38.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:10:37.181138+0000 mgr.smithi067.rdualw (mgr.24569) 5633 : audit [DBG] from='client.37898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:10:38.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:10:37.540610+0000 mon.smithi061 (mon.0) 1287 : audit [DBG] from='client.? 172.21.15.61:0/288548257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:10:38.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:10:36.887014+0000 mgr.smithi067.rdualw (mgr.24569) 5631 : audit [DBG] from='client.37894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:10:38.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:36.998085+0000 mgr.smithi067.rdualw (mgr.24569) 5632 : cluster [DBG] pgmap v4853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:10:38.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:10:37.181138+0000 mgr.smithi067.rdualw (mgr.24569) 5633 : audit [DBG] from='client.37898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:10:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:10:37.540610+0000 mon.smithi061 (mon.0) 1287 : audit [DBG] from='client.? 172.21.15.61:0/288548257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:10:40.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:38.998709+0000 mgr.smithi067.rdualw (mgr.24569) 5634 : cluster [DBG] pgmap v4854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:40.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:38.998709+0000 mgr.smithi067.rdualw (mgr.24569) 5634 : cluster [DBG] pgmap v4854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:40.999511+0000 mgr.smithi067.rdualw (mgr.24569) 5635 : cluster [DBG] pgmap v4855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:10:41.309923+0000 mon.smithi067 (mon.1) 874 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:10:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:10:41.311388+0000 mon.smithi067 (mon.1) 875 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:10:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:10:41.312343+0000 mon.smithi067 (mon.1) 876 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:10:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:10:41.313220+0000 mgr.smithi067.rdualw (mgr.24569) 5636 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:10:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:10:41.729387+0000 mon.smithi061 (mon.0) 1288 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:10:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:40.999511+0000 mgr.smithi067.rdualw (mgr.24569) 5635 : cluster [DBG] pgmap v4855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:10:41.309923+0000 mon.smithi067 (mon.1) 874 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:10:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:10:41.311388+0000 mon.smithi067 (mon.1) 875 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:10:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:10:41.312343+0000 mon.smithi067 (mon.1) 876 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:10:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:10:41.313220+0000 mgr.smithi067.rdualw (mgr.24569) 5636 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:10:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:10:41.729387+0000 mon.smithi061 (mon.0) 1288 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:10:43.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:10:41.738253+0000 mon.smithi061 (mon.0) 1289 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:10:43.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:10:41.738253+0000 mon.smithi061 (mon.0) 1289 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:10:44.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:42.999981+0000 mgr.smithi067.rdualw (mgr.24569) 5637 : cluster [DBG] pgmap v4856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:44.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:42.999981+0000 mgr.smithi067.rdualw (mgr.24569) 5637 : cluster [DBG] pgmap v4856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:46.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:45.000512+0000 mgr.smithi067.rdualw (mgr.24569) 5638 : cluster [DBG] pgmap v4857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:46.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:45.000512+0000 mgr.smithi067.rdualw (mgr.24569) 5638 : cluster [DBG] pgmap v4857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:48.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:47.001413+0000 mgr.smithi067.rdualw (mgr.24569) 5639 : cluster [DBG] pgmap v4858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:10:48.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:47.001413+0000 mgr.smithi067.rdualw (mgr.24569) 5639 : cluster [DBG] pgmap v4858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:10:50.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:49.001985+0000 mgr.smithi067.rdualw (mgr.24569) 5640 : cluster [DBG] pgmap v4859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:50.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:49.001985+0000 mgr.smithi067.rdualw (mgr.24569) 5640 : cluster [DBG] pgmap v4859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:51.002894+0000 mgr.smithi067.rdualw (mgr.24569) 5641 : cluster [DBG] pgmap v4860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:51.002894+0000 mgr.smithi067.rdualw (mgr.24569) 5641 : cluster [DBG] pgmap v4860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:54.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:53.003390+0000 mgr.smithi067.rdualw (mgr.24569) 5642 : cluster [DBG] pgmap v4861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:54.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:53.003390+0000 mgr.smithi067.rdualw (mgr.24569) 5642 : cluster [DBG] pgmap v4861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:55.003981+0000 mgr.smithi067.rdualw (mgr.24569) 5643 : cluster [DBG] pgmap v4862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:56.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:55.003981+0000 mgr.smithi067.rdualw (mgr.24569) 5643 : cluster [DBG] pgmap v4862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:10:58.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:10:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:57.005069+0000 mgr.smithi067.rdualw (mgr.24569) 5644 : cluster [DBG] pgmap v4863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:10:58.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:10:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:57.005069+0000 mgr.smithi067.rdualw (mgr.24569) 5644 : cluster [DBG] pgmap v4863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:11:00.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:10:59.005606+0000 mgr.smithi067.rdualw (mgr.24569) 5645 : cluster [DBG] pgmap v4864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:00.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:10:59.005606+0000 mgr.smithi067.rdualw (mgr.24569) 5645 : cluster [DBG] pgmap v4864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:01.006676+0000 mgr.smithi067.rdualw (mgr.24569) 5646 : cluster [DBG] pgmap v4865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:01.006676+0000 mgr.smithi067.rdualw (mgr.24569) 5646 : cluster [DBG] pgmap v4865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:04.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:03.007257+0000 mgr.smithi067.rdualw (mgr.24569) 5647 : cluster [DBG] pgmap v4866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:04.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:03.007257+0000 mgr.smithi067.rdualw (mgr.24569) 5647 : cluster [DBG] pgmap v4866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:06.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:05.007911+0000 mgr.smithi067.rdualw (mgr.24569) 5648 : cluster [DBG] pgmap v4867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:06.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:05.007911+0000 mgr.smithi067.rdualw (mgr.24569) 5648 : cluster [DBG] pgmap v4867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:07.849 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:11:08.165 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:11:08.165 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 7m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:11:08.166 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 7m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:11:08.166 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 7m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:11:08.166 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 7m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:11:08.166 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 7m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:11:08.166 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 7m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:11:08.167 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 7m ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:11:08.167 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 7m ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:11:08.167 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 7m ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:11:08.167 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 7m ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:11:08.168 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 7m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:11:08.168 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 7m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:11:08.168 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 7m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:11:08.168 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 7m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:11:08.168 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 7m ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:11:08.169 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 7m ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:11:08.169 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 7m ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:11:08.169 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 7m ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:11:08.169 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 7m ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:11:08.170 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 7m ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:11:08.170 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 7m ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:11:08.170 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 7m ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:11:08.170 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 7m ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:11:08.508 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:11:08.508 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:11:08.509 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:11:08.509 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:11:08.509 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:11:08.509 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:11:08.510 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:11:08.510 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:11:08.510 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:11:08.510 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:11:08.510 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:11:08.511 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:11:08.511 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:11:08.511 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:11:08.511 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:11:08.511 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:11:08.512 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:11:08.512 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:11:08.512 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:11:08.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:07.008852+0000 mgr.smithi067.rdualw (mgr.24569) 5649 : cluster [DBG] pgmap v4868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:11:08.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:07.008852+0000 mgr.smithi067.rdualw (mgr.24569) 5649 : cluster [DBG] pgmap v4868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:11:09.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:11:07.837079+0000 mgr.smithi067.rdualw (mgr.24569) 5650 : audit [DBG] from='client.37906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:11:09.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:11:08.149442+0000 mgr.smithi067.rdualw (mgr.24569) 5651 : audit [DBG] from='client.37910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:11:09.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:11:08.508855+0000 mon.smithi061 (mon.0) 1290 : audit [DBG] from='client.? 172.21.15.61:0/398318324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:11:09.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:11:07.837079+0000 mgr.smithi067.rdualw (mgr.24569) 5650 : audit [DBG] from='client.37906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:11:09.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:11:08.149442+0000 mgr.smithi067.rdualw (mgr.24569) 5651 : audit [DBG] from='client.37910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:11:09.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:11:08.508855+0000 mon.smithi061 (mon.0) 1290 : audit [DBG] from='client.? 172.21.15.61:0/398318324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:11:10.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:09.009468+0000 mgr.smithi067.rdualw (mgr.24569) 5652 : cluster [DBG] pgmap v4869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:10.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:09.009468+0000 mgr.smithi067.rdualw (mgr.24569) 5652 : cluster [DBG] pgmap v4869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:11.010557+0000 mgr.smithi067.rdualw (mgr.24569) 5653 : cluster [DBG] pgmap v4870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:11.010557+0000 mgr.smithi067.rdualw (mgr.24569) 5653 : cluster [DBG] pgmap v4870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:14.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:13.011020+0000 mgr.smithi067.rdualw (mgr.24569) 5654 : cluster [DBG] pgmap v4871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:14.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:13.011020+0000 mgr.smithi067.rdualw (mgr.24569) 5654 : cluster [DBG] pgmap v4871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:16.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:15.011775+0000 mgr.smithi067.rdualw (mgr.24569) 5655 : cluster [DBG] pgmap v4872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:16.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:15.011775+0000 mgr.smithi067.rdualw (mgr.24569) 5655 : cluster [DBG] pgmap v4872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:18.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:17.012764+0000 mgr.smithi067.rdualw (mgr.24569) 5656 : cluster [DBG] pgmap v4873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:11:18.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:17.012764+0000 mgr.smithi067.rdualw (mgr.24569) 5656 : cluster [DBG] pgmap v4873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:11:20.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:19.013415+0000 mgr.smithi067.rdualw (mgr.24569) 5657 : cluster [DBG] pgmap v4874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:20.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:19.013415+0000 mgr.smithi067.rdualw (mgr.24569) 5657 : cluster [DBG] pgmap v4874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:21.014272+0000 mgr.smithi067.rdualw (mgr.24569) 5658 : cluster [DBG] pgmap v4875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:22.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:21.014272+0000 mgr.smithi067.rdualw (mgr.24569) 5658 : cluster [DBG] pgmap v4875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:24.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:23.015028+0000 mgr.smithi067.rdualw (mgr.24569) 5659 : cluster [DBG] pgmap v4876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:24.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:23.015028+0000 mgr.smithi067.rdualw (mgr.24569) 5659 : cluster [DBG] pgmap v4876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:26.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:25.015666+0000 mgr.smithi067.rdualw (mgr.24569) 5660 : cluster [DBG] pgmap v4877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:26.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:25.015666+0000 mgr.smithi067.rdualw (mgr.24569) 5660 : cluster [DBG] pgmap v4877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:28.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:27.016666+0000 mgr.smithi067.rdualw (mgr.24569) 5661 : cluster [DBG] pgmap v4878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:11:28.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:27.016666+0000 mgr.smithi067.rdualw (mgr.24569) 5661 : cluster [DBG] pgmap v4878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:11:30.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:29.017343+0000 mgr.smithi067.rdualw (mgr.24569) 5662 : cluster [DBG] pgmap v4879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:29.017343+0000 mgr.smithi067.rdualw (mgr.24569) 5662 : cluster [DBG] pgmap v4879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:31.018282+0000 mgr.smithi067.rdualw (mgr.24569) 5663 : cluster [DBG] pgmap v4880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:31.018282+0000 mgr.smithi067.rdualw (mgr.24569) 5663 : cluster [DBG] pgmap v4880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:34.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:33.018838+0000 mgr.smithi067.rdualw (mgr.24569) 5664 : cluster [DBG] pgmap v4881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:34.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:33.018838+0000 mgr.smithi067.rdualw (mgr.24569) 5664 : cluster [DBG] pgmap v4881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:35.019408+0000 mgr.smithi067.rdualw (mgr.24569) 5665 : cluster [DBG] pgmap v4882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:11:35.325065+0000 mon.smithi067 (mon.1) 877 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:11:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:11:35.325419+0000 mon.smithi067 (mon.1) 878 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:11:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:11:35.325750+0000 mon.smithi061 (mon.0) 1291 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:11:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:11:35.326261+0000 mon.smithi061 (mon.0) 1292 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:11:36.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:35.019408+0000 mgr.smithi067.rdualw (mgr.24569) 5665 : cluster [DBG] pgmap v4882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:11:35.325065+0000 mon.smithi067 (mon.1) 877 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:11:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:11:35.325419+0000 mon.smithi067 (mon.1) 878 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:11:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:11:35.325750+0000 mon.smithi061 (mon.0) 1291 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:11:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:11:35.326261+0000 mon.smithi061 (mon.0) 1292 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:11:38.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:37.020338+0000 mgr.smithi067.rdualw (mgr.24569) 5666 : cluster [DBG] pgmap v4883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:11:38.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:37.020338+0000 mgr.smithi067.rdualw (mgr.24569) 5666 : cluster [DBG] pgmap v4883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:11:38.825 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:11:39.120 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:11:39.121 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 8m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:11:39.122 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 8m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:11:39.122 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 8m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:11:39.122 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 8m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:11:39.122 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 8m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:11:39.123 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 8m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:11:39.123 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 8m ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:11:39.123 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 8m ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:11:39.124 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 8m ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:11:39.124 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 8m ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:11:39.124 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 8m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:11:39.124 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 8m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:11:39.124 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 8m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:11:39.125 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 8m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:11:39.125 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 8m ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:11:39.125 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 8m ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:11:39.125 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 8m ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:11:39.125 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 8m ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:11:39.126 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 8m ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:11:39.126 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 8m ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:11:39.126 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 8m ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:11:39.126 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 8m ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:11:39.127 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 8m ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:11:39.464 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:11:39.464 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:11:39.465 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:11:39.465 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:11:39.465 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:11:39.465 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:11:39.465 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:11:39.466 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:11:39.466 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:11:39.466 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:11:39.466 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:11:39.467 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:11:39.467 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:11:39.468 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:11:39.468 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:11:39.468 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:11:39.469 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:11:39.469 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:11:39.469 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:11:40.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:11:38.813435+0000 mgr.smithi067.rdualw (mgr.24569) 5667 : audit [DBG] from='client.37918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:11:40.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:39.020914+0000 mgr.smithi067.rdualw (mgr.24569) 5668 : cluster [DBG] pgmap v4884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:40.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:11:39.103952+0000 mgr.smithi067.rdualw (mgr.24569) 5669 : audit [DBG] from='client.37922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:11:40.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:11:39.464675+0000 mon.smithi061 (mon.0) 1293 : audit [DBG] from='client.? 172.21.15.61:0/722551118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:11:40.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:11:38.813435+0000 mgr.smithi067.rdualw (mgr.24569) 5667 : audit [DBG] from='client.37918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:11:40.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:39.020914+0000 mgr.smithi067.rdualw (mgr.24569) 5668 : cluster [DBG] pgmap v4884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:40.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:11:39.103952+0000 mgr.smithi067.rdualw (mgr.24569) 5669 : audit [DBG] from='client.37922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:11:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:11:39.464675+0000 mon.smithi061 (mon.0) 1293 : audit [DBG] from='client.? 172.21.15.61:0/722551118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:11:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:41.021873+0000 mgr.smithi067.rdualw (mgr.24569) 5670 : cluster [DBG] pgmap v4885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:42.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:41.021873+0000 mgr.smithi067.rdualw (mgr.24569) 5670 : cluster [DBG] pgmap v4885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:43.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:11:41.743676+0000 mon.smithi067 (mon.1) 879 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:11:43.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:11:41.749389+0000 mon.smithi067 (mon.1) 880 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:11:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:11:41.750342+0000 mon.smithi067 (mon.1) 881 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:11:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:11:41.751208+0000 mgr.smithi067.rdualw (mgr.24569) 5671 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:11:43.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:11:42.156979+0000 mon.smithi061 (mon.0) 1294 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:11:43.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:11:42.164482+0000 mon.smithi061 (mon.0) 1295 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:11:43.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:11:41.743676+0000 mon.smithi067 (mon.1) 879 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:11:43.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:11:41.749389+0000 mon.smithi067 (mon.1) 880 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:11:43.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:11:41.750342+0000 mon.smithi067 (mon.1) 881 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:11:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:11:41.751208+0000 mgr.smithi067.rdualw (mgr.24569) 5671 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:11:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:11:42.156979+0000 mon.smithi061 (mon.0) 1294 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:11:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:11:42.164482+0000 mon.smithi061 (mon.0) 1295 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:11:44.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:43.022454+0000 mgr.smithi067.rdualw (mgr.24569) 5672 : cluster [DBG] pgmap v4886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:44.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:43.022454+0000 mgr.smithi067.rdualw (mgr.24569) 5672 : cluster [DBG] pgmap v4886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:46.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:45.023074+0000 mgr.smithi067.rdualw (mgr.24569) 5673 : cluster [DBG] pgmap v4887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:46.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:45.023074+0000 mgr.smithi067.rdualw (mgr.24569) 5673 : cluster [DBG] pgmap v4887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:48.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:47.023995+0000 mgr.smithi067.rdualw (mgr.24569) 5674 : cluster [DBG] pgmap v4888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:11:48.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:47.023995+0000 mgr.smithi067.rdualw (mgr.24569) 5674 : cluster [DBG] pgmap v4888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:11:50.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:49.024715+0000 mgr.smithi067.rdualw (mgr.24569) 5675 : cluster [DBG] pgmap v4889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:50.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:49.024715+0000 mgr.smithi067.rdualw (mgr.24569) 5675 : cluster [DBG] pgmap v4889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:51.025577+0000 mgr.smithi067.rdualw (mgr.24569) 5676 : cluster [DBG] pgmap v4890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:51.025577+0000 mgr.smithi067.rdualw (mgr.24569) 5676 : cluster [DBG] pgmap v4890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:54.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:53.026252+0000 mgr.smithi067.rdualw (mgr.24569) 5677 : cluster [DBG] pgmap v4891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:54.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:53.026252+0000 mgr.smithi067.rdualw (mgr.24569) 5677 : cluster [DBG] pgmap v4891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:56.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:55.026872+0000 mgr.smithi067.rdualw (mgr.24569) 5678 : cluster [DBG] pgmap v4892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:56.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:55.026872+0000 mgr.smithi067.rdualw (mgr.24569) 5678 : cluster [DBG] pgmap v4892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:11:58.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:11:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:57.028032+0000 mgr.smithi067.rdualw (mgr.24569) 5679 : cluster [DBG] pgmap v4893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:11:58.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:11:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:57.028032+0000 mgr.smithi067.rdualw (mgr.24569) 5679 : cluster [DBG] pgmap v4893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:12:00.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:11:59.028766+0000 mgr.smithi067.rdualw (mgr.24569) 5680 : cluster [DBG] pgmap v4894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:00.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:11:59.028766+0000 mgr.smithi067.rdualw (mgr.24569) 5680 : cluster [DBG] pgmap v4894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:02.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:01.029819+0000 mgr.smithi067.rdualw (mgr.24569) 5681 : cluster [DBG] pgmap v4895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:02.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:01.029819+0000 mgr.smithi067.rdualw (mgr.24569) 5681 : cluster [DBG] pgmap v4895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:04.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:03.030385+0000 mgr.smithi067.rdualw (mgr.24569) 5682 : cluster [DBG] pgmap v4896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:04.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:03.030385+0000 mgr.smithi067.rdualw (mgr.24569) 5682 : cluster [DBG] pgmap v4896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:06.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:05.031165+0000 mgr.smithi067.rdualw (mgr.24569) 5683 : cluster [DBG] pgmap v4897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:06.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:05.031165+0000 mgr.smithi067.rdualw (mgr.24569) 5683 : cluster [DBG] pgmap v4897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:08.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:07.032208+0000 mgr.smithi067.rdualw (mgr.24569) 5684 : cluster [DBG] pgmap v4898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:12:08.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:07.032208+0000 mgr.smithi067.rdualw (mgr.24569) 5684 : cluster [DBG] pgmap v4898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:12:09.773 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:12:10.066 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:12:10.066 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 8m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:12:10.066 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 8m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:12:10.067 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 8m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:12:10.067 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 8m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:12:10.067 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 8m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:12:10.067 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 8m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:12:10.068 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 8m ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:12:10.068 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 8m ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:12:10.068 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 8m ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:12:10.068 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 8m ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:12:10.068 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 8m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:12:10.069 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 8m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:12:10.069 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 8m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:12:10.069 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 8m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:12:10.069 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 8m ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:12:10.069 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 8m ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:12:10.070 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 8m ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:12:10.070 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 8m ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:12:10.070 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 8m ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:12:10.070 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 8m ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:12:10.071 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 8m ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:12:10.071 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 8m ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:12:10.071 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 8m ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:12:10.413 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:12:10.413 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:12:10.414 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:12:10.414 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:12:10.414 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:12:10.414 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:12:10.415 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:12:10.415 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:12:10.415 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:12:10.415 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:12:10.415 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:12:10.416 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:12:10.416 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:12:10.416 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:12:10.416 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:12:10.417 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:12:10.417 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:12:10.417 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:12:10.417 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:12:10.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:09.032900+0000 mgr.smithi067.rdualw (mgr.24569) 5685 : cluster [DBG] pgmap v4899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:10.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:09.032900+0000 mgr.smithi067.rdualw (mgr.24569) 5685 : cluster [DBG] pgmap v4899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:11.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:12:09.761294+0000 mgr.smithi067.rdualw (mgr.24569) 5686 : audit [DBG] from='client.37930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:12:11.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:12:10.050137+0000 mgr.smithi067.rdualw (mgr.24569) 5687 : audit [DBG] from='client.37934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:12:11.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:12:10.413708+0000 mon.smithi061 (mon.0) 1296 : audit [DBG] from='client.? 172.21.15.61:0/3381169401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:12:11.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:12:09.761294+0000 mgr.smithi067.rdualw (mgr.24569) 5686 : audit [DBG] from='client.37930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:12:11.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:12:10.050137+0000 mgr.smithi067.rdualw (mgr.24569) 5687 : audit [DBG] from='client.37934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:12:11.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:12:10.413708+0000 mon.smithi061 (mon.0) 1296 : audit [DBG] from='client.? 172.21.15.61:0/3381169401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:12:12.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:11.033897+0000 mgr.smithi067.rdualw (mgr.24569) 5688 : cluster [DBG] pgmap v4900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:12.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:11.033897+0000 mgr.smithi067.rdualw (mgr.24569) 5688 : cluster [DBG] pgmap v4900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:14.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:13.034369+0000 mgr.smithi067.rdualw (mgr.24569) 5689 : cluster [DBG] pgmap v4901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:14.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:13.034369+0000 mgr.smithi067.rdualw (mgr.24569) 5689 : cluster [DBG] pgmap v4901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:16.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:15.035017+0000 mgr.smithi067.rdualw (mgr.24569) 5690 : cluster [DBG] pgmap v4902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:16.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:15.035017+0000 mgr.smithi067.rdualw (mgr.24569) 5690 : cluster [DBG] pgmap v4902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:18.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:17.036096+0000 mgr.smithi067.rdualw (mgr.24569) 5691 : cluster [DBG] pgmap v4903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:12:18.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:17.036096+0000 mgr.smithi067.rdualw (mgr.24569) 5691 : cluster [DBG] pgmap v4903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:12:20.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:19.036688+0000 mgr.smithi067.rdualw (mgr.24569) 5692 : cluster [DBG] pgmap v4904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:20.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:19.036688+0000 mgr.smithi067.rdualw (mgr.24569) 5692 : cluster [DBG] pgmap v4904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:21.037423+0000 mgr.smithi067.rdualw (mgr.24569) 5693 : cluster [DBG] pgmap v4905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:21.037423+0000 mgr.smithi067.rdualw (mgr.24569) 5693 : cluster [DBG] pgmap v4905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:24.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:23.038000+0000 mgr.smithi067.rdualw (mgr.24569) 5694 : cluster [DBG] pgmap v4906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:24.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:23.038000+0000 mgr.smithi067.rdualw (mgr.24569) 5694 : cluster [DBG] pgmap v4906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:26.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:25.038684+0000 mgr.smithi067.rdualw (mgr.24569) 5695 : cluster [DBG] pgmap v4907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:26.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:25.038684+0000 mgr.smithi067.rdualw (mgr.24569) 5695 : cluster [DBG] pgmap v4907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:28.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:27.039528+0000 mgr.smithi067.rdualw (mgr.24569) 5696 : cluster [DBG] pgmap v4908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:12:28.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:27.039528+0000 mgr.smithi067.rdualw (mgr.24569) 5696 : cluster [DBG] pgmap v4908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:12:30.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:29.040290+0000 mgr.smithi067.rdualw (mgr.24569) 5697 : cluster [DBG] pgmap v4909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:30.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:29.040290+0000 mgr.smithi067.rdualw (mgr.24569) 5697 : cluster [DBG] pgmap v4909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:31.041164+0000 mgr.smithi067.rdualw (mgr.24569) 5698 : cluster [DBG] pgmap v4910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:32.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:31.041164+0000 mgr.smithi067.rdualw (mgr.24569) 5698 : cluster [DBG] pgmap v4910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:34.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:33.041890+0000 mgr.smithi067.rdualw (mgr.24569) 5699 : cluster [DBG] pgmap v4911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:34.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:33.041890+0000 mgr.smithi067.rdualw (mgr.24569) 5699 : cluster [DBG] pgmap v4911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:35.042530+0000 mgr.smithi067.rdualw (mgr.24569) 5700 : cluster [DBG] pgmap v4912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:12:35.329915+0000 mon.smithi067 (mon.1) 882 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:12:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:12:35.330263+0000 mon.smithi067 (mon.1) 883 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:12:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:12:35.330408+0000 mon.smithi061 (mon.0) 1297 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:12:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:12:35.330885+0000 mon.smithi061 (mon.0) 1298 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:12:36.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:35.042530+0000 mgr.smithi067.rdualw (mgr.24569) 5700 : cluster [DBG] pgmap v4912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:12:35.329915+0000 mon.smithi067 (mon.1) 882 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:12:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:12:35.330263+0000 mon.smithi067 (mon.1) 883 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:12:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:12:35.330408+0000 mon.smithi061 (mon.0) 1297 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:12:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:12:35.330885+0000 mon.smithi061 (mon.0) 1298 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:12:38.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:37.043530+0000 mgr.smithi067.rdualw (mgr.24569) 5701 : cluster [DBG] pgmap v4913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:12:38.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:37.043530+0000 mgr.smithi067.rdualw (mgr.24569) 5701 : cluster [DBG] pgmap v4913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:12:40.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:39.044274+0000 mgr.smithi067.rdualw (mgr.24569) 5702 : cluster [DBG] pgmap v4914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:40.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:39.044274+0000 mgr.smithi067.rdualw (mgr.24569) 5702 : cluster [DBG] pgmap v4914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:40.737 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:12:41.026 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:12:41.027 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 9m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:12:41.027 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 9m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:12:41.027 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 9m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:12:41.028 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 9m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:12:41.028 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 9m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:12:41.029 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 9m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:12:41.029 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 9m ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:12:41.029 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 9m ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:12:41.030 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 9m ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:12:41.030 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 9m ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:12:41.031 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 9m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:12:41.031 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 9m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:12:41.031 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 9m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:12:41.032 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 9m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:12:41.032 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 9m ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:12:41.032 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 9m ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:12:41.033 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 9m ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:12:41.033 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 9m ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:12:41.034 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 9m ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:12:41.034 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 9m ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:12:41.034 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 9m ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:12:41.035 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 9m ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:12:41.035 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 9m ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:12:41.365 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:12:41.366 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:12:41.366 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:12:41.366 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:12:41.367 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:12:41.367 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:12:41.367 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:12:41.367 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:12:41.367 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:12:41.368 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:12:41.368 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:12:41.368 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:12:41.368 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:12:41.368 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:12:41.369 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:12:41.369 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:12:41.369 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:12:41.369 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:12:41.369 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:12:41.753 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:12:40.726080+0000 mgr.smithi067.rdualw (mgr.24569) 5703 : audit [DBG] from='client.37942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:12:41.753 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:12:41.009956+0000 mgr.smithi067.rdualw (mgr.24569) 5704 : audit [DBG] from='client.37946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:12:41.753 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:41.045128+0000 mgr.smithi067.rdualw (mgr.24569) 5705 : cluster [DBG] pgmap v4915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:41.754 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:12:41.366015+0000 mon.smithi061 (mon.0) 1299 : audit [DBG] from='client.? 172.21.15.61:0/3297715681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:12:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:12:40.726080+0000 mgr.smithi067.rdualw (mgr.24569) 5703 : audit [DBG] from='client.37942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:12:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:12:41.009956+0000 mgr.smithi067.rdualw (mgr.24569) 5704 : audit [DBG] from='client.37946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:12:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:41.045128+0000 mgr.smithi067.rdualw (mgr.24569) 5705 : cluster [DBG] pgmap v4915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:12:41.366015+0000 mon.smithi061 (mon.0) 1299 : audit [DBG] from='client.? 172.21.15.61:0/3297715681' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:12:43.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:12:42.167910+0000 mon.smithi067 (mon.1) 884 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:12:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:12:42.169437+0000 mon.smithi067 (mon.1) 885 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:12:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:12:42.170389+0000 mon.smithi067 (mon.1) 886 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:12:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:12:42.171312+0000 mgr.smithi067.rdualw (mgr.24569) 5706 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:12:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:12:42.585554+0000 mon.smithi061 (mon.0) 1300 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:12:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:12:42.591627+0000 mon.smithi061 (mon.0) 1301 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:12:43.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:12:42.167910+0000 mon.smithi067 (mon.1) 884 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:12:43.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:12:42.169437+0000 mon.smithi067 (mon.1) 885 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:12:43.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:12:42.170389+0000 mon.smithi067 (mon.1) 886 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:12:43.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:12:42.171312+0000 mgr.smithi067.rdualw (mgr.24569) 5706 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:12:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:12:42.585554+0000 mon.smithi061 (mon.0) 1300 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:12:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:12:42.591627+0000 mon.smithi061 (mon.0) 1301 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:12:44.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:43.045591+0000 mgr.smithi067.rdualw (mgr.24569) 5707 : cluster [DBG] pgmap v4916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:44.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:43.045591+0000 mgr.smithi067.rdualw (mgr.24569) 5707 : cluster [DBG] pgmap v4916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:46.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:45.046123+0000 mgr.smithi067.rdualw (mgr.24569) 5708 : cluster [DBG] pgmap v4917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:46.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:45.046123+0000 mgr.smithi067.rdualw (mgr.24569) 5708 : cluster [DBG] pgmap v4917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:48.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:47.047202+0000 mgr.smithi067.rdualw (mgr.24569) 5709 : cluster [DBG] pgmap v4918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:12:48.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:47.047202+0000 mgr.smithi067.rdualw (mgr.24569) 5709 : cluster [DBG] pgmap v4918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:12:50.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:49.047794+0000 mgr.smithi067.rdualw (mgr.24569) 5710 : cluster [DBG] pgmap v4919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:50.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:49.047794+0000 mgr.smithi067.rdualw (mgr.24569) 5710 : cluster [DBG] pgmap v4919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:51.048789+0000 mgr.smithi067.rdualw (mgr.24569) 5711 : cluster [DBG] pgmap v4920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:52.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:51.048789+0000 mgr.smithi067.rdualw (mgr.24569) 5711 : cluster [DBG] pgmap v4920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:54.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:53.049512+0000 mgr.smithi067.rdualw (mgr.24569) 5712 : cluster [DBG] pgmap v4921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:54.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:53.049512+0000 mgr.smithi067.rdualw (mgr.24569) 5712 : cluster [DBG] pgmap v4921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:56.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:55.050176+0000 mgr.smithi067.rdualw (mgr.24569) 5713 : cluster [DBG] pgmap v4922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:56.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:55.050176+0000 mgr.smithi067.rdualw (mgr.24569) 5713 : cluster [DBG] pgmap v4922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:12:58.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:12:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:57.051043+0000 mgr.smithi067.rdualw (mgr.24569) 5714 : cluster [DBG] pgmap v4923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:12:58.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:12:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:57.051043+0000 mgr.smithi067.rdualw (mgr.24569) 5714 : cluster [DBG] pgmap v4923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:13:00.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:12:59.051762+0000 mgr.smithi067.rdualw (mgr.24569) 5715 : cluster [DBG] pgmap v4924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:00.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:12:59.051762+0000 mgr.smithi067.rdualw (mgr.24569) 5715 : cluster [DBG] pgmap v4924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:02.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:01.052696+0000 mgr.smithi067.rdualw (mgr.24569) 5716 : cluster [DBG] pgmap v4925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:01.052696+0000 mgr.smithi067.rdualw (mgr.24569) 5716 : cluster [DBG] pgmap v4925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:04.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:03.053351+0000 mgr.smithi067.rdualw (mgr.24569) 5717 : cluster [DBG] pgmap v4926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:04.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:03.053351+0000 mgr.smithi067.rdualw (mgr.24569) 5717 : cluster [DBG] pgmap v4926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:06.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:05.054122+0000 mgr.smithi067.rdualw (mgr.24569) 5718 : cluster [DBG] pgmap v4927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:06.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:05.054122+0000 mgr.smithi067.rdualw (mgr.24569) 5718 : cluster [DBG] pgmap v4927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:08.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:07.055003+0000 mgr.smithi067.rdualw (mgr.24569) 5719 : cluster [DBG] pgmap v4928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:13:08.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:07.055003+0000 mgr.smithi067.rdualw (mgr.24569) 5719 : cluster [DBG] pgmap v4928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:13:10.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:09.055550+0000 mgr.smithi067.rdualw (mgr.24569) 5720 : cluster [DBG] pgmap v4929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:10.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:09.055550+0000 mgr.smithi067.rdualw (mgr.24569) 5720 : cluster [DBG] pgmap v4929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:11.671 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:13:11.972 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:13:11.973 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 9m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:13:11.973 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 9m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:13:11.973 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 9m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:13:11.973 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 9m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:13:11.974 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 9m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:13:11.974 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 9m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:13:11.974 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 9m ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:13:11.974 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 9m ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:13:11.975 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 9m ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:13:11.975 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 9m ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:13:11.975 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 9m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:13:11.975 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 9m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:13:11.976 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 9m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:13:11.976 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 9m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:13:11.976 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 9m ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:13:11.976 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 9m ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:13:11.976 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 9m ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:13:11.977 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 9m ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:13:11.977 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 9m ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:13:11.977 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 9m ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:13:11.977 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 9m ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:13:11.978 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 9m ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:13:11.978 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 9m ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:13:12.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:11.056445+0000 mgr.smithi067.rdualw (mgr.24569) 5721 : cluster [DBG] pgmap v4930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:12.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:11.056445+0000 mgr.smithi067.rdualw (mgr.24569) 5721 : cluster [DBG] pgmap v4930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:12.322 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:13:12.323 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:13:12.323 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:13:12.324 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:13:12.324 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:13:12.324 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:13:12.325 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:13:12.325 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:13:12.325 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:13:12.325 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:13:12.325 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:13:12.326 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:13:12.326 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:13:12.326 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:13:12.326 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:13:12.327 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:13:12.327 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:13:12.327 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:13:12.328 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:13:13.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:11.659898+0000 mgr.smithi067.rdualw (mgr.24569) 5722 : audit [DBG] from='client.37954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:13:13.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:11.956918+0000 mgr.smithi067.rdualw (mgr.24569) 5723 : audit [DBG] from='client.46901 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:13:13.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:12.323066+0000 mon.smithi061 (mon.0) 1302 : audit [DBG] from='client.? 172.21.15.61:0/2823817576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:13:13.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:11.659898+0000 mgr.smithi067.rdualw (mgr.24569) 5722 : audit [DBG] from='client.37954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:13:13.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:11.956918+0000 mgr.smithi067.rdualw (mgr.24569) 5723 : audit [DBG] from='client.46901 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:13:13.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:12.323066+0000 mon.smithi061 (mon.0) 1302 : audit [DBG] from='client.? 172.21.15.61:0/2823817576' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:13:14.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:13.056982+0000 mgr.smithi067.rdualw (mgr.24569) 5724 : cluster [DBG] pgmap v4931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:14.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:13.056982+0000 mgr.smithi067.rdualw (mgr.24569) 5724 : cluster [DBG] pgmap v4931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:16.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:15.057619+0000 mgr.smithi067.rdualw (mgr.24569) 5725 : cluster [DBG] pgmap v4932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:16.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:15.057619+0000 mgr.smithi067.rdualw (mgr.24569) 5725 : cluster [DBG] pgmap v4932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:18.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:17.058590+0000 mgr.smithi067.rdualw (mgr.24569) 5726 : cluster [DBG] pgmap v4933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:13:18.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:17.058590+0000 mgr.smithi067.rdualw (mgr.24569) 5726 : cluster [DBG] pgmap v4933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:13:20.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:19.059112+0000 mgr.smithi067.rdualw (mgr.24569) 5727 : cluster [DBG] pgmap v4934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:20.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:19.059112+0000 mgr.smithi067.rdualw (mgr.24569) 5727 : cluster [DBG] pgmap v4934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:21.060178+0000 mgr.smithi067.rdualw (mgr.24569) 5728 : cluster [DBG] pgmap v4935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:21.060178+0000 mgr.smithi067.rdualw (mgr.24569) 5728 : cluster [DBG] pgmap v4935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:24.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:23.060756+0000 mgr.smithi067.rdualw (mgr.24569) 5729 : cluster [DBG] pgmap v4936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:24.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:23.060756+0000 mgr.smithi067.rdualw (mgr.24569) 5729 : cluster [DBG] pgmap v4936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:26.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:25.061397+0000 mgr.smithi067.rdualw (mgr.24569) 5730 : cluster [DBG] pgmap v4937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:26.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:25.061397+0000 mgr.smithi067.rdualw (mgr.24569) 5730 : cluster [DBG] pgmap v4937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:28.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:27.062442+0000 mgr.smithi067.rdualw (mgr.24569) 5731 : cluster [DBG] pgmap v4938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:13:28.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:27.062442+0000 mgr.smithi067.rdualw (mgr.24569) 5731 : cluster [DBG] pgmap v4938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:13:30.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:29.063002+0000 mgr.smithi067.rdualw (mgr.24569) 5732 : cluster [DBG] pgmap v4939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:30.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:29.063002+0000 mgr.smithi067.rdualw (mgr.24569) 5732 : cluster [DBG] pgmap v4939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:31.063847+0000 mgr.smithi067.rdualw (mgr.24569) 5733 : cluster [DBG] pgmap v4940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:32.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:31.063847+0000 mgr.smithi067.rdualw (mgr.24569) 5733 : cluster [DBG] pgmap v4940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:34.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:33.064467+0000 mgr.smithi067.rdualw (mgr.24569) 5734 : cluster [DBG] pgmap v4941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:34.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:33.064467+0000 mgr.smithi067.rdualw (mgr.24569) 5734 : cluster [DBG] pgmap v4941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:35.065068+0000 mgr.smithi067.rdualw (mgr.24569) 5735 : cluster [DBG] pgmap v4942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:35.335840+0000 mon.smithi067 (mon.1) 887 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:13:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:35.336085+0000 mon.smithi067 (mon.1) 888 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:13:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:35.336417+0000 mon.smithi061 (mon.0) 1303 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:13:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:35.336648+0000 mon.smithi061 (mon.0) 1304 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:13:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:35.065068+0000 mgr.smithi067.rdualw (mgr.24569) 5735 : cluster [DBG] pgmap v4942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:35.335840+0000 mon.smithi067 (mon.1) 887 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:13:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:35.336085+0000 mon.smithi067 (mon.1) 888 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:13:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:35.336417+0000 mon.smithi061 (mon.0) 1303 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:13:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:35.336648+0000 mon.smithi061 (mon.0) 1304 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:13:38.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:37.066186+0000 mgr.smithi067.rdualw (mgr.24569) 5736 : cluster [DBG] pgmap v4943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:13:38.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:37.066186+0000 mgr.smithi067.rdualw (mgr.24569) 5736 : cluster [DBG] pgmap v4943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:13:40.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:39.066913+0000 mgr.smithi067.rdualw (mgr.24569) 5737 : cluster [DBG] pgmap v4944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:40.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:39.066913+0000 mgr.smithi067.rdualw (mgr.24569) 5737 : cluster [DBG] pgmap v4944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:41.067888+0000 mgr.smithi067.rdualw (mgr.24569) 5738 : cluster [DBG] pgmap v4945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:41.067888+0000 mgr.smithi067.rdualw (mgr.24569) 5738 : cluster [DBG] pgmap v4945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:42.635 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:13:43.008 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:13:43.008 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 10m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:13:43.008 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 10m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:13:43.009 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 10m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:13:43.009 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 10m ago 2h 41.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:13:43.009 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 10m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:13:43.009 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 10m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:13:43.010 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 10m ago 2h 462M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:13:43.010 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 10m ago 2h 555M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:13:43.010 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 10m ago 2h 1060M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:13:43.010 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 10m ago 2h 554M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:13:43.011 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 10m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:13:43.011 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 10m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:13:43.011 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 10m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:13:43.011 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 10m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:13:43.011 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 10m ago 2h 815M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:13:43.012 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 10m ago 2h 1667M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:13:43.012 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 10m ago 2h 1038M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:13:43.012 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 10m ago 2h 1795M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:13:43.012 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 10m ago 2h 1657M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:13:43.013 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 10m ago 2h 1872M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:13:43.013 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 10m ago 2h 1494M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:13:43.013 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 10m ago 2h 2377M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:13:43.013 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 10m ago 2h 87.9M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:13:43.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:42.596918+0000 mon.smithi067 (mon.1) 889 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:13:43.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:42.598345+0000 mon.smithi067 (mon.1) 890 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:13:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:42.599284+0000 mon.smithi067 (mon.1) 891 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:13:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:13:42.600117+0000 mgr.smithi067.rdualw (mgr.24569) 5739 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:13:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:42.619474+0000 mgr.smithi067.rdualw (mgr.24569) 5740 : audit [DBG] from='client.37966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:13:43.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:42.596918+0000 mon.smithi067 (mon.1) 889 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:13:43.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:42.598345+0000 mon.smithi067 (mon.1) 890 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:13:43.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:42.599284+0000 mon.smithi067 (mon.1) 891 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:13:43.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:13:42.600117+0000 mgr.smithi067.rdualw (mgr.24569) 5739 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:13:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:42.619474+0000 mgr.smithi067.rdualw (mgr.24569) 5740 : audit [DBG] from='client.37966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:13:43.383 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:13:43.383 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:13:43.384 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:13:43.384 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:13:43.384 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:13:43.384 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:13:43.385 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:13:43.385 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:13:43.385 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:13:43.385 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:13:43.386 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:13:43.386 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:13:43.386 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:13:43.386 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:13:43.386 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:13:43.387 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:13:43.387 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:13:43.387 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:13:43.387 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:13:44.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:42.993370+0000 mgr.smithi067.rdualw (mgr.24569) 5741 : audit [DBG] from='client.37970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:13:44.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:43.068316+0000 mgr.smithi067.rdualw (mgr.24569) 5742 : cluster [DBG] pgmap v4946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:43.383440+0000 mon.smithi061 (mon.0) 1305 : audit [DBG] from='client.? 172.21.15.61:0/4052931012' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:13:44.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:42.993370+0000 mgr.smithi067.rdualw (mgr.24569) 5741 : audit [DBG] from='client.37970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:13:44.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:43.068316+0000 mgr.smithi067.rdualw (mgr.24569) 5742 : cluster [DBG] pgmap v4946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:43.383440+0000 mon.smithi061 (mon.0) 1305 : audit [DBG] from='client.? 172.21.15.61:0/4052931012' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:13:46.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:45.068832+0000 mgr.smithi067.rdualw (mgr.24569) 5743 : cluster [DBG] pgmap v4947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:46.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:45.068832+0000 mgr.smithi067.rdualw (mgr.24569) 5743 : cluster [DBG] pgmap v4947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:48.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:47.069579+0000 mgr.smithi067.rdualw (mgr.24569) 5744 : cluster [DBG] pgmap v4948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:13:48.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:47.101375+0000 mon.smithi061 (mon.0) 1306 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:13:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:47.500729+0000 mon.smithi067 (mon.1) 892 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:13:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:47.501213+0000 mon.smithi061 (mon.0) 1307 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:13:48.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:47.069579+0000 mgr.smithi067.rdualw (mgr.24569) 5744 : cluster [DBG] pgmap v4948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:13:48.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:47.101375+0000 mon.smithi061 (mon.0) 1306 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:13:48.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:47.500729+0000 mon.smithi067 (mon.1) 892 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:13:48.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:47.501213+0000 mon.smithi061 (mon.0) 1307 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:13:50.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:49.070309+0000 mgr.smithi067.rdualw (mgr.24569) 5745 : cluster [DBG] pgmap v4949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:50.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:49.858558+0000 mon.smithi061 (mon.0) 1308 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:13:50.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:49.070309+0000 mgr.smithi067.rdualw (mgr.24569) 5745 : cluster [DBG] pgmap v4949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:50.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:49.858558+0000 mon.smithi061 (mon.0) 1308 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:13:51.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:50.175472+0000 mon.smithi067 (mon.1) 893 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:13:51.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:50.176028+0000 mon.smithi061 (mon.0) 1309 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:13:51.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:50.180837+0000 mon.smithi061 (mon.0) 1310 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:13:51.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:13:50.189633+0000 mon.smithi061 (mon.0) 1311 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:13:51.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:50.175472+0000 mon.smithi067 (mon.1) 893 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:13:51.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:50.176028+0000 mon.smithi061 (mon.0) 1309 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:13:51.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:50.180837+0000 mon.smithi061 (mon.0) 1310 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:13:51.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:13:50.189633+0000 mon.smithi061 (mon.0) 1311 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:13:52.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:51.071221+0000 mgr.smithi067.rdualw (mgr.24569) 5746 : cluster [DBG] pgmap v4950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:52.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:51.071221+0000 mgr.smithi067.rdualw (mgr.24569) 5746 : cluster [DBG] pgmap v4950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:54.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:53.071775+0000 mgr.smithi067.rdualw (mgr.24569) 5747 : cluster [DBG] pgmap v4951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:54.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:53.071775+0000 mgr.smithi067.rdualw (mgr.24569) 5747 : cluster [DBG] pgmap v4951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:56.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:55.072474+0000 mgr.smithi067.rdualw (mgr.24569) 5748 : cluster [DBG] pgmap v4952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:56.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:55.072474+0000 mgr.smithi067.rdualw (mgr.24569) 5748 : cluster [DBG] pgmap v4952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:13:58.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:13:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:57.073322+0000 mgr.smithi067.rdualw (mgr.24569) 5749 : cluster [DBG] pgmap v4953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:13:58.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:13:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:57.073322+0000 mgr.smithi067.rdualw (mgr.24569) 5749 : cluster [DBG] pgmap v4953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:14:00.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:13:59.074030+0000 mgr.smithi067.rdualw (mgr.24569) 5750 : cluster [DBG] pgmap v4954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:00.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:13:59.074030+0000 mgr.smithi067.rdualw (mgr.24569) 5750 : cluster [DBG] pgmap v4954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:02.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:01.074955+0000 mgr.smithi067.rdualw (mgr.24569) 5751 : cluster [DBG] pgmap v4955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:02.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:01.074955+0000 mgr.smithi067.rdualw (mgr.24569) 5751 : cluster [DBG] pgmap v4955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:04.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:03.075475+0000 mgr.smithi067.rdualw (mgr.24569) 5752 : cluster [DBG] pgmap v4956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:04.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:03.075475+0000 mgr.smithi067.rdualw (mgr.24569) 5752 : cluster [DBG] pgmap v4956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:06.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:05.076057+0000 mgr.smithi067.rdualw (mgr.24569) 5753 : cluster [DBG] pgmap v4957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:06.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:05.076057+0000 mgr.smithi067.rdualw (mgr.24569) 5753 : cluster [DBG] pgmap v4957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:08.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:07.076938+0000 mgr.smithi067.rdualw (mgr.24569) 5754 : cluster [DBG] pgmap v4958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:14:08.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:07.076938+0000 mgr.smithi067.rdualw (mgr.24569) 5754 : cluster [DBG] pgmap v4958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:14:10.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:09.077528+0000 mgr.smithi067.rdualw (mgr.24569) 5755 : cluster [DBG] pgmap v4959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:10.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:09.077528+0000 mgr.smithi067.rdualw (mgr.24569) 5755 : cluster [DBG] pgmap v4959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:12.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:11.078515+0000 mgr.smithi067.rdualw (mgr.24569) 5756 : cluster [DBG] pgmap v4960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:12.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:11.078515+0000 mgr.smithi067.rdualw (mgr.24569) 5756 : cluster [DBG] pgmap v4960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:13.754 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:14:14.051 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:14:14.052 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 24s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:14:14.052 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 24s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:14:14.052 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 26s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:14:14.052 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 24s ago 2h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:14:14.053 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 24s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:14:14.053 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 26s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:14:14.053 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 24s ago 2h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:14:14.053 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 26s ago 2h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:14:14.054 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 24s ago 2h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:14:14.054 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 26s ago 2h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:14:14.054 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 24s ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:14:14.054 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 26s ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:14:14.055 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 24s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:14:14.055 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 26s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:14:14.055 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 24s ago 2h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:14:14.055 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 24s ago 2h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:14:14.055 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 24s ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:14:14.056 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 24s ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:14:14.056 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 26s ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:14:14.056 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 26s ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:14:14.056 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 26s ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:14:14.057 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 26s ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:14:14.057 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 24s ago 2h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:14:14.392 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:14:14.392 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:14:14.393 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:14:14.393 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:14:14.393 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:14:14.393 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:14:14.394 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:14:14.394 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:14:14.394 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:14:14.394 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:14:14.395 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:14:14.395 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:14:14.395 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:14:14.395 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:14:14.396 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:14:14.396 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:14:14.396 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:14:14.396 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:14:14.397 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:14:14.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:13.079107+0000 mgr.smithi067.rdualw (mgr.24569) 5757 : cluster [DBG] pgmap v4961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:14.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:13.079107+0000 mgr.smithi067.rdualw (mgr.24569) 5757 : cluster [DBG] pgmap v4961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:15.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:14:13.739348+0000 mgr.smithi067.rdualw (mgr.24569) 5758 : audit [DBG] from='client.37978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:14:15.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:14:14.035114+0000 mgr.smithi067.rdualw (mgr.24569) 5759 : audit [DBG] from='client.37982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:14:15.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:14:14.392741+0000 mon.smithi061 (mon.0) 1312 : audit [DBG] from='client.? 172.21.15.61:0/2041433960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:14:15.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:14:13.739348+0000 mgr.smithi067.rdualw (mgr.24569) 5758 : audit [DBG] from='client.37978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:14:15.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:14:14.035114+0000 mgr.smithi067.rdualw (mgr.24569) 5759 : audit [DBG] from='client.37982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:14:15.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:14:14.392741+0000 mon.smithi061 (mon.0) 1312 : audit [DBG] from='client.? 172.21.15.61:0/2041433960' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:14:16.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:15.079743+0000 mgr.smithi067.rdualw (mgr.24569) 5760 : cluster [DBG] pgmap v4962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:16.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:15.079743+0000 mgr.smithi067.rdualw (mgr.24569) 5760 : cluster [DBG] pgmap v4962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:18.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:17.080618+0000 mgr.smithi067.rdualw (mgr.24569) 5761 : cluster [DBG] pgmap v4963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:14:18.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:17.080618+0000 mgr.smithi067.rdualw (mgr.24569) 5761 : cluster [DBG] pgmap v4963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:14:20.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:19.081343+0000 mgr.smithi067.rdualw (mgr.24569) 5762 : cluster [DBG] pgmap v4964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:20.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:19.081343+0000 mgr.smithi067.rdualw (mgr.24569) 5762 : cluster [DBG] pgmap v4964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:21.082351+0000 mgr.smithi067.rdualw (mgr.24569) 5763 : cluster [DBG] pgmap v4965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:21.082351+0000 mgr.smithi067.rdualw (mgr.24569) 5763 : cluster [DBG] pgmap v4965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:24.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:23.082906+0000 mgr.smithi067.rdualw (mgr.24569) 5764 : cluster [DBG] pgmap v4966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:24.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:23.082906+0000 mgr.smithi067.rdualw (mgr.24569) 5764 : cluster [DBG] pgmap v4966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:26.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:25.083525+0000 mgr.smithi067.rdualw (mgr.24569) 5765 : cluster [DBG] pgmap v4967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:26.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:25.083525+0000 mgr.smithi067.rdualw (mgr.24569) 5765 : cluster [DBG] pgmap v4967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:28.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:27.084578+0000 mgr.smithi067.rdualw (mgr.24569) 5766 : cluster [DBG] pgmap v4968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:14:28.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:27.084578+0000 mgr.smithi067.rdualw (mgr.24569) 5766 : cluster [DBG] pgmap v4968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:14:30.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:29.085205+0000 mgr.smithi067.rdualw (mgr.24569) 5767 : cluster [DBG] pgmap v4969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:30.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:29.085205+0000 mgr.smithi067.rdualw (mgr.24569) 5767 : cluster [DBG] pgmap v4969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:32.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:31.086273+0000 mgr.smithi067.rdualw (mgr.24569) 5768 : cluster [DBG] pgmap v4970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:31.086273+0000 mgr.smithi067.rdualw (mgr.24569) 5768 : cluster [DBG] pgmap v4970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:34.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:33.086835+0000 mgr.smithi067.rdualw (mgr.24569) 5769 : cluster [DBG] pgmap v4971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:34.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:33.086835+0000 mgr.smithi067.rdualw (mgr.24569) 5769 : cluster [DBG] pgmap v4971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:35.087592+0000 mgr.smithi067.rdualw (mgr.24569) 5770 : cluster [DBG] pgmap v4972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:14:35.341119+0000 mon.smithi067 (mon.1) 894 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:14:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:14:35.341378+0000 mon.smithi067 (mon.1) 895 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:14:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:14:35.341728+0000 mon.smithi061 (mon.0) 1313 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:14:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:14:35.342120+0000 mon.smithi061 (mon.0) 1314 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:14:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:35.087592+0000 mgr.smithi067.rdualw (mgr.24569) 5770 : cluster [DBG] pgmap v4972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:14:35.341119+0000 mon.smithi067 (mon.1) 894 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:14:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:14:35.341378+0000 mon.smithi067 (mon.1) 895 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:14:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:14:35.341728+0000 mon.smithi061 (mon.0) 1313 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:14:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:14:35.342120+0000 mon.smithi061 (mon.0) 1314 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:14:38.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:37.088493+0000 mgr.smithi067.rdualw (mgr.24569) 5771 : cluster [DBG] pgmap v4973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:14:38.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:37.088493+0000 mgr.smithi067.rdualw (mgr.24569) 5771 : cluster [DBG] pgmap v4973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:14:40.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:39.089208+0000 mgr.smithi067.rdualw (mgr.24569) 5772 : cluster [DBG] pgmap v4974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:40.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:39.089208+0000 mgr.smithi067.rdualw (mgr.24569) 5772 : cluster [DBG] pgmap v4974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:42.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:41.090131+0000 mgr.smithi067.rdualw (mgr.24569) 5773 : cluster [DBG] pgmap v4975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:41.090131+0000 mgr.smithi067.rdualw (mgr.24569) 5773 : cluster [DBG] pgmap v4975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:44.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:43.090804+0000 mgr.smithi067.rdualw (mgr.24569) 5774 : cluster [DBG] pgmap v4976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:44.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:43.090804+0000 mgr.smithi067.rdualw (mgr.24569) 5774 : cluster [DBG] pgmap v4976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:44.726 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:14:45.018 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:14:45.018 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 55s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:14:45.018 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 55s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:14:45.019 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 57s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:14:45.019 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 55s ago 2h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:14:45.019 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 55s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:14:45.019 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 57s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:14:45.020 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 55s ago 2h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:14:45.020 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 57s ago 2h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:14:45.020 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 55s ago 2h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:14:45.020 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 57s ago 2h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:14:45.020 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 55s ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:14:45.021 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 57s ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:14:45.021 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 55s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:14:45.021 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 57s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:14:45.021 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 55s ago 2h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:14:45.022 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 55s ago 2h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:14:45.022 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 55s ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:14:45.022 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 55s ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:14:45.022 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 57s ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:14:45.023 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 57s ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:14:45.023 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 57s ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:14:45.023 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 57s ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:14:45.023 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 55s ago 2h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:14:45.368 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:14:45.368 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:14:45.369 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:14:45.369 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:14:45.369 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:14:45.369 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:14:45.370 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:14:45.370 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:14:45.370 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:14:45.370 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:14:45.371 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:14:45.371 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:14:45.371 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:14:45.371 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:14:45.371 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:14:45.372 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:14:45.372 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:14:45.372 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:14:45.372 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:14:46.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:14:44.715069+0000 mgr.smithi067.rdualw (mgr.24569) 5775 : audit [DBG] from='client.37990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:14:46.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:14:45.001546+0000 mgr.smithi067.rdualw (mgr.24569) 5776 : audit [DBG] from='client.37994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:14:46.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:45.091476+0000 mgr.smithi067.rdualw (mgr.24569) 5777 : cluster [DBG] pgmap v4977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:14:45.368904+0000 mon.smithi061 (mon.0) 1315 : audit [DBG] from='client.? 172.21.15.61:0/1446068235' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:14:46.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:14:44.715069+0000 mgr.smithi067.rdualw (mgr.24569) 5775 : audit [DBG] from='client.37990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:14:46.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:14:45.001546+0000 mgr.smithi067.rdualw (mgr.24569) 5776 : audit [DBG] from='client.37994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:14:46.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:45.091476+0000 mgr.smithi067.rdualw (mgr.24569) 5777 : cluster [DBG] pgmap v4977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:46.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:14:45.368904+0000 mon.smithi061 (mon.0) 1315 : audit [DBG] from='client.? 172.21.15.61:0/1446068235' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:14:48.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:47.092480+0000 mgr.smithi067.rdualw (mgr.24569) 5778 : cluster [DBG] pgmap v4978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:14:48.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:47.092480+0000 mgr.smithi067.rdualw (mgr.24569) 5778 : cluster [DBG] pgmap v4978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:14:50.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:49.093098+0000 mgr.smithi067.rdualw (mgr.24569) 5779 : cluster [DBG] pgmap v4979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:50.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:49.093098+0000 mgr.smithi067.rdualw (mgr.24569) 5779 : cluster [DBG] pgmap v4979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:51.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:14:50.193747+0000 mon.smithi067 (mon.1) 896 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:14:51.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:14:50.195171+0000 mon.smithi067 (mon.1) 897 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:14:51.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:14:50.196080+0000 mon.smithi067 (mon.1) 898 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:14:51.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:14:50.196905+0000 mgr.smithi067.rdualw (mgr.24569) 5780 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:14:51.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:14:50.609311+0000 mon.smithi061 (mon.0) 1316 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:14:51.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:14:50.614636+0000 mon.smithi061 (mon.0) 1317 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:14:51.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:14:50.193747+0000 mon.smithi067 (mon.1) 896 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:14:51.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:14:50.195171+0000 mon.smithi067 (mon.1) 897 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:14:51.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:14:50.196080+0000 mon.smithi067 (mon.1) 898 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:14:51.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:14:50.196905+0000 mgr.smithi067.rdualw (mgr.24569) 5780 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:14:51.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:14:50.609311+0000 mon.smithi061 (mon.0) 1316 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:14:51.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:14:50.614636+0000 mon.smithi061 (mon.0) 1317 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:14:52.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:51.093983+0000 mgr.smithi067.rdualw (mgr.24569) 5781 : cluster [DBG] pgmap v4980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:52.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:51.093983+0000 mgr.smithi067.rdualw (mgr.24569) 5781 : cluster [DBG] pgmap v4980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:54.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:53.094783+0000 mgr.smithi067.rdualw (mgr.24569) 5782 : cluster [DBG] pgmap v4981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:54.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:53.094783+0000 mgr.smithi067.rdualw (mgr.24569) 5782 : cluster [DBG] pgmap v4981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:56.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:55.095561+0000 mgr.smithi067.rdualw (mgr.24569) 5783 : cluster [DBG] pgmap v4982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:56.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:55.095561+0000 mgr.smithi067.rdualw (mgr.24569) 5783 : cluster [DBG] pgmap v4982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:14:58.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:14:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:57.096608+0000 mgr.smithi067.rdualw (mgr.24569) 5784 : cluster [DBG] pgmap v4983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:14:58.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:14:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:57.096608+0000 mgr.smithi067.rdualw (mgr.24569) 5784 : cluster [DBG] pgmap v4983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:15:00.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:14:59.097221+0000 mgr.smithi067.rdualw (mgr.24569) 5785 : cluster [DBG] pgmap v4984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:00.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:14:59.097221+0000 mgr.smithi067.rdualw (mgr.24569) 5785 : cluster [DBG] pgmap v4984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:02.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:01.098287+0000 mgr.smithi067.rdualw (mgr.24569) 5786 : cluster [DBG] pgmap v4985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:01.098287+0000 mgr.smithi067.rdualw (mgr.24569) 5786 : cluster [DBG] pgmap v4985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:04.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:03.098899+0000 mgr.smithi067.rdualw (mgr.24569) 5787 : cluster [DBG] pgmap v4986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:04.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:03.098899+0000 mgr.smithi067.rdualw (mgr.24569) 5787 : cluster [DBG] pgmap v4986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:06.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:05.099639+0000 mgr.smithi067.rdualw (mgr.24569) 5788 : cluster [DBG] pgmap v4987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:06.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:05.099639+0000 mgr.smithi067.rdualw (mgr.24569) 5788 : cluster [DBG] pgmap v4987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:08.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:07.100610+0000 mgr.smithi067.rdualw (mgr.24569) 5789 : cluster [DBG] pgmap v4988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:15:08.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:07.100610+0000 mgr.smithi067.rdualw (mgr.24569) 5789 : cluster [DBG] pgmap v4988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:15:10.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:09.101323+0000 mgr.smithi067.rdualw (mgr.24569) 5790 : cluster [DBG] pgmap v4989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:10.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:09.101323+0000 mgr.smithi067.rdualw (mgr.24569) 5790 : cluster [DBG] pgmap v4989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:12.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:11.102171+0000 mgr.smithi067.rdualw (mgr.24569) 5791 : cluster [DBG] pgmap v4990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:11.102171+0000 mgr.smithi067.rdualw (mgr.24569) 5791 : cluster [DBG] pgmap v4990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:14.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:13.102902+0000 mgr.smithi067.rdualw (mgr.24569) 5792 : cluster [DBG] pgmap v4991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:14.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:13.102902+0000 mgr.smithi067.rdualw (mgr.24569) 5792 : cluster [DBG] pgmap v4991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:15.678 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:15:15.987 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:15:15.987 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 86s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:15:15.988 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 86s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:15:15.988 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 88s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:15:15.988 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 86s ago 2h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:15:15.988 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 86s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:15:15.989 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 88s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:15:15.989 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 86s ago 2h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:15:15.989 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 88s ago 2h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:15:15.989 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 86s ago 2h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:15:15.990 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 88s ago 2h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:15:15.990 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 86s ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:15:15.990 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 88s ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:15:15.990 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 86s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:15:15.991 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 88s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:15:15.991 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 86s ago 2h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:15:15.991 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 86s ago 2h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:15:15.991 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 86s ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:15:15.992 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 86s ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:15:15.992 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 88s ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:15:15.992 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 88s ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:15:15.992 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 88s ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:15:15.993 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 88s ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:15:15.993 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 86s ago 2h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:15:16.338 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:15:16.338 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:15:16.338 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:15:16.339 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:15:16.339 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:15:16.339 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:15:16.339 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:15:16.340 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:15:16.340 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:15:16.340 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:15:16.340 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:15:16.340 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:15:16.341 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:15:16.341 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:15:16.341 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:15:16.341 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:15:16.342 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:15:16.342 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:15:16.342 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:15:16.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:15.103601+0000 mgr.smithi067.rdualw (mgr.24569) 5793 : cluster [DBG] pgmap v4992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:16.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:15.103601+0000 mgr.smithi067.rdualw (mgr.24569) 5793 : cluster [DBG] pgmap v4992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:17.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:15:15.665941+0000 mgr.smithi067.rdualw (mgr.24569) 5794 : audit [DBG] from='client.38002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:15:17.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:15:15.971220+0000 mgr.smithi067.rdualw (mgr.24569) 5795 : audit [DBG] from='client.38006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:15:17.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:15:16.338557+0000 mon.smithi061 (mon.0) 1318 : audit [DBG] from='client.? 172.21.15.61:0/4232292915' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:15:17.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:15:15.665941+0000 mgr.smithi067.rdualw (mgr.24569) 5794 : audit [DBG] from='client.38002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:15:17.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:15:15.971220+0000 mgr.smithi067.rdualw (mgr.24569) 5795 : audit [DBG] from='client.38006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:15:17.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:15:16.338557+0000 mon.smithi061 (mon.0) 1318 : audit [DBG] from='client.? 172.21.15.61:0/4232292915' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:15:18.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:17.104582+0000 mgr.smithi067.rdualw (mgr.24569) 5796 : cluster [DBG] pgmap v4993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:15:18.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:17.104582+0000 mgr.smithi067.rdualw (mgr.24569) 5796 : cluster [DBG] pgmap v4993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:15:20.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:19.105155+0000 mgr.smithi067.rdualw (mgr.24569) 5797 : cluster [DBG] pgmap v4994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:20.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:19.105155+0000 mgr.smithi067.rdualw (mgr.24569) 5797 : cluster [DBG] pgmap v4994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:21.106209+0000 mgr.smithi067.rdualw (mgr.24569) 5798 : cluster [DBG] pgmap v4995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:22.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:21.106209+0000 mgr.smithi067.rdualw (mgr.24569) 5798 : cluster [DBG] pgmap v4995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:24.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:23.106945+0000 mgr.smithi067.rdualw (mgr.24569) 5799 : cluster [DBG] pgmap v4996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:24.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:23.106945+0000 mgr.smithi067.rdualw (mgr.24569) 5799 : cluster [DBG] pgmap v4996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:26.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:25.107681+0000 mgr.smithi067.rdualw (mgr.24569) 5800 : cluster [DBG] pgmap v4997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:26.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:25.107681+0000 mgr.smithi067.rdualw (mgr.24569) 5800 : cluster [DBG] pgmap v4997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:28.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:27.108518+0000 mgr.smithi067.rdualw (mgr.24569) 5801 : cluster [DBG] pgmap v4998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:15:28.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:27.108518+0000 mgr.smithi067.rdualw (mgr.24569) 5801 : cluster [DBG] pgmap v4998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:15:30.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:29.109189+0000 mgr.smithi067.rdualw (mgr.24569) 5802 : cluster [DBG] pgmap v4999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:30.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:29.109189+0000 mgr.smithi067.rdualw (mgr.24569) 5802 : cluster [DBG] pgmap v4999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:32.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:31.110220+0000 mgr.smithi067.rdualw (mgr.24569) 5803 : cluster [DBG] pgmap v5000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:32.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:31.110220+0000 mgr.smithi067.rdualw (mgr.24569) 5803 : cluster [DBG] pgmap v5000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:34.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:33.110894+0000 mgr.smithi067.rdualw (mgr.24569) 5804 : cluster [DBG] pgmap v5001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:34.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:33.110894+0000 mgr.smithi067.rdualw (mgr.24569) 5804 : cluster [DBG] pgmap v5001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:35.111565+0000 mgr.smithi067.rdualw (mgr.24569) 5805 : cluster [DBG] pgmap v5002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:15:35.346900+0000 mon.smithi067 (mon.1) 899 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:15:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:15:35.347152+0000 mon.smithi067 (mon.1) 900 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:15:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:15:35.347591+0000 mon.smithi061 (mon.0) 1319 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:15:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:15:35.348296+0000 mon.smithi061 (mon.0) 1320 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:15:36.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:35.111565+0000 mgr.smithi067.rdualw (mgr.24569) 5805 : cluster [DBG] pgmap v5002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:15:35.346900+0000 mon.smithi067 (mon.1) 899 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:15:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:15:35.347152+0000 mon.smithi067 (mon.1) 900 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:15:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:15:35.347591+0000 mon.smithi061 (mon.0) 1319 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:15:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:15:35.348296+0000 mon.smithi061 (mon.0) 1320 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:15:38.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:37.112502+0000 mgr.smithi067.rdualw (mgr.24569) 5806 : cluster [DBG] pgmap v5003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:15:38.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:37.112502+0000 mgr.smithi067.rdualw (mgr.24569) 5806 : cluster [DBG] pgmap v5003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:15:40.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:39.113187+0000 mgr.smithi067.rdualw (mgr.24569) 5807 : cluster [DBG] pgmap v5004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:40.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:39.113187+0000 mgr.smithi067.rdualw (mgr.24569) 5807 : cluster [DBG] pgmap v5004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:42.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:41.114095+0000 mgr.smithi067.rdualw (mgr.24569) 5808 : cluster [DBG] pgmap v5005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:41.114095+0000 mgr.smithi067.rdualw (mgr.24569) 5808 : cluster [DBG] pgmap v5005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:44.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:43.114607+0000 mgr.smithi067.rdualw (mgr.24569) 5809 : cluster [DBG] pgmap v5006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:44.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:43.114607+0000 mgr.smithi067.rdualw (mgr.24569) 5809 : cluster [DBG] pgmap v5006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:46.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:45.115436+0000 mgr.smithi067.rdualw (mgr.24569) 5810 : cluster [DBG] pgmap v5007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:46.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:45.115436+0000 mgr.smithi067.rdualw (mgr.24569) 5810 : cluster [DBG] pgmap v5007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:46.662 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:15:46.955 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:15:46.955 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 117s ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:15:46.955 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 117s ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:15:46.956 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 119s ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:15:46.956 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 117s ago 2h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:15:46.956 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 117s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:15:46.956 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 119s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:15:46.956 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 117s ago 2h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:15:46.957 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 119s ago 2h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:15:46.957 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 117s ago 2h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:15:46.957 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 119s ago 2h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:15:46.957 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 117s ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:15:46.958 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 119s ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:15:46.958 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 117s ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:15:46.958 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 119s ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:15:46.958 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 117s ago 2h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:15:46.959 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 117s ago 2h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:15:46.959 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 117s ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:15:46.960 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 117s ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:15:46.960 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 119s ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:15:46.960 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 119s ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:15:46.960 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 119s ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:15:46.960 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 119s ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:15:46.961 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 117s ago 2h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:15:47.306 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:15:47.306 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:15:47.307 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:15:47.307 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:15:47.308 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:15:47.308 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:15:47.308 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:15:47.309 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:15:47.309 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:15:47.309 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:15:47.310 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:15:47.310 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:15:47.311 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:15:47.311 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:15:47.311 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:15:47.312 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:15:47.312 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:15:47.312 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:15:47.313 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:15:47.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:15:46.649729+0000 mgr.smithi067.rdualw (mgr.24569) 5811 : audit [DBG] from='client.38014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:15:47.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:15:46.649729+0000 mgr.smithi067.rdualw (mgr.24569) 5811 : audit [DBG] from='client.38014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:15:48.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:15:46.938766+0000 mgr.smithi067.rdualw (mgr.24569) 5812 : audit [DBG] from='client.38018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:15:48.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:47.116353+0000 mgr.smithi067.rdualw (mgr.24569) 5813 : cluster [DBG] pgmap v5008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:15:48.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:15:47.306469+0000 mon.smithi061 (mon.0) 1321 : audit [DBG] from='client.? 172.21.15.61:0/2518485401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:15:48.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:15:46.938766+0000 mgr.smithi067.rdualw (mgr.24569) 5812 : audit [DBG] from='client.38018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:15:48.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:47.116353+0000 mgr.smithi067.rdualw (mgr.24569) 5813 : cluster [DBG] pgmap v5008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:15:48.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:15:47.306469+0000 mon.smithi061 (mon.0) 1321 : audit [DBG] from='client.? 172.21.15.61:0/2518485401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:15:50.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:49.117128+0000 mgr.smithi067.rdualw (mgr.24569) 5814 : cluster [DBG] pgmap v5009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:50.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:49.117128+0000 mgr.smithi067.rdualw (mgr.24569) 5814 : cluster [DBG] pgmap v5009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:51.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:15:50.618432+0000 mon.smithi067 (mon.1) 901 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:15:51.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:15:50.619865+0000 mon.smithi067 (mon.1) 902 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:15:51.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:15:50.620840+0000 mon.smithi067 (mon.1) 903 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:15:51.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:15:50.621766+0000 mgr.smithi067.rdualw (mgr.24569) 5815 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:15:51.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:15:50.981341+0000 mon.smithi061 (mon.0) 1322 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:15:51.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:15:50.987398+0000 mon.smithi061 (mon.0) 1323 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:15:51.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:15:50.618432+0000 mon.smithi067 (mon.1) 901 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:15:51.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:15:50.619865+0000 mon.smithi067 (mon.1) 902 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:15:51.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:15:50.620840+0000 mon.smithi067 (mon.1) 903 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:15:51.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:15:50.621766+0000 mgr.smithi067.rdualw (mgr.24569) 5815 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:15:51.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:15:50.981341+0000 mon.smithi061 (mon.0) 1322 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:15:51.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:15:50.987398+0000 mon.smithi061 (mon.0) 1323 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:15:52.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:51.117887+0000 mgr.smithi067.rdualw (mgr.24569) 5816 : cluster [DBG] pgmap v5010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:52.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:15:51.380385+0000 mon.smithi061 (mon.0) 1324 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:15:52.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:15:51.385748+0000 mon.smithi061 (mon.0) 1325 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:15:52.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:51.117887+0000 mgr.smithi067.rdualw (mgr.24569) 5816 : cluster [DBG] pgmap v5010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:52.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:15:51.380385+0000 mon.smithi061 (mon.0) 1324 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:15:52.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:15:51.385748+0000 mon.smithi061 (mon.0) 1325 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:15:54.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:53.118466+0000 mgr.smithi067.rdualw (mgr.24569) 5817 : cluster [DBG] pgmap v5011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:54.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:53.118466+0000 mgr.smithi067.rdualw (mgr.24569) 5817 : cluster [DBG] pgmap v5011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:56.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:55.119020+0000 mgr.smithi067.rdualw (mgr.24569) 5818 : cluster [DBG] pgmap v5012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:56.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:55.119020+0000 mgr.smithi067.rdualw (mgr.24569) 5818 : cluster [DBG] pgmap v5012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:15:58.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:15:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:57.120100+0000 mgr.smithi067.rdualw (mgr.24569) 5819 : cluster [DBG] pgmap v5013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:15:58.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:15:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:57.120100+0000 mgr.smithi067.rdualw (mgr.24569) 5819 : cluster [DBG] pgmap v5013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:16:00.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:15:59.120711+0000 mgr.smithi067.rdualw (mgr.24569) 5820 : cluster [DBG] pgmap v5014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:00.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:15:59.120711+0000 mgr.smithi067.rdualw (mgr.24569) 5820 : cluster [DBG] pgmap v5014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:01.121668+0000 mgr.smithi067.rdualw (mgr.24569) 5821 : cluster [DBG] pgmap v5015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:02.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:01.121668+0000 mgr.smithi067.rdualw (mgr.24569) 5821 : cluster [DBG] pgmap v5015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:04.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:03.122353+0000 mgr.smithi067.rdualw (mgr.24569) 5822 : cluster [DBG] pgmap v5016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:04.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:03.122353+0000 mgr.smithi067.rdualw (mgr.24569) 5822 : cluster [DBG] pgmap v5016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:06.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:05.122972+0000 mgr.smithi067.rdualw (mgr.24569) 5823 : cluster [DBG] pgmap v5017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:06.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:05.122972+0000 mgr.smithi067.rdualw (mgr.24569) 5823 : cluster [DBG] pgmap v5017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:08.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:07.123971+0000 mgr.smithi067.rdualw (mgr.24569) 5824 : cluster [DBG] pgmap v5018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:16:08.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:07.123971+0000 mgr.smithi067.rdualw (mgr.24569) 5824 : cluster [DBG] pgmap v5018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:16:10.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:09.124573+0000 mgr.smithi067.rdualw (mgr.24569) 5825 : cluster [DBG] pgmap v5019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:10.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:09.124573+0000 mgr.smithi067.rdualw (mgr.24569) 5825 : cluster [DBG] pgmap v5019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:11.125519+0000 mgr.smithi067.rdualw (mgr.24569) 5826 : cluster [DBG] pgmap v5020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:12.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:11.125519+0000 mgr.smithi067.rdualw (mgr.24569) 5826 : cluster [DBG] pgmap v5020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:14.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:13.126254+0000 mgr.smithi067.rdualw (mgr.24569) 5827 : cluster [DBG] pgmap v5021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:14.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:13.126254+0000 mgr.smithi067.rdualw (mgr.24569) 5827 : cluster [DBG] pgmap v5021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:16.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:15.126895+0000 mgr.smithi067.rdualw (mgr.24569) 5828 : cluster [DBG] pgmap v5022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:16.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:15.126895+0000 mgr.smithi067.rdualw (mgr.24569) 5828 : cluster [DBG] pgmap v5022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:17.618 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:16:17.920 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:16:17.920 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 2m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:16:17.920 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 2m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:16:17.921 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 2m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:16:17.921 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 2m ago 2h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:16:17.921 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 2m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:16:17.921 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 2m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:16:17.922 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 2m ago 2h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:16:17.922 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 2m ago 2h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:16:17.922 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 2m ago 2h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:16:17.922 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 2m ago 2h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:16:17.923 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 2m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:16:17.924 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 2m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:16:17.924 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 2m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:16:17.924 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 2m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:16:17.925 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 2m ago 2h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:16:17.925 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 2m ago 2h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:16:17.925 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 2m ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:16:17.925 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 2m ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:16:17.926 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 2m ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:16:17.926 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 2m ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:16:17.926 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 2m ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:16:17.926 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 2m ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:16:17.927 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 2m ago 2h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:16:18.263 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:16:18.263 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:16:18.263 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:16:18.264 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:16:18.264 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:16:18.264 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:16:18.264 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:16:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:16:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:16:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:16:18.265 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:16:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:16:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:16:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:16:18.266 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:16:18.267 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:16:18.267 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:16:18.267 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:16:18.268 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:16:18.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:17.127831+0000 mgr.smithi067.rdualw (mgr.24569) 5829 : cluster [DBG] pgmap v5023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:16:18.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:16:17.606374+0000 mgr.smithi067.rdualw (mgr.24569) 5830 : audit [DBG] from='client.38026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:16:18.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:17.127831+0000 mgr.smithi067.rdualw (mgr.24569) 5829 : cluster [DBG] pgmap v5023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:16:18.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:16:17.606374+0000 mgr.smithi067.rdualw (mgr.24569) 5830 : audit [DBG] from='client.38026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:16:19.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:16:17.903812+0000 mgr.smithi067.rdualw (mgr.24569) 5831 : audit [DBG] from='client.38030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:16:19.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:16:18.263657+0000 mon.smithi061 (mon.0) 1326 : audit [DBG] from='client.? 172.21.15.61:0/433206620' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:16:19.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:16:17.903812+0000 mgr.smithi067.rdualw (mgr.24569) 5831 : audit [DBG] from='client.38030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:16:19.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:16:18.263657+0000 mon.smithi061 (mon.0) 1326 : audit [DBG] from='client.? 172.21.15.61:0/433206620' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:16:20.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:19.128425+0000 mgr.smithi067.rdualw (mgr.24569) 5832 : cluster [DBG] pgmap v5024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:20.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:19.128425+0000 mgr.smithi067.rdualw (mgr.24569) 5832 : cluster [DBG] pgmap v5024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:22.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:21.129309+0000 mgr.smithi067.rdualw (mgr.24569) 5833 : cluster [DBG] pgmap v5025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:22.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:21.129309+0000 mgr.smithi067.rdualw (mgr.24569) 5833 : cluster [DBG] pgmap v5025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:24.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:23.129892+0000 mgr.smithi067.rdualw (mgr.24569) 5834 : cluster [DBG] pgmap v5026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:24.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:23.129892+0000 mgr.smithi067.rdualw (mgr.24569) 5834 : cluster [DBG] pgmap v5026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:26.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:25.130608+0000 mgr.smithi067.rdualw (mgr.24569) 5835 : cluster [DBG] pgmap v5027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:26.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:25.130608+0000 mgr.smithi067.rdualw (mgr.24569) 5835 : cluster [DBG] pgmap v5027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:28.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:27.131499+0000 mgr.smithi067.rdualw (mgr.24569) 5836 : cluster [DBG] pgmap v5028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:16:28.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:27.131499+0000 mgr.smithi067.rdualw (mgr.24569) 5836 : cluster [DBG] pgmap v5028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:16:30.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:29.132147+0000 mgr.smithi067.rdualw (mgr.24569) 5837 : cluster [DBG] pgmap v5029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:30.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:29.132147+0000 mgr.smithi067.rdualw (mgr.24569) 5837 : cluster [DBG] pgmap v5029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:32.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:31.133164+0000 mgr.smithi067.rdualw (mgr.24569) 5838 : cluster [DBG] pgmap v5030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:32.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:31.133164+0000 mgr.smithi067.rdualw (mgr.24569) 5838 : cluster [DBG] pgmap v5030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:34.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:33.133855+0000 mgr.smithi067.rdualw (mgr.24569) 5839 : cluster [DBG] pgmap v5031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:34.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:33.133855+0000 mgr.smithi067.rdualw (mgr.24569) 5839 : cluster [DBG] pgmap v5031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:36.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:35.134523+0000 mgr.smithi067.rdualw (mgr.24569) 5840 : cluster [DBG] pgmap v5032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:36.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:16:35.352335+0000 mon.smithi067 (mon.1) 904 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:16:36.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:16:35.352598+0000 mon.smithi067 (mon.1) 905 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:16:36.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:16:35.352738+0000 mon.smithi061 (mon.0) 1327 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:16:36.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:16:35.353115+0000 mon.smithi061 (mon.0) 1328 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:16:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:35.134523+0000 mgr.smithi067.rdualw (mgr.24569) 5840 : cluster [DBG] pgmap v5032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:16:35.352335+0000 mon.smithi067 (mon.1) 904 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:16:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:16:35.352598+0000 mon.smithi067 (mon.1) 905 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:16:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:16:35.352738+0000 mon.smithi061 (mon.0) 1327 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:16:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:16:35.353115+0000 mon.smithi061 (mon.0) 1328 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:16:38.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:37.135529+0000 mgr.smithi067.rdualw (mgr.24569) 5841 : cluster [DBG] pgmap v5033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:16:38.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:37.135529+0000 mgr.smithi067.rdualw (mgr.24569) 5841 : cluster [DBG] pgmap v5033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:16:40.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:39.136126+0000 mgr.smithi067.rdualw (mgr.24569) 5842 : cluster [DBG] pgmap v5034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:40.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:39.136126+0000 mgr.smithi067.rdualw (mgr.24569) 5842 : cluster [DBG] pgmap v5034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:42.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:41.137208+0000 mgr.smithi067.rdualw (mgr.24569) 5843 : cluster [DBG] pgmap v5035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:41.137208+0000 mgr.smithi067.rdualw (mgr.24569) 5843 : cluster [DBG] pgmap v5035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:44.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:43.137812+0000 mgr.smithi067.rdualw (mgr.24569) 5844 : cluster [DBG] pgmap v5036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:44.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:43.137812+0000 mgr.smithi067.rdualw (mgr.24569) 5844 : cluster [DBG] pgmap v5036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:46.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:45.138575+0000 mgr.smithi067.rdualw (mgr.24569) 5845 : cluster [DBG] pgmap v5037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:46.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:45.138575+0000 mgr.smithi067.rdualw (mgr.24569) 5845 : cluster [DBG] pgmap v5037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:48.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:47.139432+0000 mgr.smithi067.rdualw (mgr.24569) 5846 : cluster [DBG] pgmap v5038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:16:48.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:47.139432+0000 mgr.smithi067.rdualw (mgr.24569) 5846 : cluster [DBG] pgmap v5038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:16:48.571 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:16:48.861 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:16:48.862 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 2m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:16:48.862 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 2m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:16:48.862 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 3m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:16:48.862 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 2m ago 2h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:16:48.863 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 2m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:16:48.863 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 3m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:16:48.863 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 2m ago 2h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:16:48.863 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 3m ago 2h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:16:48.863 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 2m ago 2h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:16:48.864 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 3m ago 2h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:16:48.864 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 2m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:16:48.864 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 3m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:16:48.864 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 2m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:16:48.865 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 3m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:16:48.865 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 2m ago 2h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:16:48.865 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 2m ago 2h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:16:48.865 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 2m ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:16:48.866 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 2m ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:16:48.866 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 3m ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:16:48.866 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 3m ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:16:48.866 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 3m ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:16:48.866 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 3m ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:16:48.867 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 2m ago 2h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:16:49.202 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:16:49.202 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:16:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:16:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:16:49.203 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:16:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:16:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:16:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:16:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:16:49.204 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:16:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:16:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:16:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:16:49.205 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:16:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:16:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:16:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:16:49.206 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:16:49.206 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:16:49.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:16:48.559163+0000 mgr.smithi067.rdualw (mgr.24569) 5847 : audit [DBG] from='client.38038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:16:49.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:16:48.559163+0000 mgr.smithi067.rdualw (mgr.24569) 5847 : audit [DBG] from='client.38038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:16:50.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:16:48.845675+0000 mgr.smithi067.rdualw (mgr.24569) 5848 : audit [DBG] from='client.38042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:16:50.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:49.140004+0000 mgr.smithi067.rdualw (mgr.24569) 5849 : cluster [DBG] pgmap v5039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:50.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:16:49.202785+0000 mon.smithi061 (mon.0) 1329 : audit [DBG] from='client.? 172.21.15.61:0/2285209187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:16:50.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:16:48.845675+0000 mgr.smithi067.rdualw (mgr.24569) 5848 : audit [DBG] from='client.38042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:16:50.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:49.140004+0000 mgr.smithi067.rdualw (mgr.24569) 5849 : cluster [DBG] pgmap v5039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:50.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:16:49.202785+0000 mon.smithi061 (mon.0) 1329 : audit [DBG] from='client.? 172.21.15.61:0/2285209187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:16:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:51.140830+0000 mgr.smithi067.rdualw (mgr.24569) 5850 : cluster [DBG] pgmap v5040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:16:51.388997+0000 mon.smithi067 (mon.1) 906 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:16:52.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:16:51.390490+0000 mon.smithi067 (mon.1) 907 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:16:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:16:51.391449+0000 mon.smithi067 (mon.1) 908 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:16:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:16:51.392330+0000 mgr.smithi067.rdualw (mgr.24569) 5851 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:16:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:51.140830+0000 mgr.smithi067.rdualw (mgr.24569) 5850 : cluster [DBG] pgmap v5040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:16:51.388997+0000 mon.smithi067 (mon.1) 906 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:16:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:16:51.390490+0000 mon.smithi067 (mon.1) 907 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:16:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:16:51.391449+0000 mon.smithi067 (mon.1) 908 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:16:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:16:51.392330+0000 mgr.smithi067.rdualw (mgr.24569) 5851 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:16:53.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:16:51.806086+0000 mon.smithi061 (mon.0) 1330 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:16:53.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:16:51.811701+0000 mon.smithi061 (mon.0) 1331 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:16:53.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:16:51.806086+0000 mon.smithi061 (mon.0) 1330 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:16:53.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:16:51.811701+0000 mon.smithi061 (mon.0) 1331 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:16:54.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:53.141357+0000 mgr.smithi067.rdualw (mgr.24569) 5852 : cluster [DBG] pgmap v5041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:54.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:53.141357+0000 mgr.smithi067.rdualw (mgr.24569) 5852 : cluster [DBG] pgmap v5041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:56.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:55.142096+0000 mgr.smithi067.rdualw (mgr.24569) 5853 : cluster [DBG] pgmap v5042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:56.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:55.142096+0000 mgr.smithi067.rdualw (mgr.24569) 5853 : cluster [DBG] pgmap v5042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:16:58.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:16:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:57.143002+0000 mgr.smithi067.rdualw (mgr.24569) 5854 : cluster [DBG] pgmap v5043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:16:58.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:16:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:57.143002+0000 mgr.smithi067.rdualw (mgr.24569) 5854 : cluster [DBG] pgmap v5043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:17:00.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:16:59.143564+0000 mgr.smithi067.rdualw (mgr.24569) 5855 : cluster [DBG] pgmap v5044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:00.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:16:59.143564+0000 mgr.smithi067.rdualw (mgr.24569) 5855 : cluster [DBG] pgmap v5044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:02.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:01.144372+0000 mgr.smithi067.rdualw (mgr.24569) 5856 : cluster [DBG] pgmap v5045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:02.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:01.144372+0000 mgr.smithi067.rdualw (mgr.24569) 5856 : cluster [DBG] pgmap v5045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:04.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:03.145033+0000 mgr.smithi067.rdualw (mgr.24569) 5857 : cluster [DBG] pgmap v5046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:04.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:03.145033+0000 mgr.smithi067.rdualw (mgr.24569) 5857 : cluster [DBG] pgmap v5046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:06.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:05.145769+0000 mgr.smithi067.rdualw (mgr.24569) 5858 : cluster [DBG] pgmap v5047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:06.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:05.145769+0000 mgr.smithi067.rdualw (mgr.24569) 5858 : cluster [DBG] pgmap v5047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:08.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:07.146599+0000 mgr.smithi067.rdualw (mgr.24569) 5859 : cluster [DBG] pgmap v5048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:17:08.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:07.146599+0000 mgr.smithi067.rdualw (mgr.24569) 5859 : cluster [DBG] pgmap v5048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:17:10.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:09.147237+0000 mgr.smithi067.rdualw (mgr.24569) 5860 : cluster [DBG] pgmap v5049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:10.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:09.147237+0000 mgr.smithi067.rdualw (mgr.24569) 5860 : cluster [DBG] pgmap v5049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:12.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:11.148079+0000 mgr.smithi067.rdualw (mgr.24569) 5861 : cluster [DBG] pgmap v5050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:11.148079+0000 mgr.smithi067.rdualw (mgr.24569) 5861 : cluster [DBG] pgmap v5050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:14.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:13.148542+0000 mgr.smithi067.rdualw (mgr.24569) 5862 : cluster [DBG] pgmap v5051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:14.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:13.148542+0000 mgr.smithi067.rdualw (mgr.24569) 5862 : cluster [DBG] pgmap v5051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:16.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:15.149098+0000 mgr.smithi067.rdualw (mgr.24569) 5863 : cluster [DBG] pgmap v5052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:16.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:15.149098+0000 mgr.smithi067.rdualw (mgr.24569) 5863 : cluster [DBG] pgmap v5052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:18.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:17.150111+0000 mgr.smithi067.rdualw (mgr.24569) 5864 : cluster [DBG] pgmap v5053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:17:18.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:17.150111+0000 mgr.smithi067.rdualw (mgr.24569) 5864 : cluster [DBG] pgmap v5053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:17:19.516 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:17:19.806 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:17:19.807 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 3m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:17:19.807 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 3m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:17:19.807 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 3m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:17:19.808 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 3m ago 2h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:17:19.808 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 3m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:17:19.808 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 3m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:17:19.808 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 3m ago 2h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:17:19.808 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 3m ago 2h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:17:19.809 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 3m ago 2h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:17:19.809 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 3m ago 2h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:17:19.809 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 3m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:17:19.809 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 3m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:17:19.810 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 3m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:17:19.810 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 3m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:17:19.810 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 3m ago 2h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:17:19.810 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 3m ago 2h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:17:19.810 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 3m ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:17:19.811 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 3m ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:17:19.811 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 3m ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:17:19.811 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 3m ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:17:19.811 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 3m ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:17:19.811 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 3m ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:17:19.812 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 3m ago 2h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:17:20.150 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:17:20.151 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:17:20.151 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:17:20.151 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:17:20.152 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:17:20.152 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:17:20.152 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:17:20.153 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:17:20.153 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:17:20.153 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:17:20.154 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:17:20.154 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:17:20.154 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:17:20.155 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:17:20.155 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:17:20.155 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:17:20.155 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:17:20.155 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:17:20.156 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:17:20.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:19.150759+0000 mgr.smithi067.rdualw (mgr.24569) 5865 : cluster [DBG] pgmap v5054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:20.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:17:19.504339+0000 mgr.smithi067.rdualw (mgr.24569) 5866 : audit [DBG] from='client.38050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:17:20.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:17:20.151205+0000 mon.smithi061 (mon.0) 1332 : audit [DBG] from='client.? 172.21.15.61:0/3855004100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:17:20.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:19.150759+0000 mgr.smithi067.rdualw (mgr.24569) 5865 : cluster [DBG] pgmap v5054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:20.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:17:19.504339+0000 mgr.smithi067.rdualw (mgr.24569) 5866 : audit [DBG] from='client.38050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:17:20.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:17:20.151205+0000 mon.smithi061 (mon.0) 1332 : audit [DBG] from='client.? 172.21.15.61:0/3855004100' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:17:21.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:17:19.791307+0000 mgr.smithi067.rdualw (mgr.24569) 5867 : audit [DBG] from='client.38054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:17:21.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:17:19.791307+0000 mgr.smithi067.rdualw (mgr.24569) 5867 : audit [DBG] from='client.38054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:17:22.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:21.151616+0000 mgr.smithi067.rdualw (mgr.24569) 5868 : cluster [DBG] pgmap v5055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:22.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:21.151616+0000 mgr.smithi067.rdualw (mgr.24569) 5868 : cluster [DBG] pgmap v5055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:24.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:23.152128+0000 mgr.smithi067.rdualw (mgr.24569) 5869 : cluster [DBG] pgmap v5056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:24.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:23.152128+0000 mgr.smithi067.rdualw (mgr.24569) 5869 : cluster [DBG] pgmap v5056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:26.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:25.152856+0000 mgr.smithi067.rdualw (mgr.24569) 5870 : cluster [DBG] pgmap v5057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:26.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:25.152856+0000 mgr.smithi067.rdualw (mgr.24569) 5870 : cluster [DBG] pgmap v5057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:28.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:27.153712+0000 mgr.smithi067.rdualw (mgr.24569) 5871 : cluster [DBG] pgmap v5058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:17:28.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:27.153712+0000 mgr.smithi067.rdualw (mgr.24569) 5871 : cluster [DBG] pgmap v5058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:17:30.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:29.154416+0000 mgr.smithi067.rdualw (mgr.24569) 5872 : cluster [DBG] pgmap v5059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:30.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:29.154416+0000 mgr.smithi067.rdualw (mgr.24569) 5872 : cluster [DBG] pgmap v5059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:32.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:31.155304+0000 mgr.smithi067.rdualw (mgr.24569) 5873 : cluster [DBG] pgmap v5060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:32.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:31.155304+0000 mgr.smithi067.rdualw (mgr.24569) 5873 : cluster [DBG] pgmap v5060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:34.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:33.155909+0000 mgr.smithi067.rdualw (mgr.24569) 5874 : cluster [DBG] pgmap v5061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:34.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:33.155909+0000 mgr.smithi067.rdualw (mgr.24569) 5874 : cluster [DBG] pgmap v5061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:36.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:35.156702+0000 mgr.smithi067.rdualw (mgr.24569) 5875 : cluster [DBG] pgmap v5062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:17:35.358527+0000 mon.smithi067 (mon.1) 909 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:17:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:17:35.358788+0000 mon.smithi067 (mon.1) 910 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:17:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:17:35.358959+0000 mon.smithi061 (mon.0) 1333 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:17:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:17:35.359263+0000 mon.smithi061 (mon.0) 1334 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:17:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:35.156702+0000 mgr.smithi067.rdualw (mgr.24569) 5875 : cluster [DBG] pgmap v5062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:17:35.358527+0000 mon.smithi067 (mon.1) 909 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:17:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:17:35.358788+0000 mon.smithi067 (mon.1) 910 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:17:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:17:35.358959+0000 mon.smithi061 (mon.0) 1333 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:17:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:17:35.359263+0000 mon.smithi061 (mon.0) 1334 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:17:38.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:37.157687+0000 mgr.smithi067.rdualw (mgr.24569) 5876 : cluster [DBG] pgmap v5063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:17:38.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:37.157687+0000 mgr.smithi067.rdualw (mgr.24569) 5876 : cluster [DBG] pgmap v5063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:17:40.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:39.158324+0000 mgr.smithi067.rdualw (mgr.24569) 5877 : cluster [DBG] pgmap v5064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:40.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:39.158324+0000 mgr.smithi067.rdualw (mgr.24569) 5877 : cluster [DBG] pgmap v5064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:41.159340+0000 mgr.smithi067.rdualw (mgr.24569) 5878 : cluster [DBG] pgmap v5065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:41.159340+0000 mgr.smithi067.rdualw (mgr.24569) 5878 : cluster [DBG] pgmap v5065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:44.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:43.160039+0000 mgr.smithi067.rdualw (mgr.24569) 5879 : cluster [DBG] pgmap v5066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:44.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:43.160039+0000 mgr.smithi067.rdualw (mgr.24569) 5879 : cluster [DBG] pgmap v5066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:46.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:45.160813+0000 mgr.smithi067.rdualw (mgr.24569) 5880 : cluster [DBG] pgmap v5067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:46.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:45.160813+0000 mgr.smithi067.rdualw (mgr.24569) 5880 : cluster [DBG] pgmap v5067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:47.161729+0000 mgr.smithi067.rdualw (mgr.24569) 5881 : cluster [DBG] pgmap v5068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:17:48.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:47.161729+0000 mgr.smithi067.rdualw (mgr.24569) 5881 : cluster [DBG] pgmap v5068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:17:50.462 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:17:50.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:49.162322+0000 mgr.smithi067.rdualw (mgr.24569) 5882 : cluster [DBG] pgmap v5069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:50.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:49.162322+0000 mgr.smithi067.rdualw (mgr.24569) 5882 : cluster [DBG] pgmap v5069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:50.793 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:17:50.794 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 4m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:17:50.794 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 4m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:17:50.794 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 4m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:17:50.794 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 4m ago 2h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:17:50.795 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 4m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:17:50.795 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 4m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:17:50.795 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 4m ago 2h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:17:50.795 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 4m ago 2h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:17:50.795 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 4m ago 2h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:17:50.796 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 4m ago 2h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:17:50.796 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 4m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:17:50.796 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 4m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:17:50.796 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 4m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:17:50.797 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 4m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:17:50.797 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 4m ago 2h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:17:50.797 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 4m ago 2h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:17:50.797 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 4m ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:17:50.797 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 4m ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:17:50.798 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 4m ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:17:50.798 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 4m ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:17:50.798 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 4m ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:17:50.798 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 4m ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:17:50.799 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 4m ago 2h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:17:51.194 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:17:51.194 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:17:51.195 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:17:51.195 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:17:51.196 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:17:51.196 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:17:51.196 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:17:51.197 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:17:51.197 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:17:51.198 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:17:51.198 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:17:51.199 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:17:51.199 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:17:51.199 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:17:51.200 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:17:51.200 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:17:51.200 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:17:51.201 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:17:51.201 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:17:51.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:17:50.450379+0000 mgr.smithi067.rdualw (mgr.24569) 5883 : audit [DBG] from='client.38062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:17:51.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:17:51.193551+0000 mon.smithi061 (mon.0) 1335 : audit [DBG] from='client.? 172.21.15.61:0/1532356390' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:17:51.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:17:50.450379+0000 mgr.smithi067.rdualw (mgr.24569) 5883 : audit [DBG] from='client.38062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:17:51.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:17:51.193551+0000 mon.smithi061 (mon.0) 1335 : audit [DBG] from='client.? 172.21.15.61:0/1532356390' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:17:52.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:17:50.777596+0000 mgr.smithi067.rdualw (mgr.24569) 5884 : audit [DBG] from='client.38066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:17:52.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:51.163288+0000 mgr.smithi067.rdualw (mgr.24569) 5885 : cluster [DBG] pgmap v5070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:52.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:17:51.815100+0000 mon.smithi067 (mon.1) 911 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:17:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:17:51.816504+0000 mon.smithi067 (mon.1) 912 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:17:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:17:51.817409+0000 mon.smithi067 (mon.1) 913 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:17:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:17:52.224213+0000 mon.smithi061 (mon.0) 1336 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:17:52.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:17:50.777596+0000 mgr.smithi067.rdualw (mgr.24569) 5884 : audit [DBG] from='client.38066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:17:52.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:51.163288+0000 mgr.smithi067.rdualw (mgr.24569) 5885 : cluster [DBG] pgmap v5070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:52.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:17:51.815100+0000 mon.smithi067 (mon.1) 911 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:17:52.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:17:51.816504+0000 mon.smithi067 (mon.1) 912 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:17:52.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:17:51.817409+0000 mon.smithi067 (mon.1) 913 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:17:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:17:52.224213+0000 mon.smithi061 (mon.0) 1336 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:17:53.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:17:51.818240+0000 mgr.smithi067.rdualw (mgr.24569) 5886 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:17:53.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:17:52.230716+0000 mon.smithi061 (mon.0) 1337 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:17:53.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:17:51.818240+0000 mgr.smithi067.rdualw (mgr.24569) 5886 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:17:53.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:17:52.230716+0000 mon.smithi061 (mon.0) 1337 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:17:54.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:53.163882+0000 mgr.smithi067.rdualw (mgr.24569) 5887 : cluster [DBG] pgmap v5071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:54.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:53.163882+0000 mgr.smithi067.rdualw (mgr.24569) 5887 : cluster [DBG] pgmap v5071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:56.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:55.164504+0000 mgr.smithi067.rdualw (mgr.24569) 5888 : cluster [DBG] pgmap v5072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:56.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:55.164504+0000 mgr.smithi067.rdualw (mgr.24569) 5888 : cluster [DBG] pgmap v5072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:17:58.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:17:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:57.165522+0000 mgr.smithi067.rdualw (mgr.24569) 5889 : cluster [DBG] pgmap v5073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:17:58.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:17:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:57.165522+0000 mgr.smithi067.rdualw (mgr.24569) 5889 : cluster [DBG] pgmap v5073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:18:00.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:17:59.166209+0000 mgr.smithi067.rdualw (mgr.24569) 5890 : cluster [DBG] pgmap v5074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:00.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:17:59.166209+0000 mgr.smithi067.rdualw (mgr.24569) 5890 : cluster [DBG] pgmap v5074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:02.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:01.167238+0000 mgr.smithi067.rdualw (mgr.24569) 5891 : cluster [DBG] pgmap v5075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:02.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:01.167238+0000 mgr.smithi067.rdualw (mgr.24569) 5891 : cluster [DBG] pgmap v5075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:04.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:03.167865+0000 mgr.smithi067.rdualw (mgr.24569) 5892 : cluster [DBG] pgmap v5076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:04.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:03.167865+0000 mgr.smithi067.rdualw (mgr.24569) 5892 : cluster [DBG] pgmap v5076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:06.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:05.168497+0000 mgr.smithi067.rdualw (mgr.24569) 5893 : cluster [DBG] pgmap v5077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:06.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:05.168497+0000 mgr.smithi067.rdualw (mgr.24569) 5893 : cluster [DBG] pgmap v5077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:08.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:07.169356+0000 mgr.smithi067.rdualw (mgr.24569) 5894 : cluster [DBG] pgmap v5078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:18:08.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:07.169356+0000 mgr.smithi067.rdualw (mgr.24569) 5894 : cluster [DBG] pgmap v5078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:18:10.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:09.169982+0000 mgr.smithi067.rdualw (mgr.24569) 5895 : cluster [DBG] pgmap v5079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:10.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:09.169982+0000 mgr.smithi067.rdualw (mgr.24569) 5895 : cluster [DBG] pgmap v5079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:12.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:11.170885+0000 mgr.smithi067.rdualw (mgr.24569) 5896 : cluster [DBG] pgmap v5080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:12.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:11.170885+0000 mgr.smithi067.rdualw (mgr.24569) 5896 : cluster [DBG] pgmap v5080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:14.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:13.171679+0000 mgr.smithi067.rdualw (mgr.24569) 5897 : cluster [DBG] pgmap v5081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:14.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:13.171679+0000 mgr.smithi067.rdualw (mgr.24569) 5897 : cluster [DBG] pgmap v5081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:16.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:15.172340+0000 mgr.smithi067.rdualw (mgr.24569) 5898 : cluster [DBG] pgmap v5082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:16.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:15.172340+0000 mgr.smithi067.rdualw (mgr.24569) 5898 : cluster [DBG] pgmap v5082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:18.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:17.173329+0000 mgr.smithi067.rdualw (mgr.24569) 5899 : cluster [DBG] pgmap v5083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:18:18.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:17.173329+0000 mgr.smithi067.rdualw (mgr.24569) 5899 : cluster [DBG] pgmap v5083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:18:20.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:19.173922+0000 mgr.smithi067.rdualw (mgr.24569) 5900 : cluster [DBG] pgmap v5084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:20.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:19.173922+0000 mgr.smithi067.rdualw (mgr.24569) 5900 : cluster [DBG] pgmap v5084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:21.502 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:18:21.829 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:18:21.829 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 4m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:18:21.829 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 4m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:18:21.830 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 4m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:18:21.830 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 4m ago 2h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:18:21.830 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 4m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:18:21.830 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 4m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:18:21.831 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 4m ago 2h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:18:21.831 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 4m ago 2h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:18:21.831 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 4m ago 2h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:18:21.831 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 4m ago 2h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:18:21.832 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 4m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:18:21.832 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 4m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:18:21.832 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 4m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:18:21.833 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 4m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:18:21.833 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 4m ago 2h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:18:21.833 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 4m ago 2h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:18:21.833 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 4m ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:18:21.833 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 4m ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:18:21.834 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 4m ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:18:21.834 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 4m ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:18:21.834 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 4m ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:18:21.835 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 4m ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:18:21.835 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 4m ago 2h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:18:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:21.174735+0000 mgr.smithi067.rdualw (mgr.24569) 5901 : cluster [DBG] pgmap v5085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:18:21.490752+0000 mgr.smithi067.rdualw (mgr.24569) 5902 : audit [DBG] from='client.38074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:18:22.170 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:18:22.170 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:18:22.171 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:18:22.171 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:18:22.171 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:18:22.171 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:18:22.172 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:18:22.172 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:18:22.172 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:18:22.172 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:18:22.172 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:18:22.173 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:18:22.173 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:18:22.173 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:18:22.173 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:18:22.174 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:18:22.174 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:18:22.174 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:18:22.174 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:18:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:21.174735+0000 mgr.smithi067.rdualw (mgr.24569) 5901 : cluster [DBG] pgmap v5085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:22.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:18:21.490752+0000 mgr.smithi067.rdualw (mgr.24569) 5902 : audit [DBG] from='client.38074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:18:23.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:18:21.812828+0000 mgr.smithi067.rdualw (mgr.24569) 5903 : audit [DBG] from='client.38078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:18:23.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:18:22.170749+0000 mon.smithi061 (mon.0) 1338 : audit [DBG] from='client.? 172.21.15.61:0/3516313299' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:18:23.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:18:21.812828+0000 mgr.smithi067.rdualw (mgr.24569) 5903 : audit [DBG] from='client.38078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:18:23.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:18:22.170749+0000 mon.smithi061 (mon.0) 1338 : audit [DBG] from='client.? 172.21.15.61:0/3516313299' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:18:24.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:23.175277+0000 mgr.smithi067.rdualw (mgr.24569) 5904 : cluster [DBG] pgmap v5086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:24.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:23.175277+0000 mgr.smithi067.rdualw (mgr.24569) 5904 : cluster [DBG] pgmap v5086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:26.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:25.176054+0000 mgr.smithi067.rdualw (mgr.24569) 5905 : cluster [DBG] pgmap v5087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:26.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:25.176054+0000 mgr.smithi067.rdualw (mgr.24569) 5905 : cluster [DBG] pgmap v5087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:28.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:27.176935+0000 mgr.smithi067.rdualw (mgr.24569) 5906 : cluster [DBG] pgmap v5088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:18:28.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:27.176935+0000 mgr.smithi067.rdualw (mgr.24569) 5906 : cluster [DBG] pgmap v5088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:18:30.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:29.177648+0000 mgr.smithi067.rdualw (mgr.24569) 5907 : cluster [DBG] pgmap v5089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:30.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:29.177648+0000 mgr.smithi067.rdualw (mgr.24569) 5907 : cluster [DBG] pgmap v5089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:32.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:31.178447+0000 mgr.smithi067.rdualw (mgr.24569) 5908 : cluster [DBG] pgmap v5090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:31.178447+0000 mgr.smithi067.rdualw (mgr.24569) 5908 : cluster [DBG] pgmap v5090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:34.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:33.178983+0000 mgr.smithi067.rdualw (mgr.24569) 5909 : cluster [DBG] pgmap v5091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:34.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:33.178983+0000 mgr.smithi067.rdualw (mgr.24569) 5909 : cluster [DBG] pgmap v5091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:35.179838+0000 mgr.smithi067.rdualw (mgr.24569) 5910 : cluster [DBG] pgmap v5092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:18:35.363451+0000 mon.smithi067 (mon.1) 914 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:18:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:18:35.363728+0000 mon.smithi067 (mon.1) 915 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:18:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:18:35.363927+0000 mon.smithi061 (mon.0) 1339 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:18:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:18:35.364279+0000 mon.smithi061 (mon.0) 1340 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:18:36.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:35.179838+0000 mgr.smithi067.rdualw (mgr.24569) 5910 : cluster [DBG] pgmap v5092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:18:35.363451+0000 mon.smithi067 (mon.1) 914 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:18:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:18:35.363728+0000 mon.smithi067 (mon.1) 915 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:18:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:18:35.363927+0000 mon.smithi061 (mon.0) 1339 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:18:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:18:35.364279+0000 mon.smithi061 (mon.0) 1340 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:18:38.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:37.180797+0000 mgr.smithi067.rdualw (mgr.24569) 5911 : cluster [DBG] pgmap v5093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:18:38.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:37.180797+0000 mgr.smithi067.rdualw (mgr.24569) 5911 : cluster [DBG] pgmap v5093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:18:40.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:39.181590+0000 mgr.smithi067.rdualw (mgr.24569) 5912 : cluster [DBG] pgmap v5094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:40.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:39.181590+0000 mgr.smithi067.rdualw (mgr.24569) 5912 : cluster [DBG] pgmap v5094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:42.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:41.182432+0000 mgr.smithi067.rdualw (mgr.24569) 5913 : cluster [DBG] pgmap v5095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:42.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:41.182432+0000 mgr.smithi067.rdualw (mgr.24569) 5913 : cluster [DBG] pgmap v5095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:44.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:43.183117+0000 mgr.smithi067.rdualw (mgr.24569) 5914 : cluster [DBG] pgmap v5096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:44.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:43.183117+0000 mgr.smithi067.rdualw (mgr.24569) 5914 : cluster [DBG] pgmap v5096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:46.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:45.183823+0000 mgr.smithi067.rdualw (mgr.24569) 5915 : cluster [DBG] pgmap v5097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:46.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:45.183823+0000 mgr.smithi067.rdualw (mgr.24569) 5915 : cluster [DBG] pgmap v5097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:48.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:47.184820+0000 mgr.smithi067.rdualw (mgr.24569) 5916 : cluster [DBG] pgmap v5098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:18:48.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:47.184820+0000 mgr.smithi067.rdualw (mgr.24569) 5916 : cluster [DBG] pgmap v5098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:18:50.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:49.185499+0000 mgr.smithi067.rdualw (mgr.24569) 5917 : cluster [DBG] pgmap v5099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:50.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:49.185499+0000 mgr.smithi067.rdualw (mgr.24569) 5917 : cluster [DBG] pgmap v5099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:51.186338+0000 mgr.smithi067.rdualw (mgr.24569) 5918 : cluster [DBG] pgmap v5100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:51.186338+0000 mgr.smithi067.rdualw (mgr.24569) 5918 : cluster [DBG] pgmap v5100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:52.504 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:18:52.806 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:18:52.806 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 5m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:18:52.806 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 5m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:18:52.806 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 5m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:18:52.807 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 5m ago 2h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:18:52.807 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 5m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:18:52.807 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 5m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:18:52.807 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 5m ago 2h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:18:52.808 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 5m ago 2h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:18:52.808 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 5m ago 2h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:18:52.808 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 5m ago 2h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:18:52.808 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 5m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:18:52.808 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 5m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:18:52.809 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 5m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:18:52.809 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 5m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:18:52.809 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 5m ago 2h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:18:52.809 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 5m ago 2h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:18:52.810 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 5m ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:18:52.810 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 5m ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:18:52.810 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 5m ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:18:52.810 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 5m ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:18:52.810 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 5m ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:18:52.811 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 5m ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:18:52.811 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 5m ago 2h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:18:53.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:18:52.236157+0000 mon.smithi067 (mon.1) 916 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:18:53.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:18:52.237790+0000 mon.smithi067 (mon.1) 917 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:18:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:18:52.238754+0000 mon.smithi067 (mon.1) 918 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:18:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:18:52.239598+0000 mgr.smithi067.rdualw (mgr.24569) 5919 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:18:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:18:52.492235+0000 mgr.smithi067.rdualw (mgr.24569) 5920 : audit [DBG] from='client.38086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:18:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:18:52.674392+0000 mon.smithi061 (mon.0) 1341 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:18:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:18:52.679963+0000 mon.smithi061 (mon.0) 1342 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:18:53.147 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:18:53.147 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:18:53.148 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:18:53.148 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:18:53.148 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:18:53.148 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:18:53.149 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:18:53.149 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:18:53.149 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:18:53.149 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:18:53.149 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:18:53.150 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:18:53.150 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:18:53.150 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:18:53.150 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:18:53.151 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:18:53.151 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:18:53.151 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:18:53.152 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:18:53.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:18:52.236157+0000 mon.smithi067 (mon.1) 916 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:18:53.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:18:52.237790+0000 mon.smithi067 (mon.1) 917 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:18:53.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:18:52.238754+0000 mon.smithi067 (mon.1) 918 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:18:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:18:52.239598+0000 mgr.smithi067.rdualw (mgr.24569) 5919 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:18:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:18:52.492235+0000 mgr.smithi067.rdualw (mgr.24569) 5920 : audit [DBG] from='client.38086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:18:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:18:52.674392+0000 mon.smithi061 (mon.0) 1341 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:18:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:18:52.679963+0000 mon.smithi061 (mon.0) 1342 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:18:54.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:18:52.791655+0000 mgr.smithi067.rdualw (mgr.24569) 5921 : audit [DBG] from='client.38090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:18:54.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:18:53.147859+0000 mon.smithi061 (mon.0) 1343 : audit [DBG] from='client.? 172.21.15.61:0/508104974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:18:54.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:53.186814+0000 mgr.smithi067.rdualw (mgr.24569) 5922 : cluster [DBG] pgmap v5101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:54.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:18:52.791655+0000 mgr.smithi067.rdualw (mgr.24569) 5921 : audit [DBG] from='client.38090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:18:54.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:18:53.147859+0000 mon.smithi061 (mon.0) 1343 : audit [DBG] from='client.? 172.21.15.61:0/508104974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:18:54.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:53.186814+0000 mgr.smithi067.rdualw (mgr.24569) 5922 : cluster [DBG] pgmap v5101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:56.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:55.187426+0000 mgr.smithi067.rdualw (mgr.24569) 5923 : cluster [DBG] pgmap v5102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:56.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:55.187426+0000 mgr.smithi067.rdualw (mgr.24569) 5923 : cluster [DBG] pgmap v5102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:18:58.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:18:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:57.188430+0000 mgr.smithi067.rdualw (mgr.24569) 5924 : cluster [DBG] pgmap v5103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:18:58.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:18:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:57.188430+0000 mgr.smithi067.rdualw (mgr.24569) 5924 : cluster [DBG] pgmap v5103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:19:00.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:18:59.189116+0000 mgr.smithi067.rdualw (mgr.24569) 5925 : cluster [DBG] pgmap v5104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:00.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:18:59.189116+0000 mgr.smithi067.rdualw (mgr.24569) 5925 : cluster [DBG] pgmap v5104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:02.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:01.190141+0000 mgr.smithi067.rdualw (mgr.24569) 5926 : cluster [DBG] pgmap v5105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:02.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:01.190141+0000 mgr.smithi067.rdualw (mgr.24569) 5926 : cluster [DBG] pgmap v5105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:04.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:03.190697+0000 mgr.smithi067.rdualw (mgr.24569) 5927 : cluster [DBG] pgmap v5106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:04.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:03.190697+0000 mgr.smithi067.rdualw (mgr.24569) 5927 : cluster [DBG] pgmap v5106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:06.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:05.191311+0000 mgr.smithi067.rdualw (mgr.24569) 5928 : cluster [DBG] pgmap v5107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:06.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:05.191311+0000 mgr.smithi067.rdualw (mgr.24569) 5928 : cluster [DBG] pgmap v5107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:08.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:07.192182+0000 mgr.smithi067.rdualw (mgr.24569) 5929 : cluster [DBG] pgmap v5108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:19:08.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:07.192182+0000 mgr.smithi067.rdualw (mgr.24569) 5929 : cluster [DBG] pgmap v5108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:19:10.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:09.192912+0000 mgr.smithi067.rdualw (mgr.24569) 5930 : cluster [DBG] pgmap v5109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:10.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:09.192912+0000 mgr.smithi067.rdualw (mgr.24569) 5930 : cluster [DBG] pgmap v5109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:11.193840+0000 mgr.smithi067.rdualw (mgr.24569) 5931 : cluster [DBG] pgmap v5110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:12.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:11.193840+0000 mgr.smithi067.rdualw (mgr.24569) 5931 : cluster [DBG] pgmap v5110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:14.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:13.194426+0000 mgr.smithi067.rdualw (mgr.24569) 5932 : cluster [DBG] pgmap v5111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:14.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:13.194426+0000 mgr.smithi067.rdualw (mgr.24569) 5932 : cluster [DBG] pgmap v5111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:16.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:15.195015+0000 mgr.smithi067.rdualw (mgr.24569) 5933 : cluster [DBG] pgmap v5112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:16.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:15.195015+0000 mgr.smithi067.rdualw (mgr.24569) 5933 : cluster [DBG] pgmap v5112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:18.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:17.195920+0000 mgr.smithi067.rdualw (mgr.24569) 5934 : cluster [DBG] pgmap v5113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:19:18.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:17.195920+0000 mgr.smithi067.rdualw (mgr.24569) 5934 : cluster [DBG] pgmap v5113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:19:20.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:19.196576+0000 mgr.smithi067.rdualw (mgr.24569) 5935 : cluster [DBG] pgmap v5114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:20.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:19.196576+0000 mgr.smithi067.rdualw (mgr.24569) 5935 : cluster [DBG] pgmap v5114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:21.197625+0000 mgr.smithi067.rdualw (mgr.24569) 5936 : cluster [DBG] pgmap v5115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:21.197625+0000 mgr.smithi067.rdualw (mgr.24569) 5936 : cluster [DBG] pgmap v5115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:23.461 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:19:23.750 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:19:23.751 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 5m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:19:23.751 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 5m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:19:23.751 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 5m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:19:23.752 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 5m ago 2h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:19:23.752 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 5m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:19:23.752 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 5m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:19:23.752 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 5m ago 2h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:19:23.752 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 5m ago 2h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:19:23.753 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 5m ago 2h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:19:23.753 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 5m ago 2h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:19:23.753 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 5m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:19:23.753 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 5m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:19:23.754 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 5m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:19:23.754 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 5m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:19:23.754 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 5m ago 2h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:19:23.754 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 5m ago 2h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:19:23.755 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 5m ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:19:23.755 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 5m ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:19:23.755 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 5m ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:19:23.755 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 5m ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:19:23.755 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 5m ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:19:23.756 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 5m ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:19:23.756 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 5m ago 2h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:19:24.093 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:19:24.093 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:19:24.094 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:19:24.094 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:19:24.094 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:19:24.094 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:19:24.094 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:19:24.095 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:19:24.095 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:19:24.095 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:19:24.095 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:19:24.096 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:19:24.096 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:19:24.096 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:19:24.096 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:19:24.096 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:19:24.097 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:19:24.097 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:19:24.097 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:19:24.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:23.198100+0000 mgr.smithi067.rdualw (mgr.24569) 5937 : cluster [DBG] pgmap v5116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:24.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:19:23.449991+0000 mgr.smithi067.rdualw (mgr.24569) 5938 : audit [DBG] from='client.38098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:19:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:19:24.093770+0000 mon.smithi061 (mon.0) 1344 : audit [DBG] from='client.? 172.21.15.61:0/3835843833' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:19:24.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:23.198100+0000 mgr.smithi067.rdualw (mgr.24569) 5937 : cluster [DBG] pgmap v5116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:24.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:19:23.449991+0000 mgr.smithi067.rdualw (mgr.24569) 5938 : audit [DBG] from='client.38098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:19:24.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:19:24.093770+0000 mon.smithi061 (mon.0) 1344 : audit [DBG] from='client.? 172.21.15.61:0/3835843833' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:19:25.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:19:23.735157+0000 mgr.smithi067.rdualw (mgr.24569) 5939 : audit [DBG] from='client.38102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:19:25.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:19:23.735157+0000 mgr.smithi067.rdualw (mgr.24569) 5939 : audit [DBG] from='client.38102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:19:26.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:25.198729+0000 mgr.smithi067.rdualw (mgr.24569) 5940 : cluster [DBG] pgmap v5117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:26.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:25.198729+0000 mgr.smithi067.rdualw (mgr.24569) 5940 : cluster [DBG] pgmap v5117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:28.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:27.199575+0000 mgr.smithi067.rdualw (mgr.24569) 5941 : cluster [DBG] pgmap v5118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:19:28.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:27.199575+0000 mgr.smithi067.rdualw (mgr.24569) 5941 : cluster [DBG] pgmap v5118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:19:30.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:29.200310+0000 mgr.smithi067.rdualw (mgr.24569) 5942 : cluster [DBG] pgmap v5119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:30.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:29.200310+0000 mgr.smithi067.rdualw (mgr.24569) 5942 : cluster [DBG] pgmap v5119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:32.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:31.201306+0000 mgr.smithi067.rdualw (mgr.24569) 5943 : cluster [DBG] pgmap v5120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:31.201306+0000 mgr.smithi067.rdualw (mgr.24569) 5943 : cluster [DBG] pgmap v5120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:34.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:33.201891+0000 mgr.smithi067.rdualw (mgr.24569) 5944 : cluster [DBG] pgmap v5121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:34.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:33.201891+0000 mgr.smithi067.rdualw (mgr.24569) 5944 : cluster [DBG] pgmap v5121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:35.202523+0000 mgr.smithi067.rdualw (mgr.24569) 5945 : cluster [DBG] pgmap v5122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:19:35.368012+0000 mon.smithi067 (mon.1) 919 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:19:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:19:35.368481+0000 mon.smithi061 (mon.0) 1345 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:19:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:19:35.370236+0000 mon.smithi067 (mon.1) 920 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:19:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:19:35.370623+0000 mon.smithi061 (mon.0) 1346 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:19:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:35.202523+0000 mgr.smithi067.rdualw (mgr.24569) 5945 : cluster [DBG] pgmap v5122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:19:35.368012+0000 mon.smithi067 (mon.1) 919 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:19:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:19:35.368481+0000 mon.smithi061 (mon.0) 1345 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:19:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:19:35.370236+0000 mon.smithi067 (mon.1) 920 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:19:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:19:35.370623+0000 mon.smithi061 (mon.0) 1346 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:19:38.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:37.203649+0000 mgr.smithi067.rdualw (mgr.24569) 5946 : cluster [DBG] pgmap v5123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:19:38.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:37.203649+0000 mgr.smithi067.rdualw (mgr.24569) 5946 : cluster [DBG] pgmap v5123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:19:40.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:39.204371+0000 mgr.smithi067.rdualw (mgr.24569) 5947 : cluster [DBG] pgmap v5124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:40.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:39.204371+0000 mgr.smithi067.rdualw (mgr.24569) 5947 : cluster [DBG] pgmap v5124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:41.205215+0000 mgr.smithi067.rdualw (mgr.24569) 5948 : cluster [DBG] pgmap v5125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:42.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:41.205215+0000 mgr.smithi067.rdualw (mgr.24569) 5948 : cluster [DBG] pgmap v5125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:44.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:43.205722+0000 mgr.smithi067.rdualw (mgr.24569) 5949 : cluster [DBG] pgmap v5126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:44.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:43.205722+0000 mgr.smithi067.rdualw (mgr.24569) 5949 : cluster [DBG] pgmap v5126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:46.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:45.206573+0000 mgr.smithi067.rdualw (mgr.24569) 5950 : cluster [DBG] pgmap v5127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:46.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:45.206573+0000 mgr.smithi067.rdualw (mgr.24569) 5950 : cluster [DBG] pgmap v5127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:48.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:47.207604+0000 mgr.smithi067.rdualw (mgr.24569) 5951 : cluster [DBG] pgmap v5128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:19:48.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:47.207604+0000 mgr.smithi067.rdualw (mgr.24569) 5951 : cluster [DBG] pgmap v5128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:19:50.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:49.208320+0000 mgr.smithi067.rdualw (mgr.24569) 5952 : cluster [DBG] pgmap v5129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:50.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:49.208320+0000 mgr.smithi067.rdualw (mgr.24569) 5952 : cluster [DBG] pgmap v5129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:52.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:51.209389+0000 mgr.smithi067.rdualw (mgr.24569) 5953 : cluster [DBG] pgmap v5130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:52.333 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:51.209389+0000 mgr.smithi067.rdualw (mgr.24569) 5953 : cluster [DBG] pgmap v5130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:53.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:19:52.683740+0000 mon.smithi067 (mon.1) 921 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:19:53.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:19:52.685197+0000 mon.smithi067 (mon.1) 922 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:19:53.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:19:52.686103+0000 mon.smithi067 (mon.1) 923 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:19:53.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:19:52.686942+0000 mgr.smithi067.rdualw (mgr.24569) 5954 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:19:53.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:19:52.683740+0000 mon.smithi067 (mon.1) 921 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:19:53.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:19:52.685197+0000 mon.smithi067 (mon.1) 922 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:19:53.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:19:52.686103+0000 mon.smithi067 (mon.1) 923 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:19:53.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:19:52.686942+0000 mgr.smithi067.rdualw (mgr.24569) 5954 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:19:54.385 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:19:53.099502+0000 mon.smithi061 (mon.0) 1347 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:19:54.385 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:19:53.105403+0000 mon.smithi061 (mon.0) 1348 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:19:54.386 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:53.210068+0000 mgr.smithi067.rdualw (mgr.24569) 5955 : cluster [DBG] pgmap v5131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:54.405 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:19:54.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:19:53.099502+0000 mon.smithi061 (mon.0) 1347 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:19:54.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:19:53.105403+0000 mon.smithi061 (mon.0) 1348 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:19:54.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:53.210068+0000 mgr.smithi067.rdualw (mgr.24569) 5955 : cluster [DBG] pgmap v5131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:54.699 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:19:54.699 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 6m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:19:54.700 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 6m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:19:54.700 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 6m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:19:54.700 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 6m ago 2h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:19:54.700 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 6m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:19:54.700 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 6m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:19:54.701 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 6m ago 2h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:19:54.701 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 6m ago 2h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:19:54.701 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 6m ago 2h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:19:54.702 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 6m ago 2h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:19:54.702 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 6m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:19:54.702 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 6m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:19:54.703 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 6m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:19:54.703 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 6m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:19:54.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 6m ago 2h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:19:54.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 6m ago 2h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:19:54.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 6m ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:19:54.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 6m ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:19:54.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 6m ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:19:54.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 6m ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:19:54.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 6m ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:19:54.705 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 6m ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:19:54.705 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 6m ago 2h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:19:55.109 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:19:55.110 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:19:55.110 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:19:55.110 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:19:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:19:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:19:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:19:55.111 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:19:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:19:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:19:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:19:55.112 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:19:55.113 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:19:55.113 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:19:55.113 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:19:55.113 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:19:55.113 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:19:55.114 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:19:55.114 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:19:55.385 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:19:54.391322+0000 mgr.smithi067.rdualw (mgr.24569) 5956 : audit [DBG] from='client.38110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:19:55.385 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:19:54.682955+0000 mgr.smithi067.rdualw (mgr.24569) 5957 : audit [DBG] from='client.38114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:19:55.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:19:54.391322+0000 mgr.smithi067.rdualw (mgr.24569) 5956 : audit [DBG] from='client.38110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:19:55.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:19:54.682955+0000 mgr.smithi067.rdualw (mgr.24569) 5957 : audit [DBG] from='client.38114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:19:56.385 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:19:55.110133+0000 mon.smithi061 (mon.0) 1349 : audit [DBG] from='client.? 172.21.15.61:0/2405657497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:19:56.386 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:55.210810+0000 mgr.smithi067.rdualw (mgr.24569) 5958 : cluster [DBG] pgmap v5132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:56.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:19:55.110133+0000 mon.smithi061 (mon.0) 1349 : audit [DBG] from='client.? 172.21.15.61:0/2405657497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:19:56.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:55.210810+0000 mgr.smithi067.rdualw (mgr.24569) 5958 : cluster [DBG] pgmap v5132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:19:58.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:19:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:57.211685+0000 mgr.smithi067.rdualw (mgr.24569) 5959 : cluster [DBG] pgmap v5133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:19:58.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:19:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:57.211685+0000 mgr.smithi067.rdualw (mgr.24569) 5959 : cluster [DBG] pgmap v5133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:20:00.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:19:59.212335+0000 mgr.smithi067.rdualw (mgr.24569) 5960 : cluster [DBG] pgmap v5134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:00.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:00.000102+0000 mon.smithi061 (mon.0) 1350 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T18:20:00.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:19:59.212335+0000 mgr.smithi067.rdualw (mgr.24569) 5960 : cluster [DBG] pgmap v5134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:00.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:00.000102+0000 mon.smithi061 (mon.0) 1350 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T18:20:02.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:01.213338+0000 mgr.smithi067.rdualw (mgr.24569) 5961 : cluster [DBG] pgmap v5135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:01.213338+0000 mgr.smithi067.rdualw (mgr.24569) 5961 : cluster [DBG] pgmap v5135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:04.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:03.213937+0000 mgr.smithi067.rdualw (mgr.24569) 5962 : cluster [DBG] pgmap v5136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:04.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:03.213937+0000 mgr.smithi067.rdualw (mgr.24569) 5962 : cluster [DBG] pgmap v5136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:06.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:05.214757+0000 mgr.smithi067.rdualw (mgr.24569) 5963 : cluster [DBG] pgmap v5137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:06.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:05.214757+0000 mgr.smithi067.rdualw (mgr.24569) 5963 : cluster [DBG] pgmap v5137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:08.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:07.215860+0000 mgr.smithi067.rdualw (mgr.24569) 5964 : cluster [DBG] pgmap v5138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:20:08.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:07.215860+0000 mgr.smithi067.rdualw (mgr.24569) 5964 : cluster [DBG] pgmap v5138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:20:10.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:09.216765+0000 mgr.smithi067.rdualw (mgr.24569) 5965 : cluster [DBG] pgmap v5139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:10.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:09.216765+0000 mgr.smithi067.rdualw (mgr.24569) 5965 : cluster [DBG] pgmap v5139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:12.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:11.217710+0000 mgr.smithi067.rdualw (mgr.24569) 5966 : cluster [DBG] pgmap v5140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:12.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:11.217710+0000 mgr.smithi067.rdualw (mgr.24569) 5966 : cluster [DBG] pgmap v5140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:14.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:13.218299+0000 mgr.smithi067.rdualw (mgr.24569) 5967 : cluster [DBG] pgmap v5141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:14.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:13.218299+0000 mgr.smithi067.rdualw (mgr.24569) 5967 : cluster [DBG] pgmap v5141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:16.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:15.218945+0000 mgr.smithi067.rdualw (mgr.24569) 5968 : cluster [DBG] pgmap v5142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:16.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:15.218945+0000 mgr.smithi067.rdualw (mgr.24569) 5968 : cluster [DBG] pgmap v5142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:18.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:17.219810+0000 mgr.smithi067.rdualw (mgr.24569) 5969 : cluster [DBG] pgmap v5143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:20:18.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:17.219810+0000 mgr.smithi067.rdualw (mgr.24569) 5969 : cluster [DBG] pgmap v5143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:20:20.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:19.220517+0000 mgr.smithi067.rdualw (mgr.24569) 5970 : cluster [DBG] pgmap v5144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:20.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:19.220517+0000 mgr.smithi067.rdualw (mgr.24569) 5970 : cluster [DBG] pgmap v5144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:21.221437+0000 mgr.smithi067.rdualw (mgr.24569) 5971 : cluster [DBG] pgmap v5145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:21.221437+0000 mgr.smithi067.rdualw (mgr.24569) 5971 : cluster [DBG] pgmap v5145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:24.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:23.221886+0000 mgr.smithi067.rdualw (mgr.24569) 5972 : cluster [DBG] pgmap v5146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:24.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:23.221886+0000 mgr.smithi067.rdualw (mgr.24569) 5972 : cluster [DBG] pgmap v5146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:25.419 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:20:25.733 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:20:25.734 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 6m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:20:25.734 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 6m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:20:25.734 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 6m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:20:25.735 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 6m ago 2h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:20:25.735 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 6m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:20:25.735 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 6m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:20:25.736 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 6m ago 3h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:20:25.736 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 6m ago 2h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:20:25.736 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 6m ago 3h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:20:25.736 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 6m ago 2h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:20:25.736 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 6m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:20:25.737 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 6m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:20:25.737 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 6m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:20:25.737 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 6m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:20:25.737 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 6m ago 2h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:20:25.737 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 6m ago 2h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:20:25.738 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 6m ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:20:25.738 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 6m ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:20:25.738 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 6m ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:20:25.738 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 6m ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:20:25.739 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 6m ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:20:25.739 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 6m ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:20:25.739 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 6m ago 2h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:20:26.087 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:20:26.087 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:20:26.087 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:20:26.088 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:20:26.088 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:20:26.088 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:20:26.088 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:20:26.089 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:20:26.089 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:20:26.089 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:20:26.089 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:20:26.090 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:20:26.090 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:20:26.090 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:20:26.090 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:20:26.091 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:20:26.091 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:20:26.091 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:20:26.092 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:20:26.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:25.222597+0000 mgr.smithi067.rdualw (mgr.24569) 5973 : cluster [DBG] pgmap v5147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:26.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:20:25.407496+0000 mgr.smithi067.rdualw (mgr.24569) 5974 : audit [DBG] from='client.38122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:20:26.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:20:26.087813+0000 mon.smithi061 (mon.0) 1351 : audit [DBG] from='client.? 172.21.15.61:0/2336205348' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:20:26.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:25.222597+0000 mgr.smithi067.rdualw (mgr.24569) 5973 : cluster [DBG] pgmap v5147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:26.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:20:25.407496+0000 mgr.smithi067.rdualw (mgr.24569) 5974 : audit [DBG] from='client.38122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:20:26.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:20:26.087813+0000 mon.smithi061 (mon.0) 1351 : audit [DBG] from='client.? 172.21.15.61:0/2336205348' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:20:27.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:20:25.717443+0000 mgr.smithi067.rdualw (mgr.24569) 5975 : audit [DBG] from='client.38126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:20:27.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:20:25.717443+0000 mgr.smithi067.rdualw (mgr.24569) 5975 : audit [DBG] from='client.38126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:20:28.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:27.223484+0000 mgr.smithi067.rdualw (mgr.24569) 5976 : cluster [DBG] pgmap v5148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:20:28.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:27.223484+0000 mgr.smithi067.rdualw (mgr.24569) 5976 : cluster [DBG] pgmap v5148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:20:30.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:29.224021+0000 mgr.smithi067.rdualw (mgr.24569) 5977 : cluster [DBG] pgmap v5149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:30.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:29.224021+0000 mgr.smithi067.rdualw (mgr.24569) 5977 : cluster [DBG] pgmap v5149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:31.224923+0000 mgr.smithi067.rdualw (mgr.24569) 5978 : cluster [DBG] pgmap v5150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:31.224923+0000 mgr.smithi067.rdualw (mgr.24569) 5978 : cluster [DBG] pgmap v5150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:34.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:33.225520+0000 mgr.smithi067.rdualw (mgr.24569) 5979 : cluster [DBG] pgmap v5151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:34.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:33.225520+0000 mgr.smithi067.rdualw (mgr.24569) 5979 : cluster [DBG] pgmap v5151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:35.226297+0000 mgr.smithi067.rdualw (mgr.24569) 5980 : cluster [DBG] pgmap v5152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:20:35.375390+0000 mon.smithi067 (mon.1) 924 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:20:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:20:35.375673+0000 mon.smithi067 (mon.1) 925 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:20:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:20:35.376132+0000 mon.smithi061 (mon.0) 1352 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:20:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:20:35.376445+0000 mon.smithi061 (mon.0) 1353 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:20:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:35.226297+0000 mgr.smithi067.rdualw (mgr.24569) 5980 : cluster [DBG] pgmap v5152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:20:35.375390+0000 mon.smithi067 (mon.1) 924 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:20:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:20:35.375673+0000 mon.smithi067 (mon.1) 925 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:20:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:20:35.376132+0000 mon.smithi061 (mon.0) 1352 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:20:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:20:35.376445+0000 mon.smithi061 (mon.0) 1353 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:20:38.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:37.227161+0000 mgr.smithi067.rdualw (mgr.24569) 5981 : cluster [DBG] pgmap v5153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:20:38.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:37.227161+0000 mgr.smithi067.rdualw (mgr.24569) 5981 : cluster [DBG] pgmap v5153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:20:40.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:39.227990+0000 mgr.smithi067.rdualw (mgr.24569) 5982 : cluster [DBG] pgmap v5154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:39.227990+0000 mgr.smithi067.rdualw (mgr.24569) 5982 : cluster [DBG] pgmap v5154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:41.228863+0000 mgr.smithi067.rdualw (mgr.24569) 5983 : cluster [DBG] pgmap v5155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:42.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:41.228863+0000 mgr.smithi067.rdualw (mgr.24569) 5983 : cluster [DBG] pgmap v5155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:44.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:43.229584+0000 mgr.smithi067.rdualw (mgr.24569) 5984 : cluster [DBG] pgmap v5156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:44.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:43.229584+0000 mgr.smithi067.rdualw (mgr.24569) 5984 : cluster [DBG] pgmap v5156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:46.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:45.230117+0000 mgr.smithi067.rdualw (mgr.24569) 5985 : cluster [DBG] pgmap v5157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:46.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:45.230117+0000 mgr.smithi067.rdualw (mgr.24569) 5985 : cluster [DBG] pgmap v5157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:48.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:47.230991+0000 mgr.smithi067.rdualw (mgr.24569) 5986 : cluster [DBG] pgmap v5158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:20:48.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:47.230991+0000 mgr.smithi067.rdualw (mgr.24569) 5986 : cluster [DBG] pgmap v5158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:20:50.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:49.231666+0000 mgr.smithi067.rdualw (mgr.24569) 5987 : cluster [DBG] pgmap v5159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:50.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:49.231666+0000 mgr.smithi067.rdualw (mgr.24569) 5987 : cluster [DBG] pgmap v5159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:51.232503+0000 mgr.smithi067.rdualw (mgr.24569) 5988 : cluster [DBG] pgmap v5160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:52.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:51.232503+0000 mgr.smithi067.rdualw (mgr.24569) 5988 : cluster [DBG] pgmap v5160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:53.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:20:53.108948+0000 mon.smithi067 (mon.1) 926 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:20:53.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:20:53.110398+0000 mon.smithi067 (mon.1) 927 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:20:53.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:20:53.111331+0000 mon.smithi067 (mon.1) 928 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:20:53.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:20:53.108948+0000 mon.smithi067 (mon.1) 926 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:20:53.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:20:53.110398+0000 mon.smithi067 (mon.1) 927 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:20:53.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:20:53.111331+0000 mon.smithi067 (mon.1) 928 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:20:54.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:20:53.112158+0000 mgr.smithi067.rdualw (mgr.24569) 5989 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:20:54.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:53.233027+0000 mgr.smithi067.rdualw (mgr.24569) 5990 : cluster [DBG] pgmap v5161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:54.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:20:53.529880+0000 mon.smithi061 (mon.0) 1354 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:20:54.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:20:53.535177+0000 mon.smithi061 (mon.0) 1355 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:20:54.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:20:53.112158+0000 mgr.smithi067.rdualw (mgr.24569) 5989 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:20:54.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:53.233027+0000 mgr.smithi067.rdualw (mgr.24569) 5990 : cluster [DBG] pgmap v5161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:54.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:20:53.529880+0000 mon.smithi061 (mon.0) 1354 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:20:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:20:53.535177+0000 mon.smithi061 (mon.0) 1355 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:20:56.405 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:20:56.698 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:20:56.698 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 7m ago 2h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:20:56.698 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 7m ago 2h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:20:56.699 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 7m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:20:56.699 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 7m ago 2h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:20:56.699 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 7m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:20:56.699 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 7m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:20:56.700 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 7m ago 3h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:20:56.700 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 7m ago 2h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:20:56.700 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 7m ago 3h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:20:56.700 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 7m ago 2h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:20:56.700 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 7m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:20:56.701 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 7m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:20:56.701 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 7m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:20:56.702 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 7m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:20:56.702 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 7m ago 2h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:20:56.702 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 7m ago 2h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:20:56.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 7m ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:20:56.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 7m ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:20:56.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 7m ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:20:56.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 7m ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:20:56.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 7m ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:20:56.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 7m ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:20:56.704 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 7m ago 2h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:20:56.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:55.233720+0000 mgr.smithi067.rdualw (mgr.24569) 5991 : cluster [DBG] pgmap v5162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:56.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:55.233720+0000 mgr.smithi067.rdualw (mgr.24569) 5991 : cluster [DBG] pgmap v5162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:20:57.037 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:20:57.037 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:20:57.038 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:20:57.038 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:20:57.038 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:20:57.038 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:20:57.039 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:20:57.039 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:20:57.039 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:20:57.039 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:20:57.040 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:20:57.040 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:20:57.040 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:20:57.040 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:20:57.040 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:20:57.041 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:20:57.041 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:20:57.041 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:20:57.041 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:20:57.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:20:56.393691+0000 mgr.smithi067.rdualw (mgr.24569) 5992 : audit [DBG] from='client.38134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:20:57.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:20:56.681936+0000 mgr.smithi067.rdualw (mgr.24569) 5993 : audit [DBG] from='client.38138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:20:57.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:20:57.037769+0000 mon.smithi061 (mon.0) 1356 : audit [DBG] from='client.? 172.21.15.61:0/1371422589' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:20:57.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:20:56.393691+0000 mgr.smithi067.rdualw (mgr.24569) 5992 : audit [DBG] from='client.38134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:20:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:20:56.681936+0000 mgr.smithi067.rdualw (mgr.24569) 5993 : audit [DBG] from='client.38138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:20:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:20:57.037769+0000 mon.smithi061 (mon.0) 1356 : audit [DBG] from='client.? 172.21.15.61:0/1371422589' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:20:58.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:20:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:57.234793+0000 mgr.smithi067.rdualw (mgr.24569) 5994 : cluster [DBG] pgmap v5163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:20:58.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:20:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:57.234793+0000 mgr.smithi067.rdualw (mgr.24569) 5994 : cluster [DBG] pgmap v5163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:21:00.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:20:59.235392+0000 mgr.smithi067.rdualw (mgr.24569) 5995 : cluster [DBG] pgmap v5164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:00.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:20:59.235392+0000 mgr.smithi067.rdualw (mgr.24569) 5995 : cluster [DBG] pgmap v5164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:02.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:01.236288+0000 mgr.smithi067.rdualw (mgr.24569) 5996 : cluster [DBG] pgmap v5165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:01.236288+0000 mgr.smithi067.rdualw (mgr.24569) 5996 : cluster [DBG] pgmap v5165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:04.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:03.236906+0000 mgr.smithi067.rdualw (mgr.24569) 5997 : cluster [DBG] pgmap v5166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:04.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:03.236906+0000 mgr.smithi067.rdualw (mgr.24569) 5997 : cluster [DBG] pgmap v5166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:06.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:05.237515+0000 mgr.smithi067.rdualw (mgr.24569) 5998 : cluster [DBG] pgmap v5167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:06.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:05.237515+0000 mgr.smithi067.rdualw (mgr.24569) 5998 : cluster [DBG] pgmap v5167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:08.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:07.238334+0000 mgr.smithi067.rdualw (mgr.24569) 5999 : cluster [DBG] pgmap v5168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:21:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:07.238334+0000 mgr.smithi067.rdualw (mgr.24569) 5999 : cluster [DBG] pgmap v5168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:21:10.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:09.238972+0000 mgr.smithi067.rdualw (mgr.24569) 6000 : cluster [DBG] pgmap v5169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:10.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:09.238972+0000 mgr.smithi067.rdualw (mgr.24569) 6000 : cluster [DBG] pgmap v5169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:12.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:11.239840+0000 mgr.smithi067.rdualw (mgr.24569) 6001 : cluster [DBG] pgmap v5170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:12.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:11.239840+0000 mgr.smithi067.rdualw (mgr.24569) 6001 : cluster [DBG] pgmap v5170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:14.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:13.240384+0000 mgr.smithi067.rdualw (mgr.24569) 6002 : cluster [DBG] pgmap v5171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:14.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:13.240384+0000 mgr.smithi067.rdualw (mgr.24569) 6002 : cluster [DBG] pgmap v5171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:16.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:15.240999+0000 mgr.smithi067.rdualw (mgr.24569) 6003 : cluster [DBG] pgmap v5172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:16.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:15.240999+0000 mgr.smithi067.rdualw (mgr.24569) 6003 : cluster [DBG] pgmap v5172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:18.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:17.242054+0000 mgr.smithi067.rdualw (mgr.24569) 6004 : cluster [DBG] pgmap v5173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:21:18.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:17.242054+0000 mgr.smithi067.rdualw (mgr.24569) 6004 : cluster [DBG] pgmap v5173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:21:20.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:19.242668+0000 mgr.smithi067.rdualw (mgr.24569) 6005 : cluster [DBG] pgmap v5174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:20.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:19.242668+0000 mgr.smithi067.rdualw (mgr.24569) 6005 : cluster [DBG] pgmap v5174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:22.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:21.243591+0000 mgr.smithi067.rdualw (mgr.24569) 6006 : cluster [DBG] pgmap v5175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:21.243591+0000 mgr.smithi067.rdualw (mgr.24569) 6006 : cluster [DBG] pgmap v5175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:24.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:23.244191+0000 mgr.smithi067.rdualw (mgr.24569) 6007 : cluster [DBG] pgmap v5176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:24.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:23.244191+0000 mgr.smithi067.rdualw (mgr.24569) 6007 : cluster [DBG] pgmap v5176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:26.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:25.244943+0000 mgr.smithi067.rdualw (mgr.24569) 6008 : cluster [DBG] pgmap v5177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:26.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:25.244943+0000 mgr.smithi067.rdualw (mgr.24569) 6008 : cluster [DBG] pgmap v5177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:27.345 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:21:27.634 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:21:27.634 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 7m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:21:27.635 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 7m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:21:27.635 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 7m ago 2h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:21:27.635 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 7m ago 2h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:21:27.635 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 7m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:21:27.636 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 7m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:21:27.636 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 7m ago 3h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:21:27.636 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 7m ago 2h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:21:27.636 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 7m ago 3h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:21:27.636 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 7m ago 2h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:21:27.637 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 7m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:21:27.637 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 7m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:21:27.637 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (2h) 7m ago 2h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:21:27.637 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 7m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:21:27.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 7m ago 2h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:21:27.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 7m ago 2h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:21:27.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 7m ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:21:27.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 7m ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:21:27.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 7m ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:21:27.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 7m ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:21:27.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 7m ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:21:27.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 7m ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:21:27.639 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 7m ago 2h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:21:27.983 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:21:27.984 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:21:27.984 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:21:27.984 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:21:27.985 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:21:27.985 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:21:27.985 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:21:27.985 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:21:27.985 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:21:27.986 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:21:27.986 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:21:27.986 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:21:27.986 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:21:27.987 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:21:27.987 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:21:27.987 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:21:27.987 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:21:27.987 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:21:27.988 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:21:28.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:27.245890+0000 mgr.smithi067.rdualw (mgr.24569) 6009 : cluster [DBG] pgmap v5178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:21:28.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:21:27.333579+0000 mgr.smithi067.rdualw (mgr.24569) 6010 : audit [DBG] from='client.38146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:21:28.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:21:27.618650+0000 mgr.smithi067.rdualw (mgr.24569) 6011 : audit [DBG] from='client.38150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:21:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:21:27.984433+0000 mon.smithi061 (mon.0) 1357 : audit [DBG] from='client.? 172.21.15.61:0/3883020590' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:21:28.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:27.245890+0000 mgr.smithi067.rdualw (mgr.24569) 6009 : cluster [DBG] pgmap v5178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:21:28.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:21:27.333579+0000 mgr.smithi067.rdualw (mgr.24569) 6010 : audit [DBG] from='client.38146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:21:28.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:21:27.618650+0000 mgr.smithi067.rdualw (mgr.24569) 6011 : audit [DBG] from='client.38150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:21:28.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:21:27.984433+0000 mon.smithi061 (mon.0) 1357 : audit [DBG] from='client.? 172.21.15.61:0/3883020590' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:21:30.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:29.246474+0000 mgr.smithi067.rdualw (mgr.24569) 6012 : cluster [DBG] pgmap v5179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:30.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:29.246474+0000 mgr.smithi067.rdualw (mgr.24569) 6012 : cluster [DBG] pgmap v5179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:31.247448+0000 mgr.smithi067.rdualw (mgr.24569) 6013 : cluster [DBG] pgmap v5180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:31.247448+0000 mgr.smithi067.rdualw (mgr.24569) 6013 : cluster [DBG] pgmap v5180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:34.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:33.247959+0000 mgr.smithi067.rdualw (mgr.24569) 6014 : cluster [DBG] pgmap v5181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:34.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:33.247959+0000 mgr.smithi067.rdualw (mgr.24569) 6014 : cluster [DBG] pgmap v5181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:35.248558+0000 mgr.smithi067.rdualw (mgr.24569) 6015 : cluster [DBG] pgmap v5182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:21:35.379749+0000 mon.smithi067 (mon.1) 929 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:21:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:21:35.380581+0000 mon.smithi061 (mon.0) 1358 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:21:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:21:35.380644+0000 mon.smithi067 (mon.1) 930 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:21:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:21:35.381280+0000 mon.smithi061 (mon.0) 1359 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:21:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:35.248558+0000 mgr.smithi067.rdualw (mgr.24569) 6015 : cluster [DBG] pgmap v5182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:21:35.379749+0000 mon.smithi067 (mon.1) 929 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:21:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:21:35.380581+0000 mon.smithi061 (mon.0) 1358 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:21:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:21:35.380644+0000 mon.smithi067 (mon.1) 930 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:21:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:21:35.381280+0000 mon.smithi061 (mon.0) 1359 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:21:38.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:37.249555+0000 mgr.smithi067.rdualw (mgr.24569) 6016 : cluster [DBG] pgmap v5183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:21:38.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:37.249555+0000 mgr.smithi067.rdualw (mgr.24569) 6016 : cluster [DBG] pgmap v5183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:21:40.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:39.250107+0000 mgr.smithi067.rdualw (mgr.24569) 6017 : cluster [DBG] pgmap v5184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:40.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:39.250107+0000 mgr.smithi067.rdualw (mgr.24569) 6017 : cluster [DBG] pgmap v5184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:41.251077+0000 mgr.smithi067.rdualw (mgr.24569) 6018 : cluster [DBG] pgmap v5185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:42.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:41.251077+0000 mgr.smithi067.rdualw (mgr.24569) 6018 : cluster [DBG] pgmap v5185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:44.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:43.251573+0000 mgr.smithi067.rdualw (mgr.24569) 6019 : cluster [DBG] pgmap v5186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:44.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:43.251573+0000 mgr.smithi067.rdualw (mgr.24569) 6019 : cluster [DBG] pgmap v5186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:46.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:45.252320+0000 mgr.smithi067.rdualw (mgr.24569) 6020 : cluster [DBG] pgmap v5187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:46.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:45.252320+0000 mgr.smithi067.rdualw (mgr.24569) 6020 : cluster [DBG] pgmap v5187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:48.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:47.253280+0000 mgr.smithi067.rdualw (mgr.24569) 6021 : cluster [DBG] pgmap v5188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:21:48.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:47.253280+0000 mgr.smithi067.rdualw (mgr.24569) 6021 : cluster [DBG] pgmap v5188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:21:50.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:49.253821+0000 mgr.smithi067.rdualw (mgr.24569) 6022 : cluster [DBG] pgmap v5189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:50.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:49.253821+0000 mgr.smithi067.rdualw (mgr.24569) 6022 : cluster [DBG] pgmap v5189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:51.254774+0000 mgr.smithi067.rdualw (mgr.24569) 6023 : cluster [DBG] pgmap v5190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:52.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:51.254774+0000 mgr.smithi067.rdualw (mgr.24569) 6023 : cluster [DBG] pgmap v5190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:54.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:53.255435+0000 mgr.smithi067.rdualw (mgr.24569) 6024 : cluster [DBG] pgmap v5191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:54.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:21:53.538710+0000 mon.smithi067 (mon.1) 931 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:21:54.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:21:53.540133+0000 mon.smithi067 (mon.1) 932 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:21:54.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:21:53.541050+0000 mon.smithi067 (mon.1) 933 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:21:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:21:53.541898+0000 mgr.smithi067.rdualw (mgr.24569) 6025 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:21:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:21:53.957167+0000 mon.smithi061 (mon.0) 1360 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:21:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:21:53.962572+0000 mon.smithi061 (mon.0) 1361 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:21:54.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:53.255435+0000 mgr.smithi067.rdualw (mgr.24569) 6024 : cluster [DBG] pgmap v5191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:54.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:21:53.538710+0000 mon.smithi067 (mon.1) 931 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:21:54.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:21:53.540133+0000 mon.smithi067 (mon.1) 932 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:21:54.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:21:53.541050+0000 mon.smithi067 (mon.1) 933 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:21:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:21:53.541898+0000 mgr.smithi067.rdualw (mgr.24569) 6025 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:21:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:21:53.957167+0000 mon.smithi061 (mon.0) 1360 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:21:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:21:53.962572+0000 mon.smithi061 (mon.0) 1361 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:21:56.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:55.256146+0000 mgr.smithi067.rdualw (mgr.24569) 6026 : cluster [DBG] pgmap v5192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:56.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:55.256146+0000 mgr.smithi067.rdualw (mgr.24569) 6026 : cluster [DBG] pgmap v5192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:21:58.291 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:21:58.661 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:21:58.661 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (2h) 8m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:21:58.662 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 8m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:21:58.662 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 8m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:21:58.662 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 8m ago 3h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:21:58.662 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 8m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:21:58.663 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 8m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:21:58.663 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 8m ago 3h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:21:58.663 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 8m ago 3h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:21:58.663 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 8m ago 3h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:21:58.663 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 8m ago 2h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:21:58.664 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 8m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:21:58.664 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 8m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:21:58.664 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 8m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:21:58.664 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (2h) 8m ago 2h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:21:58.665 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 8m ago 2h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:21:58.665 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 8m ago 2h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:21:58.665 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 8m ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:21:58.665 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 8m ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:21:58.665 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 8m ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:21:58.666 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 8m ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:21:58.666 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 8m ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:21:58.666 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 8m ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:21:58.666 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 8m ago 3h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:21:58.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:57.257399+0000 mgr.smithi067.rdualw (mgr.24569) 6027 : cluster [DBG] pgmap v5193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:21:58.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:57.257399+0000 mgr.smithi067.rdualw (mgr.24569) 6027 : cluster [DBG] pgmap v5193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:21:59.004 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:21:59.005 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:21:59.005 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:21:59.005 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:21:59.005 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:21:59.006 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:21:59.006 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:21:59.006 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:21:59.006 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:21:59.006 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:21:59.007 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:21:59.007 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:21:59.007 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:21:59.007 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:21:59.008 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:21:59.008 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:21:59.008 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:21:59.009 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:21:59.009 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:21:59.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:21:58.280105+0000 mgr.smithi067.rdualw (mgr.24569) 6028 : audit [DBG] from='client.38158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:21:59.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:21:58.645260+0000 mgr.smithi067.rdualw (mgr.24569) 6029 : audit [DBG] from='client.38162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:21:59.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:21:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:21:59.005160+0000 mon.smithi061 (mon.0) 1362 : audit [DBG] from='client.? 172.21.15.61:0/558382746' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:21:59.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:21:58.280105+0000 mgr.smithi067.rdualw (mgr.24569) 6028 : audit [DBG] from='client.38158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:21:59.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:21:58.645260+0000 mgr.smithi067.rdualw (mgr.24569) 6029 : audit [DBG] from='client.38162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:21:59.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:21:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:21:59.005160+0000 mon.smithi061 (mon.0) 1362 : audit [DBG] from='client.? 172.21.15.61:0/558382746' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:22:00.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:21:59.257989+0000 mgr.smithi067.rdualw (mgr.24569) 6030 : cluster [DBG] pgmap v5194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:00.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:21:59.257989+0000 mgr.smithi067.rdualw (mgr.24569) 6030 : cluster [DBG] pgmap v5194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:02.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:01.258943+0000 mgr.smithi067.rdualw (mgr.24569) 6031 : cluster [DBG] pgmap v5195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:01.258943+0000 mgr.smithi067.rdualw (mgr.24569) 6031 : cluster [DBG] pgmap v5195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:04.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:03.259687+0000 mgr.smithi067.rdualw (mgr.24569) 6032 : cluster [DBG] pgmap v5196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:04.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:03.259687+0000 mgr.smithi067.rdualw (mgr.24569) 6032 : cluster [DBG] pgmap v5196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:06.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:05.260275+0000 mgr.smithi067.rdualw (mgr.24569) 6033 : cluster [DBG] pgmap v5197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:22:06.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:05.260275+0000 mgr.smithi067.rdualw (mgr.24569) 6033 : cluster [DBG] pgmap v5197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:22:08.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:07.261143+0000 mgr.smithi067.rdualw (mgr.24569) 6034 : cluster [DBG] pgmap v5198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:22:08.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:07.261143+0000 mgr.smithi067.rdualw (mgr.24569) 6034 : cluster [DBG] pgmap v5198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:22:10.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:09.261954+0000 mgr.smithi067.rdualw (mgr.24569) 6035 : cluster [DBG] pgmap v5199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:10.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:09.261954+0000 mgr.smithi067.rdualw (mgr.24569) 6035 : cluster [DBG] pgmap v5199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:11.262867+0000 mgr.smithi067.rdualw (mgr.24569) 6036 : cluster [DBG] pgmap v5200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:11.262867+0000 mgr.smithi067.rdualw (mgr.24569) 6036 : cluster [DBG] pgmap v5200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:14.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:13.263609+0000 mgr.smithi067.rdualw (mgr.24569) 6037 : cluster [DBG] pgmap v5201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:14.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:13.263609+0000 mgr.smithi067.rdualw (mgr.24569) 6037 : cluster [DBG] pgmap v5201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:16.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:15.264332+0000 mgr.smithi067.rdualw (mgr.24569) 6038 : cluster [DBG] pgmap v5202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:22:16.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:15.264332+0000 mgr.smithi067.rdualw (mgr.24569) 6038 : cluster [DBG] pgmap v5202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:22:18.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:17.265374+0000 mgr.smithi067.rdualw (mgr.24569) 6039 : cluster [DBG] pgmap v5203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:18.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:17.265374+0000 mgr.smithi067.rdualw (mgr.24569) 6039 : cluster [DBG] pgmap v5203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:20.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:19.266210+0000 mgr.smithi067.rdualw (mgr.24569) 6040 : cluster [DBG] pgmap v5204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:20.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:19.266210+0000 mgr.smithi067.rdualw (mgr.24569) 6040 : cluster [DBG] pgmap v5204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:22.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:21.267413+0000 mgr.smithi067.rdualw (mgr.24569) 6041 : cluster [DBG] pgmap v5205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:21.267413+0000 mgr.smithi067.rdualw (mgr.24569) 6041 : cluster [DBG] pgmap v5205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:24.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:23.267933+0000 mgr.smithi067.rdualw (mgr.24569) 6042 : cluster [DBG] pgmap v5206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:24.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:23.267933+0000 mgr.smithi067.rdualw (mgr.24569) 6042 : cluster [DBG] pgmap v5206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:26.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:25.268566+0000 mgr.smithi067.rdualw (mgr.24569) 6043 : cluster [DBG] pgmap v5207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:22:26.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:25.268566+0000 mgr.smithi067.rdualw (mgr.24569) 6043 : cluster [DBG] pgmap v5207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:22:28.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:27.269650+0000 mgr.smithi067.rdualw (mgr.24569) 6044 : cluster [DBG] pgmap v5208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:28.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:27.269650+0000 mgr.smithi067.rdualw (mgr.24569) 6044 : cluster [DBG] pgmap v5208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:29.313 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:22:29.606 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:22:29.606 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 8m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:22:29.607 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 8m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:22:29.607 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 8m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:22:29.607 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (2h) 8m ago 3h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:22:29.607 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 8m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:22:29.607 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 8m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:22:29.608 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 8m ago 3h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:22:29.608 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 8m ago 3h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:22:29.608 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 8m ago 3h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:22:29.608 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 8m ago 3h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:22:29.609 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 8m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:22:29.609 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 8m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:22:29.609 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 8m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:22:29.609 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 8m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:22:29.609 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 8m ago 2h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:22:29.610 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (2h) 8m ago 2h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:22:29.610 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 8m ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:22:29.610 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 8m ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:22:29.610 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 8m ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:22:29.611 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 8m ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:22:29.611 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 8m ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:22:29.611 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 8m ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:22:29.611 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (2h) 8m ago 3h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:22:29.946 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:22:29.947 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:22:29.947 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:22:29.947 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:22:29.947 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:22:29.948 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:22:29.948 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:22:29.948 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:22:29.948 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:22:29.948 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:22:29.949 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:22:29.949 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:22:29.949 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:22:29.949 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:22:29.950 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:22:29.950 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:22:29.950 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:22:29.950 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:22:29.950 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:22:30.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:29.270215+0000 mgr.smithi067.rdualw (mgr.24569) 6045 : cluster [DBG] pgmap v5209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:30.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:22:29.302163+0000 mgr.smithi067.rdualw (mgr.24569) 6046 : audit [DBG] from='client.38170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:22:30.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:22:29.590112+0000 mgr.smithi067.rdualw (mgr.24569) 6047 : audit [DBG] from='client.38174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:22:30.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:22:29.947049+0000 mon.smithi061 (mon.0) 1363 : audit [DBG] from='client.? 172.21.15.61:0/1720498591' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:22:30.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:29.270215+0000 mgr.smithi067.rdualw (mgr.24569) 6045 : cluster [DBG] pgmap v5209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:30.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:22:29.302163+0000 mgr.smithi067.rdualw (mgr.24569) 6046 : audit [DBG] from='client.38170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:22:30.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:22:29.590112+0000 mgr.smithi067.rdualw (mgr.24569) 6047 : audit [DBG] from='client.38174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:22:30.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:22:29.947049+0000 mon.smithi061 (mon.0) 1363 : audit [DBG] from='client.? 172.21.15.61:0/1720498591' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:22:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:31.271247+0000 mgr.smithi067.rdualw (mgr.24569) 6048 : cluster [DBG] pgmap v5210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:31.271247+0000 mgr.smithi067.rdualw (mgr.24569) 6048 : cluster [DBG] pgmap v5210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:34.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:33.271788+0000 mgr.smithi067.rdualw (mgr.24569) 6049 : cluster [DBG] pgmap v5211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:34.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:33.271788+0000 mgr.smithi067.rdualw (mgr.24569) 6049 : cluster [DBG] pgmap v5211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:35.272426+0000 mgr.smithi067.rdualw (mgr.24569) 6050 : cluster [DBG] pgmap v5212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:22:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:22:35.386988+0000 mon.smithi067 (mon.1) 934 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:22:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:22:35.387224+0000 mon.smithi067 (mon.1) 935 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:22:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:22:35.387413+0000 mon.smithi061 (mon.0) 1364 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:22:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:22:35.387745+0000 mon.smithi061 (mon.0) 1365 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:22:36.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:35.272426+0000 mgr.smithi067.rdualw (mgr.24569) 6050 : cluster [DBG] pgmap v5212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:22:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:22:35.386988+0000 mon.smithi067 (mon.1) 934 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:22:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:22:35.387224+0000 mon.smithi067 (mon.1) 935 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:22:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:22:35.387413+0000 mon.smithi061 (mon.0) 1364 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:22:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:22:35.387745+0000 mon.smithi061 (mon.0) 1365 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:22:38.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:37.273211+0000 mgr.smithi067.rdualw (mgr.24569) 6051 : cluster [DBG] pgmap v5213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:38.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:37.273211+0000 mgr.smithi067.rdualw (mgr.24569) 6051 : cluster [DBG] pgmap v5213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:40.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:39.273768+0000 mgr.smithi067.rdualw (mgr.24569) 6052 : cluster [DBG] pgmap v5214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:40.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:39.273768+0000 mgr.smithi067.rdualw (mgr.24569) 6052 : cluster [DBG] pgmap v5214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:42.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:41.274709+0000 mgr.smithi067.rdualw (mgr.24569) 6053 : cluster [DBG] pgmap v5215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:42.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:41.274709+0000 mgr.smithi067.rdualw (mgr.24569) 6053 : cluster [DBG] pgmap v5215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:44.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:43.275422+0000 mgr.smithi067.rdualw (mgr.24569) 6054 : cluster [DBG] pgmap v5216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:44.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:43.275422+0000 mgr.smithi067.rdualw (mgr.24569) 6054 : cluster [DBG] pgmap v5216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:46.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:45.276086+0000 mgr.smithi067.rdualw (mgr.24569) 6055 : cluster [DBG] pgmap v5217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:22:46.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:45.276086+0000 mgr.smithi067.rdualw (mgr.24569) 6055 : cluster [DBG] pgmap v5217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:22:48.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:47.277036+0000 mgr.smithi067.rdualw (mgr.24569) 6056 : cluster [DBG] pgmap v5218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:48.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:47.277036+0000 mgr.smithi067.rdualw (mgr.24569) 6056 : cluster [DBG] pgmap v5218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:50.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:49.277706+0000 mgr.smithi067.rdualw (mgr.24569) 6057 : cluster [DBG] pgmap v5219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:50.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:49.277706+0000 mgr.smithi067.rdualw (mgr.24569) 6057 : cluster [DBG] pgmap v5219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:52.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:51.278645+0000 mgr.smithi067.rdualw (mgr.24569) 6058 : cluster [DBG] pgmap v5220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:51.278645+0000 mgr.smithi067.rdualw (mgr.24569) 6058 : cluster [DBG] pgmap v5220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:54.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:53.279304+0000 mgr.smithi067.rdualw (mgr.24569) 6059 : cluster [DBG] pgmap v5221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:54.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:22:53.968481+0000 mon.smithi067 (mon.1) 936 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:22:54.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:22:53.969939+0000 mon.smithi067 (mon.1) 937 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:22:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:22:53.970850+0000 mon.smithi067 (mon.1) 938 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:22:54.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:53.279304+0000 mgr.smithi067.rdualw (mgr.24569) 6059 : cluster [DBG] pgmap v5221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:54.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:22:53.968481+0000 mon.smithi067 (mon.1) 936 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:22:54.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:22:53.969939+0000 mon.smithi067 (mon.1) 937 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:22:54.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:22:53.970850+0000 mon.smithi067 (mon.1) 938 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:22:55.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:22:53.971677+0000 mgr.smithi067.rdualw (mgr.24569) 6060 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:22:55.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:22:54.400777+0000 mon.smithi061 (mon.0) 1366 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:22:55.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:22:54.406413+0000 mon.smithi061 (mon.0) 1367 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:22:55.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:22:53.971677+0000 mgr.smithi067.rdualw (mgr.24569) 6060 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:22:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:22:54.400777+0000 mon.smithi061 (mon.0) 1366 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:22:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:22:54.406413+0000 mon.smithi061 (mon.0) 1367 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:22:56.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:55.279940+0000 mgr.smithi067.rdualw (mgr.24569) 6061 : cluster [DBG] pgmap v5222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:22:56.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:55.279940+0000 mgr.smithi067.rdualw (mgr.24569) 6061 : cluster [DBG] pgmap v5222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:22:58.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:22:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:57.280804+0000 mgr.smithi067.rdualw (mgr.24569) 6062 : cluster [DBG] pgmap v5223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:22:58.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:22:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:57.280804+0000 mgr.smithi067.rdualw (mgr.24569) 6062 : cluster [DBG] pgmap v5223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:00.257 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:23:00.548 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:23:00.549 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 9m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:23:00.549 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 9m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:23:00.549 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 9m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:23:00.549 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 9m ago 3h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:23:00.550 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 9m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:23:00.550 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 9m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:23:00.550 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 9m ago 3h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:23:00.550 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 9m ago 3h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:23:00.551 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 9m ago 3h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:23:00.551 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 9m ago 3h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:23:00.551 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 9m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:23:00.551 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 9m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:23:00.552 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 9m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:23:00.552 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 9m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:23:00.552 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 9m ago 3h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:23:00.552 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 9m ago 3h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:23:00.553 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (2h) 9m ago 2h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:23:00.553 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (2h) 9m ago 2h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:23:00.553 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 9m ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:23:00.553 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 9m ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:23:00.553 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 9m ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:23:00.554 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 9m ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:23:00.554 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 9m ago 3h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:23:00.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:22:59.281562+0000 mgr.smithi067.rdualw (mgr.24569) 6063 : cluster [DBG] pgmap v5224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:00.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:22:59.281562+0000 mgr.smithi067.rdualw (mgr.24569) 6063 : cluster [DBG] pgmap v5224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:00.896 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:23:00.896 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:23:00.896 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:23:00.897 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:23:00.897 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:23:00.897 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:23:00.897 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:23:00.898 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:23:00.898 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:23:00.898 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:23:00.898 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:23:00.898 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:23:00.899 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:23:00.899 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:23:00.899 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:23:00.899 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:23:00.900 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:23:00.900 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:23:00.900 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:23:01.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:23:00.245921+0000 mgr.smithi067.rdualw (mgr.24569) 6064 : audit [DBG] from='client.38182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:23:01.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:23:00.532705+0000 mgr.smithi067.rdualw (mgr.24569) 6065 : audit [DBG] from='client.38186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:23:01.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:23:00.896646+0000 mon.smithi061 (mon.0) 1368 : audit [DBG] from='client.? 172.21.15.61:0/851776533' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:23:01.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:23:00.245921+0000 mgr.smithi067.rdualw (mgr.24569) 6064 : audit [DBG] from='client.38182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:23:01.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:23:00.532705+0000 mgr.smithi067.rdualw (mgr.24569) 6065 : audit [DBG] from='client.38186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:23:01.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:23:00.896646+0000 mon.smithi061 (mon.0) 1368 : audit [DBG] from='client.? 172.21.15.61:0/851776533' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:23:02.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:01.282490+0000 mgr.smithi067.rdualw (mgr.24569) 6066 : cluster [DBG] pgmap v5225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:02.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:01.282490+0000 mgr.smithi067.rdualw (mgr.24569) 6066 : cluster [DBG] pgmap v5225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:04.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:03.283034+0000 mgr.smithi067.rdualw (mgr.24569) 6067 : cluster [DBG] pgmap v5226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:04.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:03.283034+0000 mgr.smithi067.rdualw (mgr.24569) 6067 : cluster [DBG] pgmap v5226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:06.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:05.283649+0000 mgr.smithi067.rdualw (mgr.24569) 6068 : cluster [DBG] pgmap v5227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:23:06.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:05.283649+0000 mgr.smithi067.rdualw (mgr.24569) 6068 : cluster [DBG] pgmap v5227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:23:08.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:07.284425+0000 mgr.smithi067.rdualw (mgr.24569) 6069 : cluster [DBG] pgmap v5228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:08.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:07.284425+0000 mgr.smithi067.rdualw (mgr.24569) 6069 : cluster [DBG] pgmap v5228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:10.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:09.285149+0000 mgr.smithi067.rdualw (mgr.24569) 6070 : cluster [DBG] pgmap v5229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:10.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:09.285149+0000 mgr.smithi067.rdualw (mgr.24569) 6070 : cluster [DBG] pgmap v5229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:12.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:11.286076+0000 mgr.smithi067.rdualw (mgr.24569) 6071 : cluster [DBG] pgmap v5230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:12.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:11.286076+0000 mgr.smithi067.rdualw (mgr.24569) 6071 : cluster [DBG] pgmap v5230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:14.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:13.286806+0000 mgr.smithi067.rdualw (mgr.24569) 6072 : cluster [DBG] pgmap v5231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:14.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:13.286806+0000 mgr.smithi067.rdualw (mgr.24569) 6072 : cluster [DBG] pgmap v5231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:16.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:15.287527+0000 mgr.smithi067.rdualw (mgr.24569) 6073 : cluster [DBG] pgmap v5232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:23:16.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:15.287527+0000 mgr.smithi067.rdualw (mgr.24569) 6073 : cluster [DBG] pgmap v5232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:23:18.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:17.288366+0000 mgr.smithi067.rdualw (mgr.24569) 6074 : cluster [DBG] pgmap v5233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:18.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:17.288366+0000 mgr.smithi067.rdualw (mgr.24569) 6074 : cluster [DBG] pgmap v5233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:20.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:19.288894+0000 mgr.smithi067.rdualw (mgr.24569) 6075 : cluster [DBG] pgmap v5234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:20.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:19.288894+0000 mgr.smithi067.rdualw (mgr.24569) 6075 : cluster [DBG] pgmap v5234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:21.289844+0000 mgr.smithi067.rdualw (mgr.24569) 6076 : cluster [DBG] pgmap v5235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:22.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:21.289844+0000 mgr.smithi067.rdualw (mgr.24569) 6076 : cluster [DBG] pgmap v5235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:24.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:23.290356+0000 mgr.smithi067.rdualw (mgr.24569) 6077 : cluster [DBG] pgmap v5236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:23.290356+0000 mgr.smithi067.rdualw (mgr.24569) 6077 : cluster [DBG] pgmap v5236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:26.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:25.290985+0000 mgr.smithi067.rdualw (mgr.24569) 6078 : cluster [DBG] pgmap v5237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:23:26.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:25.290985+0000 mgr.smithi067.rdualw (mgr.24569) 6078 : cluster [DBG] pgmap v5237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:23:28.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:27.291932+0000 mgr.smithi067.rdualw (mgr.24569) 6079 : cluster [DBG] pgmap v5238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:28.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:27.291932+0000 mgr.smithi067.rdualw (mgr.24569) 6079 : cluster [DBG] pgmap v5238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:30.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:29.292662+0000 mgr.smithi067.rdualw (mgr.24569) 6080 : cluster [DBG] pgmap v5239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:30.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:29.292662+0000 mgr.smithi067.rdualw (mgr.24569) 6080 : cluster [DBG] pgmap v5239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:31.208 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:23:31.501 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:23:31.501 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 9m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:23:31.502 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 9m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:23:31.502 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 9m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:23:31.502 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 9m ago 3h 41.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:23:31.502 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 9m ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:23:31.503 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 9m ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:23:31.503 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 9m ago 3h 464M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:23:31.503 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 9m ago 3h 562M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:23:31.503 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 9m ago 3h 1125M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:23:31.504 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 9m ago 3h 593M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:23:31.504 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 9m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:23:31.504 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 9m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:23:31.504 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 9m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:23:31.505 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 9m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:23:31.506 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 9m ago 3h 842M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:23:31.507 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 9m ago 3h 1699M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:23:31.507 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 9m ago 3h 1059M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:23:31.507 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 9m ago 3h 1830M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:23:31.507 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (2h) 9m ago 2h 1690M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:23:31.507 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (2h) 9m ago 2h 1900M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:23:31.508 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 9m ago 2h 1519M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:23:31.508 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 9m ago 2h 2408M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:23:31.508 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 9m ago 3h 90.3M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:23:31.850 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:23:31.850 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:23:31.851 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:23:31.851 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:23:31.851 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:23:31.851 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:23:31.852 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:23:31.852 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:23:31.852 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:23:31.852 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:23:31.852 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:23:31.853 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:23:31.853 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:23:31.853 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:23:31.853 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:23:31.854 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:23:31.854 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:23:31.854 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:23:31.854 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:23:32.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:23:31.196421+0000 mgr.smithi067.rdualw (mgr.24569) 6081 : audit [DBG] from='client.38194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:23:32.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:31.293479+0000 mgr.smithi067.rdualw (mgr.24569) 6082 : cluster [DBG] pgmap v5240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:32.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:23:31.483955+0000 mgr.smithi067.rdualw (mgr.24569) 6083 : audit [DBG] from='client.38198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:23:32.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:23:31.850810+0000 mon.smithi061 (mon.0) 1369 : audit [DBG] from='client.? 172.21.15.61:0/763053366' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:23:32.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:23:31.196421+0000 mgr.smithi067.rdualw (mgr.24569) 6081 : audit [DBG] from='client.38194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:23:32.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:31.293479+0000 mgr.smithi067.rdualw (mgr.24569) 6082 : cluster [DBG] pgmap v5240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:32.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:23:31.483955+0000 mgr.smithi067.rdualw (mgr.24569) 6083 : audit [DBG] from='client.38198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:23:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:23:31.850810+0000 mon.smithi061 (mon.0) 1369 : audit [DBG] from='client.? 172.21.15.61:0/763053366' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:23:34.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:33.294198+0000 mgr.smithi067.rdualw (mgr.24569) 6084 : cluster [DBG] pgmap v5241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:34.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:33.294198+0000 mgr.smithi067.rdualw (mgr.24569) 6084 : cluster [DBG] pgmap v5241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:36.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:35.295180+0000 mgr.smithi067.rdualw (mgr.24569) 6085 : cluster [DBG] pgmap v5242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:23:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:23:35.392491+0000 mon.smithi067 (mon.1) 939 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:23:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:23:35.392763+0000 mon.smithi067 (mon.1) 940 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:23:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:23:35.392935+0000 mon.smithi061 (mon.0) 1370 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:23:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:23:35.393422+0000 mon.smithi061 (mon.0) 1371 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:23:36.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:35.295180+0000 mgr.smithi067.rdualw (mgr.24569) 6085 : cluster [DBG] pgmap v5242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:23:36.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:23:35.392491+0000 mon.smithi067 (mon.1) 939 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:23:36.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:23:35.392763+0000 mon.smithi067 (mon.1) 940 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:23:36.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:23:35.392935+0000 mon.smithi061 (mon.0) 1370 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:23:36.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:23:35.393422+0000 mon.smithi061 (mon.0) 1371 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:23:38.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:37.295883+0000 mgr.smithi067.rdualw (mgr.24569) 6086 : cluster [DBG] pgmap v5243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:38.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:37.295883+0000 mgr.smithi067.rdualw (mgr.24569) 6086 : cluster [DBG] pgmap v5243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:40.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:39.296607+0000 mgr.smithi067.rdualw (mgr.24569) 6087 : cluster [DBG] pgmap v5244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:40.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:39.296607+0000 mgr.smithi067.rdualw (mgr.24569) 6087 : cluster [DBG] pgmap v5244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:41.297459+0000 mgr.smithi067.rdualw (mgr.24569) 6088 : cluster [DBG] pgmap v5245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:42.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:41.297459+0000 mgr.smithi067.rdualw (mgr.24569) 6088 : cluster [DBG] pgmap v5245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:44.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:43.298102+0000 mgr.smithi067.rdualw (mgr.24569) 6089 : cluster [DBG] pgmap v5246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:44.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:43.298102+0000 mgr.smithi067.rdualw (mgr.24569) 6089 : cluster [DBG] pgmap v5246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:46.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:45.298944+0000 mgr.smithi067.rdualw (mgr.24569) 6090 : cluster [DBG] pgmap v5247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:23:46.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:45.298944+0000 mgr.smithi067.rdualw (mgr.24569) 6090 : cluster [DBG] pgmap v5247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:23:48.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:47.299754+0000 mgr.smithi067.rdualw (mgr.24569) 6091 : cluster [DBG] pgmap v5248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:48.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:47.299754+0000 mgr.smithi067.rdualw (mgr.24569) 6091 : cluster [DBG] pgmap v5248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:50.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:49.300336+0000 mgr.smithi067.rdualw (mgr.24569) 6092 : cluster [DBG] pgmap v5249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:50.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:49.300336+0000 mgr.smithi067.rdualw (mgr.24569) 6092 : cluster [DBG] pgmap v5249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:51.301263+0000 mgr.smithi067.rdualw (mgr.24569) 6093 : cluster [DBG] pgmap v5250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:51.301263+0000 mgr.smithi067.rdualw (mgr.24569) 6093 : cluster [DBG] pgmap v5250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:54.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:53.301792+0000 mgr.smithi067.rdualw (mgr.24569) 6094 : cluster [DBG] pgmap v5251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:53.301792+0000 mgr.smithi067.rdualw (mgr.24569) 6094 : cluster [DBG] pgmap v5251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:55.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:23:54.412155+0000 mon.smithi067 (mon.1) 941 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:23:55.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:23:54.413596+0000 mon.smithi067 (mon.1) 942 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:23:55.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:23:54.414468+0000 mon.smithi067 (mon.1) 943 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:23:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:23:54.415294+0000 mgr.smithi067.rdualw (mgr.24569) 6095 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:23:55.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:23:54.412155+0000 mon.smithi067 (mon.1) 941 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:23:55.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:23:54.413596+0000 mon.smithi067 (mon.1) 942 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:23:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:23:54.414468+0000 mon.smithi067 (mon.1) 943 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:23:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:23:54.415294+0000 mgr.smithi067.rdualw (mgr.24569) 6095 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:23:56.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:55.302395+0000 mgr.smithi067.rdualw (mgr.24569) 6096 : cluster [DBG] pgmap v5252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:23:56.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:55.302395+0000 mgr.smithi067.rdualw (mgr.24569) 6096 : cluster [DBG] pgmap v5252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:23:58.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:23:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:57.303065+0000 mgr.smithi067.rdualw (mgr.24569) 6097 : cluster [DBG] pgmap v5253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:23:58.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:23:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:57.303065+0000 mgr.smithi067.rdualw (mgr.24569) 6097 : cluster [DBG] pgmap v5253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:00.425 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:23:59.107006+0000 mon.smithi061 (mon.0) 1372 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:24:00.425 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:23:59.303597+0000 mgr.smithi067.rdualw (mgr.24569) 6098 : cluster [DBG] pgmap v5254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:00.425 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:23:59.493386+0000 mon.smithi067 (mon.1) 944 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:24:00.426 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:23:59.493995+0000 mon.smithi061 (mon.0) 1373 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:24:00.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:23:59.107006+0000 mon.smithi061 (mon.0) 1372 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:24:00.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:23:59.303597+0000 mgr.smithi067.rdualw (mgr.24569) 6098 : cluster [DBG] pgmap v5254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:00.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:23:59.493386+0000 mon.smithi067 (mon.1) 944 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:24:00.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:23:59.493995+0000 mon.smithi061 (mon.0) 1373 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:24:02.162 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:24:02.473 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:24:02.473 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 0s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:24:02.474 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 0s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:24:02.474 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 3s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:24:02.474 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 0s ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:24:02.474 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 0s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:24:02.475 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 3s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:24:02.475 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 0s ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:24:02.475 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 3s ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:24:02.475 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 0s ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:24:02.476 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 3s ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:24:02.476 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 0s ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:24:02.476 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 3s ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:24:02.476 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 0s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:24:02.476 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 3s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:24:02.477 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 0s ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:24:02.477 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 0s ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:24:02.477 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 0s ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:24:02.477 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 0s ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:24:02.477 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 3s ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:24:02.478 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 3s ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:24:02.478 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (2h) 3s ago 2h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:24:02.478 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (2h) 3s ago 2h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:24:02.478 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 0s ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:24:02.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:01.304499+0000 mgr.smithi067.rdualw (mgr.24569) 6099 : cluster [DBG] pgmap v5255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:02.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:24:01.514628+0000 mon.smithi061 (mon.0) 1374 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:24:02.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:24:01.912451+0000 mon.smithi067 (mon.1) 945 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:24:02.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:24:01.912981+0000 mon.smithi061 (mon.0) 1375 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:24:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:24:01.917699+0000 mon.smithi061 (mon.0) 1376 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:24:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:24:01.924659+0000 mon.smithi061 (mon.0) 1377 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:24:02.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:01.304499+0000 mgr.smithi067.rdualw (mgr.24569) 6099 : cluster [DBG] pgmap v5255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:02.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:24:01.514628+0000 mon.smithi061 (mon.0) 1374 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:24:02.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:24:01.912451+0000 mon.smithi067 (mon.1) 945 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:24:02.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:24:01.912981+0000 mon.smithi061 (mon.0) 1375 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:24:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:24:01.917699+0000 mon.smithi061 (mon.0) 1376 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:24:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:24:01.924659+0000 mon.smithi061 (mon.0) 1377 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:24:02.817 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:24:02.817 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:24:02.817 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:24:02.818 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:24:02.818 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:24:02.818 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:24:02.818 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:24:02.818 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:24:02.819 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:24:02.819 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:24:02.820 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:24:02.820 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:24:02.820 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:24:02.820 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:24:02.820 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:24:02.821 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:24:02.821 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:24:02.821 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:24:02.821 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:24:03.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:24:02.150040+0000 mgr.smithi067.rdualw (mgr.24569) 6100 : audit [DBG] from='client.38206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:24:03.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:24:02.457498+0000 mgr.smithi067.rdualw (mgr.24569) 6101 : audit [DBG] from='client.38210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:24:03.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:24:02.817881+0000 mon.smithi061 (mon.0) 1378 : audit [DBG] from='client.? 172.21.15.61:0/116973044' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:24:03.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:24:02.150040+0000 mgr.smithi067.rdualw (mgr.24569) 6100 : audit [DBG] from='client.38206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:24:03.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:24:02.457498+0000 mgr.smithi067.rdualw (mgr.24569) 6101 : audit [DBG] from='client.38210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:24:03.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:24:02.817881+0000 mon.smithi061 (mon.0) 1378 : audit [DBG] from='client.? 172.21.15.61:0/116973044' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:24:04.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:03.305215+0000 mgr.smithi067.rdualw (mgr.24569) 6102 : cluster [DBG] pgmap v5256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:04.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:03.305215+0000 mgr.smithi067.rdualw (mgr.24569) 6102 : cluster [DBG] pgmap v5256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:06.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:05.305918+0000 mgr.smithi067.rdualw (mgr.24569) 6103 : cluster [DBG] pgmap v5257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:24:06.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:05.305918+0000 mgr.smithi067.rdualw (mgr.24569) 6103 : cluster [DBG] pgmap v5257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:24:08.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:07.306915+0000 mgr.smithi067.rdualw (mgr.24569) 6104 : cluster [DBG] pgmap v5258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:08.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:07.306915+0000 mgr.smithi067.rdualw (mgr.24569) 6104 : cluster [DBG] pgmap v5258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:10.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:09.307587+0000 mgr.smithi067.rdualw (mgr.24569) 6105 : cluster [DBG] pgmap v5259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:10.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:09.307587+0000 mgr.smithi067.rdualw (mgr.24569) 6105 : cluster [DBG] pgmap v5259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:12.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:11.308523+0000 mgr.smithi067.rdualw (mgr.24569) 6106 : cluster [DBG] pgmap v5260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:12.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:11.308523+0000 mgr.smithi067.rdualw (mgr.24569) 6106 : cluster [DBG] pgmap v5260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:14.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:13.309144+0000 mgr.smithi067.rdualw (mgr.24569) 6107 : cluster [DBG] pgmap v5261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:14.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:13.309144+0000 mgr.smithi067.rdualw (mgr.24569) 6107 : cluster [DBG] pgmap v5261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:16.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:15.309954+0000 mgr.smithi067.rdualw (mgr.24569) 6108 : cluster [DBG] pgmap v5262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:24:16.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:15.309954+0000 mgr.smithi067.rdualw (mgr.24569) 6108 : cluster [DBG] pgmap v5262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:24:18.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:17.310822+0000 mgr.smithi067.rdualw (mgr.24569) 6109 : cluster [DBG] pgmap v5263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:18.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:17.310822+0000 mgr.smithi067.rdualw (mgr.24569) 6109 : cluster [DBG] pgmap v5263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:20.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:19.311479+0000 mgr.smithi067.rdualw (mgr.24569) 6110 : cluster [DBG] pgmap v5264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:20.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:19.311479+0000 mgr.smithi067.rdualw (mgr.24569) 6110 : cluster [DBG] pgmap v5264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:22.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:21.312550+0000 mgr.smithi067.rdualw (mgr.24569) 6111 : cluster [DBG] pgmap v5265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:21.312550+0000 mgr.smithi067.rdualw (mgr.24569) 6111 : cluster [DBG] pgmap v5265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:24.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:23.313014+0000 mgr.smithi067.rdualw (mgr.24569) 6112 : cluster [DBG] pgmap v5266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:24.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:23.313014+0000 mgr.smithi067.rdualw (mgr.24569) 6112 : cluster [DBG] pgmap v5266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:26.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:25.313882+0000 mgr.smithi067.rdualw (mgr.24569) 6113 : cluster [DBG] pgmap v5267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:24:26.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:25.313882+0000 mgr.smithi067.rdualw (mgr.24569) 6113 : cluster [DBG] pgmap v5267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:24:28.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:27.314622+0000 mgr.smithi067.rdualw (mgr.24569) 6114 : cluster [DBG] pgmap v5268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:28.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:27.314622+0000 mgr.smithi067.rdualw (mgr.24569) 6114 : cluster [DBG] pgmap v5268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:30.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:29.315366+0000 mgr.smithi067.rdualw (mgr.24569) 6115 : cluster [DBG] pgmap v5269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:30.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:29.315366+0000 mgr.smithi067.rdualw (mgr.24569) 6115 : cluster [DBG] pgmap v5269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:31.316428+0000 mgr.smithi067.rdualw (mgr.24569) 6116 : cluster [DBG] pgmap v5270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:31.316428+0000 mgr.smithi067.rdualw (mgr.24569) 6116 : cluster [DBG] pgmap v5270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:33.122 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:24:33.411 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:24:33.412 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 31s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:24:33.412 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 31s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:24:33.412 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 34s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:24:33.412 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 31s ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:24:33.413 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 31s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:24:33.413 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 34s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:24:33.413 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 31s ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:24:33.413 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 34s ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:24:33.416 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 31s ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:24:33.416 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 34s ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:24:33.416 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 31s ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:24:33.416 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 34s ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:24:33.417 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 31s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:24:33.417 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 34s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:24:33.417 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 31s ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:24:33.417 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 31s ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:24:33.418 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 31s ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:24:33.418 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 31s ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:24:33.418 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 34s ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:24:33.419 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 34s ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:24:33.419 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 34s ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:24:33.419 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 34s ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:24:33.419 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 31s ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:24:33.789 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:24:33.790 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:24:33.790 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:24:33.790 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:24:33.791 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:24:33.791 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:24:33.791 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:24:33.791 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:24:33.791 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:24:33.792 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:24:33.792 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:24:33.792 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:24:33.792 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:24:33.793 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:24:33.793 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:24:33.793 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:24:33.793 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:24:33.794 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:24:33.794 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:24:34.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:24:33.111102+0000 mgr.smithi067.rdualw (mgr.24569) 6117 : audit [DBG] from='client.38218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:24:34.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:33.316913+0000 mgr.smithi067.rdualw (mgr.24569) 6118 : cluster [DBG] pgmap v5271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:34.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:24:33.395761+0000 mgr.smithi067.rdualw (mgr.24569) 6119 : audit [DBG] from='client.38222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:24:34.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:24:33.790349+0000 mon.smithi061 (mon.0) 1379 : audit [DBG] from='client.? 172.21.15.61:0/3031888487' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:24:34.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:24:33.111102+0000 mgr.smithi067.rdualw (mgr.24569) 6117 : audit [DBG] from='client.38218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:24:34.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:33.316913+0000 mgr.smithi067.rdualw (mgr.24569) 6118 : cluster [DBG] pgmap v5271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:34.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:24:33.395761+0000 mgr.smithi067.rdualw (mgr.24569) 6119 : audit [DBG] from='client.38222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:24:34.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:24:33.790349+0000 mon.smithi061 (mon.0) 1379 : audit [DBG] from='client.? 172.21.15.61:0/3031888487' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:24:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:35.317607+0000 mgr.smithi067.rdualw (mgr.24569) 6120 : cluster [DBG] pgmap v5272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:24:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:24:35.398574+0000 mon.smithi067 (mon.1) 946 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:24:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:24:35.398807+0000 mon.smithi067 (mon.1) 947 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:24:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:24:35.399236+0000 mon.smithi061 (mon.0) 1380 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:24:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:24:35.399546+0000 mon.smithi061 (mon.0) 1381 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:24:36.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:35.317607+0000 mgr.smithi067.rdualw (mgr.24569) 6120 : cluster [DBG] pgmap v5272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:24:36.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:24:35.398574+0000 mon.smithi067 (mon.1) 946 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:24:36.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:24:35.398807+0000 mon.smithi067 (mon.1) 947 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:24:36.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:24:35.399236+0000 mon.smithi061 (mon.0) 1380 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:24:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:24:35.399546+0000 mon.smithi061 (mon.0) 1381 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:24:38.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:37.318525+0000 mgr.smithi067.rdualw (mgr.24569) 6121 : cluster [DBG] pgmap v5273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:38.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:37.318525+0000 mgr.smithi067.rdualw (mgr.24569) 6121 : cluster [DBG] pgmap v5273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:39.319292+0000 mgr.smithi067.rdualw (mgr.24569) 6122 : cluster [DBG] pgmap v5274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:40.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:39.319292+0000 mgr.smithi067.rdualw (mgr.24569) 6122 : cluster [DBG] pgmap v5274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:42.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:41.320256+0000 mgr.smithi067.rdualw (mgr.24569) 6123 : cluster [DBG] pgmap v5275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:42.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:41.320256+0000 mgr.smithi067.rdualw (mgr.24569) 6123 : cluster [DBG] pgmap v5275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:44.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:43.320903+0000 mgr.smithi067.rdualw (mgr.24569) 6124 : cluster [DBG] pgmap v5276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:44.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:43.320903+0000 mgr.smithi067.rdualw (mgr.24569) 6124 : cluster [DBG] pgmap v5276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:46.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:45.321545+0000 mgr.smithi067.rdualw (mgr.24569) 6125 : cluster [DBG] pgmap v5277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:24:46.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:45.321545+0000 mgr.smithi067.rdualw (mgr.24569) 6125 : cluster [DBG] pgmap v5277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:24:48.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:47.322378+0000 mgr.smithi067.rdualw (mgr.24569) 6126 : cluster [DBG] pgmap v5278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:48.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:47.322378+0000 mgr.smithi067.rdualw (mgr.24569) 6126 : cluster [DBG] pgmap v5278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:50.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:49.322966+0000 mgr.smithi067.rdualw (mgr.24569) 6127 : cluster [DBG] pgmap v5279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:50.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:49.322966+0000 mgr.smithi067.rdualw (mgr.24569) 6127 : cluster [DBG] pgmap v5279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:51.323825+0000 mgr.smithi067.rdualw (mgr.24569) 6128 : cluster [DBG] pgmap v5280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:52.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:51.323825+0000 mgr.smithi067.rdualw (mgr.24569) 6128 : cluster [DBG] pgmap v5280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:54.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:53.324421+0000 mgr.smithi067.rdualw (mgr.24569) 6129 : cluster [DBG] pgmap v5281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:54.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:53.324421+0000 mgr.smithi067.rdualw (mgr.24569) 6129 : cluster [DBG] pgmap v5281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:56.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:55.325295+0000 mgr.smithi067.rdualw (mgr.24569) 6130 : cluster [DBG] pgmap v5282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:24:56.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:55.325295+0000 mgr.smithi067.rdualw (mgr.24569) 6130 : cluster [DBG] pgmap v5282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:24:58.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:24:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:57.326066+0000 mgr.smithi067.rdualw (mgr.24569) 6131 : cluster [DBG] pgmap v5283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:24:58.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:24:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:57.326066+0000 mgr.smithi067.rdualw (mgr.24569) 6131 : cluster [DBG] pgmap v5283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:00.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:24:59.326621+0000 mgr.smithi067.rdualw (mgr.24569) 6132 : cluster [DBG] pgmap v5284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:00.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:24:59.326621+0000 mgr.smithi067.rdualw (mgr.24569) 6132 : cluster [DBG] pgmap v5284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:02.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:01.327748+0000 mgr.smithi067.rdualw (mgr.24569) 6133 : cluster [DBG] pgmap v5285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:01.327748+0000 mgr.smithi067.rdualw (mgr.24569) 6133 : cluster [DBG] pgmap v5285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:03.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:25:01.928477+0000 mon.smithi067 (mon.1) 948 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:25:03.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:25:01.929883+0000 mon.smithi067 (mon.1) 949 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:25:03.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:25:01.930829+0000 mon.smithi067 (mon.1) 950 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:25:03.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:25:01.931684+0000 mgr.smithi067.rdualw (mgr.24569) 6134 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:25:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:25:02.348950+0000 mon.smithi061 (mon.0) 1382 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:25:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:25:02.354285+0000 mon.smithi061 (mon.0) 1383 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:25:03.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:25:01.928477+0000 mon.smithi067 (mon.1) 948 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:25:03.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:25:01.929883+0000 mon.smithi067 (mon.1) 949 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:25:03.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:25:01.930829+0000 mon.smithi067 (mon.1) 950 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:25:03.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:25:01.931684+0000 mgr.smithi067.rdualw (mgr.24569) 6134 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:25:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:25:02.348950+0000 mon.smithi061 (mon.0) 1382 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:25:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:25:02.354285+0000 mon.smithi061 (mon.0) 1383 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:25:04.099 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:25:04.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:03.328418+0000 mgr.smithi067.rdualw (mgr.24569) 6135 : cluster [DBG] pgmap v5286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:04.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:03.328418+0000 mgr.smithi067.rdualw (mgr.24569) 6135 : cluster [DBG] pgmap v5286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:04.403 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:25:04.404 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 62s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:25:04.404 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 62s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:25:04.404 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 65s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:25:04.404 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 62s ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:25:04.405 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 62s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:25:04.405 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 65s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:25:04.405 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 62s ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:25:04.405 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 65s ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:25:04.405 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 62s ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:25:04.406 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 65s ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:25:04.406 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 62s ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:25:04.406 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 65s ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:25:04.406 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 62s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:25:04.407 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 65s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:25:04.407 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 62s ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:25:04.407 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 62s ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:25:04.407 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 62s ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:25:04.407 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 62s ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:25:04.408 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 65s ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:25:04.408 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 65s ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:25:04.408 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 65s ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:25:04.408 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 65s ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:25:04.408 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 62s ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:25:04.747 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:25:04.747 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:25:04.748 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:25:04.748 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:25:04.750 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:25:04.750 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:25:04.750 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:25:04.750 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:25:04.751 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:25:04.751 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:25:04.751 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:25:04.751 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:25:04.751 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:25:04.752 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:25:04.752 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:25:04.752 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:25:04.752 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:25:04.753 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:25:04.753 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:25:05.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:25:04.088025+0000 mgr.smithi067.rdualw (mgr.24569) 6136 : audit [DBG] from='client.38230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:25:05.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:25:04.387963+0000 mgr.smithi067.rdualw (mgr.24569) 6137 : audit [DBG] from='client.38234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:25:05.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:25:04.747721+0000 mon.smithi061 (mon.0) 1384 : audit [DBG] from='client.? 172.21.15.61:0/3142835956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:25:05.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:25:04.088025+0000 mgr.smithi067.rdualw (mgr.24569) 6136 : audit [DBG] from='client.38230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:25:05.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:25:04.387963+0000 mgr.smithi067.rdualw (mgr.24569) 6137 : audit [DBG] from='client.38234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:25:05.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:25:04.747721+0000 mon.smithi061 (mon.0) 1384 : audit [DBG] from='client.? 172.21.15.61:0/3142835956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:25:06.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:05.329063+0000 mgr.smithi067.rdualw (mgr.24569) 6138 : cluster [DBG] pgmap v5287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:25:06.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:05.329063+0000 mgr.smithi067.rdualw (mgr.24569) 6138 : cluster [DBG] pgmap v5287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:25:08.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:07.329787+0000 mgr.smithi067.rdualw (mgr.24569) 6139 : cluster [DBG] pgmap v5288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:08.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:07.329787+0000 mgr.smithi067.rdualw (mgr.24569) 6139 : cluster [DBG] pgmap v5288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:10.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:09.330334+0000 mgr.smithi067.rdualw (mgr.24569) 6140 : cluster [DBG] pgmap v5289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:10.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:09.330334+0000 mgr.smithi067.rdualw (mgr.24569) 6140 : cluster [DBG] pgmap v5289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:12.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:11.331338+0000 mgr.smithi067.rdualw (mgr.24569) 6141 : cluster [DBG] pgmap v5290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:12.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:11.331338+0000 mgr.smithi067.rdualw (mgr.24569) 6141 : cluster [DBG] pgmap v5290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:14.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:13.331937+0000 mgr.smithi067.rdualw (mgr.24569) 6142 : cluster [DBG] pgmap v5291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:14.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:13.331937+0000 mgr.smithi067.rdualw (mgr.24569) 6142 : cluster [DBG] pgmap v5291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:16.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:15.332675+0000 mgr.smithi067.rdualw (mgr.24569) 6143 : cluster [DBG] pgmap v5292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:25:16.950 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:15.332675+0000 mgr.smithi067.rdualw (mgr.24569) 6143 : cluster [DBG] pgmap v5292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:25:18.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:17.333418+0000 mgr.smithi067.rdualw (mgr.24569) 6144 : cluster [DBG] pgmap v5293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:18.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:17.333418+0000 mgr.smithi067.rdualw (mgr.24569) 6144 : cluster [DBG] pgmap v5293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:20.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:19.333980+0000 mgr.smithi067.rdualw (mgr.24569) 6145 : cluster [DBG] pgmap v5294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:20.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:19.333980+0000 mgr.smithi067.rdualw (mgr.24569) 6145 : cluster [DBG] pgmap v5294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:21.334908+0000 mgr.smithi067.rdualw (mgr.24569) 6146 : cluster [DBG] pgmap v5295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:22.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:21.334908+0000 mgr.smithi067.rdualw (mgr.24569) 6146 : cluster [DBG] pgmap v5295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:24.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:23.335580+0000 mgr.smithi067.rdualw (mgr.24569) 6147 : cluster [DBG] pgmap v5296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:24.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:23.335580+0000 mgr.smithi067.rdualw (mgr.24569) 6147 : cluster [DBG] pgmap v5296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:26.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:25.336404+0000 mgr.smithi067.rdualw (mgr.24569) 6148 : cluster [DBG] pgmap v5297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:25:26.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:25.336404+0000 mgr.smithi067.rdualw (mgr.24569) 6148 : cluster [DBG] pgmap v5297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:25:28.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:27.337214+0000 mgr.smithi067.rdualw (mgr.24569) 6149 : cluster [DBG] pgmap v5298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:28.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:27.337214+0000 mgr.smithi067.rdualw (mgr.24569) 6149 : cluster [DBG] pgmap v5298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:30.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:29.337883+0000 mgr.smithi067.rdualw (mgr.24569) 6150 : cluster [DBG] pgmap v5299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:30.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:29.337883+0000 mgr.smithi067.rdualw (mgr.24569) 6150 : cluster [DBG] pgmap v5299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:31.338795+0000 mgr.smithi067.rdualw (mgr.24569) 6151 : cluster [DBG] pgmap v5300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:31.338795+0000 mgr.smithi067.rdualw (mgr.24569) 6151 : cluster [DBG] pgmap v5300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:34.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:33.339296+0000 mgr.smithi067.rdualw (mgr.24569) 6152 : cluster [DBG] pgmap v5301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:34.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:33.339296+0000 mgr.smithi067.rdualw (mgr.24569) 6152 : cluster [DBG] pgmap v5301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:35.055 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:25:35.347 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:25:35.348 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 93s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:25:35.348 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 93s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:25:35.348 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 96s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:25:35.348 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 93s ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:25:35.349 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 93s ago 2h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:25:35.349 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 96s ago 2h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:25:35.349 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 93s ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:25:35.349 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 96s ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:25:35.349 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 93s ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:25:35.350 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 96s ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:25:35.350 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 93s ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:25:35.350 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 96s ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:25:35.350 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 93s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:25:35.351 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 96s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:25:35.351 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 93s ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:25:35.351 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 93s ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:25:35.351 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 93s ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:25:35.352 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 93s ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:25:35.352 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 96s ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:25:35.352 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 96s ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:25:35.352 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 96s ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:25:35.353 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 96s ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:25:35.353 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 93s ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:25:35.688 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:25:35.689 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:25:35.689 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:25:35.689 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:25:35.690 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:25:35.690 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:25:35.690 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:25:35.690 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:25:35.691 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:25:35.691 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:25:35.691 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:25:35.691 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:25:35.692 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:25:35.692 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:25:35.692 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:25:35.692 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:25:35.693 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:25:35.693 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:25:35.693 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:25:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:25:35.043500+0000 mgr.smithi067.rdualw (mgr.24569) 6153 : audit [DBG] from='client.38242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:25:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:25:35.331421+0000 mgr.smithi067.rdualw (mgr.24569) 6154 : audit [DBG] from='client.38246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:25:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:35.339978+0000 mgr.smithi067.rdualw (mgr.24569) 6155 : cluster [DBG] pgmap v5302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:25:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:25:35.403602+0000 mon.smithi067 (mon.1) 951 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:25:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:25:35.403958+0000 mon.smithi067 (mon.1) 952 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:25:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:25:35.404105+0000 mon.smithi061 (mon.0) 1385 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:25:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:25:35.404425+0000 mon.smithi061 (mon.0) 1386 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:25:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:25:35.688762+0000 mon.smithi061 (mon.0) 1387 : audit [DBG] from='client.? 172.21.15.61:0/3912096859' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:25:36.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:25:35.043500+0000 mgr.smithi067.rdualw (mgr.24569) 6153 : audit [DBG] from='client.38242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:25:36.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:25:35.331421+0000 mgr.smithi067.rdualw (mgr.24569) 6154 : audit [DBG] from='client.38246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:25:36.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:35.339978+0000 mgr.smithi067.rdualw (mgr.24569) 6155 : cluster [DBG] pgmap v5302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:25:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:25:35.403602+0000 mon.smithi067 (mon.1) 951 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:25:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:25:35.403958+0000 mon.smithi067 (mon.1) 952 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:25:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:25:35.404105+0000 mon.smithi061 (mon.0) 1385 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:25:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:25:35.404425+0000 mon.smithi061 (mon.0) 1386 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:25:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:25:35.688762+0000 mon.smithi061 (mon.0) 1387 : audit [DBG] from='client.? 172.21.15.61:0/3912096859' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:25:38.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:37.340849+0000 mgr.smithi067.rdualw (mgr.24569) 6156 : cluster [DBG] pgmap v5303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:38.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:37.340849+0000 mgr.smithi067.rdualw (mgr.24569) 6156 : cluster [DBG] pgmap v5303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:40.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:39.341440+0000 mgr.smithi067.rdualw (mgr.24569) 6157 : cluster [DBG] pgmap v5304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:40.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:39.341440+0000 mgr.smithi067.rdualw (mgr.24569) 6157 : cluster [DBG] pgmap v5304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:41.342423+0000 mgr.smithi067.rdualw (mgr.24569) 6158 : cluster [DBG] pgmap v5305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:42.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:41.342423+0000 mgr.smithi067.rdualw (mgr.24569) 6158 : cluster [DBG] pgmap v5305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:44.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:43.343209+0000 mgr.smithi067.rdualw (mgr.24569) 6159 : cluster [DBG] pgmap v5306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:44.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:43.343209+0000 mgr.smithi067.rdualw (mgr.24569) 6159 : cluster [DBG] pgmap v5306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:46.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:45.344004+0000 mgr.smithi067.rdualw (mgr.24569) 6160 : cluster [DBG] pgmap v5307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:25:46.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:45.344004+0000 mgr.smithi067.rdualw (mgr.24569) 6160 : cluster [DBG] pgmap v5307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:25:48.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:47.344969+0000 mgr.smithi067.rdualw (mgr.24569) 6161 : cluster [DBG] pgmap v5308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:48.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:47.344969+0000 mgr.smithi067.rdualw (mgr.24569) 6161 : cluster [DBG] pgmap v5308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:50.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:49.345573+0000 mgr.smithi067.rdualw (mgr.24569) 6162 : cluster [DBG] pgmap v5309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:50.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:49.345573+0000 mgr.smithi067.rdualw (mgr.24569) 6162 : cluster [DBG] pgmap v5309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:51.346471+0000 mgr.smithi067.rdualw (mgr.24569) 6163 : cluster [DBG] pgmap v5310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:52.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:51.346471+0000 mgr.smithi067.rdualw (mgr.24569) 6163 : cluster [DBG] pgmap v5310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:54.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:53.347195+0000 mgr.smithi067.rdualw (mgr.24569) 6164 : cluster [DBG] pgmap v5311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:54.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:53.347195+0000 mgr.smithi067.rdualw (mgr.24569) 6164 : cluster [DBG] pgmap v5311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:56.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:55.348148+0000 mgr.smithi067.rdualw (mgr.24569) 6165 : cluster [DBG] pgmap v5312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:25:56.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:55.348148+0000 mgr.smithi067.rdualw (mgr.24569) 6165 : cluster [DBG] pgmap v5312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:25:58.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:25:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:57.348833+0000 mgr.smithi067.rdualw (mgr.24569) 6166 : cluster [DBG] pgmap v5313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:25:58.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:25:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:57.348833+0000 mgr.smithi067.rdualw (mgr.24569) 6166 : cluster [DBG] pgmap v5313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:00.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:25:59.349355+0000 mgr.smithi067.rdualw (mgr.24569) 6167 : cluster [DBG] pgmap v5314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:00.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:25:59.349355+0000 mgr.smithi067.rdualw (mgr.24569) 6167 : cluster [DBG] pgmap v5314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:02.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:01.350261+0000 mgr.smithi067.rdualw (mgr.24569) 6168 : cluster [DBG] pgmap v5315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:02.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:01.350261+0000 mgr.smithi067.rdualw (mgr.24569) 6168 : cluster [DBG] pgmap v5315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:03.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:26:02.357703+0000 mon.smithi067 (mon.1) 953 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:26:03.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:26:02.359295+0000 mon.smithi067 (mon.1) 954 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:26:03.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:26:02.360370+0000 mon.smithi067 (mon.1) 955 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:26:03.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:26:02.361282+0000 mgr.smithi067.rdualw (mgr.24569) 6169 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:26:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:26:02.715149+0000 mon.smithi061 (mon.0) 1388 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:26:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:26:02.727300+0000 mon.smithi061 (mon.0) 1389 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:26:03.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:26:02.357703+0000 mon.smithi067 (mon.1) 953 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:26:03.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:26:02.359295+0000 mon.smithi067 (mon.1) 954 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:26:03.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:26:02.360370+0000 mon.smithi067 (mon.1) 955 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:26:03.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:26:02.361282+0000 mgr.smithi067.rdualw (mgr.24569) 6169 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:26:03.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:26:02.715149+0000 mon.smithi061 (mon.0) 1388 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:26:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:26:02.727300+0000 mon.smithi061 (mon.0) 1389 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:26:04.445 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:26:03.131705+0000 mon.smithi061 (mon.0) 1390 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:26:04.445 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:26:03.137489+0000 mon.smithi061 (mon.0) 1391 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:26:04.446 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:03.350793+0000 mgr.smithi067.rdualw (mgr.24569) 6170 : cluster [DBG] pgmap v5316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:04.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:26:03.131705+0000 mon.smithi061 (mon.0) 1390 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:26:04.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:26:03.137489+0000 mon.smithi061 (mon.0) 1391 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:26:04.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:03.350793+0000 mgr.smithi067.rdualw (mgr.24569) 6170 : cluster [DBG] pgmap v5316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:06.021 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:26:06.315 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:26:06.315 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 2m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:26:06.316 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 2m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:26:06.316 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 2m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:26:06.316 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 2m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:26:06.316 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 2m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:26:06.316 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 2m ago 3h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:26:06.317 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 2m ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:26:06.317 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 2m ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:26:06.317 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 2m ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:26:06.317 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 2m ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:26:06.318 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 2m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:26:06.318 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 2m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:26:06.318 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 2m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:26:06.318 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 2m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:26:06.318 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 2m ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:26:06.319 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 2m ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:26:06.319 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 2m ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:26:06.319 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 2m ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:26:06.319 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 2m ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:26:06.320 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 2m ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:26:06.320 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 2m ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:26:06.320 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 2m ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:26:06.320 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 2m ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:26:06.656 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:26:06.656 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:26:06.656 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:26:06.657 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:26:06.657 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:26:06.657 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:26:06.657 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:26:06.658 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:26:06.658 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:26:06.658 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:26:06.658 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:26:06.659 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:26:06.659 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:26:06.659 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:26:06.659 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:26:06.659 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:26:06.660 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:26:06.660 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:26:06.660 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:26:06.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:05.351764+0000 mgr.smithi067.rdualw (mgr.24569) 6171 : cluster [DBG] pgmap v5317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:26:06.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:05.351764+0000 mgr.smithi067.rdualw (mgr.24569) 6171 : cluster [DBG] pgmap v5317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:26:07.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:26:06.009908+0000 mgr.smithi067.rdualw (mgr.24569) 6172 : audit [DBG] from='client.38254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:26:07.899 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:26:06.299157+0000 mgr.smithi067.rdualw (mgr.24569) 6173 : audit [DBG] from='client.38258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:26:07.899 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:26:06.656503+0000 mon.smithi061 (mon.0) 1392 : audit [DBG] from='client.? 172.21.15.61:0/1871395081' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:26:07.900 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:26:06.009908+0000 mgr.smithi067.rdualw (mgr.24569) 6172 : audit [DBG] from='client.38254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:26:07.900 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:26:06.299157+0000 mgr.smithi067.rdualw (mgr.24569) 6173 : audit [DBG] from='client.38258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:26:07.901 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:26:06.656503+0000 mon.smithi061 (mon.0) 1392 : audit [DBG] from='client.? 172.21.15.61:0/1871395081' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:26:08.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:07.352457+0000 mgr.smithi067.rdualw (mgr.24569) 6174 : cluster [DBG] pgmap v5318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:08.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:07.352457+0000 mgr.smithi067.rdualw (mgr.24569) 6174 : cluster [DBG] pgmap v5318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:10.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:09.353047+0000 mgr.smithi067.rdualw (mgr.24569) 6175 : cluster [DBG] pgmap v5319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:10.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:09.353047+0000 mgr.smithi067.rdualw (mgr.24569) 6175 : cluster [DBG] pgmap v5319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:12.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:11.353942+0000 mgr.smithi067.rdualw (mgr.24569) 6176 : cluster [DBG] pgmap v5320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:12.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:11.353942+0000 mgr.smithi067.rdualw (mgr.24569) 6176 : cluster [DBG] pgmap v5320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:14.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:13.354422+0000 mgr.smithi067.rdualw (mgr.24569) 6177 : cluster [DBG] pgmap v5321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:14.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:13.354422+0000 mgr.smithi067.rdualw (mgr.24569) 6177 : cluster [DBG] pgmap v5321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:16.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:15.355372+0000 mgr.smithi067.rdualw (mgr.24569) 6178 : cluster [DBG] pgmap v5322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:26:16.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:15.355372+0000 mgr.smithi067.rdualw (mgr.24569) 6178 : cluster [DBG] pgmap v5322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:26:18.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:17.356214+0000 mgr.smithi067.rdualw (mgr.24569) 6179 : cluster [DBG] pgmap v5323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:18.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:17.356214+0000 mgr.smithi067.rdualw (mgr.24569) 6179 : cluster [DBG] pgmap v5323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:20.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:19.356769+0000 mgr.smithi067.rdualw (mgr.24569) 6180 : cluster [DBG] pgmap v5324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:20.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:19.356769+0000 mgr.smithi067.rdualw (mgr.24569) 6180 : cluster [DBG] pgmap v5324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:21.357654+0000 mgr.smithi067.rdualw (mgr.24569) 6181 : cluster [DBG] pgmap v5325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:22.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:21.357654+0000 mgr.smithi067.rdualw (mgr.24569) 6181 : cluster [DBG] pgmap v5325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:24.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:23.358366+0000 mgr.smithi067.rdualw (mgr.24569) 6182 : cluster [DBG] pgmap v5326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:24.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:23.358366+0000 mgr.smithi067.rdualw (mgr.24569) 6182 : cluster [DBG] pgmap v5326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:26.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:25.359363+0000 mgr.smithi067.rdualw (mgr.24569) 6183 : cluster [DBG] pgmap v5327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:26:26.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:25.359363+0000 mgr.smithi067.rdualw (mgr.24569) 6183 : cluster [DBG] pgmap v5327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:26:28.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:27.360181+0000 mgr.smithi067.rdualw (mgr.24569) 6184 : cluster [DBG] pgmap v5328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:28.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:27.360181+0000 mgr.smithi067.rdualw (mgr.24569) 6184 : cluster [DBG] pgmap v5328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:30.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:29.360752+0000 mgr.smithi067.rdualw (mgr.24569) 6185 : cluster [DBG] pgmap v5329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:30.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:29.360752+0000 mgr.smithi067.rdualw (mgr.24569) 6185 : cluster [DBG] pgmap v5329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:32.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:31.361577+0000 mgr.smithi067.rdualw (mgr.24569) 6186 : cluster [DBG] pgmap v5330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:31.361577+0000 mgr.smithi067.rdualw (mgr.24569) 6186 : cluster [DBG] pgmap v5330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:34.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:33.362197+0000 mgr.smithi067.rdualw (mgr.24569) 6187 : cluster [DBG] pgmap v5331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:34.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:33.362197+0000 mgr.smithi067.rdualw (mgr.24569) 6187 : cluster [DBG] pgmap v5331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:26:35.408848+0000 mon.smithi067 (mon.1) 956 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:26:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:26:35.409184+0000 mon.smithi067 (mon.1) 957 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:26:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:26:35.409294+0000 mon.smithi061 (mon.0) 1393 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:26:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:26:35.409552+0000 mon.smithi061 (mon.0) 1394 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:26:35.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:26:35.408848+0000 mon.smithi067 (mon.1) 956 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:26:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:26:35.409184+0000 mon.smithi067 (mon.1) 957 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:26:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:26:35.409294+0000 mon.smithi061 (mon.0) 1393 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:26:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:26:35.409552+0000 mon.smithi061 (mon.0) 1394 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:26:36.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:35.362970+0000 mgr.smithi067.rdualw (mgr.24569) 6188 : cluster [DBG] pgmap v5332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:26:36.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:35.362970+0000 mgr.smithi067.rdualw (mgr.24569) 6188 : cluster [DBG] pgmap v5332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:26:36.964 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:26:37.255 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:26:37.256 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 2m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:26:37.256 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 2m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:26:37.256 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 2m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:26:37.256 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 2m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:26:37.257 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 2m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:26:37.257 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 2m ago 3h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:26:37.257 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 2m ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:26:37.257 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 2m ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:26:37.257 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 2m ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:26:37.258 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 2m ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:26:37.258 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 2m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:26:37.259 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 2m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:26:37.259 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 2m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:26:37.259 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 2m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:26:37.259 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 2m ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:26:37.259 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 2m ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:26:37.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 2m ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:26:37.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 2m ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:26:37.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 2m ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:26:37.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 2m ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:26:37.261 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 2m ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:26:37.261 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 2m ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:26:37.261 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 2m ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:26:37.600 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:26:37.600 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:26:37.601 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:26:37.601 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:26:37.601 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:26:37.601 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:26:37.601 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:26:37.602 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:26:37.602 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:26:37.602 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:26:37.602 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:26:37.603 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:26:37.603 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:26:37.603 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:26:37.603 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:26:37.604 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:26:37.604 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:26:37.604 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:26:37.604 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:26:38.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:26:36.952203+0000 mgr.smithi067.rdualw (mgr.24569) 6189 : audit [DBG] from='client.38266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:26:38.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:26:37.239968+0000 mgr.smithi067.rdualw (mgr.24569) 6190 : audit [DBG] from='client.38270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:26:38.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:37.363567+0000 mgr.smithi067.rdualw (mgr.24569) 6191 : cluster [DBG] pgmap v5333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:26:37.600771+0000 mon.smithi061 (mon.0) 1395 : audit [DBG] from='client.? 172.21.15.61:0/2116447187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:26:38.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:26:36.952203+0000 mgr.smithi067.rdualw (mgr.24569) 6189 : audit [DBG] from='client.38266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:26:38.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:26:37.239968+0000 mgr.smithi067.rdualw (mgr.24569) 6190 : audit [DBG] from='client.38270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:26:38.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:37.363567+0000 mgr.smithi067.rdualw (mgr.24569) 6191 : cluster [DBG] pgmap v5333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:26:37.600771+0000 mon.smithi061 (mon.0) 1395 : audit [DBG] from='client.? 172.21.15.61:0/2116447187' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:26:40.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:39.364124+0000 mgr.smithi067.rdualw (mgr.24569) 6192 : cluster [DBG] pgmap v5334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:40.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:39.364124+0000 mgr.smithi067.rdualw (mgr.24569) 6192 : cluster [DBG] pgmap v5334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:42.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:41.365049+0000 mgr.smithi067.rdualw (mgr.24569) 6193 : cluster [DBG] pgmap v5335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:42.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:41.365049+0000 mgr.smithi067.rdualw (mgr.24569) 6193 : cluster [DBG] pgmap v5335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:44.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:43.365646+0000 mgr.smithi067.rdualw (mgr.24569) 6194 : cluster [DBG] pgmap v5336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:44.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:43.365646+0000 mgr.smithi067.rdualw (mgr.24569) 6194 : cluster [DBG] pgmap v5336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:46.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:45.366347+0000 mgr.smithi067.rdualw (mgr.24569) 6195 : cluster [DBG] pgmap v5337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:26:46.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:45.366347+0000 mgr.smithi067.rdualw (mgr.24569) 6195 : cluster [DBG] pgmap v5337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:26:48.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:47.367185+0000 mgr.smithi067.rdualw (mgr.24569) 6196 : cluster [DBG] pgmap v5338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:48.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:47.367185+0000 mgr.smithi067.rdualw (mgr.24569) 6196 : cluster [DBG] pgmap v5338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:50.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:49.367800+0000 mgr.smithi067.rdualw (mgr.24569) 6197 : cluster [DBG] pgmap v5339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:50.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:49.367800+0000 mgr.smithi067.rdualw (mgr.24569) 6197 : cluster [DBG] pgmap v5339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:51.368857+0000 mgr.smithi067.rdualw (mgr.24569) 6198 : cluster [DBG] pgmap v5340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:51.368857+0000 mgr.smithi067.rdualw (mgr.24569) 6198 : cluster [DBG] pgmap v5340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:54.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:53.369377+0000 mgr.smithi067.rdualw (mgr.24569) 6199 : cluster [DBG] pgmap v5341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:54.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:53.369377+0000 mgr.smithi067.rdualw (mgr.24569) 6199 : cluster [DBG] pgmap v5341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:56.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:55.370292+0000 mgr.smithi067.rdualw (mgr.24569) 6200 : cluster [DBG] pgmap v5342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:26:56.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:55.370292+0000 mgr.smithi067.rdualw (mgr.24569) 6200 : cluster [DBG] pgmap v5342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:26:58.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:26:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:57.371065+0000 mgr.smithi067.rdualw (mgr.24569) 6201 : cluster [DBG] pgmap v5343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:26:58.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:26:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:57.371065+0000 mgr.smithi067.rdualw (mgr.24569) 6201 : cluster [DBG] pgmap v5343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:00.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:26:59.371621+0000 mgr.smithi067.rdualw (mgr.24569) 6202 : cluster [DBG] pgmap v5344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:00.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:26:59.371621+0000 mgr.smithi067.rdualw (mgr.24569) 6202 : cluster [DBG] pgmap v5344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:02.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:01.372411+0000 mgr.smithi067.rdualw (mgr.24569) 6203 : cluster [DBG] pgmap v5345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:01.372411+0000 mgr.smithi067.rdualw (mgr.24569) 6203 : cluster [DBG] pgmap v5345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:03.455 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:27:03.140772+0000 mon.smithi067 (mon.1) 958 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:27:03.455 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:27:03.142200+0000 mon.smithi067 (mon.1) 959 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:27:03.456 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:27:03.143164+0000 mon.smithi067 (mon.1) 960 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:27:03.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:27:03.140772+0000 mon.smithi067 (mon.1) 958 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:27:03.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:27:03.142200+0000 mon.smithi067 (mon.1) 959 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:27:03.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:27:03.143164+0000 mon.smithi067 (mon.1) 960 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:27:04.455 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:27:03.143996+0000 mgr.smithi067.rdualw (mgr.24569) 6204 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:27:04.456 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:03.372833+0000 mgr.smithi067.rdualw (mgr.24569) 6205 : cluster [DBG] pgmap v5346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:04.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:27:03.143996+0000 mgr.smithi067.rdualw (mgr.24569) 6204 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:27:04.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:03.372833+0000 mgr.smithi067.rdualw (mgr.24569) 6205 : cluster [DBG] pgmap v5346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:06.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:05.373570+0000 mgr.smithi067.rdualw (mgr.24569) 6206 : cluster [DBG] pgmap v5347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:27:06.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:27:06.291768+0000 mon.smithi061 (mon.0) 1396 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:27:06.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:05.373570+0000 mgr.smithi067.rdualw (mgr.24569) 6206 : cluster [DBG] pgmap v5347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:27:06.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:27:06.291768+0000 mon.smithi061 (mon.0) 1396 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:27:07.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:27:06.600526+0000 mon.smithi061 (mon.0) 1397 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:27:07.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:27:06.607352+0000 mon.smithi061 (mon.0) 1398 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:27:07.914 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:27:08.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:27:06.600526+0000 mon.smithi061 (mon.0) 1397 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:27:08.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:27:06.607352+0000 mon.smithi061 (mon.0) 1398 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:27:08.209 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:27:08.209 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 3m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:27:08.210 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 3m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:27:08.210 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 3m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:27:08.210 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 3m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:27:08.210 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 3m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:27:08.210 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 3m ago 3h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:27:08.211 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 3m ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:27:08.211 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 3m ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:27:08.211 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 3m ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:27:08.211 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 3m ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:27:08.212 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 3m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:27:08.212 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 3m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:27:08.212 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 3m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:27:08.212 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 3m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:27:08.212 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 3m ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:27:08.213 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 3m ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:27:08.213 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 3m ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:27:08.213 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 3m ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:27:08.213 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 3m ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:27:08.214 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 3m ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:27:08.214 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 3m ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:27:08.214 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 3m ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:27:08.214 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 3m ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:27:08.550 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:27:08.550 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:27:08.551 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:27:08.551 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:27:08.551 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:27:08.551 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:27:08.552 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:27:08.552 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:27:08.552 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:27:08.553 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:27:08.553 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:27:08.553 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:27:08.554 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:27:08.554 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:27:08.554 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:27:08.554 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:27:08.555 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:27:08.555 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:27:08.555 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:27:08.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:07.374340+0000 mgr.smithi067.rdualw (mgr.24569) 6207 : cluster [DBG] pgmap v5348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:08.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:27:08.551018+0000 mon.smithi061 (mon.0) 1399 : audit [DBG] from='client.? 172.21.15.61:0/459203152' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:27:09.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:07.374340+0000 mgr.smithi067.rdualw (mgr.24569) 6207 : cluster [DBG] pgmap v5348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:09.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:27:08.551018+0000 mon.smithi061 (mon.0) 1399 : audit [DBG] from='client.? 172.21.15.61:0/459203152' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:27:09.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:27:07.902523+0000 mgr.smithi067.rdualw (mgr.24569) 6208 : audit [DBG] from='client.38278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:27:09.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:27:08.192998+0000 mgr.smithi067.rdualw (mgr.24569) 6209 : audit [DBG] from='client.38282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:27:10.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:27:07.902523+0000 mgr.smithi067.rdualw (mgr.24569) 6208 : audit [DBG] from='client.38278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:27:10.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:27:08.192998+0000 mgr.smithi067.rdualw (mgr.24569) 6209 : audit [DBG] from='client.38282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:27:10.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:09.375059+0000 mgr.smithi067.rdualw (mgr.24569) 6210 : cluster [DBG] pgmap v5349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:11.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:09.375059+0000 mgr.smithi067.rdualw (mgr.24569) 6210 : cluster [DBG] pgmap v5349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:12.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:11.375877+0000 mgr.smithi067.rdualw (mgr.24569) 6211 : cluster [DBG] pgmap v5350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:12.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:11.375877+0000 mgr.smithi067.rdualw (mgr.24569) 6211 : cluster [DBG] pgmap v5350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:14.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:13.376464+0000 mgr.smithi067.rdualw (mgr.24569) 6212 : cluster [DBG] pgmap v5351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:13.376464+0000 mgr.smithi067.rdualw (mgr.24569) 6212 : cluster [DBG] pgmap v5351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:16.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:15.377279+0000 mgr.smithi067.rdualw (mgr.24569) 6213 : cluster [DBG] pgmap v5352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:27:16.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:15.377279+0000 mgr.smithi067.rdualw (mgr.24569) 6213 : cluster [DBG] pgmap v5352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:27:18.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:17.378028+0000 mgr.smithi067.rdualw (mgr.24569) 6214 : cluster [DBG] pgmap v5353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:18.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:17.378028+0000 mgr.smithi067.rdualw (mgr.24569) 6214 : cluster [DBG] pgmap v5353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:20.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:19.378653+0000 mgr.smithi067.rdualw (mgr.24569) 6215 : cluster [DBG] pgmap v5354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:20.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:19.378653+0000 mgr.smithi067.rdualw (mgr.24569) 6215 : cluster [DBG] pgmap v5354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:21.379595+0000 mgr.smithi067.rdualw (mgr.24569) 6216 : cluster [DBG] pgmap v5355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:22.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:21.379595+0000 mgr.smithi067.rdualw (mgr.24569) 6216 : cluster [DBG] pgmap v5355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:24.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:23.380103+0000 mgr.smithi067.rdualw (mgr.24569) 6217 : cluster [DBG] pgmap v5356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:24.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:23.380103+0000 mgr.smithi067.rdualw (mgr.24569) 6217 : cluster [DBG] pgmap v5356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:26.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:25.380881+0000 mgr.smithi067.rdualw (mgr.24569) 6218 : cluster [DBG] pgmap v5357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:27:26.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:25.380881+0000 mgr.smithi067.rdualw (mgr.24569) 6218 : cluster [DBG] pgmap v5357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:27:28.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:27.381586+0000 mgr.smithi067.rdualw (mgr.24569) 6219 : cluster [DBG] pgmap v5358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:28.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:27.381586+0000 mgr.smithi067.rdualw (mgr.24569) 6219 : cluster [DBG] pgmap v5358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:30.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:29.382221+0000 mgr.smithi067.rdualw (mgr.24569) 6220 : cluster [DBG] pgmap v5359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:30.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:29.382221+0000 mgr.smithi067.rdualw (mgr.24569) 6220 : cluster [DBG] pgmap v5359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:31.383284+0000 mgr.smithi067.rdualw (mgr.24569) 6221 : cluster [DBG] pgmap v5360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:32.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:31.383284+0000 mgr.smithi067.rdualw (mgr.24569) 6221 : cluster [DBG] pgmap v5360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:34.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:33.383820+0000 mgr.smithi067.rdualw (mgr.24569) 6222 : cluster [DBG] pgmap v5361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:34.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:33.383820+0000 mgr.smithi067.rdualw (mgr.24569) 6222 : cluster [DBG] pgmap v5361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:35.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:27:35.415024+0000 mon.smithi067 (mon.1) 961 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:27:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:27:35.415285+0000 mon.smithi067 (mon.1) 962 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:27:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:27:35.415665+0000 mon.smithi061 (mon.0) 1400 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:27:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:27:35.416163+0000 mon.smithi061 (mon.0) 1401 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:27:35.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:27:35.415024+0000 mon.smithi067 (mon.1) 961 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:27:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:27:35.415285+0000 mon.smithi067 (mon.1) 962 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:27:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:27:35.415665+0000 mon.smithi061 (mon.0) 1400 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:27:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:27:35.416163+0000 mon.smithi061 (mon.0) 1401 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:27:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:35.384729+0000 mgr.smithi067.rdualw (mgr.24569) 6223 : cluster [DBG] pgmap v5362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:27:36.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:35.384729+0000 mgr.smithi067.rdualw (mgr.24569) 6223 : cluster [DBG] pgmap v5362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:27:38.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:37.385520+0000 mgr.smithi067.rdualw (mgr.24569) 6224 : cluster [DBG] pgmap v5363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:38.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:37.385520+0000 mgr.smithi067.rdualw (mgr.24569) 6224 : cluster [DBG] pgmap v5363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:38.919 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:27:39.251 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:27:39.251 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 3m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:27:39.252 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 3m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:27:39.252 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 3m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:27:39.252 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 3m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:27:39.252 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 3m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:27:39.253 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 3m ago 3h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:27:39.253 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 3m ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:27:39.257 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 3m ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:27:39.257 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 3m ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:27:39.258 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 3m ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:27:39.258 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (2h) 3m ago 2h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:27:39.258 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (2h) 3m ago 2h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:27:39.258 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 3m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:27:39.259 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 3m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:27:39.259 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 3m ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:27:39.259 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 3m ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:27:39.259 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 3m ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:27:39.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 3m ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:27:39.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 3m ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:27:39.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 3m ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:27:39.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 3m ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:27:39.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 3m ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:27:39.261 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 3m ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:27:39.621 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:27:39.622 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:27:39.622 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:27:39.622 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:27:39.623 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:27:39.623 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:27:39.623 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:27:39.623 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:27:39.624 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:27:39.624 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:27:39.624 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:27:39.624 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:27:39.624 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:27:39.625 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:27:39.625 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:27:39.625 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:27:39.625 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:27:39.625 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:27:39.626 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:27:40.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:27:38.905606+0000 mgr.smithi067.rdualw (mgr.24569) 6225 : audit [DBG] from='client.38290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:27:40.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:27:39.235241+0000 mgr.smithi067.rdualw (mgr.24569) 6226 : audit [DBG] from='client.38294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:27:40.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:39.386138+0000 mgr.smithi067.rdualw (mgr.24569) 6227 : cluster [DBG] pgmap v5364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:27:39.622428+0000 mon.smithi061 (mon.0) 1402 : audit [DBG] from='client.? 172.21.15.61:0/1583777742' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:27:40.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:27:38.905606+0000 mgr.smithi067.rdualw (mgr.24569) 6225 : audit [DBG] from='client.38290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:27:40.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:27:39.235241+0000 mgr.smithi067.rdualw (mgr.24569) 6226 : audit [DBG] from='client.38294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:27:40.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:39.386138+0000 mgr.smithi067.rdualw (mgr.24569) 6227 : cluster [DBG] pgmap v5364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:40.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:27:39.622428+0000 mon.smithi061 (mon.0) 1402 : audit [DBG] from='client.? 172.21.15.61:0/1583777742' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:27:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:41.387192+0000 mgr.smithi067.rdualw (mgr.24569) 6228 : cluster [DBG] pgmap v5365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:42.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:41.387192+0000 mgr.smithi067.rdualw (mgr.24569) 6228 : cluster [DBG] pgmap v5365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:44.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:43.387950+0000 mgr.smithi067.rdualw (mgr.24569) 6229 : cluster [DBG] pgmap v5366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:44.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:43.387950+0000 mgr.smithi067.rdualw (mgr.24569) 6229 : cluster [DBG] pgmap v5366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:46.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:45.388904+0000 mgr.smithi067.rdualw (mgr.24569) 6230 : cluster [DBG] pgmap v5367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:27:46.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:45.388904+0000 mgr.smithi067.rdualw (mgr.24569) 6230 : cluster [DBG] pgmap v5367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:27:48.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:47.389519+0000 mgr.smithi067.rdualw (mgr.24569) 6231 : cluster [DBG] pgmap v5368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:48.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:47.389519+0000 mgr.smithi067.rdualw (mgr.24569) 6231 : cluster [DBG] pgmap v5368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:50.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:49.390038+0000 mgr.smithi067.rdualw (mgr.24569) 6232 : cluster [DBG] pgmap v5369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:50.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:49.390038+0000 mgr.smithi067.rdualw (mgr.24569) 6232 : cluster [DBG] pgmap v5369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:52.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:51.390916+0000 mgr.smithi067.rdualw (mgr.24569) 6233 : cluster [DBG] pgmap v5370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:51.390916+0000 mgr.smithi067.rdualw (mgr.24569) 6233 : cluster [DBG] pgmap v5370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:54.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:53.391461+0000 mgr.smithi067.rdualw (mgr.24569) 6234 : cluster [DBG] pgmap v5371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:54.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:53.391461+0000 mgr.smithi067.rdualw (mgr.24569) 6234 : cluster [DBG] pgmap v5371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:56.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:55.392235+0000 mgr.smithi067.rdualw (mgr.24569) 6235 : cluster [DBG] pgmap v5372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:27:56.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:55.392235+0000 mgr.smithi067.rdualw (mgr.24569) 6235 : cluster [DBG] pgmap v5372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:27:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:27:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:57.392867+0000 mgr.smithi067.rdualw (mgr.24569) 6236 : cluster [DBG] pgmap v5373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:27:58.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:27:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:57.392867+0000 mgr.smithi067.rdualw (mgr.24569) 6236 : cluster [DBG] pgmap v5373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:00.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:27:59.393620+0000 mgr.smithi067.rdualw (mgr.24569) 6237 : cluster [DBG] pgmap v5374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:00.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:27:59.393620+0000 mgr.smithi067.rdualw (mgr.24569) 6237 : cluster [DBG] pgmap v5374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:02.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:01.394665+0000 mgr.smithi067.rdualw (mgr.24569) 6238 : cluster [DBG] pgmap v5375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:01.394665+0000 mgr.smithi067.rdualw (mgr.24569) 6238 : cluster [DBG] pgmap v5375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:04.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:03.395371+0000 mgr.smithi067.rdualw (mgr.24569) 6239 : cluster [DBG] pgmap v5376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:04.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:03.395371+0000 mgr.smithi067.rdualw (mgr.24569) 6239 : cluster [DBG] pgmap v5376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:06.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:05.396223+0000 mgr.smithi067.rdualw (mgr.24569) 6240 : cluster [DBG] pgmap v5377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:28:06.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:05.396223+0000 mgr.smithi067.rdualw (mgr.24569) 6240 : cluster [DBG] pgmap v5377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:28:07.529 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:28:06.611922+0000 mon.smithi067 (mon.1) 963 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:28:07.530 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:28:06.613398+0000 mon.smithi067 (mon.1) 964 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:28:07.530 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:28:06.614302+0000 mon.smithi067 (mon.1) 965 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:28:07.530 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:28:06.615153+0000 mgr.smithi067.rdualw (mgr.24569) 6241 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:28:07.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:28:06.611922+0000 mon.smithi067 (mon.1) 963 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:28:07.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:28:06.613398+0000 mon.smithi067 (mon.1) 964 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:28:07.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:28:06.614302+0000 mon.smithi067 (mon.1) 965 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:28:07.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:28:06.615153+0000 mgr.smithi067.rdualw (mgr.24569) 6241 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:28:08.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:07.396810+0000 mgr.smithi067.rdualw (mgr.24569) 6242 : cluster [DBG] pgmap v5378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:08.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:07.396810+0000 mgr.smithi067.rdualw (mgr.24569) 6242 : cluster [DBG] pgmap v5378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:09.932 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:28:10.225 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:28:10.225 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 4m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:28:10.226 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 4m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:28:10.226 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 4m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:28:10.226 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 4m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:28:10.226 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 4m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:28:10.227 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 4m ago 3h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:28:10.227 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (2h) 4m ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:28:10.227 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (2h) 4m ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:28:10.227 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 4m ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:28:10.228 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 4m ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:28:10.228 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 4m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:28:10.228 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 4m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:28:10.228 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 4m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:28:10.229 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 4m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:28:10.229 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 4m ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:28:10.229 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 4m ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:28:10.229 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 4m ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:28:10.230 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 4m ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:28:10.230 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 4m ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:28:10.230 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 4m ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:28:10.230 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 4m ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:28:10.230 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 4m ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:28:10.231 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 4m ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:28:10.573 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:28:10.573 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:28:10.573 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:28:10.573 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:28:10.574 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:28:10.574 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:28:10.574 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:28:10.574 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:28:10.575 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:28:10.575 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:28:10.575 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:28:10.575 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:28:10.576 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:28:10.576 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:28:10.576 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:28:10.576 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:28:10.576 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:28:10.577 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:28:10.577 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:28:10.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:09.397301+0000 mgr.smithi067.rdualw (mgr.24569) 6243 : cluster [DBG] pgmap v5379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:10.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:28:09.633288+0000 mon.smithi061 (mon.0) 1403 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:28:10.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:28:10.034575+0000 mon.smithi061 (mon.0) 1404 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:28:10.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:28:10.040165+0000 mon.smithi061 (mon.0) 1405 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:28:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:28:10.573513+0000 mon.smithi061 (mon.0) 1406 : audit [DBG] from='client.? 172.21.15.61:0/2203014661' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:28:11.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:09.397301+0000 mgr.smithi067.rdualw (mgr.24569) 6243 : cluster [DBG] pgmap v5379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:11.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:28:09.633288+0000 mon.smithi061 (mon.0) 1403 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:28:11.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:28:10.034575+0000 mon.smithi061 (mon.0) 1404 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:28:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:28:10.040165+0000 mon.smithi061 (mon.0) 1405 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:28:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:28:10.573513+0000 mon.smithi061 (mon.0) 1406 : audit [DBG] from='client.? 172.21.15.61:0/2203014661' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:28:11.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:28:09.920827+0000 mgr.smithi067.rdualw (mgr.24569) 6244 : audit [DBG] from='client.38302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:28:11.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:28:10.210846+0000 mgr.smithi067.rdualw (mgr.24569) 6245 : audit [DBG] from='client.38306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:28:12.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:28:09.920827+0000 mgr.smithi067.rdualw (mgr.24569) 6244 : audit [DBG] from='client.38302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:28:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:28:10.210846+0000 mgr.smithi067.rdualw (mgr.24569) 6245 : audit [DBG] from='client.38306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:28:12.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:11.398219+0000 mgr.smithi067.rdualw (mgr.24569) 6246 : cluster [DBG] pgmap v5380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:13.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:11.398219+0000 mgr.smithi067.rdualw (mgr.24569) 6246 : cluster [DBG] pgmap v5380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:14.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:13.398856+0000 mgr.smithi067.rdualw (mgr.24569) 6247 : cluster [DBG] pgmap v5381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:15.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:13.398856+0000 mgr.smithi067.rdualw (mgr.24569) 6247 : cluster [DBG] pgmap v5381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:16.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:15.399993+0000 mgr.smithi067.rdualw (mgr.24569) 6248 : cluster [DBG] pgmap v5382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:28:17.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:15.399993+0000 mgr.smithi067.rdualw (mgr.24569) 6248 : cluster [DBG] pgmap v5382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:28:18.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:17.400747+0000 mgr.smithi067.rdualw (mgr.24569) 6249 : cluster [DBG] pgmap v5383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:19.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:17.400747+0000 mgr.smithi067.rdualw (mgr.24569) 6249 : cluster [DBG] pgmap v5383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:20.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:19.401441+0000 mgr.smithi067.rdualw (mgr.24569) 6250 : cluster [DBG] pgmap v5384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:19.401441+0000 mgr.smithi067.rdualw (mgr.24569) 6250 : cluster [DBG] pgmap v5384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:21.402368+0000 mgr.smithi067.rdualw (mgr.24569) 6251 : cluster [DBG] pgmap v5385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:21.402368+0000 mgr.smithi067.rdualw (mgr.24569) 6251 : cluster [DBG] pgmap v5385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:24.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:23.402900+0000 mgr.smithi067.rdualw (mgr.24569) 6252 : cluster [DBG] pgmap v5386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:24.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:23.402900+0000 mgr.smithi067.rdualw (mgr.24569) 6252 : cluster [DBG] pgmap v5386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:26.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:25.403858+0000 mgr.smithi067.rdualw (mgr.24569) 6253 : cluster [DBG] pgmap v5387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:28:26.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:25.403858+0000 mgr.smithi067.rdualw (mgr.24569) 6253 : cluster [DBG] pgmap v5387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:28:28.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:27.404441+0000 mgr.smithi067.rdualw (mgr.24569) 6254 : cluster [DBG] pgmap v5388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:28.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:27.404441+0000 mgr.smithi067.rdualw (mgr.24569) 6254 : cluster [DBG] pgmap v5388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:30.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:29.404999+0000 mgr.smithi067.rdualw (mgr.24569) 6255 : cluster [DBG] pgmap v5389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:30.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:29.404999+0000 mgr.smithi067.rdualw (mgr.24569) 6255 : cluster [DBG] pgmap v5389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:31.406054+0000 mgr.smithi067.rdualw (mgr.24569) 6256 : cluster [DBG] pgmap v5390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:31.406054+0000 mgr.smithi067.rdualw (mgr.24569) 6256 : cluster [DBG] pgmap v5390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:34.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:33.406602+0000 mgr.smithi067.rdualw (mgr.24569) 6257 : cluster [DBG] pgmap v5391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:34.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:33.406602+0000 mgr.smithi067.rdualw (mgr.24569) 6257 : cluster [DBG] pgmap v5391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:35.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:28:35.420021+0000 mon.smithi067 (mon.1) 966 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:28:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:28:35.420262+0000 mon.smithi067 (mon.1) 967 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:28:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:28:35.420471+0000 mon.smithi061 (mon.0) 1407 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:28:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:28:35.420783+0000 mon.smithi061 (mon.0) 1408 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:28:35.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:28:35.420021+0000 mon.smithi067 (mon.1) 966 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:28:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:28:35.420262+0000 mon.smithi067 (mon.1) 967 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:28:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:28:35.420471+0000 mon.smithi061 (mon.0) 1407 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:28:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:28:35.420783+0000 mon.smithi061 (mon.0) 1408 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:28:36.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:35.407458+0000 mgr.smithi067.rdualw (mgr.24569) 6258 : cluster [DBG] pgmap v5392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:28:36.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:35.407458+0000 mgr.smithi067.rdualw (mgr.24569) 6258 : cluster [DBG] pgmap v5392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:28:38.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:37.408082+0000 mgr.smithi067.rdualw (mgr.24569) 6259 : cluster [DBG] pgmap v5393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:38.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:37.408082+0000 mgr.smithi067.rdualw (mgr.24569) 6259 : cluster [DBG] pgmap v5393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:40.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:39.408690+0000 mgr.smithi067.rdualw (mgr.24569) 6260 : cluster [DBG] pgmap v5394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:40.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:39.408690+0000 mgr.smithi067.rdualw (mgr.24569) 6260 : cluster [DBG] pgmap v5394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:40.880 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:28:41.256 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:28:41.256 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 4m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:28:41.257 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 4m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:28:41.257 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 4m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:28:41.257 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 4m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:28:41.257 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 4m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:28:41.257 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 4m ago 3h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:28:41.258 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 4m ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:28:41.258 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 4m ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:28:41.258 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (2h) 4m ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:28:41.258 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (2h) 4m ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:28:41.259 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 4m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:28:41.259 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 4m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:28:41.259 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 4m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:28:41.259 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 4m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:28:41.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 4m ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:28:41.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 4m ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:28:41.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 4m ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:28:41.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 4m ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:28:41.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 4m ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:28:41.261 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 4m ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:28:41.261 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 4m ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:28:41.261 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 4m ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:28:41.261 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 4m ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:28:41.659 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:28:41.768 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:28:41.768 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:28:41.768 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:28:41.769 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:28:41.769 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:28:41.769 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:28:41.769 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:28:41.770 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:28:41.770 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:28:41.770 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:28:41.770 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:28:41.771 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:28:41.771 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:28:41.771 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:28:41.771 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:28:41.771 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:28:41.772 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:28:41.772 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:28:42.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:28:40.868991+0000 mgr.smithi067.rdualw (mgr.24569) 6261 : audit [DBG] from='client.38314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:28:42.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:28:41.240528+0000 mgr.smithi067.rdualw (mgr.24569) 6262 : audit [DBG] from='client.38318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:28:42.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:41.409552+0000 mgr.smithi067.rdualw (mgr.24569) 6263 : cluster [DBG] pgmap v5395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:42.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:28:41.660331+0000 mon.smithi061 (mon.0) 1409 : audit [DBG] from='client.? 172.21.15.61:0/2106707116' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:28:42.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:28:40.868991+0000 mgr.smithi067.rdualw (mgr.24569) 6261 : audit [DBG] from='client.38314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:28:42.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:28:41.240528+0000 mgr.smithi067.rdualw (mgr.24569) 6262 : audit [DBG] from='client.38318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:28:42.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:41.409552+0000 mgr.smithi067.rdualw (mgr.24569) 6263 : cluster [DBG] pgmap v5395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:42.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:28:41.660331+0000 mon.smithi061 (mon.0) 1409 : audit [DBG] from='client.? 172.21.15.61:0/2106707116' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:28:44.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:43.410232+0000 mgr.smithi067.rdualw (mgr.24569) 6264 : cluster [DBG] pgmap v5396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:44.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:43.410232+0000 mgr.smithi067.rdualw (mgr.24569) 6264 : cluster [DBG] pgmap v5396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:46.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:45.411266+0000 mgr.smithi067.rdualw (mgr.24569) 6265 : cluster [DBG] pgmap v5397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:28:46.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:45.411266+0000 mgr.smithi067.rdualw (mgr.24569) 6265 : cluster [DBG] pgmap v5397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:28:48.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:47.411862+0000 mgr.smithi067.rdualw (mgr.24569) 6266 : cluster [DBG] pgmap v5398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:48.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:47.411862+0000 mgr.smithi067.rdualw (mgr.24569) 6266 : cluster [DBG] pgmap v5398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:50.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:49.412573+0000 mgr.smithi067.rdualw (mgr.24569) 6267 : cluster [DBG] pgmap v5399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:50.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:49.412573+0000 mgr.smithi067.rdualw (mgr.24569) 6267 : cluster [DBG] pgmap v5399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:51.413551+0000 mgr.smithi067.rdualw (mgr.24569) 6268 : cluster [DBG] pgmap v5400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:51.413551+0000 mgr.smithi067.rdualw (mgr.24569) 6268 : cluster [DBG] pgmap v5400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:54.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:53.414237+0000 mgr.smithi067.rdualw (mgr.24569) 6269 : cluster [DBG] pgmap v5401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:54.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:53.414237+0000 mgr.smithi067.rdualw (mgr.24569) 6269 : cluster [DBG] pgmap v5401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:56.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:55.415201+0000 mgr.smithi067.rdualw (mgr.24569) 6270 : cluster [DBG] pgmap v5402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:28:56.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:55.415201+0000 mgr.smithi067.rdualw (mgr.24569) 6270 : cluster [DBG] pgmap v5402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:28:58.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:28:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:57.415688+0000 mgr.smithi067.rdualw (mgr.24569) 6271 : cluster [DBG] pgmap v5403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:28:58.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:28:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:57.415688+0000 mgr.smithi067.rdualw (mgr.24569) 6271 : cluster [DBG] pgmap v5403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:00.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:28:59.416422+0000 mgr.smithi067.rdualw (mgr.24569) 6272 : cluster [DBG] pgmap v5404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:28:59.416422+0000 mgr.smithi067.rdualw (mgr.24569) 6272 : cluster [DBG] pgmap v5404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:01.417319+0000 mgr.smithi067.rdualw (mgr.24569) 6273 : cluster [DBG] pgmap v5405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:01.417319+0000 mgr.smithi067.rdualw (mgr.24569) 6273 : cluster [DBG] pgmap v5405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:04.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:03.417845+0000 mgr.smithi067.rdualw (mgr.24569) 6274 : cluster [DBG] pgmap v5406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:04.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:03.417845+0000 mgr.smithi067.rdualw (mgr.24569) 6274 : cluster [DBG] pgmap v5406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:06.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:05.418705+0000 mgr.smithi067.rdualw (mgr.24569) 6275 : cluster [DBG] pgmap v5407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:29:06.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:05.418705+0000 mgr.smithi067.rdualw (mgr.24569) 6275 : cluster [DBG] pgmap v5407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:29:08.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:07.419220+0000 mgr.smithi067.rdualw (mgr.24569) 6276 : cluster [DBG] pgmap v5408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:08.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:07.419220+0000 mgr.smithi067.rdualw (mgr.24569) 6276 : cluster [DBG] pgmap v5408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:10.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:09.419813+0000 mgr.smithi067.rdualw (mgr.24569) 6277 : cluster [DBG] pgmap v5409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:10.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:29:10.043467+0000 mon.smithi067 (mon.1) 968 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:29:10.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:29:10.044969+0000 mon.smithi067 (mon.1) 969 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:29:10.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:29:10.045889+0000 mon.smithi067 (mon.1) 970 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:29:10.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:29:10.465827+0000 mon.smithi061 (mon.0) 1410 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:29:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:29:10.472624+0000 mon.smithi061 (mon.0) 1411 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:29:10.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:09.419813+0000 mgr.smithi067.rdualw (mgr.24569) 6277 : cluster [DBG] pgmap v5409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:10.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:29:10.043467+0000 mon.smithi067 (mon.1) 968 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:29:10.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:29:10.044969+0000 mon.smithi067 (mon.1) 969 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:29:10.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:29:10.045889+0000 mon.smithi067 (mon.1) 970 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:29:10.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:29:10.465827+0000 mon.smithi061 (mon.0) 1410 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:29:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:29:10.472624+0000 mon.smithi061 (mon.0) 1411 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:29:11.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:29:10.046734+0000 mgr.smithi067.rdualw (mgr.24569) 6278 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:29:11.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:29:10.046734+0000 mgr.smithi067.rdualw (mgr.24569) 6278 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:29:11.973 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:29:12.265 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:29:12.265 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 5m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:29:12.265 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 5m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:29:12.266 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 5m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:29:12.266 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 5m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:29:12.266 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (2h) 5m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:29:12.266 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (2h) 5m ago 3h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:29:12.267 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 5m ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:29:12.267 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 5m ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:29:12.267 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 5m ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:29:12.267 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 5m ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:29:12.268 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 5m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:29:12.268 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 5m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:29:12.268 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 5m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:29:12.268 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 5m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:29:12.268 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 5m ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:29:12.269 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 5m ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:29:12.269 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 5m ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:29:12.269 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 5m ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:29:12.269 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 5m ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:29:12.269 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 5m ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:29:12.270 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 5m ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:29:12.270 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 5m ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:29:12.270 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 5m ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:29:12.615 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:29:12.644 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:29:12.645 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:29:12.645 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:29:12.645 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:29:12.646 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:29:12.646 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:29:12.646 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:29:12.646 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:29:12.647 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:29:12.647 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:29:12.647 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:29:12.647 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:29:12.648 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:29:12.648 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:29:12.648 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:29:12.648 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:29:12.648 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:29:12.649 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:29:12.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:11.420777+0000 mgr.smithi067.rdualw (mgr.24569) 6279 : cluster [DBG] pgmap v5410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:12.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:11.420777+0000 mgr.smithi067.rdualw (mgr.24569) 6279 : cluster [DBG] pgmap v5410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:13.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:29:11.960869+0000 mgr.smithi067.rdualw (mgr.24569) 6280 : audit [DBG] from='client.38326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:29:13.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:29:12.249104+0000 mgr.smithi067.rdualw (mgr.24569) 6281 : audit [DBG] from='client.38330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:29:13.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:29:12.615524+0000 mon.smithi061 (mon.0) 1412 : audit [DBG] from='client.? 172.21.15.61:0/2927829181' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:29:13.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:29:11.960869+0000 mgr.smithi067.rdualw (mgr.24569) 6280 : audit [DBG] from='client.38326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:29:13.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:29:12.249104+0000 mgr.smithi067.rdualw (mgr.24569) 6281 : audit [DBG] from='client.38330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:29:13.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:29:12.615524+0000 mon.smithi061 (mon.0) 1412 : audit [DBG] from='client.? 172.21.15.61:0/2927829181' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:29:14.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:13.421477+0000 mgr.smithi067.rdualw (mgr.24569) 6282 : cluster [DBG] pgmap v5411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:14.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:13.421477+0000 mgr.smithi067.rdualw (mgr.24569) 6282 : cluster [DBG] pgmap v5411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:16.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:15.422446+0000 mgr.smithi067.rdualw (mgr.24569) 6283 : cluster [DBG] pgmap v5412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:29:16.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:15.422446+0000 mgr.smithi067.rdualw (mgr.24569) 6283 : cluster [DBG] pgmap v5412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:29:18.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:17.423003+0000 mgr.smithi067.rdualw (mgr.24569) 6284 : cluster [DBG] pgmap v5413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:18.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:17.423003+0000 mgr.smithi067.rdualw (mgr.24569) 6284 : cluster [DBG] pgmap v5413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:20.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:19.423623+0000 mgr.smithi067.rdualw (mgr.24569) 6285 : cluster [DBG] pgmap v5414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:20.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:19.423623+0000 mgr.smithi067.rdualw (mgr.24569) 6285 : cluster [DBG] pgmap v5414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:22.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:21.424589+0000 mgr.smithi067.rdualw (mgr.24569) 6286 : cluster [DBG] pgmap v5415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:21.424589+0000 mgr.smithi067.rdualw (mgr.24569) 6286 : cluster [DBG] pgmap v5415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:24.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:23.425164+0000 mgr.smithi067.rdualw (mgr.24569) 6287 : cluster [DBG] pgmap v5416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:24.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:23.425164+0000 mgr.smithi067.rdualw (mgr.24569) 6287 : cluster [DBG] pgmap v5416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:26.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:25.426070+0000 mgr.smithi067.rdualw (mgr.24569) 6288 : cluster [DBG] pgmap v5417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:29:26.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:25.426070+0000 mgr.smithi067.rdualw (mgr.24569) 6288 : cluster [DBG] pgmap v5417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:29:28.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:27.426593+0000 mgr.smithi067.rdualw (mgr.24569) 6289 : cluster [DBG] pgmap v5418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:28.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:27.426593+0000 mgr.smithi067.rdualw (mgr.24569) 6289 : cluster [DBG] pgmap v5418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:30.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:29.427264+0000 mgr.smithi067.rdualw (mgr.24569) 6290 : cluster [DBG] pgmap v5419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:30.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:29.427264+0000 mgr.smithi067.rdualw (mgr.24569) 6290 : cluster [DBG] pgmap v5419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:31.428148+0000 mgr.smithi067.rdualw (mgr.24569) 6291 : cluster [DBG] pgmap v5420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:31.428148+0000 mgr.smithi067.rdualw (mgr.24569) 6291 : cluster [DBG] pgmap v5420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:34.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:33.428811+0000 mgr.smithi067.rdualw (mgr.24569) 6292 : cluster [DBG] pgmap v5421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:34.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:33.428811+0000 mgr.smithi067.rdualw (mgr.24569) 6292 : cluster [DBG] pgmap v5421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:29:35.425736+0000 mon.smithi067 (mon.1) 971 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:29:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:29:35.426011+0000 mon.smithi067 (mon.1) 972 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:29:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:29:35.426352+0000 mon.smithi061 (mon.0) 1413 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:29:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:29:35.426692+0000 mon.smithi061 (mon.0) 1414 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:29:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:29:35.425736+0000 mon.smithi067 (mon.1) 971 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:29:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:29:35.426011+0000 mon.smithi067 (mon.1) 972 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:29:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:29:35.426352+0000 mon.smithi061 (mon.0) 1413 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:29:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:29:35.426692+0000 mon.smithi061 (mon.0) 1414 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:29:36.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:35.429591+0000 mgr.smithi067.rdualw (mgr.24569) 6293 : cluster [DBG] pgmap v5422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:29:36.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:35.429591+0000 mgr.smithi067.rdualw (mgr.24569) 6293 : cluster [DBG] pgmap v5422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:29:38.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:37.430086+0000 mgr.smithi067.rdualw (mgr.24569) 6294 : cluster [DBG] pgmap v5423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:38.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:37.430086+0000 mgr.smithi067.rdualw (mgr.24569) 6294 : cluster [DBG] pgmap v5423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:40.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:39.430742+0000 mgr.smithi067.rdualw (mgr.24569) 6295 : cluster [DBG] pgmap v5424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:40.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:39.430742+0000 mgr.smithi067.rdualw (mgr.24569) 6295 : cluster [DBG] pgmap v5424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:41.431567+0000 mgr.smithi067.rdualw (mgr.24569) 6296 : cluster [DBG] pgmap v5425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:42.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:41.431567+0000 mgr.smithi067.rdualw (mgr.24569) 6296 : cluster [DBG] pgmap v5425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:42.922 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:29:43.218 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:29:43.218 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 5m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:29:43.218 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (2h) 5m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:29:43.219 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (2h) 5m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:29:43.219 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 5m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:29:43.220 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 5m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:29:43.220 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 5m ago 3h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:29:43.221 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 5m ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:29:43.221 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 5m ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:29:43.221 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 5m ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:29:43.221 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 5m ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:29:43.222 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 5m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:29:43.222 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 5m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:29:43.222 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 5m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:29:43.222 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 5m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:29:43.223 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 5m ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:29:43.223 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 5m ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:29:43.223 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 5m ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:29:43.223 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 5m ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:29:43.224 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 5m ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:29:43.224 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 5m ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:29:43.224 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 5m ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:29:43.224 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 5m ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:29:43.224 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 5m ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:29:43.559 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:29:43.559 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:29:43.560 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:29:43.560 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:29:43.560 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:29:43.560 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:29:43.560 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:29:43.561 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:29:43.561 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:29:43.561 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:29:43.561 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:29:43.562 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:29:43.562 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:29:43.562 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:29:43.562 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:29:43.563 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:29:43.563 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:29:43.563 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:29:43.563 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:29:44.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:29:42.911032+0000 mgr.smithi067.rdualw (mgr.24569) 6297 : audit [DBG] from='client.38338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:29:44.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:29:43.202403+0000 mgr.smithi067.rdualw (mgr.24569) 6298 : audit [DBG] from='client.38342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:29:44.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:43.432060+0000 mgr.smithi067.rdualw (mgr.24569) 6299 : cluster [DBG] pgmap v5426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:44.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:29:43.559760+0000 mon.smithi061 (mon.0) 1415 : audit [DBG] from='client.? 172.21.15.61:0/2628855736' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:29:44.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:29:42.911032+0000 mgr.smithi067.rdualw (mgr.24569) 6297 : audit [DBG] from='client.38338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:29:44.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:29:43.202403+0000 mgr.smithi067.rdualw (mgr.24569) 6298 : audit [DBG] from='client.38342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:29:44.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:43.432060+0000 mgr.smithi067.rdualw (mgr.24569) 6299 : cluster [DBG] pgmap v5426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:44.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:29:43.559760+0000 mon.smithi061 (mon.0) 1415 : audit [DBG] from='client.? 172.21.15.61:0/2628855736' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:29:46.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:45.432930+0000 mgr.smithi067.rdualw (mgr.24569) 6300 : cluster [DBG] pgmap v5427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:29:46.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:45.432930+0000 mgr.smithi067.rdualw (mgr.24569) 6300 : cluster [DBG] pgmap v5427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:29:48.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:47.433489+0000 mgr.smithi067.rdualw (mgr.24569) 6301 : cluster [DBG] pgmap v5428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:48.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:47.433489+0000 mgr.smithi067.rdualw (mgr.24569) 6301 : cluster [DBG] pgmap v5428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:50.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:49.434021+0000 mgr.smithi067.rdualw (mgr.24569) 6302 : cluster [DBG] pgmap v5429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:50.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:49.434021+0000 mgr.smithi067.rdualw (mgr.24569) 6302 : cluster [DBG] pgmap v5429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:51.434862+0000 mgr.smithi067.rdualw (mgr.24569) 6303 : cluster [DBG] pgmap v5430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:51.434862+0000 mgr.smithi067.rdualw (mgr.24569) 6303 : cluster [DBG] pgmap v5430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:54.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:53.435412+0000 mgr.smithi067.rdualw (mgr.24569) 6304 : cluster [DBG] pgmap v5431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:54.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:53.435412+0000 mgr.smithi067.rdualw (mgr.24569) 6304 : cluster [DBG] pgmap v5431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:56.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:55.436264+0000 mgr.smithi067.rdualw (mgr.24569) 6305 : cluster [DBG] pgmap v5432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:29:56.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:55.436264+0000 mgr.smithi067.rdualw (mgr.24569) 6305 : cluster [DBG] pgmap v5432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:29:58.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:29:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:57.436902+0000 mgr.smithi067.rdualw (mgr.24569) 6306 : cluster [DBG] pgmap v5433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:29:58.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:29:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:57.436902+0000 mgr.smithi067.rdualw (mgr.24569) 6306 : cluster [DBG] pgmap v5433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:00.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:29:59.437725+0000 mgr.smithi067.rdualw (mgr.24569) 6307 : cluster [DBG] pgmap v5434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:00.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:00.000104+0000 mon.smithi061 (mon.0) 1416 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T18:30:00.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:29:59.437725+0000 mgr.smithi067.rdualw (mgr.24569) 6307 : cluster [DBG] pgmap v5434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:00.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:00.000104+0000 mon.smithi061 (mon.0) 1416 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T18:30:02.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:01.438578+0000 mgr.smithi067.rdualw (mgr.24569) 6308 : cluster [DBG] pgmap v5435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:01.438578+0000 mgr.smithi067.rdualw (mgr.24569) 6308 : cluster [DBG] pgmap v5435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:04.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:03.439157+0000 mgr.smithi067.rdualw (mgr.24569) 6309 : cluster [DBG] pgmap v5436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:04.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:03.439157+0000 mgr.smithi067.rdualw (mgr.24569) 6309 : cluster [DBG] pgmap v5436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:06.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:05.440272+0000 mgr.smithi067.rdualw (mgr.24569) 6310 : cluster [DBG] pgmap v5437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:30:06.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:05.440272+0000 mgr.smithi067.rdualw (mgr.24569) 6310 : cluster [DBG] pgmap v5437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:30:08.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:07.440791+0000 mgr.smithi067.rdualw (mgr.24569) 6311 : cluster [DBG] pgmap v5438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:08.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:07.440791+0000 mgr.smithi067.rdualw (mgr.24569) 6311 : cluster [DBG] pgmap v5438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:10.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:09.441417+0000 mgr.smithi067.rdualw (mgr.24569) 6312 : cluster [DBG] pgmap v5439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:10.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:30:10.476885+0000 mon.smithi067 (mon.1) 973 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:30:10.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:30:10.478405+0000 mon.smithi067 (mon.1) 974 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:30:10.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:30:10.479325+0000 mon.smithi067 (mon.1) 975 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:30:10.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:09.441417+0000 mgr.smithi067.rdualw (mgr.24569) 6312 : cluster [DBG] pgmap v5439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:10.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:30:10.476885+0000 mon.smithi067 (mon.1) 973 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:30:10.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:30:10.478405+0000 mon.smithi067 (mon.1) 974 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:30:10.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:30:10.479325+0000 mon.smithi067 (mon.1) 975 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:30:11.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:30:10.480173+0000 mgr.smithi067.rdualw (mgr.24569) 6313 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:30:11.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:30:10.903053+0000 mon.smithi061 (mon.0) 1417 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:30:11.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:30:10.908495+0000 mon.smithi061 (mon.0) 1418 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:30:11.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:30:10.480173+0000 mgr.smithi067.rdualw (mgr.24569) 6313 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:30:11.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:30:10.903053+0000 mon.smithi061 (mon.0) 1417 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:30:11.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:30:10.908495+0000 mon.smithi061 (mon.0) 1418 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:30:12.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:11.442233+0000 mgr.smithi067.rdualw (mgr.24569) 6314 : cluster [DBG] pgmap v5440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:12.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:11.442233+0000 mgr.smithi067.rdualw (mgr.24569) 6314 : cluster [DBG] pgmap v5440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:13.975 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:30:14.264 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:30:14.265 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 6m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:30:14.265 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 6m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:30:14.266 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 6m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:30:14.266 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 6m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:30:14.267 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 6m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:30:14.267 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 6m ago 3h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:30:14.267 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 6m ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:30:14.267 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 6m ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:30:14.268 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 6m ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:30:14.269 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 6m ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:30:14.269 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 6m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:30:14.269 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 6m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:30:14.270 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 6m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:30:14.270 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 6m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:30:14.270 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 6m ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:30:14.270 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 6m ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:30:14.270 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 6m ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:30:14.271 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 6m ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:30:14.271 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 6m ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:30:14.271 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 6m ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:30:14.271 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 6m ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:30:14.272 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 6m ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:30:14.272 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 6m ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:30:14.603 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:30:14.604 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:30:14.604 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:30:14.604 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:30:14.604 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:30:14.605 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:30:14.605 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:30:14.605 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:30:14.605 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:30:14.606 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:30:14.606 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:30:14.606 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:30:14.607 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:30:14.607 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:30:14.607 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:30:14.607 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:30:14.607 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:30:14.608 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:30:14.608 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:30:14.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:13.442887+0000 mgr.smithi067.rdualw (mgr.24569) 6315 : cluster [DBG] pgmap v5441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:14.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:13.442887+0000 mgr.smithi067.rdualw (mgr.24569) 6315 : cluster [DBG] pgmap v5441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:15.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:30:13.960974+0000 mgr.smithi067.rdualw (mgr.24569) 6316 : audit [DBG] from='client.38350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:30:15.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:30:14.248570+0000 mgr.smithi067.rdualw (mgr.24569) 6317 : audit [DBG] from='client.38354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:30:15.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:30:14.604203+0000 mon.smithi061 (mon.0) 1419 : audit [DBG] from='client.? 172.21.15.61:0/3715888350' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:30:15.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:30:13.960974+0000 mgr.smithi067.rdualw (mgr.24569) 6316 : audit [DBG] from='client.38350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:30:15.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:30:14.248570+0000 mgr.smithi067.rdualw (mgr.24569) 6317 : audit [DBG] from='client.38354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:30:15.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:30:14.604203+0000 mon.smithi061 (mon.0) 1419 : audit [DBG] from='client.? 172.21.15.61:0/3715888350' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:30:16.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:15.443674+0000 mgr.smithi067.rdualw (mgr.24569) 6318 : cluster [DBG] pgmap v5442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:30:16.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:15.443674+0000 mgr.smithi067.rdualw (mgr.24569) 6318 : cluster [DBG] pgmap v5442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:30:18.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:17.444291+0000 mgr.smithi067.rdualw (mgr.24569) 6319 : cluster [DBG] pgmap v5443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:18.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:17.444291+0000 mgr.smithi067.rdualw (mgr.24569) 6319 : cluster [DBG] pgmap v5443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:20.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:19.444849+0000 mgr.smithi067.rdualw (mgr.24569) 6320 : cluster [DBG] pgmap v5444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:20.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:19.444849+0000 mgr.smithi067.rdualw (mgr.24569) 6320 : cluster [DBG] pgmap v5444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:22.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:21.445774+0000 mgr.smithi067.rdualw (mgr.24569) 6321 : cluster [DBG] pgmap v5445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:21.445774+0000 mgr.smithi067.rdualw (mgr.24569) 6321 : cluster [DBG] pgmap v5445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:24.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:23.446282+0000 mgr.smithi067.rdualw (mgr.24569) 6322 : cluster [DBG] pgmap v5446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:24.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:23.446282+0000 mgr.smithi067.rdualw (mgr.24569) 6322 : cluster [DBG] pgmap v5446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:26.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:25.447191+0000 mgr.smithi067.rdualw (mgr.24569) 6323 : cluster [DBG] pgmap v5447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:30:26.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:25.447191+0000 mgr.smithi067.rdualw (mgr.24569) 6323 : cluster [DBG] pgmap v5447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:30:28.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:27.447654+0000 mgr.smithi067.rdualw (mgr.24569) 6324 : cluster [DBG] pgmap v5448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:28.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:27.447654+0000 mgr.smithi067.rdualw (mgr.24569) 6324 : cluster [DBG] pgmap v5448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:30.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:29.448190+0000 mgr.smithi067.rdualw (mgr.24569) 6325 : cluster [DBG] pgmap v5449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:30.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:29.448190+0000 mgr.smithi067.rdualw (mgr.24569) 6325 : cluster [DBG] pgmap v5449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:31.449231+0000 mgr.smithi067.rdualw (mgr.24569) 6326 : cluster [DBG] pgmap v5450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:31.449231+0000 mgr.smithi067.rdualw (mgr.24569) 6326 : cluster [DBG] pgmap v5450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:34.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:33.449840+0000 mgr.smithi067.rdualw (mgr.24569) 6327 : cluster [DBG] pgmap v5451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:34.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:33.449840+0000 mgr.smithi067.rdualw (mgr.24569) 6327 : cluster [DBG] pgmap v5451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:35.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:30:35.431736+0000 mon.smithi067 (mon.1) 976 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:30:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:30:35.431997+0000 mon.smithi067 (mon.1) 977 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:30:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:30:35.432139+0000 mon.smithi061 (mon.0) 1420 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:30:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:30:35.432459+0000 mon.smithi061 (mon.0) 1421 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:30:35.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:30:35.431736+0000 mon.smithi067 (mon.1) 976 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:30:35.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:30:35.431997+0000 mon.smithi067 (mon.1) 977 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:30:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:30:35.432139+0000 mon.smithi061 (mon.0) 1420 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:30:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:30:35.432459+0000 mon.smithi061 (mon.0) 1421 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:30:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:35.450915+0000 mgr.smithi067.rdualw (mgr.24569) 6328 : cluster [DBG] pgmap v5452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:30:36.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:35.450915+0000 mgr.smithi067.rdualw (mgr.24569) 6328 : cluster [DBG] pgmap v5452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:30:38.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:37.451441+0000 mgr.smithi067.rdualw (mgr.24569) 6329 : cluster [DBG] pgmap v5453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:38.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:37.451441+0000 mgr.smithi067.rdualw (mgr.24569) 6329 : cluster [DBG] pgmap v5453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:40.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:39.452016+0000 mgr.smithi067.rdualw (mgr.24569) 6330 : cluster [DBG] pgmap v5454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:40.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:39.452016+0000 mgr.smithi067.rdualw (mgr.24569) 6330 : cluster [DBG] pgmap v5454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:41.452987+0000 mgr.smithi067.rdualw (mgr.24569) 6331 : cluster [DBG] pgmap v5455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:42.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:41.452987+0000 mgr.smithi067.rdualw (mgr.24569) 6331 : cluster [DBG] pgmap v5455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:44.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:43.453564+0000 mgr.smithi067.rdualw (mgr.24569) 6332 : cluster [DBG] pgmap v5456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:44.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:43.453564+0000 mgr.smithi067.rdualw (mgr.24569) 6332 : cluster [DBG] pgmap v5456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:44.913 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:30:45.205 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:30:45.206 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 6m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:30:45.206 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 6m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:30:45.206 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 6m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:30:45.206 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 6m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:30:45.207 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 6m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:30:45.207 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 6m ago 3h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:30:45.207 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 6m ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:30:45.207 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 6m ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:30:45.208 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 6m ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:30:45.208 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 6m ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:30:45.208 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 6m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:30:45.208 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 6m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:30:45.209 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 6m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:30:45.209 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 6m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:30:45.209 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 6m ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:30:45.209 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 6m ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:30:45.209 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 6m ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:30:45.210 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 6m ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:30:45.210 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 6m ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:30:45.210 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 6m ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:30:45.210 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 6m ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:30:45.211 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 6m ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:30:45.211 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 6m ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:30:45.543 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:30:45.543 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:30:45.543 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:30:45.544 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:30:45.544 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:30:45.544 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:30:45.544 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:30:45.544 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:30:45.545 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:30:45.545 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:30:45.545 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:30:45.545 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:30:45.546 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:30:45.546 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:30:45.546 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:30:45.546 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:30:45.546 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:30:45.547 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:30:45.547 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:30:46.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:30:44.901391+0000 mgr.smithi067.rdualw (mgr.24569) 6333 : audit [DBG] from='client.38362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:30:46.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:30:45.189847+0000 mgr.smithi067.rdualw (mgr.24569) 6334 : audit [DBG] from='client.38366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:30:46.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:45.454407+0000 mgr.smithi067.rdualw (mgr.24569) 6335 : cluster [DBG] pgmap v5457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:30:46.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:30:45.543702+0000 mon.smithi061 (mon.0) 1422 : audit [DBG] from='client.? 172.21.15.61:0/1928714078' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:30:46.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:30:44.901391+0000 mgr.smithi067.rdualw (mgr.24569) 6333 : audit [DBG] from='client.38362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:30:46.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:30:45.189847+0000 mgr.smithi067.rdualw (mgr.24569) 6334 : audit [DBG] from='client.38366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:30:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:45.454407+0000 mgr.smithi067.rdualw (mgr.24569) 6335 : cluster [DBG] pgmap v5457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:30:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:30:45.543702+0000 mon.smithi061 (mon.0) 1422 : audit [DBG] from='client.? 172.21.15.61:0/1928714078' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:30:48.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:47.455035+0000 mgr.smithi067.rdualw (mgr.24569) 6336 : cluster [DBG] pgmap v5458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:48.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:47.455035+0000 mgr.smithi067.rdualw (mgr.24569) 6336 : cluster [DBG] pgmap v5458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:50.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:49.455689+0000 mgr.smithi067.rdualw (mgr.24569) 6337 : cluster [DBG] pgmap v5459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:50.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:49.455689+0000 mgr.smithi067.rdualw (mgr.24569) 6337 : cluster [DBG] pgmap v5459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:51.456630+0000 mgr.smithi067.rdualw (mgr.24569) 6338 : cluster [DBG] pgmap v5460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:51.456630+0000 mgr.smithi067.rdualw (mgr.24569) 6338 : cluster [DBG] pgmap v5460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:54.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:53.457145+0000 mgr.smithi067.rdualw (mgr.24569) 6339 : cluster [DBG] pgmap v5461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:54.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:53.457145+0000 mgr.smithi067.rdualw (mgr.24569) 6339 : cluster [DBG] pgmap v5461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:56.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:55.458044+0000 mgr.smithi067.rdualw (mgr.24569) 6340 : cluster [DBG] pgmap v5462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:30:56.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:55.458044+0000 mgr.smithi067.rdualw (mgr.24569) 6340 : cluster [DBG] pgmap v5462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:30:58.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:30:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:57.458630+0000 mgr.smithi067.rdualw (mgr.24569) 6341 : cluster [DBG] pgmap v5463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:30:58.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:30:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:57.458630+0000 mgr.smithi067.rdualw (mgr.24569) 6341 : cluster [DBG] pgmap v5463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:00.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:30:59.459320+0000 mgr.smithi067.rdualw (mgr.24569) 6342 : cluster [DBG] pgmap v5464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:00.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:30:59.459320+0000 mgr.smithi067.rdualw (mgr.24569) 6342 : cluster [DBG] pgmap v5464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:02.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:01.460274+0000 mgr.smithi067.rdualw (mgr.24569) 6343 : cluster [DBG] pgmap v5465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:01.460274+0000 mgr.smithi067.rdualw (mgr.24569) 6343 : cluster [DBG] pgmap v5465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:04.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:03.460933+0000 mgr.smithi067.rdualw (mgr.24569) 6344 : cluster [DBG] pgmap v5466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:04.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:03.460933+0000 mgr.smithi067.rdualw (mgr.24569) 6344 : cluster [DBG] pgmap v5466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:06.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:05.461809+0000 mgr.smithi067.rdualw (mgr.24569) 6345 : cluster [DBG] pgmap v5467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:31:06.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:05.461809+0000 mgr.smithi067.rdualw (mgr.24569) 6345 : cluster [DBG] pgmap v5467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:31:08.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:07.462390+0000 mgr.smithi067.rdualw (mgr.24569) 6346 : cluster [DBG] pgmap v5468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:08.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:07.462390+0000 mgr.smithi067.rdualw (mgr.24569) 6346 : cluster [DBG] pgmap v5468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:10.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:09.463043+0000 mgr.smithi067.rdualw (mgr.24569) 6347 : cluster [DBG] pgmap v5469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:09.463043+0000 mgr.smithi067.rdualw (mgr.24569) 6347 : cluster [DBG] pgmap v5469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:11.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:31:10.911847+0000 mon.smithi067 (mon.1) 978 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:31:11.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:31:10.913273+0000 mon.smithi067 (mon.1) 979 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:31:11.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:31:10.914249+0000 mon.smithi067 (mon.1) 980 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:31:11.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:31:11.324259+0000 mon.smithi061 (mon.0) 1423 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:31:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:31:11.329647+0000 mon.smithi061 (mon.0) 1424 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:31:11.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:31:10.911847+0000 mon.smithi067 (mon.1) 978 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:31:11.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:31:10.913273+0000 mon.smithi067 (mon.1) 979 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:31:11.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:31:10.914249+0000 mon.smithi067 (mon.1) 980 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:31:11.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:31:11.324259+0000 mon.smithi061 (mon.0) 1423 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:31:11.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:31:11.329647+0000 mon.smithi061 (mon.0) 1424 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:31:12.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:31:10.915123+0000 mgr.smithi067.rdualw (mgr.24569) 6348 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:31:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:11.463809+0000 mgr.smithi067.rdualw (mgr.24569) 6349 : cluster [DBG] pgmap v5470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:12.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:31:10.915123+0000 mgr.smithi067.rdualw (mgr.24569) 6348 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:31:12.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:11.463809+0000 mgr.smithi067.rdualw (mgr.24569) 6349 : cluster [DBG] pgmap v5470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:14.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:13.464512+0000 mgr.smithi067.rdualw (mgr.24569) 6350 : cluster [DBG] pgmap v5471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:14.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:13.464512+0000 mgr.smithi067.rdualw (mgr.24569) 6350 : cluster [DBG] pgmap v5471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:15.859 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:31:16.156 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:31:16.156 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 7m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:31:16.156 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 7m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:31:16.157 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 7m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:31:16.157 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 7m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:31:16.157 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 7m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:31:16.157 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 7m ago 3h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:31:16.158 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 7m ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:31:16.158 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 7m ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:31:16.158 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 7m ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:31:16.158 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 7m ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:31:16.158 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 7m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:31:16.159 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 7m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:31:16.159 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 7m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:31:16.159 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 7m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:31:16.159 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 7m ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:31:16.160 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 7m ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:31:16.160 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 7m ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:31:16.160 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 7m ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:31:16.160 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 7m ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:31:16.160 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 7m ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:31:16.161 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 7m ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:31:16.161 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 7m ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:31:16.161 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 7m ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:31:16.496 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:31:16.497 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:31:16.497 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:31:16.497 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:31:16.498 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:31:16.498 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:31:16.498 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:31:16.498 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:31:16.499 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:31:16.499 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:31:16.499 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:31:16.499 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:31:16.499 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:31:16.500 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:31:16.500 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:31:16.500 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:31:16.500 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:31:16.501 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:31:16.501 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:31:16.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:15.465643+0000 mgr.smithi067.rdualw (mgr.24569) 6351 : cluster [DBG] pgmap v5472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:31:16.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:31:16.497410+0000 mon.smithi061 (mon.0) 1425 : audit [DBG] from='client.? 172.21.15.61:0/4061019449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:31:16.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:15.465643+0000 mgr.smithi067.rdualw (mgr.24569) 6351 : cluster [DBG] pgmap v5472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:31:16.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:31:16.497410+0000 mon.smithi061 (mon.0) 1425 : audit [DBG] from='client.? 172.21.15.61:0/4061019449' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:31:17.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:31:15.847602+0000 mgr.smithi067.rdualw (mgr.24569) 6352 : audit [DBG] from='client.38374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:31:17.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:31:16.140171+0000 mgr.smithi067.rdualw (mgr.24569) 6353 : audit [DBG] from='client.38378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:31:17.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:31:15.847602+0000 mgr.smithi067.rdualw (mgr.24569) 6352 : audit [DBG] from='client.38374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:31:17.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:31:16.140171+0000 mgr.smithi067.rdualw (mgr.24569) 6353 : audit [DBG] from='client.38378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:31:18.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:17.466181+0000 mgr.smithi067.rdualw (mgr.24569) 6354 : cluster [DBG] pgmap v5473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:18.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:17.466181+0000 mgr.smithi067.rdualw (mgr.24569) 6354 : cluster [DBG] pgmap v5473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:20.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:19.466792+0000 mgr.smithi067.rdualw (mgr.24569) 6355 : cluster [DBG] pgmap v5474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:20.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:19.466792+0000 mgr.smithi067.rdualw (mgr.24569) 6355 : cluster [DBG] pgmap v5474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:21.467831+0000 mgr.smithi067.rdualw (mgr.24569) 6356 : cluster [DBG] pgmap v5475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:21.467831+0000 mgr.smithi067.rdualw (mgr.24569) 6356 : cluster [DBG] pgmap v5475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:24.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:23.468370+0000 mgr.smithi067.rdualw (mgr.24569) 6357 : cluster [DBG] pgmap v5476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:24.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:23.468370+0000 mgr.smithi067.rdualw (mgr.24569) 6357 : cluster [DBG] pgmap v5476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:26.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:25.469207+0000 mgr.smithi067.rdualw (mgr.24569) 6358 : cluster [DBG] pgmap v5477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:31:26.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:25.469207+0000 mgr.smithi067.rdualw (mgr.24569) 6358 : cluster [DBG] pgmap v5477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:31:28.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:27.469757+0000 mgr.smithi067.rdualw (mgr.24569) 6359 : cluster [DBG] pgmap v5478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:28.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:27.469757+0000 mgr.smithi067.rdualw (mgr.24569) 6359 : cluster [DBG] pgmap v5478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:30.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:29.470337+0000 mgr.smithi067.rdualw (mgr.24569) 6360 : cluster [DBG] pgmap v5479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:30.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:29.470337+0000 mgr.smithi067.rdualw (mgr.24569) 6360 : cluster [DBG] pgmap v5479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:31.471204+0000 mgr.smithi067.rdualw (mgr.24569) 6361 : cluster [DBG] pgmap v5480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:32.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:31.471204+0000 mgr.smithi067.rdualw (mgr.24569) 6361 : cluster [DBG] pgmap v5480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:34.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:33.471921+0000 mgr.smithi067.rdualw (mgr.24569) 6362 : cluster [DBG] pgmap v5481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:34.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:33.471921+0000 mgr.smithi067.rdualw (mgr.24569) 6362 : cluster [DBG] pgmap v5481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:31:35.436852+0000 mon.smithi067 (mon.1) 981 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:31:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:31:35.437144+0000 mon.smithi067 (mon.1) 982 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:31:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:31:35.437234+0000 mon.smithi061 (mon.0) 1426 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:31:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:31:35.437567+0000 mon.smithi061 (mon.0) 1427 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:31:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:31:35.436852+0000 mon.smithi067 (mon.1) 981 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:31:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:31:35.437144+0000 mon.smithi067 (mon.1) 982 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:31:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:31:35.437234+0000 mon.smithi061 (mon.0) 1426 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:31:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:31:35.437567+0000 mon.smithi061 (mon.0) 1427 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:31:36.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:35.472972+0000 mgr.smithi067.rdualw (mgr.24569) 6363 : cluster [DBG] pgmap v5482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:31:36.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:35.472972+0000 mgr.smithi067.rdualw (mgr.24569) 6363 : cluster [DBG] pgmap v5482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:31:38.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:37.473479+0000 mgr.smithi067.rdualw (mgr.24569) 6364 : cluster [DBG] pgmap v5483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:38.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:37.473479+0000 mgr.smithi067.rdualw (mgr.24569) 6364 : cluster [DBG] pgmap v5483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:40.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:39.474253+0000 mgr.smithi067.rdualw (mgr.24569) 6365 : cluster [DBG] pgmap v5484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:40.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:39.474253+0000 mgr.smithi067.rdualw (mgr.24569) 6365 : cluster [DBG] pgmap v5484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:41.475157+0000 mgr.smithi067.rdualw (mgr.24569) 6366 : cluster [DBG] pgmap v5485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:42.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:41.475157+0000 mgr.smithi067.rdualw (mgr.24569) 6366 : cluster [DBG] pgmap v5485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:44.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:43.475682+0000 mgr.smithi067.rdualw (mgr.24569) 6367 : cluster [DBG] pgmap v5486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:44.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:43.475682+0000 mgr.smithi067.rdualw (mgr.24569) 6367 : cluster [DBG] pgmap v5486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:46.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:45.476555+0000 mgr.smithi067.rdualw (mgr.24569) 6368 : cluster [DBG] pgmap v5487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:31:46.802 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:31:46.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:45.476555+0000 mgr.smithi067.rdualw (mgr.24569) 6368 : cluster [DBG] pgmap v5487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:31:47.102 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:31:47.102 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 7m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:31:47.103 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 7m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:31:47.103 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 7m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:31:47.103 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 7m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:31:47.103 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 7m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:31:47.103 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 7m ago 3h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:31:47.104 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 7m ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:31:47.104 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 7m ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:31:47.104 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 7m ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:31:47.104 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 7m ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:31:47.105 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 7m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:31:47.105 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 7m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:31:47.105 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 7m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:31:47.105 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 7m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:31:47.105 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 7m ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:31:47.106 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 7m ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:31:47.106 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 7m ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:31:47.106 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 7m ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:31:47.106 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 7m ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:31:47.107 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 7m ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:31:47.107 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 7m ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:31:47.107 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 7m ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:31:47.107 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 7m ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:31:47.531 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:31:47.532 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:31:47.532 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:31:47.533 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:31:47.533 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:31:47.534 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:31:47.535 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:31:47.535 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:31:47.535 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:31:47.535 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:31:47.536 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:31:47.536 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:31:47.536 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:31:47.536 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:31:47.537 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:31:47.537 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:31:47.537 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:31:47.537 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:31:47.537 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:31:47.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:31:46.791042+0000 mgr.smithi067.rdualw (mgr.24569) 6369 : audit [DBG] from='client.38386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:31:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:31:47.531995+0000 mon.smithi061 (mon.0) 1428 : audit [DBG] from='client.? 172.21.15.61:0/2351022939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:31:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:31:46.791042+0000 mgr.smithi067.rdualw (mgr.24569) 6369 : audit [DBG] from='client.38386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:31:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:31:47.531995+0000 mon.smithi061 (mon.0) 1428 : audit [DBG] from='client.? 172.21.15.61:0/2351022939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:31:48.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:31:47.086232+0000 mgr.smithi067.rdualw (mgr.24569) 6370 : audit [DBG] from='client.38390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:31:48.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:47.477120+0000 mgr.smithi067.rdualw (mgr.24569) 6371 : cluster [DBG] pgmap v5488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:48.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:31:47.086232+0000 mgr.smithi067.rdualw (mgr.24569) 6370 : audit [DBG] from='client.38390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:31:48.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:47.477120+0000 mgr.smithi067.rdualw (mgr.24569) 6371 : cluster [DBG] pgmap v5488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:50.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:49.477933+0000 mgr.smithi067.rdualw (mgr.24569) 6372 : cluster [DBG] pgmap v5489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:50.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:49.477933+0000 mgr.smithi067.rdualw (mgr.24569) 6372 : cluster [DBG] pgmap v5489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:51.479026+0000 mgr.smithi067.rdualw (mgr.24569) 6373 : cluster [DBG] pgmap v5490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:51.479026+0000 mgr.smithi067.rdualw (mgr.24569) 6373 : cluster [DBG] pgmap v5490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:54.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:53.479526+0000 mgr.smithi067.rdualw (mgr.24569) 6374 : cluster [DBG] pgmap v5491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:54.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:53.479526+0000 mgr.smithi067.rdualw (mgr.24569) 6374 : cluster [DBG] pgmap v5491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:56.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:55.480373+0000 mgr.smithi067.rdualw (mgr.24569) 6375 : cluster [DBG] pgmap v5492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:31:56.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:55.480373+0000 mgr.smithi067.rdualw (mgr.24569) 6375 : cluster [DBG] pgmap v5492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:31:58.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:31:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:57.480902+0000 mgr.smithi067.rdualw (mgr.24569) 6376 : cluster [DBG] pgmap v5493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:31:58.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:31:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:57.480902+0000 mgr.smithi067.rdualw (mgr.24569) 6376 : cluster [DBG] pgmap v5493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:00.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:31:59.481405+0000 mgr.smithi067.rdualw (mgr.24569) 6377 : cluster [DBG] pgmap v5494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:00.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:31:59.481405+0000 mgr.smithi067.rdualw (mgr.24569) 6377 : cluster [DBG] pgmap v5494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:02.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:01.482400+0000 mgr.smithi067.rdualw (mgr.24569) 6378 : cluster [DBG] pgmap v5495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:01.482400+0000 mgr.smithi067.rdualw (mgr.24569) 6378 : cluster [DBG] pgmap v5495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:04.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:03.482895+0000 mgr.smithi067.rdualw (mgr.24569) 6379 : cluster [DBG] pgmap v5496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:04.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:03.482895+0000 mgr.smithi067.rdualw (mgr.24569) 6379 : cluster [DBG] pgmap v5496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:06.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:05.483874+0000 mgr.smithi067.rdualw (mgr.24569) 6380 : cluster [DBG] pgmap v5497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:32:06.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:05.483874+0000 mgr.smithi067.rdualw (mgr.24569) 6380 : cluster [DBG] pgmap v5497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:32:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:07.484493+0000 mgr.smithi067.rdualw (mgr.24569) 6381 : cluster [DBG] pgmap v5498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:08.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:07.484493+0000 mgr.smithi067.rdualw (mgr.24569) 6381 : cluster [DBG] pgmap v5498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:09.485017+0000 mgr.smithi067.rdualw (mgr.24569) 6382 : cluster [DBG] pgmap v5499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:10.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:09.485017+0000 mgr.smithi067.rdualw (mgr.24569) 6382 : cluster [DBG] pgmap v5499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:12.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:32:11.333035+0000 mon.smithi067 (mon.1) 983 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:32:12.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:32:11.334622+0000 mon.smithi067 (mon.1) 984 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:32:12.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:32:11.335587+0000 mon.smithi067 (mon.1) 985 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:32:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:32:11.336430+0000 mgr.smithi067.rdualw (mgr.24569) 6383 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:32:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:11.485749+0000 mgr.smithi067.rdualw (mgr.24569) 6384 : cluster [DBG] pgmap v5500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:32:11.747941+0000 mon.smithi061 (mon.0) 1429 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:32:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:32:11.756572+0000 mon.smithi061 (mon.0) 1430 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:32:12.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:32:11.333035+0000 mon.smithi067 (mon.1) 983 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:32:12.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:32:11.334622+0000 mon.smithi067 (mon.1) 984 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:32:12.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:32:11.335587+0000 mon.smithi067 (mon.1) 985 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:32:12.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:32:11.336430+0000 mgr.smithi067.rdualw (mgr.24569) 6383 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:32:12.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:11.485749+0000 mgr.smithi067.rdualw (mgr.24569) 6384 : cluster [DBG] pgmap v5500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:32:11.747941+0000 mon.smithi061 (mon.0) 1429 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:32:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:32:11.756572+0000 mon.smithi061 (mon.0) 1430 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:32:14.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:13.486293+0000 mgr.smithi067.rdualw (mgr.24569) 6385 : cluster [DBG] pgmap v5501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:14.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:13.486293+0000 mgr.smithi067.rdualw (mgr.24569) 6385 : cluster [DBG] pgmap v5501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:16.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:15.487333+0000 mgr.smithi067.rdualw (mgr.24569) 6386 : cluster [DBG] pgmap v5502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:32:16.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:15.487333+0000 mgr.smithi067.rdualw (mgr.24569) 6386 : cluster [DBG] pgmap v5502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:32:17.867 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:32:18.161 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:32:18.162 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 8m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:32:18.162 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 8m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:32:18.162 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 8m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:32:18.163 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 8m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:32:18.163 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 8m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:32:18.163 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 8m ago 3h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:32:18.163 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 8m ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:32:18.164 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 8m ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:32:18.164 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 8m ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:32:18.164 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 8m ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:32:18.164 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 8m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:32:18.164 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 8m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:32:18.165 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 8m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:32:18.165 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 8m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:32:18.165 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 8m ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:32:18.165 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 8m ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:32:18.166 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 8m ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:32:18.166 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 8m ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:32:18.167 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 8m ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:32:18.168 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 8m ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:32:18.168 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 8m ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:32:18.168 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 8m ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:32:18.169 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 8m ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:32:18.503 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:32:18.503 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:32:18.503 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:32:18.503 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:32:18.504 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:32:18.504 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:32:18.504 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:32:18.504 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:32:18.505 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:32:18.505 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:32:18.505 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:32:18.505 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:32:18.506 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:32:18.506 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:32:18.506 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:32:18.507 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:32:18.507 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:32:18.507 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:32:18.507 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:32:18.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:17.487901+0000 mgr.smithi067.rdualw (mgr.24569) 6387 : cluster [DBG] pgmap v5503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:18.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:32:18.503369+0000 mon.smithi061 (mon.0) 1431 : audit [DBG] from='client.? 172.21.15.61:0/595810545' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:32:18.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:17.487901+0000 mgr.smithi067.rdualw (mgr.24569) 6387 : cluster [DBG] pgmap v5503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:18.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:32:18.503369+0000 mon.smithi061 (mon.0) 1431 : audit [DBG] from='client.? 172.21.15.61:0/595810545' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:32:19.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:32:17.855871+0000 mgr.smithi067.rdualw (mgr.24569) 6388 : audit [DBG] from='client.38398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:32:19.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:32:18.146001+0000 mgr.smithi067.rdualw (mgr.24569) 6389 : audit [DBG] from='client.38402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:32:19.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:32:17.855871+0000 mgr.smithi067.rdualw (mgr.24569) 6388 : audit [DBG] from='client.38398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:32:19.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:32:18.146001+0000 mgr.smithi067.rdualw (mgr.24569) 6389 : audit [DBG] from='client.38402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:32:20.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:19.488685+0000 mgr.smithi067.rdualw (mgr.24569) 6390 : cluster [DBG] pgmap v5504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:20.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:19.488685+0000 mgr.smithi067.rdualw (mgr.24569) 6390 : cluster [DBG] pgmap v5504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:21.489527+0000 mgr.smithi067.rdualw (mgr.24569) 6391 : cluster [DBG] pgmap v5505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:21.489527+0000 mgr.smithi067.rdualw (mgr.24569) 6391 : cluster [DBG] pgmap v5505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:24.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:23.490195+0000 mgr.smithi067.rdualw (mgr.24569) 6392 : cluster [DBG] pgmap v5506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:24.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:23.490195+0000 mgr.smithi067.rdualw (mgr.24569) 6392 : cluster [DBG] pgmap v5506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:26.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:25.491136+0000 mgr.smithi067.rdualw (mgr.24569) 6393 : cluster [DBG] pgmap v5507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:32:26.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:25.491136+0000 mgr.smithi067.rdualw (mgr.24569) 6393 : cluster [DBG] pgmap v5507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:32:28.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:27.491879+0000 mgr.smithi067.rdualw (mgr.24569) 6394 : cluster [DBG] pgmap v5508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:28.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:27.491879+0000 mgr.smithi067.rdualw (mgr.24569) 6394 : cluster [DBG] pgmap v5508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:30.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:29.492427+0000 mgr.smithi067.rdualw (mgr.24569) 6395 : cluster [DBG] pgmap v5509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:30.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:29.492427+0000 mgr.smithi067.rdualw (mgr.24569) 6395 : cluster [DBG] pgmap v5509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:31.493450+0000 mgr.smithi067.rdualw (mgr.24569) 6396 : cluster [DBG] pgmap v5510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:31.493450+0000 mgr.smithi067.rdualw (mgr.24569) 6396 : cluster [DBG] pgmap v5510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:34.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:33.494090+0000 mgr.smithi067.rdualw (mgr.24569) 6397 : cluster [DBG] pgmap v5511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:34.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:33.494090+0000 mgr.smithi067.rdualw (mgr.24569) 6397 : cluster [DBG] pgmap v5511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:35.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:32:35.442336+0000 mon.smithi067 (mon.1) 986 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:32:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:32:35.442621+0000 mon.smithi067 (mon.1) 987 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:32:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:32:35.442735+0000 mon.smithi061 (mon.0) 1432 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:32:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:32:35.443077+0000 mon.smithi061 (mon.0) 1433 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:32:35.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:32:35.442336+0000 mon.smithi067 (mon.1) 986 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:32:35.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:32:35.442621+0000 mon.smithi067 (mon.1) 987 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:32:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:32:35.442735+0000 mon.smithi061 (mon.0) 1432 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:32:35.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:32:35.443077+0000 mon.smithi061 (mon.0) 1433 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:32:36.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:35.494928+0000 mgr.smithi067.rdualw (mgr.24569) 6398 : cluster [DBG] pgmap v5512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:32:36.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:35.494928+0000 mgr.smithi067.rdualw (mgr.24569) 6398 : cluster [DBG] pgmap v5512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:32:38.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:37.495515+0000 mgr.smithi067.rdualw (mgr.24569) 6399 : cluster [DBG] pgmap v5513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:38.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:37.495515+0000 mgr.smithi067.rdualw (mgr.24569) 6399 : cluster [DBG] pgmap v5513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:40.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:39.496100+0000 mgr.smithi067.rdualw (mgr.24569) 6400 : cluster [DBG] pgmap v5514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:40.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:39.496100+0000 mgr.smithi067.rdualw (mgr.24569) 6400 : cluster [DBG] pgmap v5514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:42.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:41.497115+0000 mgr.smithi067.rdualw (mgr.24569) 6401 : cluster [DBG] pgmap v5515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:42.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:41.497115+0000 mgr.smithi067.rdualw (mgr.24569) 6401 : cluster [DBG] pgmap v5515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:44.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:43.497767+0000 mgr.smithi067.rdualw (mgr.24569) 6402 : cluster [DBG] pgmap v5516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:44.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:43.497767+0000 mgr.smithi067.rdualw (mgr.24569) 6402 : cluster [DBG] pgmap v5516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:46.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:45.498617+0000 mgr.smithi067.rdualw (mgr.24569) 6403 : cluster [DBG] pgmap v5517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:32:46.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:45.498617+0000 mgr.smithi067.rdualw (mgr.24569) 6403 : cluster [DBG] pgmap v5517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:32:48.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:47.499150+0000 mgr.smithi067.rdualw (mgr.24569) 6404 : cluster [DBG] pgmap v5518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:48.811 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:32:48.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:47.499150+0000 mgr.smithi067.rdualw (mgr.24569) 6404 : cluster [DBG] pgmap v5518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:49.107 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:32:49.108 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 8m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:32:49.108 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 8m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:32:49.108 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 8m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:32:49.108 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 8m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:32:49.109 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 8m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:32:49.109 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 8m ago 3h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:32:49.109 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 8m ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:32:49.109 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 8m ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:32:49.110 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 8m ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:32:49.110 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 8m ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:32:49.110 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 8m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:32:49.110 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 8m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:32:49.111 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 8m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:32:49.111 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 8m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:32:49.111 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 8m ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:32:49.111 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 8m ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:32:49.111 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 8m ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:32:49.112 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 8m ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:32:49.112 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 8m ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:32:49.112 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 8m ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:32:49.112 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 8m ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:32:49.113 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 8m ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:32:49.113 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 8m ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:32:49.441 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:32:49.441 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:32:49.441 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:32:49.442 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:32:49.442 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:32:49.442 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:32:49.442 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:32:49.443 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:32:49.443 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:32:49.443 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:32:49.443 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:32:49.443 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:32:49.444 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:32:49.444 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:32:49.444 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:32:49.444 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:32:49.445 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:32:49.445 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:32:49.445 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:32:49.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:32:48.800089+0000 mgr.smithi067.rdualw (mgr.24569) 6405 : audit [DBG] from='client.38410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:32:49.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:32:49.441790+0000 mon.smithi061 (mon.0) 1434 : audit [DBG] from='client.? 172.21.15.61:0/1237858800' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:32:49.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:32:48.800089+0000 mgr.smithi067.rdualw (mgr.24569) 6405 : audit [DBG] from='client.38410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:32:49.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:32:49.441790+0000 mon.smithi061 (mon.0) 1434 : audit [DBG] from='client.? 172.21.15.61:0/1237858800' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:32:50.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:32:49.085611+0000 mgr.smithi067.rdualw (mgr.24569) 6406 : audit [DBG] from='client.38414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:32:50.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:49.499796+0000 mgr.smithi067.rdualw (mgr.24569) 6407 : cluster [DBG] pgmap v5519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:50.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:32:49.085611+0000 mgr.smithi067.rdualw (mgr.24569) 6406 : audit [DBG] from='client.38414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:32:50.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:49.499796+0000 mgr.smithi067.rdualw (mgr.24569) 6407 : cluster [DBG] pgmap v5519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:51.500888+0000 mgr.smithi067.rdualw (mgr.24569) 6408 : cluster [DBG] pgmap v5520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:51.500888+0000 mgr.smithi067.rdualw (mgr.24569) 6408 : cluster [DBG] pgmap v5520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:54.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:53.501456+0000 mgr.smithi067.rdualw (mgr.24569) 6409 : cluster [DBG] pgmap v5521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:54.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:53.501456+0000 mgr.smithi067.rdualw (mgr.24569) 6409 : cluster [DBG] pgmap v5521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:56.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:55.502269+0000 mgr.smithi067.rdualw (mgr.24569) 6410 : cluster [DBG] pgmap v5522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:32:56.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:55.502269+0000 mgr.smithi067.rdualw (mgr.24569) 6410 : cluster [DBG] pgmap v5522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:32:58.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:32:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:57.502885+0000 mgr.smithi067.rdualw (mgr.24569) 6411 : cluster [DBG] pgmap v5523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:32:58.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:32:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:57.502885+0000 mgr.smithi067.rdualw (mgr.24569) 6411 : cluster [DBG] pgmap v5523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:00.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:32:59.503602+0000 mgr.smithi067.rdualw (mgr.24569) 6412 : cluster [DBG] pgmap v5524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:01.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:32:59.503602+0000 mgr.smithi067.rdualw (mgr.24569) 6412 : cluster [DBG] pgmap v5524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:02.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:01.504725+0000 mgr.smithi067.rdualw (mgr.24569) 6413 : cluster [DBG] pgmap v5525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:01.504725+0000 mgr.smithi067.rdualw (mgr.24569) 6413 : cluster [DBG] pgmap v5525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:04.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:03.505260+0000 mgr.smithi067.rdualw (mgr.24569) 6414 : cluster [DBG] pgmap v5526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:04.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:03.505260+0000 mgr.smithi067.rdualw (mgr.24569) 6414 : cluster [DBG] pgmap v5526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:06.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:05.506098+0000 mgr.smithi067.rdualw (mgr.24569) 6415 : cluster [DBG] pgmap v5527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:33:06.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:05.506098+0000 mgr.smithi067.rdualw (mgr.24569) 6415 : cluster [DBG] pgmap v5527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:33:08.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:07.506776+0000 mgr.smithi067.rdualw (mgr.24569) 6416 : cluster [DBG] pgmap v5528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:09.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:07.506776+0000 mgr.smithi067.rdualw (mgr.24569) 6416 : cluster [DBG] pgmap v5528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:10.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:09.507431+0000 mgr.smithi067.rdualw (mgr.24569) 6417 : cluster [DBG] pgmap v5529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:11.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:09.507431+0000 mgr.smithi067.rdualw (mgr.24569) 6417 : cluster [DBG] pgmap v5529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:12.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:11.508208+0000 mgr.smithi067.rdualw (mgr.24569) 6418 : cluster [DBG] pgmap v5530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:12.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:33:11.760179+0000 mon.smithi067 (mon.1) 988 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:33:12.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:33:11.761666+0000 mon.smithi067 (mon.1) 989 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:33:12.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:33:11.762576+0000 mon.smithi067 (mon.1) 990 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:33:12.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:33:11.763390+0000 mgr.smithi067.rdualw (mgr.24569) 6419 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:33:12.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:11.508208+0000 mgr.smithi067.rdualw (mgr.24569) 6418 : cluster [DBG] pgmap v5530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:12.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:33:11.760179+0000 mon.smithi067 (mon.1) 988 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:33:12.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:33:11.761666+0000 mon.smithi067 (mon.1) 989 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:33:12.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:33:11.762576+0000 mon.smithi067 (mon.1) 990 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:33:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:33:11.763390+0000 mgr.smithi067.rdualw (mgr.24569) 6419 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:33:13.515 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:33:12.166037+0000 mon.smithi061 (mon.0) 1435 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:33:13.515 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:33:12.171527+0000 mon.smithi061 (mon.0) 1436 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:33:13.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:33:12.166037+0000 mon.smithi061 (mon.0) 1435 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:33:13.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:33:12.171527+0000 mon.smithi061 (mon.0) 1436 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:33:14.515 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:13.508838+0000 mgr.smithi067.rdualw (mgr.24569) 6420 : cluster [DBG] pgmap v5531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:14.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:13.508838+0000 mgr.smithi067.rdualw (mgr.24569) 6420 : cluster [DBG] pgmap v5531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:16.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:15.509690+0000 mgr.smithi067.rdualw (mgr.24569) 6421 : cluster [DBG] pgmap v5532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:33:16.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:15.509690+0000 mgr.smithi067.rdualw (mgr.24569) 6421 : cluster [DBG] pgmap v5532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:33:18.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:17.510268+0000 mgr.smithi067.rdualw (mgr.24569) 6422 : cluster [DBG] pgmap v5533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:19.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:17.510268+0000 mgr.smithi067.rdualw (mgr.24569) 6422 : cluster [DBG] pgmap v5533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:19.748 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:33:20.039 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:33:20.039 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 9m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:33:20.040 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 9m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:33:20.040 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 9m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:33:20.040 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 9m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:33:20.040 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 9m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:33:20.041 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 9m ago 3h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:33:20.041 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 9m ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:33:20.041 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 9m ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:33:20.041 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 9m ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:33:20.041 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 9m ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:33:20.042 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 9m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:33:20.042 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 9m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:33:20.042 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 9m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:33:20.042 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 9m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:33:20.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 9m ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:33:20.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 9m ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:33:20.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 9m ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:33:20.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 9m ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:33:20.044 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 9m ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:33:20.044 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 9m ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:33:20.044 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 9m ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:33:20.044 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 9m ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:33:20.044 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 9m ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:33:20.378 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:33:20.379 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:33:20.379 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:33:20.379 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:33:20.380 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:33:20.380 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:33:20.380 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:33:20.380 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:33:20.380 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:33:20.381 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:33:20.381 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:33:20.381 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:33:20.381 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:33:20.382 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:33:20.382 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:33:20.382 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:33:20.382 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:33:20.382 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:33:20.383 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:33:20.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:19.510892+0000 mgr.smithi067.rdualw (mgr.24569) 6423 : cluster [DBG] pgmap v5534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:20.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:33:19.737433+0000 mgr.smithi067.rdualw (mgr.24569) 6424 : audit [DBG] from='client.38422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:33:20.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:33:20.379121+0000 mon.smithi061 (mon.0) 1437 : audit [DBG] from='client.? 172.21.15.61:0/4102851063' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:33:21.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:19.510892+0000 mgr.smithi067.rdualw (mgr.24569) 6423 : cluster [DBG] pgmap v5534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:21.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:33:19.737433+0000 mgr.smithi067.rdualw (mgr.24569) 6424 : audit [DBG] from='client.38422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:33:21.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:33:20.379121+0000 mon.smithi061 (mon.0) 1437 : audit [DBG] from='client.? 172.21.15.61:0/4102851063' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:33:21.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:33:20.023820+0000 mgr.smithi067.rdualw (mgr.24569) 6425 : audit [DBG] from='client.38426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:33:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:33:20.023820+0000 mgr.smithi067.rdualw (mgr.24569) 6425 : audit [DBG] from='client.38426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:33:22.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:21.511986+0000 mgr.smithi067.rdualw (mgr.24569) 6426 : cluster [DBG] pgmap v5535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:23.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:21.511986+0000 mgr.smithi067.rdualw (mgr.24569) 6426 : cluster [DBG] pgmap v5535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:24.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:23.512694+0000 mgr.smithi067.rdualw (mgr.24569) 6427 : cluster [DBG] pgmap v5536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:24.836 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:23.512694+0000 mgr.smithi067.rdualw (mgr.24569) 6427 : cluster [DBG] pgmap v5536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:26.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:25.513776+0000 mgr.smithi067.rdualw (mgr.24569) 6428 : cluster [DBG] pgmap v5537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:33:27.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:25.513776+0000 mgr.smithi067.rdualw (mgr.24569) 6428 : cluster [DBG] pgmap v5537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:33:28.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:27.514316+0000 mgr.smithi067.rdualw (mgr.24569) 6429 : cluster [DBG] pgmap v5538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:29.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:27.514316+0000 mgr.smithi067.rdualw (mgr.24569) 6429 : cluster [DBG] pgmap v5538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:30.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:29.514928+0000 mgr.smithi067.rdualw (mgr.24569) 6430 : cluster [DBG] pgmap v5539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:31.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:29.514928+0000 mgr.smithi067.rdualw (mgr.24569) 6430 : cluster [DBG] pgmap v5539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:31.515965+0000 mgr.smithi067.rdualw (mgr.24569) 6431 : cluster [DBG] pgmap v5540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:31.515965+0000 mgr.smithi067.rdualw (mgr.24569) 6431 : cluster [DBG] pgmap v5540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:34.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:33.516508+0000 mgr.smithi067.rdualw (mgr.24569) 6432 : cluster [DBG] pgmap v5541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:34.836 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:33.516508+0000 mgr.smithi067.rdualw (mgr.24569) 6432 : cluster [DBG] pgmap v5541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:35.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:33:35.447746+0000 mon.smithi067 (mon.1) 991 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:33:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:33:35.448032+0000 mon.smithi067 (mon.1) 992 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:33:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:33:35.448338+0000 mon.smithi061 (mon.0) 1438 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:33:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:33:35.448659+0000 mon.smithi061 (mon.0) 1439 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:33:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:33:35.447746+0000 mon.smithi067 (mon.1) 991 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:33:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:33:35.448032+0000 mon.smithi067 (mon.1) 992 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:33:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:33:35.448338+0000 mon.smithi061 (mon.0) 1438 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:33:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:33:35.448659+0000 mon.smithi061 (mon.0) 1439 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:33:36.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:35.517493+0000 mgr.smithi067.rdualw (mgr.24569) 6433 : cluster [DBG] pgmap v5542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:33:37.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:35.517493+0000 mgr.smithi067.rdualw (mgr.24569) 6433 : cluster [DBG] pgmap v5542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:33:38.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:37.518029+0000 mgr.smithi067.rdualw (mgr.24569) 6434 : cluster [DBG] pgmap v5543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:39.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:37.518029+0000 mgr.smithi067.rdualw (mgr.24569) 6434 : cluster [DBG] pgmap v5543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:40.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:39.518571+0000 mgr.smithi067.rdualw (mgr.24569) 6435 : cluster [DBG] pgmap v5544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:41.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:39.518571+0000 mgr.smithi067.rdualw (mgr.24569) 6435 : cluster [DBG] pgmap v5544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:41.519400+0000 mgr.smithi067.rdualw (mgr.24569) 6436 : cluster [DBG] pgmap v5545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:42.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:41.519400+0000 mgr.smithi067.rdualw (mgr.24569) 6436 : cluster [DBG] pgmap v5545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:44.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:43.520009+0000 mgr.smithi067.rdualw (mgr.24569) 6437 : cluster [DBG] pgmap v5546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:44.836 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:43.520009+0000 mgr.smithi067.rdualw (mgr.24569) 6437 : cluster [DBG] pgmap v5546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:46.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:45.521061+0000 mgr.smithi067.rdualw (mgr.24569) 6438 : cluster [DBG] pgmap v5547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:33:47.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:45.521061+0000 mgr.smithi067.rdualw (mgr.24569) 6438 : cluster [DBG] pgmap v5547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:33:48.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:47.521688+0000 mgr.smithi067.rdualw (mgr.24569) 6439 : cluster [DBG] pgmap v5548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:49.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:47.521688+0000 mgr.smithi067.rdualw (mgr.24569) 6439 : cluster [DBG] pgmap v5548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:50.686 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:33:50.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:49.522230+0000 mgr.smithi067.rdualw (mgr.24569) 6440 : cluster [DBG] pgmap v5549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:50.979 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:33:50.979 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 9m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:33:50.979 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 9m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:33:50.980 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 9m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:33:50.980 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 9m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:33:50.980 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 9m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:33:50.980 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 9m ago 3h 24.8M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:33:50.981 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 9m ago 3h 466M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:33:50.981 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 9m ago 3h 568M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:33:50.981 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 9m ago 3h 1190M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:33:50.981 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 9m ago 3h 622M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:33:50.982 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 9m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:33:50.982 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 9m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:33:50.982 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 9m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:33:50.982 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 9m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:33:50.983 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 9m ago 3h 870M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:33:50.983 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 9m ago 3h 1733M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:33:50.983 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 9m ago 3h 1081M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:33:50.984 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 9m ago 3h 1865M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:33:50.984 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 9m ago 3h 1722M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:33:50.984 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 9m ago 3h 1928M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:33:50.984 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 9m ago 3h 1545M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:33:50.985 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 9m ago 3h 2440M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:33:50.985 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 9m ago 3h 109M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:33:51.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:49.522230+0000 mgr.smithi067.rdualw (mgr.24569) 6440 : cluster [DBG] pgmap v5549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:51.318 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:33:51.319 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:33:51.319 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:33:51.319 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:33:51.320 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:33:51.320 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:33:51.320 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:33:51.320 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:33:51.321 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:33:51.321 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:33:51.321 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:33:51.322 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:33:51.323 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:33:51.323 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:33:51.324 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:33:51.324 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:33:51.325 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:33:51.325 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:33:51.325 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:33:51.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:33:50.674753+0000 mgr.smithi067.rdualw (mgr.24569) 6441 : audit [DBG] from='client.38434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:33:51.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:33:51.318721+0000 mon.smithi061 (mon.0) 1440 : audit [DBG] from='client.? 172.21.15.61:0/42685142' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:33:52.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:33:50.674753+0000 mgr.smithi067.rdualw (mgr.24569) 6441 : audit [DBG] from='client.38434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:33:52.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:33:51.318721+0000 mon.smithi061 (mon.0) 1440 : audit [DBG] from='client.? 172.21.15.61:0/42685142' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:33:52.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:33:50.963337+0000 mgr.smithi067.rdualw (mgr.24569) 6442 : audit [DBG] from='client.38438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:33:52.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:51.523144+0000 mgr.smithi067.rdualw (mgr.24569) 6443 : cluster [DBG] pgmap v5550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:53.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:33:50.963337+0000 mgr.smithi067.rdualw (mgr.24569) 6442 : audit [DBG] from='client.38438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:33:53.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:51.523144+0000 mgr.smithi067.rdualw (mgr.24569) 6443 : cluster [DBG] pgmap v5550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:54.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:53.523668+0000 mgr.smithi067.rdualw (mgr.24569) 6444 : cluster [DBG] pgmap v5551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:55.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:53.523668+0000 mgr.smithi067.rdualw (mgr.24569) 6444 : cluster [DBG] pgmap v5551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:56.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:55.524560+0000 mgr.smithi067.rdualw (mgr.24569) 6445 : cluster [DBG] pgmap v5552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:33:57.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:55.524560+0000 mgr.smithi067.rdualw (mgr.24569) 6445 : cluster [DBG] pgmap v5552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:33:58.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:33:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:57.525033+0000 mgr.smithi067.rdualw (mgr.24569) 6446 : cluster [DBG] pgmap v5553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:33:59.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:33:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:57.525033+0000 mgr.smithi067.rdualw (mgr.24569) 6446 : cluster [DBG] pgmap v5553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:00.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:33:59.525687+0000 mgr.smithi067.rdualw (mgr.24569) 6447 : cluster [DBG] pgmap v5554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:01.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:33:59.525687+0000 mgr.smithi067.rdualw (mgr.24569) 6447 : cluster [DBG] pgmap v5554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:02.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:01.526610+0000 mgr.smithi067.rdualw (mgr.24569) 6448 : cluster [DBG] pgmap v5555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:01.526610+0000 mgr.smithi067.rdualw (mgr.24569) 6448 : cluster [DBG] pgmap v5555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:04.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:03.527096+0000 mgr.smithi067.rdualw (mgr.24569) 6449 : cluster [DBG] pgmap v5556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:04.836 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:03.527096+0000 mgr.smithi067.rdualw (mgr.24569) 6449 : cluster [DBG] pgmap v5556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:06.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:05.528147+0000 mgr.smithi067.rdualw (mgr.24569) 6450 : cluster [DBG] pgmap v5557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:34:07.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:05.528147+0000 mgr.smithi067.rdualw (mgr.24569) 6450 : cluster [DBG] pgmap v5557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:34:08.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:07.528740+0000 mgr.smithi067.rdualw (mgr.24569) 6451 : cluster [DBG] pgmap v5558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:09.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:07.528740+0000 mgr.smithi067.rdualw (mgr.24569) 6451 : cluster [DBG] pgmap v5558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:10.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:09.529451+0000 mgr.smithi067.rdualw (mgr.24569) 6452 : cluster [DBG] pgmap v5559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:11.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:09.529451+0000 mgr.smithi067.rdualw (mgr.24569) 6452 : cluster [DBG] pgmap v5559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:12.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:11.530727+0000 mgr.smithi067.rdualw (mgr.24569) 6453 : cluster [DBG] pgmap v5560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:12.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:11.530727+0000 mgr.smithi067.rdualw (mgr.24569) 6453 : cluster [DBG] pgmap v5560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:13.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:12.177160+0000 mon.smithi067 (mon.1) 993 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:34:13.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:12.178671+0000 mon.smithi067 (mon.1) 994 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:34:13.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:12.179693+0000 mon.smithi067 (mon.1) 995 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:34:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:34:12.180684+0000 mgr.smithi067.rdualw (mgr.24569) 6454 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:34:13.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:12.177160+0000 mon.smithi067 (mon.1) 993 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:34:13.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:12.178671+0000 mon.smithi067 (mon.1) 994 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:34:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:12.179693+0000 mon.smithi067 (mon.1) 995 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:34:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:34:12.180684+0000 mgr.smithi067.rdualw (mgr.24569) 6454 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:34:14.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:13.531178+0000 mgr.smithi067.rdualw (mgr.24569) 6455 : cluster [DBG] pgmap v5561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:14.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:13.531178+0000 mgr.smithi067.rdualw (mgr.24569) 6455 : cluster [DBG] pgmap v5561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:16.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:15.532157+0000 mgr.smithi067.rdualw (mgr.24569) 6456 : cluster [DBG] pgmap v5562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:34:17.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:15.532157+0000 mgr.smithi067.rdualw (mgr.24569) 6456 : cluster [DBG] pgmap v5562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:34:18.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:16.977806+0000 mon.smithi061 (mon.0) 1441 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:34:18.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:17.367131+0000 mon.smithi067 (mon.1) 996 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:34:18.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:17.367630+0000 mon.smithi061 (mon.0) 1442 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:34:18.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:17.532661+0000 mgr.smithi067.rdualw (mgr.24569) 6457 : cluster [DBG] pgmap v5563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:18.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:16.977806+0000 mon.smithi061 (mon.0) 1441 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:34:18.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:17.367131+0000 mon.smithi067 (mon.1) 996 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:34:18.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:17.367630+0000 mon.smithi061 (mon.0) 1442 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:34:18.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:17.532661+0000 mgr.smithi067.rdualw (mgr.24569) 6457 : cluster [DBG] pgmap v5563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:20.525 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:19.175293+0000 mon.smithi061 (mon.0) 1443 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:34:20.526 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:19.533216+0000 mgr.smithi067.rdualw (mgr.24569) 6458 : cluster [DBG] pgmap v5564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:20.526 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:19.581365+0000 mon.smithi067 (mon.1) 997 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:34:20.526 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:19.581893+0000 mon.smithi061 (mon.0) 1444 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:34:20.526 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:19.588605+0000 mon.smithi061 (mon.0) 1445 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:34:20.527 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:19.597902+0000 mon.smithi061 (mon.0) 1446 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:34:20.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:19.175293+0000 mon.smithi061 (mon.0) 1443 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:34:20.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:19.533216+0000 mgr.smithi067.rdualw (mgr.24569) 6458 : cluster [DBG] pgmap v5564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:20.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:19.581365+0000 mon.smithi067 (mon.1) 997 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:34:20.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:19.581893+0000 mon.smithi061 (mon.0) 1444 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:34:20.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:19.588605+0000 mon.smithi061 (mon.0) 1445 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:34:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:19.597902+0000 mon.smithi061 (mon.0) 1446 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:34:21.631 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:34:22.488 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:21.534084+0000 mgr.smithi067.rdualw (mgr.24569) 6459 : cluster [DBG] pgmap v5565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:22.488 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:21.616657+0000 mgr.smithi067.rdualw (mgr.24569) 6460 : audit [DBG] from='client.38446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:34:22.489 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:34:22.489 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 2s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:34:22.490 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 2s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:34:22.490 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 5s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:34:22.490 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 2s ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:34:22.491 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 2s ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:34:22.491 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 5s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:34:22.492 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 2s ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:34:22.492 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 5s ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:34:22.492 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 2s ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:34:22.493 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 5s ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:34:22.493 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 2s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:34:22.493 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 5s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:34:22.494 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 2s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:34:22.494 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 5s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:34:22.494 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 2s ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:34:22.495 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 2s ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:34:22.495 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 2s ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:34:22.495 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 2s ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:34:22.495 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 5s ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:34:22.496 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 5s ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:34:22.496 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 5s ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:34:22.496 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 5s ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:34:22.496 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 2s ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:34:22.497 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:21.534084+0000 mgr.smithi067.rdualw (mgr.24569) 6459 : cluster [DBG] pgmap v5565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:22.497 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:21.616657+0000 mgr.smithi067.rdualw (mgr.24569) 6460 : audit [DBG] from='client.38446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:34:22.498 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:34:22.498 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:34:22.498 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:34:22.498 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:34:22.499 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:34:22.499 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:34:22.499 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:34:22.499 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:34:22.499 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:34:22.500 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:34:22.500 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:34:22.500 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:34:22.500 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:34:22.501 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:34:22.501 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:34:22.501 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:34:22.501 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:34:22.501 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:34:22.502 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:34:23.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:21.981877+0000 mgr.smithi067.rdualw (mgr.24569) 6461 : audit [DBG] from='client.38450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:34:23.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:22.338993+0000 mon.smithi061 (mon.0) 1447 : audit [DBG] from='client.? 172.21.15.61:0/466460123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:34:23.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:21.981877+0000 mgr.smithi067.rdualw (mgr.24569) 6461 : audit [DBG] from='client.38450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:34:23.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:22.338993+0000 mon.smithi061 (mon.0) 1447 : audit [DBG] from='client.? 172.21.15.61:0/466460123' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:34:24.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:23.534604+0000 mgr.smithi067.rdualw (mgr.24569) 6462 : cluster [DBG] pgmap v5566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:24.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:23.534604+0000 mgr.smithi067.rdualw (mgr.24569) 6462 : cluster [DBG] pgmap v5566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:26.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:25.535466+0000 mgr.smithi067.rdualw (mgr.24569) 6463 : cluster [DBG] pgmap v5567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:34:27.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:25.535466+0000 mgr.smithi067.rdualw (mgr.24569) 6463 : cluster [DBG] pgmap v5567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:34:28.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:27.536038+0000 mgr.smithi067.rdualw (mgr.24569) 6464 : cluster [DBG] pgmap v5568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:29.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:27.536038+0000 mgr.smithi067.rdualw (mgr.24569) 6464 : cluster [DBG] pgmap v5568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:30.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:29.536780+0000 mgr.smithi067.rdualw (mgr.24569) 6465 : cluster [DBG] pgmap v5569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:31.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:29.536780+0000 mgr.smithi067.rdualw (mgr.24569) 6465 : cluster [DBG] pgmap v5569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:31.537723+0000 mgr.smithi067.rdualw (mgr.24569) 6466 : cluster [DBG] pgmap v5570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:31.537723+0000 mgr.smithi067.rdualw (mgr.24569) 6466 : cluster [DBG] pgmap v5570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:34.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:33.538428+0000 mgr.smithi067.rdualw (mgr.24569) 6467 : cluster [DBG] pgmap v5571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:35.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:33.538428+0000 mgr.smithi067.rdualw (mgr.24569) 6467 : cluster [DBG] pgmap v5571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:35.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:35.453786+0000 mon.smithi067 (mon.1) 998 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:34:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:35.454164+0000 mon.smithi061 (mon.0) 1448 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:34:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:35.454200+0000 mon.smithi067 (mon.1) 999 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:34:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:35.454565+0000 mon.smithi061 (mon.0) 1449 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:34:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:35.453786+0000 mon.smithi067 (mon.1) 998 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:34:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:35.454164+0000 mon.smithi061 (mon.0) 1448 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:34:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:35.454200+0000 mon.smithi067 (mon.1) 999 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:34:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:35.454565+0000 mon.smithi061 (mon.0) 1449 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:34:36.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:35.539521+0000 mgr.smithi067.rdualw (mgr.24569) 6468 : cluster [DBG] pgmap v5572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:34:37.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:35.539521+0000 mgr.smithi067.rdualw (mgr.24569) 6468 : cluster [DBG] pgmap v5572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:34:38.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:37.540193+0000 mgr.smithi067.rdualw (mgr.24569) 6469 : cluster [DBG] pgmap v5573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:39.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:37.540193+0000 mgr.smithi067.rdualw (mgr.24569) 6469 : cluster [DBG] pgmap v5573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:40.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:39.540920+0000 mgr.smithi067.rdualw (mgr.24569) 6470 : cluster [DBG] pgmap v5574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:41.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:39.540920+0000 mgr.smithi067.rdualw (mgr.24569) 6470 : cluster [DBG] pgmap v5574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:41.541982+0000 mgr.smithi067.rdualw (mgr.24569) 6471 : cluster [DBG] pgmap v5575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:42.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:41.541982+0000 mgr.smithi067.rdualw (mgr.24569) 6471 : cluster [DBG] pgmap v5575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:44.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:43.542639+0000 mgr.smithi067.rdualw (mgr.24569) 6472 : cluster [DBG] pgmap v5576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:45.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:43.542639+0000 mgr.smithi067.rdualw (mgr.24569) 6472 : cluster [DBG] pgmap v5576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:46.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:45.543790+0000 mgr.smithi067.rdualw (mgr.24569) 6473 : cluster [DBG] pgmap v5577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:34:47.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:45.543790+0000 mgr.smithi067.rdualw (mgr.24569) 6473 : cluster [DBG] pgmap v5577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:34:48.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:47.544316+0000 mgr.smithi067.rdualw (mgr.24569) 6474 : cluster [DBG] pgmap v5578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:49.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:47.544316+0000 mgr.smithi067.rdualw (mgr.24569) 6474 : cluster [DBG] pgmap v5578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:50.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:49.544882+0000 mgr.smithi067.rdualw (mgr.24569) 6475 : cluster [DBG] pgmap v5579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:51.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:49.544882+0000 mgr.smithi067.rdualw (mgr.24569) 6475 : cluster [DBG] pgmap v5579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:51.545938+0000 mgr.smithi067.rdualw (mgr.24569) 6476 : cluster [DBG] pgmap v5580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:51.545938+0000 mgr.smithi067.rdualw (mgr.24569) 6476 : cluster [DBG] pgmap v5580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:52.649 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:34:53.024 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:34:53.025 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 33s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:34:53.025 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 33s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:34:53.025 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 36s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:34:53.025 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 33s ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:34:53.026 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 33s ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:34:53.026 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 36s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:34:53.026 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 33s ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:34:53.026 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 36s ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:34:53.026 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 33s ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:34:53.027 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 36s ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:34:53.027 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 33s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:34:53.027 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 36s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:34:53.027 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 33s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:34:53.028 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 36s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:34:53.028 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 33s ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:34:53.028 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 33s ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:34:53.028 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 33s ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:34:53.029 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 33s ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:34:53.029 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 36s ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:34:53.030 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 36s ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:34:53.031 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 36s ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:34:53.031 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 36s ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:34:53.031 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 33s ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:34:53.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:52.637336+0000 mgr.smithi067.rdualw (mgr.24569) 6477 : audit [DBG] from='client.38458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:34:53.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:52.637336+0000 mgr.smithi067.rdualw (mgr.24569) 6477 : audit [DBG] from='client.38458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:34:53.369 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:34:53.369 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:34:53.370 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:34:53.370 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:34:53.370 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:34:53.370 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:34:53.371 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:34:53.371 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:34:53.371 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:34:53.371 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:34:53.372 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:34:53.372 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:34:53.372 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:34:53.372 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:34:53.372 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:34:53.373 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:34:53.373 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:34:53.373 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:34:53.373 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:34:54.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:53.009042+0000 mgr.smithi067.rdualw (mgr.24569) 6478 : audit [DBG] from='client.38462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:34:54.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:34:53.370004+0000 mon.smithi061 (mon.0) 1450 : audit [DBG] from='client.? 172.21.15.61:0/3336739009' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:34:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:53.546516+0000 mgr.smithi067.rdualw (mgr.24569) 6479 : cluster [DBG] pgmap v5581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:54.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:53.009042+0000 mgr.smithi067.rdualw (mgr.24569) 6478 : audit [DBG] from='client.38462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:34:54.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:34:53.370004+0000 mon.smithi061 (mon.0) 1450 : audit [DBG] from='client.? 172.21.15.61:0/3336739009' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:34:54.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:53.546516+0000 mgr.smithi067.rdualw (mgr.24569) 6479 : cluster [DBG] pgmap v5581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:56.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:55.547470+0000 mgr.smithi067.rdualw (mgr.24569) 6480 : cluster [DBG] pgmap v5582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:34:57.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:55.547470+0000 mgr.smithi067.rdualw (mgr.24569) 6480 : cluster [DBG] pgmap v5582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:34:58.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:34:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:57.548198+0000 mgr.smithi067.rdualw (mgr.24569) 6481 : cluster [DBG] pgmap v5583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:34:59.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:34:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:57.548198+0000 mgr.smithi067.rdualw (mgr.24569) 6481 : cluster [DBG] pgmap v5583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:00.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:34:59.548783+0000 mgr.smithi067.rdualw (mgr.24569) 6482 : cluster [DBG] pgmap v5584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:01.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:34:59.548783+0000 mgr.smithi067.rdualw (mgr.24569) 6482 : cluster [DBG] pgmap v5584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:02.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:01.549827+0000 mgr.smithi067.rdualw (mgr.24569) 6483 : cluster [DBG] pgmap v5585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:01.549827+0000 mgr.smithi067.rdualw (mgr.24569) 6483 : cluster [DBG] pgmap v5585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:04.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:03.550378+0000 mgr.smithi067.rdualw (mgr.24569) 6484 : cluster [DBG] pgmap v5586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:05.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:03.550378+0000 mgr.smithi067.rdualw (mgr.24569) 6484 : cluster [DBG] pgmap v5586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:06.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:05.551226+0000 mgr.smithi067.rdualw (mgr.24569) 6485 : cluster [DBG] pgmap v5587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:35:07.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:05.551226+0000 mgr.smithi067.rdualw (mgr.24569) 6485 : cluster [DBG] pgmap v5587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:35:08.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:07.551830+0000 mgr.smithi067.rdualw (mgr.24569) 6486 : cluster [DBG] pgmap v5588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:09.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:07.551830+0000 mgr.smithi067.rdualw (mgr.24569) 6486 : cluster [DBG] pgmap v5588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:10.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:09.552390+0000 mgr.smithi067.rdualw (mgr.24569) 6487 : cluster [DBG] pgmap v5589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:11.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:09.552390+0000 mgr.smithi067.rdualw (mgr.24569) 6487 : cluster [DBG] pgmap v5589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:12.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:11.553409+0000 mgr.smithi067.rdualw (mgr.24569) 6488 : cluster [DBG] pgmap v5590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:12.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:11.553409+0000 mgr.smithi067.rdualw (mgr.24569) 6488 : cluster [DBG] pgmap v5590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:14.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:13.553985+0000 mgr.smithi067.rdualw (mgr.24569) 6489 : cluster [DBG] pgmap v5591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:15.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:13.553985+0000 mgr.smithi067.rdualw (mgr.24569) 6489 : cluster [DBG] pgmap v5591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:16.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:15.554912+0000 mgr.smithi067.rdualw (mgr.24569) 6490 : cluster [DBG] pgmap v5592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:35:17.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:15.554912+0000 mgr.smithi067.rdualw (mgr.24569) 6490 : cluster [DBG] pgmap v5592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:35:18.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:17.555411+0000 mgr.smithi067.rdualw (mgr.24569) 6491 : cluster [DBG] pgmap v5593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:17.555411+0000 mgr.smithi067.rdualw (mgr.24569) 6491 : cluster [DBG] pgmap v5593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:19.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:35:19.602576+0000 mon.smithi067 (mon.1) 1000 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:35:19.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:35:19.604051+0000 mon.smithi067 (mon.1) 1001 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:35:19.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:35:19.605063+0000 mon.smithi067 (mon.1) 1002 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:35:20.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:35:19.602576+0000 mon.smithi067 (mon.1) 1000 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:35:20.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:35:19.604051+0000 mon.smithi067 (mon.1) 1001 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:35:20.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:35:19.605063+0000 mon.smithi067 (mon.1) 1002 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:35:20.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:19.555973+0000 mgr.smithi067.rdualw (mgr.24569) 6492 : cluster [DBG] pgmap v5594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:20.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:35:19.605960+0000 mgr.smithi067.rdualw (mgr.24569) 6493 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:35:20.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:35:20.026420+0000 mon.smithi061 (mon.0) 1451 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:35:20.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:35:20.034099+0000 mon.smithi061 (mon.0) 1452 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:35:21.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:19.555973+0000 mgr.smithi067.rdualw (mgr.24569) 6492 : cluster [DBG] pgmap v5594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:21.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:35:19.605960+0000 mgr.smithi067.rdualw (mgr.24569) 6493 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:35:21.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:35:20.026420+0000 mon.smithi061 (mon.0) 1451 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:35:21.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:35:20.034099+0000 mon.smithi061 (mon.0) 1452 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:35:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:21.556825+0000 mgr.smithi067.rdualw (mgr.24569) 6494 : cluster [DBG] pgmap v5595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:21.556825+0000 mgr.smithi067.rdualw (mgr.24569) 6494 : cluster [DBG] pgmap v5595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:23.676 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:35:23.968 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:35:23.969 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 64s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:35:23.969 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 64s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:35:23.969 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 66s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:35:23.969 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 64s ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:35:23.970 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 64s ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:35:23.970 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 66s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:35:23.970 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 64s ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:35:23.970 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 66s ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:35:23.970 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 64s ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:35:23.971 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 66s ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:35:23.971 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 64s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:35:23.971 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 66s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:35:23.971 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 64s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:35:23.972 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 66s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:35:23.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 64s ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:35:23.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 64s ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:35:23.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 64s ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:35:23.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 64s ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:35:23.973 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 66s ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:35:23.973 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 66s ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:35:23.973 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 66s ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:35:23.973 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 66s ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:35:23.973 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 64s ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:35:24.309 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:35:24.309 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:35:24.309 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:35:24.310 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:35:24.310 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:35:24.310 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:35:24.310 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:35:24.310 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:35:24.311 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:35:24.311 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:35:24.311 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:35:24.311 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:35:24.312 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:35:24.312 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:35:24.312 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:35:24.312 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:35:24.313 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:35:24.313 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:35:24.313 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:35:24.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:23.557404+0000 mgr.smithi067.rdualw (mgr.24569) 6495 : cluster [DBG] pgmap v5596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:35:23.665218+0000 mgr.smithi067.rdualw (mgr.24569) 6496 : audit [DBG] from='client.38470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:35:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:35:24.309702+0000 mon.smithi061 (mon.0) 1453 : audit [DBG] from='client.? 172.21.15.61:0/1840956105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:35:25.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:23.557404+0000 mgr.smithi067.rdualw (mgr.24569) 6495 : cluster [DBG] pgmap v5596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:25.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:35:23.665218+0000 mgr.smithi067.rdualw (mgr.24569) 6496 : audit [DBG] from='client.38470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:35:25.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:35:24.309702+0000 mon.smithi061 (mon.0) 1453 : audit [DBG] from='client.? 172.21.15.61:0/1840956105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:35:25.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:35:23.952046+0000 mgr.smithi067.rdualw (mgr.24569) 6497 : audit [DBG] from='client.38474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:35:26.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:35:23.952046+0000 mgr.smithi067.rdualw (mgr.24569) 6497 : audit [DBG] from='client.38474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:35:26.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:25.558410+0000 mgr.smithi067.rdualw (mgr.24569) 6498 : cluster [DBG] pgmap v5597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:35:27.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:25.558410+0000 mgr.smithi067.rdualw (mgr.24569) 6498 : cluster [DBG] pgmap v5597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:35:28.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:27.559007+0000 mgr.smithi067.rdualw (mgr.24569) 6499 : cluster [DBG] pgmap v5598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:29.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:27.559007+0000 mgr.smithi067.rdualw (mgr.24569) 6499 : cluster [DBG] pgmap v5598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:30.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:29.559559+0000 mgr.smithi067.rdualw (mgr.24569) 6500 : cluster [DBG] pgmap v5599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:31.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:29.559559+0000 mgr.smithi067.rdualw (mgr.24569) 6500 : cluster [DBG] pgmap v5599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:31.560469+0000 mgr.smithi067.rdualw (mgr.24569) 6501 : cluster [DBG] pgmap v5600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:31.560469+0000 mgr.smithi067.rdualw (mgr.24569) 6501 : cluster [DBG] pgmap v5600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:34.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:33.561079+0000 mgr.smithi067.rdualw (mgr.24569) 6502 : cluster [DBG] pgmap v5601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:35.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:33.561079+0000 mgr.smithi067.rdualw (mgr.24569) 6502 : cluster [DBG] pgmap v5601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:35.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:35:35.459158+0000 mon.smithi067 (mon.1) 1003 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:35:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:35:35.459501+0000 mon.smithi061 (mon.0) 1454 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:35:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:35:35.459569+0000 mon.smithi067 (mon.1) 1004 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:35:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:35:35.459787+0000 mon.smithi061 (mon.0) 1455 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:35:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:35:35.459158+0000 mon.smithi067 (mon.1) 1003 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:35:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:35:35.459501+0000 mon.smithi061 (mon.0) 1454 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:35:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:35:35.459569+0000 mon.smithi067 (mon.1) 1004 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:35:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:35:35.459787+0000 mon.smithi061 (mon.0) 1455 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:35:36.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:35.562063+0000 mgr.smithi067.rdualw (mgr.24569) 6503 : cluster [DBG] pgmap v5602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:35:37.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:35.562063+0000 mgr.smithi067.rdualw (mgr.24569) 6503 : cluster [DBG] pgmap v5602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:35:38.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:37.562574+0000 mgr.smithi067.rdualw (mgr.24569) 6504 : cluster [DBG] pgmap v5603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:39.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:37.562574+0000 mgr.smithi067.rdualw (mgr.24569) 6504 : cluster [DBG] pgmap v5603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:40.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:39.563302+0000 mgr.smithi067.rdualw (mgr.24569) 6505 : cluster [DBG] pgmap v5604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:41.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:39.563302+0000 mgr.smithi067.rdualw (mgr.24569) 6505 : cluster [DBG] pgmap v5604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:41.564257+0000 mgr.smithi067.rdualw (mgr.24569) 6506 : cluster [DBG] pgmap v5605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:42.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:41.564257+0000 mgr.smithi067.rdualw (mgr.24569) 6506 : cluster [DBG] pgmap v5605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:44.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:43.564792+0000 mgr.smithi067.rdualw (mgr.24569) 6507 : cluster [DBG] pgmap v5606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:45.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:43.564792+0000 mgr.smithi067.rdualw (mgr.24569) 6507 : cluster [DBG] pgmap v5606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:46.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:45.565680+0000 mgr.smithi067.rdualw (mgr.24569) 6508 : cluster [DBG] pgmap v5607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:35:47.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:45.565680+0000 mgr.smithi067.rdualw (mgr.24569) 6508 : cluster [DBG] pgmap v5607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:35:48.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:47.566266+0000 mgr.smithi067.rdualw (mgr.24569) 6509 : cluster [DBG] pgmap v5608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:49.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:47.566266+0000 mgr.smithi067.rdualw (mgr.24569) 6509 : cluster [DBG] pgmap v5608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:50.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:49.567024+0000 mgr.smithi067.rdualw (mgr.24569) 6510 : cluster [DBG] pgmap v5609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:51.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:49.567024+0000 mgr.smithi067.rdualw (mgr.24569) 6510 : cluster [DBG] pgmap v5609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:51.567859+0000 mgr.smithi067.rdualw (mgr.24569) 6511 : cluster [DBG] pgmap v5610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:51.567859+0000 mgr.smithi067.rdualw (mgr.24569) 6511 : cluster [DBG] pgmap v5610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:54.616 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:35:54.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:53.568307+0000 mgr.smithi067.rdualw (mgr.24569) 6512 : cluster [DBG] pgmap v5611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:54.909 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:35:54.909 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 95s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:35:54.910 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 95s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:35:54.910 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 97s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:35:54.910 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 95s ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:35:54.910 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 95s ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:35:54.911 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 97s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:35:54.911 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 95s ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:35:54.911 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 97s ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:35:54.911 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 95s ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:35:54.912 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 97s ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:35:54.912 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 95s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:35:54.912 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 97s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:35:54.912 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 95s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:35:54.913 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 97s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:35:54.913 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 95s ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:35:54.913 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 95s ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:35:54.913 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 95s ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:35:54.914 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 95s ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:35:54.914 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 97s ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:35:54.914 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 97s ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:35:54.914 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 97s ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:35:54.915 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 97s ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:35:54.915 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 95s ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:35:55.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:53.568307+0000 mgr.smithi067.rdualw (mgr.24569) 6512 : cluster [DBG] pgmap v5611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:55.252 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:35:55.253 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:35:55.253 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:35:55.253 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:35:55.253 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:35:55.254 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:35:55.254 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:35:55.254 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:35:55.255 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:35:55.255 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:35:55.255 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:35:55.256 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:35:55.256 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:35:55.256 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:35:55.257 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:35:55.258 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:35:55.258 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:35:55.258 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:35:55.259 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:35:55.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:35:54.605250+0000 mgr.smithi067.rdualw (mgr.24569) 6513 : audit [DBG] from='client.38482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:35:55.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:35:55.252981+0000 mon.smithi061 (mon.0) 1456 : audit [DBG] from='client.? 172.21.15.61:0/3217648900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:35:56.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:35:54.605250+0000 mgr.smithi067.rdualw (mgr.24569) 6513 : audit [DBG] from='client.38482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:35:56.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:35:55.252981+0000 mon.smithi061 (mon.0) 1456 : audit [DBG] from='client.? 172.21.15.61:0/3217648900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:35:56.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:35:54.893670+0000 mgr.smithi067.rdualw (mgr.24569) 6514 : audit [DBG] from='client.38486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:35:56.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:55.569140+0000 mgr.smithi067.rdualw (mgr.24569) 6515 : cluster [DBG] pgmap v5612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:35:57.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:35:54.893670+0000 mgr.smithi067.rdualw (mgr.24569) 6514 : audit [DBG] from='client.38486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:35:57.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:55.569140+0000 mgr.smithi067.rdualw (mgr.24569) 6515 : cluster [DBG] pgmap v5612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:35:58.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:35:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:57.569731+0000 mgr.smithi067.rdualw (mgr.24569) 6516 : cluster [DBG] pgmap v5613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:35:59.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:35:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:57.569731+0000 mgr.smithi067.rdualw (mgr.24569) 6516 : cluster [DBG] pgmap v5613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:00.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:35:59.570340+0000 mgr.smithi067.rdualw (mgr.24569) 6517 : cluster [DBG] pgmap v5614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:01.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:35:59.570340+0000 mgr.smithi067.rdualw (mgr.24569) 6517 : cluster [DBG] pgmap v5614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:02.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:01.571327+0000 mgr.smithi067.rdualw (mgr.24569) 6518 : cluster [DBG] pgmap v5615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:01.571327+0000 mgr.smithi067.rdualw (mgr.24569) 6518 : cluster [DBG] pgmap v5615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:04.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:03.571864+0000 mgr.smithi067.rdualw (mgr.24569) 6519 : cluster [DBG] pgmap v5616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:05.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:03.571864+0000 mgr.smithi067.rdualw (mgr.24569) 6519 : cluster [DBG] pgmap v5616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:06.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:05.572665+0000 mgr.smithi067.rdualw (mgr.24569) 6520 : cluster [DBG] pgmap v5617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:36:07.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:05.572665+0000 mgr.smithi067.rdualw (mgr.24569) 6520 : cluster [DBG] pgmap v5617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:36:08.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:07.573205+0000 mgr.smithi067.rdualw (mgr.24569) 6521 : cluster [DBG] pgmap v5618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:09.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:07.573205+0000 mgr.smithi067.rdualw (mgr.24569) 6521 : cluster [DBG] pgmap v5618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:10.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:09.573815+0000 mgr.smithi067.rdualw (mgr.24569) 6522 : cluster [DBG] pgmap v5619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:11.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:09.573815+0000 mgr.smithi067.rdualw (mgr.24569) 6522 : cluster [DBG] pgmap v5619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:12.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:11.574808+0000 mgr.smithi067.rdualw (mgr.24569) 6523 : cluster [DBG] pgmap v5620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:12.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:11.574808+0000 mgr.smithi067.rdualw (mgr.24569) 6523 : cluster [DBG] pgmap v5620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:14.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:13.575265+0000 mgr.smithi067.rdualw (mgr.24569) 6524 : cluster [DBG] pgmap v5621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:15.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:13.575265+0000 mgr.smithi067.rdualw (mgr.24569) 6524 : cluster [DBG] pgmap v5621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:16.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:15.576239+0000 mgr.smithi067.rdualw (mgr.24569) 6525 : cluster [DBG] pgmap v5622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:36:17.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:15.576239+0000 mgr.smithi067.rdualw (mgr.24569) 6525 : cluster [DBG] pgmap v5622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:36:18.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:17.576985+0000 mgr.smithi067.rdualw (mgr.24569) 6526 : cluster [DBG] pgmap v5623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:19.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:17.576985+0000 mgr.smithi067.rdualw (mgr.24569) 6526 : cluster [DBG] pgmap v5623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:20.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:19.577564+0000 mgr.smithi067.rdualw (mgr.24569) 6527 : cluster [DBG] pgmap v5624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:20.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:36:20.037351+0000 mon.smithi067 (mon.1) 1005 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:36:20.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:36:20.038755+0000 mon.smithi067 (mon.1) 1006 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:36:20.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:36:20.039634+0000 mon.smithi067 (mon.1) 1007 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:36:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:36:20.397020+0000 mon.smithi061 (mon.0) 1457 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:36:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:36:20.401770+0000 mon.smithi061 (mon.0) 1458 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:36:21.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:19.577564+0000 mgr.smithi067.rdualw (mgr.24569) 6527 : cluster [DBG] pgmap v5624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:21.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:36:20.037351+0000 mon.smithi067 (mon.1) 1005 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:36:21.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:36:20.038755+0000 mon.smithi067 (mon.1) 1006 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:36:21.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:36:20.039634+0000 mon.smithi067 (mon.1) 1007 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:36:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:36:20.397020+0000 mon.smithi061 (mon.0) 1457 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:36:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:36:20.401770+0000 mon.smithi061 (mon.0) 1458 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:36:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:36:20.040456+0000 mgr.smithi067.rdualw (mgr.24569) 6528 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:36:22.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:36:20.838380+0000 mon.smithi061 (mon.0) 1459 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:36:22.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:36:20.843836+0000 mon.smithi061 (mon.0) 1460 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:36:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:36:20.040456+0000 mgr.smithi067.rdualw (mgr.24569) 6528 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:36:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:36:20.838380+0000 mon.smithi061 (mon.0) 1459 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:36:22.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:36:20.843836+0000 mon.smithi061 (mon.0) 1460 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:36:23.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:21.578431+0000 mgr.smithi067.rdualw (mgr.24569) 6529 : cluster [DBG] pgmap v5625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:23.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:21.578431+0000 mgr.smithi067.rdualw (mgr.24569) 6529 : cluster [DBG] pgmap v5625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:25.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:23.578962+0000 mgr.smithi067.rdualw (mgr.24569) 6530 : cluster [DBG] pgmap v5626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:25.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:23.578962+0000 mgr.smithi067.rdualw (mgr.24569) 6530 : cluster [DBG] pgmap v5626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:25.564 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:36:25.856 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:36:25.857 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 2m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:36:25.857 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 2m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:36:25.857 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 2m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:36:25.858 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 2m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:36:25.858 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 2m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:36:25.858 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 2m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:36:25.859 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 2m ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:36:25.859 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 2m ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:36:25.859 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 2m ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:36:25.860 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 2m ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:36:25.860 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 2m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:36:25.861 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 2m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:36:25.861 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 2m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:36:25.862 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 2m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:36:25.862 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 2m ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:36:25.863 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 2m ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:36:25.863 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 2m ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:36:25.863 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 2m ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:36:25.864 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 2m ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:36:25.864 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 2m ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:36:25.865 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 2m ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:36:25.865 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 2m ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:36:25.866 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 2m ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:36:26.210 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:36:26.211 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:36:26.211 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:36:26.211 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:36:26.211 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:36:26.211 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:36:26.212 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:36:26.212 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:36:26.212 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:36:26.212 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:36:26.213 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:36:26.213 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:36:26.213 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:36:26.213 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:36:26.213 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:36:26.214 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:36:26.214 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:36:26.214 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:36:26.214 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:36:27.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:36:25.552699+0000 mgr.smithi067.rdualw (mgr.24569) 6531 : audit [DBG] from='client.38494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:36:27.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:25.579750+0000 mgr.smithi067.rdualw (mgr.24569) 6532 : cluster [DBG] pgmap v5627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:36:27.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:36:25.840717+0000 mgr.smithi067.rdualw (mgr.24569) 6533 : audit [DBG] from='client.38498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:36:27.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:36:26.211337+0000 mon.smithi061 (mon.0) 1461 : audit [DBG] from='client.? 172.21.15.61:0/2834374939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:36:27.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:36:25.552699+0000 mgr.smithi067.rdualw (mgr.24569) 6531 : audit [DBG] from='client.38494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:36:27.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:25.579750+0000 mgr.smithi067.rdualw (mgr.24569) 6532 : cluster [DBG] pgmap v5627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:36:27.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:36:25.840717+0000 mgr.smithi067.rdualw (mgr.24569) 6533 : audit [DBG] from='client.38498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:36:27.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:36:26.211337+0000 mon.smithi061 (mon.0) 1461 : audit [DBG] from='client.? 172.21.15.61:0/2834374939' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:36:29.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:27.580223+0000 mgr.smithi067.rdualw (mgr.24569) 6534 : cluster [DBG] pgmap v5628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:29.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:27.580223+0000 mgr.smithi067.rdualw (mgr.24569) 6534 : cluster [DBG] pgmap v5628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:31.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:29.580829+0000 mgr.smithi067.rdualw (mgr.24569) 6535 : cluster [DBG] pgmap v5629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:31.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:29.580829+0000 mgr.smithi067.rdualw (mgr.24569) 6535 : cluster [DBG] pgmap v5629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:31.581710+0000 mgr.smithi067.rdualw (mgr.24569) 6536 : cluster [DBG] pgmap v5630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:31.581710+0000 mgr.smithi067.rdualw (mgr.24569) 6536 : cluster [DBG] pgmap v5630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:34.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:33.582204+0000 mgr.smithi067.rdualw (mgr.24569) 6537 : cluster [DBG] pgmap v5631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:35.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:33.582204+0000 mgr.smithi067.rdualw (mgr.24569) 6537 : cluster [DBG] pgmap v5631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:35.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:36:35.464623+0000 mon.smithi067 (mon.1) 1008 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:36:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:36:35.464874+0000 mon.smithi067 (mon.1) 1009 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:36:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:36:35.464909+0000 mon.smithi061 (mon.0) 1462 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:36:35.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:36:35.465218+0000 mon.smithi061 (mon.0) 1463 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:36:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:36:35.464623+0000 mon.smithi067 (mon.1) 1008 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:36:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:36:35.464874+0000 mon.smithi067 (mon.1) 1009 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:36:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:36:35.464909+0000 mon.smithi061 (mon.0) 1462 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:36:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:36:35.465218+0000 mon.smithi061 (mon.0) 1463 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:36:36.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:35.583184+0000 mgr.smithi067.rdualw (mgr.24569) 6538 : cluster [DBG] pgmap v5632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:36:37.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:35.583184+0000 mgr.smithi067.rdualw (mgr.24569) 6538 : cluster [DBG] pgmap v5632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:36:38.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:37.583698+0000 mgr.smithi067.rdualw (mgr.24569) 6539 : cluster [DBG] pgmap v5633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:39.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:37.583698+0000 mgr.smithi067.rdualw (mgr.24569) 6539 : cluster [DBG] pgmap v5633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:40.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:39.584253+0000 mgr.smithi067.rdualw (mgr.24569) 6540 : cluster [DBG] pgmap v5634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:41.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:39.584253+0000 mgr.smithi067.rdualw (mgr.24569) 6540 : cluster [DBG] pgmap v5634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:41.585252+0000 mgr.smithi067.rdualw (mgr.24569) 6541 : cluster [DBG] pgmap v5635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:42.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:41.585252+0000 mgr.smithi067.rdualw (mgr.24569) 6541 : cluster [DBG] pgmap v5635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:45.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:43.585898+0000 mgr.smithi067.rdualw (mgr.24569) 6542 : cluster [DBG] pgmap v5636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:45.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:43.585898+0000 mgr.smithi067.rdualw (mgr.24569) 6542 : cluster [DBG] pgmap v5636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:45.586730+0000 mgr.smithi067.rdualw (mgr.24569) 6543 : cluster [DBG] pgmap v5637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:36:47.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:45.586730+0000 mgr.smithi067.rdualw (mgr.24569) 6543 : cluster [DBG] pgmap v5637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:36:49.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:47.587478+0000 mgr.smithi067.rdualw (mgr.24569) 6544 : cluster [DBG] pgmap v5638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:49.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:47.587478+0000 mgr.smithi067.rdualw (mgr.24569) 6544 : cluster [DBG] pgmap v5638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:51.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:49.588055+0000 mgr.smithi067.rdualw (mgr.24569) 6545 : cluster [DBG] pgmap v5639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:51.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:49.588055+0000 mgr.smithi067.rdualw (mgr.24569) 6545 : cluster [DBG] pgmap v5639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:51.589093+0000 mgr.smithi067.rdualw (mgr.24569) 6546 : cluster [DBG] pgmap v5640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:51.589093+0000 mgr.smithi067.rdualw (mgr.24569) 6546 : cluster [DBG] pgmap v5640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:55.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:53.589581+0000 mgr.smithi067.rdualw (mgr.24569) 6547 : cluster [DBG] pgmap v5641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:55.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:53.589581+0000 mgr.smithi067.rdualw (mgr.24569) 6547 : cluster [DBG] pgmap v5641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:56.517 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:36:56.808 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:36:56.808 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 2m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:36:56.808 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 2m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:36:56.808 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 2m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:36:56.809 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 2m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:36:56.809 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 2m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:36:56.809 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 2m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:36:56.809 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 2m ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:36:56.810 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 2m ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:36:56.810 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 2m ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:36:56.810 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 2m ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:36:56.810 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 2m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:36:56.811 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 2m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:36:56.811 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 2m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:36:56.811 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 2m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:36:56.811 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 2m ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:36:56.811 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 2m ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:36:56.812 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 2m ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:36:56.812 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 2m ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:36:56.812 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 2m ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:36:56.812 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 2m ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:36:56.812 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 2m ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:36:56.813 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 2m ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:36:56.813 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 2m ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:36:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:55.590410+0000 mgr.smithi067.rdualw (mgr.24569) 6548 : cluster [DBG] pgmap v5642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:36:57.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:55.590410+0000 mgr.smithi067.rdualw (mgr.24569) 6548 : cluster [DBG] pgmap v5642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:36:57.149 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:36:57.149 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:36:57.150 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:36:57.150 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:36:57.150 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:36:57.150 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:36:57.151 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:36:57.151 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:36:57.151 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:36:57.151 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:36:57.152 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:36:57.152 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:36:57.152 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:36:57.152 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:36:57.152 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:36:57.153 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:36:57.153 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:36:57.153 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:36:57.154 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:36:58.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:36:56.506005+0000 mgr.smithi067.rdualw (mgr.24569) 6549 : audit [DBG] from='client.38506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:36:58.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:36:56.792379+0000 mgr.smithi067.rdualw (mgr.24569) 6550 : audit [DBG] from='client.38510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:36:58.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:36:57.149718+0000 mon.smithi061 (mon.0) 1464 : audit [DBG] from='client.? 172.21.15.61:0/2463527729' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:36:58.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:36:56.506005+0000 mgr.smithi067.rdualw (mgr.24569) 6549 : audit [DBG] from='client.38506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:36:58.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:36:56.792379+0000 mgr.smithi067.rdualw (mgr.24569) 6550 : audit [DBG] from='client.38510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:36:58.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:36:57.149718+0000 mon.smithi061 (mon.0) 1464 : audit [DBG] from='client.? 172.21.15.61:0/2463527729' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:36:59.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:36:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:57.590987+0000 mgr.smithi067.rdualw (mgr.24569) 6551 : cluster [DBG] pgmap v5643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:36:59.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:36:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:57.590987+0000 mgr.smithi067.rdualw (mgr.24569) 6551 : cluster [DBG] pgmap v5643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:01.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:36:59.591475+0000 mgr.smithi067.rdualw (mgr.24569) 6552 : cluster [DBG] pgmap v5644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:01.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:36:59.591475+0000 mgr.smithi067.rdualw (mgr.24569) 6552 : cluster [DBG] pgmap v5644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:02.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:01.592478+0000 mgr.smithi067.rdualw (mgr.24569) 6553 : cluster [DBG] pgmap v5645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:01.592478+0000 mgr.smithi067.rdualw (mgr.24569) 6553 : cluster [DBG] pgmap v5645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:05.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:03.592993+0000 mgr.smithi067.rdualw (mgr.24569) 6554 : cluster [DBG] pgmap v5646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:05.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:03.592993+0000 mgr.smithi067.rdualw (mgr.24569) 6554 : cluster [DBG] pgmap v5646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:07.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:05.593792+0000 mgr.smithi067.rdualw (mgr.24569) 6555 : cluster [DBG] pgmap v5647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:37:07.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:05.593792+0000 mgr.smithi067.rdualw (mgr.24569) 6555 : cluster [DBG] pgmap v5647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:37:09.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:07.594265+0000 mgr.smithi067.rdualw (mgr.24569) 6556 : cluster [DBG] pgmap v5648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:09.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:07.594265+0000 mgr.smithi067.rdualw (mgr.24569) 6556 : cluster [DBG] pgmap v5648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:11.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:09.595048+0000 mgr.smithi067.rdualw (mgr.24569) 6557 : cluster [DBG] pgmap v5649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:11.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:09.595048+0000 mgr.smithi067.rdualw (mgr.24569) 6557 : cluster [DBG] pgmap v5649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:12.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:11.595885+0000 mgr.smithi067.rdualw (mgr.24569) 6558 : cluster [DBG] pgmap v5650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:11.595885+0000 mgr.smithi067.rdualw (mgr.24569) 6558 : cluster [DBG] pgmap v5650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:15.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:13.596465+0000 mgr.smithi067.rdualw (mgr.24569) 6559 : cluster [DBG] pgmap v5651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:15.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:13.596465+0000 mgr.smithi067.rdualw (mgr.24569) 6559 : cluster [DBG] pgmap v5651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:17.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:15.597236+0000 mgr.smithi067.rdualw (mgr.24569) 6560 : cluster [DBG] pgmap v5652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:37:17.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:15.597236+0000 mgr.smithi067.rdualw (mgr.24569) 6560 : cluster [DBG] pgmap v5652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:37:19.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:17.597971+0000 mgr.smithi067.rdualw (mgr.24569) 6561 : cluster [DBG] pgmap v5653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:19.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:17.597971+0000 mgr.smithi067.rdualw (mgr.24569) 6561 : cluster [DBG] pgmap v5653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:21.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:19.598597+0000 mgr.smithi067.rdualw (mgr.24569) 6562 : cluster [DBG] pgmap v5654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:21.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:19.598597+0000 mgr.smithi067.rdualw (mgr.24569) 6562 : cluster [DBG] pgmap v5654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:22.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:37:20.849645+0000 mon.smithi067 (mon.1) 1010 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:37:22.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:37:20.851069+0000 mon.smithi067 (mon.1) 1011 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:37:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:37:20.851969+0000 mon.smithi067 (mon.1) 1012 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:37:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:37:20.852814+0000 mgr.smithi067.rdualw (mgr.24569) 6563 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:37:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:37:21.275048+0000 mon.smithi061 (mon.0) 1465 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:37:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:37:21.282909+0000 mon.smithi061 (mon.0) 1466 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:37:22.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:37:20.849645+0000 mon.smithi067 (mon.1) 1010 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:37:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:37:20.851069+0000 mon.smithi067 (mon.1) 1011 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:37:22.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:37:20.851969+0000 mon.smithi067 (mon.1) 1012 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:37:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:37:20.852814+0000 mgr.smithi067.rdualw (mgr.24569) 6563 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:37:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:37:21.275048+0000 mon.smithi061 (mon.0) 1465 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:37:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:37:21.282909+0000 mon.smithi061 (mon.0) 1466 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:37:23.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:21.599497+0000 mgr.smithi067.rdualw (mgr.24569) 6564 : cluster [DBG] pgmap v5655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:23.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:21.599497+0000 mgr.smithi067.rdualw (mgr.24569) 6564 : cluster [DBG] pgmap v5655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:25.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:23.599986+0000 mgr.smithi067.rdualw (mgr.24569) 6565 : cluster [DBG] pgmap v5656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:25.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:23.599986+0000 mgr.smithi067.rdualw (mgr.24569) 6565 : cluster [DBG] pgmap v5656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:27.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:25.601043+0000 mgr.smithi067.rdualw (mgr.24569) 6566 : cluster [DBG] pgmap v5657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:37:27.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:25.601043+0000 mgr.smithi067.rdualw (mgr.24569) 6566 : cluster [DBG] pgmap v5657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:37:27.459 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:37:27.749 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:37:27.749 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 3m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:37:27.750 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 3m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:37:27.750 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 3m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:37:27.750 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 3m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:37:27.750 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 3m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:37:27.751 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 3m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:37:27.751 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 3m ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:37:27.751 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 3m ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:37:27.751 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 3m ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:37:27.752 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 3m ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:37:27.752 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 3m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:37:27.752 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 3m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:37:27.752 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 3m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:37:27.752 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 3m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:37:27.753 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 3m ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:37:27.753 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 3m ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:37:27.753 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 3m ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:37:27.753 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 3m ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:37:27.754 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 3m ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:37:27.754 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 3m ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:37:27.754 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 3m ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:37:27.754 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 3m ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:37:27.754 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 3m ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:37:28.157 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:37:28.173 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:37:28.174 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:37:28.174 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:37:28.174 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:37:28.175 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:37:28.175 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:37:28.175 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:37:28.176 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:37:28.176 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:37:28.176 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:37:28.176 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:37:28.177 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:37:28.177 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:37:28.177 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:37:28.177 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:37:28.177 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:37:28.178 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:37:28.178 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:37:29.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:37:27.447414+0000 mgr.smithi067.rdualw (mgr.24569) 6567 : audit [DBG] from='client.38518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:37:29.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:27.601578+0000 mgr.smithi067.rdualw (mgr.24569) 6568 : cluster [DBG] pgmap v5658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:29.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:37:27.733873+0000 mgr.smithi067.rdualw (mgr.24569) 6569 : audit [DBG] from='client.38522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:37:29.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:37:28.158450+0000 mon.smithi061 (mon.0) 1467 : audit [DBG] from='client.? 172.21.15.61:0/572171826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:37:29.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:37:27.447414+0000 mgr.smithi067.rdualw (mgr.24569) 6567 : audit [DBG] from='client.38518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:37:29.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:27.601578+0000 mgr.smithi067.rdualw (mgr.24569) 6568 : cluster [DBG] pgmap v5658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:29.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:37:27.733873+0000 mgr.smithi067.rdualw (mgr.24569) 6569 : audit [DBG] from='client.38522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:37:29.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:37:28.158450+0000 mon.smithi061 (mon.0) 1467 : audit [DBG] from='client.? 172.21.15.61:0/572171826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:37:31.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:29.602145+0000 mgr.smithi067.rdualw (mgr.24569) 6570 : cluster [DBG] pgmap v5659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:31.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:29.602145+0000 mgr.smithi067.rdualw (mgr.24569) 6570 : cluster [DBG] pgmap v5659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:31.603200+0000 mgr.smithi067.rdualw (mgr.24569) 6571 : cluster [DBG] pgmap v5660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:31.603200+0000 mgr.smithi067.rdualw (mgr.24569) 6571 : cluster [DBG] pgmap v5660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:35.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:33.603839+0000 mgr.smithi067.rdualw (mgr.24569) 6572 : cluster [DBG] pgmap v5661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:35.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:33.603839+0000 mgr.smithi067.rdualw (mgr.24569) 6572 : cluster [DBG] pgmap v5661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:36.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:37:35.469997+0000 mon.smithi067 (mon.1) 1013 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:37:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:37:35.470269+0000 mon.smithi067 (mon.1) 1014 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:37:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:37:35.470485+0000 mon.smithi061 (mon.0) 1468 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:37:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:37:35.470804+0000 mon.smithi061 (mon.0) 1469 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:37:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:37:35.469997+0000 mon.smithi067 (mon.1) 1013 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:37:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:37:35.470269+0000 mon.smithi067 (mon.1) 1014 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:37:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:37:35.470485+0000 mon.smithi061 (mon.0) 1468 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:37:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:37:35.470804+0000 mon.smithi061 (mon.0) 1469 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:37:37.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:35.604652+0000 mgr.smithi067.rdualw (mgr.24569) 6573 : cluster [DBG] pgmap v5662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:37:37.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:35.604652+0000 mgr.smithi067.rdualw (mgr.24569) 6573 : cluster [DBG] pgmap v5662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:37:39.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:37.605248+0000 mgr.smithi067.rdualw (mgr.24569) 6574 : cluster [DBG] pgmap v5663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:37.605248+0000 mgr.smithi067.rdualw (mgr.24569) 6574 : cluster [DBG] pgmap v5663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:41.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:39.605919+0000 mgr.smithi067.rdualw (mgr.24569) 6575 : cluster [DBG] pgmap v5664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:41.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:39.605919+0000 mgr.smithi067.rdualw (mgr.24569) 6575 : cluster [DBG] pgmap v5664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:41.606778+0000 mgr.smithi067.rdualw (mgr.24569) 6576 : cluster [DBG] pgmap v5665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:42.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:41.606778+0000 mgr.smithi067.rdualw (mgr.24569) 6576 : cluster [DBG] pgmap v5665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:45.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:43.607354+0000 mgr.smithi067.rdualw (mgr.24569) 6577 : cluster [DBG] pgmap v5666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:45.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:43.607354+0000 mgr.smithi067.rdualw (mgr.24569) 6577 : cluster [DBG] pgmap v5666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:47.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:45.608167+0000 mgr.smithi067.rdualw (mgr.24569) 6578 : cluster [DBG] pgmap v5667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:37:47.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:45.608167+0000 mgr.smithi067.rdualw (mgr.24569) 6578 : cluster [DBG] pgmap v5667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:37:49.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:47.608746+0000 mgr.smithi067.rdualw (mgr.24569) 6579 : cluster [DBG] pgmap v5668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:49.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:47.608746+0000 mgr.smithi067.rdualw (mgr.24569) 6579 : cluster [DBG] pgmap v5668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:51.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:49.609371+0000 mgr.smithi067.rdualw (mgr.24569) 6580 : cluster [DBG] pgmap v5669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:51.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:49.609371+0000 mgr.smithi067.rdualw (mgr.24569) 6580 : cluster [DBG] pgmap v5669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:51.610409+0000 mgr.smithi067.rdualw (mgr.24569) 6581 : cluster [DBG] pgmap v5670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:51.610409+0000 mgr.smithi067.rdualw (mgr.24569) 6581 : cluster [DBG] pgmap v5670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:55.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:53.610929+0000 mgr.smithi067.rdualw (mgr.24569) 6582 : cluster [DBG] pgmap v5671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:55.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:53.610929+0000 mgr.smithi067.rdualw (mgr.24569) 6582 : cluster [DBG] pgmap v5671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:57.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:55.611745+0000 mgr.smithi067.rdualw (mgr.24569) 6583 : cluster [DBG] pgmap v5672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:37:57.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:55.611745+0000 mgr.smithi067.rdualw (mgr.24569) 6583 : cluster [DBG] pgmap v5672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:37:58.477 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:37:58.771 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:37:58.771 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 3m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:37:58.771 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 3m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:37:58.772 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 3m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:37:58.772 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 3m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:37:58.772 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 3m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:37:58.772 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 3m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:37:58.773 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 3m ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:37:58.773 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 3m ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:37:58.773 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 3m ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:37:58.773 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 3m ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:37:58.774 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 3m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:37:58.774 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 3m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:37:58.774 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 3m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:37:58.774 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 3m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:37:58.774 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 3m ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:37:58.775 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 3m ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:37:58.775 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 3m ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:37:58.775 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 3m ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:37:58.775 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 3m ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:37:58.776 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 3m ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:37:58.776 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 3m ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:37:58.776 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 3m ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:37:58.776 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 3m ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:37:59.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:57.612234+0000 mgr.smithi067.rdualw (mgr.24569) 6584 : cluster [DBG] pgmap v5673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:59.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:57.612234+0000 mgr.smithi067.rdualw (mgr.24569) 6584 : cluster [DBG] pgmap v5673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:37:59.158 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:37:59.158 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:37:59.158 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:37:59.159 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:37:59.159 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:37:59.159 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:37:59.159 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:37:59.160 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:37:59.160 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:37:59.160 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:37:59.160 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:37:59.161 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:37:59.162 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:37:59.162 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:37:59.162 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:37:59.162 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:37:59.163 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:37:59.163 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:37:59.163 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:38:00.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:37:58.463173+0000 mgr.smithi067.rdualw (mgr.24569) 6585 : audit [DBG] from='client.38530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:38:00.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:37:58.755504+0000 mgr.smithi067.rdualw (mgr.24569) 6586 : audit [DBG] from='client.38534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:38:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:37:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:37:59.158707+0000 mon.smithi061 (mon.0) 1470 : audit [DBG] from='client.? 172.21.15.61:0/3290882035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:38:00.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:37:58.463173+0000 mgr.smithi067.rdualw (mgr.24569) 6585 : audit [DBG] from='client.38530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:38:00.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:37:58.755504+0000 mgr.smithi067.rdualw (mgr.24569) 6586 : audit [DBG] from='client.38534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:38:00.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:37:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:37:59.158707+0000 mon.smithi061 (mon.0) 1470 : audit [DBG] from='client.? 172.21.15.61:0/3290882035' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:38:01.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:37:59.612764+0000 mgr.smithi067.rdualw (mgr.24569) 6587 : cluster [DBG] pgmap v5674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:01.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:37:59.612764+0000 mgr.smithi067.rdualw (mgr.24569) 6587 : cluster [DBG] pgmap v5674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:02.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:01.613641+0000 mgr.smithi067.rdualw (mgr.24569) 6588 : cluster [DBG] pgmap v5675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:01.613641+0000 mgr.smithi067.rdualw (mgr.24569) 6588 : cluster [DBG] pgmap v5675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:05.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:03.614145+0000 mgr.smithi067.rdualw (mgr.24569) 6589 : cluster [DBG] pgmap v5676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:05.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:03.614145+0000 mgr.smithi067.rdualw (mgr.24569) 6589 : cluster [DBG] pgmap v5676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:07.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:05.615102+0000 mgr.smithi067.rdualw (mgr.24569) 6590 : cluster [DBG] pgmap v5677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:38:07.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:05.615102+0000 mgr.smithi067.rdualw (mgr.24569) 6590 : cluster [DBG] pgmap v5677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:38:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:07.615686+0000 mgr.smithi067.rdualw (mgr.24569) 6591 : cluster [DBG] pgmap v5678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:09.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:07.615686+0000 mgr.smithi067.rdualw (mgr.24569) 6591 : cluster [DBG] pgmap v5678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:11.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:09.616444+0000 mgr.smithi067.rdualw (mgr.24569) 6592 : cluster [DBG] pgmap v5679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:11.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:09.616444+0000 mgr.smithi067.rdualw (mgr.24569) 6592 : cluster [DBG] pgmap v5679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:12.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:11.617523+0000 mgr.smithi067.rdualw (mgr.24569) 6593 : cluster [DBG] pgmap v5680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:12.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:11.617523+0000 mgr.smithi067.rdualw (mgr.24569) 6593 : cluster [DBG] pgmap v5680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:15.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:13.618075+0000 mgr.smithi067.rdualw (mgr.24569) 6594 : cluster [DBG] pgmap v5681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:15.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:13.618075+0000 mgr.smithi067.rdualw (mgr.24569) 6594 : cluster [DBG] pgmap v5681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:17.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:15.618943+0000 mgr.smithi067.rdualw (mgr.24569) 6595 : cluster [DBG] pgmap v5682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:38:17.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:15.618943+0000 mgr.smithi067.rdualw (mgr.24569) 6595 : cluster [DBG] pgmap v5682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:38:19.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:17.619693+0000 mgr.smithi067.rdualw (mgr.24569) 6596 : cluster [DBG] pgmap v5683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:19.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:17.619693+0000 mgr.smithi067.rdualw (mgr.24569) 6596 : cluster [DBG] pgmap v5683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:21.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:19.620336+0000 mgr.smithi067.rdualw (mgr.24569) 6597 : cluster [DBG] pgmap v5684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:21.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:19.620336+0000 mgr.smithi067.rdualw (mgr.24569) 6597 : cluster [DBG] pgmap v5684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:38:21.286675+0000 mon.smithi067 (mon.1) 1015 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:38:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:38:21.288185+0000 mon.smithi067 (mon.1) 1016 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:38:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:38:21.289145+0000 mon.smithi067 (mon.1) 1017 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:38:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:38:21.290021+0000 mgr.smithi067.rdualw (mgr.24569) 6598 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:38:22.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:21.621066+0000 mgr.smithi067.rdualw (mgr.24569) 6599 : cluster [DBG] pgmap v5685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:22.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:38:21.694474+0000 mon.smithi061 (mon.0) 1471 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:38:22.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:38:21.699689+0000 mon.smithi061 (mon.0) 1472 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:38:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:38:21.286675+0000 mon.smithi067 (mon.1) 1015 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:38:22.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:38:21.288185+0000 mon.smithi067 (mon.1) 1016 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:38:22.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:38:21.289145+0000 mon.smithi067 (mon.1) 1017 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:38:22.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:38:21.290021+0000 mgr.smithi067.rdualw (mgr.24569) 6598 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:38:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:21.621066+0000 mgr.smithi067.rdualw (mgr.24569) 6599 : cluster [DBG] pgmap v5685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:38:21.694474+0000 mon.smithi061 (mon.0) 1471 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:38:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:38:21.699689+0000 mon.smithi061 (mon.0) 1472 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:38:25.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:23.621622+0000 mgr.smithi067.rdualw (mgr.24569) 6600 : cluster [DBG] pgmap v5686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:25.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:23.621622+0000 mgr.smithi067.rdualw (mgr.24569) 6600 : cluster [DBG] pgmap v5686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:27.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:25.622739+0000 mgr.smithi067.rdualw (mgr.24569) 6601 : cluster [DBG] pgmap v5687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:38:27.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:25.622739+0000 mgr.smithi067.rdualw (mgr.24569) 6601 : cluster [DBG] pgmap v5687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:38:29.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:27.623299+0000 mgr.smithi067.rdualw (mgr.24569) 6602 : cluster [DBG] pgmap v5688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:29.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:27.623299+0000 mgr.smithi067.rdualw (mgr.24569) 6602 : cluster [DBG] pgmap v5688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:29.468 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:38:29.758 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:38:29.758 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 4m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:38:29.758 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 4m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:38:29.759 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 4m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:38:29.759 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 4m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:38:29.759 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 4m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:38:29.759 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 4m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:38:29.760 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 4m ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:38:29.760 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 4m ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:38:29.760 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 4m ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:38:29.760 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 4m ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:38:29.761 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 4m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:38:29.761 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 4m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:38:29.761 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 4m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:38:29.763 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 4m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:38:29.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (2h) 4m ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:38:29.764 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 4m ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:38:29.766 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 4m ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:38:29.766 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 4m ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:38:29.766 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 4m ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:38:29.766 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 4m ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:38:29.767 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 4m ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:38:29.767 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 4m ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:38:29.767 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 4m ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:38:30.101 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:38:30.245 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:38:30.245 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:38:30.246 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:38:30.246 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:38:30.246 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:38:30.246 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:38:30.246 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:38:30.247 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:38:30.247 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:38:30.247 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:38:30.247 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:38:30.248 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:38:30.248 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:38:30.248 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:38:30.248 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:38:30.248 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:38:30.249 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:38:30.249 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:38:31.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:38:29.454234+0000 mgr.smithi067.rdualw (mgr.24569) 6603 : audit [DBG] from='client.38542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:38:31.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:29.624031+0000 mgr.smithi067.rdualw (mgr.24569) 6604 : cluster [DBG] pgmap v5689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:31.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:38:29.742517+0000 mgr.smithi067.rdualw (mgr.24569) 6605 : audit [DBG] from='client.38546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:38:31.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:38:30.102138+0000 mon.smithi061 (mon.0) 1473 : audit [DBG] from='client.? 172.21.15.61:0/2689545872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:38:31.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:38:29.454234+0000 mgr.smithi067.rdualw (mgr.24569) 6603 : audit [DBG] from='client.38542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:38:31.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:29.624031+0000 mgr.smithi067.rdualw (mgr.24569) 6604 : cluster [DBG] pgmap v5689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:31.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:38:29.742517+0000 mgr.smithi067.rdualw (mgr.24569) 6605 : audit [DBG] from='client.38546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:38:31.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:38:30.102138+0000 mon.smithi061 (mon.0) 1473 : audit [DBG] from='client.? 172.21.15.61:0/2689545872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:38:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:31.624852+0000 mgr.smithi067.rdualw (mgr.24569) 6606 : cluster [DBG] pgmap v5690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:31.624852+0000 mgr.smithi067.rdualw (mgr.24569) 6606 : cluster [DBG] pgmap v5690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:35.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:33.625518+0000 mgr.smithi067.rdualw (mgr.24569) 6607 : cluster [DBG] pgmap v5691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:35.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:33.625518+0000 mgr.smithi067.rdualw (mgr.24569) 6607 : cluster [DBG] pgmap v5691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:38:35.476905+0000 mon.smithi067 (mon.1) 1018 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:38:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:38:35.477171+0000 mon.smithi067 (mon.1) 1019 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:38:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:38:35.477483+0000 mon.smithi061 (mon.0) 1474 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:38:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:38:35.477827+0000 mon.smithi061 (mon.0) 1475 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:38:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:38:35.476905+0000 mon.smithi067 (mon.1) 1018 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:38:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:38:35.477171+0000 mon.smithi067 (mon.1) 1019 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:38:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:38:35.477483+0000 mon.smithi061 (mon.0) 1474 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:38:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:38:35.477827+0000 mon.smithi061 (mon.0) 1475 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:38:37.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:35.626441+0000 mgr.smithi067.rdualw (mgr.24569) 6608 : cluster [DBG] pgmap v5692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:38:37.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:35.626441+0000 mgr.smithi067.rdualw (mgr.24569) 6608 : cluster [DBG] pgmap v5692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:38:39.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:37.627057+0000 mgr.smithi067.rdualw (mgr.24569) 6609 : cluster [DBG] pgmap v5693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:39.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:37.627057+0000 mgr.smithi067.rdualw (mgr.24569) 6609 : cluster [DBG] pgmap v5693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:41.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:39.627692+0000 mgr.smithi067.rdualw (mgr.24569) 6610 : cluster [DBG] pgmap v5694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:41.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:39.627692+0000 mgr.smithi067.rdualw (mgr.24569) 6610 : cluster [DBG] pgmap v5694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:41.628728+0000 mgr.smithi067.rdualw (mgr.24569) 6611 : cluster [DBG] pgmap v5695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:42.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:41.628728+0000 mgr.smithi067.rdualw (mgr.24569) 6611 : cluster [DBG] pgmap v5695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:45.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:43.629387+0000 mgr.smithi067.rdualw (mgr.24569) 6612 : cluster [DBG] pgmap v5696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:45.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:43.629387+0000 mgr.smithi067.rdualw (mgr.24569) 6612 : cluster [DBG] pgmap v5696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:47.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:45.630306+0000 mgr.smithi067.rdualw (mgr.24569) 6613 : cluster [DBG] pgmap v5697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:38:47.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:45.630306+0000 mgr.smithi067.rdualw (mgr.24569) 6613 : cluster [DBG] pgmap v5697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:38:49.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:47.630773+0000 mgr.smithi067.rdualw (mgr.24569) 6614 : cluster [DBG] pgmap v5698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:49.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:47.630773+0000 mgr.smithi067.rdualw (mgr.24569) 6614 : cluster [DBG] pgmap v5698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:51.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:49.631469+0000 mgr.smithi067.rdualw (mgr.24569) 6615 : cluster [DBG] pgmap v5699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:49.631469+0000 mgr.smithi067.rdualw (mgr.24569) 6615 : cluster [DBG] pgmap v5699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:51.632376+0000 mgr.smithi067.rdualw (mgr.24569) 6616 : cluster [DBG] pgmap v5700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:51.632376+0000 mgr.smithi067.rdualw (mgr.24569) 6616 : cluster [DBG] pgmap v5700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:55.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:53.633075+0000 mgr.smithi067.rdualw (mgr.24569) 6617 : cluster [DBG] pgmap v5701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:55.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:53.633075+0000 mgr.smithi067.rdualw (mgr.24569) 6617 : cluster [DBG] pgmap v5701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:57.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:55.634170+0000 mgr.smithi067.rdualw (mgr.24569) 6618 : cluster [DBG] pgmap v5702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:38:57.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:55.634170+0000 mgr.smithi067.rdualw (mgr.24569) 6618 : cluster [DBG] pgmap v5702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:38:59.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:38:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:57.634804+0000 mgr.smithi067.rdualw (mgr.24569) 6619 : cluster [DBG] pgmap v5703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:38:59.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:38:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:57.634804+0000 mgr.smithi067.rdualw (mgr.24569) 6619 : cluster [DBG] pgmap v5703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:00.407 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:39:00.700 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:39:00.701 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 4m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:39:00.701 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 4m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:39:00.701 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 4m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:39:00.702 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 4m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:39:00.702 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 4m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:39:00.702 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 4m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:39:00.702 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 4m ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:39:00.702 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 4m ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:39:00.703 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 4m ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:39:00.703 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 4m ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:39:00.703 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 4m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:39:00.703 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 4m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:39:00.704 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 4m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:39:00.704 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 4m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:39:00.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 4m ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:39:00.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 4m ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:39:00.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 4m ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:39:00.705 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 4m ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:39:00.705 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 4m ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:39:00.705 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 4m ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:39:00.705 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 4m ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:39:00.706 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 4m ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:39:00.706 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 4m ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:39:01.040 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:39:01.040 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:39:01.040 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:39:01.041 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:39:01.041 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:39:01.041 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:39:01.041 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:39:01.042 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:39:01.042 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:39:01.042 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:39:01.042 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:39:01.042 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:39:01.043 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:39:01.043 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:39:01.043 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:39:01.044 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:39:01.044 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:39:01.045 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:39:01.045 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:39:01.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:38:59.635364+0000 mgr.smithi067.rdualw (mgr.24569) 6620 : cluster [DBG] pgmap v5704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:01.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:38:59.635364+0000 mgr.smithi067.rdualw (mgr.24569) 6620 : cluster [DBG] pgmap v5704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:02.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:39:00.395083+0000 mgr.smithi067.rdualw (mgr.24569) 6621 : audit [DBG] from='client.38554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:39:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:39:00.685304+0000 mgr.smithi067.rdualw (mgr.24569) 6622 : audit [DBG] from='client.38558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:39:02.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:39:01.040499+0000 mon.smithi061 (mon.0) 1476 : audit [DBG] from='client.? 172.21.15.61:0/901416118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:39:02.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:39:00.395083+0000 mgr.smithi067.rdualw (mgr.24569) 6621 : audit [DBG] from='client.38554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:39:02.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:39:00.685304+0000 mgr.smithi067.rdualw (mgr.24569) 6622 : audit [DBG] from='client.38558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:39:02.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:39:01.040499+0000 mon.smithi061 (mon.0) 1476 : audit [DBG] from='client.? 172.21.15.61:0/901416118' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:39:03.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:01.636293+0000 mgr.smithi067.rdualw (mgr.24569) 6623 : cluster [DBG] pgmap v5705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:03.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:01.636293+0000 mgr.smithi067.rdualw (mgr.24569) 6623 : cluster [DBG] pgmap v5705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:05.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:03.636821+0000 mgr.smithi067.rdualw (mgr.24569) 6624 : cluster [DBG] pgmap v5706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:05.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:03.636821+0000 mgr.smithi067.rdualw (mgr.24569) 6624 : cluster [DBG] pgmap v5706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:07.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:05.637843+0000 mgr.smithi067.rdualw (mgr.24569) 6625 : cluster [DBG] pgmap v5707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:39:07.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:05.637843+0000 mgr.smithi067.rdualw (mgr.24569) 6625 : cluster [DBG] pgmap v5707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:39:09.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:07.638352+0000 mgr.smithi067.rdualw (mgr.24569) 6626 : cluster [DBG] pgmap v5708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:09.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:07.638352+0000 mgr.smithi067.rdualw (mgr.24569) 6626 : cluster [DBG] pgmap v5708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:11.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:09.639044+0000 mgr.smithi067.rdualw (mgr.24569) 6627 : cluster [DBG] pgmap v5709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:11.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:09.639044+0000 mgr.smithi067.rdualw (mgr.24569) 6627 : cluster [DBG] pgmap v5709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:12.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:11.640106+0000 mgr.smithi067.rdualw (mgr.24569) 6628 : cluster [DBG] pgmap v5710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:12.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:11.640106+0000 mgr.smithi067.rdualw (mgr.24569) 6628 : cluster [DBG] pgmap v5710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:15.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:13.640671+0000 mgr.smithi067.rdualw (mgr.24569) 6629 : cluster [DBG] pgmap v5711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:15.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:13.640671+0000 mgr.smithi067.rdualw (mgr.24569) 6629 : cluster [DBG] pgmap v5711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:17.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:15.641733+0000 mgr.smithi067.rdualw (mgr.24569) 6630 : cluster [DBG] pgmap v5712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:39:17.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:15.641733+0000 mgr.smithi067.rdualw (mgr.24569) 6630 : cluster [DBG] pgmap v5712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:39:19.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:17.642360+0000 mgr.smithi067.rdualw (mgr.24569) 6631 : cluster [DBG] pgmap v5713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:19.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:17.642360+0000 mgr.smithi067.rdualw (mgr.24569) 6631 : cluster [DBG] pgmap v5713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:21.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:19.642925+0000 mgr.smithi067.rdualw (mgr.24569) 6632 : cluster [DBG] pgmap v5714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:21.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:19.642925+0000 mgr.smithi067.rdualw (mgr.24569) 6632 : cluster [DBG] pgmap v5714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:21.643728+0000 mgr.smithi067.rdualw (mgr.24569) 6633 : cluster [DBG] pgmap v5715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:22.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:39:21.703381+0000 mon.smithi067 (mon.1) 1020 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:39:22.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:39:21.704848+0000 mon.smithi067 (mon.1) 1021 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:39:22.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:39:21.705831+0000 mon.smithi067 (mon.1) 1022 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:39:22.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:39:21.706673+0000 mgr.smithi067.rdualw (mgr.24569) 6634 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:39:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:21.643728+0000 mgr.smithi067.rdualw (mgr.24569) 6633 : cluster [DBG] pgmap v5715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:39:21.703381+0000 mon.smithi067 (mon.1) 1020 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:39:22.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:39:21.704848+0000 mon.smithi067 (mon.1) 1021 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:39:22.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:39:21.705831+0000 mon.smithi067 (mon.1) 1022 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:39:22.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:39:21.706673+0000 mgr.smithi067.rdualw (mgr.24569) 6634 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:39:23.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:39:22.109121+0000 mon.smithi061 (mon.0) 1477 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:39:23.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:39:22.114568+0000 mon.smithi061 (mon.0) 1478 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:39:23.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:39:22.109121+0000 mon.smithi061 (mon.0) 1477 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:39:23.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:39:22.114568+0000 mon.smithi061 (mon.0) 1478 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:39:24.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:23.644236+0000 mgr.smithi067.rdualw (mgr.24569) 6635 : cluster [DBG] pgmap v5716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:24.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:23.644236+0000 mgr.smithi067.rdualw (mgr.24569) 6635 : cluster [DBG] pgmap v5716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:27.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:25.645043+0000 mgr.smithi067.rdualw (mgr.24569) 6636 : cluster [DBG] pgmap v5717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:39:27.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:25.645043+0000 mgr.smithi067.rdualw (mgr.24569) 6636 : cluster [DBG] pgmap v5717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:39:29.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:27.645548+0000 mgr.smithi067.rdualw (mgr.24569) 6637 : cluster [DBG] pgmap v5718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:29.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:27.645548+0000 mgr.smithi067.rdualw (mgr.24569) 6637 : cluster [DBG] pgmap v5718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:31.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:29.646090+0000 mgr.smithi067.rdualw (mgr.24569) 6638 : cluster [DBG] pgmap v5719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:31.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:29.646090+0000 mgr.smithi067.rdualw (mgr.24569) 6638 : cluster [DBG] pgmap v5719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:31.346 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:39:31.636 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:39:31.637 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 5m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:39:31.637 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 5m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:39:31.638 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 5m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:39:31.638 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 5m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:39:31.639 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 5m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:39:31.639 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 5m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:39:31.639 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 5m ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:39:31.640 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 5m ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:39:31.640 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 5m ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:39:31.641 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 5m ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:39:31.641 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 5m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:39:31.641 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 5m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:39:31.642 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 5m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:39:31.642 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 5m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:39:31.643 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 5m ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:39:31.643 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 5m ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:39:31.644 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 5m ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:39:31.644 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 5m ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:39:31.644 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 5m ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:39:31.645 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 5m ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:39:31.645 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 5m ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:39:31.646 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 5m ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:39:31.646 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 5m ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:39:31.980 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:39:31.981 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:39:31.981 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:39:31.981 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:39:31.981 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:39:31.982 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:39:31.982 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:39:31.983 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:39:31.983 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:39:31.984 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:39:31.984 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:39:31.985 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:39:31.985 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:39:31.986 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:39:31.986 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:39:31.986 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:39:31.987 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:39:31.987 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:39:31.988 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:39:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:39:31.335316+0000 mgr.smithi067.rdualw (mgr.24569) 6639 : audit [DBG] from='client.38566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:39:32.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:39:31.620373+0000 mgr.smithi067.rdualw (mgr.24569) 6640 : audit [DBG] from='client.38570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:39:32.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:31.647100+0000 mgr.smithi067.rdualw (mgr.24569) 6641 : cluster [DBG] pgmap v5720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:32.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:39:31.981427+0000 mon.smithi061 (mon.0) 1479 : audit [DBG] from='client.? 172.21.15.61:0/1867055726' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:39:32.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:39:31.335316+0000 mgr.smithi067.rdualw (mgr.24569) 6639 : audit [DBG] from='client.38566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:39:32.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:39:31.620373+0000 mgr.smithi067.rdualw (mgr.24569) 6640 : audit [DBG] from='client.38570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:39:32.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:31.647100+0000 mgr.smithi067.rdualw (mgr.24569) 6641 : cluster [DBG] pgmap v5720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:32.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:39:31.981427+0000 mon.smithi061 (mon.0) 1479 : audit [DBG] from='client.? 172.21.15.61:0/1867055726' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:39:35.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:33.647849+0000 mgr.smithi067.rdualw (mgr.24569) 6642 : cluster [DBG] pgmap v5721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:35.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:33.647849+0000 mgr.smithi067.rdualw (mgr.24569) 6642 : cluster [DBG] pgmap v5721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:36.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:39:35.482714+0000 mon.smithi067 (mon.1) 1023 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:39:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:39:35.483043+0000 mon.smithi067 (mon.1) 1024 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:39:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:39:35.483255+0000 mon.smithi061 (mon.0) 1480 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:39:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:39:35.483567+0000 mon.smithi061 (mon.0) 1481 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:39:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:39:35.482714+0000 mon.smithi067 (mon.1) 1023 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:39:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:39:35.483043+0000 mon.smithi067 (mon.1) 1024 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:39:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:39:35.483255+0000 mon.smithi061 (mon.0) 1480 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:39:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:39:35.483567+0000 mon.smithi061 (mon.0) 1481 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:39:37.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:35.648720+0000 mgr.smithi067.rdualw (mgr.24569) 6643 : cluster [DBG] pgmap v5722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:39:37.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:35.648720+0000 mgr.smithi067.rdualw (mgr.24569) 6643 : cluster [DBG] pgmap v5722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:39:39.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:37.649274+0000 mgr.smithi067.rdualw (mgr.24569) 6644 : cluster [DBG] pgmap v5723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:39.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:37.649274+0000 mgr.smithi067.rdualw (mgr.24569) 6644 : cluster [DBG] pgmap v5723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:41.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:39.649857+0000 mgr.smithi067.rdualw (mgr.24569) 6645 : cluster [DBG] pgmap v5724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:41.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:39.649857+0000 mgr.smithi067.rdualw (mgr.24569) 6645 : cluster [DBG] pgmap v5724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:41.650705+0000 mgr.smithi067.rdualw (mgr.24569) 6646 : cluster [DBG] pgmap v5725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:42.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:41.650705+0000 mgr.smithi067.rdualw (mgr.24569) 6646 : cluster [DBG] pgmap v5725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:45.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:43.651229+0000 mgr.smithi067.rdualw (mgr.24569) 6647 : cluster [DBG] pgmap v5726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:45.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:43.651229+0000 mgr.smithi067.rdualw (mgr.24569) 6647 : cluster [DBG] pgmap v5726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:47.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:45.652223+0000 mgr.smithi067.rdualw (mgr.24569) 6648 : cluster [DBG] pgmap v5727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:39:47.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:45.652223+0000 mgr.smithi067.rdualw (mgr.24569) 6648 : cluster [DBG] pgmap v5727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:39:49.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:47.652835+0000 mgr.smithi067.rdualw (mgr.24569) 6649 : cluster [DBG] pgmap v5728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:49.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:47.652835+0000 mgr.smithi067.rdualw (mgr.24569) 6649 : cluster [DBG] pgmap v5728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:51.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:49.653460+0000 mgr.smithi067.rdualw (mgr.24569) 6650 : cluster [DBG] pgmap v5729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:51.192 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:49.653460+0000 mgr.smithi067.rdualw (mgr.24569) 6650 : cluster [DBG] pgmap v5729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:52.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:51.654352+0000 mgr.smithi067.rdualw (mgr.24569) 6651 : cluster [DBG] pgmap v5730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:51.654352+0000 mgr.smithi067.rdualw (mgr.24569) 6651 : cluster [DBG] pgmap v5730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:55.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:53.654864+0000 mgr.smithi067.rdualw (mgr.24569) 6652 : cluster [DBG] pgmap v5731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:55.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:53.654864+0000 mgr.smithi067.rdualw (mgr.24569) 6652 : cluster [DBG] pgmap v5731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:57.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:55.655677+0000 mgr.smithi067.rdualw (mgr.24569) 6653 : cluster [DBG] pgmap v5732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:39:57.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:55.655677+0000 mgr.smithi067.rdualw (mgr.24569) 6653 : cluster [DBG] pgmap v5732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:39:59.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:39:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:57.656297+0000 mgr.smithi067.rdualw (mgr.24569) 6654 : cluster [DBG] pgmap v5733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:39:59.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:39:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:57.656297+0000 mgr.smithi067.rdualw (mgr.24569) 6654 : cluster [DBG] pgmap v5733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:01.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:39:59.657088+0000 mgr.smithi067.rdualw (mgr.24569) 6655 : cluster [DBG] pgmap v5734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:01.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:00.000087+0000 mon.smithi061 (mon.0) 1482 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T18:40:01.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:39:59.657088+0000 mgr.smithi067.rdualw (mgr.24569) 6655 : cluster [DBG] pgmap v5734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:01.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:00.000087+0000 mon.smithi061 (mon.0) 1482 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T18:40:02.291 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:40:02.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:01.658143+0000 mgr.smithi067.rdualw (mgr.24569) 6656 : cluster [DBG] pgmap v5735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:01.658143+0000 mgr.smithi067.rdualw (mgr.24569) 6656 : cluster [DBG] pgmap v5735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:02.588 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:40:02.588 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 5m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:40:02.588 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 5m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:40:02.589 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 5m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:40:02.589 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 5m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:40:02.589 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 5m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:40:02.589 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 5m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:40:02.590 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 5m ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:40:02.590 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 5m ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:40:02.590 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 5m ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:40:02.591 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 5m ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:40:02.591 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 5m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:40:02.591 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 5m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:40:02.591 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 5m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:40:02.592 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 5m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:40:02.592 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 5m ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:40:02.592 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 5m ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:40:02.592 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 5m ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:40:02.592 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 5m ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:40:02.593 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 5m ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:40:02.593 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 5m ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:40:02.593 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 5m ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:40:02.593 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 5m ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:40:02.594 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 5m ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:40:02.926 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:40:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:40:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:40:02.927 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:40:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:40:02.928 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:40:02.929 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:40:02.929 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:40:02.930 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:40:02.930 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:40:02.930 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:40:02.931 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:40:02.931 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:40:02.931 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:40:02.932 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:40:02.932 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:40:02.932 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:40:02.933 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:40:02.933 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:40:03.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:40:02.279937+0000 mgr.smithi067.rdualw (mgr.24569) 6657 : audit [DBG] from='client.38578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:40:03.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:40:02.571595+0000 mgr.smithi067.rdualw (mgr.24569) 6658 : audit [DBG] from='client.38582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:40:03.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:40:02.927152+0000 mon.smithi061 (mon.0) 1483 : audit [DBG] from='client.? 172.21.15.61:0/1750568207' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:40:03.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:40:02.279937+0000 mgr.smithi067.rdualw (mgr.24569) 6657 : audit [DBG] from='client.38578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:40:03.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:40:02.571595+0000 mgr.smithi067.rdualw (mgr.24569) 6658 : audit [DBG] from='client.38582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:40:03.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:40:02.927152+0000 mon.smithi061 (mon.0) 1483 : audit [DBG] from='client.? 172.21.15.61:0/1750568207' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:40:04.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:03.658775+0000 mgr.smithi067.rdualw (mgr.24569) 6659 : cluster [DBG] pgmap v5736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:04.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:03.658775+0000 mgr.smithi067.rdualw (mgr.24569) 6659 : cluster [DBG] pgmap v5736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:07.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:05.659631+0000 mgr.smithi067.rdualw (mgr.24569) 6660 : cluster [DBG] pgmap v5737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:40:07.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:05.659631+0000 mgr.smithi067.rdualw (mgr.24569) 6660 : cluster [DBG] pgmap v5737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:40:09.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:07.660147+0000 mgr.smithi067.rdualw (mgr.24569) 6661 : cluster [DBG] pgmap v5738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:09.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:07.660147+0000 mgr.smithi067.rdualw (mgr.24569) 6661 : cluster [DBG] pgmap v5738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:11.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:09.660894+0000 mgr.smithi067.rdualw (mgr.24569) 6662 : cluster [DBG] pgmap v5739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:11.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:09.660894+0000 mgr.smithi067.rdualw (mgr.24569) 6662 : cluster [DBG] pgmap v5739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:12.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:11.661946+0000 mgr.smithi067.rdualw (mgr.24569) 6663 : cluster [DBG] pgmap v5740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:12.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:11.661946+0000 mgr.smithi067.rdualw (mgr.24569) 6663 : cluster [DBG] pgmap v5740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:15.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:13.662617+0000 mgr.smithi067.rdualw (mgr.24569) 6664 : cluster [DBG] pgmap v5741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:15.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:13.662617+0000 mgr.smithi067.rdualw (mgr.24569) 6664 : cluster [DBG] pgmap v5741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:17.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:15.663558+0000 mgr.smithi067.rdualw (mgr.24569) 6665 : cluster [DBG] pgmap v5742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:40:17.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:15.663558+0000 mgr.smithi067.rdualw (mgr.24569) 6665 : cluster [DBG] pgmap v5742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:40:19.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:17.664210+0000 mgr.smithi067.rdualw (mgr.24569) 6666 : cluster [DBG] pgmap v5743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:19.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:17.664210+0000 mgr.smithi067.rdualw (mgr.24569) 6666 : cluster [DBG] pgmap v5743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:21.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:19.664845+0000 mgr.smithi067.rdualw (mgr.24569) 6667 : cluster [DBG] pgmap v5744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:21.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:19.664845+0000 mgr.smithi067.rdualw (mgr.24569) 6667 : cluster [DBG] pgmap v5744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:21.665846+0000 mgr.smithi067.rdualw (mgr.24569) 6668 : cluster [DBG] pgmap v5745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:22.311 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:21.665846+0000 mgr.smithi067.rdualw (mgr.24569) 6668 : cluster [DBG] pgmap v5745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:23.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:40:22.118317+0000 mon.smithi067 (mon.1) 1025 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:40:23.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:40:22.119845+0000 mon.smithi067 (mon.1) 1026 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:40:23.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:40:22.120889+0000 mon.smithi067 (mon.1) 1027 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:40:23.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:40:22.121807+0000 mgr.smithi067.rdualw (mgr.24569) 6669 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:40:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:40:22.537440+0000 mon.smithi061 (mon.0) 1484 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:40:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:40:22.543241+0000 mon.smithi061 (mon.0) 1485 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:40:23.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:40:22.118317+0000 mon.smithi067 (mon.1) 1025 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:40:23.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:40:22.119845+0000 mon.smithi067 (mon.1) 1026 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:40:23.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:40:22.120889+0000 mon.smithi067 (mon.1) 1027 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:40:23.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:40:22.121807+0000 mgr.smithi067.rdualw (mgr.24569) 6669 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:40:23.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:40:22.537440+0000 mon.smithi061 (mon.0) 1484 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:40:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:40:22.543241+0000 mon.smithi061 (mon.0) 1485 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:40:24.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:23.666429+0000 mgr.smithi067.rdualw (mgr.24569) 6670 : cluster [DBG] pgmap v5746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:24.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:23.666429+0000 mgr.smithi067.rdualw (mgr.24569) 6670 : cluster [DBG] pgmap v5746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:27.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:25.667434+0000 mgr.smithi067.rdualw (mgr.24569) 6671 : cluster [DBG] pgmap v5747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:40:27.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:25.667434+0000 mgr.smithi067.rdualw (mgr.24569) 6671 : cluster [DBG] pgmap v5747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:40:29.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:27.668089+0000 mgr.smithi067.rdualw (mgr.24569) 6672 : cluster [DBG] pgmap v5748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:29.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:27.668089+0000 mgr.smithi067.rdualw (mgr.24569) 6672 : cluster [DBG] pgmap v5748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:31.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:29.668734+0000 mgr.smithi067.rdualw (mgr.24569) 6673 : cluster [DBG] pgmap v5749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:31.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:29.668734+0000 mgr.smithi067.rdualw (mgr.24569) 6673 : cluster [DBG] pgmap v5749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:31.669659+0000 mgr.smithi067.rdualw (mgr.24569) 6674 : cluster [DBG] pgmap v5750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:31.669659+0000 mgr.smithi067.rdualw (mgr.24569) 6674 : cluster [DBG] pgmap v5750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:33.258 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:40:33.552 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:40:33.552 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 6m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:40:33.553 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 6m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:40:33.553 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 6m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:40:33.553 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 6m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:40:33.554 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 6m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:40:33.554 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 6m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:40:33.554 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 6m ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:40:33.554 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 6m ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:40:33.554 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 6m ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:40:33.555 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 6m ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:40:33.556 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 6m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:40:33.556 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 6m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:40:33.556 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 6m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:40:33.556 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 6m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:40:33.557 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 6m ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:40:33.557 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 6m ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:40:33.557 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 6m ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:40:33.557 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 6m ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:40:33.558 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 6m ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:40:33.558 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 6m ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:40:33.558 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 6m ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:40:33.558 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 6m ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:40:33.558 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 6m ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:40:33.899 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:40:33.899 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:40:33.899 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:40:33.900 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:40:33.900 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:40:33.900 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:40:33.901 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:40:33.901 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:40:33.901 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:40:33.901 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:40:33.902 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:40:33.902 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:40:33.902 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:40:33.903 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:40:33.903 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:40:33.903 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:40:33.903 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:40:33.904 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:40:33.904 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:40:35.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:40:33.246714+0000 mgr.smithi067.rdualw (mgr.24569) 6675 : audit [DBG] from='client.38590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:40:35.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:40:33.536509+0000 mgr.smithi067.rdualw (mgr.24569) 6676 : audit [DBG] from='client.38594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:40:35.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:33.670356+0000 mgr.smithi067.rdualw (mgr.24569) 6677 : cluster [DBG] pgmap v5751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:35.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:40:33.899997+0000 mon.smithi061 (mon.0) 1486 : audit [DBG] from='client.? 172.21.15.61:0/3350337815' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:40:35.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:40:33.246714+0000 mgr.smithi067.rdualw (mgr.24569) 6675 : audit [DBG] from='client.38590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:40:35.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:40:33.536509+0000 mgr.smithi067.rdualw (mgr.24569) 6676 : audit [DBG] from='client.38594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:40:35.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:33.670356+0000 mgr.smithi067.rdualw (mgr.24569) 6677 : cluster [DBG] pgmap v5751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:35.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:40:33.899997+0000 mon.smithi061 (mon.0) 1486 : audit [DBG] from='client.? 172.21.15.61:0/3350337815' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:40:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:40:35.488726+0000 mon.smithi067 (mon.1) 1028 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:40:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:40:35.488982+0000 mon.smithi067 (mon.1) 1029 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:40:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:40:35.489333+0000 mon.smithi061 (mon.0) 1487 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:40:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:40:35.490047+0000 mon.smithi061 (mon.0) 1488 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:40:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:40:35.488726+0000 mon.smithi067 (mon.1) 1028 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:40:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:40:35.488982+0000 mon.smithi067 (mon.1) 1029 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:40:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:40:35.489333+0000 mon.smithi061 (mon.0) 1487 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:40:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:40:35.490047+0000 mon.smithi061 (mon.0) 1488 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:40:37.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:35.671368+0000 mgr.smithi067.rdualw (mgr.24569) 6678 : cluster [DBG] pgmap v5752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:40:37.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:35.671368+0000 mgr.smithi067.rdualw (mgr.24569) 6678 : cluster [DBG] pgmap v5752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:40:39.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:37.671858+0000 mgr.smithi067.rdualw (mgr.24569) 6679 : cluster [DBG] pgmap v5753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:39.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:37.671858+0000 mgr.smithi067.rdualw (mgr.24569) 6679 : cluster [DBG] pgmap v5753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:41.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:39.672451+0000 mgr.smithi067.rdualw (mgr.24569) 6680 : cluster [DBG] pgmap v5754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:41.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:39.672451+0000 mgr.smithi067.rdualw (mgr.24569) 6680 : cluster [DBG] pgmap v5754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:41.673318+0000 mgr.smithi067.rdualw (mgr.24569) 6681 : cluster [DBG] pgmap v5755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:42.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:41.673318+0000 mgr.smithi067.rdualw (mgr.24569) 6681 : cluster [DBG] pgmap v5755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:45.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:43.673796+0000 mgr.smithi067.rdualw (mgr.24569) 6682 : cluster [DBG] pgmap v5756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:45.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:43.673796+0000 mgr.smithi067.rdualw (mgr.24569) 6682 : cluster [DBG] pgmap v5756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:47.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:45.674622+0000 mgr.smithi067.rdualw (mgr.24569) 6683 : cluster [DBG] pgmap v5757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:40:47.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:45.674622+0000 mgr.smithi067.rdualw (mgr.24569) 6683 : cluster [DBG] pgmap v5757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:40:49.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:47.675180+0000 mgr.smithi067.rdualw (mgr.24569) 6684 : cluster [DBG] pgmap v5758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:49.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:47.675180+0000 mgr.smithi067.rdualw (mgr.24569) 6684 : cluster [DBG] pgmap v5758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:49.675734+0000 mgr.smithi067.rdualw (mgr.24569) 6685 : cluster [DBG] pgmap v5759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:51.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:49.675734+0000 mgr.smithi067.rdualw (mgr.24569) 6685 : cluster [DBG] pgmap v5759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:51.676865+0000 mgr.smithi067.rdualw (mgr.24569) 6686 : cluster [DBG] pgmap v5760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:51.676865+0000 mgr.smithi067.rdualw (mgr.24569) 6686 : cluster [DBG] pgmap v5760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:55.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:53.677520+0000 mgr.smithi067.rdualw (mgr.24569) 6687 : cluster [DBG] pgmap v5761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:55.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:53.677520+0000 mgr.smithi067.rdualw (mgr.24569) 6687 : cluster [DBG] pgmap v5761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:57.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:55.678420+0000 mgr.smithi067.rdualw (mgr.24569) 6688 : cluster [DBG] pgmap v5762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:40:57.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:55.678420+0000 mgr.smithi067.rdualw (mgr.24569) 6688 : cluster [DBG] pgmap v5762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:40:59.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:40:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:57.678955+0000 mgr.smithi067.rdualw (mgr.24569) 6689 : cluster [DBG] pgmap v5763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:40:59.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:40:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:57.678955+0000 mgr.smithi067.rdualw (mgr.24569) 6689 : cluster [DBG] pgmap v5763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:01.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:40:59.679507+0000 mgr.smithi067.rdualw (mgr.24569) 6690 : cluster [DBG] pgmap v5764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:01.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:40:59.679507+0000 mgr.smithi067.rdualw (mgr.24569) 6690 : cluster [DBG] pgmap v5764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:02.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:01.680455+0000 mgr.smithi067.rdualw (mgr.24569) 6691 : cluster [DBG] pgmap v5765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:01.680455+0000 mgr.smithi067.rdualw (mgr.24569) 6691 : cluster [DBG] pgmap v5765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:04.205 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:41:04.581 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:41:04.582 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 6m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:41:04.582 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 6m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:41:04.582 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 6m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:41:04.582 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 6m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:41:04.583 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 6m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:41:04.583 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 6m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:41:04.583 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 6m ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:41:04.583 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 6m ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:41:04.584 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 6m ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:41:04.584 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 6m ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:41:04.584 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 6m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:41:04.584 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 6m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:41:04.584 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 6m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:41:04.585 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 6m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:41:04.585 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 6m ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:41:04.585 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 6m ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:41:04.585 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 6m ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:41:04.585 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 6m ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:41:04.586 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 6m ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:41:04.586 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 6m ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:41:04.586 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 6m ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:41:04.586 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 6m ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:41:04.586 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 6m ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:41:04.926 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:41:04.927 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:41:04.927 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:41:04.927 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:41:04.927 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:41:04.928 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:41:04.928 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:41:04.928 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:41:04.928 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:41:04.928 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:41:04.929 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:41:04.929 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:41:04.929 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:41:04.929 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:41:04.930 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:41:04.930 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:41:04.930 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:41:04.931 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:41:04.931 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:41:05.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:03.680976+0000 mgr.smithi067.rdualw (mgr.24569) 6692 : cluster [DBG] pgmap v5766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:05.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:03.680976+0000 mgr.smithi067.rdualw (mgr.24569) 6692 : cluster [DBG] pgmap v5766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:06.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:41:04.194500+0000 mgr.smithi067.rdualw (mgr.24569) 6693 : audit [DBG] from='client.38602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:41:06.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:41:04.566358+0000 mgr.smithi067.rdualw (mgr.24569) 6694 : audit [DBG] from='client.38606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:41:06.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:41:04.927445+0000 mon.smithi061 (mon.0) 1489 : audit [DBG] from='client.? 172.21.15.61:0/1415033956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:41:06.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:41:04.194500+0000 mgr.smithi067.rdualw (mgr.24569) 6693 : audit [DBG] from='client.38602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:41:06.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:41:04.566358+0000 mgr.smithi067.rdualw (mgr.24569) 6694 : audit [DBG] from='client.38606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:41:06.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:41:04.927445+0000 mon.smithi061 (mon.0) 1489 : audit [DBG] from='client.? 172.21.15.61:0/1415033956' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:41:07.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:05.681825+0000 mgr.smithi067.rdualw (mgr.24569) 6695 : cluster [DBG] pgmap v5767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:41:07.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:05.681825+0000 mgr.smithi067.rdualw (mgr.24569) 6695 : cluster [DBG] pgmap v5767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:41:09.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:07.682491+0000 mgr.smithi067.rdualw (mgr.24569) 6696 : cluster [DBG] pgmap v5768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:09.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:07.682491+0000 mgr.smithi067.rdualw (mgr.24569) 6696 : cluster [DBG] pgmap v5768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:11.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:09.683118+0000 mgr.smithi067.rdualw (mgr.24569) 6697 : cluster [DBG] pgmap v5769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:11.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:09.683118+0000 mgr.smithi067.rdualw (mgr.24569) 6697 : cluster [DBG] pgmap v5769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:12.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:11.684002+0000 mgr.smithi067.rdualw (mgr.24569) 6698 : cluster [DBG] pgmap v5770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:12.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:11.684002+0000 mgr.smithi067.rdualw (mgr.24569) 6698 : cluster [DBG] pgmap v5770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:15.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:13.684725+0000 mgr.smithi067.rdualw (mgr.24569) 6699 : cluster [DBG] pgmap v5771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:15.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:13.684725+0000 mgr.smithi067.rdualw (mgr.24569) 6699 : cluster [DBG] pgmap v5771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:17.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:15.685494+0000 mgr.smithi067.rdualw (mgr.24569) 6700 : cluster [DBG] pgmap v5772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:41:17.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:15.685494+0000 mgr.smithi067.rdualw (mgr.24569) 6700 : cluster [DBG] pgmap v5772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:41:19.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:17.686077+0000 mgr.smithi067.rdualw (mgr.24569) 6701 : cluster [DBG] pgmap v5773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:19.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:17.686077+0000 mgr.smithi067.rdualw (mgr.24569) 6701 : cluster [DBG] pgmap v5773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:21.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:19.686605+0000 mgr.smithi067.rdualw (mgr.24569) 6702 : cluster [DBG] pgmap v5774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:21.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:19.686605+0000 mgr.smithi067.rdualw (mgr.24569) 6702 : cluster [DBG] pgmap v5774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:21.687588+0000 mgr.smithi067.rdualw (mgr.24569) 6703 : cluster [DBG] pgmap v5775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:21.687588+0000 mgr.smithi067.rdualw (mgr.24569) 6703 : cluster [DBG] pgmap v5775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:23.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:41:22.546592+0000 mon.smithi067 (mon.1) 1030 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:41:23.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:41:22.548086+0000 mon.smithi067 (mon.1) 1031 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:41:23.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:41:22.549060+0000 mon.smithi067 (mon.1) 1032 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:41:23.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:41:22.549907+0000 mgr.smithi067.rdualw (mgr.24569) 6704 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:41:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:41:22.969458+0000 mon.smithi061 (mon.0) 1490 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:41:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:41:22.975106+0000 mon.smithi061 (mon.0) 1491 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:41:23.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:41:22.546592+0000 mon.smithi067 (mon.1) 1030 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:41:23.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:41:22.548086+0000 mon.smithi067 (mon.1) 1031 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:41:23.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:41:22.549060+0000 mon.smithi067 (mon.1) 1032 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:41:23.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:41:22.549907+0000 mgr.smithi067.rdualw (mgr.24569) 6704 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:41:23.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:41:22.969458+0000 mon.smithi061 (mon.0) 1490 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:41:23.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:41:22.975106+0000 mon.smithi061 (mon.0) 1491 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:41:24.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:23.688131+0000 mgr.smithi067.rdualw (mgr.24569) 6705 : cluster [DBG] pgmap v5776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:24.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:23.688131+0000 mgr.smithi067.rdualw (mgr.24569) 6705 : cluster [DBG] pgmap v5776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:27.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:25.689238+0000 mgr.smithi067.rdualw (mgr.24569) 6706 : cluster [DBG] pgmap v5777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:41:27.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:25.689238+0000 mgr.smithi067.rdualw (mgr.24569) 6706 : cluster [DBG] pgmap v5777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:41:29.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:27.689851+0000 mgr.smithi067.rdualw (mgr.24569) 6707 : cluster [DBG] pgmap v5778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:29.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:27.689851+0000 mgr.smithi067.rdualw (mgr.24569) 6707 : cluster [DBG] pgmap v5778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:31.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:29.690621+0000 mgr.smithi067.rdualw (mgr.24569) 6708 : cluster [DBG] pgmap v5779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:31.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:29.690621+0000 mgr.smithi067.rdualw (mgr.24569) 6708 : cluster [DBG] pgmap v5779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:31.691417+0000 mgr.smithi067.rdualw (mgr.24569) 6709 : cluster [DBG] pgmap v5780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:31.691417+0000 mgr.smithi067.rdualw (mgr.24569) 6709 : cluster [DBG] pgmap v5780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:35.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:33.692098+0000 mgr.smithi067.rdualw (mgr.24569) 6710 : cluster [DBG] pgmap v5781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:35.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:33.692098+0000 mgr.smithi067.rdualw (mgr.24569) 6710 : cluster [DBG] pgmap v5781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:35.232 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:41:35.527 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:41:35.528 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 7m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:41:35.528 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 7m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:41:35.528 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 7m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:41:35.529 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 7m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:41:35.529 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 7m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:41:35.529 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 7m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:41:35.529 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 7m ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:41:35.529 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 7m ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:41:35.530 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 7m ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:41:35.530 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 7m ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:41:35.530 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 7m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:41:35.530 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 7m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:41:35.531 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 7m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:41:35.531 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 7m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:41:35.531 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 7m ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:41:35.531 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 7m ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:41:35.531 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 7m ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:41:35.532 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 7m ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:41:35.532 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 7m ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:41:35.532 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 7m ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:41:35.532 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 7m ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:41:35.533 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 7m ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:41:35.533 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 7m ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:41:35.868 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:41:35.869 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:41:35.869 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:41:35.869 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:41:35.870 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:41:35.870 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:41:35.870 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:41:35.870 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:41:35.871 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:41:35.871 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:41:35.871 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:41:35.871 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:41:35.871 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:41:35.872 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:41:35.872 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:41:35.872 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:41:35.872 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:41:35.873 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:41:35.873 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:41:36.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:41:35.494455+0000 mon.smithi067 (mon.1) 1033 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:41:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:41:35.494712+0000 mon.smithi067 (mon.1) 1034 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:41:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:41:35.494836+0000 mon.smithi061 (mon.0) 1492 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:41:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:41:35.495172+0000 mon.smithi061 (mon.0) 1493 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:41:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:41:35.494455+0000 mon.smithi067 (mon.1) 1033 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:41:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:41:35.494712+0000 mon.smithi067 (mon.1) 1034 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:41:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:41:35.494836+0000 mon.smithi061 (mon.0) 1492 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:41:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:41:35.495172+0000 mon.smithi061 (mon.0) 1493 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:41:37.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:41:35.221396+0000 mgr.smithi067.rdualw (mgr.24569) 6711 : audit [DBG] from='client.38614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:41:37.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:41:35.512635+0000 mgr.smithi067.rdualw (mgr.24569) 6712 : audit [DBG] from='client.38618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:41:37.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:35.692912+0000 mgr.smithi067.rdualw (mgr.24569) 6713 : cluster [DBG] pgmap v5782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:41:37.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:41:35.869561+0000 mon.smithi061 (mon.0) 1494 : audit [DBG] from='client.? 172.21.15.61:0/1476077772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:41:37.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:41:35.221396+0000 mgr.smithi067.rdualw (mgr.24569) 6711 : audit [DBG] from='client.38614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:41:37.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:41:35.512635+0000 mgr.smithi067.rdualw (mgr.24569) 6712 : audit [DBG] from='client.38618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:41:37.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:35.692912+0000 mgr.smithi067.rdualw (mgr.24569) 6713 : cluster [DBG] pgmap v5782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:41:37.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:41:35.869561+0000 mon.smithi061 (mon.0) 1494 : audit [DBG] from='client.? 172.21.15.61:0/1476077772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:41:39.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:37.693449+0000 mgr.smithi067.rdualw (mgr.24569) 6714 : cluster [DBG] pgmap v5783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:39.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:37.693449+0000 mgr.smithi067.rdualw (mgr.24569) 6714 : cluster [DBG] pgmap v5783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:41.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:39.694192+0000 mgr.smithi067.rdualw (mgr.24569) 6715 : cluster [DBG] pgmap v5784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:41.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:39.694192+0000 mgr.smithi067.rdualw (mgr.24569) 6715 : cluster [DBG] pgmap v5784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:41.695074+0000 mgr.smithi067.rdualw (mgr.24569) 6716 : cluster [DBG] pgmap v5785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:42.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:41.695074+0000 mgr.smithi067.rdualw (mgr.24569) 6716 : cluster [DBG] pgmap v5785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:45.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:43.695662+0000 mgr.smithi067.rdualw (mgr.24569) 6717 : cluster [DBG] pgmap v5786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:45.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:43.695662+0000 mgr.smithi067.rdualw (mgr.24569) 6717 : cluster [DBG] pgmap v5786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:47.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:45.696487+0000 mgr.smithi067.rdualw (mgr.24569) 6718 : cluster [DBG] pgmap v5787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:41:47.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:45.696487+0000 mgr.smithi067.rdualw (mgr.24569) 6718 : cluster [DBG] pgmap v5787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:41:49.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:47.697013+0000 mgr.smithi067.rdualw (mgr.24569) 6719 : cluster [DBG] pgmap v5788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:49.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:47.697013+0000 mgr.smithi067.rdualw (mgr.24569) 6719 : cluster [DBG] pgmap v5788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:51.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:49.697563+0000 mgr.smithi067.rdualw (mgr.24569) 6720 : cluster [DBG] pgmap v5789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:51.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:49.697563+0000 mgr.smithi067.rdualw (mgr.24569) 6720 : cluster [DBG] pgmap v5789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:51.698501+0000 mgr.smithi067.rdualw (mgr.24569) 6721 : cluster [DBG] pgmap v5790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:51.698501+0000 mgr.smithi067.rdualw (mgr.24569) 6721 : cluster [DBG] pgmap v5790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:55.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:53.699212+0000 mgr.smithi067.rdualw (mgr.24569) 6722 : cluster [DBG] pgmap v5791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:55.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:53.699212+0000 mgr.smithi067.rdualw (mgr.24569) 6722 : cluster [DBG] pgmap v5791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:57.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:55.700243+0000 mgr.smithi067.rdualw (mgr.24569) 6723 : cluster [DBG] pgmap v5792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:41:57.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:55.700243+0000 mgr.smithi067.rdualw (mgr.24569) 6723 : cluster [DBG] pgmap v5792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:41:59.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:41:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:57.700765+0000 mgr.smithi067.rdualw (mgr.24569) 6724 : cluster [DBG] pgmap v5793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:41:59.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:41:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:57.700765+0000 mgr.smithi067.rdualw (mgr.24569) 6724 : cluster [DBG] pgmap v5793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:01.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:41:59.701308+0000 mgr.smithi067.rdualw (mgr.24569) 6725 : cluster [DBG] pgmap v5794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:01.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:41:59.701308+0000 mgr.smithi067.rdualw (mgr.24569) 6725 : cluster [DBG] pgmap v5794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:02.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:01.702196+0000 mgr.smithi067.rdualw (mgr.24569) 6726 : cluster [DBG] pgmap v5795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:01.702196+0000 mgr.smithi067.rdualw (mgr.24569) 6726 : cluster [DBG] pgmap v5795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:05.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:03.702750+0000 mgr.smithi067.rdualw (mgr.24569) 6727 : cluster [DBG] pgmap v5796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:05.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:03.702750+0000 mgr.smithi067.rdualw (mgr.24569) 6727 : cluster [DBG] pgmap v5796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:06.179 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:42:06.470 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:42:06.470 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 7m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:42:06.471 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 7m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:42:06.471 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 7m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:42:06.471 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 7m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:42:06.471 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 7m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:42:06.472 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 7m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:42:06.472 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 7m ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:42:06.472 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 7m ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:42:06.472 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 7m ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:42:06.472 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 7m ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:42:06.473 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 7m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:42:06.473 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 7m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:42:06.473 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 7m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:42:06.473 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 7m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:42:06.474 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 7m ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:42:06.474 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 7m ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:42:06.474 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 7m ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:42:06.474 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 7m ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:42:06.475 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 7m ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:42:06.475 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 7m ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:42:06.475 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 7m ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:42:06.475 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 7m ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:42:06.475 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 7m ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:42:06.811 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:42:06.811 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:42:06.811 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:42:06.812 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:42:06.812 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:42:06.812 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:42:06.812 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:42:06.813 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:42:06.813 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:42:06.813 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:42:06.813 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:42:06.814 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:42:06.814 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:42:06.814 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:42:06.814 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:42:06.815 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:42:06.815 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:42:06.815 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:42:06.815 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:42:07.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:05.703901+0000 mgr.smithi067.rdualw (mgr.24569) 6728 : cluster [DBG] pgmap v5797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:42:07.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:05.703901+0000 mgr.smithi067.rdualw (mgr.24569) 6728 : cluster [DBG] pgmap v5797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:42:08.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:42:06.167944+0000 mgr.smithi067.rdualw (mgr.24569) 6729 : audit [DBG] from='client.38626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:42:08.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:42:06.454497+0000 mgr.smithi067.rdualw (mgr.24569) 6730 : audit [DBG] from='client.38630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:42:08.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:42:06.811992+0000 mon.smithi061 (mon.0) 1495 : audit [DBG] from='client.? 172.21.15.61:0/3642339529' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:42:08.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:42:06.167944+0000 mgr.smithi067.rdualw (mgr.24569) 6729 : audit [DBG] from='client.38626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:42:08.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:42:06.454497+0000 mgr.smithi067.rdualw (mgr.24569) 6730 : audit [DBG] from='client.38630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:42:08.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:42:06.811992+0000 mon.smithi061 (mon.0) 1495 : audit [DBG] from='client.? 172.21.15.61:0/3642339529' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:42:09.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:07.704574+0000 mgr.smithi067.rdualw (mgr.24569) 6731 : cluster [DBG] pgmap v5798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:09.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:07.704574+0000 mgr.smithi067.rdualw (mgr.24569) 6731 : cluster [DBG] pgmap v5798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:11.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:09.705185+0000 mgr.smithi067.rdualw (mgr.24569) 6732 : cluster [DBG] pgmap v5799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:11.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:09.705185+0000 mgr.smithi067.rdualw (mgr.24569) 6732 : cluster [DBG] pgmap v5799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:12.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:11.706158+0000 mgr.smithi067.rdualw (mgr.24569) 6733 : cluster [DBG] pgmap v5800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:12.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:11.706158+0000 mgr.smithi067.rdualw (mgr.24569) 6733 : cluster [DBG] pgmap v5800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:15.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:13.706759+0000 mgr.smithi067.rdualw (mgr.24569) 6734 : cluster [DBG] pgmap v5801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:15.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:13.706759+0000 mgr.smithi067.rdualw (mgr.24569) 6734 : cluster [DBG] pgmap v5801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:17.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:15.707692+0000 mgr.smithi067.rdualw (mgr.24569) 6735 : cluster [DBG] pgmap v5802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:42:17.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:15.707692+0000 mgr.smithi067.rdualw (mgr.24569) 6735 : cluster [DBG] pgmap v5802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:42:19.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:17.708188+0000 mgr.smithi067.rdualw (mgr.24569) 6736 : cluster [DBG] pgmap v5803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:19.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:17.708188+0000 mgr.smithi067.rdualw (mgr.24569) 6736 : cluster [DBG] pgmap v5803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:21.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:19.708811+0000 mgr.smithi067.rdualw (mgr.24569) 6737 : cluster [DBG] pgmap v5804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:21.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:19.708811+0000 mgr.smithi067.rdualw (mgr.24569) 6737 : cluster [DBG] pgmap v5804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:21.709758+0000 mgr.smithi067.rdualw (mgr.24569) 6738 : cluster [DBG] pgmap v5805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:21.709758+0000 mgr.smithi067.rdualw (mgr.24569) 6738 : cluster [DBG] pgmap v5805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:23.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:42:22.978936+0000 mon.smithi067 (mon.1) 1035 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:42:23.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:42:22.980360+0000 mon.smithi067 (mon.1) 1036 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:42:23.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:42:22.981269+0000 mon.smithi067 (mon.1) 1037 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:42:23.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:42:22.978936+0000 mon.smithi067 (mon.1) 1035 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:42:23.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:42:22.980360+0000 mon.smithi067 (mon.1) 1036 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:42:23.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:42:22.981269+0000 mon.smithi067 (mon.1) 1037 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:42:24.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:42:22.982100+0000 mgr.smithi067.rdualw (mgr.24569) 6739 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:42:24.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:42:23.398084+0000 mon.smithi061 (mon.0) 1496 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:42:24.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:42:23.403387+0000 mon.smithi061 (mon.0) 1497 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:42:24.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:23.710284+0000 mgr.smithi067.rdualw (mgr.24569) 6740 : cluster [DBG] pgmap v5806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:24.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:42:22.982100+0000 mgr.smithi067.rdualw (mgr.24569) 6739 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:42:24.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:42:23.398084+0000 mon.smithi061 (mon.0) 1496 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:42:24.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:42:23.403387+0000 mon.smithi061 (mon.0) 1497 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:42:24.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:23.710284+0000 mgr.smithi067.rdualw (mgr.24569) 6740 : cluster [DBG] pgmap v5806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:27.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:25.711079+0000 mgr.smithi067.rdualw (mgr.24569) 6741 : cluster [DBG] pgmap v5807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:42:27.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:25.711079+0000 mgr.smithi067.rdualw (mgr.24569) 6741 : cluster [DBG] pgmap v5807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:42:29.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:27.711681+0000 mgr.smithi067.rdualw (mgr.24569) 6742 : cluster [DBG] pgmap v5808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:29.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:27.711681+0000 mgr.smithi067.rdualw (mgr.24569) 6742 : cluster [DBG] pgmap v5808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:31.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:29.712228+0000 mgr.smithi067.rdualw (mgr.24569) 6743 : cluster [DBG] pgmap v5809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:31.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:29.712228+0000 mgr.smithi067.rdualw (mgr.24569) 6743 : cluster [DBG] pgmap v5809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:31.713308+0000 mgr.smithi067.rdualw (mgr.24569) 6744 : cluster [DBG] pgmap v5810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:31.713308+0000 mgr.smithi067.rdualw (mgr.24569) 6744 : cluster [DBG] pgmap v5810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:35.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:33.713872+0000 mgr.smithi067.rdualw (mgr.24569) 6745 : cluster [DBG] pgmap v5811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:35.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:33.713872+0000 mgr.smithi067.rdualw (mgr.24569) 6745 : cluster [DBG] pgmap v5811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:36.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:42:35.499769+0000 mon.smithi067 (mon.1) 1038 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:42:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:42:35.500131+0000 mon.smithi067 (mon.1) 1039 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:42:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:42:35.500154+0000 mon.smithi061 (mon.0) 1498 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:42:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:42:35.500541+0000 mon.smithi061 (mon.0) 1499 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:42:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:42:35.499769+0000 mon.smithi067 (mon.1) 1038 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:42:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:42:35.500131+0000 mon.smithi067 (mon.1) 1039 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:42:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:42:35.500154+0000 mon.smithi061 (mon.0) 1498 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:42:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:42:35.500541+0000 mon.smithi061 (mon.0) 1499 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:42:37.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:35.714712+0000 mgr.smithi067.rdualw (mgr.24569) 6746 : cluster [DBG] pgmap v5812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:42:37.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:35.714712+0000 mgr.smithi067.rdualw (mgr.24569) 6746 : cluster [DBG] pgmap v5812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:42:37.127 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:42:37.411 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:42:37.412 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 8m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:42:37.412 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 8m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:42:37.412 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 8m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:42:37.413 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 8m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:42:37.413 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 8m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:42:37.413 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 8m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:42:37.413 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 8m ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:42:37.414 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 8m ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:42:37.414 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 8m ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:42:37.414 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 8m ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:42:37.414 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 8m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:42:37.415 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 8m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:42:37.415 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 8m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:42:37.415 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 8m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:42:37.415 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 8m ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:42:37.416 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 8m ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:42:37.416 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 8m ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:42:37.416 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 8m ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:42:37.416 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 8m ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:42:37.417 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 8m ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:42:37.417 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 8m ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:42:37.417 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 8m ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:42:37.417 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 8m ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:42:37.754 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:42:37.754 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:42:37.754 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:42:37.755 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:42:37.755 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:42:37.755 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:42:37.755 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:42:37.756 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:42:37.756 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:42:37.756 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:42:37.756 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:42:37.756 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:42:37.757 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:42:37.757 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:42:37.757 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:42:37.758 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:42:37.758 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:42:37.758 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:42:37.758 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:42:38.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:42:37.755037+0000 mon.smithi061 (mon.0) 1500 : audit [DBG] from='client.? 172.21.15.61:0/217813072' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:42:38.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:42:37.755037+0000 mon.smithi061 (mon.0) 1500 : audit [DBG] from='client.? 172.21.15.61:0/217813072' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:42:39.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:42:37.109426+0000 mgr.smithi067.rdualw (mgr.24569) 6747 : audit [DBG] from='client.38638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:42:39.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:42:37.396256+0000 mgr.smithi067.rdualw (mgr.24569) 6748 : audit [DBG] from='client.38642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:42:39.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:37.715386+0000 mgr.smithi067.rdualw (mgr.24569) 6749 : cluster [DBG] pgmap v5813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:39.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:42:37.109426+0000 mgr.smithi067.rdualw (mgr.24569) 6747 : audit [DBG] from='client.38638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:42:39.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:42:37.396256+0000 mgr.smithi067.rdualw (mgr.24569) 6748 : audit [DBG] from='client.38642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:42:39.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:37.715386+0000 mgr.smithi067.rdualw (mgr.24569) 6749 : cluster [DBG] pgmap v5813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:41.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:39.716056+0000 mgr.smithi067.rdualw (mgr.24569) 6750 : cluster [DBG] pgmap v5814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:41.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:39.716056+0000 mgr.smithi067.rdualw (mgr.24569) 6750 : cluster [DBG] pgmap v5814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:41.716970+0000 mgr.smithi067.rdualw (mgr.24569) 6751 : cluster [DBG] pgmap v5815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:42.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:41.716970+0000 mgr.smithi067.rdualw (mgr.24569) 6751 : cluster [DBG] pgmap v5815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:45.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:43.717466+0000 mgr.smithi067.rdualw (mgr.24569) 6752 : cluster [DBG] pgmap v5816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:45.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:43.717466+0000 mgr.smithi067.rdualw (mgr.24569) 6752 : cluster [DBG] pgmap v5816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:47.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:45.718584+0000 mgr.smithi067.rdualw (mgr.24569) 6753 : cluster [DBG] pgmap v5817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:42:47.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:45.718584+0000 mgr.smithi067.rdualw (mgr.24569) 6753 : cluster [DBG] pgmap v5817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:42:49.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:47.719059+0000 mgr.smithi067.rdualw (mgr.24569) 6754 : cluster [DBG] pgmap v5818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:49.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:47.719059+0000 mgr.smithi067.rdualw (mgr.24569) 6754 : cluster [DBG] pgmap v5818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:51.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:49.719632+0000 mgr.smithi067.rdualw (mgr.24569) 6755 : cluster [DBG] pgmap v5819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:51.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:49.719632+0000 mgr.smithi067.rdualw (mgr.24569) 6755 : cluster [DBG] pgmap v5819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:51.720654+0000 mgr.smithi067.rdualw (mgr.24569) 6756 : cluster [DBG] pgmap v5820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:51.720654+0000 mgr.smithi067.rdualw (mgr.24569) 6756 : cluster [DBG] pgmap v5820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:55.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:53.721227+0000 mgr.smithi067.rdualw (mgr.24569) 6757 : cluster [DBG] pgmap v5821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:55.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:53.721227+0000 mgr.smithi067.rdualw (mgr.24569) 6757 : cluster [DBG] pgmap v5821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:57.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:55.722187+0000 mgr.smithi067.rdualw (mgr.24569) 6758 : cluster [DBG] pgmap v5822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:42:57.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:55.722187+0000 mgr.smithi067.rdualw (mgr.24569) 6758 : cluster [DBG] pgmap v5822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:42:59.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:42:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:57.722612+0000 mgr.smithi067.rdualw (mgr.24569) 6759 : cluster [DBG] pgmap v5823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:42:59.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:42:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:57.722612+0000 mgr.smithi067.rdualw (mgr.24569) 6759 : cluster [DBG] pgmap v5823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:01.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:42:59.723326+0000 mgr.smithi067.rdualw (mgr.24569) 6760 : cluster [DBG] pgmap v5824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:01.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:42:59.723326+0000 mgr.smithi067.rdualw (mgr.24569) 6760 : cluster [DBG] pgmap v5824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:02.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:01.724423+0000 mgr.smithi067.rdualw (mgr.24569) 6761 : cluster [DBG] pgmap v5825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:01.724423+0000 mgr.smithi067.rdualw (mgr.24569) 6761 : cluster [DBG] pgmap v5825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:05.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:03.724998+0000 mgr.smithi067.rdualw (mgr.24569) 6762 : cluster [DBG] pgmap v5826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:05.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:03.724998+0000 mgr.smithi067.rdualw (mgr.24569) 6762 : cluster [DBG] pgmap v5826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:07.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:05.725885+0000 mgr.smithi067.rdualw (mgr.24569) 6763 : cluster [DBG] pgmap v5827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:43:07.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:05.725885+0000 mgr.smithi067.rdualw (mgr.24569) 6763 : cluster [DBG] pgmap v5827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:43:08.077 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:43:08.382 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:43:08.383 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 8m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:43:08.383 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 8m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:43:08.384 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 8m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:43:08.384 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 8m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:43:08.385 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 8m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:43:08.385 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 8m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:43:08.386 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 8m ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:43:08.386 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 8m ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:43:08.387 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 8m ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:43:08.387 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 8m ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:43:08.387 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 8m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:43:08.388 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 8m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:43:08.388 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 8m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:43:08.388 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 8m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:43:08.388 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 8m ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:43:08.389 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 8m ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:43:08.389 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 8m ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:43:08.389 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 8m ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:43:08.389 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 8m ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:43:08.390 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 8m ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:43:08.390 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 8m ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:43:08.390 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 8m ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:43:08.390 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 8m ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:43:08.750 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:43:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:43:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:43:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:43:08.751 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:43:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:43:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:43:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:43:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:43:08.752 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:43:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:43:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:43:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:43:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:43:08.753 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:43:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:43:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:43:08.754 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:43:08.754 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:43:09.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:07.726378+0000 mgr.smithi067.rdualw (mgr.24569) 6764 : cluster [DBG] pgmap v5828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:09.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:43:08.751341+0000 mon.smithi061 (mon.0) 1501 : audit [DBG] from='client.? 172.21.15.61:0/3709092912' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:43:09.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:07.726378+0000 mgr.smithi067.rdualw (mgr.24569) 6764 : cluster [DBG] pgmap v5828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:09.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:43:08.751341+0000 mon.smithi061 (mon.0) 1501 : audit [DBG] from='client.? 172.21.15.61:0/3709092912' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:43:10.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:43:08.063702+0000 mgr.smithi067.rdualw (mgr.24569) 6765 : audit [DBG] from='client.38650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:43:10.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:43:08.366901+0000 mgr.smithi067.rdualw (mgr.24569) 6766 : audit [DBG] from='client.38654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:43:10.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:43:08.063702+0000 mgr.smithi067.rdualw (mgr.24569) 6765 : audit [DBG] from='client.38650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:43:10.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:43:08.366901+0000 mgr.smithi067.rdualw (mgr.24569) 6766 : audit [DBG] from='client.38654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:43:11.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:09.727099+0000 mgr.smithi067.rdualw (mgr.24569) 6767 : cluster [DBG] pgmap v5829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:11.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:09.727099+0000 mgr.smithi067.rdualw (mgr.24569) 6767 : cluster [DBG] pgmap v5829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:12.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:11.727937+0000 mgr.smithi067.rdualw (mgr.24569) 6768 : cluster [DBG] pgmap v5830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:12.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:11.727937+0000 mgr.smithi067.rdualw (mgr.24569) 6768 : cluster [DBG] pgmap v5830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:15.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:13.728631+0000 mgr.smithi067.rdualw (mgr.24569) 6769 : cluster [DBG] pgmap v5831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:15.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:13.728631+0000 mgr.smithi067.rdualw (mgr.24569) 6769 : cluster [DBG] pgmap v5831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:17.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:15.729396+0000 mgr.smithi067.rdualw (mgr.24569) 6770 : cluster [DBG] pgmap v5832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:43:17.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:15.729396+0000 mgr.smithi067.rdualw (mgr.24569) 6770 : cluster [DBG] pgmap v5832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:43:19.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:17.729946+0000 mgr.smithi067.rdualw (mgr.24569) 6771 : cluster [DBG] pgmap v5833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:19.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:17.729946+0000 mgr.smithi067.rdualw (mgr.24569) 6771 : cluster [DBG] pgmap v5833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:21.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:19.730619+0000 mgr.smithi067.rdualw (mgr.24569) 6772 : cluster [DBG] pgmap v5834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:21.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:19.730619+0000 mgr.smithi067.rdualw (mgr.24569) 6772 : cluster [DBG] pgmap v5834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:22.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:21.731741+0000 mgr.smithi067.rdualw (mgr.24569) 6773 : cluster [DBG] pgmap v5835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:22.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:21.731741+0000 mgr.smithi067.rdualw (mgr.24569) 6773 : cluster [DBG] pgmap v5835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:23.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:43:23.407357+0000 mon.smithi067 (mon.1) 1040 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:43:23.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:43:23.408851+0000 mon.smithi067 (mon.1) 1041 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:43:23.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:43:23.409809+0000 mon.smithi067 (mon.1) 1042 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:43:23.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:43:23.407357+0000 mon.smithi067 (mon.1) 1040 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:43:23.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:43:23.408851+0000 mon.smithi067 (mon.1) 1041 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:43:23.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:43:23.409809+0000 mon.smithi067 (mon.1) 1042 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:43:25.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:43:23.410705+0000 mgr.smithi067.rdualw (mgr.24569) 6774 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:43:25.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:23.732333+0000 mgr.smithi067.rdualw (mgr.24569) 6775 : cluster [DBG] pgmap v5836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:25.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:43:23.826452+0000 mon.smithi061 (mon.0) 1502 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:43:25.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:43:23.832593+0000 mon.smithi061 (mon.0) 1503 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:43:25.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:43:23.410705+0000 mgr.smithi067.rdualw (mgr.24569) 6774 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:43:25.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:23.732333+0000 mgr.smithi067.rdualw (mgr.24569) 6775 : cluster [DBG] pgmap v5836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:25.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:43:23.826452+0000 mon.smithi061 (mon.0) 1502 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:43:25.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:43:23.832593+0000 mon.smithi061 (mon.0) 1503 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:43:27.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:25.733131+0000 mgr.smithi067.rdualw (mgr.24569) 6776 : cluster [DBG] pgmap v5837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:43:27.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:25.733131+0000 mgr.smithi067.rdualw (mgr.24569) 6776 : cluster [DBG] pgmap v5837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:43:29.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:27.733857+0000 mgr.smithi067.rdualw (mgr.24569) 6777 : cluster [DBG] pgmap v5838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:29.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:27.733857+0000 mgr.smithi067.rdualw (mgr.24569) 6777 : cluster [DBG] pgmap v5838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:31.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:29.734455+0000 mgr.smithi067.rdualw (mgr.24569) 6778 : cluster [DBG] pgmap v5839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:31.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:29.734455+0000 mgr.smithi067.rdualw (mgr.24569) 6778 : cluster [DBG] pgmap v5839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:31.735396+0000 mgr.smithi067.rdualw (mgr.24569) 6779 : cluster [DBG] pgmap v5840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:31.735396+0000 mgr.smithi067.rdualw (mgr.24569) 6779 : cluster [DBG] pgmap v5840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:35.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:33.735896+0000 mgr.smithi067.rdualw (mgr.24569) 6780 : cluster [DBG] pgmap v5841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:35.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:33.735896+0000 mgr.smithi067.rdualw (mgr.24569) 6780 : cluster [DBG] pgmap v5841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:36.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:43:35.504983+0000 mon.smithi067 (mon.1) 1043 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:43:36.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:43:35.505237+0000 mon.smithi067 (mon.1) 1044 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:43:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:43:35.505554+0000 mon.smithi061 (mon.0) 1504 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:43:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:43:35.506257+0000 mon.smithi061 (mon.0) 1505 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:43:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:43:35.504983+0000 mon.smithi067 (mon.1) 1043 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:43:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:43:35.505237+0000 mon.smithi067 (mon.1) 1044 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:43:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:43:35.505554+0000 mon.smithi061 (mon.0) 1504 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:43:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:43:35.506257+0000 mon.smithi061 (mon.0) 1505 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:43:37.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:35.736856+0000 mgr.smithi067.rdualw (mgr.24569) 6781 : cluster [DBG] pgmap v5842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:43:37.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:35.736856+0000 mgr.smithi067.rdualw (mgr.24569) 6781 : cluster [DBG] pgmap v5842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:43:39.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:37.737469+0000 mgr.smithi067.rdualw (mgr.24569) 6782 : cluster [DBG] pgmap v5843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:39.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:37.737469+0000 mgr.smithi067.rdualw (mgr.24569) 6782 : cluster [DBG] pgmap v5843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:39.087 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:43:39.375 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:43:39.375 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 9m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:43:39.375 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 9m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:43:39.375 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 9m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:43:39.376 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 9m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:43:39.376 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 9m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:43:39.376 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 9m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:43:39.376 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 9m ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:43:39.377 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 9m ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:43:39.377 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 9m ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:43:39.377 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 9m ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:43:39.377 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 9m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:43:39.378 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 9m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:43:39.378 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 9m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:43:39.378 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 9m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:43:39.378 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 9m ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:43:39.378 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 9m ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:43:39.379 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 9m ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:43:39.379 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 9m ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:43:39.379 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 9m ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:43:39.380 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 9m ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:43:39.380 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 9m ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:43:39.380 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 9m ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:43:39.381 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 9m ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:43:39.717 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:43:39.717 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:43:39.717 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:43:39.717 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:43:39.718 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:43:39.718 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:43:39.718 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:43:39.718 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:43:39.719 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:43:39.719 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:43:39.719 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:43:39.719 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:43:39.720 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:43:39.720 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:43:39.720 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:43:39.721 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:43:39.721 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:43:39.721 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:43:39.721 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:43:40.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:43:39.717638+0000 mon.smithi061 (mon.0) 1506 : audit [DBG] from='client.? 172.21.15.61:0/3653498815' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:43:40.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:43:39.717638+0000 mon.smithi061 (mon.0) 1506 : audit [DBG] from='client.? 172.21.15.61:0/3653498815' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:43:41.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:43:39.075686+0000 mgr.smithi067.rdualw (mgr.24569) 6783 : audit [DBG] from='client.38662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:43:41.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:43:39.359768+0000 mgr.smithi067.rdualw (mgr.24569) 6784 : audit [DBG] from='client.38666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:43:41.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:39.738082+0000 mgr.smithi067.rdualw (mgr.24569) 6785 : cluster [DBG] pgmap v5844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:41.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:43:39.075686+0000 mgr.smithi067.rdualw (mgr.24569) 6783 : audit [DBG] from='client.38662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:43:41.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:43:39.359768+0000 mgr.smithi067.rdualw (mgr.24569) 6784 : audit [DBG] from='client.38666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:43:41.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:39.738082+0000 mgr.smithi067.rdualw (mgr.24569) 6785 : cluster [DBG] pgmap v5844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:42.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:41.739191+0000 mgr.smithi067.rdualw (mgr.24569) 6786 : cluster [DBG] pgmap v5845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:42.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:41.739191+0000 mgr.smithi067.rdualw (mgr.24569) 6786 : cluster [DBG] pgmap v5845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:45.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:43.739806+0000 mgr.smithi067.rdualw (mgr.24569) 6787 : cluster [DBG] pgmap v5846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:45.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:43.739806+0000 mgr.smithi067.rdualw (mgr.24569) 6787 : cluster [DBG] pgmap v5846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:47.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:45.740652+0000 mgr.smithi067.rdualw (mgr.24569) 6788 : cluster [DBG] pgmap v5847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:43:47.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:45.740652+0000 mgr.smithi067.rdualw (mgr.24569) 6788 : cluster [DBG] pgmap v5847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:43:49.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:47.741155+0000 mgr.smithi067.rdualw (mgr.24569) 6789 : cluster [DBG] pgmap v5848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:49.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:47.741155+0000 mgr.smithi067.rdualw (mgr.24569) 6789 : cluster [DBG] pgmap v5848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:51.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:49.741909+0000 mgr.smithi067.rdualw (mgr.24569) 6790 : cluster [DBG] pgmap v5849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:51.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:49.741909+0000 mgr.smithi067.rdualw (mgr.24569) 6790 : cluster [DBG] pgmap v5849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:52.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:51.742842+0000 mgr.smithi067.rdualw (mgr.24569) 6791 : cluster [DBG] pgmap v5850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:51.742842+0000 mgr.smithi067.rdualw (mgr.24569) 6791 : cluster [DBG] pgmap v5850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:55.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:53.743379+0000 mgr.smithi067.rdualw (mgr.24569) 6792 : cluster [DBG] pgmap v5851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:55.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:53.743379+0000 mgr.smithi067.rdualw (mgr.24569) 6792 : cluster [DBG] pgmap v5851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:57.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:55.744250+0000 mgr.smithi067.rdualw (mgr.24569) 6793 : cluster [DBG] pgmap v5852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:43:57.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:55.744250+0000 mgr.smithi067.rdualw (mgr.24569) 6793 : cluster [DBG] pgmap v5852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:43:59.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:43:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:57.744877+0000 mgr.smithi067.rdualw (mgr.24569) 6794 : cluster [DBG] pgmap v5853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:43:59.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:43:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:57.744877+0000 mgr.smithi067.rdualw (mgr.24569) 6794 : cluster [DBG] pgmap v5853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:01.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:43:59.745522+0000 mgr.smithi067.rdualw (mgr.24569) 6795 : cluster [DBG] pgmap v5854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:01.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:43:59.745522+0000 mgr.smithi067.rdualw (mgr.24569) 6795 : cluster [DBG] pgmap v5854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:02.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:01.746522+0000 mgr.smithi067.rdualw (mgr.24569) 6796 : cluster [DBG] pgmap v5855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:02.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:01.746522+0000 mgr.smithi067.rdualw (mgr.24569) 6796 : cluster [DBG] pgmap v5855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:05.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:03.747093+0000 mgr.smithi067.rdualw (mgr.24569) 6797 : cluster [DBG] pgmap v5856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:05.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:03.747093+0000 mgr.smithi067.rdualw (mgr.24569) 6797 : cluster [DBG] pgmap v5856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:07.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:05.747993+0000 mgr.smithi067.rdualw (mgr.24569) 6798 : cluster [DBG] pgmap v5857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:44:07.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:05.747993+0000 mgr.smithi067.rdualw (mgr.24569) 6798 : cluster [DBG] pgmap v5857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:44:09.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:07.748573+0000 mgr.smithi067.rdualw (mgr.24569) 6799 : cluster [DBG] pgmap v5858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:09.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:07.748573+0000 mgr.smithi067.rdualw (mgr.24569) 6799 : cluster [DBG] pgmap v5858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:10.028 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:44:10.325 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:44:10.326 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 9m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:44:10.326 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 9m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:44:10.326 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 9m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:44:10.327 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 9m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:44:10.327 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 9m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:44:10.327 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 9m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:44:10.327 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 9m ago 3h 468M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:44:10.328 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 9m ago 3h 575M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:44:10.328 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 9m ago 3h 1258M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:44:10.328 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 9m ago 3h 664M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:44:10.328 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 9m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:44:10.328 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 9m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:44:10.329 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 9m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:44:10.329 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 9m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:44:10.329 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 9m ago 3h 897M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:44:10.329 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 9m ago 3h 1767M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:44:10.329 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 9m ago 3h 1102M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:44:10.330 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 9m ago 3h 1900M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:44:10.330 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 9m ago 3h 1754M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:44:10.330 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 9m ago 3h 1956M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:44:10.330 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 9m ago 3h 1571M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:44:10.331 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 9m ago 3h 2472M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:44:10.331 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 9m ago 3h 113M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:44:10.667 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:44:10.668 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:44:10.668 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:44:10.669 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:44:10.669 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:44:10.670 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:44:10.670 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:44:10.671 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:44:10.671 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:44:10.671 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:44:10.672 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:44:10.672 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:44:10.673 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:44:10.674 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:44:10.675 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:44:10.675 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:44:10.675 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:44:10.675 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:44:10.676 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:44:11.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:09.749231+0000 mgr.smithi067.rdualw (mgr.24569) 6800 : cluster [DBG] pgmap v5859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:11.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:10.668571+0000 mon.smithi061 (mon.0) 1507 : audit [DBG] from='client.? 172.21.15.61:0/88656207' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:44:11.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:09.749231+0000 mgr.smithi067.rdualw (mgr.24569) 6800 : cluster [DBG] pgmap v5859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:11.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:10.668571+0000 mon.smithi061 (mon.0) 1507 : audit [DBG] from='client.? 172.21.15.61:0/88656207' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:44:12.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:10.017735+0000 mgr.smithi067.rdualw (mgr.24569) 6801 : audit [DBG] from='client.38674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:44:12.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:10.310230+0000 mgr.smithi067.rdualw (mgr.24569) 6802 : audit [DBG] from='client.38678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:44:12.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:10.017735+0000 mgr.smithi067.rdualw (mgr.24569) 6801 : audit [DBG] from='client.38674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:44:12.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:10.310230+0000 mgr.smithi067.rdualw (mgr.24569) 6802 : audit [DBG] from='client.38678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:44:13.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:11.750411+0000 mgr.smithi067.rdualw (mgr.24569) 6803 : cluster [DBG] pgmap v5860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:13.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:11.750411+0000 mgr.smithi067.rdualw (mgr.24569) 6803 : cluster [DBG] pgmap v5860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:15.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:13.751027+0000 mgr.smithi067.rdualw (mgr.24569) 6804 : cluster [DBG] pgmap v5861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:15.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:13.751027+0000 mgr.smithi067.rdualw (mgr.24569) 6804 : cluster [DBG] pgmap v5861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:17.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:15.752189+0000 mgr.smithi067.rdualw (mgr.24569) 6805 : cluster [DBG] pgmap v5862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:44:17.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:15.752189+0000 mgr.smithi067.rdualw (mgr.24569) 6805 : cluster [DBG] pgmap v5862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:44:19.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:17.752875+0000 mgr.smithi067.rdualw (mgr.24569) 6806 : cluster [DBG] pgmap v5863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:19.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:17.752875+0000 mgr.smithi067.rdualw (mgr.24569) 6806 : cluster [DBG] pgmap v5863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:21.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:19.753629+0000 mgr.smithi067.rdualw (mgr.24569) 6807 : cluster [DBG] pgmap v5864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:21.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:19.753629+0000 mgr.smithi067.rdualw (mgr.24569) 6807 : cluster [DBG] pgmap v5864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:22.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:21.754596+0000 mgr.smithi067.rdualw (mgr.24569) 6808 : cluster [DBG] pgmap v5865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:22.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:21.754596+0000 mgr.smithi067.rdualw (mgr.24569) 6808 : cluster [DBG] pgmap v5865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:25.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:23.755291+0000 mgr.smithi067.rdualw (mgr.24569) 6809 : cluster [DBG] pgmap v5866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:25.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:23.836090+0000 mon.smithi067 (mon.1) 1045 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:44:25.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:23.837488+0000 mon.smithi067 (mon.1) 1046 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:44:25.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:23.838409+0000 mon.smithi067 (mon.1) 1047 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:44:25.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:44:23.839273+0000 mgr.smithi067.rdualw (mgr.24569) 6810 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:44:25.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:23.755291+0000 mgr.smithi067.rdualw (mgr.24569) 6809 : cluster [DBG] pgmap v5866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:25.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:23.836090+0000 mon.smithi067 (mon.1) 1045 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:44:25.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:23.837488+0000 mon.smithi067 (mon.1) 1046 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:44:25.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:23.838409+0000 mon.smithi067 (mon.1) 1047 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:44:25.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:44:23.839273+0000 mgr.smithi067.rdualw (mgr.24569) 6810 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:44:27.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:25.756360+0000 mgr.smithi067.rdualw (mgr.24569) 6811 : cluster [DBG] pgmap v5867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:44:27.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:25.756360+0000 mgr.smithi067.rdualw (mgr.24569) 6811 : cluster [DBG] pgmap v5867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:44:29.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:27.756798+0000 mgr.smithi067.rdualw (mgr.24569) 6812 : cluster [DBG] pgmap v5868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:29.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:28.534030+0000 mon.smithi061 (mon.0) 1508 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:44:29.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:27.756798+0000 mgr.smithi067.rdualw (mgr.24569) 6812 : cluster [DBG] pgmap v5868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:29.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:28.534030+0000 mon.smithi061 (mon.0) 1508 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:44:30.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:28.922610+0000 mon.smithi067 (mon.1) 1048 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:44:30.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:28.923099+0000 mon.smithi061 (mon.0) 1509 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:44:30.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:28.922610+0000 mon.smithi067 (mon.1) 1048 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:44:30.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:28.923099+0000 mon.smithi061 (mon.0) 1509 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:44:31.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:29.757420+0000 mgr.smithi067.rdualw (mgr.24569) 6813 : cluster [DBG] pgmap v5869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:31.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:29.757420+0000 mgr.smithi067.rdualw (mgr.24569) 6813 : cluster [DBG] pgmap v5869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:30.997675+0000 mon.smithi061 (mon.0) 1510 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:44:32.299 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:31.404735+0000 mon.smithi067 (mon.1) 1049 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:44:32.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:31.405123+0000 mon.smithi061 (mon.0) 1511 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:44:32.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:31.409927+0000 mon.smithi061 (mon.0) 1512 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:44:32.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:31.416811+0000 mon.smithi061 (mon.0) 1513 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:44:32.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:31.758280+0000 mgr.smithi067.rdualw (mgr.24569) 6814 : cluster [DBG] pgmap v5870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:30.997675+0000 mon.smithi061 (mon.0) 1510 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:44:32.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:31.404735+0000 mon.smithi067 (mon.1) 1049 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:44:32.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:31.405123+0000 mon.smithi061 (mon.0) 1511 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:44:32.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:31.409927+0000 mon.smithi061 (mon.0) 1512 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:44:32.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:31.416811+0000 mon.smithi061 (mon.0) 1513 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:44:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:31.758280+0000 mgr.smithi067.rdualw (mgr.24569) 6814 : cluster [DBG] pgmap v5870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:35.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:33.758901+0000 mgr.smithi067.rdualw (mgr.24569) 6815 : cluster [DBG] pgmap v5871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:35.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:33.758901+0000 mgr.smithi067.rdualw (mgr.24569) 6815 : cluster [DBG] pgmap v5871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:36.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:35.511083+0000 mon.smithi067 (mon.1) 1050 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:44:36.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:35.511367+0000 mon.smithi067 (mon.1) 1051 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:44:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:35.511474+0000 mon.smithi061 (mon.0) 1514 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:44:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:35.511807+0000 mon.smithi061 (mon.0) 1515 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:44:36.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:35.511083+0000 mon.smithi067 (mon.1) 1050 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:44:36.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:35.511367+0000 mon.smithi067 (mon.1) 1051 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:44:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:35.511474+0000 mon.smithi061 (mon.0) 1514 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:44:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:35.511807+0000 mon.smithi061 (mon.0) 1515 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:44:37.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:35.759804+0000 mgr.smithi067.rdualw (mgr.24569) 6816 : cluster [DBG] pgmap v5872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:44:37.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:35.759804+0000 mgr.smithi067.rdualw (mgr.24569) 6816 : cluster [DBG] pgmap v5872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:44:39.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:37.760454+0000 mgr.smithi067.rdualw (mgr.24569) 6817 : cluster [DBG] pgmap v5873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:39.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:37.760454+0000 mgr.smithi067.rdualw (mgr.24569) 6817 : cluster [DBG] pgmap v5873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:41.013 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:44:41.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:39.761168+0000 mgr.smithi067.rdualw (mgr.24569) 6818 : cluster [DBG] pgmap v5874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:41.308 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:44:41.309 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 10s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:44:41.309 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 10s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:44:41.309 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 12s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:44:41.310 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 10s ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:44:41.310 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 10s ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:44:41.310 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 12s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:44:41.310 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 10s ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:44:41.310 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 12s ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:44:41.311 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 10s ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:44:41.311 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 12s ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:44:41.311 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 10s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:44:41.311 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 12s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:44:41.312 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 10s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:44:41.312 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 12s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:44:41.312 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 10s ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:44:41.312 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 10s ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:44:41.312 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 10s ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:44:41.313 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 10s ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:44:41.313 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 12s ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:44:41.313 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 12s ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:44:41.313 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 12s ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:44:41.314 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 12s ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:44:41.314 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 10s ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:44:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:39.761168+0000 mgr.smithi067.rdualw (mgr.24569) 6818 : cluster [DBG] pgmap v5874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:41.652 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:44:41.652 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:44:41.652 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:44:41.653 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:44:41.653 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:44:41.653 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:44:41.653 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:44:41.654 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:44:41.654 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:44:41.654 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:44:41.654 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:44:41.655 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:44:41.655 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:44:41.655 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:44:41.655 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:44:41.655 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:44:41.656 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:44:41.656 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:44:41.656 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:44:42.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:41.001327+0000 mgr.smithi067.rdualw (mgr.24569) 6819 : audit [DBG] from='client.38686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:44:42.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:41.293175+0000 mgr.smithi067.rdualw (mgr.24569) 6820 : audit [DBG] from='client.38690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:44:42.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:44:41.652975+0000 mon.smithi061 (mon.0) 1516 : audit [DBG] from='client.? 172.21.15.61:0/3266980925' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:44:42.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:41.761981+0000 mgr.smithi067.rdualw (mgr.24569) 6821 : cluster [DBG] pgmap v5875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:42.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:41.001327+0000 mgr.smithi067.rdualw (mgr.24569) 6819 : audit [DBG] from='client.38686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:44:42.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:41.293175+0000 mgr.smithi067.rdualw (mgr.24569) 6820 : audit [DBG] from='client.38690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:44:42.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:44:41.652975+0000 mon.smithi061 (mon.0) 1516 : audit [DBG] from='client.? 172.21.15.61:0/3266980925' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:44:42.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:41.761981+0000 mgr.smithi067.rdualw (mgr.24569) 6821 : cluster [DBG] pgmap v5875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:45.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:43.762573+0000 mgr.smithi067.rdualw (mgr.24569) 6822 : cluster [DBG] pgmap v5876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:45.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:43.762573+0000 mgr.smithi067.rdualw (mgr.24569) 6822 : cluster [DBG] pgmap v5876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:47.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:45.763583+0000 mgr.smithi067.rdualw (mgr.24569) 6823 : cluster [DBG] pgmap v5877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:44:47.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:45.763583+0000 mgr.smithi067.rdualw (mgr.24569) 6823 : cluster [DBG] pgmap v5877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:44:49.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:47.764073+0000 mgr.smithi067.rdualw (mgr.24569) 6824 : cluster [DBG] pgmap v5878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:49.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:47.764073+0000 mgr.smithi067.rdualw (mgr.24569) 6824 : cluster [DBG] pgmap v5878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:51.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:49.764674+0000 mgr.smithi067.rdualw (mgr.24569) 6825 : cluster [DBG] pgmap v5879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:51.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:49.764674+0000 mgr.smithi067.rdualw (mgr.24569) 6825 : cluster [DBG] pgmap v5879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:52.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:51.765473+0000 mgr.smithi067.rdualw (mgr.24569) 6826 : cluster [DBG] pgmap v5880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:52.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:51.765473+0000 mgr.smithi067.rdualw (mgr.24569) 6826 : cluster [DBG] pgmap v5880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:55.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:53.766080+0000 mgr.smithi067.rdualw (mgr.24569) 6827 : cluster [DBG] pgmap v5881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:55.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:53.766080+0000 mgr.smithi067.rdualw (mgr.24569) 6827 : cluster [DBG] pgmap v5881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:57.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:55.767128+0000 mgr.smithi067.rdualw (mgr.24569) 6828 : cluster [DBG] pgmap v5882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:44:57.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:55.767128+0000 mgr.smithi067.rdualw (mgr.24569) 6828 : cluster [DBG] pgmap v5882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:44:59.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:44:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:57.767725+0000 mgr.smithi067.rdualw (mgr.24569) 6829 : cluster [DBG] pgmap v5883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:44:59.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:44:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:57.767725+0000 mgr.smithi067.rdualw (mgr.24569) 6829 : cluster [DBG] pgmap v5883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:01.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:44:59.768412+0000 mgr.smithi067.rdualw (mgr.24569) 6830 : cluster [DBG] pgmap v5884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:01.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:44:59.768412+0000 mgr.smithi067.rdualw (mgr.24569) 6830 : cluster [DBG] pgmap v5884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:02.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:01.769452+0000 mgr.smithi067.rdualw (mgr.24569) 6831 : cluster [DBG] pgmap v5885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:02.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:01.769452+0000 mgr.smithi067.rdualw (mgr.24569) 6831 : cluster [DBG] pgmap v5885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:05.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:03.770057+0000 mgr.smithi067.rdualw (mgr.24569) 6832 : cluster [DBG] pgmap v5886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:05.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:03.770057+0000 mgr.smithi067.rdualw (mgr.24569) 6832 : cluster [DBG] pgmap v5886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:07.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:05.771165+0000 mgr.smithi067.rdualw (mgr.24569) 6833 : cluster [DBG] pgmap v5887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:45:07.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:05.771165+0000 mgr.smithi067.rdualw (mgr.24569) 6833 : cluster [DBG] pgmap v5887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:45:09.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:07.771688+0000 mgr.smithi067.rdualw (mgr.24569) 6834 : cluster [DBG] pgmap v5888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:09.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:07.771688+0000 mgr.smithi067.rdualw (mgr.24569) 6834 : cluster [DBG] pgmap v5888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:11.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:09.772384+0000 mgr.smithi067.rdualw (mgr.24569) 6835 : cluster [DBG] pgmap v5889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:11.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:09.772384+0000 mgr.smithi067.rdualw (mgr.24569) 6835 : cluster [DBG] pgmap v5889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:11.963 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:45:12.255 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:45:12.255 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 41s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:45:12.255 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 41s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:45:12.256 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 43s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:45:12.256 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 41s ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:45:12.256 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 41s ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:45:12.256 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 43s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:45:12.256 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 41s ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:45:12.257 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 43s ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:45:12.257 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 41s ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:45:12.257 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 43s ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:45:12.257 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 41s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:45:12.258 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 43s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:45:12.258 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 41s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:45:12.258 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 43s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:45:12.258 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 41s ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:45:12.259 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 41s ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:45:12.259 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 41s ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:45:12.259 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 41s ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:45:12.259 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 43s ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:45:12.259 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 43s ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:45:12.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 43s ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:45:12.260 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 43s ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:45:12.260 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 41s ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:45:12.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:11.773204+0000 mgr.smithi067.rdualw (mgr.24569) 6836 : cluster [DBG] pgmap v5890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:12.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:45:11.952222+0000 mgr.smithi067.rdualw (mgr.24569) 6837 : audit [DBG] from='client.38698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:45:12.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:11.773204+0000 mgr.smithi067.rdualw (mgr.24569) 6836 : cluster [DBG] pgmap v5890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:12.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:45:11.952222+0000 mgr.smithi067.rdualw (mgr.24569) 6837 : audit [DBG] from='client.38698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:45:12.597 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:45:12.597 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:45:12.598 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:45:12.598 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:45:12.598 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:45:12.598 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:45:12.599 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:45:12.599 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:45:12.599 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:45:12.599 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:45:12.600 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:45:12.600 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:45:12.600 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:45:12.600 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:45:12.601 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:45:12.601 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:45:12.601 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:45:12.601 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:45:12.601 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:45:13.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:45:12.239724+0000 mgr.smithi067.rdualw (mgr.24569) 6838 : audit [DBG] from='client.38702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:45:13.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:45:12.598409+0000 mon.smithi061 (mon.0) 1517 : audit [DBG] from='client.? 172.21.15.61:0/545104304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:45:13.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:45:12.239724+0000 mgr.smithi067.rdualw (mgr.24569) 6838 : audit [DBG] from='client.38702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:45:13.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:45:12.598409+0000 mon.smithi061 (mon.0) 1517 : audit [DBG] from='client.? 172.21.15.61:0/545104304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:45:14.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:13.773748+0000 mgr.smithi067.rdualw (mgr.24569) 6839 : cluster [DBG] pgmap v5891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:14.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:13.773748+0000 mgr.smithi067.rdualw (mgr.24569) 6839 : cluster [DBG] pgmap v5891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:17.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:15.774691+0000 mgr.smithi067.rdualw (mgr.24569) 6840 : cluster [DBG] pgmap v5892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:45:17.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:15.774691+0000 mgr.smithi067.rdualw (mgr.24569) 6840 : cluster [DBG] pgmap v5892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:45:19.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:17.775169+0000 mgr.smithi067.rdualw (mgr.24569) 6841 : cluster [DBG] pgmap v5893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:19.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:17.775169+0000 mgr.smithi067.rdualw (mgr.24569) 6841 : cluster [DBG] pgmap v5893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:21.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:19.775913+0000 mgr.smithi067.rdualw (mgr.24569) 6842 : cluster [DBG] pgmap v5894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:21.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:19.775913+0000 mgr.smithi067.rdualw (mgr.24569) 6842 : cluster [DBG] pgmap v5894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:22.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:21.776969+0000 mgr.smithi067.rdualw (mgr.24569) 6843 : cluster [DBG] pgmap v5895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:22.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:21.776969+0000 mgr.smithi067.rdualw (mgr.24569) 6843 : cluster [DBG] pgmap v5895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:25.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:23.777513+0000 mgr.smithi067.rdualw (mgr.24569) 6844 : cluster [DBG] pgmap v5896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:25.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:23.777513+0000 mgr.smithi067.rdualw (mgr.24569) 6844 : cluster [DBG] pgmap v5896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:27.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:25.778478+0000 mgr.smithi067.rdualw (mgr.24569) 6845 : cluster [DBG] pgmap v5897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:45:27.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:25.778478+0000 mgr.smithi067.rdualw (mgr.24569) 6845 : cluster [DBG] pgmap v5897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:45:29.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:27.779215+0000 mgr.smithi067.rdualw (mgr.24569) 6846 : cluster [DBG] pgmap v5898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:29.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:27.779215+0000 mgr.smithi067.rdualw (mgr.24569) 6846 : cluster [DBG] pgmap v5898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:31.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:29.779841+0000 mgr.smithi067.rdualw (mgr.24569) 6847 : cluster [DBG] pgmap v5899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:31.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:29.779841+0000 mgr.smithi067.rdualw (mgr.24569) 6847 : cluster [DBG] pgmap v5899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:32.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:45:31.421171+0000 mon.smithi067 (mon.1) 1052 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:45:32.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:45:31.422615+0000 mon.smithi067 (mon.1) 1053 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:45:32.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:45:31.423616+0000 mon.smithi067 (mon.1) 1054 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:45:32.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:45:31.424510+0000 mgr.smithi067.rdualw (mgr.24569) 6848 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:45:32.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:31.780605+0000 mgr.smithi067.rdualw (mgr.24569) 6849 : cluster [DBG] pgmap v5900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:45:31.839547+0000 mon.smithi061 (mon.0) 1518 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:45:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:45:31.845542+0000 mon.smithi061 (mon.0) 1519 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:45:32.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:45:31.421171+0000 mon.smithi067 (mon.1) 1052 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:45:32.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:45:31.422615+0000 mon.smithi067 (mon.1) 1053 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:45:32.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:45:31.423616+0000 mon.smithi067 (mon.1) 1054 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:45:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:45:31.424510+0000 mgr.smithi067.rdualw (mgr.24569) 6848 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:45:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:31.780605+0000 mgr.smithi067.rdualw (mgr.24569) 6849 : cluster [DBG] pgmap v5900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:45:31.839547+0000 mon.smithi061 (mon.0) 1518 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:45:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:45:31.845542+0000 mon.smithi061 (mon.0) 1519 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:45:35.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:33.781277+0000 mgr.smithi067.rdualw (mgr.24569) 6850 : cluster [DBG] pgmap v5901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:35.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:33.781277+0000 mgr.smithi067.rdualw (mgr.24569) 6850 : cluster [DBG] pgmap v5901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:36.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:45:35.516324+0000 mon.smithi067 (mon.1) 1055 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:45:36.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:45:35.516606+0000 mon.smithi067 (mon.1) 1056 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:45:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:45:35.516969+0000 mon.smithi061 (mon.0) 1520 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:45:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:45:35.517458+0000 mon.smithi061 (mon.0) 1521 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:45:36.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:45:35.516324+0000 mon.smithi067 (mon.1) 1055 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:45:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:45:35.516606+0000 mon.smithi067 (mon.1) 1056 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:45:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:45:35.516969+0000 mon.smithi061 (mon.0) 1520 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:45:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:45:35.517458+0000 mon.smithi061 (mon.0) 1521 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:45:37.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:35.782205+0000 mgr.smithi067.rdualw (mgr.24569) 6851 : cluster [DBG] pgmap v5902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:45:37.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:35.782205+0000 mgr.smithi067.rdualw (mgr.24569) 6851 : cluster [DBG] pgmap v5902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:45:39.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:37.782695+0000 mgr.smithi067.rdualw (mgr.24569) 6852 : cluster [DBG] pgmap v5903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:39.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:37.782695+0000 mgr.smithi067.rdualw (mgr.24569) 6852 : cluster [DBG] pgmap v5903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:41.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:39.783304+0000 mgr.smithi067.rdualw (mgr.24569) 6853 : cluster [DBG] pgmap v5904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:41.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:39.783304+0000 mgr.smithi067.rdualw (mgr.24569) 6853 : cluster [DBG] pgmap v5904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:42.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:41.784178+0000 mgr.smithi067.rdualw (mgr.24569) 6854 : cluster [DBG] pgmap v5905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:42.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:41.784178+0000 mgr.smithi067.rdualw (mgr.24569) 6854 : cluster [DBG] pgmap v5905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:42.907 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:45:43.198 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:45:43.198 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 72s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:45:43.198 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 72s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:45:43.199 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 74s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:45:43.199 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 72s ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:45:43.199 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 72s ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:45:43.199 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 74s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:45:43.200 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 72s ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:45:43.200 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 74s ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:45:43.200 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 72s ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:45:43.200 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 74s ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:45:43.200 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 72s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:45:43.201 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 74s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:45:43.201 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 72s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:45:43.201 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 74s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:45:43.201 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 72s ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:45:43.202 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 72s ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:45:43.202 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 72s ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:45:43.202 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 72s ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:45:43.202 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 74s ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:45:43.203 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 74s ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:45:43.203 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 74s ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:45:43.203 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 74s ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:45:43.203 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 72s ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:45:43.536 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:45:43.536 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:45:43.536 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:45:43.537 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:45:43.537 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:45:43.537 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:45:43.537 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:45:43.537 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:45:43.538 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:45:43.538 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:45:43.538 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:45:43.538 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:45:43.539 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:45:43.539 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:45:43.539 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:45:43.539 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:45:43.540 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:45:43.540 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:45:43.540 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:45:43.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:45:42.895782+0000 mgr.smithi067.rdualw (mgr.24569) 6855 : audit [DBG] from='client.38710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:45:43.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:45:42.895782+0000 mgr.smithi067.rdualw (mgr.24569) 6855 : audit [DBG] from='client.38710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:45:44.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:45:43.182278+0000 mgr.smithi067.rdualw (mgr.24569) 6856 : audit [DBG] from='client.38714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:45:44.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:45:43.536948+0000 mon.smithi061 (mon.0) 1522 : audit [DBG] from='client.? 172.21.15.61:0/2250640149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:45:44.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:43.784749+0000 mgr.smithi067.rdualw (mgr.24569) 6857 : cluster [DBG] pgmap v5906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:44.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:45:43.182278+0000 mgr.smithi067.rdualw (mgr.24569) 6856 : audit [DBG] from='client.38714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:45:44.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:45:43.536948+0000 mon.smithi061 (mon.0) 1522 : audit [DBG] from='client.? 172.21.15.61:0/2250640149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:45:44.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:43.784749+0000 mgr.smithi067.rdualw (mgr.24569) 6857 : cluster [DBG] pgmap v5906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:47.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:45.785546+0000 mgr.smithi067.rdualw (mgr.24569) 6858 : cluster [DBG] pgmap v5907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:45:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:45.785546+0000 mgr.smithi067.rdualw (mgr.24569) 6858 : cluster [DBG] pgmap v5907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:45:49.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:47.786003+0000 mgr.smithi067.rdualw (mgr.24569) 6859 : cluster [DBG] pgmap v5908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:49.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:47.786003+0000 mgr.smithi067.rdualw (mgr.24569) 6859 : cluster [DBG] pgmap v5908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:51.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:49.786571+0000 mgr.smithi067.rdualw (mgr.24569) 6860 : cluster [DBG] pgmap v5909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:51.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:49.786571+0000 mgr.smithi067.rdualw (mgr.24569) 6860 : cluster [DBG] pgmap v5909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:52.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:51.787403+0000 mgr.smithi067.rdualw (mgr.24569) 6861 : cluster [DBG] pgmap v5910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:52.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:51.787403+0000 mgr.smithi067.rdualw (mgr.24569) 6861 : cluster [DBG] pgmap v5910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:55.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:53.787969+0000 mgr.smithi067.rdualw (mgr.24569) 6862 : cluster [DBG] pgmap v5911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:55.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:53.787969+0000 mgr.smithi067.rdualw (mgr.24569) 6862 : cluster [DBG] pgmap v5911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:57.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:55.788944+0000 mgr.smithi067.rdualw (mgr.24569) 6863 : cluster [DBG] pgmap v5912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:45:57.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:55.788944+0000 mgr.smithi067.rdualw (mgr.24569) 6863 : cluster [DBG] pgmap v5912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:45:59.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:45:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:57.789429+0000 mgr.smithi067.rdualw (mgr.24569) 6864 : cluster [DBG] pgmap v5913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:45:59.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:45:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:57.789429+0000 mgr.smithi067.rdualw (mgr.24569) 6864 : cluster [DBG] pgmap v5913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:01.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:45:59.790099+0000 mgr.smithi067.rdualw (mgr.24569) 6865 : cluster [DBG] pgmap v5914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:01.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:45:59.790099+0000 mgr.smithi067.rdualw (mgr.24569) 6865 : cluster [DBG] pgmap v5914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:02.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:01.790982+0000 mgr.smithi067.rdualw (mgr.24569) 6866 : cluster [DBG] pgmap v5915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:02.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:01.790982+0000 mgr.smithi067.rdualw (mgr.24569) 6866 : cluster [DBG] pgmap v5915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:05.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:03.791542+0000 mgr.smithi067.rdualw (mgr.24569) 6867 : cluster [DBG] pgmap v5916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:05.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:03.791542+0000 mgr.smithi067.rdualw (mgr.24569) 6867 : cluster [DBG] pgmap v5916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:07.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:05.792445+0000 mgr.smithi067.rdualw (mgr.24569) 6868 : cluster [DBG] pgmap v5917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:46:07.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:05.792445+0000 mgr.smithi067.rdualw (mgr.24569) 6868 : cluster [DBG] pgmap v5917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:46:09.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:07.792984+0000 mgr.smithi067.rdualw (mgr.24569) 6869 : cluster [DBG] pgmap v5918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:09.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:07.792984+0000 mgr.smithi067.rdualw (mgr.24569) 6869 : cluster [DBG] pgmap v5918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:11.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:09.793677+0000 mgr.smithi067.rdualw (mgr.24569) 6870 : cluster [DBG] pgmap v5919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:11.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:09.793677+0000 mgr.smithi067.rdualw (mgr.24569) 6870 : cluster [DBG] pgmap v5919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:12.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:11.794799+0000 mgr.smithi067.rdualw (mgr.24569) 6871 : cluster [DBG] pgmap v5920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:12.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:11.794799+0000 mgr.smithi067.rdualw (mgr.24569) 6871 : cluster [DBG] pgmap v5920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:13.843 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:46:14.133 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:46:14.134 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 103s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:46:14.134 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 103s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:46:14.134 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 105s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:46:14.134 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 103s ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:46:14.135 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 103s ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:46:14.135 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 105s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:46:14.135 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 103s ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:46:14.135 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 105s ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:46:14.135 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 103s ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:46:14.136 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 105s ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:46:14.136 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 103s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:46:14.136 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 105s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:46:14.136 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 103s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:46:14.137 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 105s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:46:14.137 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 103s ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:46:14.137 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 103s ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:46:14.137 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 103s ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:46:14.138 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 103s ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:46:14.138 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 105s ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:46:14.138 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 105s ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:46:14.138 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 105s ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:46:14.138 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 105s ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:46:14.139 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 103s ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:46:14.477 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:46:14.477 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:46:14.478 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:46:14.478 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:46:14.478 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:46:14.479 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:46:14.479 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:46:14.479 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:46:14.479 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:46:14.479 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:46:14.480 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:46:14.480 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:46:14.480 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:46:14.480 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:46:14.481 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:46:14.481 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:46:14.481 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:46:14.481 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:46:14.481 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:46:15.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:13.795377+0000 mgr.smithi067.rdualw (mgr.24569) 6872 : cluster [DBG] pgmap v5921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:15.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:46:13.832768+0000 mgr.smithi067.rdualw (mgr.24569) 6873 : audit [DBG] from='client.38722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:46:15.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:46:14.478320+0000 mon.smithi061 (mon.0) 1523 : audit [DBG] from='client.? 172.21.15.61:0/1689285205' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:46:15.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:13.795377+0000 mgr.smithi067.rdualw (mgr.24569) 6872 : cluster [DBG] pgmap v5921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:15.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:46:13.832768+0000 mgr.smithi067.rdualw (mgr.24569) 6873 : audit [DBG] from='client.38722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:46:15.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:46:14.478320+0000 mon.smithi061 (mon.0) 1523 : audit [DBG] from='client.? 172.21.15.61:0/1689285205' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:46:16.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:46:14.118204+0000 mgr.smithi067.rdualw (mgr.24569) 6874 : audit [DBG] from='client.38726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:46:16.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:46:14.118204+0000 mgr.smithi067.rdualw (mgr.24569) 6874 : audit [DBG] from='client.38726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:46:17.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:15.796249+0000 mgr.smithi067.rdualw (mgr.24569) 6875 : cluster [DBG] pgmap v5922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:46:17.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:15.796249+0000 mgr.smithi067.rdualw (mgr.24569) 6875 : cluster [DBG] pgmap v5922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:46:19.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:17.796902+0000 mgr.smithi067.rdualw (mgr.24569) 6876 : cluster [DBG] pgmap v5923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:19.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:17.796902+0000 mgr.smithi067.rdualw (mgr.24569) 6876 : cluster [DBG] pgmap v5923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:21.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:19.797490+0000 mgr.smithi067.rdualw (mgr.24569) 6877 : cluster [DBG] pgmap v5924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:21.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:19.797490+0000 mgr.smithi067.rdualw (mgr.24569) 6877 : cluster [DBG] pgmap v5924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:22.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:21.798477+0000 mgr.smithi067.rdualw (mgr.24569) 6878 : cluster [DBG] pgmap v5925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:22.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:21.798477+0000 mgr.smithi067.rdualw (mgr.24569) 6878 : cluster [DBG] pgmap v5925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:25.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:23.799091+0000 mgr.smithi067.rdualw (mgr.24569) 6879 : cluster [DBG] pgmap v5926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:25.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:23.799091+0000 mgr.smithi067.rdualw (mgr.24569) 6879 : cluster [DBG] pgmap v5926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:27.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:25.799926+0000 mgr.smithi067.rdualw (mgr.24569) 6880 : cluster [DBG] pgmap v5927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:46:27.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:25.799926+0000 mgr.smithi067.rdualw (mgr.24569) 6880 : cluster [DBG] pgmap v5927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:46:29.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:27.800579+0000 mgr.smithi067.rdualw (mgr.24569) 6881 : cluster [DBG] pgmap v5928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:29.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:27.800579+0000 mgr.smithi067.rdualw (mgr.24569) 6881 : cluster [DBG] pgmap v5928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:31.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:29.801268+0000 mgr.smithi067.rdualw (mgr.24569) 6882 : cluster [DBG] pgmap v5929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:31.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:29.801268+0000 mgr.smithi067.rdualw (mgr.24569) 6882 : cluster [DBG] pgmap v5929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:32.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:31.802372+0000 mgr.smithi067.rdualw (mgr.24569) 6883 : cluster [DBG] pgmap v5930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:32.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:46:31.849523+0000 mon.smithi067 (mon.1) 1057 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:46:32.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:46:31.851035+0000 mon.smithi067 (mon.1) 1058 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:46:32.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:46:31.852018+0000 mon.smithi067 (mon.1) 1059 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:46:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:46:31.852875+0000 mgr.smithi067.rdualw (mgr.24569) 6884 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:46:32.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:31.802372+0000 mgr.smithi067.rdualw (mgr.24569) 6883 : cluster [DBG] pgmap v5930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:32.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:46:31.849523+0000 mon.smithi067 (mon.1) 1057 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:46:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:46:31.851035+0000 mon.smithi067 (mon.1) 1058 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:46:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:46:31.852018+0000 mon.smithi067 (mon.1) 1059 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:46:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:46:31.852875+0000 mgr.smithi067.rdualw (mgr.24569) 6884 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:46:33.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:46:32.209747+0000 mon.smithi061 (mon.0) 1524 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:46:33.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:46:32.214679+0000 mon.smithi061 (mon.0) 1525 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:46:33.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:46:32.615135+0000 mon.smithi061 (mon.0) 1526 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:46:33.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:46:32.622639+0000 mon.smithi061 (mon.0) 1527 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:46:33.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:46:32.209747+0000 mon.smithi061 (mon.0) 1524 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:46:33.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:46:32.214679+0000 mon.smithi061 (mon.0) 1525 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:46:33.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:46:32.615135+0000 mon.smithi061 (mon.0) 1526 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:46:33.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:46:32.622639+0000 mon.smithi061 (mon.0) 1527 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:46:34.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:33.802971+0000 mgr.smithi067.rdualw (mgr.24569) 6885 : cluster [DBG] pgmap v5931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:34.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:33.802971+0000 mgr.smithi067.rdualw (mgr.24569) 6885 : cluster [DBG] pgmap v5931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:36.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:46:35.521591+0000 mon.smithi067 (mon.1) 1060 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:46:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:46:35.521846+0000 mon.smithi067 (mon.1) 1061 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:46:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:46:35.522041+0000 mon.smithi061 (mon.0) 1528 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:46:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:46:35.522299+0000 mon.smithi061 (mon.0) 1529 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:46:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:46:35.521591+0000 mon.smithi067 (mon.1) 1060 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:46:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:46:35.521846+0000 mon.smithi067 (mon.1) 1061 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:46:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:46:35.522041+0000 mon.smithi061 (mon.0) 1528 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:46:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:46:35.522299+0000 mon.smithi061 (mon.0) 1529 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:46:37.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:35.804044+0000 mgr.smithi067.rdualw (mgr.24569) 6886 : cluster [DBG] pgmap v5932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:46:37.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:35.804044+0000 mgr.smithi067.rdualw (mgr.24569) 6886 : cluster [DBG] pgmap v5932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:46:39.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:37.804523+0000 mgr.smithi067.rdualw (mgr.24569) 6887 : cluster [DBG] pgmap v5933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:39.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:37.804523+0000 mgr.smithi067.rdualw (mgr.24569) 6887 : cluster [DBG] pgmap v5933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:41.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:39.805072+0000 mgr.smithi067.rdualw (mgr.24569) 6888 : cluster [DBG] pgmap v5934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:41.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:39.805072+0000 mgr.smithi067.rdualw (mgr.24569) 6888 : cluster [DBG] pgmap v5934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:42.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:41.805914+0000 mgr.smithi067.rdualw (mgr.24569) 6889 : cluster [DBG] pgmap v5935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:42.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:41.805914+0000 mgr.smithi067.rdualw (mgr.24569) 6889 : cluster [DBG] pgmap v5935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:44.785 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:46:45.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:43.806457+0000 mgr.smithi067.rdualw (mgr.24569) 6890 : cluster [DBG] pgmap v5936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:45.129 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:46:45.130 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 2m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:46:45.130 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 2m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:46:45.130 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 2m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:46:45.131 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 2m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:46:45.131 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 2m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:46:45.131 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 2m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:46:45.131 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 2m ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:46:45.132 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 2m ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:46:45.132 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 2m ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:46:45.132 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 2m ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:46:45.132 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 2m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:46:45.132 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 2m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:46:45.133 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 2m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:46:45.133 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 2m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:46:45.133 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 2m ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:46:45.133 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 2m ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:46:45.134 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 2m ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:46:45.134 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 2m ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:46:45.134 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 2m ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:46:45.134 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 2m ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:46:45.135 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 2m ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:46:45.135 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 2m ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:46:45.135 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 2m ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:46:45.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:43.806457+0000 mgr.smithi067.rdualw (mgr.24569) 6890 : cluster [DBG] pgmap v5936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:45.475 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:46:45.476 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:46:45.476 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:46:45.476 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:46:45.477 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:46:45.477 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:46:45.477 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:46:45.478 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:46:45.478 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:46:45.478 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:46:45.479 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:46:45.479 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:46:45.479 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:46:45.479 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:46:45.479 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:46:45.480 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:46:45.480 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:46:45.480 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:46:45.480 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:46:46.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:46:44.773983+0000 mgr.smithi067.rdualw (mgr.24569) 6891 : audit [DBG] from='client.38734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:46:46.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:46:45.476637+0000 mon.smithi061 (mon.0) 1530 : audit [DBG] from='client.? 172.21.15.61:0/2278496807' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:46:46.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:46:44.773983+0000 mgr.smithi067.rdualw (mgr.24569) 6891 : audit [DBG] from='client.38734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:46:46.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:46:45.476637+0000 mon.smithi061 (mon.0) 1530 : audit [DBG] from='client.? 172.21.15.61:0/2278496807' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:46:47.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:46:45.114461+0000 mgr.smithi067.rdualw (mgr.24569) 6892 : audit [DBG] from='client.38738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:46:47.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:45.807227+0000 mgr.smithi067.rdualw (mgr.24569) 6893 : cluster [DBG] pgmap v5937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:46:47.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:46:45.114461+0000 mgr.smithi067.rdualw (mgr.24569) 6892 : audit [DBG] from='client.38738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:46:47.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:45.807227+0000 mgr.smithi067.rdualw (mgr.24569) 6893 : cluster [DBG] pgmap v5937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:46:49.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:47.807881+0000 mgr.smithi067.rdualw (mgr.24569) 6894 : cluster [DBG] pgmap v5938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:49.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:47.807881+0000 mgr.smithi067.rdualw (mgr.24569) 6894 : cluster [DBG] pgmap v5938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:51.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:49.808469+0000 mgr.smithi067.rdualw (mgr.24569) 6895 : cluster [DBG] pgmap v5939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:51.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:49.808469+0000 mgr.smithi067.rdualw (mgr.24569) 6895 : cluster [DBG] pgmap v5939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:52.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:51.809368+0000 mgr.smithi067.rdualw (mgr.24569) 6896 : cluster [DBG] pgmap v5940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:52.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:51.809368+0000 mgr.smithi067.rdualw (mgr.24569) 6896 : cluster [DBG] pgmap v5940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:55.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:53.810005+0000 mgr.smithi067.rdualw (mgr.24569) 6897 : cluster [DBG] pgmap v5941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:55.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:53.810005+0000 mgr.smithi067.rdualw (mgr.24569) 6897 : cluster [DBG] pgmap v5941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:57.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:55.811055+0000 mgr.smithi067.rdualw (mgr.24569) 6898 : cluster [DBG] pgmap v5942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:46:57.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:55.811055+0000 mgr.smithi067.rdualw (mgr.24569) 6898 : cluster [DBG] pgmap v5942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:46:59.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:46:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:57.811716+0000 mgr.smithi067.rdualw (mgr.24569) 6899 : cluster [DBG] pgmap v5943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:46:59.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:46:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:57.811716+0000 mgr.smithi067.rdualw (mgr.24569) 6899 : cluster [DBG] pgmap v5943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:01.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:46:59.812396+0000 mgr.smithi067.rdualw (mgr.24569) 6900 : cluster [DBG] pgmap v5944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:01.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:46:59.812396+0000 mgr.smithi067.rdualw (mgr.24569) 6900 : cluster [DBG] pgmap v5944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:02.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:01.813286+0000 mgr.smithi067.rdualw (mgr.24569) 6901 : cluster [DBG] pgmap v5945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:02.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:01.813286+0000 mgr.smithi067.rdualw (mgr.24569) 6901 : cluster [DBG] pgmap v5945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:05.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:03.813909+0000 mgr.smithi067.rdualw (mgr.24569) 6902 : cluster [DBG] pgmap v5946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:05.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:03.813909+0000 mgr.smithi067.rdualw (mgr.24569) 6902 : cluster [DBG] pgmap v5946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:07.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:05.814812+0000 mgr.smithi067.rdualw (mgr.24569) 6903 : cluster [DBG] pgmap v5947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:47:07.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:05.814812+0000 mgr.smithi067.rdualw (mgr.24569) 6903 : cluster [DBG] pgmap v5947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:47:09.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:07.815317+0000 mgr.smithi067.rdualw (mgr.24569) 6904 : cluster [DBG] pgmap v5948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:09.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:07.815317+0000 mgr.smithi067.rdualw (mgr.24569) 6904 : cluster [DBG] pgmap v5948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:11.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:09.815945+0000 mgr.smithi067.rdualw (mgr.24569) 6905 : cluster [DBG] pgmap v5949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:11.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:09.815945+0000 mgr.smithi067.rdualw (mgr.24569) 6905 : cluster [DBG] pgmap v5949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:12.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:11.816909+0000 mgr.smithi067.rdualw (mgr.24569) 6906 : cluster [DBG] pgmap v5950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:12.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:11.816909+0000 mgr.smithi067.rdualw (mgr.24569) 6906 : cluster [DBG] pgmap v5950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:15.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:13.817553+0000 mgr.smithi067.rdualw (mgr.24569) 6907 : cluster [DBG] pgmap v5951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:15.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:13.817553+0000 mgr.smithi067.rdualw (mgr.24569) 6907 : cluster [DBG] pgmap v5951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:15.789 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:47:16.080 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:47:16.081 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 2m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:47:16.081 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 2m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:47:16.081 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 2m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:47:16.082 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 2m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:47:16.082 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 2m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:47:16.082 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 2m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:47:16.082 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 2m ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:47:16.082 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 2m ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:47:16.083 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 2m ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:47:16.083 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 2m ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:47:16.083 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 2m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:47:16.083 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 2m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:47:16.084 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 2m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:47:16.084 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 2m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:47:16.084 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 2m ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:47:16.084 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 2m ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:47:16.084 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 2m ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:47:16.085 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 2m ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:47:16.085 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 2m ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:47:16.085 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 2m ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:47:16.085 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 2m ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:47:16.086 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 2m ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:47:16.086 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 2m ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:47:16.421 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:47:16.422 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:47:16.422 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:47:16.422 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:47:16.423 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:47:16.423 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:47:16.423 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:47:16.423 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:47:16.423 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:47:16.424 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:47:16.424 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:47:16.424 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:47:16.425 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:47:16.425 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:47:16.425 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:47:16.425 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:47:16.425 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:47:16.426 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:47:16.426 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:47:17.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:47:15.775487+0000 mgr.smithi067.rdualw (mgr.24569) 6908 : audit [DBG] from='client.38746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:47:17.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:15.818614+0000 mgr.smithi067.rdualw (mgr.24569) 6909 : cluster [DBG] pgmap v5952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:47:17.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:47:16.422574+0000 mon.smithi061 (mon.0) 1531 : audit [DBG] from='client.? 172.21.15.61:0/3952827714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:47:17.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:47:15.775487+0000 mgr.smithi067.rdualw (mgr.24569) 6908 : audit [DBG] from='client.38746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:47:17.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:15.818614+0000 mgr.smithi067.rdualw (mgr.24569) 6909 : cluster [DBG] pgmap v5952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:47:17.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:47:16.422574+0000 mon.smithi061 (mon.0) 1531 : audit [DBG] from='client.? 172.21.15.61:0/3952827714' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:47:18.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:47:16.064836+0000 mgr.smithi067.rdualw (mgr.24569) 6910 : audit [DBG] from='client.38750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:47:18.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:47:16.064836+0000 mgr.smithi067.rdualw (mgr.24569) 6910 : audit [DBG] from='client.38750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:47:19.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:17.819174+0000 mgr.smithi067.rdualw (mgr.24569) 6911 : cluster [DBG] pgmap v5953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:19.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:17.819174+0000 mgr.smithi067.rdualw (mgr.24569) 6911 : cluster [DBG] pgmap v5953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:21.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:19.819815+0000 mgr.smithi067.rdualw (mgr.24569) 6912 : cluster [DBG] pgmap v5954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:21.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:19.819815+0000 mgr.smithi067.rdualw (mgr.24569) 6912 : cluster [DBG] pgmap v5954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:22.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:21.820620+0000 mgr.smithi067.rdualw (mgr.24569) 6913 : cluster [DBG] pgmap v5955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:22.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:21.820620+0000 mgr.smithi067.rdualw (mgr.24569) 6913 : cluster [DBG] pgmap v5955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:25.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:23.821164+0000 mgr.smithi067.rdualw (mgr.24569) 6914 : cluster [DBG] pgmap v5956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:25.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:23.821164+0000 mgr.smithi067.rdualw (mgr.24569) 6914 : cluster [DBG] pgmap v5956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:27.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:25.822044+0000 mgr.smithi067.rdualw (mgr.24569) 6915 : cluster [DBG] pgmap v5957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:47:27.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:25.822044+0000 mgr.smithi067.rdualw (mgr.24569) 6915 : cluster [DBG] pgmap v5957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:47:29.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:27.822640+0000 mgr.smithi067.rdualw (mgr.24569) 6916 : cluster [DBG] pgmap v5958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:29.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:27.822640+0000 mgr.smithi067.rdualw (mgr.24569) 6916 : cluster [DBG] pgmap v5958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:31.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:29.823158+0000 mgr.smithi067.rdualw (mgr.24569) 6917 : cluster [DBG] pgmap v5959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:31.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:29.823158+0000 mgr.smithi067.rdualw (mgr.24569) 6917 : cluster [DBG] pgmap v5959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:32.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:31.824070+0000 mgr.smithi067.rdualw (mgr.24569) 6918 : cluster [DBG] pgmap v5960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:32.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:31.824070+0000 mgr.smithi067.rdualw (mgr.24569) 6918 : cluster [DBG] pgmap v5960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:33.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:47:32.627885+0000 mon.smithi067 (mon.1) 1062 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:47:33.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:47:32.629309+0000 mon.smithi067 (mon.1) 1063 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:47:33.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:47:32.630268+0000 mon.smithi067 (mon.1) 1064 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:47:33.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:47:32.631115+0000 mgr.smithi067.rdualw (mgr.24569) 6919 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:47:33.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:47:33.045536+0000 mon.smithi061 (mon.0) 1532 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:47:33.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:47:33.051402+0000 mon.smithi061 (mon.0) 1533 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:47:33.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:47:32.627885+0000 mon.smithi067 (mon.1) 1062 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:47:33.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:47:32.629309+0000 mon.smithi067 (mon.1) 1063 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:47:33.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:47:32.630268+0000 mon.smithi067 (mon.1) 1064 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:47:33.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:47:32.631115+0000 mgr.smithi067.rdualw (mgr.24569) 6919 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:47:33.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:47:33.045536+0000 mon.smithi061 (mon.0) 1532 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:47:33.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:47:33.051402+0000 mon.smithi061 (mon.0) 1533 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:47:34.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:33.824681+0000 mgr.smithi067.rdualw (mgr.24569) 6920 : cluster [DBG] pgmap v5961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:34.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:33.824681+0000 mgr.smithi067.rdualw (mgr.24569) 6920 : cluster [DBG] pgmap v5961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:36.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:47:35.527507+0000 mon.smithi067 (mon.1) 1065 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:47:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:47:35.527780+0000 mon.smithi067 (mon.1) 1066 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:47:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:47:35.527851+0000 mon.smithi061 (mon.0) 1534 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:47:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:47:35.528218+0000 mon.smithi061 (mon.0) 1535 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:47:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:47:35.527507+0000 mon.smithi067 (mon.1) 1065 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:47:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:47:35.527780+0000 mon.smithi067 (mon.1) 1066 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:47:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:47:35.527851+0000 mon.smithi061 (mon.0) 1534 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:47:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:47:35.528218+0000 mon.smithi061 (mon.0) 1535 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:47:37.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:35.825609+0000 mgr.smithi067.rdualw (mgr.24569) 6921 : cluster [DBG] pgmap v5962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:47:37.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:35.825609+0000 mgr.smithi067.rdualw (mgr.24569) 6921 : cluster [DBG] pgmap v5962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:47:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:37.826135+0000 mgr.smithi067.rdualw (mgr.24569) 6922 : cluster [DBG] pgmap v5963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:39.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:37.826135+0000 mgr.smithi067.rdualw (mgr.24569) 6922 : cluster [DBG] pgmap v5963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:41.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:39.826862+0000 mgr.smithi067.rdualw (mgr.24569) 6923 : cluster [DBG] pgmap v5964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:41.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:39.826862+0000 mgr.smithi067.rdualw (mgr.24569) 6923 : cluster [DBG] pgmap v5964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:42.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:41.827897+0000 mgr.smithi067.rdualw (mgr.24569) 6924 : cluster [DBG] pgmap v5965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:42.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:41.827897+0000 mgr.smithi067.rdualw (mgr.24569) 6924 : cluster [DBG] pgmap v5965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:45.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:43.828571+0000 mgr.smithi067.rdualw (mgr.24569) 6925 : cluster [DBG] pgmap v5966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:45.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:43.828571+0000 mgr.smithi067.rdualw (mgr.24569) 6925 : cluster [DBG] pgmap v5966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:46.729 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:47:47.022 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:47:47.023 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 3m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:47:47.023 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 3m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:47:47.023 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 3m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:47:47.024 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 3m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:47:47.024 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 3m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:47:47.024 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 3m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:47:47.024 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 3m ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:47:47.025 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 3m ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:47:47.025 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 3m ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:47:47.025 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 3m ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:47:47.025 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 3m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:47:47.026 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 3m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:47:47.026 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 3m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:47:47.026 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 3m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:47:47.026 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 3m ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:47:47.026 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 3m ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:47:47.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 3m ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:47:47.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 3m ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:47:47.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 3m ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:47:47.027 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 3m ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:47:47.028 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 3m ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:47:47.028 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 3m ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:47:47.028 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 3m ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:47:47.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:45.829614+0000 mgr.smithi067.rdualw (mgr.24569) 6926 : cluster [DBG] pgmap v5967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:47:47.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:45.829614+0000 mgr.smithi067.rdualw (mgr.24569) 6926 : cluster [DBG] pgmap v5967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:47:47.368 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:47:47.368 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:47:47.368 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:47:47.369 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:47:47.369 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:47:47.369 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:47:47.369 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:47:47.370 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:47:47.370 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:47:47.370 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:47:47.370 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:47:47.371 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:47:47.371 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:47:47.371 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:47:47.371 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:47:47.371 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:47:47.372 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:47:47.372 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:47:47.372 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:47:48.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:47:46.717864+0000 mgr.smithi067.rdualw (mgr.24569) 6927 : audit [DBG] from='client.38758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:47:48.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:47:47.006766+0000 mgr.smithi067.rdualw (mgr.24569) 6928 : audit [DBG] from='client.38762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:47:48.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:47:47.367826+0000 mon.smithi061 (mon.0) 1536 : audit [DBG] from='client.? 172.21.15.61:0/3025346349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:47:48.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:47:46.717864+0000 mgr.smithi067.rdualw (mgr.24569) 6927 : audit [DBG] from='client.38758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:47:48.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:47:47.006766+0000 mgr.smithi067.rdualw (mgr.24569) 6928 : audit [DBG] from='client.38762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:47:48.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:47:47.367826+0000 mon.smithi061 (mon.0) 1536 : audit [DBG] from='client.? 172.21.15.61:0/3025346349' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:47:49.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:47.830124+0000 mgr.smithi067.rdualw (mgr.24569) 6929 : cluster [DBG] pgmap v5968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:49.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:47.830124+0000 mgr.smithi067.rdualw (mgr.24569) 6929 : cluster [DBG] pgmap v5968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:51.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:49.830754+0000 mgr.smithi067.rdualw (mgr.24569) 6930 : cluster [DBG] pgmap v5969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:51.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:49.830754+0000 mgr.smithi067.rdualw (mgr.24569) 6930 : cluster [DBG] pgmap v5969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:52.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:51.831798+0000 mgr.smithi067.rdualw (mgr.24569) 6931 : cluster [DBG] pgmap v5970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:52.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:51.831798+0000 mgr.smithi067.rdualw (mgr.24569) 6931 : cluster [DBG] pgmap v5970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:55.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:53.832469+0000 mgr.smithi067.rdualw (mgr.24569) 6932 : cluster [DBG] pgmap v5971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:55.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:53.832469+0000 mgr.smithi067.rdualw (mgr.24569) 6932 : cluster [DBG] pgmap v5971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:57.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:55.833338+0000 mgr.smithi067.rdualw (mgr.24569) 6933 : cluster [DBG] pgmap v5972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:47:57.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:55.833338+0000 mgr.smithi067.rdualw (mgr.24569) 6933 : cluster [DBG] pgmap v5972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:47:59.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:47:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:57.833889+0000 mgr.smithi067.rdualw (mgr.24569) 6934 : cluster [DBG] pgmap v5973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:47:59.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:47:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:57.833889+0000 mgr.smithi067.rdualw (mgr.24569) 6934 : cluster [DBG] pgmap v5973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:01.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:47:59.834644+0000 mgr.smithi067.rdualw (mgr.24569) 6935 : cluster [DBG] pgmap v5974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:01.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:47:59.834644+0000 mgr.smithi067.rdualw (mgr.24569) 6935 : cluster [DBG] pgmap v5974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:02.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:01.835550+0000 mgr.smithi067.rdualw (mgr.24569) 6936 : cluster [DBG] pgmap v5975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:02.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:01.835550+0000 mgr.smithi067.rdualw (mgr.24569) 6936 : cluster [DBG] pgmap v5975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:05.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:03.836266+0000 mgr.smithi067.rdualw (mgr.24569) 6937 : cluster [DBG] pgmap v5976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:05.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:03.836266+0000 mgr.smithi067.rdualw (mgr.24569) 6937 : cluster [DBG] pgmap v5976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:07.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:05.837140+0000 mgr.smithi067.rdualw (mgr.24569) 6938 : cluster [DBG] pgmap v5977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:48:07.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:05.837140+0000 mgr.smithi067.rdualw (mgr.24569) 6938 : cluster [DBG] pgmap v5977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:48:09.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:07.837704+0000 mgr.smithi067.rdualw (mgr.24569) 6939 : cluster [DBG] pgmap v5978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:09.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:07.837704+0000 mgr.smithi067.rdualw (mgr.24569) 6939 : cluster [DBG] pgmap v5978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:11.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:09.838358+0000 mgr.smithi067.rdualw (mgr.24569) 6940 : cluster [DBG] pgmap v5979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:09.838358+0000 mgr.smithi067.rdualw (mgr.24569) 6940 : cluster [DBG] pgmap v5979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:12.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:11.839143+0000 mgr.smithi067.rdualw (mgr.24569) 6941 : cluster [DBG] pgmap v5980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:12.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:11.839143+0000 mgr.smithi067.rdualw (mgr.24569) 6941 : cluster [DBG] pgmap v5980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:15.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:13.839770+0000 mgr.smithi067.rdualw (mgr.24569) 6942 : cluster [DBG] pgmap v5981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:15.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:13.839770+0000 mgr.smithi067.rdualw (mgr.24569) 6942 : cluster [DBG] pgmap v5981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:17.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:15.840600+0000 mgr.smithi067.rdualw (mgr.24569) 6943 : cluster [DBG] pgmap v5982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:48:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:15.840600+0000 mgr.smithi067.rdualw (mgr.24569) 6943 : cluster [DBG] pgmap v5982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:48:17.740 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:48:18.075 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:48:18.075 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 3m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:48:18.075 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 3m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:48:18.076 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 3m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:48:18.076 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 3m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:48:18.076 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 3m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:48:18.076 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 3m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:48:18.077 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 3m ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:48:18.077 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 3m ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:48:18.077 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 3m ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:48:18.077 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 3m ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:48:18.077 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 3m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:48:18.078 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 3m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:48:18.078 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 3m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:48:18.078 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 3m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:48:18.078 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 3m ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:48:18.078 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 3m ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:48:18.079 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 3m ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:48:18.079 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 3m ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:48:18.079 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 3m ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:48:18.079 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 3m ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:48:18.080 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 3m ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:48:18.080 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 3m ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:48:18.080 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 3m ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:48:18.417 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:48:18.418 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:48:18.418 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:48:18.418 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:48:18.419 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:48:18.419 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:48:18.419 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:48:18.419 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:48:18.420 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:48:18.420 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:48:18.420 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:48:18.420 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:48:18.421 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:48:18.421 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:48:18.421 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:48:18.421 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:48:18.422 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:48:18.422 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:48:18.422 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:48:19.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:48:17.728857+0000 mgr.smithi067.rdualw (mgr.24569) 6944 : audit [DBG] from='client.38770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:48:19.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:17.841180+0000 mgr.smithi067.rdualw (mgr.24569) 6945 : cluster [DBG] pgmap v5983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:19.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:48:18.418309+0000 mon.smithi061 (mon.0) 1537 : audit [DBG] from='client.? 172.21.15.61:0/1723728425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:48:19.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:48:17.728857+0000 mgr.smithi067.rdualw (mgr.24569) 6944 : audit [DBG] from='client.38770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:48:19.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:17.841180+0000 mgr.smithi067.rdualw (mgr.24569) 6945 : cluster [DBG] pgmap v5983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:19.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:48:18.418309+0000 mon.smithi061 (mon.0) 1537 : audit [DBG] from='client.? 172.21.15.61:0/1723728425' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:48:20.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:48:18.059500+0000 mgr.smithi067.rdualw (mgr.24569) 6946 : audit [DBG] from='client.38774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:48:20.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:48:18.059500+0000 mgr.smithi067.rdualw (mgr.24569) 6946 : audit [DBG] from='client.38774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:48:21.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:19.841815+0000 mgr.smithi067.rdualw (mgr.24569) 6947 : cluster [DBG] pgmap v5984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:21.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:19.841815+0000 mgr.smithi067.rdualw (mgr.24569) 6947 : cluster [DBG] pgmap v5984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:22.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:21.842737+0000 mgr.smithi067.rdualw (mgr.24569) 6948 : cluster [DBG] pgmap v5985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:22.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:21.842737+0000 mgr.smithi067.rdualw (mgr.24569) 6948 : cluster [DBG] pgmap v5985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:25.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:23.843314+0000 mgr.smithi067.rdualw (mgr.24569) 6949 : cluster [DBG] pgmap v5986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:25.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:23.843314+0000 mgr.smithi067.rdualw (mgr.24569) 6949 : cluster [DBG] pgmap v5986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:27.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:25.844170+0000 mgr.smithi067.rdualw (mgr.24569) 6950 : cluster [DBG] pgmap v5987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:48:27.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:25.844170+0000 mgr.smithi067.rdualw (mgr.24569) 6950 : cluster [DBG] pgmap v5987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:48:29.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:27.844827+0000 mgr.smithi067.rdualw (mgr.24569) 6951 : cluster [DBG] pgmap v5988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:29.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:27.844827+0000 mgr.smithi067.rdualw (mgr.24569) 6951 : cluster [DBG] pgmap v5988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:31.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:29.845495+0000 mgr.smithi067.rdualw (mgr.24569) 6952 : cluster [DBG] pgmap v5989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:31.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:29.845495+0000 mgr.smithi067.rdualw (mgr.24569) 6952 : cluster [DBG] pgmap v5989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:32.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:31.846323+0000 mgr.smithi067.rdualw (mgr.24569) 6953 : cluster [DBG] pgmap v5990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:32.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:31.846323+0000 mgr.smithi067.rdualw (mgr.24569) 6953 : cluster [DBG] pgmap v5990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:33.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:48:33.054752+0000 mon.smithi067 (mon.1) 1067 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:48:33.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:48:33.056243+0000 mon.smithi067 (mon.1) 1068 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:48:33.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:48:33.057216+0000 mon.smithi067 (mon.1) 1069 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:48:33.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:48:33.054752+0000 mon.smithi067 (mon.1) 1067 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:48:33.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:48:33.056243+0000 mon.smithi067 (mon.1) 1068 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:48:33.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:48:33.057216+0000 mon.smithi067 (mon.1) 1069 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:48:34.799 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:48:33.058125+0000 mgr.smithi067.rdualw (mgr.24569) 6954 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:48:34.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:48:33.471102+0000 mon.smithi061 (mon.0) 1538 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:48:34.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:48:33.476743+0000 mon.smithi061 (mon.0) 1539 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:48:34.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:33.846930+0000 mgr.smithi067.rdualw (mgr.24569) 6955 : cluster [DBG] pgmap v5991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:34.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:48:33.058125+0000 mgr.smithi067.rdualw (mgr.24569) 6954 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:48:34.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:48:33.471102+0000 mon.smithi061 (mon.0) 1538 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:48:34.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:48:33.476743+0000 mon.smithi061 (mon.0) 1539 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:48:34.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:33.846930+0000 mgr.smithi067.rdualw (mgr.24569) 6955 : cluster [DBG] pgmap v5991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:36.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:48:35.533207+0000 mon.smithi067 (mon.1) 1070 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:48:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:48:35.533490+0000 mon.smithi061 (mon.0) 1540 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:48:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:48:35.533490+0000 mon.smithi067 (mon.1) 1071 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:48:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:48:35.533809+0000 mon.smithi061 (mon.0) 1541 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:48:36.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:48:35.533207+0000 mon.smithi067 (mon.1) 1070 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:48:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:48:35.533490+0000 mon.smithi061 (mon.0) 1540 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:48:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:48:35.533490+0000 mon.smithi067 (mon.1) 1071 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:48:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:48:35.533809+0000 mon.smithi061 (mon.0) 1541 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:48:37.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:35.847825+0000 mgr.smithi067.rdualw (mgr.24569) 6956 : cluster [DBG] pgmap v5992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:48:37.063 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:35.847825+0000 mgr.smithi067.rdualw (mgr.24569) 6956 : cluster [DBG] pgmap v5992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:48:39.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:37.848367+0000 mgr.smithi067.rdualw (mgr.24569) 6957 : cluster [DBG] pgmap v5993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:39.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:37.848367+0000 mgr.smithi067.rdualw (mgr.24569) 6957 : cluster [DBG] pgmap v5993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:41.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:39.848955+0000 mgr.smithi067.rdualw (mgr.24569) 6958 : cluster [DBG] pgmap v5994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:41.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:39.848955+0000 mgr.smithi067.rdualw (mgr.24569) 6958 : cluster [DBG] pgmap v5994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:42.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:41.849901+0000 mgr.smithi067.rdualw (mgr.24569) 6959 : cluster [DBG] pgmap v5995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:42.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:41.849901+0000 mgr.smithi067.rdualw (mgr.24569) 6959 : cluster [DBG] pgmap v5995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:45.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:43.850657+0000 mgr.smithi067.rdualw (mgr.24569) 6960 : cluster [DBG] pgmap v5996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:45.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:43.850657+0000 mgr.smithi067.rdualw (mgr.24569) 6960 : cluster [DBG] pgmap v5996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:47.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:45.851487+0000 mgr.smithi067.rdualw (mgr.24569) 6961 : cluster [DBG] pgmap v5997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:48:47.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:45.851487+0000 mgr.smithi067.rdualw (mgr.24569) 6961 : cluster [DBG] pgmap v5997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:48:48.727 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:48:49.020 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:48:49.020 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 4m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:48:49.020 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 4m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:48:49.021 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 4m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:48:49.021 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 4m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:48:49.021 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 4m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:48:49.021 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 4m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:48:49.021 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 4m ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:48:49.022 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 4m ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:48:49.022 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 4m ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:48:49.022 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 4m ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:48:49.022 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 4m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:48:49.023 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 4m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:48:49.023 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 4m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:48:49.023 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 4m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:48:49.023 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 4m ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:48:49.024 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 4m ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:48:49.024 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 4m ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:48:49.024 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 4m ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:48:49.024 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 4m ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:48:49.024 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 4m ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:48:49.025 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 4m ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:48:49.025 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 4m ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:48:49.025 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 4m ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:48:49.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:47.852034+0000 mgr.smithi067.rdualw (mgr.24569) 6962 : cluster [DBG] pgmap v5998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:49.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:47.852034+0000 mgr.smithi067.rdualw (mgr.24569) 6962 : cluster [DBG] pgmap v5998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:49.361 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:48:49.361 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:48:49.361 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:48:49.361 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:48:49.362 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:48:49.362 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:48:49.362 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:48:49.362 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:48:49.363 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:48:49.363 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:48:49.363 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:48:49.363 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:48:49.363 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:48:49.364 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:48:49.364 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:48:49.364 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:48:49.364 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:48:49.364 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:48:49.365 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:48:50.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:48:48.715605+0000 mgr.smithi067.rdualw (mgr.24569) 6963 : audit [DBG] from='client.38782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:48:50.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:48:49.003966+0000 mgr.smithi067.rdualw (mgr.24569) 6964 : audit [DBG] from='client.38786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:48:50.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:48:49.361520+0000 mon.smithi061 (mon.0) 1542 : audit [DBG] from='client.? 172.21.15.61:0/2524710557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:48:50.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:48:48.715605+0000 mgr.smithi067.rdualw (mgr.24569) 6963 : audit [DBG] from='client.38782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:48:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:48:49.003966+0000 mgr.smithi067.rdualw (mgr.24569) 6964 : audit [DBG] from='client.38786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:48:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:48:49.361520+0000 mon.smithi061 (mon.0) 1542 : audit [DBG] from='client.? 172.21.15.61:0/2524710557' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:48:51.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:49.852778+0000 mgr.smithi067.rdualw (mgr.24569) 6965 : cluster [DBG] pgmap v5999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:51.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:49.852778+0000 mgr.smithi067.rdualw (mgr.24569) 6965 : cluster [DBG] pgmap v5999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:52.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:51.853676+0000 mgr.smithi067.rdualw (mgr.24569) 6966 : cluster [DBG] pgmap v6000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:52.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:51.853676+0000 mgr.smithi067.rdualw (mgr.24569) 6966 : cluster [DBG] pgmap v6000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:55.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:53.854448+0000 mgr.smithi067.rdualw (mgr.24569) 6967 : cluster [DBG] pgmap v6001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:55.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:53.854448+0000 mgr.smithi067.rdualw (mgr.24569) 6967 : cluster [DBG] pgmap v6001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:57.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:55.855219+0000 mgr.smithi067.rdualw (mgr.24569) 6968 : cluster [DBG] pgmap v6002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:48:57.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:55.855219+0000 mgr.smithi067.rdualw (mgr.24569) 6968 : cluster [DBG] pgmap v6002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:48:59.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:48:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:57.855726+0000 mgr.smithi067.rdualw (mgr.24569) 6969 : cluster [DBG] pgmap v6003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:48:59.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:48:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:57.855726+0000 mgr.smithi067.rdualw (mgr.24569) 6969 : cluster [DBG] pgmap v6003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:01.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:48:59.856262+0000 mgr.smithi067.rdualw (mgr.24569) 6970 : cluster [DBG] pgmap v6004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:01.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:48:59.856262+0000 mgr.smithi067.rdualw (mgr.24569) 6970 : cluster [DBG] pgmap v6004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:02.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:01.857193+0000 mgr.smithi067.rdualw (mgr.24569) 6971 : cluster [DBG] pgmap v6005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:02.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:01.857193+0000 mgr.smithi067.rdualw (mgr.24569) 6971 : cluster [DBG] pgmap v6005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:05.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:03.857806+0000 mgr.smithi067.rdualw (mgr.24569) 6972 : cluster [DBG] pgmap v6006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:05.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:03.857806+0000 mgr.smithi067.rdualw (mgr.24569) 6972 : cluster [DBG] pgmap v6006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:07.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:05.858767+0000 mgr.smithi067.rdualw (mgr.24569) 6973 : cluster [DBG] pgmap v6007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:49:07.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:05.858767+0000 mgr.smithi067.rdualw (mgr.24569) 6973 : cluster [DBG] pgmap v6007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:49:09.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:07.859318+0000 mgr.smithi067.rdualw (mgr.24569) 6974 : cluster [DBG] pgmap v6008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:09.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:07.859318+0000 mgr.smithi067.rdualw (mgr.24569) 6974 : cluster [DBG] pgmap v6008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:11.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:09.859977+0000 mgr.smithi067.rdualw (mgr.24569) 6975 : cluster [DBG] pgmap v6009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:11.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:09.859977+0000 mgr.smithi067.rdualw (mgr.24569) 6975 : cluster [DBG] pgmap v6009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:12.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:11.860810+0000 mgr.smithi067.rdualw (mgr.24569) 6976 : cluster [DBG] pgmap v6010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:12.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:11.860810+0000 mgr.smithi067.rdualw (mgr.24569) 6976 : cluster [DBG] pgmap v6010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:15.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:13.861613+0000 mgr.smithi067.rdualw (mgr.24569) 6977 : cluster [DBG] pgmap v6011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:15.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:13.861613+0000 mgr.smithi067.rdualw (mgr.24569) 6977 : cluster [DBG] pgmap v6011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:17.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:15.862584+0000 mgr.smithi067.rdualw (mgr.24569) 6978 : cluster [DBG] pgmap v6012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:49:17.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:15.862584+0000 mgr.smithi067.rdualw (mgr.24569) 6978 : cluster [DBG] pgmap v6012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:49:19.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:17.863206+0000 mgr.smithi067.rdualw (mgr.24569) 6979 : cluster [DBG] pgmap v6013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:19.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:17.863206+0000 mgr.smithi067.rdualw (mgr.24569) 6979 : cluster [DBG] pgmap v6013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:19.667 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:49:20.014 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:49:20.015 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 4m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:49:20.015 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 4m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:49:20.015 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 4m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:49:20.016 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 4m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:49:20.016 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 4m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:49:20.016 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 4m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:49:20.016 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 4m ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:49:20.016 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 4m ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:49:20.017 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 4m ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:49:20.017 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 4m ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:49:20.017 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 4m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:49:20.017 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 4m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:49:20.018 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 4m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:49:20.018 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 4m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:49:20.019 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 4m ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:49:20.019 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 4m ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:49:20.019 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 4m ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:49:20.019 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 4m ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:49:20.019 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 4m ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:49:20.020 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 4m ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:49:20.020 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 4m ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:49:20.020 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 4m ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:49:20.020 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 4m ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:49:20.379 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:49:20.380 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:49:20.380 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:49:20.380 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:49:20.380 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:49:20.381 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:49:20.381 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:49:20.381 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:49:20.381 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:49:20.382 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:49:20.382 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:49:20.382 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:49:20.383 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:49:20.383 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:49:20.383 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:49:20.383 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:49:20.384 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:49:20.384 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:49:20.384 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:49:21.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:49:19.655498+0000 mgr.smithi067.rdualw (mgr.24569) 6980 : audit [DBG] from='client.38794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:49:21.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:19.863773+0000 mgr.smithi067.rdualw (mgr.24569) 6981 : cluster [DBG] pgmap v6014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:49:19.999101+0000 mgr.smithi067.rdualw (mgr.24569) 6982 : audit [DBG] from='client.38798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:49:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:49:20.379892+0000 mon.smithi061 (mon.0) 1543 : audit [DBG] from='client.? 172.21.15.61:0/2479982253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:49:21.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:49:19.655498+0000 mgr.smithi067.rdualw (mgr.24569) 6980 : audit [DBG] from='client.38794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:49:21.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:19.863773+0000 mgr.smithi067.rdualw (mgr.24569) 6981 : cluster [DBG] pgmap v6014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:21.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:49:19.999101+0000 mgr.smithi067.rdualw (mgr.24569) 6982 : audit [DBG] from='client.38798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:49:21.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:49:20.379892+0000 mon.smithi061 (mon.0) 1543 : audit [DBG] from='client.? 172.21.15.61:0/2479982253' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:49:22.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:21.864611+0000 mgr.smithi067.rdualw (mgr.24569) 6983 : cluster [DBG] pgmap v6015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:22.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:21.864611+0000 mgr.smithi067.rdualw (mgr.24569) 6983 : cluster [DBG] pgmap v6015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:25.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:23.865231+0000 mgr.smithi067.rdualw (mgr.24569) 6984 : cluster [DBG] pgmap v6016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:25.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:23.865231+0000 mgr.smithi067.rdualw (mgr.24569) 6984 : cluster [DBG] pgmap v6016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:27.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:25.866086+0000 mgr.smithi067.rdualw (mgr.24569) 6985 : cluster [DBG] pgmap v6017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:49:27.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:25.866086+0000 mgr.smithi067.rdualw (mgr.24569) 6985 : cluster [DBG] pgmap v6017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:49:29.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:27.866665+0000 mgr.smithi067.rdualw (mgr.24569) 6986 : cluster [DBG] pgmap v6018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:29.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:27.866665+0000 mgr.smithi067.rdualw (mgr.24569) 6986 : cluster [DBG] pgmap v6018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:31.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:29.867312+0000 mgr.smithi067.rdualw (mgr.24569) 6987 : cluster [DBG] pgmap v6019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:31.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:29.867312+0000 mgr.smithi067.rdualw (mgr.24569) 6987 : cluster [DBG] pgmap v6019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:32.549 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:31.868272+0000 mgr.smithi067.rdualw (mgr.24569) 6988 : cluster [DBG] pgmap v6020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:31.868272+0000 mgr.smithi067.rdualw (mgr.24569) 6988 : cluster [DBG] pgmap v6020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:33.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:49:33.480419+0000 mon.smithi067 (mon.1) 1072 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:49:33.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:49:33.481875+0000 mon.smithi067 (mon.1) 1073 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:49:33.800 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:49:33.482873+0000 mon.smithi067 (mon.1) 1074 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:49:33.813 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:49:33.480419+0000 mon.smithi067 (mon.1) 1072 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:49:33.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:49:33.481875+0000 mon.smithi067 (mon.1) 1073 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:49:33.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:49:33.482873+0000 mon.smithi067 (mon.1) 1074 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:49:35.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:49:33.483806+0000 mgr.smithi067.rdualw (mgr.24569) 6989 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:49:35.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:33.868798+0000 mgr.smithi067.rdualw (mgr.24569) 6990 : cluster [DBG] pgmap v6021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:35.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:49:33.891877+0000 mon.smithi061 (mon.0) 1544 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:49:35.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:49:33.897750+0000 mon.smithi061 (mon.0) 1545 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:49:35.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:49:33.483806+0000 mgr.smithi067.rdualw (mgr.24569) 6989 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:49:35.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:33.868798+0000 mgr.smithi067.rdualw (mgr.24569) 6990 : cluster [DBG] pgmap v6021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:35.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:49:33.891877+0000 mon.smithi061 (mon.0) 1544 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:49:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:49:33.897750+0000 mon.smithi061 (mon.0) 1545 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:49:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:49:35.538672+0000 mon.smithi067 (mon.1) 1075 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:49:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:49:35.539045+0000 mon.smithi067 (mon.1) 1076 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:49:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:49:35.539055+0000 mon.smithi061 (mon.0) 1546 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:49:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:49:35.539311+0000 mon.smithi061 (mon.0) 1547 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:49:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:49:35.538672+0000 mon.smithi067 (mon.1) 1075 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:49:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:49:35.539045+0000 mon.smithi067 (mon.1) 1076 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:49:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:49:35.539055+0000 mon.smithi061 (mon.0) 1546 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:49:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:49:35.539311+0000 mon.smithi061 (mon.0) 1547 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:49:37.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:35.869780+0000 mgr.smithi067.rdualw (mgr.24569) 6991 : cluster [DBG] pgmap v6022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:49:37.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:35.869780+0000 mgr.smithi067.rdualw (mgr.24569) 6991 : cluster [DBG] pgmap v6022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:49:39.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:37.870477+0000 mgr.smithi067.rdualw (mgr.24569) 6992 : cluster [DBG] pgmap v6023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:39.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:37.870477+0000 mgr.smithi067.rdualw (mgr.24569) 6992 : cluster [DBG] pgmap v6023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:41.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:39.871225+0000 mgr.smithi067.rdualw (mgr.24569) 6993 : cluster [DBG] pgmap v6024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:41.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:39.871225+0000 mgr.smithi067.rdualw (mgr.24569) 6993 : cluster [DBG] pgmap v6024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:42.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:41.872169+0000 mgr.smithi067.rdualw (mgr.24569) 6994 : cluster [DBG] pgmap v6025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:42.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:41.872169+0000 mgr.smithi067.rdualw (mgr.24569) 6994 : cluster [DBG] pgmap v6025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:45.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:43.872854+0000 mgr.smithi067.rdualw (mgr.24569) 6995 : cluster [DBG] pgmap v6026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:45.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:43.872854+0000 mgr.smithi067.rdualw (mgr.24569) 6995 : cluster [DBG] pgmap v6026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:47.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:45.873692+0000 mgr.smithi067.rdualw (mgr.24569) 6996 : cluster [DBG] pgmap v6027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:49:47.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:45.873692+0000 mgr.smithi067.rdualw (mgr.24569) 6996 : cluster [DBG] pgmap v6027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:49:49.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:47.874222+0000 mgr.smithi067.rdualw (mgr.24569) 6997 : cluster [DBG] pgmap v6028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:49.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:47.874222+0000 mgr.smithi067.rdualw (mgr.24569) 6997 : cluster [DBG] pgmap v6028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:50.691 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:49:50.983 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:49:50.983 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 5m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:49:50.983 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 5m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:49:50.984 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 5m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:49:50.984 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 5m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:49:50.984 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 5m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:49:50.984 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 5m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:49:50.985 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 5m ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:49:50.985 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 5m ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:49:50.985 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 5m ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:49:50.985 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 5m ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:49:50.986 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 5m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:49:50.986 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 5m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:49:50.986 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 5m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:49:50.986 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 5m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:49:50.986 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 5m ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:49:50.987 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 5m ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:49:50.987 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 5m ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:49:50.987 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 5m ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:49:50.987 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 5m ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:49:50.988 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 5m ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:49:50.988 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 5m ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:49:50.988 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 5m ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:49:50.988 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 5m ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:49:51.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:49.874951+0000 mgr.smithi067.rdualw (mgr.24569) 6998 : cluster [DBG] pgmap v6029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:51.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:49.874951+0000 mgr.smithi067.rdualw (mgr.24569) 6998 : cluster [DBG] pgmap v6029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:51.323 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:49:51.323 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:49:51.323 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:49:51.323 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:49:51.324 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:49:51.324 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:49:51.324 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:49:51.324 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:49:51.325 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:49:51.325 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:49:51.325 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:49:51.325 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:49:51.325 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:49:51.326 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:49:51.326 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:49:51.326 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:49:51.326 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:49:51.327 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:49:51.327 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:49:52.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:49:50.677333+0000 mgr.smithi067.rdualw (mgr.24569) 6999 : audit [DBG] from='client.38806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:49:52.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:49:50.966489+0000 mgr.smithi067.rdualw (mgr.24569) 7000 : audit [DBG] from='client.38810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:49:52.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:49:51.323338+0000 mon.smithi061 (mon.0) 1548 : audit [DBG] from='client.? 172.21.15.61:0/1310672566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:49:52.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:49:50.677333+0000 mgr.smithi067.rdualw (mgr.24569) 6999 : audit [DBG] from='client.38806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:49:52.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:49:50.966489+0000 mgr.smithi067.rdualw (mgr.24569) 7000 : audit [DBG] from='client.38810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:49:52.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:49:51.323338+0000 mon.smithi061 (mon.0) 1548 : audit [DBG] from='client.? 172.21.15.61:0/1310672566' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:49:53.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:51.875920+0000 mgr.smithi067.rdualw (mgr.24569) 7001 : cluster [DBG] pgmap v6030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:53.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:51.875920+0000 mgr.smithi067.rdualw (mgr.24569) 7001 : cluster [DBG] pgmap v6030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:55.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:53.876656+0000 mgr.smithi067.rdualw (mgr.24569) 7002 : cluster [DBG] pgmap v6031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:55.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:53.876656+0000 mgr.smithi067.rdualw (mgr.24569) 7002 : cluster [DBG] pgmap v6031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:57.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:55.877395+0000 mgr.smithi067.rdualw (mgr.24569) 7003 : cluster [DBG] pgmap v6032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:49:57.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:55.877395+0000 mgr.smithi067.rdualw (mgr.24569) 7003 : cluster [DBG] pgmap v6032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:49:59.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:49:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:57.877913+0000 mgr.smithi067.rdualw (mgr.24569) 7004 : cluster [DBG] pgmap v6033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:49:59.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:49:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:57.877913+0000 mgr.smithi067.rdualw (mgr.24569) 7004 : cluster [DBG] pgmap v6033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:01.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:49:59.878745+0000 mgr.smithi067.rdualw (mgr.24569) 7005 : cluster [DBG] pgmap v6034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:01.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:00.000174+0000 mon.smithi061 (mon.0) 1549 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T18:50:01.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:49:59.878745+0000 mgr.smithi067.rdualw (mgr.24569) 7005 : cluster [DBG] pgmap v6034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:01.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:00.000174+0000 mon.smithi061 (mon.0) 1549 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T18:50:02.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:01.879778+0000 mgr.smithi067.rdualw (mgr.24569) 7006 : cluster [DBG] pgmap v6035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:02.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:01.879778+0000 mgr.smithi067.rdualw (mgr.24569) 7006 : cluster [DBG] pgmap v6035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:05.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:03.880342+0000 mgr.smithi067.rdualw (mgr.24569) 7007 : cluster [DBG] pgmap v6036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:05.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:03.880342+0000 mgr.smithi067.rdualw (mgr.24569) 7007 : cluster [DBG] pgmap v6036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:07.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:05.881174+0000 mgr.smithi067.rdualw (mgr.24569) 7008 : cluster [DBG] pgmap v6037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:50:07.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:05.881174+0000 mgr.smithi067.rdualw (mgr.24569) 7008 : cluster [DBG] pgmap v6037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:50:09.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:07.881741+0000 mgr.smithi067.rdualw (mgr.24569) 7009 : cluster [DBG] pgmap v6038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:09.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:07.881741+0000 mgr.smithi067.rdualw (mgr.24569) 7009 : cluster [DBG] pgmap v6038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:11.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:09.882289+0000 mgr.smithi067.rdualw (mgr.24569) 7010 : cluster [DBG] pgmap v6039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:11.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:09.882289+0000 mgr.smithi067.rdualw (mgr.24569) 7010 : cluster [DBG] pgmap v6039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:12.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:11.883334+0000 mgr.smithi067.rdualw (mgr.24569) 7011 : cluster [DBG] pgmap v6040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:12.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:11.883334+0000 mgr.smithi067.rdualw (mgr.24569) 7011 : cluster [DBG] pgmap v6040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:15.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:13.884123+0000 mgr.smithi067.rdualw (mgr.24569) 7012 : cluster [DBG] pgmap v6041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:15.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:13.884123+0000 mgr.smithi067.rdualw (mgr.24569) 7012 : cluster [DBG] pgmap v6041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:17.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:15.884977+0000 mgr.smithi067.rdualw (mgr.24569) 7013 : cluster [DBG] pgmap v6042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:50:17.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:15.884977+0000 mgr.smithi067.rdualw (mgr.24569) 7013 : cluster [DBG] pgmap v6042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:50:19.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:17.885513+0000 mgr.smithi067.rdualw (mgr.24569) 7014 : cluster [DBG] pgmap v6043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:19.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:17.885513+0000 mgr.smithi067.rdualw (mgr.24569) 7014 : cluster [DBG] pgmap v6043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:21.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:19.886237+0000 mgr.smithi067.rdualw (mgr.24569) 7015 : cluster [DBG] pgmap v6044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:21.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:19.886237+0000 mgr.smithi067.rdualw (mgr.24569) 7015 : cluster [DBG] pgmap v6044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:21.631 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:50:21.930 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:50:21.931 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 5m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:50:21.931 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 5m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:50:21.931 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 5m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:50:21.931 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 5m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:50:21.932 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 5m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:50:21.932 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 5m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:50:21.932 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 5m ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:50:21.932 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 5m ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:50:21.933 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 5m ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:50:21.933 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 5m ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:50:21.933 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 5m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:50:21.933 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 5m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:50:21.934 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 5m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:50:21.934 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 5m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:50:21.934 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 5m ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:50:21.934 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 5m ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:50:21.935 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 5m ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:50:21.935 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 5m ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:50:21.935 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 5m ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:50:21.935 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 5m ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:50:21.936 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 5m ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:50:21.936 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 5m ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:50:21.936 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 5m ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:50:22.270 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:50:22.271 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:50:22.271 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:50:22.271 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:50:22.272 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:50:22.272 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:50:22.272 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:50:22.272 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:50:22.272 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:50:22.273 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:50:22.273 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:50:22.273 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:50:22.273 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:50:22.273 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:50:22.274 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:50:22.274 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:50:22.274 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:50:22.274 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:50:22.275 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:50:22.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:50:21.618698+0000 mgr.smithi067.rdualw (mgr.24569) 7016 : audit [DBG] from='client.38818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:50:22.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:21.887142+0000 mgr.smithi067.rdualw (mgr.24569) 7017 : cluster [DBG] pgmap v6045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:22.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:50:21.914362+0000 mgr.smithi067.rdualw (mgr.24569) 7018 : audit [DBG] from='client.38822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:50:22.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:50:21.618698+0000 mgr.smithi067.rdualw (mgr.24569) 7016 : audit [DBG] from='client.38818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:50:22.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:21.887142+0000 mgr.smithi067.rdualw (mgr.24569) 7017 : cluster [DBG] pgmap v6045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:22.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:50:21.914362+0000 mgr.smithi067.rdualw (mgr.24569) 7018 : audit [DBG] from='client.38822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:50:23.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:50:22.270838+0000 mon.smithi061 (mon.0) 1550 : audit [DBG] from='client.? 172.21.15.61:0/1574798262' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:50:23.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:50:22.270838+0000 mon.smithi061 (mon.0) 1550 : audit [DBG] from='client.? 172.21.15.61:0/1574798262' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:50:24.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:23.887750+0000 mgr.smithi067.rdualw (mgr.24569) 7019 : cluster [DBG] pgmap v6046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:24.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:23.887750+0000 mgr.smithi067.rdualw (mgr.24569) 7019 : cluster [DBG] pgmap v6046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:27.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:25.888509+0000 mgr.smithi067.rdualw (mgr.24569) 7020 : cluster [DBG] pgmap v6047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:50:27.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:25.888509+0000 mgr.smithi067.rdualw (mgr.24569) 7020 : cluster [DBG] pgmap v6047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:50:29.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:27.889104+0000 mgr.smithi067.rdualw (mgr.24569) 7021 : cluster [DBG] pgmap v6048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:29.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:27.889104+0000 mgr.smithi067.rdualw (mgr.24569) 7021 : cluster [DBG] pgmap v6048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:31.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:29.889881+0000 mgr.smithi067.rdualw (mgr.24569) 7022 : cluster [DBG] pgmap v6049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:31.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:29.889881+0000 mgr.smithi067.rdualw (mgr.24569) 7022 : cluster [DBG] pgmap v6049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:32.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:31.890725+0000 mgr.smithi067.rdualw (mgr.24569) 7023 : cluster [DBG] pgmap v6050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:32.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:31.890725+0000 mgr.smithi067.rdualw (mgr.24569) 7023 : cluster [DBG] pgmap v6050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:34.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:50:33.901894+0000 mon.smithi067 (mon.1) 1077 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:50:34.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:50:33.903390+0000 mon.smithi067 (mon.1) 1078 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:50:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:50:33.904327+0000 mon.smithi067 (mon.1) 1079 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:50:34.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:50:33.901894+0000 mon.smithi067 (mon.1) 1077 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:50:34.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:50:33.903390+0000 mon.smithi067 (mon.1) 1078 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:50:34.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:50:33.904327+0000 mon.smithi067 (mon.1) 1079 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:50:35.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:33.891344+0000 mgr.smithi067.rdualw (mgr.24569) 7024 : cluster [DBG] pgmap v6051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:35.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:50:33.905171+0000 mgr.smithi067.rdualw (mgr.24569) 7025 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:50:35.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:50:34.322267+0000 mon.smithi061 (mon.0) 1551 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:50:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:50:34.327763+0000 mon.smithi061 (mon.0) 1552 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:50:35.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:33.891344+0000 mgr.smithi067.rdualw (mgr.24569) 7024 : cluster [DBG] pgmap v6051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:50:33.905171+0000 mgr.smithi067.rdualw (mgr.24569) 7025 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:50:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:50:34.322267+0000 mon.smithi061 (mon.0) 1551 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:50:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:50:34.327763+0000 mon.smithi061 (mon.0) 1552 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:50:36.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:50:35.544520+0000 mon.smithi067 (mon.1) 1080 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:50:36.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:50:35.544799+0000 mon.smithi067 (mon.1) 1081 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:50:36.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:50:35.544940+0000 mon.smithi061 (mon.0) 1553 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:50:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:50:35.545175+0000 mon.smithi061 (mon.0) 1554 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:50:36.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:50:35.544520+0000 mon.smithi067 (mon.1) 1080 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:50:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:50:35.544799+0000 mon.smithi067 (mon.1) 1081 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:50:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:50:35.544940+0000 mon.smithi061 (mon.0) 1553 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:50:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:50:35.545175+0000 mon.smithi061 (mon.0) 1554 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:50:37.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:35.892089+0000 mgr.smithi067.rdualw (mgr.24569) 7026 : cluster [DBG] pgmap v6052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:50:37.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:35.892089+0000 mgr.smithi067.rdualw (mgr.24569) 7026 : cluster [DBG] pgmap v6052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:50:39.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:37.892810+0000 mgr.smithi067.rdualw (mgr.24569) 7027 : cluster [DBG] pgmap v6053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:39.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:37.892810+0000 mgr.smithi067.rdualw (mgr.24569) 7027 : cluster [DBG] pgmap v6053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:41.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:39.893545+0000 mgr.smithi067.rdualw (mgr.24569) 7028 : cluster [DBG] pgmap v6054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:41.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:39.893545+0000 mgr.smithi067.rdualw (mgr.24569) 7028 : cluster [DBG] pgmap v6054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:42.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:41.894433+0000 mgr.smithi067.rdualw (mgr.24569) 7029 : cluster [DBG] pgmap v6055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:42.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:41.894433+0000 mgr.smithi067.rdualw (mgr.24569) 7029 : cluster [DBG] pgmap v6055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:45.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:43.895160+0000 mgr.smithi067.rdualw (mgr.24569) 7030 : cluster [DBG] pgmap v6056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:45.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:43.895160+0000 mgr.smithi067.rdualw (mgr.24569) 7030 : cluster [DBG] pgmap v6056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:45.896065+0000 mgr.smithi067.rdualw (mgr.24569) 7031 : cluster [DBG] pgmap v6057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:50:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:45.896065+0000 mgr.smithi067.rdualw (mgr.24569) 7031 : cluster [DBG] pgmap v6057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:50:49.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:47.896682+0000 mgr.smithi067.rdualw (mgr.24569) 7032 : cluster [DBG] pgmap v6058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:47.896682+0000 mgr.smithi067.rdualw (mgr.24569) 7032 : cluster [DBG] pgmap v6058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:51.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:49.897449+0000 mgr.smithi067.rdualw (mgr.24569) 7033 : cluster [DBG] pgmap v6059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:51.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:49.897449+0000 mgr.smithi067.rdualw (mgr.24569) 7033 : cluster [DBG] pgmap v6059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:52.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:51.898423+0000 mgr.smithi067.rdualw (mgr.24569) 7034 : cluster [DBG] pgmap v6060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:52.563 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:51.898423+0000 mgr.smithi067.rdualw (mgr.24569) 7034 : cluster [DBG] pgmap v6060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:52.595 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:50:52.887 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:50:52.887 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 6m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:50:52.888 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 6m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:50:52.888 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 6m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:50:52.888 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 6m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:50:52.888 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 6m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:50:52.889 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 6m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:50:52.889 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 6m ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:50:52.889 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 6m ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:50:52.889 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 6m ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:50:52.889 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 6m ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:50:52.890 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 6m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:50:52.890 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 6m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:50:52.890 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 6m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:50:52.890 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 6m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:50:52.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 6m ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:50:52.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 6m ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:50:52.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 6m ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:50:52.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 6m ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:50:52.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 6m ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:50:52.892 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 6m ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:50:52.892 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 6m ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:50:52.892 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 6m ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:50:52.892 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 6m ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:50:53.238 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:50:53.238 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:50:53.239 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:50:53.239 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:50:53.239 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:50:53.239 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:50:53.239 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:50:53.240 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:50:53.240 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:50:53.240 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:50:53.240 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:50:53.241 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:50:53.241 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:50:53.241 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:50:53.241 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:50:53.242 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:50:53.242 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:50:53.242 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:50:53.242 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:50:53.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:50:52.583382+0000 mgr.smithi067.rdualw (mgr.24569) 7035 : audit [DBG] from='client.38830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:50:53.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:50:52.871789+0000 mgr.smithi067.rdualw (mgr.24569) 7036 : audit [DBG] from='client.38834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:50:53.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:50:52.583382+0000 mgr.smithi067.rdualw (mgr.24569) 7035 : audit [DBG] from='client.38830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:50:53.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:50:52.871789+0000 mgr.smithi067.rdualw (mgr.24569) 7036 : audit [DBG] from='client.38834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:50:54.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:50:53.238218+0000 mon.smithi061 (mon.0) 1555 : audit [DBG] from='client.? 172.21.15.61:0/1055193925' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:50:54.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:53.899079+0000 mgr.smithi067.rdualw (mgr.24569) 7037 : cluster [DBG] pgmap v6061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:54.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:50:53.238218+0000 mon.smithi061 (mon.0) 1555 : audit [DBG] from='client.? 172.21.15.61:0/1055193925' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:50:54.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:53.899079+0000 mgr.smithi067.rdualw (mgr.24569) 7037 : cluster [DBG] pgmap v6061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:57.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:55.899964+0000 mgr.smithi067.rdualw (mgr.24569) 7038 : cluster [DBG] pgmap v6062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:50:57.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:55.899964+0000 mgr.smithi067.rdualw (mgr.24569) 7038 : cluster [DBG] pgmap v6062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:50:59.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:50:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:57.900561+0000 mgr.smithi067.rdualw (mgr.24569) 7039 : cluster [DBG] pgmap v6063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:50:59.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:50:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:57.900561+0000 mgr.smithi067.rdualw (mgr.24569) 7039 : cluster [DBG] pgmap v6063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:01.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:50:59.901344+0000 mgr.smithi067.rdualw (mgr.24569) 7040 : cluster [DBG] pgmap v6064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:01.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:50:59.901344+0000 mgr.smithi067.rdualw (mgr.24569) 7040 : cluster [DBG] pgmap v6064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:02.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:01.902258+0000 mgr.smithi067.rdualw (mgr.24569) 7041 : cluster [DBG] pgmap v6065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:02.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:01.902258+0000 mgr.smithi067.rdualw (mgr.24569) 7041 : cluster [DBG] pgmap v6065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:05.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:03.902863+0000 mgr.smithi067.rdualw (mgr.24569) 7042 : cluster [DBG] pgmap v6066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:05.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:03.902863+0000 mgr.smithi067.rdualw (mgr.24569) 7042 : cluster [DBG] pgmap v6066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:07.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:05.903785+0000 mgr.smithi067.rdualw (mgr.24569) 7043 : cluster [DBG] pgmap v6067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:51:07.313 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:05.903785+0000 mgr.smithi067.rdualw (mgr.24569) 7043 : cluster [DBG] pgmap v6067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:51:09.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:07.904386+0000 mgr.smithi067.rdualw (mgr.24569) 7044 : cluster [DBG] pgmap v6068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:09.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:07.904386+0000 mgr.smithi067.rdualw (mgr.24569) 7044 : cluster [DBG] pgmap v6068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:11.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:09.905003+0000 mgr.smithi067.rdualw (mgr.24569) 7045 : cluster [DBG] pgmap v6069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:11.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:09.905003+0000 mgr.smithi067.rdualw (mgr.24569) 7045 : cluster [DBG] pgmap v6069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:12.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:11.905900+0000 mgr.smithi067.rdualw (mgr.24569) 7046 : cluster [DBG] pgmap v6070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:12.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:11.905900+0000 mgr.smithi067.rdualw (mgr.24569) 7046 : cluster [DBG] pgmap v6070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:15.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:13.906620+0000 mgr.smithi067.rdualw (mgr.24569) 7047 : cluster [DBG] pgmap v6071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:15.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:13.906620+0000 mgr.smithi067.rdualw (mgr.24569) 7047 : cluster [DBG] pgmap v6071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:17.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:15.907481+0000 mgr.smithi067.rdualw (mgr.24569) 7048 : cluster [DBG] pgmap v6072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:51:17.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:15.907481+0000 mgr.smithi067.rdualw (mgr.24569) 7048 : cluster [DBG] pgmap v6072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:51:19.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:17.907918+0000 mgr.smithi067.rdualw (mgr.24569) 7049 : cluster [DBG] pgmap v6073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:19.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:17.907918+0000 mgr.smithi067.rdualw (mgr.24569) 7049 : cluster [DBG] pgmap v6073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:21.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:19.908658+0000 mgr.smithi067.rdualw (mgr.24569) 7050 : cluster [DBG] pgmap v6074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:21.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:19.908658+0000 mgr.smithi067.rdualw (mgr.24569) 7050 : cluster [DBG] pgmap v6074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:22.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:21.909653+0000 mgr.smithi067.rdualw (mgr.24569) 7051 : cluster [DBG] pgmap v6075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:22.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:21.909653+0000 mgr.smithi067.rdualw (mgr.24569) 7051 : cluster [DBG] pgmap v6075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:23.547 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:51:23.837 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:51:23.838 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 6m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:51:23.838 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 6m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:51:23.838 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 6m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:51:23.838 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 6m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:51:23.839 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 6m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:51:23.839 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 6m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:51:23.839 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 6m ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:51:23.839 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 6m ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:51:23.840 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 6m ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:51:23.840 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 6m ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:51:23.840 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 6m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:51:23.840 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 6m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:51:23.841 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 6m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:51:23.841 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 6m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:51:23.841 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 6m ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:51:23.841 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 6m ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:51:23.841 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 6m ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:51:23.842 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 6m ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:51:23.842 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 6m ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:51:23.842 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 6m ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:51:23.842 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 6m ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:51:23.843 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 6m ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:51:23.843 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 6m ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:51:24.183 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:51:24.184 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:51:24.184 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:51:24.184 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:51:24.185 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:51:24.185 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:51:24.185 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:51:24.185 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:51:24.186 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:51:24.186 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:51:24.186 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:51:24.186 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:51:24.187 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:51:24.187 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:51:24.187 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:51:24.187 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:51:24.188 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:51:24.188 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:51:24.188 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:51:25.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:51:23.535374+0000 mgr.smithi067.rdualw (mgr.24569) 7052 : audit [DBG] from='client.38842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:51:25.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:51:23.821796+0000 mgr.smithi067.rdualw (mgr.24569) 7053 : audit [DBG] from='client.38846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:51:25.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:23.910319+0000 mgr.smithi067.rdualw (mgr.24569) 7054 : cluster [DBG] pgmap v6076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:51:24.183687+0000 mon.smithi061 (mon.0) 1556 : audit [DBG] from='client.? 172.21.15.61:0/435003617' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:51:25.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:51:23.535374+0000 mgr.smithi067.rdualw (mgr.24569) 7052 : audit [DBG] from='client.38842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:51:25.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:51:23.821796+0000 mgr.smithi067.rdualw (mgr.24569) 7053 : audit [DBG] from='client.38846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:51:25.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:23.910319+0000 mgr.smithi067.rdualw (mgr.24569) 7054 : cluster [DBG] pgmap v6076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:25.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:51:24.183687+0000 mon.smithi061 (mon.0) 1556 : audit [DBG] from='client.? 172.21.15.61:0/435003617' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:51:27.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:25.911140+0000 mgr.smithi067.rdualw (mgr.24569) 7055 : cluster [DBG] pgmap v6077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:51:27.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:25.911140+0000 mgr.smithi067.rdualw (mgr.24569) 7055 : cluster [DBG] pgmap v6077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:51:29.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:27.911654+0000 mgr.smithi067.rdualw (mgr.24569) 7056 : cluster [DBG] pgmap v6078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:29.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:27.911654+0000 mgr.smithi067.rdualw (mgr.24569) 7056 : cluster [DBG] pgmap v6078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:31.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:29.912407+0000 mgr.smithi067.rdualw (mgr.24569) 7057 : cluster [DBG] pgmap v6079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:31.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:29.912407+0000 mgr.smithi067.rdualw (mgr.24569) 7057 : cluster [DBG] pgmap v6079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:32.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:31.913257+0000 mgr.smithi067.rdualw (mgr.24569) 7058 : cluster [DBG] pgmap v6080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:31.913257+0000 mgr.smithi067.rdualw (mgr.24569) 7058 : cluster [DBG] pgmap v6080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:35.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:33.913853+0000 mgr.smithi067.rdualw (mgr.24569) 7059 : cluster [DBG] pgmap v6081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:51:34.331134+0000 mon.smithi067 (mon.1) 1082 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:51:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:51:34.332671+0000 mon.smithi067 (mon.1) 1083 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:51:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:51:34.333671+0000 mon.smithi067 (mon.1) 1084 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:51:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:51:34.756787+0000 mon.smithi061 (mon.0) 1557 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:51:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:51:34.762297+0000 mon.smithi061 (mon.0) 1558 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:51:35.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:33.913853+0000 mgr.smithi067.rdualw (mgr.24569) 7059 : cluster [DBG] pgmap v6081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:35.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:51:34.331134+0000 mon.smithi067 (mon.1) 1082 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:51:35.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:51:34.332671+0000 mon.smithi067 (mon.1) 1083 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:51:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:51:34.333671+0000 mon.smithi067 (mon.1) 1084 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:51:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:51:34.756787+0000 mon.smithi061 (mon.0) 1557 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:51:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:51:34.762297+0000 mon.smithi061 (mon.0) 1558 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:51:36.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:51:34.334579+0000 mgr.smithi067.rdualw (mgr.24569) 7060 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:51:36.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:51:35.550071+0000 mon.smithi067 (mon.1) 1085 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:51:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:51:35.550444+0000 mon.smithi067 (mon.1) 1086 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:51:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:51:35.550452+0000 mon.smithi061 (mon.0) 1559 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:51:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:51:35.550843+0000 mon.smithi061 (mon.0) 1560 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:51:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:51:34.334579+0000 mgr.smithi067.rdualw (mgr.24569) 7060 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:51:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:51:35.550071+0000 mon.smithi067 (mon.1) 1085 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:51:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:51:35.550444+0000 mon.smithi067 (mon.1) 1086 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:51:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:51:35.550452+0000 mon.smithi061 (mon.0) 1559 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:51:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:51:35.550843+0000 mon.smithi061 (mon.0) 1560 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:51:37.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:35.914610+0000 mgr.smithi067.rdualw (mgr.24569) 7061 : cluster [DBG] pgmap v6082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:51:37.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:35.914610+0000 mgr.smithi067.rdualw (mgr.24569) 7061 : cluster [DBG] pgmap v6082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:51:39.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:37.915105+0000 mgr.smithi067.rdualw (mgr.24569) 7062 : cluster [DBG] pgmap v6083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:39.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:37.915105+0000 mgr.smithi067.rdualw (mgr.24569) 7062 : cluster [DBG] pgmap v6083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:41.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:39.915775+0000 mgr.smithi067.rdualw (mgr.24569) 7063 : cluster [DBG] pgmap v6084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:39.915775+0000 mgr.smithi067.rdualw (mgr.24569) 7063 : cluster [DBG] pgmap v6084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:42.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:41.916593+0000 mgr.smithi067.rdualw (mgr.24569) 7064 : cluster [DBG] pgmap v6085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:42.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:41.916593+0000 mgr.smithi067.rdualw (mgr.24569) 7064 : cluster [DBG] pgmap v6085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:45.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:43.917107+0000 mgr.smithi067.rdualw (mgr.24569) 7065 : cluster [DBG] pgmap v6086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:45.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:43.917107+0000 mgr.smithi067.rdualw (mgr.24569) 7065 : cluster [DBG] pgmap v6086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:47.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:45.917937+0000 mgr.smithi067.rdualw (mgr.24569) 7066 : cluster [DBG] pgmap v6087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:51:47.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:45.917937+0000 mgr.smithi067.rdualw (mgr.24569) 7066 : cluster [DBG] pgmap v6087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:51:49.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:47.918480+0000 mgr.smithi067.rdualw (mgr.24569) 7067 : cluster [DBG] pgmap v6088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:49.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:47.918480+0000 mgr.smithi067.rdualw (mgr.24569) 7067 : cluster [DBG] pgmap v6088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:51.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:49.919143+0000 mgr.smithi067.rdualw (mgr.24569) 7068 : cluster [DBG] pgmap v6089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:51.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:49.919143+0000 mgr.smithi067.rdualw (mgr.24569) 7068 : cluster [DBG] pgmap v6089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:52.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:51.920209+0000 mgr.smithi067.rdualw (mgr.24569) 7069 : cluster [DBG] pgmap v6090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:52.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:51.920209+0000 mgr.smithi067.rdualw (mgr.24569) 7069 : cluster [DBG] pgmap v6090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:54.494 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:51:54.785 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:51:54.786 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 7m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:51:54.786 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 7m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:51:54.786 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 7m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:51:54.787 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 7m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:51:54.787 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 7m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:51:54.787 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 7m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:51:54.787 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 7m ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:51:54.787 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 7m ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:51:54.788 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 7m ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:51:54.788 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 7m ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:51:54.788 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 7m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:51:54.788 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 7m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:51:54.789 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 7m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:51:54.789 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 7m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:51:54.789 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 7m ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:51:54.789 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 7m ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:51:54.789 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 7m ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:51:54.790 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 7m ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:51:54.790 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 7m ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:51:54.790 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 7m ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:51:54.790 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 7m ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:51:54.791 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 7m ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:51:54.791 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 7m ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:51:55.133 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:51:55.133 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:51:55.133 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:51:55.133 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:51:55.134 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:51:55.134 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:51:55.135 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:51:55.135 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:51:55.135 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:51:55.135 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:51:55.136 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:51:55.136 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:51:55.136 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:51:55.136 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:51:55.136 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:51:55.137 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:51:55.137 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:51:55.137 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:51:55.137 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:51:55.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:53.920926+0000 mgr.smithi067.rdualw (mgr.24569) 7070 : cluster [DBG] pgmap v6091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:55.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:53.920926+0000 mgr.smithi067.rdualw (mgr.24569) 7070 : cluster [DBG] pgmap v6091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:56.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:51:54.482228+0000 mgr.smithi067.rdualw (mgr.24569) 7071 : audit [DBG] from='client.38854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:51:56.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:51:54.770069+0000 mgr.smithi067.rdualw (mgr.24569) 7072 : audit [DBG] from='client.38858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:51:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:51:55.132097+0000 mon.smithi061 (mon.0) 1561 : audit [DBG] from='client.? 172.21.15.61:0/1156495464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:51:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:51:54.482228+0000 mgr.smithi067.rdualw (mgr.24569) 7071 : audit [DBG] from='client.38854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:51:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:51:54.770069+0000 mgr.smithi067.rdualw (mgr.24569) 7072 : audit [DBG] from='client.38858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:51:56.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:51:55.132097+0000 mon.smithi061 (mon.0) 1561 : audit [DBG] from='client.? 172.21.15.61:0/1156495464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:51:57.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:55.921866+0000 mgr.smithi067.rdualw (mgr.24569) 7073 : cluster [DBG] pgmap v6092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:51:57.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:55.921866+0000 mgr.smithi067.rdualw (mgr.24569) 7073 : cluster [DBG] pgmap v6092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:51:59.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:51:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:57.922577+0000 mgr.smithi067.rdualw (mgr.24569) 7074 : cluster [DBG] pgmap v6093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:51:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:51:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:57.922577+0000 mgr.smithi067.rdualw (mgr.24569) 7074 : cluster [DBG] pgmap v6093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:01.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:51:59.923362+0000 mgr.smithi067.rdualw (mgr.24569) 7075 : cluster [DBG] pgmap v6094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:01.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:51:59.923362+0000 mgr.smithi067.rdualw (mgr.24569) 7075 : cluster [DBG] pgmap v6094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:02.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:01.924402+0000 mgr.smithi067.rdualw (mgr.24569) 7076 : cluster [DBG] pgmap v6095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:02.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:01.924402+0000 mgr.smithi067.rdualw (mgr.24569) 7076 : cluster [DBG] pgmap v6095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:05.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:03.924974+0000 mgr.smithi067.rdualw (mgr.24569) 7077 : cluster [DBG] pgmap v6096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:05.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:03.924974+0000 mgr.smithi067.rdualw (mgr.24569) 7077 : cluster [DBG] pgmap v6096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:07.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:05.925881+0000 mgr.smithi067.rdualw (mgr.24569) 7078 : cluster [DBG] pgmap v6097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:52:07.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:05.925881+0000 mgr.smithi067.rdualw (mgr.24569) 7078 : cluster [DBG] pgmap v6097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:52:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:07.926470+0000 mgr.smithi067.rdualw (mgr.24569) 7079 : cluster [DBG] pgmap v6098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:09.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:07.926470+0000 mgr.smithi067.rdualw (mgr.24569) 7079 : cluster [DBG] pgmap v6098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:11.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:09.927097+0000 mgr.smithi067.rdualw (mgr.24569) 7080 : cluster [DBG] pgmap v6099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:11.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:09.927097+0000 mgr.smithi067.rdualw (mgr.24569) 7080 : cluster [DBG] pgmap v6099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:12.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:11.928138+0000 mgr.smithi067.rdualw (mgr.24569) 7081 : cluster [DBG] pgmap v6100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:12.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:11.928138+0000 mgr.smithi067.rdualw (mgr.24569) 7081 : cluster [DBG] pgmap v6100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:15.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:13.928904+0000 mgr.smithi067.rdualw (mgr.24569) 7082 : cluster [DBG] pgmap v6101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:15.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:13.928904+0000 mgr.smithi067.rdualw (mgr.24569) 7082 : cluster [DBG] pgmap v6101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:17.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:15.929794+0000 mgr.smithi067.rdualw (mgr.24569) 7083 : cluster [DBG] pgmap v6102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:52:17.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:15.929794+0000 mgr.smithi067.rdualw (mgr.24569) 7083 : cluster [DBG] pgmap v6102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:52:19.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:17.930315+0000 mgr.smithi067.rdualw (mgr.24569) 7084 : cluster [DBG] pgmap v6103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:19.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:17.930315+0000 mgr.smithi067.rdualw (mgr.24569) 7084 : cluster [DBG] pgmap v6103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:21.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:19.930956+0000 mgr.smithi067.rdualw (mgr.24569) 7085 : cluster [DBG] pgmap v6104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:21.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:19.930956+0000 mgr.smithi067.rdualw (mgr.24569) 7085 : cluster [DBG] pgmap v6104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:22.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:21.931998+0000 mgr.smithi067.rdualw (mgr.24569) 7086 : cluster [DBG] pgmap v6105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:22.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:21.931998+0000 mgr.smithi067.rdualw (mgr.24569) 7086 : cluster [DBG] pgmap v6105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:25.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:23.932735+0000 mgr.smithi067.rdualw (mgr.24569) 7087 : cluster [DBG] pgmap v6106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:25.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:23.932735+0000 mgr.smithi067.rdualw (mgr.24569) 7087 : cluster [DBG] pgmap v6106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:25.444 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:52:25.756 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:52:25.756 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 7m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:52:25.757 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 7m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:52:25.757 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 7m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:52:25.757 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 7m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:52:25.757 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 7m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:52:25.757 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 7m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:52:25.758 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 7m ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:52:25.758 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 7m ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:52:25.758 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 7m ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:52:25.758 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 7m ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:52:25.758 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 7m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:52:25.759 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 7m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:52:25.759 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 7m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:52:25.759 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 7m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:52:25.759 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 7m ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:52:25.760 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 7m ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:52:25.760 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 7m ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:52:25.760 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 7m ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:52:25.760 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 7m ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:52:25.760 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 7m ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:52:25.761 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 7m ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:52:25.761 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 7m ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:52:25.761 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 7m ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:52:26.097 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:52:26.097 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:52:26.098 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:52:26.098 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:52:26.098 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:52:26.098 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:52:26.099 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:52:26.099 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:52:26.099 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:52:26.099 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:52:26.100 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:52:26.100 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:52:26.100 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:52:26.100 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:52:26.101 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:52:26.101 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:52:26.101 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:52:26.101 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:52:26.101 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:52:27.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:52:25.431794+0000 mgr.smithi067.rdualw (mgr.24569) 7088 : audit [DBG] from='client.38866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:52:27.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:52:25.740495+0000 mgr.smithi067.rdualw (mgr.24569) 7089 : audit [DBG] from='client.38870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:52:27.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:25.933679+0000 mgr.smithi067.rdualw (mgr.24569) 7090 : cluster [DBG] pgmap v6107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:52:27.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:52:26.097394+0000 mon.smithi061 (mon.0) 1562 : audit [DBG] from='client.? 172.21.15.61:0/3803492437' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:52:27.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:52:25.431794+0000 mgr.smithi067.rdualw (mgr.24569) 7088 : audit [DBG] from='client.38866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:52:27.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:52:25.740495+0000 mgr.smithi067.rdualw (mgr.24569) 7089 : audit [DBG] from='client.38870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:52:27.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:25.933679+0000 mgr.smithi067.rdualw (mgr.24569) 7090 : cluster [DBG] pgmap v6107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:52:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:52:26.097394+0000 mon.smithi061 (mon.0) 1562 : audit [DBG] from='client.? 172.21.15.61:0/3803492437' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:52:29.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:27.934180+0000 mgr.smithi067.rdualw (mgr.24569) 7091 : cluster [DBG] pgmap v6108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:29.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:27.934180+0000 mgr.smithi067.rdualw (mgr.24569) 7091 : cluster [DBG] pgmap v6108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:31.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:29.934847+0000 mgr.smithi067.rdualw (mgr.24569) 7092 : cluster [DBG] pgmap v6109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:31.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:29.934847+0000 mgr.smithi067.rdualw (mgr.24569) 7092 : cluster [DBG] pgmap v6109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:32.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:31.935947+0000 mgr.smithi067.rdualw (mgr.24569) 7093 : cluster [DBG] pgmap v6110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:31.935947+0000 mgr.smithi067.rdualw (mgr.24569) 7093 : cluster [DBG] pgmap v6110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:35.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:33.936496+0000 mgr.smithi067.rdualw (mgr.24569) 7094 : cluster [DBG] pgmap v6111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:35.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:52:34.765802+0000 mon.smithi067 (mon.1) 1087 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:52:35.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:52:34.767261+0000 mon.smithi067 (mon.1) 1088 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:52:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:52:34.768168+0000 mon.smithi067 (mon.1) 1089 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:52:35.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:33.936496+0000 mgr.smithi067.rdualw (mgr.24569) 7094 : cluster [DBG] pgmap v6111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:35.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:52:34.765802+0000 mon.smithi067 (mon.1) 1087 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:52:35.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:52:34.767261+0000 mon.smithi067 (mon.1) 1088 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:52:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:52:34.768168+0000 mon.smithi067 (mon.1) 1089 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:52:36.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:52:34.769037+0000 mgr.smithi067.rdualw (mgr.24569) 7095 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:52:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:52:35.188948+0000 mon.smithi061 (mon.0) 1563 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:52:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:52:35.194941+0000 mon.smithi061 (mon.0) 1564 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:52:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:52:35.554739+0000 mon.smithi067 (mon.1) 1090 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:52:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:52:35.554931+0000 mon.smithi067 (mon.1) 1091 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:52:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:52:35.555051+0000 mon.smithi061 (mon.0) 1565 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:52:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:52:35.555301+0000 mon.smithi061 (mon.0) 1566 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:52:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:52:34.769037+0000 mgr.smithi067.rdualw (mgr.24569) 7095 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:52:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:52:35.188948+0000 mon.smithi061 (mon.0) 1563 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:52:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:52:35.194941+0000 mon.smithi061 (mon.0) 1564 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:52:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:52:35.554739+0000 mon.smithi067 (mon.1) 1090 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:52:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:52:35.554931+0000 mon.smithi067 (mon.1) 1091 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:52:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:52:35.555051+0000 mon.smithi061 (mon.0) 1565 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:52:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:52:35.555301+0000 mon.smithi061 (mon.0) 1566 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:52:37.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:35.937571+0000 mgr.smithi067.rdualw (mgr.24569) 7096 : cluster [DBG] pgmap v6112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:52:37.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:35.937571+0000 mgr.smithi067.rdualw (mgr.24569) 7096 : cluster [DBG] pgmap v6112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:52:39.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:37.938259+0000 mgr.smithi067.rdualw (mgr.24569) 7097 : cluster [DBG] pgmap v6113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:39.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:37.938259+0000 mgr.smithi067.rdualw (mgr.24569) 7097 : cluster [DBG] pgmap v6113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:41.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:39.938988+0000 mgr.smithi067.rdualw (mgr.24569) 7098 : cluster [DBG] pgmap v6114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:41.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:39.938988+0000 mgr.smithi067.rdualw (mgr.24569) 7098 : cluster [DBG] pgmap v6114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:42.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:41.939891+0000 mgr.smithi067.rdualw (mgr.24569) 7099 : cluster [DBG] pgmap v6115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:42.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:41.939891+0000 mgr.smithi067.rdualw (mgr.24569) 7099 : cluster [DBG] pgmap v6115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:45.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:43.940601+0000 mgr.smithi067.rdualw (mgr.24569) 7100 : cluster [DBG] pgmap v6116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:45.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:43.940601+0000 mgr.smithi067.rdualw (mgr.24569) 7100 : cluster [DBG] pgmap v6116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:47.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:45.941427+0000 mgr.smithi067.rdualw (mgr.24569) 7101 : cluster [DBG] pgmap v6117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:52:47.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:45.941427+0000 mgr.smithi067.rdualw (mgr.24569) 7101 : cluster [DBG] pgmap v6117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:52:49.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:47.941917+0000 mgr.smithi067.rdualw (mgr.24569) 7102 : cluster [DBG] pgmap v6118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:49.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:47.941917+0000 mgr.smithi067.rdualw (mgr.24569) 7102 : cluster [DBG] pgmap v6118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:51.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:49.942617+0000 mgr.smithi067.rdualw (mgr.24569) 7103 : cluster [DBG] pgmap v6119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:51.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:49.942617+0000 mgr.smithi067.rdualw (mgr.24569) 7103 : cluster [DBG] pgmap v6119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:52.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:51.943492+0000 mgr.smithi067.rdualw (mgr.24569) 7104 : cluster [DBG] pgmap v6120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:52.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:51.943492+0000 mgr.smithi067.rdualw (mgr.24569) 7104 : cluster [DBG] pgmap v6120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:55.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:53.944132+0000 mgr.smithi067.rdualw (mgr.24569) 7105 : cluster [DBG] pgmap v6121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:55.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:53.944132+0000 mgr.smithi067.rdualw (mgr.24569) 7105 : cluster [DBG] pgmap v6121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:56.408 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:52:56.698 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:52:56.699 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 8m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:52:56.699 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 8m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:52:56.699 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 8m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:52:56.700 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 8m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:52:56.700 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 8m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:52:56.700 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 8m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:52:56.701 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 8m ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:52:56.701 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 8m ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:52:56.701 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 8m ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:52:56.701 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 8m ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:52:56.702 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 8m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:52:56.702 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 8m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:52:56.702 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 8m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:52:56.702 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 8m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:52:56.702 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 8m ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:52:56.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 8m ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:52:56.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 8m ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:52:56.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 8m ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:52:56.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 8m ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:52:56.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 8m ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:52:56.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 8m ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:52:56.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 8m ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:52:56.705 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 8m ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:52:57.039 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:52:57.039 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:52:57.039 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:52:57.040 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:52:57.040 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:52:57.040 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:52:57.040 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:52:57.041 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:52:57.041 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:52:57.041 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:52:57.041 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:52:57.041 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:52:57.042 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:52:57.042 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:52:57.042 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:52:57.042 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:52:57.042 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:52:57.043 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:52:57.043 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:52:57.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:55.945160+0000 mgr.smithi067.rdualw (mgr.24569) 7106 : cluster [DBG] pgmap v6122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:52:57.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:55.945160+0000 mgr.smithi067.rdualw (mgr.24569) 7106 : cluster [DBG] pgmap v6122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:52:58.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:52:56.394723+0000 mgr.smithi067.rdualw (mgr.24569) 7107 : audit [DBG] from='client.38878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:52:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:52:56.681815+0000 mgr.smithi067.rdualw (mgr.24569) 7108 : audit [DBG] from='client.38882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:52:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:52:57.039035+0000 mon.smithi061 (mon.0) 1567 : audit [DBG] from='client.? 172.21.15.61:0/2546559792' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:52:58.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:52:56.394723+0000 mgr.smithi067.rdualw (mgr.24569) 7107 : audit [DBG] from='client.38878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:52:58.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:52:56.681815+0000 mgr.smithi067.rdualw (mgr.24569) 7108 : audit [DBG] from='client.38882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:52:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:52:57.039035+0000 mon.smithi061 (mon.0) 1567 : audit [DBG] from='client.? 172.21.15.61:0/2546559792' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:52:59.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:52:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:57.945710+0000 mgr.smithi067.rdualw (mgr.24569) 7109 : cluster [DBG] pgmap v6123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:52:59.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:52:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:57.945710+0000 mgr.smithi067.rdualw (mgr.24569) 7109 : cluster [DBG] pgmap v6123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:01.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:52:59.946308+0000 mgr.smithi067.rdualw (mgr.24569) 7110 : cluster [DBG] pgmap v6124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:52:59.946308+0000 mgr.smithi067.rdualw (mgr.24569) 7110 : cluster [DBG] pgmap v6124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:02.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:01.947264+0000 mgr.smithi067.rdualw (mgr.24569) 7111 : cluster [DBG] pgmap v6125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:02.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:01.947264+0000 mgr.smithi067.rdualw (mgr.24569) 7111 : cluster [DBG] pgmap v6125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:05.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:03.947937+0000 mgr.smithi067.rdualw (mgr.24569) 7112 : cluster [DBG] pgmap v6126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:05.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:03.947937+0000 mgr.smithi067.rdualw (mgr.24569) 7112 : cluster [DBG] pgmap v6126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:07.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:05.948995+0000 mgr.smithi067.rdualw (mgr.24569) 7113 : cluster [DBG] pgmap v6127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:53:07.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:05.948995+0000 mgr.smithi067.rdualw (mgr.24569) 7113 : cluster [DBG] pgmap v6127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:53:09.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:07.949551+0000 mgr.smithi067.rdualw (mgr.24569) 7114 : cluster [DBG] pgmap v6128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:09.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:07.949551+0000 mgr.smithi067.rdualw (mgr.24569) 7114 : cluster [DBG] pgmap v6128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:11.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:09.950333+0000 mgr.smithi067.rdualw (mgr.24569) 7115 : cluster [DBG] pgmap v6129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:11.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:09.950333+0000 mgr.smithi067.rdualw (mgr.24569) 7115 : cluster [DBG] pgmap v6129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:12.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:11.951409+0000 mgr.smithi067.rdualw (mgr.24569) 7116 : cluster [DBG] pgmap v6130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:12.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:11.951409+0000 mgr.smithi067.rdualw (mgr.24569) 7116 : cluster [DBG] pgmap v6130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:15.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:13.952037+0000 mgr.smithi067.rdualw (mgr.24569) 7117 : cluster [DBG] pgmap v6131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:15.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:13.952037+0000 mgr.smithi067.rdualw (mgr.24569) 7117 : cluster [DBG] pgmap v6131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:17.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:15.952817+0000 mgr.smithi067.rdualw (mgr.24569) 7118 : cluster [DBG] pgmap v6132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:53:17.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:15.952817+0000 mgr.smithi067.rdualw (mgr.24569) 7118 : cluster [DBG] pgmap v6132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:53:19.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:17.953494+0000 mgr.smithi067.rdualw (mgr.24569) 7119 : cluster [DBG] pgmap v6133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:19.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:17.953494+0000 mgr.smithi067.rdualw (mgr.24569) 7119 : cluster [DBG] pgmap v6133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:21.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:19.954061+0000 mgr.smithi067.rdualw (mgr.24569) 7120 : cluster [DBG] pgmap v6134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:21.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:19.954061+0000 mgr.smithi067.rdualw (mgr.24569) 7120 : cluster [DBG] pgmap v6134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:22.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:21.954971+0000 mgr.smithi067.rdualw (mgr.24569) 7121 : cluster [DBG] pgmap v6135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:22.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:21.954971+0000 mgr.smithi067.rdualw (mgr.24569) 7121 : cluster [DBG] pgmap v6135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:25.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:23.955672+0000 mgr.smithi067.rdualw (mgr.24569) 7122 : cluster [DBG] pgmap v6136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:25.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:23.955672+0000 mgr.smithi067.rdualw (mgr.24569) 7122 : cluster [DBG] pgmap v6136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:27.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:25.956738+0000 mgr.smithi067.rdualw (mgr.24569) 7123 : cluster [DBG] pgmap v6137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:53:27.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:25.956738+0000 mgr.smithi067.rdualw (mgr.24569) 7123 : cluster [DBG] pgmap v6137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:53:27.344 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:53:27.634 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:53:27.634 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 8m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:53:27.634 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 8m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:53:27.634 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 8m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:53:27.635 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 8m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:53:27.635 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 8m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:53:27.635 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 8m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:53:27.635 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 8m ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:53:27.636 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 8m ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:53:27.636 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 8m ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:53:27.637 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 8m ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:53:27.637 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 8m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:53:27.638 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 8m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:53:27.638 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 8m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:53:27.638 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 8m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:53:27.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 8m ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:53:27.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 8m ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:53:27.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 8m ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:53:27.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 8m ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:53:27.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 8m ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:53:27.642 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 8m ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:53:27.642 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 8m ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:53:27.642 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 8m ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:53:27.643 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 8m ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:53:27.977 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:53:27.977 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:53:27.978 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:53:27.978 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:53:27.978 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:53:27.978 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:53:27.979 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:53:27.979 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:53:27.979 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:53:27.980 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:53:27.980 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:53:27.980 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:53:27.980 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:53:27.981 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:53:27.981 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:53:27.981 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:53:27.981 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:53:27.982 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:53:27.982 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:53:28.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:53:27.977340+0000 mon.smithi061 (mon.0) 1568 : audit [DBG] from='client.? 172.21.15.61:0/4072765914' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:53:28.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:53:27.977340+0000 mon.smithi061 (mon.0) 1568 : audit [DBG] from='client.? 172.21.15.61:0/4072765914' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:53:29.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:53:27.331921+0000 mgr.smithi067.rdualw (mgr.24569) 7124 : audit [DBG] from='client.38890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:53:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:53:27.617342+0000 mgr.smithi067.rdualw (mgr.24569) 7125 : audit [DBG] from='client.38894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:53:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:27.957414+0000 mgr.smithi067.rdualw (mgr.24569) 7126 : cluster [DBG] pgmap v6138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:29.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:53:27.331921+0000 mgr.smithi067.rdualw (mgr.24569) 7124 : audit [DBG] from='client.38890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:53:29.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:53:27.617342+0000 mgr.smithi067.rdualw (mgr.24569) 7125 : audit [DBG] from='client.38894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:53:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:27.957414+0000 mgr.smithi067.rdualw (mgr.24569) 7126 : cluster [DBG] pgmap v6138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:31.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:29.958166+0000 mgr.smithi067.rdualw (mgr.24569) 7127 : cluster [DBG] pgmap v6139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:31.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:29.958166+0000 mgr.smithi067.rdualw (mgr.24569) 7127 : cluster [DBG] pgmap v6139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:32.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:31.959230+0000 mgr.smithi067.rdualw (mgr.24569) 7128 : cluster [DBG] pgmap v6140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:31.959230+0000 mgr.smithi067.rdualw (mgr.24569) 7128 : cluster [DBG] pgmap v6140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:35.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:33.959818+0000 mgr.smithi067.rdualw (mgr.24569) 7129 : cluster [DBG] pgmap v6141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:35.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:33.959818+0000 mgr.smithi067.rdualw (mgr.24569) 7129 : cluster [DBG] pgmap v6141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:36.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:53:35.198935+0000 mon.smithi067 (mon.1) 1092 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:53:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:53:35.200451+0000 mon.smithi067 (mon.1) 1093 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:53:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:53:35.201496+0000 mon.smithi067 (mon.1) 1094 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:53:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:53:35.559543+0000 mon.smithi067 (mon.1) 1095 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:53:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:53:35.559736+0000 mon.smithi067 (mon.1) 1096 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:53:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:53:35.559873+0000 mon.smithi061 (mon.0) 1569 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:53:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:53:35.560208+0000 mon.smithi061 (mon.0) 1570 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:53:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:53:35.621423+0000 mon.smithi061 (mon.0) 1571 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:53:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:53:35.627324+0000 mon.smithi061 (mon.0) 1572 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:53:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:53:35.198935+0000 mon.smithi067 (mon.1) 1092 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:53:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:53:35.200451+0000 mon.smithi067 (mon.1) 1093 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:53:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:53:35.201496+0000 mon.smithi067 (mon.1) 1094 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:53:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:53:35.559543+0000 mon.smithi067 (mon.1) 1095 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:53:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:53:35.559736+0000 mon.smithi067 (mon.1) 1096 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:53:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:53:35.559873+0000 mon.smithi061 (mon.0) 1569 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:53:36.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:53:35.560208+0000 mon.smithi061 (mon.0) 1570 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:53:36.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:53:35.621423+0000 mon.smithi061 (mon.0) 1571 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:53:36.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:53:35.627324+0000 mon.smithi061 (mon.0) 1572 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:53:37.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:53:35.202404+0000 mgr.smithi067.rdualw (mgr.24569) 7130 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:53:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:35.960817+0000 mgr.smithi067.rdualw (mgr.24569) 7131 : cluster [DBG] pgmap v6142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:53:37.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:53:35.202404+0000 mgr.smithi067.rdualw (mgr.24569) 7130 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:53:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:35.960817+0000 mgr.smithi067.rdualw (mgr.24569) 7131 : cluster [DBG] pgmap v6142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:53:39.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:37.961441+0000 mgr.smithi067.rdualw (mgr.24569) 7132 : cluster [DBG] pgmap v6143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:39.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:37.961441+0000 mgr.smithi067.rdualw (mgr.24569) 7132 : cluster [DBG] pgmap v6143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:41.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:39.962098+0000 mgr.smithi067.rdualw (mgr.24569) 7133 : cluster [DBG] pgmap v6144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:41.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:39.962098+0000 mgr.smithi067.rdualw (mgr.24569) 7133 : cluster [DBG] pgmap v6144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:42.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:41.963035+0000 mgr.smithi067.rdualw (mgr.24569) 7134 : cluster [DBG] pgmap v6145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:42.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:41.963035+0000 mgr.smithi067.rdualw (mgr.24569) 7134 : cluster [DBG] pgmap v6145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:45.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:43.963825+0000 mgr.smithi067.rdualw (mgr.24569) 7135 : cluster [DBG] pgmap v6146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:45.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:43.963825+0000 mgr.smithi067.rdualw (mgr.24569) 7135 : cluster [DBG] pgmap v6146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:47.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:45.964758+0000 mgr.smithi067.rdualw (mgr.24569) 7136 : cluster [DBG] pgmap v6147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:53:47.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:45.964758+0000 mgr.smithi067.rdualw (mgr.24569) 7136 : cluster [DBG] pgmap v6147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:53:49.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:47.965370+0000 mgr.smithi067.rdualw (mgr.24569) 7137 : cluster [DBG] pgmap v6148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:49.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:47.965370+0000 mgr.smithi067.rdualw (mgr.24569) 7137 : cluster [DBG] pgmap v6148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:51.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:49.965940+0000 mgr.smithi067.rdualw (mgr.24569) 7138 : cluster [DBG] pgmap v6149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:51.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:49.965940+0000 mgr.smithi067.rdualw (mgr.24569) 7138 : cluster [DBG] pgmap v6149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:52.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:51.966809+0000 mgr.smithi067.rdualw (mgr.24569) 7139 : cluster [DBG] pgmap v6150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:52.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:51.966809+0000 mgr.smithi067.rdualw (mgr.24569) 7139 : cluster [DBG] pgmap v6150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:55.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:53.967475+0000 mgr.smithi067.rdualw (mgr.24569) 7140 : cluster [DBG] pgmap v6151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:55.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:53.967475+0000 mgr.smithi067.rdualw (mgr.24569) 7140 : cluster [DBG] pgmap v6151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:57.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:55.968389+0000 mgr.smithi067.rdualw (mgr.24569) 7141 : cluster [DBG] pgmap v6152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:53:57.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:55.968389+0000 mgr.smithi067.rdualw (mgr.24569) 7141 : cluster [DBG] pgmap v6152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:53:58.287 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:53:58.579 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:53:58.579 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 9m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:53:58.579 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 9m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:53:58.580 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 9m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:53:58.580 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 9m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:53:58.580 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 9m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:53:58.580 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 9m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:53:58.581 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 9m ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:53:58.581 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 9m ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:53:58.581 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 9m ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:53:58.581 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 9m ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:53:58.582 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 9m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:53:58.582 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 9m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:53:58.582 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 9m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:53:58.582 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 9m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:53:58.583 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 9m ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:53:58.583 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 9m ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:53:58.583 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 9m ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:53:58.583 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 9m ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:53:58.583 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 9m ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:53:58.584 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 9m ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:53:58.584 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 9m ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:53:58.584 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 9m ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:53:58.584 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 9m ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:53:58.955 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:53:58.955 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:53:58.956 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:53:58.956 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:53:58.956 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:53:58.956 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:53:58.957 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:53:58.957 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:53:58.957 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:53:58.957 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:53:58.958 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:53:58.958 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:53:58.958 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:53:58.958 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:53:58.958 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:53:58.959 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:53:58.959 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:53:58.959 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:53:58.959 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:53:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:57.968946+0000 mgr.smithi067.rdualw (mgr.24569) 7142 : cluster [DBG] pgmap v6153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:53:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:53:58.955175+0000 mon.smithi061 (mon.0) 1573 : audit [DBG] from='client.? 172.21.15.61:0/1663691225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:53:59.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:57.968946+0000 mgr.smithi067.rdualw (mgr.24569) 7142 : cluster [DBG] pgmap v6153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:53:59.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:53:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:53:58.955175+0000 mon.smithi061 (mon.0) 1573 : audit [DBG] from='client.? 172.21.15.61:0/1663691225' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:54:00.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:53:58.275605+0000 mgr.smithi067.rdualw (mgr.24569) 7143 : audit [DBG] from='client.38902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:54:00.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:53:58.562345+0000 mgr.smithi067.rdualw (mgr.24569) 7144 : audit [DBG] from='client.38906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:54:00.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:53:58.275605+0000 mgr.smithi067.rdualw (mgr.24569) 7143 : audit [DBG] from='client.38902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:54:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:53:58.562345+0000 mgr.smithi067.rdualw (mgr.24569) 7144 : audit [DBG] from='client.38906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:54:01.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:53:59.969686+0000 mgr.smithi067.rdualw (mgr.24569) 7145 : cluster [DBG] pgmap v6154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:01.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:53:59.969686+0000 mgr.smithi067.rdualw (mgr.24569) 7145 : cluster [DBG] pgmap v6154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:02.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:01.970519+0000 mgr.smithi067.rdualw (mgr.24569) 7146 : cluster [DBG] pgmap v6155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:01.970519+0000 mgr.smithi067.rdualw (mgr.24569) 7146 : cluster [DBG] pgmap v6155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:03.971283+0000 mgr.smithi067.rdualw (mgr.24569) 7147 : cluster [DBG] pgmap v6156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:05.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:03.971283+0000 mgr.smithi067.rdualw (mgr.24569) 7147 : cluster [DBG] pgmap v6156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:07.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:05.972135+0000 mgr.smithi067.rdualw (mgr.24569) 7148 : cluster [DBG] pgmap v6157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:54:07.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:05.972135+0000 mgr.smithi067.rdualw (mgr.24569) 7148 : cluster [DBG] pgmap v6157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:54:09.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:07.972772+0000 mgr.smithi067.rdualw (mgr.24569) 7149 : cluster [DBG] pgmap v6158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:09.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:07.972772+0000 mgr.smithi067.rdualw (mgr.24569) 7149 : cluster [DBG] pgmap v6158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:11.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:09.973327+0000 mgr.smithi067.rdualw (mgr.24569) 7150 : cluster [DBG] pgmap v6159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:09.973327+0000 mgr.smithi067.rdualw (mgr.24569) 7150 : cluster [DBG] pgmap v6159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:11.974249+0000 mgr.smithi067.rdualw (mgr.24569) 7151 : cluster [DBG] pgmap v6160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:12.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:11.974249+0000 mgr.smithi067.rdualw (mgr.24569) 7151 : cluster [DBG] pgmap v6160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:15.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:13.974819+0000 mgr.smithi067.rdualw (mgr.24569) 7152 : cluster [DBG] pgmap v6161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:15.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:13.974819+0000 mgr.smithi067.rdualw (mgr.24569) 7152 : cluster [DBG] pgmap v6161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:17.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:15.975728+0000 mgr.smithi067.rdualw (mgr.24569) 7153 : cluster [DBG] pgmap v6162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:54:17.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:15.975728+0000 mgr.smithi067.rdualw (mgr.24569) 7153 : cluster [DBG] pgmap v6162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:54:19.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:17.976209+0000 mgr.smithi067.rdualw (mgr.24569) 7154 : cluster [DBG] pgmap v6163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:19.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:17.976209+0000 mgr.smithi067.rdualw (mgr.24569) 7154 : cluster [DBG] pgmap v6163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:21.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:19.976927+0000 mgr.smithi067.rdualw (mgr.24569) 7155 : cluster [DBG] pgmap v6164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:21.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:19.976927+0000 mgr.smithi067.rdualw (mgr.24569) 7155 : cluster [DBG] pgmap v6164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:22.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:21.977794+0000 mgr.smithi067.rdualw (mgr.24569) 7156 : cluster [DBG] pgmap v6165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:22.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:21.977794+0000 mgr.smithi067.rdualw (mgr.24569) 7156 : cluster [DBG] pgmap v6165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:25.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:23.978322+0000 mgr.smithi067.rdualw (mgr.24569) 7157 : cluster [DBG] pgmap v6166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:25.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:23.978322+0000 mgr.smithi067.rdualw (mgr.24569) 7157 : cluster [DBG] pgmap v6166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:27.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:25.979115+0000 mgr.smithi067.rdualw (mgr.24569) 7158 : cluster [DBG] pgmap v6167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:54:27.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:25.979115+0000 mgr.smithi067.rdualw (mgr.24569) 7158 : cluster [DBG] pgmap v6167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:54:29.265 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:54:29.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:27.979773+0000 mgr.smithi067.rdualw (mgr.24569) 7159 : cluster [DBG] pgmap v6168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:29.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:27.979773+0000 mgr.smithi067.rdualw (mgr.24569) 7159 : cluster [DBG] pgmap v6168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:29.556 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:54:29.557 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 9m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:54:29.557 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 9m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:54:29.557 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 10m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:54:29.558 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 9m ago 3h 41.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:54:29.558 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 9m ago 3h 42.7M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:54:29.558 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 10m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:54:29.558 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 9m ago 3h 469M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:54:29.559 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 10m ago 3h 581M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:54:29.559 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 9m ago 3h 1319M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:54:29.559 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 10m ago 3h 672M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:54:29.559 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 9m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:54:29.559 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 10m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:54:29.560 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 9m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:54:29.560 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 10m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:54:29.560 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 9m ago 3h 925M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:54:29.560 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 9m ago 3h 1801M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:54:29.561 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 9m ago 3h 1125M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:54:29.561 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 9m ago 3h 1935M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:54:29.561 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 10m ago 3h 1786M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:54:29.561 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 10m ago 3h 1985M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:54:29.562 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 10m ago 3h 1596M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:54:29.562 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 10m ago 3h 2503M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:54:29.562 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 9m ago 3h 116M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:54:29.900 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:54:29.900 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:54:29.900 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:54:29.901 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:54:29.901 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:54:29.901 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:54:29.901 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:54:29.901 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:54:29.902 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:54:29.902 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:54:29.902 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:54:29.902 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:54:29.903 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:54:29.903 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:54:29.903 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:54:29.903 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:54:29.904 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:54:29.904 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:54:29.904 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:54:30.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:29.899523+0000 mon.smithi061 (mon.0) 1574 : audit [DBG] from='client.? 172.21.15.61:0/535599103' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:54:30.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:29.899523+0000 mon.smithi061 (mon.0) 1574 : audit [DBG] from='client.? 172.21.15.61:0/535599103' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:54:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:29.253297+0000 mgr.smithi067.rdualw (mgr.24569) 7160 : audit [DBG] from='client.38914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:54:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:29.540426+0000 mgr.smithi067.rdualw (mgr.24569) 7161 : audit [DBG] from='client.38918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:54:31.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:29.980485+0000 mgr.smithi067.rdualw (mgr.24569) 7162 : cluster [DBG] pgmap v6169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:31.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:29.253297+0000 mgr.smithi067.rdualw (mgr.24569) 7160 : audit [DBG] from='client.38914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:54:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:29.540426+0000 mgr.smithi067.rdualw (mgr.24569) 7161 : audit [DBG] from='client.38918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:54:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:29.980485+0000 mgr.smithi067.rdualw (mgr.24569) 7162 : cluster [DBG] pgmap v6169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:32.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:31.981289+0000 mgr.smithi067.rdualw (mgr.24569) 7163 : cluster [DBG] pgmap v6170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:31.981289+0000 mgr.smithi067.rdualw (mgr.24569) 7163 : cluster [DBG] pgmap v6170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:35.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:33.981972+0000 mgr.smithi067.rdualw (mgr.24569) 7164 : cluster [DBG] pgmap v6171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:35.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:33.981972+0000 mgr.smithi067.rdualw (mgr.24569) 7164 : cluster [DBG] pgmap v6171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:35.563442+0000 mon.smithi067 (mon.1) 1097 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:54:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:35.563778+0000 mon.smithi061 (mon.0) 1575 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:54:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:35.563819+0000 mon.smithi067 (mon.1) 1098 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:54:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:35.564306+0000 mon.smithi061 (mon.0) 1576 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:54:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:35.630612+0000 mon.smithi067 (mon.1) 1099 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:54:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:35.632038+0000 mon.smithi067 (mon.1) 1100 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:54:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:35.633015+0000 mon.smithi067 (mon.1) 1101 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:54:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:35.563442+0000 mon.smithi067 (mon.1) 1097 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:54:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:35.563778+0000 mon.smithi061 (mon.0) 1575 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:54:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:35.563819+0000 mon.smithi067 (mon.1) 1098 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:54:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:35.564306+0000 mon.smithi061 (mon.0) 1576 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:54:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:35.630612+0000 mon.smithi067 (mon.1) 1099 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:54:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:35.632038+0000 mon.smithi067 (mon.1) 1100 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:54:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:35.633015+0000 mon.smithi067 (mon.1) 1101 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:54:37.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:54:35.633837+0000 mgr.smithi067.rdualw (mgr.24569) 7165 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:54:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:35.983749+0000 mgr.smithi067.rdualw (mgr.24569) 7166 : cluster [DBG] pgmap v6172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:54:37.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:54:35.633837+0000 mgr.smithi067.rdualw (mgr.24569) 7165 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:54:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:35.983749+0000 mgr.smithi067.rdualw (mgr.24569) 7166 : cluster [DBG] pgmap v6172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:54:39.045 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:37.984180+0000 mgr.smithi067.rdualw (mgr.24569) 7167 : cluster [DBG] pgmap v6173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:39.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:37.984180+0000 mgr.smithi067.rdualw (mgr.24569) 7167 : cluster [DBG] pgmap v6173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:41.048 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:39.984906+0000 mgr.smithi067.rdualw (mgr.24569) 7168 : cluster [DBG] pgmap v6174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:41.048 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:40.227097+0000 mon.smithi061 (mon.0) 1577 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:54:41.048 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:40.526066+0000 mon.smithi067 (mon.1) 1102 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:54:41.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:40.526526+0000 mon.smithi061 (mon.0) 1578 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:54:41.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:39.984906+0000 mgr.smithi067.rdualw (mgr.24569) 7168 : cluster [DBG] pgmap v6174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:41.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:40.227097+0000 mon.smithi061 (mon.0) 1577 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:54:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:40.526066+0000 mon.smithi067 (mon.1) 1102 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:54:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:40.526526+0000 mon.smithi061 (mon.0) 1578 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:54:42.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:41.985914+0000 mgr.smithi067.rdualw (mgr.24569) 7169 : cluster [DBG] pgmap v6175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:42.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:41.985914+0000 mgr.smithi067.rdualw (mgr.24569) 7169 : cluster [DBG] pgmap v6175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:44.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:42.966362+0000 mon.smithi061 (mon.0) 1579 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:54:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:43.372119+0000 mon.smithi067 (mon.1) 1103 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:54:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:43.372617+0000 mon.smithi061 (mon.0) 1580 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:54:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:43.377114+0000 mon.smithi061 (mon.0) 1581 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:54:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:54:43.384308+0000 mon.smithi061 (mon.0) 1582 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:54:44.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:42.966362+0000 mon.smithi061 (mon.0) 1579 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:54:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:43.372119+0000 mon.smithi067 (mon.1) 1103 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:54:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:43.372617+0000 mon.smithi061 (mon.0) 1580 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T18:54:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:43.377114+0000 mon.smithi061 (mon.0) 1581 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:54:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:54:43.384308+0000 mon.smithi061 (mon.0) 1582 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:54:45.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:43.986508+0000 mgr.smithi067.rdualw (mgr.24569) 7170 : cluster [DBG] pgmap v6176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:45.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:43.986508+0000 mgr.smithi067.rdualw (mgr.24569) 7170 : cluster [DBG] pgmap v6176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:47.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:45.987644+0000 mgr.smithi067.rdualw (mgr.24569) 7171 : cluster [DBG] pgmap v6177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:54:47.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:45.987644+0000 mgr.smithi067.rdualw (mgr.24569) 7171 : cluster [DBG] pgmap v6177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:54:49.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:47.988183+0000 mgr.smithi067.rdualw (mgr.24569) 7172 : cluster [DBG] pgmap v6178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:49.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:47.988183+0000 mgr.smithi067.rdualw (mgr.24569) 7172 : cluster [DBG] pgmap v6178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:51.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:49.988817+0000 mgr.smithi067.rdualw (mgr.24569) 7173 : cluster [DBG] pgmap v6179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:51.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:49.988817+0000 mgr.smithi067.rdualw (mgr.24569) 7173 : cluster [DBG] pgmap v6179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:52.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:51.989803+0000 mgr.smithi067.rdualw (mgr.24569) 7174 : cluster [DBG] pgmap v6180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:52.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:51.989803+0000 mgr.smithi067.rdualw (mgr.24569) 7174 : cluster [DBG] pgmap v6180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:55.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:53.990370+0000 mgr.smithi067.rdualw (mgr.24569) 7175 : cluster [DBG] pgmap v6181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:55.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:53.990370+0000 mgr.smithi067.rdualw (mgr.24569) 7175 : cluster [DBG] pgmap v6181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:57.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:55.991312+0000 mgr.smithi067.rdualw (mgr.24569) 7176 : cluster [DBG] pgmap v6182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:54:57.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:55.991312+0000 mgr.smithi067.rdualw (mgr.24569) 7176 : cluster [DBG] pgmap v6182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:54:59.300 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:54:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:57.992021+0000 mgr.smithi067.rdualw (mgr.24569) 7177 : cluster [DBG] pgmap v6183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:54:59.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:54:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:57.992021+0000 mgr.smithi067.rdualw (mgr.24569) 7177 : cluster [DBG] pgmap v6183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:00.213 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:55:00.503 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:55:00.504 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 17s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:55:00.504 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 17s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:55:00.504 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 20s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:55:00.504 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 17s ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:55:00.505 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 17s ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:55:00.505 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 20s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:55:00.505 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 17s ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:55:00.505 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 20s ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:55:00.506 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 17s ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:55:00.506 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 20s ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:55:00.506 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 17s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:55:00.506 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 20s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:55:00.507 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 17s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:55:00.507 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 20s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:55:00.507 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 17s ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:55:00.507 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 17s ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:55:00.507 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 17s ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:55:00.508 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 17s ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:55:00.508 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 20s ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:55:00.508 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 20s ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:55:00.508 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 20s ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:55:00.509 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 20s ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:55:00.509 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 17s ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:55:00.846 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:55:00.847 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:55:00.847 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:55:00.847 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:55:00.847 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:55:00.848 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:55:00.848 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:55:00.848 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:55:00.848 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:55:00.848 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:55:00.849 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:55:00.849 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:55:00.849 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:55:00.849 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:55:00.849 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:55:00.850 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:55:00.850 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:55:00.850 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:55:00.850 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:55:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:54:59.992999+0000 mgr.smithi067.rdualw (mgr.24569) 7178 : cluster [DBG] pgmap v6184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:55:00.846365+0000 mon.smithi061 (mon.0) 1583 : audit [DBG] from='client.? 172.21.15.61:0/2664895210' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:55:01.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:54:59.992999+0000 mgr.smithi067.rdualw (mgr.24569) 7178 : cluster [DBG] pgmap v6184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:01.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:55:00.846365+0000 mon.smithi061 (mon.0) 1583 : audit [DBG] from='client.? 172.21.15.61:0/2664895210' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:55:02.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:55:00.200734+0000 mgr.smithi067.rdualw (mgr.24569) 7179 : audit [DBG] from='client.38926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:55:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:55:00.487385+0000 mgr.smithi067.rdualw (mgr.24569) 7180 : audit [DBG] from='client.38930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:55:02.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:55:00.200734+0000 mgr.smithi067.rdualw (mgr.24569) 7179 : audit [DBG] from='client.38926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:55:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:55:00.487385+0000 mgr.smithi067.rdualw (mgr.24569) 7180 : audit [DBG] from='client.38930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:55:03.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:01.993833+0000 mgr.smithi067.rdualw (mgr.24569) 7181 : cluster [DBG] pgmap v6185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:03.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:01.993833+0000 mgr.smithi067.rdualw (mgr.24569) 7181 : cluster [DBG] pgmap v6185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:05.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:03.994385+0000 mgr.smithi067.rdualw (mgr.24569) 7182 : cluster [DBG] pgmap v6186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:05.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:03.994385+0000 mgr.smithi067.rdualw (mgr.24569) 7182 : cluster [DBG] pgmap v6186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:07.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:05.995313+0000 mgr.smithi067.rdualw (mgr.24569) 7183 : cluster [DBG] pgmap v6187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:55:07.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:05.995313+0000 mgr.smithi067.rdualw (mgr.24569) 7183 : cluster [DBG] pgmap v6187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:55:09.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:07.995832+0000 mgr.smithi067.rdualw (mgr.24569) 7184 : cluster [DBG] pgmap v6188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:09.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:07.995832+0000 mgr.smithi067.rdualw (mgr.24569) 7184 : cluster [DBG] pgmap v6188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:11.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:09.996421+0000 mgr.smithi067.rdualw (mgr.24569) 7185 : cluster [DBG] pgmap v6189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:11.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:09.996421+0000 mgr.smithi067.rdualw (mgr.24569) 7185 : cluster [DBG] pgmap v6189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:12.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:11.997308+0000 mgr.smithi067.rdualw (mgr.24569) 7186 : cluster [DBG] pgmap v6190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:12.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:11.997308+0000 mgr.smithi067.rdualw (mgr.24569) 7186 : cluster [DBG] pgmap v6190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:15.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:13.998104+0000 mgr.smithi067.rdualw (mgr.24569) 7187 : cluster [DBG] pgmap v6191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:15.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:13.998104+0000 mgr.smithi067.rdualw (mgr.24569) 7187 : cluster [DBG] pgmap v6191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:17.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:15.999122+0000 mgr.smithi067.rdualw (mgr.24569) 7188 : cluster [DBG] pgmap v6192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:55:17.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:15.999122+0000 mgr.smithi067.rdualw (mgr.24569) 7188 : cluster [DBG] pgmap v6192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:55:19.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:17.999656+0000 mgr.smithi067.rdualw (mgr.24569) 7189 : cluster [DBG] pgmap v6193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:19.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:17.999656+0000 mgr.smithi067.rdualw (mgr.24569) 7189 : cluster [DBG] pgmap v6193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:21.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:20.000341+0000 mgr.smithi067.rdualw (mgr.24569) 7190 : cluster [DBG] pgmap v6194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:21.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:20.000341+0000 mgr.smithi067.rdualw (mgr.24569) 7190 : cluster [DBG] pgmap v6194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:22.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:22.001344+0000 mgr.smithi067.rdualw (mgr.24569) 7191 : cluster [DBG] pgmap v6195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:22.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:22.001344+0000 mgr.smithi067.rdualw (mgr.24569) 7191 : cluster [DBG] pgmap v6195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:25.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:24.001936+0000 mgr.smithi067.rdualw (mgr.24569) 7192 : cluster [DBG] pgmap v6196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:25.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:24.001936+0000 mgr.smithi067.rdualw (mgr.24569) 7192 : cluster [DBG] pgmap v6196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:27.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:26.002749+0000 mgr.smithi067.rdualw (mgr.24569) 7193 : cluster [DBG] pgmap v6197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:55:27.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:26.002749+0000 mgr.smithi067.rdualw (mgr.24569) 7193 : cluster [DBG] pgmap v6197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:55:29.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:28.003306+0000 mgr.smithi067.rdualw (mgr.24569) 7194 : cluster [DBG] pgmap v6198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:29.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:28.003306+0000 mgr.smithi067.rdualw (mgr.24569) 7194 : cluster [DBG] pgmap v6198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:31.158 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:55:31.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:30.003943+0000 mgr.smithi067.rdualw (mgr.24569) 7195 : cluster [DBG] pgmap v6199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:31.449 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:55:31.450 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 48s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:55:31.450 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 48s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:55:31.450 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 51s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:55:31.450 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 48s ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:55:31.451 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 48s ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:55:31.451 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 51s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:55:31.451 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 48s ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:55:31.451 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 51s ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:55:31.452 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 48s ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:55:31.452 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 51s ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:55:31.452 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 48s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:55:31.452 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 51s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:55:31.452 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 48s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:55:31.453 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 51s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:55:31.453 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 48s ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:55:31.453 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 48s ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:55:31.453 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 48s ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:55:31.453 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 48s ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:55:31.454 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 51s ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:55:31.454 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 51s ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:55:31.454 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 51s ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:55:31.454 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 51s ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:55:31.455 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 48s ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:55:31.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:30.003943+0000 mgr.smithi067.rdualw (mgr.24569) 7195 : cluster [DBG] pgmap v6199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:31.809 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:55:31.809 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:55:31.809 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:55:31.810 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:55:31.810 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:55:31.810 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:55:31.810 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:55:31.810 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:55:31.811 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:55:31.811 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:55:31.811 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:55:31.811 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:55:31.812 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:55:31.812 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:55:31.812 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:55:31.812 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:55:31.813 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:55:31.813 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:55:31.813 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:55:32.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:55:31.145487+0000 mgr.smithi067.rdualw (mgr.24569) 7196 : audit [DBG] from='client.38938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:55:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:55:31.433141+0000 mgr.smithi067.rdualw (mgr.24569) 7197 : audit [DBG] from='client.38942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:55:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:55:31.808613+0000 mon.smithi061 (mon.0) 1584 : audit [DBG] from='client.? 172.21.15.61:0/525095073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:55:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:32.004872+0000 mgr.smithi067.rdualw (mgr.24569) 7198 : cluster [DBG] pgmap v6200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:55:31.145487+0000 mgr.smithi067.rdualw (mgr.24569) 7196 : audit [DBG] from='client.38938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:55:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:55:31.433141+0000 mgr.smithi067.rdualw (mgr.24569) 7197 : audit [DBG] from='client.38942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:55:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:55:31.808613+0000 mon.smithi061 (mon.0) 1584 : audit [DBG] from='client.? 172.21.15.61:0/525095073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:55:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:32.004872+0000 mgr.smithi067.rdualw (mgr.24569) 7198 : cluster [DBG] pgmap v6200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:35.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:34.005601+0000 mgr.smithi067.rdualw (mgr.24569) 7199 : cluster [DBG] pgmap v6201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:35.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:34.005601+0000 mgr.smithi067.rdualw (mgr.24569) 7199 : cluster [DBG] pgmap v6201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:55:35.571436+0000 mon.smithi067 (mon.1) 1104 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:55:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:55:35.571706+0000 mon.smithi067 (mon.1) 1105 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:55:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:55:35.571744+0000 mon.smithi061 (mon.0) 1585 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:55:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:55:35.571980+0000 mon.smithi061 (mon.0) 1586 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:55:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:55:35.571436+0000 mon.smithi067 (mon.1) 1104 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:55:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:55:35.571706+0000 mon.smithi067 (mon.1) 1105 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:55:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:55:35.571744+0000 mon.smithi061 (mon.0) 1585 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:55:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:55:35.571980+0000 mon.smithi061 (mon.0) 1586 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:55:37.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:36.006361+0000 mgr.smithi067.rdualw (mgr.24569) 7200 : cluster [DBG] pgmap v6202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:55:37.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:36.006361+0000 mgr.smithi067.rdualw (mgr.24569) 7200 : cluster [DBG] pgmap v6202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:55:39.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:38.006889+0000 mgr.smithi067.rdualw (mgr.24569) 7201 : cluster [DBG] pgmap v6203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:39.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:38.006889+0000 mgr.smithi067.rdualw (mgr.24569) 7201 : cluster [DBG] pgmap v6203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:41.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:40.007574+0000 mgr.smithi067.rdualw (mgr.24569) 7202 : cluster [DBG] pgmap v6204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:41.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:40.007574+0000 mgr.smithi067.rdualw (mgr.24569) 7202 : cluster [DBG] pgmap v6204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:42.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:42.008437+0000 mgr.smithi067.rdualw (mgr.24569) 7203 : cluster [DBG] pgmap v6205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:42.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:42.008437+0000 mgr.smithi067.rdualw (mgr.24569) 7203 : cluster [DBG] pgmap v6205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:43.743 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:55:43.388796+0000 mon.smithi067 (mon.1) 1106 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:55:43.744 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:55:43.390154+0000 mon.smithi067 (mon.1) 1107 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:55:43.744 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:55:43.391048+0000 mon.smithi067 (mon.1) 1108 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:55:43.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:55:43.388796+0000 mon.smithi067 (mon.1) 1106 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:55:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:55:43.390154+0000 mon.smithi067 (mon.1) 1107 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:55:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:55:43.391048+0000 mon.smithi067 (mon.1) 1108 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:55:45.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:55:43.391884+0000 mgr.smithi067.rdualw (mgr.24569) 7204 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:55:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:55:43.810790+0000 mon.smithi061 (mon.0) 1587 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:55:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:55:43.816634+0000 mon.smithi061 (mon.0) 1588 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:55:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:44.009089+0000 mgr.smithi067.rdualw (mgr.24569) 7205 : cluster [DBG] pgmap v6206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:45.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:55:43.391884+0000 mgr.smithi067.rdualw (mgr.24569) 7204 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:55:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:55:43.810790+0000 mon.smithi061 (mon.0) 1587 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:55:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:55:43.816634+0000 mon.smithi061 (mon.0) 1588 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:55:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:44.009089+0000 mgr.smithi067.rdualw (mgr.24569) 7205 : cluster [DBG] pgmap v6206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:47.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:46.009856+0000 mgr.smithi067.rdualw (mgr.24569) 7206 : cluster [DBG] pgmap v6207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:55:47.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:46.009856+0000 mgr.smithi067.rdualw (mgr.24569) 7206 : cluster [DBG] pgmap v6207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:55:49.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:48.010517+0000 mgr.smithi067.rdualw (mgr.24569) 7207 : cluster [DBG] pgmap v6208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:49.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:48.010517+0000 mgr.smithi067.rdualw (mgr.24569) 7207 : cluster [DBG] pgmap v6208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:51.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:50.011091+0000 mgr.smithi067.rdualw (mgr.24569) 7208 : cluster [DBG] pgmap v6209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:51.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:50.011091+0000 mgr.smithi067.rdualw (mgr.24569) 7208 : cluster [DBG] pgmap v6209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:52.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:52.012038+0000 mgr.smithi067.rdualw (mgr.24569) 7209 : cluster [DBG] pgmap v6210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:52.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:52.012038+0000 mgr.smithi067.rdualw (mgr.24569) 7209 : cluster [DBG] pgmap v6210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:55.161 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:54.012544+0000 mgr.smithi067.rdualw (mgr.24569) 7210 : cluster [DBG] pgmap v6211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:55.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:54.012544+0000 mgr.smithi067.rdualw (mgr.24569) 7210 : cluster [DBG] pgmap v6211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:57.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:56.013431+0000 mgr.smithi067.rdualw (mgr.24569) 7211 : cluster [DBG] pgmap v6212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:55:57.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:56.013431+0000 mgr.smithi067.rdualw (mgr.24569) 7211 : cluster [DBG] pgmap v6212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:55:59.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:55:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:55:58.014093+0000 mgr.smithi067.rdualw (mgr.24569) 7212 : cluster [DBG] pgmap v6213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:55:59.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:55:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:55:58.014093+0000 mgr.smithi067.rdualw (mgr.24569) 7212 : cluster [DBG] pgmap v6213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:01.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:00.014705+0000 mgr.smithi067.rdualw (mgr.24569) 7213 : cluster [DBG] pgmap v6214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:01.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:00.014705+0000 mgr.smithi067.rdualw (mgr.24569) 7213 : cluster [DBG] pgmap v6214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:02.120 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:56:02.497 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:56:02.497 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 79s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:56:02.498 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 79s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:56:02.498 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 82s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:56:02.498 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 79s ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:56:02.499 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 79s ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:56:02.499 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 82s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:56:02.500 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 79s ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:56:02.500 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 82s ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:56:02.500 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 79s ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:56:02.500 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 82s ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:56:02.500 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 79s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:56:02.501 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 82s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:56:02.501 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 79s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:56:02.501 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 82s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:56:02.502 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 79s ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:56:02.503 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 79s ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:56:02.503 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 79s ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:56:02.503 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 79s ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:56:02.504 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 82s ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:56:02.504 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 82s ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:56:02.505 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 82s ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:56:02.505 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 82s ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:56:02.506 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 79s ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:56:02.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:02.015704+0000 mgr.smithi067.rdualw (mgr.24569) 7214 : cluster [DBG] pgmap v6215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:02.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:02.015704+0000 mgr.smithi067.rdualw (mgr.24569) 7214 : cluster [DBG] pgmap v6215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:02.837 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:56:02.838 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:56:02.838 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:56:02.838 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:56:02.838 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:56:02.839 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:56:02.839 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:56:02.839 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:56:02.839 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:56:02.840 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:56:02.840 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:56:02.840 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:56:02.840 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:56:02.841 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:56:02.841 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:56:02.841 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:56:02.841 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:56:02.842 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:56:02.842 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:56:03.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:56:02.107996+0000 mgr.smithi067.rdualw (mgr.24569) 7215 : audit [DBG] from='client.38950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:56:03.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:56:02.480331+0000 mgr.smithi067.rdualw (mgr.24569) 7216 : audit [DBG] from='client.38954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:56:03.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:56:02.837261+0000 mon.smithi061 (mon.0) 1589 : audit [DBG] from='client.? 172.21.15.61:0/3396116213' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:56:03.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:56:02.107996+0000 mgr.smithi067.rdualw (mgr.24569) 7215 : audit [DBG] from='client.38950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:56:03.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:56:02.480331+0000 mgr.smithi067.rdualw (mgr.24569) 7216 : audit [DBG] from='client.38954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:56:03.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:56:02.837261+0000 mon.smithi061 (mon.0) 1589 : audit [DBG] from='client.? 172.21.15.61:0/3396116213' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:56:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:04.016265+0000 mgr.smithi067.rdualw (mgr.24569) 7217 : cluster [DBG] pgmap v6216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:04.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:04.016265+0000 mgr.smithi067.rdualw (mgr.24569) 7217 : cluster [DBG] pgmap v6216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:07.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:06.017321+0000 mgr.smithi067.rdualw (mgr.24569) 7218 : cluster [DBG] pgmap v6217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:56:07.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:06.017321+0000 mgr.smithi067.rdualw (mgr.24569) 7218 : cluster [DBG] pgmap v6217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:56:09.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:08.017866+0000 mgr.smithi067.rdualw (mgr.24569) 7219 : cluster [DBG] pgmap v6218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:09.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:08.017866+0000 mgr.smithi067.rdualw (mgr.24569) 7219 : cluster [DBG] pgmap v6218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:11.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:10.018477+0000 mgr.smithi067.rdualw (mgr.24569) 7220 : cluster [DBG] pgmap v6219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:11.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:10.018477+0000 mgr.smithi067.rdualw (mgr.24569) 7220 : cluster [DBG] pgmap v6219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:12.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:12.019447+0000 mgr.smithi067.rdualw (mgr.24569) 7221 : cluster [DBG] pgmap v6220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:12.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:12.019447+0000 mgr.smithi067.rdualw (mgr.24569) 7221 : cluster [DBG] pgmap v6220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:15.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:14.019971+0000 mgr.smithi067.rdualw (mgr.24569) 7222 : cluster [DBG] pgmap v6221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:15.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:14.019971+0000 mgr.smithi067.rdualw (mgr.24569) 7222 : cluster [DBG] pgmap v6221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:17.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:16.020988+0000 mgr.smithi067.rdualw (mgr.24569) 7223 : cluster [DBG] pgmap v6222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:56:17.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:16.020988+0000 mgr.smithi067.rdualw (mgr.24569) 7223 : cluster [DBG] pgmap v6222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:56:19.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:18.021677+0000 mgr.smithi067.rdualw (mgr.24569) 7224 : cluster [DBG] pgmap v6223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:19.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:18.021677+0000 mgr.smithi067.rdualw (mgr.24569) 7224 : cluster [DBG] pgmap v6223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:21.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:20.022277+0000 mgr.smithi067.rdualw (mgr.24569) 7225 : cluster [DBG] pgmap v6224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:21.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:20.022277+0000 mgr.smithi067.rdualw (mgr.24569) 7225 : cluster [DBG] pgmap v6224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:22.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:22.023188+0000 mgr.smithi067.rdualw (mgr.24569) 7226 : cluster [DBG] pgmap v6225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:22.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:22.023188+0000 mgr.smithi067.rdualw (mgr.24569) 7226 : cluster [DBG] pgmap v6225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:25.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:24.023853+0000 mgr.smithi067.rdualw (mgr.24569) 7227 : cluster [DBG] pgmap v6226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:25.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:24.023853+0000 mgr.smithi067.rdualw (mgr.24569) 7227 : cluster [DBG] pgmap v6226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:27.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:26.024747+0000 mgr.smithi067.rdualw (mgr.24569) 7228 : cluster [DBG] pgmap v6227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:56:27.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:26.024747+0000 mgr.smithi067.rdualw (mgr.24569) 7228 : cluster [DBG] pgmap v6227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:56:29.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:28.025481+0000 mgr.smithi067.rdualw (mgr.24569) 7229 : cluster [DBG] pgmap v6228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:29.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:28.025481+0000 mgr.smithi067.rdualw (mgr.24569) 7229 : cluster [DBG] pgmap v6228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:31.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:30.026196+0000 mgr.smithi067.rdualw (mgr.24569) 7230 : cluster [DBG] pgmap v6229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:31.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:30.026196+0000 mgr.smithi067.rdualw (mgr.24569) 7230 : cluster [DBG] pgmap v6229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:32.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:32.027230+0000 mgr.smithi067.rdualw (mgr.24569) 7231 : cluster [DBG] pgmap v6230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:32.027230+0000 mgr.smithi067.rdualw (mgr.24569) 7231 : cluster [DBG] pgmap v6230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:33.144 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:56:33.486 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:56:33.486 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 110s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:56:33.486 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 110s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:56:33.487 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 113s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:56:33.487 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 110s ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:56:33.487 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 110s ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:56:33.487 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 113s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:56:33.488 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 110s ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:56:33.488 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 113s ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:56:33.488 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 110s ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:56:33.488 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 113s ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:56:33.489 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 110s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:56:33.489 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 113s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:56:33.489 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 110s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:56:33.489 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 113s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:56:33.489 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 110s ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:56:33.490 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 110s ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:56:33.490 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 110s ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:56:33.490 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 110s ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:56:33.491 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 113s ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:56:33.491 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 113s ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:56:33.491 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 113s ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:56:33.491 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 113s ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:56:33.492 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 110s ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:56:33.830 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:56:33.831 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:56:33.831 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:56:33.831 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:56:33.831 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:56:33.832 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:56:33.832 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:56:33.832 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:56:33.832 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:56:33.832 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:56:33.833 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:56:33.833 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:56:33.833 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:56:33.833 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:56:33.834 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:56:33.834 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:56:33.834 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:56:33.834 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:56:33.834 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:56:34.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:56:33.830079+0000 mon.smithi061 (mon.0) 1590 : audit [DBG] from='client.? 172.21.15.61:0/2935155391' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:56:34.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:56:33.830079+0000 mon.smithi061 (mon.0) 1590 : audit [DBG] from='client.? 172.21.15.61:0/2935155391' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:56:35.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:56:33.132463+0000 mgr.smithi067.rdualw (mgr.24569) 7232 : audit [DBG] from='client.38962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:56:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:56:33.469264+0000 mgr.smithi067.rdualw (mgr.24569) 7233 : audit [DBG] from='client.38966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:56:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:34.027954+0000 mgr.smithi067.rdualw (mgr.24569) 7234 : cluster [DBG] pgmap v6231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:56:33.132463+0000 mgr.smithi067.rdualw (mgr.24569) 7232 : audit [DBG] from='client.38962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:56:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:56:33.469264+0000 mgr.smithi067.rdualw (mgr.24569) 7233 : audit [DBG] from='client.38966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:56:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:34.027954+0000 mgr.smithi067.rdualw (mgr.24569) 7234 : cluster [DBG] pgmap v6231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:36.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:56:35.577342+0000 mon.smithi067 (mon.1) 1109 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:56:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:56:35.577583+0000 mon.smithi061 (mon.0) 1591 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:56:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:56:35.577606+0000 mon.smithi067 (mon.1) 1110 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:56:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:56:35.577944+0000 mon.smithi061 (mon.0) 1592 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:56:36.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:56:35.577342+0000 mon.smithi067 (mon.1) 1109 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:56:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:56:35.577583+0000 mon.smithi061 (mon.0) 1591 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:56:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:56:35.577606+0000 mon.smithi067 (mon.1) 1110 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:56:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:56:35.577944+0000 mon.smithi061 (mon.0) 1592 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:56:37.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:36.028847+0000 mgr.smithi067.rdualw (mgr.24569) 7235 : cluster [DBG] pgmap v6232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:56:37.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:36.028847+0000 mgr.smithi067.rdualw (mgr.24569) 7235 : cluster [DBG] pgmap v6232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:56:39.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:38.029358+0000 mgr.smithi067.rdualw (mgr.24569) 7236 : cluster [DBG] pgmap v6233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:39.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:38.029358+0000 mgr.smithi067.rdualw (mgr.24569) 7236 : cluster [DBG] pgmap v6233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:41.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:40.029996+0000 mgr.smithi067.rdualw (mgr.24569) 7237 : cluster [DBG] pgmap v6234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:41.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:40.029996+0000 mgr.smithi067.rdualw (mgr.24569) 7237 : cluster [DBG] pgmap v6234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:42.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:42.030901+0000 mgr.smithi067.rdualw (mgr.24569) 7238 : cluster [DBG] pgmap v6235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:42.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:42.030901+0000 mgr.smithi067.rdualw (mgr.24569) 7238 : cluster [DBG] pgmap v6235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:56:43.820759+0000 mon.smithi067 (mon.1) 1111 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:56:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:56:43.822310+0000 mon.smithi067 (mon.1) 1112 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:56:44.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:56:43.823317+0000 mon.smithi067 (mon.1) 1113 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:56:44.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:56:43.820759+0000 mon.smithi067 (mon.1) 1111 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:56:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:56:43.822310+0000 mon.smithi067 (mon.1) 1112 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:56:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:56:43.823317+0000 mon.smithi067 (mon.1) 1113 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:56:45.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:56:43.824205+0000 mgr.smithi067.rdualw (mgr.24569) 7239 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:56:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:44.031519+0000 mgr.smithi067.rdualw (mgr.24569) 7240 : cluster [DBG] pgmap v6236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:56:44.181481+0000 mon.smithi061 (mon.0) 1593 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:56:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:56:44.200140+0000 mon.smithi061 (mon.0) 1594 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:56:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:56:44.603823+0000 mon.smithi061 (mon.0) 1595 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:56:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:56:44.609331+0000 mon.smithi061 (mon.0) 1596 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:56:45.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:56:43.824205+0000 mgr.smithi067.rdualw (mgr.24569) 7239 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:56:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:44.031519+0000 mgr.smithi067.rdualw (mgr.24569) 7240 : cluster [DBG] pgmap v6236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:56:44.181481+0000 mon.smithi061 (mon.0) 1593 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:56:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:56:44.200140+0000 mon.smithi061 (mon.0) 1594 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:56:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:56:44.603823+0000 mon.smithi061 (mon.0) 1595 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:56:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:56:44.609331+0000 mon.smithi061 (mon.0) 1596 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:56:47.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:46.032404+0000 mgr.smithi067.rdualw (mgr.24569) 7241 : cluster [DBG] pgmap v6237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:56:47.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:46.032404+0000 mgr.smithi067.rdualw (mgr.24569) 7241 : cluster [DBG] pgmap v6237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:56:49.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:48.032949+0000 mgr.smithi067.rdualw (mgr.24569) 7242 : cluster [DBG] pgmap v6238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:49.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:48.032949+0000 mgr.smithi067.rdualw (mgr.24569) 7242 : cluster [DBG] pgmap v6238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:51.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:50.033505+0000 mgr.smithi067.rdualw (mgr.24569) 7243 : cluster [DBG] pgmap v6239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:51.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:50.033505+0000 mgr.smithi067.rdualw (mgr.24569) 7243 : cluster [DBG] pgmap v6239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:52.034267+0000 mgr.smithi067.rdualw (mgr.24569) 7244 : cluster [DBG] pgmap v6240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:52.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:52.034267+0000 mgr.smithi067.rdualw (mgr.24569) 7244 : cluster [DBG] pgmap v6240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:55.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:54.034931+0000 mgr.smithi067.rdualw (mgr.24569) 7245 : cluster [DBG] pgmap v6241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:55.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:54.034931+0000 mgr.smithi067.rdualw (mgr.24569) 7245 : cluster [DBG] pgmap v6241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:57.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:56.035793+0000 mgr.smithi067.rdualw (mgr.24569) 7246 : cluster [DBG] pgmap v6242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:56:57.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:56.035793+0000 mgr.smithi067.rdualw (mgr.24569) 7246 : cluster [DBG] pgmap v6242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:56:59.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:56:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:56:58.036373+0000 mgr.smithi067.rdualw (mgr.24569) 7247 : cluster [DBG] pgmap v6243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:56:59.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:56:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:56:58.036373+0000 mgr.smithi067.rdualw (mgr.24569) 7247 : cluster [DBG] pgmap v6243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:01.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:00.037053+0000 mgr.smithi067.rdualw (mgr.24569) 7248 : cluster [DBG] pgmap v6244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:01.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:00.037053+0000 mgr.smithi067.rdualw (mgr.24569) 7248 : cluster [DBG] pgmap v6244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:02.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:02.037910+0000 mgr.smithi067.rdualw (mgr.24569) 7249 : cluster [DBG] pgmap v6245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:02.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:02.037910+0000 mgr.smithi067.rdualw (mgr.24569) 7249 : cluster [DBG] pgmap v6245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:04.139 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:57:04.427 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:57:04.428 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 2m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:57:04.428 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 2m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:57:04.428 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 2m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:57:04.428 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 2m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:57:04.428 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 2m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:57:04.429 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 2m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:57:04.429 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 2m ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:57:04.429 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 2m ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:57:04.429 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 2m ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:57:04.430 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 2m ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:57:04.430 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 2m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:57:04.430 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 2m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:57:04.430 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 2m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:57:04.430 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 2m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:57:04.431 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 2m ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:57:04.431 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 2m ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:57:04.431 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 2m ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:57:04.431 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 2m ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:57:04.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 2m ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:57:04.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 2m ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:57:04.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 2m ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:57:04.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 2m ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:57:04.432 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 2m ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:57:04.787 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:57:04.787 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:57:04.787 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:57:04.787 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:57:04.788 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:57:04.788 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:57:04.788 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:57:04.788 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:57:04.789 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:57:04.789 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:57:04.789 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:57:04.789 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:57:04.789 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:57:04.790 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:57:04.790 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:57:04.790 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:57:04.790 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:57:04.791 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:57:04.791 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:57:05.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:04.038614+0000 mgr.smithi067.rdualw (mgr.24569) 7250 : cluster [DBG] pgmap v6246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:05.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:57:04.786540+0000 mon.smithi061 (mon.0) 1597 : audit [DBG] from='client.? 172.21.15.61:0/3989487237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:57:05.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:04.038614+0000 mgr.smithi067.rdualw (mgr.24569) 7250 : cluster [DBG] pgmap v6246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:05.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:57:04.786540+0000 mon.smithi061 (mon.0) 1597 : audit [DBG] from='client.? 172.21.15.61:0/3989487237' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:57:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:57:04.126478+0000 mgr.smithi067.rdualw (mgr.24569) 7251 : audit [DBG] from='client.38974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:57:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:57:04.410746+0000 mgr.smithi067.rdualw (mgr.24569) 7252 : audit [DBG] from='client.38978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:57:06.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:57:04.126478+0000 mgr.smithi067.rdualw (mgr.24569) 7251 : audit [DBG] from='client.38974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:57:06.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:57:04.410746+0000 mgr.smithi067.rdualw (mgr.24569) 7252 : audit [DBG] from='client.38978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:57:07.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:06.039440+0000 mgr.smithi067.rdualw (mgr.24569) 7253 : cluster [DBG] pgmap v6247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:57:07.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:06.039440+0000 mgr.smithi067.rdualw (mgr.24569) 7253 : cluster [DBG] pgmap v6247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:57:09.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:08.039963+0000 mgr.smithi067.rdualw (mgr.24569) 7254 : cluster [DBG] pgmap v6248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:09.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:08.039963+0000 mgr.smithi067.rdualw (mgr.24569) 7254 : cluster [DBG] pgmap v6248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:11.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:10.040712+0000 mgr.smithi067.rdualw (mgr.24569) 7255 : cluster [DBG] pgmap v6249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:11.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:10.040712+0000 mgr.smithi067.rdualw (mgr.24569) 7255 : cluster [DBG] pgmap v6249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:12.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:12.041591+0000 mgr.smithi067.rdualw (mgr.24569) 7256 : cluster [DBG] pgmap v6250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:12.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:12.041591+0000 mgr.smithi067.rdualw (mgr.24569) 7256 : cluster [DBG] pgmap v6250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:15.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:14.042372+0000 mgr.smithi067.rdualw (mgr.24569) 7257 : cluster [DBG] pgmap v6251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:15.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:14.042372+0000 mgr.smithi067.rdualw (mgr.24569) 7257 : cluster [DBG] pgmap v6251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:17.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:16.043147+0000 mgr.smithi067.rdualw (mgr.24569) 7258 : cluster [DBG] pgmap v6252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:57:17.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:16.043147+0000 mgr.smithi067.rdualw (mgr.24569) 7258 : cluster [DBG] pgmap v6252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:57:19.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:18.043663+0000 mgr.smithi067.rdualw (mgr.24569) 7259 : cluster [DBG] pgmap v6253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:19.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:18.043663+0000 mgr.smithi067.rdualw (mgr.24569) 7259 : cluster [DBG] pgmap v6253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:21.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:20.044228+0000 mgr.smithi067.rdualw (mgr.24569) 7260 : cluster [DBG] pgmap v6254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:21.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:20.044228+0000 mgr.smithi067.rdualw (mgr.24569) 7260 : cluster [DBG] pgmap v6254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:22.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:22.045142+0000 mgr.smithi067.rdualw (mgr.24569) 7261 : cluster [DBG] pgmap v6255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:22.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:22.045142+0000 mgr.smithi067.rdualw (mgr.24569) 7261 : cluster [DBG] pgmap v6255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:25.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:24.045896+0000 mgr.smithi067.rdualw (mgr.24569) 7262 : cluster [DBG] pgmap v6256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:25.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:24.045896+0000 mgr.smithi067.rdualw (mgr.24569) 7262 : cluster [DBG] pgmap v6256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:27.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:26.046926+0000 mgr.smithi067.rdualw (mgr.24569) 7263 : cluster [DBG] pgmap v6257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:57:27.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:26.046926+0000 mgr.smithi067.rdualw (mgr.24569) 7263 : cluster [DBG] pgmap v6257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:57:29.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:28.047461+0000 mgr.smithi067.rdualw (mgr.24569) 7264 : cluster [DBG] pgmap v6258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:29.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:28.047461+0000 mgr.smithi067.rdualw (mgr.24569) 7264 : cluster [DBG] pgmap v6258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:31.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:30.048075+0000 mgr.smithi067.rdualw (mgr.24569) 7265 : cluster [DBG] pgmap v6259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:31.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:30.048075+0000 mgr.smithi067.rdualw (mgr.24569) 7265 : cluster [DBG] pgmap v6259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:32.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:32.049183+0000 mgr.smithi067.rdualw (mgr.24569) 7266 : cluster [DBG] pgmap v6260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:32.049183+0000 mgr.smithi067.rdualw (mgr.24569) 7266 : cluster [DBG] pgmap v6260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:35.108 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:57:35.401 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:57:35.402 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 2m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:57:35.402 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 2m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:57:35.402 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 2m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:57:35.402 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 2m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:57:35.403 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 2m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:57:35.403 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 2m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:57:35.403 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 2m ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:57:35.403 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 2m ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:57:35.404 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 2m ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:57:35.404 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 2m ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:57:35.404 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 2m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:57:35.404 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 2m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:57:35.405 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 2m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:57:35.405 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 2m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:57:35.405 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 2m ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:57:35.405 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 2m ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:57:35.405 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 2m ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:57:35.406 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 2m ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:57:35.406 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 2m ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:57:35.406 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 2m ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:57:35.406 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 2m ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:57:35.407 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 2m ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:57:35.407 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 2m ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:57:35.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:34.049891+0000 mgr.smithi067.rdualw (mgr.24569) 7267 : cluster [DBG] pgmap v6261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:35.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:34.049891+0000 mgr.smithi067.rdualw (mgr.24569) 7267 : cluster [DBG] pgmap v6261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:35.744 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:57:35.744 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:57:35.745 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:57:35.745 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:57:35.745 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:57:35.745 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:57:35.745 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:57:35.746 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:57:35.746 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:57:35.746 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:57:35.746 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:57:35.747 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:57:35.747 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:57:35.748 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:57:35.748 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:57:35.748 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:57:35.748 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:57:35.749 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:57:35.749 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:57:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:57:35.095184+0000 mgr.smithi067.rdualw (mgr.24569) 7268 : audit [DBG] from='client.38986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:57:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:57:35.582365+0000 mon.smithi067 (mon.1) 1114 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:57:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:57:35.582634+0000 mon.smithi067 (mon.1) 1115 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:57:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:57:35.582663+0000 mon.smithi061 (mon.0) 1598 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:57:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:57:35.582962+0000 mon.smithi061 (mon.0) 1599 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:57:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:57:35.743803+0000 mon.smithi061 (mon.0) 1600 : audit [DBG] from='client.? 172.21.15.61:0/1156746796' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:57:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:57:35.095184+0000 mgr.smithi067.rdualw (mgr.24569) 7268 : audit [DBG] from='client.38986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:57:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:57:35.582365+0000 mon.smithi067 (mon.1) 1114 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:57:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:57:35.582634+0000 mon.smithi067 (mon.1) 1115 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:57:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:57:35.582663+0000 mon.smithi061 (mon.0) 1598 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:57:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:57:35.582962+0000 mon.smithi061 (mon.0) 1599 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:57:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:57:35.743803+0000 mon.smithi061 (mon.0) 1600 : audit [DBG] from='client.? 172.21.15.61:0/1156746796' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:57:37.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:57:35.384681+0000 mgr.smithi067.rdualw (mgr.24569) 7269 : audit [DBG] from='client.38990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:57:37.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:36.050835+0000 mgr.smithi067.rdualw (mgr.24569) 7270 : cluster [DBG] pgmap v6262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:57:37.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:57:35.384681+0000 mgr.smithi067.rdualw (mgr.24569) 7269 : audit [DBG] from='client.38990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:57:37.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:36.050835+0000 mgr.smithi067.rdualw (mgr.24569) 7270 : cluster [DBG] pgmap v6262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:57:39.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:38.051380+0000 mgr.smithi067.rdualw (mgr.24569) 7271 : cluster [DBG] pgmap v6263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:39.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:38.051380+0000 mgr.smithi067.rdualw (mgr.24569) 7271 : cluster [DBG] pgmap v6263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:41.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:40.051976+0000 mgr.smithi067.rdualw (mgr.24569) 7272 : cluster [DBG] pgmap v6264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:41.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:40.051976+0000 mgr.smithi067.rdualw (mgr.24569) 7272 : cluster [DBG] pgmap v6264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:42.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:42.052849+0000 mgr.smithi067.rdualw (mgr.24569) 7273 : cluster [DBG] pgmap v6265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:42.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:42.052849+0000 mgr.smithi067.rdualw (mgr.24569) 7273 : cluster [DBG] pgmap v6265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:45.476 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:44.053487+0000 mgr.smithi067.rdualw (mgr.24569) 7274 : cluster [DBG] pgmap v6266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:45.477 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:57:44.614790+0000 mon.smithi067 (mon.1) 1116 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:57:45.477 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:57:44.616243+0000 mon.smithi067 (mon.1) 1117 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:57:45.477 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:57:44.617227+0000 mon.smithi067 (mon.1) 1118 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:57:45.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:44.053487+0000 mgr.smithi067.rdualw (mgr.24569) 7274 : cluster [DBG] pgmap v6266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:45.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:57:44.614790+0000 mon.smithi067 (mon.1) 1116 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:57:45.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:57:44.616243+0000 mon.smithi067 (mon.1) 1117 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:57:45.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:57:44.617227+0000 mon.smithi067 (mon.1) 1118 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:57:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:57:44.618119+0000 mgr.smithi067.rdualw (mgr.24569) 7275 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:57:46.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:57:44.618119+0000 mgr.smithi067.rdualw (mgr.24569) 7275 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:57:47.389 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:46.054471+0000 mgr.smithi067.rdualw (mgr.24569) 7276 : cluster [DBG] pgmap v6267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:57:47.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:46.054471+0000 mgr.smithi067.rdualw (mgr.24569) 7276 : cluster [DBG] pgmap v6267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:57:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:57:47.745371+0000 mon.smithi061 (mon.0) 1601 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:57:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:48.054984+0000 mgr.smithi067.rdualw (mgr.24569) 7277 : cluster [DBG] pgmap v6268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:57:48.156624+0000 mon.smithi061 (mon.0) 1602 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:57:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:57:48.164004+0000 mon.smithi061 (mon.0) 1603 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:57:49.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:57:47.745371+0000 mon.smithi061 (mon.0) 1601 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:57:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:48.054984+0000 mgr.smithi067.rdualw (mgr.24569) 7277 : cluster [DBG] pgmap v6268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:57:48.156624+0000 mon.smithi061 (mon.0) 1602 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:57:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:57:48.164004+0000 mon.smithi061 (mon.0) 1603 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:57:51.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:50.055590+0000 mgr.smithi067.rdualw (mgr.24569) 7278 : cluster [DBG] pgmap v6269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:51.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:50.055590+0000 mgr.smithi067.rdualw (mgr.24569) 7278 : cluster [DBG] pgmap v6269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:52.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:52.056461+0000 mgr.smithi067.rdualw (mgr.24569) 7279 : cluster [DBG] pgmap v6270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:52.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:52.056461+0000 mgr.smithi067.rdualw (mgr.24569) 7279 : cluster [DBG] pgmap v6270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:55.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:54.057238+0000 mgr.smithi067.rdualw (mgr.24569) 7280 : cluster [DBG] pgmap v6271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:55.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:54.057238+0000 mgr.smithi067.rdualw (mgr.24569) 7280 : cluster [DBG] pgmap v6271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:57.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:56.058121+0000 mgr.smithi067.rdualw (mgr.24569) 7281 : cluster [DBG] pgmap v6272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:57:57.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:56.058121+0000 mgr.smithi067.rdualw (mgr.24569) 7281 : cluster [DBG] pgmap v6272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:57:59.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:57:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:57:58.058733+0000 mgr.smithi067.rdualw (mgr.24569) 7282 : cluster [DBG] pgmap v6273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:57:59.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:57:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:57:58.058733+0000 mgr.smithi067.rdualw (mgr.24569) 7282 : cluster [DBG] pgmap v6273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:01.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:00.059272+0000 mgr.smithi067.rdualw (mgr.24569) 7283 : cluster [DBG] pgmap v6274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:01.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:00.059272+0000 mgr.smithi067.rdualw (mgr.24569) 7283 : cluster [DBG] pgmap v6274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:02.060160+0000 mgr.smithi067.rdualw (mgr.24569) 7284 : cluster [DBG] pgmap v6275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:02.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:02.060160+0000 mgr.smithi067.rdualw (mgr.24569) 7284 : cluster [DBG] pgmap v6275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:05.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:04.060753+0000 mgr.smithi067.rdualw (mgr.24569) 7285 : cluster [DBG] pgmap v6276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:05.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:04.060753+0000 mgr.smithi067.rdualw (mgr.24569) 7285 : cluster [DBG] pgmap v6276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:06.100 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:58:06.392 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:58:06.393 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 3m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:58:06.393 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 3m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:58:06.394 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 3m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:58:06.394 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 3m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:58:06.394 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 3m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:58:06.395 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 3m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:58:06.395 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 3m ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:58:06.395 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 3m ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:58:06.396 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 3m ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:58:06.396 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 3m ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:58:06.397 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 3m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:58:06.397 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 3m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:58:06.397 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 3m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:58:06.397 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 3m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:58:06.398 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 3m ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:58:06.398 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 3m ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:58:06.398 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 3m ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:58:06.398 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 3m ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:58:06.399 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 3m ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:58:06.399 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 3m ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:58:06.399 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 3m ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:58:06.399 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 3m ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:58:06.400 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 3m ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:58:06.735 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:58:06.735 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:58:06.736 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:58:06.736 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:58:06.736 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:58:06.736 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:58:06.737 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:58:06.737 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:58:06.737 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:58:06.737 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:58:06.737 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:58:06.738 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:58:06.738 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:58:06.738 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:58:06.738 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:58:06.739 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:58:06.739 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:58:06.739 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:58:06.739 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:58:07.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:06.061800+0000 mgr.smithi067.rdualw (mgr.24569) 7286 : cluster [DBG] pgmap v6277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:58:07.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:58:06.087895+0000 mgr.smithi067.rdualw (mgr.24569) 7287 : audit [DBG] from='client.38998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:58:07.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:58:06.734955+0000 mon.smithi061 (mon.0) 1604 : audit [DBG] from='client.? 172.21.15.61:0/2589738837' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:58:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:06.061800+0000 mgr.smithi067.rdualw (mgr.24569) 7286 : cluster [DBG] pgmap v6277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:58:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:58:06.087895+0000 mgr.smithi067.rdualw (mgr.24569) 7287 : audit [DBG] from='client.38998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:58:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:58:06.734955+0000 mon.smithi061 (mon.0) 1604 : audit [DBG] from='client.? 172.21.15.61:0/2589738837' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:58:08.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:58:06.375612+0000 mgr.smithi067.rdualw (mgr.24569) 7288 : audit [DBG] from='client.39002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:58:08.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:58:06.375612+0000 mgr.smithi067.rdualw (mgr.24569) 7288 : audit [DBG] from='client.39002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:58:09.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:08.062385+0000 mgr.smithi067.rdualw (mgr.24569) 7289 : cluster [DBG] pgmap v6278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:09.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:08.062385+0000 mgr.smithi067.rdualw (mgr.24569) 7289 : cluster [DBG] pgmap v6278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:10.063163+0000 mgr.smithi067.rdualw (mgr.24569) 7290 : cluster [DBG] pgmap v6279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:10.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:10.063163+0000 mgr.smithi067.rdualw (mgr.24569) 7290 : cluster [DBG] pgmap v6279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:12.064083+0000 mgr.smithi067.rdualw (mgr.24569) 7291 : cluster [DBG] pgmap v6280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:12.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:12.064083+0000 mgr.smithi067.rdualw (mgr.24569) 7291 : cluster [DBG] pgmap v6280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:15.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:14.064724+0000 mgr.smithi067.rdualw (mgr.24569) 7292 : cluster [DBG] pgmap v6281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:15.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:14.064724+0000 mgr.smithi067.rdualw (mgr.24569) 7292 : cluster [DBG] pgmap v6281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:17.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:16.065512+0000 mgr.smithi067.rdualw (mgr.24569) 7293 : cluster [DBG] pgmap v6282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:58:17.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:16.065512+0000 mgr.smithi067.rdualw (mgr.24569) 7293 : cluster [DBG] pgmap v6282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:58:18.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:18.066158+0000 mgr.smithi067.rdualw (mgr.24569) 7294 : cluster [DBG] pgmap v6283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:18.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:18.066158+0000 mgr.smithi067.rdualw (mgr.24569) 7294 : cluster [DBG] pgmap v6283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:21.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:20.066901+0000 mgr.smithi067.rdualw (mgr.24569) 7295 : cluster [DBG] pgmap v6284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:21.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:20.066901+0000 mgr.smithi067.rdualw (mgr.24569) 7295 : cluster [DBG] pgmap v6284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:22.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:22.067785+0000 mgr.smithi067.rdualw (mgr.24569) 7296 : cluster [DBG] pgmap v6285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:22.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:22.067785+0000 mgr.smithi067.rdualw (mgr.24569) 7296 : cluster [DBG] pgmap v6285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:25.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:24.068347+0000 mgr.smithi067.rdualw (mgr.24569) 7297 : cluster [DBG] pgmap v6286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:25.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:24.068347+0000 mgr.smithi067.rdualw (mgr.24569) 7297 : cluster [DBG] pgmap v6286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:26.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:26.069147+0000 mgr.smithi067.rdualw (mgr.24569) 7298 : cluster [DBG] pgmap v6287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:58:26.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:26.069147+0000 mgr.smithi067.rdualw (mgr.24569) 7298 : cluster [DBG] pgmap v6287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:58:29.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:28.069696+0000 mgr.smithi067.rdualw (mgr.24569) 7299 : cluster [DBG] pgmap v6288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:29.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:28.069696+0000 mgr.smithi067.rdualw (mgr.24569) 7299 : cluster [DBG] pgmap v6288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:30.070449+0000 mgr.smithi067.rdualw (mgr.24569) 7300 : cluster [DBG] pgmap v6289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:30.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:30.070449+0000 mgr.smithi067.rdualw (mgr.24569) 7300 : cluster [DBG] pgmap v6289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:32.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:32.071341+0000 mgr.smithi067.rdualw (mgr.24569) 7301 : cluster [DBG] pgmap v6290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:32.071341+0000 mgr.smithi067.rdualw (mgr.24569) 7301 : cluster [DBG] pgmap v6290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:35.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:34.071915+0000 mgr.smithi067.rdualw (mgr.24569) 7302 : cluster [DBG] pgmap v6291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:35.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:34.071915+0000 mgr.smithi067.rdualw (mgr.24569) 7302 : cluster [DBG] pgmap v6291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:36.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:58:35.587997+0000 mon.smithi067 (mon.1) 1119 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:58:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:58:35.588249+0000 mon.smithi067 (mon.1) 1120 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:58:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:58:35.588291+0000 mon.smithi061 (mon.0) 1605 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:58:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:58:35.588654+0000 mon.smithi061 (mon.0) 1606 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:58:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:36.072975+0000 mgr.smithi067.rdualw (mgr.24569) 7303 : cluster [DBG] pgmap v6292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:58:36.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:58:35.587997+0000 mon.smithi067 (mon.1) 1119 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:58:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:58:35.588249+0000 mon.smithi067 (mon.1) 1120 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:58:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:58:35.588291+0000 mon.smithi061 (mon.0) 1605 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:58:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:58:35.588654+0000 mon.smithi061 (mon.0) 1606 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:58:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:36.072975+0000 mgr.smithi067.rdualw (mgr.24569) 7303 : cluster [DBG] pgmap v6292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:58:37.044 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:58:37.339 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:58:37.340 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 3m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:58:37.340 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 3m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:58:37.340 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 3m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:58:37.340 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 3m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:58:37.341 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 3m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:58:37.341 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 3m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:58:37.341 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 3m ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:58:37.341 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 3m ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:58:37.341 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 3m ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:58:37.342 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 3m ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:58:37.342 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 3m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:58:37.342 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 3m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:58:37.342 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 3m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:58:37.343 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 3m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:58:37.343 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 3m ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:58:37.343 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 3m ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:58:37.343 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 3m ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:58:37.344 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 3m ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:58:37.344 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 3m ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:58:37.344 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 3m ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:58:37.345 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 3m ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:58:37.345 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 3m ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:58:37.345 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 3m ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:58:37.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:58:37.032254+0000 mgr.smithi067.rdualw (mgr.24569) 7304 : audit [DBG] from='client.39010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:58:37.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:58:37.032254+0000 mgr.smithi067.rdualw (mgr.24569) 7304 : audit [DBG] from='client.39010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:58:37.680 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:58:37.680 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:58:37.681 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:58:37.681 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:58:37.681 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:58:37.681 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:58:37.682 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:58:37.682 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:58:37.682 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:58:37.682 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:58:37.683 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:58:37.683 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:58:37.683 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:58:37.683 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:58:37.683 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:58:37.684 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:58:37.684 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:58:37.684 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:58:37.684 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:58:38.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:58:37.322882+0000 mgr.smithi067.rdualw (mgr.24569) 7305 : audit [DBG] from='client.39014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:58:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:58:37.679969+0000 mon.smithi061 (mon.0) 1607 : audit [DBG] from='client.? 172.21.15.61:0/3080984981' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:58:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:38.073484+0000 mgr.smithi067.rdualw (mgr.24569) 7306 : cluster [DBG] pgmap v6293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:38.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:58:37.322882+0000 mgr.smithi067.rdualw (mgr.24569) 7305 : audit [DBG] from='client.39014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:58:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:58:37.679969+0000 mon.smithi061 (mon.0) 1607 : audit [DBG] from='client.? 172.21.15.61:0/3080984981' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:58:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:38.073484+0000 mgr.smithi067.rdualw (mgr.24569) 7306 : cluster [DBG] pgmap v6293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:40.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:40.074196+0000 mgr.smithi067.rdualw (mgr.24569) 7307 : cluster [DBG] pgmap v6294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:40.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:40.074196+0000 mgr.smithi067.rdualw (mgr.24569) 7307 : cluster [DBG] pgmap v6294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:42.075216+0000 mgr.smithi067.rdualw (mgr.24569) 7308 : cluster [DBG] pgmap v6295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:42.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:42.075216+0000 mgr.smithi067.rdualw (mgr.24569) 7308 : cluster [DBG] pgmap v6295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:44.075793+0000 mgr.smithi067.rdualw (mgr.24569) 7309 : cluster [DBG] pgmap v6296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:44.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:44.075793+0000 mgr.smithi067.rdualw (mgr.24569) 7309 : cluster [DBG] pgmap v6296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:46.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:46.076611+0000 mgr.smithi067.rdualw (mgr.24569) 7310 : cluster [DBG] pgmap v6297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:58:46.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:46.076611+0000 mgr.smithi067.rdualw (mgr.24569) 7310 : cluster [DBG] pgmap v6297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:58:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:48.077143+0000 mgr.smithi067.rdualw (mgr.24569) 7311 : cluster [DBG] pgmap v6298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:58:48.168443+0000 mon.smithi067 (mon.1) 1121 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:58:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:58:48.169904+0000 mon.smithi067 (mon.1) 1122 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:58:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:58:48.170861+0000 mon.smithi067 (mon.1) 1123 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:58:48.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:48.077143+0000 mgr.smithi067.rdualw (mgr.24569) 7311 : cluster [DBG] pgmap v6298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:58:48.168443+0000 mon.smithi067 (mon.1) 1121 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:58:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:58:48.169904+0000 mon.smithi067 (mon.1) 1122 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:58:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:58:48.170861+0000 mon.smithi067 (mon.1) 1123 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:58:49.548 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:58:48.171716+0000 mgr.smithi067.rdualw (mgr.24569) 7312 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:58:49.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:58:48.171716+0000 mgr.smithi067.rdualw (mgr.24569) 7312 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:58:50.461 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:50.077718+0000 mgr.smithi067.rdualw (mgr.24569) 7313 : cluster [DBG] pgmap v6299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:50.077718+0000 mgr.smithi067.rdualw (mgr.24569) 7313 : cluster [DBG] pgmap v6299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:52.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:58:51.183099+0000 mon.smithi061 (mon.0) 1608 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:58:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:58:51.573786+0000 mon.smithi061 (mon.0) 1609 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:58:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:58:51.581663+0000 mon.smithi061 (mon.0) 1610 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:58:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:52.078432+0000 mgr.smithi067.rdualw (mgr.24569) 7314 : cluster [DBG] pgmap v6300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:52.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:58:51.183099+0000 mon.smithi061 (mon.0) 1608 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:58:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:58:51.573786+0000 mon.smithi061 (mon.0) 1609 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:58:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:58:51.581663+0000 mon.smithi061 (mon.0) 1610 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:58:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:52.078432+0000 mgr.smithi067.rdualw (mgr.24569) 7314 : cluster [DBG] pgmap v6300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:54.079121+0000 mgr.smithi067.rdualw (mgr.24569) 7315 : cluster [DBG] pgmap v6301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:54.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:54.079121+0000 mgr.smithi067.rdualw (mgr.24569) 7315 : cluster [DBG] pgmap v6301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:56.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:56.080066+0000 mgr.smithi067.rdualw (mgr.24569) 7316 : cluster [DBG] pgmap v6302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:58:56.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:56.080066+0000 mgr.smithi067.rdualw (mgr.24569) 7316 : cluster [DBG] pgmap v6302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:58:58.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:58:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:58:58.080704+0000 mgr.smithi067.rdualw (mgr.24569) 7317 : cluster [DBG] pgmap v6303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:58:58.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:58:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:58:58.080704+0000 mgr.smithi067.rdualw (mgr.24569) 7317 : cluster [DBG] pgmap v6303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:00.081470+0000 mgr.smithi067.rdualw (mgr.24569) 7318 : cluster [DBG] pgmap v6304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:00.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:00.081470+0000 mgr.smithi067.rdualw (mgr.24569) 7318 : cluster [DBG] pgmap v6304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:02.082463+0000 mgr.smithi067.rdualw (mgr.24569) 7319 : cluster [DBG] pgmap v6305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:02.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:02.082463+0000 mgr.smithi067.rdualw (mgr.24569) 7319 : cluster [DBG] pgmap v6305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:04.083006+0000 mgr.smithi067.rdualw (mgr.24569) 7320 : cluster [DBG] pgmap v6306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:04.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:04.083006+0000 mgr.smithi067.rdualw (mgr.24569) 7320 : cluster [DBG] pgmap v6306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:06.083878+0000 mgr.smithi067.rdualw (mgr.24569) 7321 : cluster [DBG] pgmap v6307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:59:06.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:06.083878+0000 mgr.smithi067.rdualw (mgr.24569) 7321 : cluster [DBG] pgmap v6307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:59:07.986 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:59:08.283 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:59:08.283 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 4m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:59:08.283 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 4m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 4m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 4m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 4m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:59:08.284 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 4m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 4m ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 4m ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 4m ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 4m ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:59:08.285 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 4m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 4m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 4m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 4m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:59:08.286 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 4m ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:59:08.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 4m ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:59:08.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 4m ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:59:08.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 4m ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:59:08.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 4m ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:59:08.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 4m ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:59:08.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 4m ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:59:08.289 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 4m ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:59:08.289 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 4m ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:59:08.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:59:07.973726+0000 mgr.smithi067.rdualw (mgr.24569) 7322 : audit [DBG] from='client.39022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:59:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:08.084376+0000 mgr.smithi067.rdualw (mgr.24569) 7323 : cluster [DBG] pgmap v6308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:08.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:59:07.973726+0000 mgr.smithi067.rdualw (mgr.24569) 7322 : audit [DBG] from='client.39022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:59:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:08.084376+0000 mgr.smithi067.rdualw (mgr.24569) 7323 : cluster [DBG] pgmap v6308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:08.624 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:59:08.625 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:59:08.625 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:59:08.625 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:59:08.626 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:59:08.626 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:59:08.626 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:59:08.626 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:59:08.626 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:59:08.627 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:59:08.627 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:59:08.627 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:59:08.627 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:59:08.628 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:59:08.628 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:59:08.628 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:59:08.628 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:59:08.628 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:59:08.629 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:59:09.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:59:08.266555+0000 mgr.smithi067.rdualw (mgr.24569) 7324 : audit [DBG] from='client.39026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:59:09.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:59:08.624300+0000 mon.smithi061 (mon.0) 1611 : audit [DBG] from='client.? 172.21.15.61:0/840002522' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:59:09.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:59:08.266555+0000 mgr.smithi067.rdualw (mgr.24569) 7324 : audit [DBG] from='client.39026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:59:09.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:59:08.624300+0000 mon.smithi061 (mon.0) 1611 : audit [DBG] from='client.? 172.21.15.61:0/840002522' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:59:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:10.085120+0000 mgr.smithi067.rdualw (mgr.24569) 7325 : cluster [DBG] pgmap v6309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:10.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:10.085120+0000 mgr.smithi067.rdualw (mgr.24569) 7325 : cluster [DBG] pgmap v6309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:12.086143+0000 mgr.smithi067.rdualw (mgr.24569) 7326 : cluster [DBG] pgmap v6310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:12.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:12.086143+0000 mgr.smithi067.rdualw (mgr.24569) 7326 : cluster [DBG] pgmap v6310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:14.086725+0000 mgr.smithi067.rdualw (mgr.24569) 7327 : cluster [DBG] pgmap v6311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:14.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:14.086725+0000 mgr.smithi067.rdualw (mgr.24569) 7327 : cluster [DBG] pgmap v6311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:16.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:16.087629+0000 mgr.smithi067.rdualw (mgr.24569) 7328 : cluster [DBG] pgmap v6312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:59:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:16.087629+0000 mgr.smithi067.rdualw (mgr.24569) 7328 : cluster [DBG] pgmap v6312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:59:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:18.088168+0000 mgr.smithi067.rdualw (mgr.24569) 7329 : cluster [DBG] pgmap v6313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:18.088168+0000 mgr.smithi067.rdualw (mgr.24569) 7329 : cluster [DBG] pgmap v6313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:20.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:20.088978+0000 mgr.smithi067.rdualw (mgr.24569) 7330 : cluster [DBG] pgmap v6314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:20.088978+0000 mgr.smithi067.rdualw (mgr.24569) 7330 : cluster [DBG] pgmap v6314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:22.089794+0000 mgr.smithi067.rdualw (mgr.24569) 7331 : cluster [DBG] pgmap v6315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:22.089794+0000 mgr.smithi067.rdualw (mgr.24569) 7331 : cluster [DBG] pgmap v6315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:24.090340+0000 mgr.smithi067.rdualw (mgr.24569) 7332 : cluster [DBG] pgmap v6316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:24.090340+0000 mgr.smithi067.rdualw (mgr.24569) 7332 : cluster [DBG] pgmap v6316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:26.091244+0000 mgr.smithi067.rdualw (mgr.24569) 7333 : cluster [DBG] pgmap v6317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:59:26.672 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:26.091244+0000 mgr.smithi067.rdualw (mgr.24569) 7333 : cluster [DBG] pgmap v6317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:59:28.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:28.091963+0000 mgr.smithi067.rdualw (mgr.24569) 7334 : cluster [DBG] pgmap v6318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:28.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:28.091963+0000 mgr.smithi067.rdualw (mgr.24569) 7334 : cluster [DBG] pgmap v6318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:30.092787+0000 mgr.smithi067.rdualw (mgr.24569) 7335 : cluster [DBG] pgmap v6319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:30.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:30.092787+0000 mgr.smithi067.rdualw (mgr.24569) 7335 : cluster [DBG] pgmap v6319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:32.093837+0000 mgr.smithi067.rdualw (mgr.24569) 7336 : cluster [DBG] pgmap v6320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:32.093837+0000 mgr.smithi067.rdualw (mgr.24569) 7336 : cluster [DBG] pgmap v6320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:34.094427+0000 mgr.smithi067.rdualw (mgr.24569) 7337 : cluster [DBG] pgmap v6321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:34.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:34.094427+0000 mgr.smithi067.rdualw (mgr.24569) 7337 : cluster [DBG] pgmap v6321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:59:35.593150+0000 mon.smithi067 (mon.1) 1124 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:59:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:59:35.593402+0000 mon.smithi067 (mon.1) 1125 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:59:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:59:35.593692+0000 mon.smithi061 (mon.0) 1612 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:59:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:59:35.593995+0000 mon.smithi061 (mon.0) 1613 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:59:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:59:35.593150+0000 mon.smithi067 (mon.1) 1124 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:59:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:59:35.593402+0000 mon.smithi067 (mon.1) 1125 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:59:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:59:35.593692+0000 mon.smithi061 (mon.0) 1612 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T18:59:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:59:35.593995+0000 mon.smithi061 (mon.0) 1613 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T18:59:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:36.095292+0000 mgr.smithi067.rdualw (mgr.24569) 7338 : cluster [DBG] pgmap v6322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:59:37.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:36.095292+0000 mgr.smithi067.rdualw (mgr.24569) 7338 : cluster [DBG] pgmap v6322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:59:38.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:38.095851+0000 mgr.smithi067.rdualw (mgr.24569) 7339 : cluster [DBG] pgmap v6323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:38.095851+0000 mgr.smithi067.rdualw (mgr.24569) 7339 : cluster [DBG] pgmap v6323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:38.935 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T18:59:39.230 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T18:59:39.230 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 4m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T18:59:39.230 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 4m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T18:59:39.231 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 4m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T18:59:39.231 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 4m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T18:59:39.231 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 4m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T18:59:39.231 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 4m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T18:59:39.232 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 4m ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T18:59:39.232 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 4m ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T18:59:39.232 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 4m ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T18:59:39.232 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 4m ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T18:59:39.233 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 4m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T18:59:39.233 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 4m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T18:59:39.233 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 4m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T18:59:39.233 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 4m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T18:59:39.233 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 4m ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T18:59:39.234 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 4m ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T18:59:39.234 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 4m ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T18:59:39.234 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 4m ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T18:59:39.234 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 4m ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T18:59:39.235 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 4m ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T18:59:39.235 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 4m ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T18:59:39.235 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 4m ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T18:59:39.235 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 4m ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T18:59:39.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:59:38.922486+0000 mgr.smithi067.rdualw (mgr.24569) 7340 : audit [DBG] from='client.39034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:59:39.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:59:38.922486+0000 mgr.smithi067.rdualw (mgr.24569) 7340 : audit [DBG] from='client.39034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:59:39.685 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T18:59:39.685 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T18:59:39.686 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T18:59:39.686 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:59:39.686 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T18:59:39.686 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:59:39.687 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:59:39.687 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T18:59:39.687 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T18:59:39.687 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T18:59:39.688 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:59:39.688 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T18:59:39.688 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T18:59:39.688 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T18:59:39.688 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T18:59:39.689 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T18:59:39.689 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T18:59:39.689 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T18:59:39.689 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T18:59:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:59:39.213068+0000 mgr.smithi067.rdualw (mgr.24569) 7341 : audit [DBG] from='client.39038 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:59:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:59:39.684646+0000 mon.smithi061 (mon.0) 1614 : audit [DBG] from='client.? 172.21.15.61:0/3306822390' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:59:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:40.096413+0000 mgr.smithi067.rdualw (mgr.24569) 7342 : cluster [DBG] pgmap v6324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:40.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:59:39.213068+0000 mgr.smithi067.rdualw (mgr.24569) 7341 : audit [DBG] from='client.39038 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T18:59:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:59:39.684646+0000 mon.smithi061 (mon.0) 1614 : audit [DBG] from='client.? 172.21.15.61:0/3306822390' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T18:59:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:40.096413+0000 mgr.smithi067.rdualw (mgr.24569) 7342 : cluster [DBG] pgmap v6324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:42.097344+0000 mgr.smithi067.rdualw (mgr.24569) 7343 : cluster [DBG] pgmap v6325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:42.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:42.097344+0000 mgr.smithi067.rdualw (mgr.24569) 7343 : cluster [DBG] pgmap v6325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:44.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:44.097911+0000 mgr.smithi067.rdualw (mgr.24569) 7344 : cluster [DBG] pgmap v6326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:44.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:44.097911+0000 mgr.smithi067.rdualw (mgr.24569) 7344 : cluster [DBG] pgmap v6326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:46.098733+0000 mgr.smithi067.rdualw (mgr.24569) 7345 : cluster [DBG] pgmap v6327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:59:46.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:46.098733+0000 mgr.smithi067.rdualw (mgr.24569) 7345 : cluster [DBG] pgmap v6327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:59:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:48.099248+0000 mgr.smithi067.rdualw (mgr.24569) 7346 : cluster [DBG] pgmap v6328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:48.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:48.099248+0000 mgr.smithi067.rdualw (mgr.24569) 7346 : cluster [DBG] pgmap v6328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:50.099935+0000 mgr.smithi067.rdualw (mgr.24569) 7347 : cluster [DBG] pgmap v6329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:50.099935+0000 mgr.smithi067.rdualw (mgr.24569) 7347 : cluster [DBG] pgmap v6329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:59:51.585530+0000 mon.smithi067 (mon.1) 1126 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:59:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:59:51.587079+0000 mon.smithi067 (mon.1) 1127 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:59:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:59:51.588012+0000 mon.smithi067 (mon.1) 1128 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:59:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T18:59:51.588832+0000 mgr.smithi067.rdualw (mgr.24569) 7348 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:59:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:59:51.996896+0000 mon.smithi061 (mon.0) 1615 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:59:52.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T18:59:52.004334+0000 mon.smithi061 (mon.0) 1616 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:59:52.556 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:52.100782+0000 mgr.smithi067.rdualw (mgr.24569) 7349 : cluster [DBG] pgmap v6330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:59:51.585530+0000 mon.smithi067 (mon.1) 1126 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T18:59:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:59:51.587079+0000 mon.smithi067 (mon.1) 1127 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T18:59:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:59:51.588012+0000 mon.smithi067 (mon.1) 1128 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T18:59:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T18:59:51.588832+0000 mgr.smithi067.rdualw (mgr.24569) 7348 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T18:59:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:59:51.996896+0000 mon.smithi061 (mon.0) 1615 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:59:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T18:59:52.004334+0000 mon.smithi061 (mon.0) 1616 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T18:59:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:52.100782+0000 mgr.smithi067.rdualw (mgr.24569) 7349 : cluster [DBG] pgmap v6330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:54.101513+0000 mgr.smithi067.rdualw (mgr.24569) 7350 : cluster [DBG] pgmap v6331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:54.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:54.101513+0000 mgr.smithi067.rdualw (mgr.24569) 7350 : cluster [DBG] pgmap v6331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:56.102442+0000 mgr.smithi067.rdualw (mgr.24569) 7351 : cluster [DBG] pgmap v6332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:59:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:56.102442+0000 mgr.smithi067.rdualw (mgr.24569) 7351 : cluster [DBG] pgmap v6332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T18:59:58.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 18:59:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T18:59:58.102917+0000 mgr.smithi067.rdualw (mgr.24569) 7352 : cluster [DBG] pgmap v6333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T18:59:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 18:59:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T18:59:58.102917+0000 mgr.smithi067.rdualw (mgr.24569) 7352 : cluster [DBG] pgmap v6333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:00.000103+0000 mon.smithi061 (mon.0) 1617 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T19:00:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:00.000103+0000 mon.smithi061 (mon.0) 1617 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T19:00:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:00.103602+0000 mgr.smithi067.rdualw (mgr.24569) 7353 : cluster [DBG] pgmap v6334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:01.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:00.103602+0000 mgr.smithi067.rdualw (mgr.24569) 7353 : cluster [DBG] pgmap v6334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:02.104566+0000 mgr.smithi067.rdualw (mgr.24569) 7354 : cluster [DBG] pgmap v6335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:02.104566+0000 mgr.smithi067.rdualw (mgr.24569) 7354 : cluster [DBG] pgmap v6335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:04.105188+0000 mgr.smithi067.rdualw (mgr.24569) 7355 : cluster [DBG] pgmap v6336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:04.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:04.105188+0000 mgr.smithi067.rdualw (mgr.24569) 7355 : cluster [DBG] pgmap v6336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:06.106177+0000 mgr.smithi067.rdualw (mgr.24569) 7356 : cluster [DBG] pgmap v6337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:00:06.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:06.106177+0000 mgr.smithi067.rdualw (mgr.24569) 7356 : cluster [DBG] pgmap v6337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:00:08.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:08.106709+0000 mgr.smithi067.rdualw (mgr.24569) 7357 : cluster [DBG] pgmap v6338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:08.106709+0000 mgr.smithi067.rdualw (mgr.24569) 7357 : cluster [DBG] pgmap v6338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:09.994 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:00:10.303 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:00:10.304 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 5m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:00:10.304 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 5m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:00:10.304 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 5m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:00:10.304 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 5m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:00:10.305 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 5m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:00:10.305 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 5m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:00:10.305 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 5m ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:00:10.305 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 5m ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:00:10.305 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 5m ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:00:10.306 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 5m ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:00:10.306 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 5m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:00:10.306 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 5m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:00:10.307 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 5m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:00:10.307 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 5m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:00:10.307 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 5m ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:00:10.307 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 5m ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:00:10.307 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 5m ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:00:10.308 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 5m ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:00:10.308 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 5m ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:00:10.308 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 5m ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:00:10.308 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 5m ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:00:10.309 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 5m ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:00:10.309 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 5m ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:00:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:00:09.981259+0000 mgr.smithi067.rdualw (mgr.24569) 7358 : audit [DBG] from='client.39046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:00:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:10.107434+0000 mgr.smithi067.rdualw (mgr.24569) 7359 : cluster [DBG] pgmap v6339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:10.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:00:09.981259+0000 mgr.smithi067.rdualw (mgr.24569) 7358 : audit [DBG] from='client.39046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:00:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:10.107434+0000 mgr.smithi067.rdualw (mgr.24569) 7359 : cluster [DBG] pgmap v6339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:10.672 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:00:10.672 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:00:10.673 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:00:10.673 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:00:10.673 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:00:10.673 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:00:10.674 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:00:10.674 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:00:10.674 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:00:10.674 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:00:10.675 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:00:10.675 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:00:10.675 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:00:10.675 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:00:10.676 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:00:10.676 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:00:10.676 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:00:10.676 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:00:10.677 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:00:11.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:00:10.286398+0000 mgr.smithi067.rdualw (mgr.24569) 7360 : audit [DBG] from='client.39050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:00:11.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:00:10.668427+0000 mon.smithi061 (mon.0) 1618 : audit [DBG] from='client.? 172.21.15.61:0/4003072843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:00:11.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:00:10.286398+0000 mgr.smithi067.rdualw (mgr.24569) 7360 : audit [DBG] from='client.39050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:00:11.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:00:10.668427+0000 mon.smithi061 (mon.0) 1618 : audit [DBG] from='client.? 172.21.15.61:0/4003072843' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:00:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:12.108299+0000 mgr.smithi067.rdualw (mgr.24569) 7361 : cluster [DBG] pgmap v6340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:12.108299+0000 mgr.smithi067.rdualw (mgr.24569) 7361 : cluster [DBG] pgmap v6340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:14.108987+0000 mgr.smithi067.rdualw (mgr.24569) 7362 : cluster [DBG] pgmap v6341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:14.108987+0000 mgr.smithi067.rdualw (mgr.24569) 7362 : cluster [DBG] pgmap v6341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:16.109815+0000 mgr.smithi067.rdualw (mgr.24569) 7363 : cluster [DBG] pgmap v6342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:00:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:16.109815+0000 mgr.smithi067.rdualw (mgr.24569) 7363 : cluster [DBG] pgmap v6342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:00:18.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:18.110423+0000 mgr.smithi067.rdualw (mgr.24569) 7364 : cluster [DBG] pgmap v6343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:18.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:18.110423+0000 mgr.smithi067.rdualw (mgr.24569) 7364 : cluster [DBG] pgmap v6343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:20.111053+0000 mgr.smithi067.rdualw (mgr.24569) 7365 : cluster [DBG] pgmap v6344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:20.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:20.111053+0000 mgr.smithi067.rdualw (mgr.24569) 7365 : cluster [DBG] pgmap v6344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:22.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:22.112153+0000 mgr.smithi067.rdualw (mgr.24569) 7366 : cluster [DBG] pgmap v6345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:22.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:22.112153+0000 mgr.smithi067.rdualw (mgr.24569) 7366 : cluster [DBG] pgmap v6345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:24.112969+0000 mgr.smithi067.rdualw (mgr.24569) 7367 : cluster [DBG] pgmap v6346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:24.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:24.112969+0000 mgr.smithi067.rdualw (mgr.24569) 7367 : cluster [DBG] pgmap v6346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:26.113800+0000 mgr.smithi067.rdualw (mgr.24569) 7368 : cluster [DBG] pgmap v6347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:00:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:26.113800+0000 mgr.smithi067.rdualw (mgr.24569) 7368 : cluster [DBG] pgmap v6347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:00:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:28.114247+0000 mgr.smithi067.rdualw (mgr.24569) 7369 : cluster [DBG] pgmap v6348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:28.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:28.114247+0000 mgr.smithi067.rdualw (mgr.24569) 7369 : cluster [DBG] pgmap v6348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:30.115090+0000 mgr.smithi067.rdualw (mgr.24569) 7370 : cluster [DBG] pgmap v6349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:30.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:30.115090+0000 mgr.smithi067.rdualw (mgr.24569) 7370 : cluster [DBG] pgmap v6349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:32.116017+0000 mgr.smithi067.rdualw (mgr.24569) 7371 : cluster [DBG] pgmap v6350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:32.116017+0000 mgr.smithi067.rdualw (mgr.24569) 7371 : cluster [DBG] pgmap v6350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:34.116613+0000 mgr.smithi067.rdualw (mgr.24569) 7372 : cluster [DBG] pgmap v6351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:34.116613+0000 mgr.smithi067.rdualw (mgr.24569) 7372 : cluster [DBG] pgmap v6351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:00:35.598759+0000 mon.smithi067 (mon.1) 1129 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:00:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:00:35.599000+0000 mon.smithi067 (mon.1) 1130 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:00:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:00:35.599304+0000 mon.smithi061 (mon.0) 1619 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:00:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:00:35.599502+0000 mon.smithi061 (mon.0) 1620 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:00:36.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:00:35.598759+0000 mon.smithi067 (mon.1) 1129 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:00:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:00:35.599000+0000 mon.smithi067 (mon.1) 1130 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:00:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:00:35.599304+0000 mon.smithi061 (mon.0) 1619 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:00:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:00:35.599502+0000 mon.smithi061 (mon.0) 1620 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:00:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:36.117587+0000 mgr.smithi067.rdualw (mgr.24569) 7373 : cluster [DBG] pgmap v6352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:00:37.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:36.117587+0000 mgr.smithi067.rdualw (mgr.24569) 7373 : cluster [DBG] pgmap v6352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:00:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:38.118180+0000 mgr.smithi067.rdualw (mgr.24569) 7374 : cluster [DBG] pgmap v6353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:38.118180+0000 mgr.smithi067.rdualw (mgr.24569) 7374 : cluster [DBG] pgmap v6353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:40.118762+0000 mgr.smithi067.rdualw (mgr.24569) 7375 : cluster [DBG] pgmap v6354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:40.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:40.118762+0000 mgr.smithi067.rdualw (mgr.24569) 7375 : cluster [DBG] pgmap v6354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:41.013 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:00:41.402 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:00:41.403 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 5m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:00:41.403 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 5m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:00:41.403 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 6m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:00:41.404 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 5m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:00:41.404 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 5m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:00:41.404 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 6m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:00:41.405 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 5m ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:00:41.405 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 6m ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:00:41.405 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 5m ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:00:41.405 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 6m ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:00:41.405 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 5m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:00:41.406 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 6m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:00:41.406 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 5m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:00:41.406 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 6m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:00:41.407 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 5m ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:00:41.407 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 5m ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:00:41.407 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 5m ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:00:41.407 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 5m ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:00:41.408 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 6m ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:00:41.408 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 6m ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:00:41.408 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 6m ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:00:41.409 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 6m ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:00:41.409 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 5m ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:00:41.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:00:41.000704+0000 mgr.smithi067.rdualw (mgr.24569) 7376 : audit [DBG] from='client.39058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:00:41.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:00:41.000704+0000 mgr.smithi067.rdualw (mgr.24569) 7376 : audit [DBG] from='client.39058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:00:41.746 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:00:41.747 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:00:41.747 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:00:41.747 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:00:41.747 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:00:41.748 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:00:41.748 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:00:41.748 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:00:41.748 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:00:41.749 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:00:41.749 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:00:41.749 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:00:41.749 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:00:41.750 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:00:41.750 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:00:41.750 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:00:41.750 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:00:41.750 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:00:41.751 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:00:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:00:41.386138+0000 mgr.smithi067.rdualw (mgr.24569) 7377 : audit [DBG] from='client.39062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:00:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:00:41.745699+0000 mon.smithi061 (mon.0) 1621 : audit [DBG] from='client.? 172.21.15.61:0/935646575' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:00:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:42.119816+0000 mgr.smithi067.rdualw (mgr.24569) 7378 : cluster [DBG] pgmap v6355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:00:41.386138+0000 mgr.smithi067.rdualw (mgr.24569) 7377 : audit [DBG] from='client.39062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:00:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:00:41.745699+0000 mon.smithi061 (mon.0) 1621 : audit [DBG] from='client.? 172.21.15.61:0/935646575' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:00:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:42.119816+0000 mgr.smithi067.rdualw (mgr.24569) 7378 : cluster [DBG] pgmap v6355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:44.120567+0000 mgr.smithi067.rdualw (mgr.24569) 7379 : cluster [DBG] pgmap v6356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:44.120567+0000 mgr.smithi067.rdualw (mgr.24569) 7379 : cluster [DBG] pgmap v6356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:46.121623+0000 mgr.smithi067.rdualw (mgr.24569) 7380 : cluster [DBG] pgmap v6357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:00:46.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:46.121623+0000 mgr.smithi067.rdualw (mgr.24569) 7380 : cluster [DBG] pgmap v6357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:00:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:48.122203+0000 mgr.smithi067.rdualw (mgr.24569) 7381 : cluster [DBG] pgmap v6358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:48.122203+0000 mgr.smithi067.rdualw (mgr.24569) 7381 : cluster [DBG] pgmap v6358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:50.122829+0000 mgr.smithi067.rdualw (mgr.24569) 7382 : cluster [DBG] pgmap v6359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:50.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:50.122829+0000 mgr.smithi067.rdualw (mgr.24569) 7382 : cluster [DBG] pgmap v6359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:00:52.007774+0000 mon.smithi067 (mon.1) 1131 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:00:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:00:52.009262+0000 mon.smithi067 (mon.1) 1132 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:00:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:00:52.010166+0000 mon.smithi067 (mon.1) 1133 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:00:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:00:52.010974+0000 mgr.smithi067.rdualw (mgr.24569) 7383 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:00:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:52.123810+0000 mgr.smithi067.rdualw (mgr.24569) 7384 : cluster [DBG] pgmap v6360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:00:52.007774+0000 mon.smithi067 (mon.1) 1131 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:00:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:00:52.009262+0000 mon.smithi067 (mon.1) 1132 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:00:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:00:52.010166+0000 mon.smithi067 (mon.1) 1133 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:00:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:00:52.010974+0000 mgr.smithi067.rdualw (mgr.24569) 7383 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:00:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:52.123810+0000 mgr.smithi067.rdualw (mgr.24569) 7384 : cluster [DBG] pgmap v6360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:53.793 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:00:52.411806+0000 mon.smithi061 (mon.0) 1622 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:00:53.794 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:00:52.420012+0000 mon.smithi061 (mon.0) 1623 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:00:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:00:52.411806+0000 mon.smithi061 (mon.0) 1622 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:00:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:00:52.420012+0000 mon.smithi061 (mon.0) 1623 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:00:54.794 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:54.124606+0000 mgr.smithi067.rdualw (mgr.24569) 7385 : cluster [DBG] pgmap v6361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:54.124606+0000 mgr.smithi067.rdualw (mgr.24569) 7385 : cluster [DBG] pgmap v6361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:56.125471+0000 mgr.smithi067.rdualw (mgr.24569) 7386 : cluster [DBG] pgmap v6362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:00:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:56.125471+0000 mgr.smithi067.rdualw (mgr.24569) 7386 : cluster [DBG] pgmap v6362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:00:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:00:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:00:58.126063+0000 mgr.smithi067.rdualw (mgr.24569) 7387 : cluster [DBG] pgmap v6363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:00:58.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:00:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:00:58.126063+0000 mgr.smithi067.rdualw (mgr.24569) 7387 : cluster [DBG] pgmap v6363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:00.126815+0000 mgr.smithi067.rdualw (mgr.24569) 7388 : cluster [DBG] pgmap v6364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:00.126815+0000 mgr.smithi067.rdualw (mgr.24569) 7388 : cluster [DBG] pgmap v6364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:02.127828+0000 mgr.smithi067.rdualw (mgr.24569) 7389 : cluster [DBG] pgmap v6365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:02.127828+0000 mgr.smithi067.rdualw (mgr.24569) 7389 : cluster [DBG] pgmap v6365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:04.128676+0000 mgr.smithi067.rdualw (mgr.24569) 7390 : cluster [DBG] pgmap v6366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:04.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:04.128676+0000 mgr.smithi067.rdualw (mgr.24569) 7390 : cluster [DBG] pgmap v6366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:06.129547+0000 mgr.smithi067.rdualw (mgr.24569) 7391 : cluster [DBG] pgmap v6367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:01:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:06.129547+0000 mgr.smithi067.rdualw (mgr.24569) 7391 : cluster [DBG] pgmap v6367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:01:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:08.130194+0000 mgr.smithi067.rdualw (mgr.24569) 7392 : cluster [DBG] pgmap v6368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:08.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:08.130194+0000 mgr.smithi067.rdualw (mgr.24569) 7392 : cluster [DBG] pgmap v6368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:10.130911+0000 mgr.smithi067.rdualw (mgr.24569) 7393 : cluster [DBG] pgmap v6369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:10.130911+0000 mgr.smithi067.rdualw (mgr.24569) 7393 : cluster [DBG] pgmap v6369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:12.065 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:01:12.383 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:01:12.383 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 6m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:01:12.383 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 6m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:01:12.383 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 6m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:01:12.384 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 6m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:01:12.384 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 6m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:01:12.384 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 6m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:01:12.384 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 6m ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:01:12.385 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 6m ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:01:12.385 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 6m ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:01:12.385 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 6m ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:01:12.385 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 6m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:01:12.385 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 6m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:01:12.386 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 6m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:01:12.386 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 6m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:01:12.386 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 6m ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:01:12.386 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 6m ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:01:12.387 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 6m ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:01:12.387 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 6m ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:01:12.387 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 6m ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:01:12.388 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 6m ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:01:12.388 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 6m ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:01:12.388 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 6m ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:01:12.388 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 6m ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:01:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:01:12.052838+0000 mgr.smithi067.rdualw (mgr.24569) 7394 : audit [DBG] from='client.39070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:01:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:12.131683+0000 mgr.smithi067.rdualw (mgr.24569) 7395 : cluster [DBG] pgmap v6370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:01:12.052838+0000 mgr.smithi067.rdualw (mgr.24569) 7394 : audit [DBG] from='client.39070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:01:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:12.131683+0000 mgr.smithi067.rdualw (mgr.24569) 7395 : cluster [DBG] pgmap v6370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:12.725 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:01:12.725 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:01:12.726 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:01:12.726 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:01:12.726 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:01:12.727 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:01:12.727 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:01:12.727 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:01:12.727 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:01:12.728 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:01:12.728 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:01:12.728 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:01:12.728 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:01:12.729 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:01:12.729 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:01:12.729 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:01:12.729 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:01:12.729 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:01:12.730 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:01:13.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:01:12.366389+0000 mgr.smithi067.rdualw (mgr.24569) 7396 : audit [DBG] from='client.39074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:01:13.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:01:12.724439+0000 mon.smithi061 (mon.0) 1624 : audit [DBG] from='client.? 172.21.15.61:0/2862238808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:01:13.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:01:12.366389+0000 mgr.smithi067.rdualw (mgr.24569) 7396 : audit [DBG] from='client.39074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:01:13.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:01:12.724439+0000 mon.smithi061 (mon.0) 1624 : audit [DBG] from='client.? 172.21.15.61:0/2862238808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:01:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:14.132562+0000 mgr.smithi067.rdualw (mgr.24569) 7397 : cluster [DBG] pgmap v6371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:14.132562+0000 mgr.smithi067.rdualw (mgr.24569) 7397 : cluster [DBG] pgmap v6371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:16.133408+0000 mgr.smithi067.rdualw (mgr.24569) 7398 : cluster [DBG] pgmap v6372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:01:16.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:16.133408+0000 mgr.smithi067.rdualw (mgr.24569) 7398 : cluster [DBG] pgmap v6372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:01:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:18.133993+0000 mgr.smithi067.rdualw (mgr.24569) 7399 : cluster [DBG] pgmap v6373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:18.133993+0000 mgr.smithi067.rdualw (mgr.24569) 7399 : cluster [DBG] pgmap v6373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:20.134585+0000 mgr.smithi067.rdualw (mgr.24569) 7400 : cluster [DBG] pgmap v6374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:20.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:20.134585+0000 mgr.smithi067.rdualw (mgr.24569) 7400 : cluster [DBG] pgmap v6374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:22.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:22.135410+0000 mgr.smithi067.rdualw (mgr.24569) 7401 : cluster [DBG] pgmap v6375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:22.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:22.135410+0000 mgr.smithi067.rdualw (mgr.24569) 7401 : cluster [DBG] pgmap v6375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:24.136068+0000 mgr.smithi067.rdualw (mgr.24569) 7402 : cluster [DBG] pgmap v6376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:24.136068+0000 mgr.smithi067.rdualw (mgr.24569) 7402 : cluster [DBG] pgmap v6376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:26.136988+0000 mgr.smithi067.rdualw (mgr.24569) 7403 : cluster [DBG] pgmap v6377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:01:26.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:26.136988+0000 mgr.smithi067.rdualw (mgr.24569) 7403 : cluster [DBG] pgmap v6377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:01:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:28.137515+0000 mgr.smithi067.rdualw (mgr.24569) 7404 : cluster [DBG] pgmap v6378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:28.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:28.137515+0000 mgr.smithi067.rdualw (mgr.24569) 7404 : cluster [DBG] pgmap v6378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:30.138324+0000 mgr.smithi067.rdualw (mgr.24569) 7405 : cluster [DBG] pgmap v6379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:30.138324+0000 mgr.smithi067.rdualw (mgr.24569) 7405 : cluster [DBG] pgmap v6379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:32.139364+0000 mgr.smithi067.rdualw (mgr.24569) 7406 : cluster [DBG] pgmap v6380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:32.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:32.139364+0000 mgr.smithi067.rdualw (mgr.24569) 7406 : cluster [DBG] pgmap v6380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:34.139975+0000 mgr.smithi067.rdualw (mgr.24569) 7407 : cluster [DBG] pgmap v6381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:34.139975+0000 mgr.smithi067.rdualw (mgr.24569) 7407 : cluster [DBG] pgmap v6381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:01:35.603823+0000 mon.smithi067 (mon.1) 1134 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:01:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:01:35.604097+0000 mon.smithi067 (mon.1) 1135 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:01:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:01:35.604146+0000 mon.smithi061 (mon.0) 1625 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:01:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:01:35.604654+0000 mon.smithi061 (mon.0) 1626 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:01:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:01:35.603823+0000 mon.smithi067 (mon.1) 1134 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:01:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:01:35.604097+0000 mon.smithi067 (mon.1) 1135 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:01:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:01:35.604146+0000 mon.smithi061 (mon.0) 1625 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:01:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:01:35.604654+0000 mon.smithi061 (mon.0) 1626 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:01:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:36.140822+0000 mgr.smithi067.rdualw (mgr.24569) 7408 : cluster [DBG] pgmap v6382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:01:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:36.140822+0000 mgr.smithi067.rdualw (mgr.24569) 7408 : cluster [DBG] pgmap v6382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:01:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:38.141311+0000 mgr.smithi067.rdualw (mgr.24569) 7409 : cluster [DBG] pgmap v6383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:38.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:38.141311+0000 mgr.smithi067.rdualw (mgr.24569) 7409 : cluster [DBG] pgmap v6383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:40.142142+0000 mgr.smithi067.rdualw (mgr.24569) 7410 : cluster [DBG] pgmap v6384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:40.142142+0000 mgr.smithi067.rdualw (mgr.24569) 7410 : cluster [DBG] pgmap v6384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:42.143018+0000 mgr.smithi067.rdualw (mgr.24569) 7411 : cluster [DBG] pgmap v6385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:42.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:42.143018+0000 mgr.smithi067.rdualw (mgr.24569) 7411 : cluster [DBG] pgmap v6385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:43.032 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:01:43.346 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:01:43.346 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 7m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:01:43.346 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 7m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:01:43.347 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 7m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:01:43.347 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 7m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:01:43.347 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 7m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:01:43.347 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 7m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:01:43.347 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 7m ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:01:43.348 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 7m ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:01:43.348 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 7m ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:01:43.348 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 7m ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:01:43.348 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 7m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:01:43.349 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 7m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:01:43.349 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 7m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:01:43.349 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 7m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:01:43.349 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 7m ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:01:43.350 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 7m ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:01:43.350 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 7m ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:01:43.350 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 7m ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:01:43.350 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 7m ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:01:43.351 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 7m ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:01:43.351 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 7m ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:01:43.351 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 7m ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:01:43.351 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 7m ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:01:43.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:01:43.019701+0000 mgr.smithi067.rdualw (mgr.24569) 7412 : audit [DBG] from='client.39082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:01:43.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:01:43.019701+0000 mgr.smithi067.rdualw (mgr.24569) 7412 : audit [DBG] from='client.39082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:01:43.769 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:01:43.770 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:01:43.770 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:01:43.770 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:01:43.770 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:01:43.770 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:01:43.771 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:01:43.771 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:01:43.771 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:01:43.771 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:01:43.772 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:01:43.772 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:01:43.772 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:01:43.772 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:01:43.772 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:01:43.773 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:01:43.773 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:01:43.773 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:01:43.773 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:01:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:01:43.329200+0000 mgr.smithi067.rdualw (mgr.24569) 7413 : audit [DBG] from='client.39086 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:01:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:01:43.768842+0000 mon.smithi061 (mon.0) 1627 : audit [DBG] from='client.? 172.21.15.61:0/3988933105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:01:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:44.143578+0000 mgr.smithi067.rdualw (mgr.24569) 7414 : cluster [DBG] pgmap v6386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:44.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:01:43.329200+0000 mgr.smithi067.rdualw (mgr.24569) 7413 : audit [DBG] from='client.39086 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:01:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:01:43.768842+0000 mon.smithi061 (mon.0) 1627 : audit [DBG] from='client.? 172.21.15.61:0/3988933105' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:01:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:44.143578+0000 mgr.smithi067.rdualw (mgr.24569) 7414 : cluster [DBG] pgmap v6386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:46.144369+0000 mgr.smithi067.rdualw (mgr.24569) 7415 : cluster [DBG] pgmap v6387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:01:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:46.144369+0000 mgr.smithi067.rdualw (mgr.24569) 7415 : cluster [DBG] pgmap v6387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:01:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:48.144991+0000 mgr.smithi067.rdualw (mgr.24569) 7416 : cluster [DBG] pgmap v6388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:48.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:48.144991+0000 mgr.smithi067.rdualw (mgr.24569) 7416 : cluster [DBG] pgmap v6388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:50.145756+0000 mgr.smithi067.rdualw (mgr.24569) 7417 : cluster [DBG] pgmap v6389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:50.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:50.145756+0000 mgr.smithi067.rdualw (mgr.24569) 7417 : cluster [DBG] pgmap v6389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:52.146863+0000 mgr.smithi067.rdualw (mgr.24569) 7418 : cluster [DBG] pgmap v6390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:52.146863+0000 mgr.smithi067.rdualw (mgr.24569) 7418 : cluster [DBG] pgmap v6390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:53.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:01:52.423704+0000 mon.smithi067 (mon.1) 1136 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:01:53.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:01:52.425241+0000 mon.smithi067 (mon.1) 1137 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:01:53.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:01:52.426145+0000 mon.smithi067 (mon.1) 1138 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:01:53.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:01:52.426975+0000 mgr.smithi067.rdualw (mgr.24569) 7419 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:01:53.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:01:52.845929+0000 mon.smithi061 (mon.0) 1628 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:01:53.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:01:52.851703+0000 mon.smithi061 (mon.0) 1629 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:01:53.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:01:52.423704+0000 mon.smithi067 (mon.1) 1136 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:01:53.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:01:52.425241+0000 mon.smithi067 (mon.1) 1137 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:01:53.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:01:52.426145+0000 mon.smithi067 (mon.1) 1138 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:01:53.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:01:52.426975+0000 mgr.smithi067.rdualw (mgr.24569) 7419 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:01:53.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:01:52.845929+0000 mon.smithi061 (mon.0) 1628 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:01:53.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:01:52.851703+0000 mon.smithi061 (mon.0) 1629 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:01:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:54.147427+0000 mgr.smithi067.rdualw (mgr.24569) 7420 : cluster [DBG] pgmap v6391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:54.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:54.147427+0000 mgr.smithi067.rdualw (mgr.24569) 7420 : cluster [DBG] pgmap v6391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:56.148321+0000 mgr.smithi067.rdualw (mgr.24569) 7421 : cluster [DBG] pgmap v6392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:01:56.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:56.148321+0000 mgr.smithi067.rdualw (mgr.24569) 7421 : cluster [DBG] pgmap v6392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:01:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:01:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:01:58.148891+0000 mgr.smithi067.rdualw (mgr.24569) 7422 : cluster [DBG] pgmap v6393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:01:58.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:01:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:01:58.148891+0000 mgr.smithi067.rdualw (mgr.24569) 7422 : cluster [DBG] pgmap v6393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:00.149601+0000 mgr.smithi067.rdualw (mgr.24569) 7423 : cluster [DBG] pgmap v6394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:00.149601+0000 mgr.smithi067.rdualw (mgr.24569) 7423 : cluster [DBG] pgmap v6394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:02.150484+0000 mgr.smithi067.rdualw (mgr.24569) 7424 : cluster [DBG] pgmap v6395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:02.150484+0000 mgr.smithi067.rdualw (mgr.24569) 7424 : cluster [DBG] pgmap v6395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:04.151177+0000 mgr.smithi067.rdualw (mgr.24569) 7425 : cluster [DBG] pgmap v6396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:04.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:04.151177+0000 mgr.smithi067.rdualw (mgr.24569) 7425 : cluster [DBG] pgmap v6396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:06.550 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:06.152228+0000 mgr.smithi067.rdualw (mgr.24569) 7426 : cluster [DBG] pgmap v6397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:02:06.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:06.152228+0000 mgr.smithi067.rdualw (mgr.24569) 7426 : cluster [DBG] pgmap v6397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:02:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:08.152936+0000 mgr.smithi067.rdualw (mgr.24569) 7427 : cluster [DBG] pgmap v6398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:08.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:08.152936+0000 mgr.smithi067.rdualw (mgr.24569) 7427 : cluster [DBG] pgmap v6398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:10.153446+0000 mgr.smithi067.rdualw (mgr.24569) 7428 : cluster [DBG] pgmap v6399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:10.153446+0000 mgr.smithi067.rdualw (mgr.24569) 7428 : cluster [DBG] pgmap v6399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:12.154290+0000 mgr.smithi067.rdualw (mgr.24569) 7429 : cluster [DBG] pgmap v6400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:12.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:12.154290+0000 mgr.smithi067.rdualw (mgr.24569) 7429 : cluster [DBG] pgmap v6400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:14.076 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:02:14.372 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:02:14.372 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 7m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:02:14.373 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 7m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:02:14.373 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 7m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:02:14.373 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 7m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:02:14.373 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 7m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:02:14.374 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 7m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:02:14.374 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 7m ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:02:14.374 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 7m ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:02:14.374 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 7m ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:02:14.374 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 7m ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:02:14.375 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 7m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:02:14.375 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 7m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:02:14.375 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 7m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:02:14.375 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 7m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:02:14.376 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 7m ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:02:14.376 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 7m ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:02:14.376 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 7m ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:02:14.376 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 7m ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:02:14.376 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 7m ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:02:14.377 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 7m ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:02:14.377 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 7m ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:02:14.377 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 7m ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:02:14.377 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 7m ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:02:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:02:14.064103+0000 mgr.smithi067.rdualw (mgr.24569) 7430 : audit [DBG] from='client.39094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:02:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:14.154816+0000 mgr.smithi067.rdualw (mgr.24569) 7431 : cluster [DBG] pgmap v6401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:02:14.064103+0000 mgr.smithi067.rdualw (mgr.24569) 7430 : audit [DBG] from='client.39094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:02:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:14.154816+0000 mgr.smithi067.rdualw (mgr.24569) 7431 : cluster [DBG] pgmap v6401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:14.714 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:02:14.715 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:02:14.715 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:02:14.715 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:02:14.715 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:02:14.716 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:02:14.716 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:02:14.716 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:02:14.716 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:02:14.717 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:02:14.717 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:02:14.717 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:02:14.717 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:02:14.717 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:02:14.718 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:02:14.718 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:02:14.718 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:02:14.718 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:02:14.719 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:02:15.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:02:14.355003+0000 mgr.smithi067.rdualw (mgr.24569) 7432 : audit [DBG] from='client.39098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:02:15.606 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:02:14.713829+0000 mon.smithi061 (mon.0) 1630 : audit [DBG] from='client.? 172.21.15.61:0/1019786567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:02:15.607 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:02:14.355003+0000 mgr.smithi067.rdualw (mgr.24569) 7432 : audit [DBG] from='client.39098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:02:15.607 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:02:14.713829+0000 mon.smithi061 (mon.0) 1630 : audit [DBG] from='client.? 172.21.15.61:0/1019786567' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:02:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:16.155679+0000 mgr.smithi067.rdualw (mgr.24569) 7433 : cluster [DBG] pgmap v6402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:02:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:16.155679+0000 mgr.smithi067.rdualw (mgr.24569) 7433 : cluster [DBG] pgmap v6402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:02:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:18.156122+0000 mgr.smithi067.rdualw (mgr.24569) 7434 : cluster [DBG] pgmap v6403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:18.156122+0000 mgr.smithi067.rdualw (mgr.24569) 7434 : cluster [DBG] pgmap v6403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:20.156862+0000 mgr.smithi067.rdualw (mgr.24569) 7435 : cluster [DBG] pgmap v6404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:20.156862+0000 mgr.smithi067.rdualw (mgr.24569) 7435 : cluster [DBG] pgmap v6404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:22.157678+0000 mgr.smithi067.rdualw (mgr.24569) 7436 : cluster [DBG] pgmap v6405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:22.157678+0000 mgr.smithi067.rdualw (mgr.24569) 7436 : cluster [DBG] pgmap v6405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:24.158280+0000 mgr.smithi067.rdualw (mgr.24569) 7437 : cluster [DBG] pgmap v6406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:24.158280+0000 mgr.smithi067.rdualw (mgr.24569) 7437 : cluster [DBG] pgmap v6406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:26.159102+0000 mgr.smithi067.rdualw (mgr.24569) 7438 : cluster [DBG] pgmap v6407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:02:26.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:26.159102+0000 mgr.smithi067.rdualw (mgr.24569) 7438 : cluster [DBG] pgmap v6407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:02:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:28.159780+0000 mgr.smithi067.rdualw (mgr.24569) 7439 : cluster [DBG] pgmap v6408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:28.159780+0000 mgr.smithi067.rdualw (mgr.24569) 7439 : cluster [DBG] pgmap v6408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:30.160348+0000 mgr.smithi067.rdualw (mgr.24569) 7440 : cluster [DBG] pgmap v6409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:30.160348+0000 mgr.smithi067.rdualw (mgr.24569) 7440 : cluster [DBG] pgmap v6409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:32.161116+0000 mgr.smithi067.rdualw (mgr.24569) 7441 : cluster [DBG] pgmap v6410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:32.161116+0000 mgr.smithi067.rdualw (mgr.24569) 7441 : cluster [DBG] pgmap v6410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:34.161687+0000 mgr.smithi067.rdualw (mgr.24569) 7442 : cluster [DBG] pgmap v6411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:34.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:34.161687+0000 mgr.smithi067.rdualw (mgr.24569) 7442 : cluster [DBG] pgmap v6411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:02:35.608956+0000 mon.smithi067 (mon.1) 1139 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:02:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:02:35.609213+0000 mon.smithi067 (mon.1) 1140 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:02:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:02:35.609493+0000 mon.smithi061 (mon.0) 1631 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:02:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:02:35.609970+0000 mon.smithi061 (mon.0) 1632 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:02:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:02:35.608956+0000 mon.smithi067 (mon.1) 1139 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:02:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:02:35.609213+0000 mon.smithi067 (mon.1) 1140 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:02:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:02:35.609493+0000 mon.smithi061 (mon.0) 1631 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:02:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:02:35.609970+0000 mon.smithi061 (mon.0) 1632 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:02:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:36.162658+0000 mgr.smithi067.rdualw (mgr.24569) 7443 : cluster [DBG] pgmap v6412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:02:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:36.162658+0000 mgr.smithi067.rdualw (mgr.24569) 7443 : cluster [DBG] pgmap v6412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:02:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:38.163128+0000 mgr.smithi067.rdualw (mgr.24569) 7444 : cluster [DBG] pgmap v6413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:38.163128+0000 mgr.smithi067.rdualw (mgr.24569) 7444 : cluster [DBG] pgmap v6413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:41.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:40.163704+0000 mgr.smithi067.rdualw (mgr.24569) 7445 : cluster [DBG] pgmap v6414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:41.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:40.163704+0000 mgr.smithi067.rdualw (mgr.24569) 7445 : cluster [DBG] pgmap v6414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:43.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:42.164468+0000 mgr.smithi067.rdualw (mgr.24569) 7446 : cluster [DBG] pgmap v6415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:43.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:42.164468+0000 mgr.smithi067.rdualw (mgr.24569) 7446 : cluster [DBG] pgmap v6415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:45.023 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:02:45.318 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:02:45.319 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 8m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:02:45.319 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 8m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:02:45.319 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 8m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:02:45.319 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 8m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:02:45.320 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 8m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:02:45.320 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 8m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:02:45.320 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 8m ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:02:45.320 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 8m ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:02:45.320 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 8m ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:02:45.321 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 8m ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:02:45.321 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 8m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:02:45.321 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 8m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:02:45.321 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 8m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:02:45.322 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 8m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:02:45.322 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 8m ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:02:45.322 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 8m ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:02:45.322 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 8m ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:02:45.323 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 8m ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:02:45.323 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 8m ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:02:45.323 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 8m ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:02:45.323 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 8m ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:02:45.323 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 8m ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:02:45.324 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 8m ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:02:45.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:44.165145+0000 mgr.smithi067.rdualw (mgr.24569) 7447 : cluster [DBG] pgmap v6416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:45.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:02:45.011183+0000 mgr.smithi067.rdualw (mgr.24569) 7448 : audit [DBG] from='client.39106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:02:45.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:44.165145+0000 mgr.smithi067.rdualw (mgr.24569) 7447 : cluster [DBG] pgmap v6416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:45.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:02:45.011183+0000 mgr.smithi067.rdualw (mgr.24569) 7448 : audit [DBG] from='client.39106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:02:45.663 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:02:45.663 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:02:45.664 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:02:45.664 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:02:45.664 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:02:45.664 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:02:45.665 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:02:45.665 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:02:45.665 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:02:45.665 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:02:45.666 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:02:45.666 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:02:45.666 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:02:45.666 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:02:45.667 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:02:45.667 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:02:45.667 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:02:45.668 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:02:45.668 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:02:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:02:45.301648+0000 mgr.smithi067.rdualw (mgr.24569) 7449 : audit [DBG] from='client.39110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:02:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:02:45.662593+0000 mon.smithi061 (mon.0) 1633 : audit [DBG] from='client.? 172.21.15.61:0/183955445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:02:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:02:45.301648+0000 mgr.smithi067.rdualw (mgr.24569) 7449 : audit [DBG] from='client.39110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:02:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:02:45.662593+0000 mon.smithi061 (mon.0) 1633 : audit [DBG] from='client.? 172.21.15.61:0/183955445' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:02:47.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:46.165932+0000 mgr.smithi067.rdualw (mgr.24569) 7450 : cluster [DBG] pgmap v6417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:02:47.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:46.165932+0000 mgr.smithi067.rdualw (mgr.24569) 7450 : cluster [DBG] pgmap v6417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:02:49.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:48.166418+0000 mgr.smithi067.rdualw (mgr.24569) 7451 : cluster [DBG] pgmap v6418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:48.166418+0000 mgr.smithi067.rdualw (mgr.24569) 7451 : cluster [DBG] pgmap v6418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:51.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:50.167158+0000 mgr.smithi067.rdualw (mgr.24569) 7452 : cluster [DBG] pgmap v6419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:51.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:50.167158+0000 mgr.smithi067.rdualw (mgr.24569) 7452 : cluster [DBG] pgmap v6419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:53.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:52.167990+0000 mgr.smithi067.rdualw (mgr.24569) 7453 : cluster [DBG] pgmap v6420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:53.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:02:52.855062+0000 mon.smithi067 (mon.1) 1141 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:02:53.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:02:52.856500+0000 mon.smithi067 (mon.1) 1142 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:02:53.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:02:52.857404+0000 mon.smithi067 (mon.1) 1143 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:02:53.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:02:52.858233+0000 mgr.smithi067.rdualw (mgr.24569) 7454 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:02:53.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:52.167990+0000 mgr.smithi067.rdualw (mgr.24569) 7453 : cluster [DBG] pgmap v6420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:53.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:02:52.855062+0000 mon.smithi067 (mon.1) 1141 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:02:53.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:02:52.856500+0000 mon.smithi067 (mon.1) 1142 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:02:53.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:02:52.857404+0000 mon.smithi067 (mon.1) 1143 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:02:53.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:02:52.858233+0000 mgr.smithi067.rdualw (mgr.24569) 7454 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:02:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:02:53.275444+0000 mon.smithi061 (mon.0) 1634 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:02:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:02:53.280991+0000 mon.smithi061 (mon.0) 1635 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:02:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:02:53.275444+0000 mon.smithi061 (mon.0) 1634 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:02:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:02:53.280991+0000 mon.smithi061 (mon.0) 1635 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:02:55.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:54.168525+0000 mgr.smithi067.rdualw (mgr.24569) 7455 : cluster [DBG] pgmap v6421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:55.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:54.168525+0000 mgr.smithi067.rdualw (mgr.24569) 7455 : cluster [DBG] pgmap v6421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:57.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:56.169375+0000 mgr.smithi067.rdualw (mgr.24569) 7456 : cluster [DBG] pgmap v6422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:02:57.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:56.169375+0000 mgr.smithi067.rdualw (mgr.24569) 7456 : cluster [DBG] pgmap v6422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:02:59.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:02:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:02:58.169873+0000 mgr.smithi067.rdualw (mgr.24569) 7457 : cluster [DBG] pgmap v6423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:02:59.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:02:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:02:58.169873+0000 mgr.smithi067.rdualw (mgr.24569) 7457 : cluster [DBG] pgmap v6423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:01.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:00.170665+0000 mgr.smithi067.rdualw (mgr.24569) 7458 : cluster [DBG] pgmap v6424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:01.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:00.170665+0000 mgr.smithi067.rdualw (mgr.24569) 7458 : cluster [DBG] pgmap v6424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:03.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:02.171488+0000 mgr.smithi067.rdualw (mgr.24569) 7459 : cluster [DBG] pgmap v6425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:03.564 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:02.171488+0000 mgr.smithi067.rdualw (mgr.24569) 7459 : cluster [DBG] pgmap v6425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:05.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:04.172319+0000 mgr.smithi067.rdualw (mgr.24569) 7460 : cluster [DBG] pgmap v6426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:05.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:04.172319+0000 mgr.smithi067.rdualw (mgr.24569) 7460 : cluster [DBG] pgmap v6426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:06.173108+0000 mgr.smithi067.rdualw (mgr.24569) 7461 : cluster [DBG] pgmap v6427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:03:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:06.173108+0000 mgr.smithi067.rdualw (mgr.24569) 7461 : cluster [DBG] pgmap v6427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:03:09.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:08.173645+0000 mgr.smithi067.rdualw (mgr.24569) 7462 : cluster [DBG] pgmap v6428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:09.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:08.173645+0000 mgr.smithi067.rdualw (mgr.24569) 7462 : cluster [DBG] pgmap v6428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:11.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:10.174196+0000 mgr.smithi067.rdualw (mgr.24569) 7463 : cluster [DBG] pgmap v6429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:10.174196+0000 mgr.smithi067.rdualw (mgr.24569) 7463 : cluster [DBG] pgmap v6429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:13.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:12.175084+0000 mgr.smithi067.rdualw (mgr.24569) 7464 : cluster [DBG] pgmap v6430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:12.175084+0000 mgr.smithi067.rdualw (mgr.24569) 7464 : cluster [DBG] pgmap v6430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:15.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:14.175676+0000 mgr.smithi067.rdualw (mgr.24569) 7465 : cluster [DBG] pgmap v6431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:15.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:14.175676+0000 mgr.smithi067.rdualw (mgr.24569) 7465 : cluster [DBG] pgmap v6431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:15.972 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:03:16.269 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:03:16.269 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 8m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:03:16.269 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 8m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:03:16.269 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 8m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:03:16.270 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 8m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:03:16.270 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 8m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:03:16.270 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 8m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:03:16.270 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 8m ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:03:16.270 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 8m ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:03:16.271 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 8m ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:03:16.271 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 8m ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:03:16.271 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 8m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:03:16.271 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 8m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:03:16.272 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 8m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:03:16.272 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 8m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:03:16.272 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 8m ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:03:16.272 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 8m ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:03:16.272 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 8m ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:03:16.273 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 8m ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:03:16.273 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 8m ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:03:16.273 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 8m ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:03:16.273 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 8m ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:03:16.273 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 8m ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:03:16.274 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 8m ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:03:16.609 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:03:16.610 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:03:16.610 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:03:16.611 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:03:16.611 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:03:16.611 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:03:16.611 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:03:16.611 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:03:16.612 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:03:16.612 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:03:16.612 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:03:16.612 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:03:16.613 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:03:16.613 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:03:16.613 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:03:16.613 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:03:16.613 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:03:16.614 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:03:16.614 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:03:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:03:15.959349+0000 mgr.smithi067.rdualw (mgr.24569) 7466 : audit [DBG] from='client.39118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:03:16.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:03:15.959349+0000 mgr.smithi067.rdualw (mgr.24569) 7466 : audit [DBG] from='client.39118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:03:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:16.176569+0000 mgr.smithi067.rdualw (mgr.24569) 7467 : cluster [DBG] pgmap v6432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:03:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:03:16.251826+0000 mgr.smithi067.rdualw (mgr.24569) 7468 : audit [DBG] from='client.39122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:03:17.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:03:16.608814+0000 mon.smithi061 (mon.0) 1636 : audit [DBG] from='client.? 172.21.15.61:0/301763892' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:03:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:16.176569+0000 mgr.smithi067.rdualw (mgr.24569) 7467 : cluster [DBG] pgmap v6432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:03:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:03:16.251826+0000 mgr.smithi067.rdualw (mgr.24569) 7468 : audit [DBG] from='client.39122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:03:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:03:16.608814+0000 mon.smithi061 (mon.0) 1636 : audit [DBG] from='client.? 172.21.15.61:0/301763892' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:03:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:18.177090+0000 mgr.smithi067.rdualw (mgr.24569) 7469 : cluster [DBG] pgmap v6433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:18.177090+0000 mgr.smithi067.rdualw (mgr.24569) 7469 : cluster [DBG] pgmap v6433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:20.177794+0000 mgr.smithi067.rdualw (mgr.24569) 7470 : cluster [DBG] pgmap v6434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:21.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:20.177794+0000 mgr.smithi067.rdualw (mgr.24569) 7470 : cluster [DBG] pgmap v6434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:22.178932+0000 mgr.smithi067.rdualw (mgr.24569) 7471 : cluster [DBG] pgmap v6435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:22.178932+0000 mgr.smithi067.rdualw (mgr.24569) 7471 : cluster [DBG] pgmap v6435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:25.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:24.179520+0000 mgr.smithi067.rdualw (mgr.24569) 7472 : cluster [DBG] pgmap v6436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:25.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:24.179520+0000 mgr.smithi067.rdualw (mgr.24569) 7472 : cluster [DBG] pgmap v6436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:26.180514+0000 mgr.smithi067.rdualw (mgr.24569) 7473 : cluster [DBG] pgmap v6437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:03:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:26.180514+0000 mgr.smithi067.rdualw (mgr.24569) 7473 : cluster [DBG] pgmap v6437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:03:29.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:28.181013+0000 mgr.smithi067.rdualw (mgr.24569) 7474 : cluster [DBG] pgmap v6438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:29.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:28.181013+0000 mgr.smithi067.rdualw (mgr.24569) 7474 : cluster [DBG] pgmap v6438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:31.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:30.181663+0000 mgr.smithi067.rdualw (mgr.24569) 7475 : cluster [DBG] pgmap v6439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:31.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:30.181663+0000 mgr.smithi067.rdualw (mgr.24569) 7475 : cluster [DBG] pgmap v6439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:33.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:32.182729+0000 mgr.smithi067.rdualw (mgr.24569) 7476 : cluster [DBG] pgmap v6440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:33.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:32.182729+0000 mgr.smithi067.rdualw (mgr.24569) 7476 : cluster [DBG] pgmap v6440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:34.183528+0000 mgr.smithi067.rdualw (mgr.24569) 7477 : cluster [DBG] pgmap v6441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:34.183528+0000 mgr.smithi067.rdualw (mgr.24569) 7477 : cluster [DBG] pgmap v6441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:03:35.614408+0000 mon.smithi067 (mon.1) 1144 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:03:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:03:35.614815+0000 mon.smithi067 (mon.1) 1145 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:03:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:03:35.614840+0000 mon.smithi061 (mon.0) 1637 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:03:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:03:35.615382+0000 mon.smithi061 (mon.0) 1638 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:03:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:03:35.614408+0000 mon.smithi067 (mon.1) 1144 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:03:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:03:35.614815+0000 mon.smithi067 (mon.1) 1145 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:03:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:03:35.614840+0000 mon.smithi061 (mon.0) 1637 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:03:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:03:35.615382+0000 mon.smithi061 (mon.0) 1638 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:03:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:36.184345+0000 mgr.smithi067.rdualw (mgr.24569) 7478 : cluster [DBG] pgmap v6442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:03:37.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:36.184345+0000 mgr.smithi067.rdualw (mgr.24569) 7478 : cluster [DBG] pgmap v6442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:03:39.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:38.185058+0000 mgr.smithi067.rdualw (mgr.24569) 7479 : cluster [DBG] pgmap v6443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:39.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:38.185058+0000 mgr.smithi067.rdualw (mgr.24569) 7479 : cluster [DBG] pgmap v6443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:41.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:40.185849+0000 mgr.smithi067.rdualw (mgr.24569) 7480 : cluster [DBG] pgmap v6444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:40.185849+0000 mgr.smithi067.rdualw (mgr.24569) 7480 : cluster [DBG] pgmap v6444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:43.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:42.186889+0000 mgr.smithi067.rdualw (mgr.24569) 7481 : cluster [DBG] pgmap v6445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:42.186889+0000 mgr.smithi067.rdualw (mgr.24569) 7481 : cluster [DBG] pgmap v6445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:45.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:44.187475+0000 mgr.smithi067.rdualw (mgr.24569) 7482 : cluster [DBG] pgmap v6446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:44.187475+0000 mgr.smithi067.rdualw (mgr.24569) 7482 : cluster [DBG] pgmap v6446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:46.921 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:03:47.251 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:03:47.252 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 9m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:03:47.252 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 9m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:03:47.252 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 9m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:03:47.252 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 9m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:03:47.253 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 9m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:03:47.253 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 9m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:03:47.253 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 9m ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:03:47.253 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 9m ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:03:47.254 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 9m ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:03:47.254 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 9m ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:03:47.254 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 9m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:03:47.254 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 9m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:03:47.254 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 9m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:03:47.255 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 9m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:03:47.255 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 9m ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:03:47.255 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 9m ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:03:47.255 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 9m ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:03:47.255 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 9m ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:03:47.256 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 9m ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:03:47.256 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 9m ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:03:47.256 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 9m ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:03:47.256 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 9m ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:03:47.256 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 9m ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:03:47.594 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:03:47.594 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:03:47.595 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:03:47.595 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:03:47.595 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:03:47.596 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:03:47.596 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:03:47.596 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:03:47.597 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:03:47.597 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:03:47.597 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:03:47.597 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:03:47.597 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:03:47.598 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:03:47.598 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:03:47.598 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:03:47.598 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:03:47.599 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:03:47.599 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:03:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:46.188303+0000 mgr.smithi067.rdualw (mgr.24569) 7483 : cluster [DBG] pgmap v6447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:03:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:03:46.908250+0000 mgr.smithi067.rdualw (mgr.24569) 7484 : audit [DBG] from='client.39130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:03:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:46.188303+0000 mgr.smithi067.rdualw (mgr.24569) 7483 : cluster [DBG] pgmap v6447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:03:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:03:46.908250+0000 mgr.smithi067.rdualw (mgr.24569) 7484 : audit [DBG] from='client.39130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:03:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:03:47.234424+0000 mgr.smithi067.rdualw (mgr.24569) 7485 : audit [DBG] from='client.39134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:03:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:03:47.593180+0000 mon.smithi061 (mon.0) 1639 : audit [DBG] from='client.? 172.21.15.61:0/28858002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:03:48.814 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:03:47.234424+0000 mgr.smithi067.rdualw (mgr.24569) 7485 : audit [DBG] from='client.39134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:03:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:03:47.593180+0000 mon.smithi061 (mon.0) 1639 : audit [DBG] from='client.? 172.21.15.61:0/28858002' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:03:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:48.188868+0000 mgr.smithi067.rdualw (mgr.24569) 7486 : cluster [DBG] pgmap v6448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:48.188868+0000 mgr.smithi067.rdualw (mgr.24569) 7486 : cluster [DBG] pgmap v6448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:51.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:50.189599+0000 mgr.smithi067.rdualw (mgr.24569) 7487 : cluster [DBG] pgmap v6449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:50.189599+0000 mgr.smithi067.rdualw (mgr.24569) 7487 : cluster [DBG] pgmap v6449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:52.190428+0000 mgr.smithi067.rdualw (mgr.24569) 7488 : cluster [DBG] pgmap v6450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:03:53.284669+0000 mon.smithi067 (mon.1) 1146 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:03:53.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:03:53.286121+0000 mon.smithi067 (mon.1) 1147 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:03:53.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:03:53.287043+0000 mon.smithi067 (mon.1) 1148 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:03:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:52.190428+0000 mgr.smithi067.rdualw (mgr.24569) 7488 : cluster [DBG] pgmap v6450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:03:53.284669+0000 mon.smithi067 (mon.1) 1146 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:03:53.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:03:53.286121+0000 mon.smithi067 (mon.1) 1147 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:03:53.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:03:53.287043+0000 mon.smithi067 (mon.1) 1148 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:03:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:03:53.287891+0000 mgr.smithi067.rdualw (mgr.24569) 7489 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:03:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:03:53.708177+0000 mon.smithi061 (mon.0) 1640 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:03:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:03:53.715816+0000 mon.smithi061 (mon.0) 1641 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:03:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:03:53.287891+0000 mgr.smithi067.rdualw (mgr.24569) 7489 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:03:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:03:53.708177+0000 mon.smithi061 (mon.0) 1640 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:03:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:03:53.715816+0000 mon.smithi061 (mon.0) 1641 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:03:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:54.191126+0000 mgr.smithi067.rdualw (mgr.24569) 7490 : cluster [DBG] pgmap v6451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:54.191126+0000 mgr.smithi067.rdualw (mgr.24569) 7490 : cluster [DBG] pgmap v6451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:03:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:56.192104+0000 mgr.smithi067.rdualw (mgr.24569) 7491 : cluster [DBG] pgmap v6452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:03:58.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:56.192104+0000 mgr.smithi067.rdualw (mgr.24569) 7491 : cluster [DBG] pgmap v6452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:04:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:03:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:03:58.192564+0000 mgr.smithi067.rdualw (mgr.24569) 7492 : cluster [DBG] pgmap v6453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:03:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:03:58.192564+0000 mgr.smithi067.rdualw (mgr.24569) 7492 : cluster [DBG] pgmap v6453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:00.193253+0000 mgr.smithi067.rdualw (mgr.24569) 7493 : cluster [DBG] pgmap v6454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:00.193253+0000 mgr.smithi067.rdualw (mgr.24569) 7493 : cluster [DBG] pgmap v6454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:02.194109+0000 mgr.smithi067.rdualw (mgr.24569) 7494 : cluster [DBG] pgmap v6455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:02.194109+0000 mgr.smithi067.rdualw (mgr.24569) 7494 : cluster [DBG] pgmap v6455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:04.194755+0000 mgr.smithi067.rdualw (mgr.24569) 7495 : cluster [DBG] pgmap v6456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:06.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:04.194755+0000 mgr.smithi067.rdualw (mgr.24569) 7495 : cluster [DBG] pgmap v6456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:06.195824+0000 mgr.smithi067.rdualw (mgr.24569) 7496 : cluster [DBG] pgmap v6457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:04:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:06.195824+0000 mgr.smithi067.rdualw (mgr.24569) 7496 : cluster [DBG] pgmap v6457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:04:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:08.196360+0000 mgr.smithi067.rdualw (mgr.24569) 7497 : cluster [DBG] pgmap v6458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:08.196360+0000 mgr.smithi067.rdualw (mgr.24569) 7497 : cluster [DBG] pgmap v6458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:10.196969+0000 mgr.smithi067.rdualw (mgr.24569) 7498 : cluster [DBG] pgmap v6459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:10.196969+0000 mgr.smithi067.rdualw (mgr.24569) 7498 : cluster [DBG] pgmap v6459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:12.197865+0000 mgr.smithi067.rdualw (mgr.24569) 7499 : cluster [DBG] pgmap v6460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:14.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:12.197865+0000 mgr.smithi067.rdualw (mgr.24569) 7499 : cluster [DBG] pgmap v6460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:14.198526+0000 mgr.smithi067.rdualw (mgr.24569) 7500 : cluster [DBG] pgmap v6461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:14.198526+0000 mgr.smithi067.rdualw (mgr.24569) 7500 : cluster [DBG] pgmap v6461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:17.952 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:04:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:16.199343+0000 mgr.smithi067.rdualw (mgr.24569) 7501 : cluster [DBG] pgmap v6462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:04:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:16.199343+0000 mgr.smithi067.rdualw (mgr.24569) 7501 : cluster [DBG] pgmap v6462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:04:18.246 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:04:18.247 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 9m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:04:18.247 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 9m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:04:18.247 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 9m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:04:18.247 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 9m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:04:18.248 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 9m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:04:18.248 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 9m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:04:18.248 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 9m ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:04:18.248 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 9m ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:04:18.248 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 9m ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:04:18.249 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 9m ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:04:18.249 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 9m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:04:18.249 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 9m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:04:18.249 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 9m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:04:18.250 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 9m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:04:18.250 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 9m ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:04:18.250 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 9m ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:04:18.250 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 9m ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:04:18.251 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 9m ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:04:18.251 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 9m ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:04:18.251 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 9m ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:04:18.251 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 9m ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:04:18.251 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 9m ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:04:18.252 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 9m ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:04:18.587 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:04:18.587 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:04:18.587 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:04:18.588 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:04:18.588 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:04:18.588 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:04:18.588 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:04:18.589 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:04:18.589 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:04:18.589 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:04:18.589 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:04:18.589 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:04:18.590 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:04:18.590 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:04:18.590 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:04:18.590 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:04:18.591 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:04:18.591 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:04:18.591 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:04:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:04:17.938842+0000 mgr.smithi067.rdualw (mgr.24569) 7502 : audit [DBG] from='client.39142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:04:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:04:18.586368+0000 mon.smithi061 (mon.0) 1642 : audit [DBG] from='client.? 172.21.15.61:0/3842174012' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:04:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:04:17.938842+0000 mgr.smithi067.rdualw (mgr.24569) 7502 : audit [DBG] from='client.39142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:04:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:04:18.586368+0000 mon.smithi061 (mon.0) 1642 : audit [DBG] from='client.? 172.21.15.61:0/3842174012' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:04:20.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:18.199929+0000 mgr.smithi067.rdualw (mgr.24569) 7503 : cluster [DBG] pgmap v6463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:20.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:04:18.229105+0000 mgr.smithi067.rdualw (mgr.24569) 7504 : audit [DBG] from='client.39146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:04:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:18.199929+0000 mgr.smithi067.rdualw (mgr.24569) 7503 : cluster [DBG] pgmap v6463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:04:18.229105+0000 mgr.smithi067.rdualw (mgr.24569) 7504 : audit [DBG] from='client.39146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:04:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:20.200691+0000 mgr.smithi067.rdualw (mgr.24569) 7505 : cluster [DBG] pgmap v6464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:20.200691+0000 mgr.smithi067.rdualw (mgr.24569) 7505 : cluster [DBG] pgmap v6464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:24.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:22.201568+0000 mgr.smithi067.rdualw (mgr.24569) 7506 : cluster [DBG] pgmap v6465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:22.201568+0000 mgr.smithi067.rdualw (mgr.24569) 7506 : cluster [DBG] pgmap v6465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:24.202295+0000 mgr.smithi067.rdualw (mgr.24569) 7507 : cluster [DBG] pgmap v6466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:24.202295+0000 mgr.smithi067.rdualw (mgr.24569) 7507 : cluster [DBG] pgmap v6466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:26.203265+0000 mgr.smithi067.rdualw (mgr.24569) 7508 : cluster [DBG] pgmap v6467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:04:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:26.203265+0000 mgr.smithi067.rdualw (mgr.24569) 7508 : cluster [DBG] pgmap v6467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:04:30.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:28.203975+0000 mgr.smithi067.rdualw (mgr.24569) 7509 : cluster [DBG] pgmap v6468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:28.203975+0000 mgr.smithi067.rdualw (mgr.24569) 7509 : cluster [DBG] pgmap v6468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:30.204587+0000 mgr.smithi067.rdualw (mgr.24569) 7510 : cluster [DBG] pgmap v6469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:32.064 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:30.204587+0000 mgr.smithi067.rdualw (mgr.24569) 7510 : cluster [DBG] pgmap v6469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:32.205398+0000 mgr.smithi067.rdualw (mgr.24569) 7511 : cluster [DBG] pgmap v6470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:32.205398+0000 mgr.smithi067.rdualw (mgr.24569) 7511 : cluster [DBG] pgmap v6470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:34.206117+0000 mgr.smithi067.rdualw (mgr.24569) 7512 : cluster [DBG] pgmap v6471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:04:35.620383+0000 mon.smithi067 (mon.1) 1149 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:04:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:04:35.620656+0000 mon.smithi061 (mon.0) 1643 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:04:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:04:35.620695+0000 mon.smithi067 (mon.1) 1150 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:04:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:04:35.620970+0000 mon.smithi061 (mon.0) 1644 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:04:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:34.206117+0000 mgr.smithi067.rdualw (mgr.24569) 7512 : cluster [DBG] pgmap v6471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:04:35.620383+0000 mon.smithi067 (mon.1) 1149 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:04:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:04:35.620656+0000 mon.smithi061 (mon.0) 1643 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:04:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:04:35.620695+0000 mon.smithi067 (mon.1) 1150 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:04:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:04:35.620970+0000 mon.smithi061 (mon.0) 1644 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:04:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:36.207118+0000 mgr.smithi067.rdualw (mgr.24569) 7513 : cluster [DBG] pgmap v6472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:04:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:36.207118+0000 mgr.smithi067.rdualw (mgr.24569) 7513 : cluster [DBG] pgmap v6472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:04:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:38.207845+0000 mgr.smithi067.rdualw (mgr.24569) 7514 : cluster [DBG] pgmap v6473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:38.207845+0000 mgr.smithi067.rdualw (mgr.24569) 7514 : cluster [DBG] pgmap v6473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:40.208641+0000 mgr.smithi067.rdualw (mgr.24569) 7515 : cluster [DBG] pgmap v6474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:40.208641+0000 mgr.smithi067.rdualw (mgr.24569) 7515 : cluster [DBG] pgmap v6474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:42.209503+0000 mgr.smithi067.rdualw (mgr.24569) 7516 : cluster [DBG] pgmap v6475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:42.209503+0000 mgr.smithi067.rdualw (mgr.24569) 7516 : cluster [DBG] pgmap v6475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:44.210103+0000 mgr.smithi067.rdualw (mgr.24569) 7517 : cluster [DBG] pgmap v6476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:44.210103+0000 mgr.smithi067.rdualw (mgr.24569) 7517 : cluster [DBG] pgmap v6476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:46.211094+0000 mgr.smithi067.rdualw (mgr.24569) 7518 : cluster [DBG] pgmap v6477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:04:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:46.211094+0000 mgr.smithi067.rdualw (mgr.24569) 7518 : cluster [DBG] pgmap v6477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:04:48.896 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:04:49.219 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:04:49.219 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 10m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:04:49.220 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 10m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:04:49.220 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 10m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:04:49.220 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 10m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:04:49.220 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 10m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:04:49.221 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 10m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:04:49.221 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 10m ago 3h 471M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:04:49.221 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 10m ago 3h 587M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:04:49.221 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 10m ago 3h 1382M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:04:49.221 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 10m ago 3h 714M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:04:49.222 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 10m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:04:49.222 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 10m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:04:49.222 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 10m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:04:49.222 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 10m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:04:49.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 10m ago 3h 953M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:04:49.223 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 10m ago 3h 1833M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:04:49.223 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 10m ago 3h 1146M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:04:49.223 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 10m ago 3h 1970M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:04:49.223 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 10m ago 3h 1818M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:04:49.224 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 10m ago 3h 2013M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:04:49.224 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 10m ago 3h 1623M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:04:49.224 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 10m ago 3h 2536M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:04:49.224 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 10m ago 3h 118M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:04:49.637 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:04:49.637 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:04:49.638 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:04:49.638 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:04:49.638 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:04:49.638 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:04:49.639 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:04:49.639 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:04:49.639 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:04:49.639 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:04:49.640 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:04:49.640 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:04:49.640 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:04:49.640 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:04:49.641 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:04:49.641 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:04:49.641 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:04:49.642 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:04:49.642 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:04:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:48.211590+0000 mgr.smithi067.rdualw (mgr.24569) 7519 : cluster [DBG] pgmap v6478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:04:48.883362+0000 mgr.smithi067.rdualw (mgr.24569) 7520 : audit [DBG] from='client.39154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:04:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:04:49.636300+0000 mon.smithi061 (mon.0) 1645 : audit [DBG] from='client.? 172.21.15.61:0/2108515749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:04:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:48.211590+0000 mgr.smithi067.rdualw (mgr.24569) 7519 : cluster [DBG] pgmap v6478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:04:48.883362+0000 mgr.smithi067.rdualw (mgr.24569) 7520 : audit [DBG] from='client.39154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:04:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:04:49.636300+0000 mon.smithi061 (mon.0) 1645 : audit [DBG] from='client.? 172.21.15.61:0/2108515749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:04:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:04:49.201989+0000 mgr.smithi067.rdualw (mgr.24569) 7521 : audit [DBG] from='client.39158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:04:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:04:49.201989+0000 mgr.smithi067.rdualw (mgr.24569) 7521 : audit [DBG] from='client.39158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:04:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:50.212187+0000 mgr.smithi067.rdualw (mgr.24569) 7522 : cluster [DBG] pgmap v6479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:50.212187+0000 mgr.smithi067.rdualw (mgr.24569) 7522 : cluster [DBG] pgmap v6479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:52.213170+0000 mgr.smithi067.rdualw (mgr.24569) 7523 : cluster [DBG] pgmap v6480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:04:53.719169+0000 mon.smithi067 (mon.1) 1151 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:04:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:04:53.720644+0000 mon.smithi067 (mon.1) 1152 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:04:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:04:53.721573+0000 mon.smithi067 (mon.1) 1153 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:04:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:52.213170+0000 mgr.smithi067.rdualw (mgr.24569) 7523 : cluster [DBG] pgmap v6480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:54.436 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:04:53.719169+0000 mon.smithi067 (mon.1) 1151 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:04:54.437 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:04:53.720644+0000 mon.smithi067 (mon.1) 1152 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:04:54.437 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:04:53.721573+0000 mon.smithi067 (mon.1) 1153 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:04:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:04:53.722400+0000 mgr.smithi067.rdualw (mgr.24569) 7524 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:04:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:04:53.722400+0000 mgr.smithi067.rdualw (mgr.24569) 7524 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:04:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:54.213693+0000 mgr.smithi067.rdualw (mgr.24569) 7525 : cluster [DBG] pgmap v6481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:54.213693+0000 mgr.smithi067.rdualw (mgr.24569) 7525 : cluster [DBG] pgmap v6481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:56.214442+0000 mgr.smithi067.rdualw (mgr.24569) 7526 : cluster [DBG] pgmap v6482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:04:58.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:56.214442+0000 mgr.smithi067.rdualw (mgr.24569) 7526 : cluster [DBG] pgmap v6482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:04:59.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:04:58.214929+0000 mgr.smithi067.rdualw (mgr.24569) 7527 : cluster [DBG] pgmap v6483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:04:58.311172+0000 mon.smithi061 (mon.0) 1646 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:04:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:04:58.698412+0000 mon.smithi067 (mon.1) 1154 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:04:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:04:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:04:58.698983+0000 mon.smithi061 (mon.0) 1647 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:04:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:04:58.214929+0000 mgr.smithi067.rdualw (mgr.24569) 7527 : cluster [DBG] pgmap v6483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:04:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:04:58.311172+0000 mon.smithi061 (mon.0) 1646 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:04:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:04:58.698412+0000 mon.smithi067 (mon.1) 1154 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:04:59.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:04:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:04:58.698983+0000 mon.smithi061 (mon.0) 1647 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:05:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:00.215808+0000 mgr.smithi067.rdualw (mgr.24569) 7528 : cluster [DBG] pgmap v6484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:05:00.959720+0000 mon.smithi061 (mon.0) 1648 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:05:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:05:01.365396+0000 mon.smithi067 (mon.1) 1155 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:05:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:05:01.365874+0000 mon.smithi061 (mon.0) 1649 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:05:02.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:05:01.371283+0000 mon.smithi061 (mon.0) 1650 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:05:02.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:05:01.378121+0000 mon.smithi061 (mon.0) 1651 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:05:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:00.215808+0000 mgr.smithi067.rdualw (mgr.24569) 7528 : cluster [DBG] pgmap v6484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:05:00.959720+0000 mon.smithi061 (mon.0) 1648 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:05:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:05:01.365396+0000 mon.smithi067 (mon.1) 1155 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:05:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:05:01.365874+0000 mon.smithi061 (mon.0) 1649 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:05:02.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:05:01.371283+0000 mon.smithi061 (mon.0) 1650 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:05:02.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:05:01.378121+0000 mon.smithi061 (mon.0) 1651 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:05:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:02.216694+0000 mgr.smithi067.rdualw (mgr.24569) 7529 : cluster [DBG] pgmap v6485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:02.216694+0000 mgr.smithi067.rdualw (mgr.24569) 7529 : cluster [DBG] pgmap v6485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:04.217375+0000 mgr.smithi067.rdualw (mgr.24569) 7530 : cluster [DBG] pgmap v6486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:04.217375+0000 mgr.smithi067.rdualw (mgr.24569) 7530 : cluster [DBG] pgmap v6486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:06.218198+0000 mgr.smithi067.rdualw (mgr.24569) 7531 : cluster [DBG] pgmap v6487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:05:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:06.218198+0000 mgr.smithi067.rdualw (mgr.24569) 7531 : cluster [DBG] pgmap v6487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:05:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:08.218712+0000 mgr.smithi067.rdualw (mgr.24569) 7532 : cluster [DBG] pgmap v6488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:08.218712+0000 mgr.smithi067.rdualw (mgr.24569) 7532 : cluster [DBG] pgmap v6488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:10.219369+0000 mgr.smithi067.rdualw (mgr.24569) 7533 : cluster [DBG] pgmap v6489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:10.219369+0000 mgr.smithi067.rdualw (mgr.24569) 7533 : cluster [DBG] pgmap v6489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:12.220280+0000 mgr.smithi067.rdualw (mgr.24569) 7534 : cluster [DBG] pgmap v6490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:12.220280+0000 mgr.smithi067.rdualw (mgr.24569) 7534 : cluster [DBG] pgmap v6490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:14.220917+0000 mgr.smithi067.rdualw (mgr.24569) 7535 : cluster [DBG] pgmap v6491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:14.220917+0000 mgr.smithi067.rdualw (mgr.24569) 7535 : cluster [DBG] pgmap v6491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:16.222037+0000 mgr.smithi067.rdualw (mgr.24569) 7536 : cluster [DBG] pgmap v6492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:05:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:16.222037+0000 mgr.smithi067.rdualw (mgr.24569) 7536 : cluster [DBG] pgmap v6492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:05:19.948 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:05:20.241 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:05:20.242 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 19s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:05:20.242 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 19s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:05:20.242 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 21s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:05:20.243 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 19s ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:05:20.243 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 19s ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:05:20.243 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 21s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:05:20.243 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 19s ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:05:20.244 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 21s ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:05:20.244 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 19s ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:05:20.244 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 21s ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:05:20.244 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 19s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:05:20.245 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 21s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:05:20.245 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 19s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:05:20.245 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 21s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:05:20.245 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 19s ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:05:20.246 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 19s ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:05:20.246 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 19s ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:05:20.246 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 19s ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:05:20.246 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 21s ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:05:20.247 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 21s ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:05:20.247 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 21s ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:05:20.247 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 21s ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:05:20.247 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 19s ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:05:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:18.222702+0000 mgr.smithi067.rdualw (mgr.24569) 7537 : cluster [DBG] pgmap v6493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:18.222702+0000 mgr.smithi067.rdualw (mgr.24569) 7537 : cluster [DBG] pgmap v6493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:20.588 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:05:20.589 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:05:20.589 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:05:20.589 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:05:20.589 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:05:20.590 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:05:20.590 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:05:20.590 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:05:20.590 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:05:20.591 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:05:20.591 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:05:20.591 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:05:20.591 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:05:20.592 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:05:20.592 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:05:20.592 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:05:20.592 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:05:20.592 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:05:20.593 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:05:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:05:19.935975+0000 mgr.smithi067.rdualw (mgr.24569) 7538 : audit [DBG] from='client.39166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:05:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:05:20.587622+0000 mon.smithi061 (mon.0) 1652 : audit [DBG] from='client.? 172.21.15.61:0/2256780499' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:05:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:05:19.935975+0000 mgr.smithi067.rdualw (mgr.24569) 7538 : audit [DBG] from='client.39166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:05:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:05:20.587622+0000 mon.smithi061 (mon.0) 1652 : audit [DBG] from='client.? 172.21.15.61:0/2256780499' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:05:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:20.223268+0000 mgr.smithi067.rdualw (mgr.24569) 7539 : cluster [DBG] pgmap v6494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:05:20.224026+0000 mgr.smithi067.rdualw (mgr.24569) 7540 : audit [DBG] from='client.39170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:05:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:20.223268+0000 mgr.smithi067.rdualw (mgr.24569) 7539 : cluster [DBG] pgmap v6494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:05:20.224026+0000 mgr.smithi067.rdualw (mgr.24569) 7540 : audit [DBG] from='client.39170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:05:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:22.224191+0000 mgr.smithi067.rdualw (mgr.24569) 7541 : cluster [DBG] pgmap v6495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:22.224191+0000 mgr.smithi067.rdualw (mgr.24569) 7541 : cluster [DBG] pgmap v6495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:24.224943+0000 mgr.smithi067.rdualw (mgr.24569) 7542 : cluster [DBG] pgmap v6496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:24.224943+0000 mgr.smithi067.rdualw (mgr.24569) 7542 : cluster [DBG] pgmap v6496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:26.225913+0000 mgr.smithi067.rdualw (mgr.24569) 7543 : cluster [DBG] pgmap v6497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:05:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:26.225913+0000 mgr.smithi067.rdualw (mgr.24569) 7543 : cluster [DBG] pgmap v6497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:05:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:28.226457+0000 mgr.smithi067.rdualw (mgr.24569) 7544 : cluster [DBG] pgmap v6498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:28.226457+0000 mgr.smithi067.rdualw (mgr.24569) 7544 : cluster [DBG] pgmap v6498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:30.227031+0000 mgr.smithi067.rdualw (mgr.24569) 7545 : cluster [DBG] pgmap v6499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:30.227031+0000 mgr.smithi067.rdualw (mgr.24569) 7545 : cluster [DBG] pgmap v6499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:32.227840+0000 mgr.smithi067.rdualw (mgr.24569) 7546 : cluster [DBG] pgmap v6500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:32.227840+0000 mgr.smithi067.rdualw (mgr.24569) 7546 : cluster [DBG] pgmap v6500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:34.228446+0000 mgr.smithi067.rdualw (mgr.24569) 7547 : cluster [DBG] pgmap v6501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:05:35.626161+0000 mon.smithi067 (mon.1) 1156 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:05:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:05:35.626553+0000 mon.smithi067 (mon.1) 1157 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:05:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:05:35.626571+0000 mon.smithi061 (mon.0) 1653 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:05:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:05:35.627066+0000 mon.smithi061 (mon.0) 1654 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:05:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:34.228446+0000 mgr.smithi067.rdualw (mgr.24569) 7547 : cluster [DBG] pgmap v6501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:05:35.626161+0000 mon.smithi067 (mon.1) 1156 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:05:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:05:35.626553+0000 mon.smithi067 (mon.1) 1157 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:05:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:05:35.626571+0000 mon.smithi061 (mon.0) 1653 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:05:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:05:35.627066+0000 mon.smithi061 (mon.0) 1654 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:05:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:36.229446+0000 mgr.smithi067.rdualw (mgr.24569) 7548 : cluster [DBG] pgmap v6502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:05:38.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:36.229446+0000 mgr.smithi067.rdualw (mgr.24569) 7548 : cluster [DBG] pgmap v6502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:05:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:38.230182+0000 mgr.smithi067.rdualw (mgr.24569) 7549 : cluster [DBG] pgmap v6503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:38.230182+0000 mgr.smithi067.rdualw (mgr.24569) 7549 : cluster [DBG] pgmap v6503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:42.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:40.230823+0000 mgr.smithi067.rdualw (mgr.24569) 7550 : cluster [DBG] pgmap v6504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:40.230823+0000 mgr.smithi067.rdualw (mgr.24569) 7550 : cluster [DBG] pgmap v6504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:42.231656+0000 mgr.smithi067.rdualw (mgr.24569) 7551 : cluster [DBG] pgmap v6505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:44.314 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:42.231656+0000 mgr.smithi067.rdualw (mgr.24569) 7551 : cluster [DBG] pgmap v6505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:44.232456+0000 mgr.smithi067.rdualw (mgr.24569) 7552 : cluster [DBG] pgmap v6506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:44.232456+0000 mgr.smithi067.rdualw (mgr.24569) 7552 : cluster [DBG] pgmap v6506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:46.233277+0000 mgr.smithi067.rdualw (mgr.24569) 7553 : cluster [DBG] pgmap v6507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:05:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:46.233277+0000 mgr.smithi067.rdualw (mgr.24569) 7553 : cluster [DBG] pgmap v6507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:05:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:48.233841+0000 mgr.smithi067.rdualw (mgr.24569) 7554 : cluster [DBG] pgmap v6508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:48.233841+0000 mgr.smithi067.rdualw (mgr.24569) 7554 : cluster [DBG] pgmap v6508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:50.912 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:05:51.206 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:05:51.206 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 50s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:05:51.206 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 50s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:05:51.207 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 52s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:05:51.207 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 50s ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:05:51.207 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 50s ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:05:51.207 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 52s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:05:51.208 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 50s ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:05:51.208 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 52s ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:05:51.208 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 50s ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:05:51.208 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 52s ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:05:51.209 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 50s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:05:51.209 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 52s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:05:51.209 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 50s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:05:51.209 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 52s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:05:51.210 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 50s ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:05:51.210 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 50s ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:05:51.210 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 50s ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:05:51.210 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 50s ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:05:51.211 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 52s ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:05:51.211 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 52s ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:05:51.211 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 52s ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:05:51.211 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 52s ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:05:51.211 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 50s ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:05:51.544 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:05:51.544 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:05:51.545 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:05:51.546 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:05:51.546 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:05:51.547 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:05:51.547 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:05:51.548 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:05:51.548 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:05:51.549 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:05:51.549 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:05:51.549 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:05:51.550 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:05:51.550 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:05:51.551 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:05:51.551 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:05:51.552 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:05:51.552 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:05:51.553 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:05:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:50.234470+0000 mgr.smithi067.rdualw (mgr.24569) 7555 : cluster [DBG] pgmap v6509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:05:50.898962+0000 mgr.smithi067.rdualw (mgr.24569) 7556 : audit [DBG] from='client.39178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:05:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:05:51.187568+0000 mgr.smithi067.rdualw (mgr.24569) 7557 : audit [DBG] from='client.39182 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:05:52.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:05:51.543076+0000 mon.smithi061 (mon.0) 1655 : audit [DBG] from='client.? 172.21.15.61:0/884776124' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:05:52.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:50.234470+0000 mgr.smithi067.rdualw (mgr.24569) 7555 : cluster [DBG] pgmap v6509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:52.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:05:50.898962+0000 mgr.smithi067.rdualw (mgr.24569) 7556 : audit [DBG] from='client.39178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:05:52.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:05:51.187568+0000 mgr.smithi067.rdualw (mgr.24569) 7557 : audit [DBG] from='client.39182 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:05:52.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:05:51.543076+0000 mon.smithi061 (mon.0) 1655 : audit [DBG] from='client.? 172.21.15.61:0/884776124' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:05:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:52.235415+0000 mgr.smithi067.rdualw (mgr.24569) 7558 : cluster [DBG] pgmap v6510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:52.235415+0000 mgr.smithi067.rdualw (mgr.24569) 7558 : cluster [DBG] pgmap v6510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:54.236026+0000 mgr.smithi067.rdualw (mgr.24569) 7559 : cluster [DBG] pgmap v6511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:54.236026+0000 mgr.smithi067.rdualw (mgr.24569) 7559 : cluster [DBG] pgmap v6511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:05:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:05:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:56.236937+0000 mgr.smithi067.rdualw (mgr.24569) 7560 : cluster [DBG] pgmap v6512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:05:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:05:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:56.236937+0000 mgr.smithi067.rdualw (mgr.24569) 7560 : cluster [DBG] pgmap v6512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:06:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:05:58.237504+0000 mgr.smithi067.rdualw (mgr.24569) 7561 : cluster [DBG] pgmap v6513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:05:58.237504+0000 mgr.smithi067.rdualw (mgr.24569) 7561 : cluster [DBG] pgmap v6513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:00.238189+0000 mgr.smithi067.rdualw (mgr.24569) 7562 : cluster [DBG] pgmap v6514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:06:01.382895+0000 mon.smithi067 (mon.1) 1158 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:06:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:06:01.384367+0000 mon.smithi067 (mon.1) 1159 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:06:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:06:01.385366+0000 mon.smithi067 (mon.1) 1160 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:06:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:06:01.805703+0000 mon.smithi061 (mon.0) 1656 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:06:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:06:01.811121+0000 mon.smithi061 (mon.0) 1657 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:06:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:00.238189+0000 mgr.smithi067.rdualw (mgr.24569) 7562 : cluster [DBG] pgmap v6514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:06:01.382895+0000 mon.smithi067 (mon.1) 1158 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:06:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:06:01.384367+0000 mon.smithi067 (mon.1) 1159 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:06:02.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:06:01.385366+0000 mon.smithi067 (mon.1) 1160 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:06:02.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:06:01.805703+0000 mon.smithi061 (mon.0) 1656 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:06:02.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:06:01.811121+0000 mon.smithi061 (mon.0) 1657 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:06:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:06:01.386244+0000 mgr.smithi067.rdualw (mgr.24569) 7563 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:06:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:06:01.386244+0000 mgr.smithi067.rdualw (mgr.24569) 7563 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:06:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:02.239189+0000 mgr.smithi067.rdualw (mgr.24569) 7564 : cluster [DBG] pgmap v6515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:02.239189+0000 mgr.smithi067.rdualw (mgr.24569) 7564 : cluster [DBG] pgmap v6515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:04.239763+0000 mgr.smithi067.rdualw (mgr.24569) 7565 : cluster [DBG] pgmap v6516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:04.239763+0000 mgr.smithi067.rdualw (mgr.24569) 7565 : cluster [DBG] pgmap v6516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:06.240794+0000 mgr.smithi067.rdualw (mgr.24569) 7566 : cluster [DBG] pgmap v6517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:06:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:06.240794+0000 mgr.smithi067.rdualw (mgr.24569) 7566 : cluster [DBG] pgmap v6517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:06:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:08.241438+0000 mgr.smithi067.rdualw (mgr.24569) 7567 : cluster [DBG] pgmap v6518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:08.241438+0000 mgr.smithi067.rdualw (mgr.24569) 7567 : cluster [DBG] pgmap v6518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:10.242048+0000 mgr.smithi067.rdualw (mgr.24569) 7568 : cluster [DBG] pgmap v6519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:10.242048+0000 mgr.smithi067.rdualw (mgr.24569) 7568 : cluster [DBG] pgmap v6519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:12.243079+0000 mgr.smithi067.rdualw (mgr.24569) 7569 : cluster [DBG] pgmap v6520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:12.243079+0000 mgr.smithi067.rdualw (mgr.24569) 7569 : cluster [DBG] pgmap v6520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:14.243827+0000 mgr.smithi067.rdualw (mgr.24569) 7570 : cluster [DBG] pgmap v6521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:14.243827+0000 mgr.smithi067.rdualw (mgr.24569) 7570 : cluster [DBG] pgmap v6521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:16.244901+0000 mgr.smithi067.rdualw (mgr.24569) 7571 : cluster [DBG] pgmap v6522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:06:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:16.244901+0000 mgr.smithi067.rdualw (mgr.24569) 7571 : cluster [DBG] pgmap v6522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:06:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:18.245610+0000 mgr.smithi067.rdualw (mgr.24569) 7572 : cluster [DBG] pgmap v6523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:18.245610+0000 mgr.smithi067.rdualw (mgr.24569) 7572 : cluster [DBG] pgmap v6523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:21.855 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:06:22.153 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:06:22.154 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 81s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:06:22.154 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 81s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:06:22.154 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 83s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:06:22.155 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 81s ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:06:22.155 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 81s ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:06:22.155 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 83s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:06:22.155 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 81s ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:06:22.155 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 83s ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:06:22.156 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 81s ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:06:22.156 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 83s ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:06:22.156 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 81s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:06:22.156 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 83s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:06:22.157 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 81s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:06:22.157 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 83s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:06:22.157 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 81s ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:06:22.157 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 81s ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:06:22.158 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 81s ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:06:22.158 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 81s ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:06:22.158 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 83s ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:06:22.159 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 83s ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:06:22.159 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 83s ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:06:22.159 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 83s ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:06:22.159 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 81s ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:06:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:20.246264+0000 mgr.smithi067.rdualw (mgr.24569) 7573 : cluster [DBG] pgmap v6524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:22.495 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:06:22.495 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:06:22.495 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:06:22.496 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:06:22.496 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:06:22.496 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:06:22.496 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:06:22.497 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:06:22.497 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:06:22.497 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:06:22.498 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:06:22.498 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:06:22.498 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:06:22.498 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:06:22.499 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:06:22.499 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:06:22.500 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:06:22.501 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:06:22.501 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:06:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:20.246264+0000 mgr.smithi067.rdualw (mgr.24569) 7573 : cluster [DBG] pgmap v6524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:06:21.842561+0000 mgr.smithi067.rdualw (mgr.24569) 7574 : audit [DBG] from='client.39190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:06:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:06:22.136802+0000 mgr.smithi067.rdualw (mgr.24569) 7575 : audit [DBG] from='client.39194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:06:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:06:22.494140+0000 mon.smithi061 (mon.0) 1658 : audit [DBG] from='client.? 172.21.15.61:0/2813668394' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:06:23.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:06:21.842561+0000 mgr.smithi067.rdualw (mgr.24569) 7574 : audit [DBG] from='client.39190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:06:23.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:06:22.136802+0000 mgr.smithi067.rdualw (mgr.24569) 7575 : audit [DBG] from='client.39194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:06:23.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:06:22.494140+0000 mon.smithi061 (mon.0) 1658 : audit [DBG] from='client.? 172.21.15.61:0/2813668394' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:06:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:22.247065+0000 mgr.smithi067.rdualw (mgr.24569) 7576 : cluster [DBG] pgmap v6525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:22.247065+0000 mgr.smithi067.rdualw (mgr.24569) 7576 : cluster [DBG] pgmap v6525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:24.247690+0000 mgr.smithi067.rdualw (mgr.24569) 7577 : cluster [DBG] pgmap v6526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:24.247690+0000 mgr.smithi067.rdualw (mgr.24569) 7577 : cluster [DBG] pgmap v6526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:27.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:26.248627+0000 mgr.smithi067.rdualw (mgr.24569) 7578 : cluster [DBG] pgmap v6527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:06:27.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:26.248627+0000 mgr.smithi067.rdualw (mgr.24569) 7578 : cluster [DBG] pgmap v6527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:06:29.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:28.249152+0000 mgr.smithi067.rdualw (mgr.24569) 7579 : cluster [DBG] pgmap v6528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:29.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:28.249152+0000 mgr.smithi067.rdualw (mgr.24569) 7579 : cluster [DBG] pgmap v6528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:31.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:30.249767+0000 mgr.smithi067.rdualw (mgr.24569) 7580 : cluster [DBG] pgmap v6529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:31.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:30.249767+0000 mgr.smithi067.rdualw (mgr.24569) 7580 : cluster [DBG] pgmap v6529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:33.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:32.250655+0000 mgr.smithi067.rdualw (mgr.24569) 7581 : cluster [DBG] pgmap v6530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:33.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:32.250655+0000 mgr.smithi067.rdualw (mgr.24569) 7581 : cluster [DBG] pgmap v6530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:35.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:34.251330+0000 mgr.smithi067.rdualw (mgr.24569) 7582 : cluster [DBG] pgmap v6531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:34.251330+0000 mgr.smithi067.rdualw (mgr.24569) 7582 : cluster [DBG] pgmap v6531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:06:35.631710+0000 mon.smithi067 (mon.1) 1161 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:06:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:06:35.632033+0000 mon.smithi061 (mon.0) 1659 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:06:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:06:35.632037+0000 mon.smithi067 (mon.1) 1162 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:06:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:06:35.632356+0000 mon.smithi061 (mon.0) 1660 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:06:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:06:35.631710+0000 mon.smithi067 (mon.1) 1161 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:06:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:06:35.632033+0000 mon.smithi061 (mon.0) 1659 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:06:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:06:35.632037+0000 mon.smithi067 (mon.1) 1162 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:06:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:06:35.632356+0000 mon.smithi061 (mon.0) 1660 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:06:37.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:36.252216+0000 mgr.smithi067.rdualw (mgr.24569) 7583 : cluster [DBG] pgmap v6532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:06:37.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:36.252216+0000 mgr.smithi067.rdualw (mgr.24569) 7583 : cluster [DBG] pgmap v6532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:06:39.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:38.252870+0000 mgr.smithi067.rdualw (mgr.24569) 7584 : cluster [DBG] pgmap v6533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:39.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:38.252870+0000 mgr.smithi067.rdualw (mgr.24569) 7584 : cluster [DBG] pgmap v6533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:41.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:40.253525+0000 mgr.smithi067.rdualw (mgr.24569) 7585 : cluster [DBG] pgmap v6534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:41.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:40.253525+0000 mgr.smithi067.rdualw (mgr.24569) 7585 : cluster [DBG] pgmap v6534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:43.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:42.254486+0000 mgr.smithi067.rdualw (mgr.24569) 7586 : cluster [DBG] pgmap v6535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:43.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:42.254486+0000 mgr.smithi067.rdualw (mgr.24569) 7586 : cluster [DBG] pgmap v6535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:45.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:44.255107+0000 mgr.smithi067.rdualw (mgr.24569) 7587 : cluster [DBG] pgmap v6536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:45.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:44.255107+0000 mgr.smithi067.rdualw (mgr.24569) 7587 : cluster [DBG] pgmap v6536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:47.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:46.255923+0000 mgr.smithi067.rdualw (mgr.24569) 7588 : cluster [DBG] pgmap v6537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:06:47.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:46.255923+0000 mgr.smithi067.rdualw (mgr.24569) 7588 : cluster [DBG] pgmap v6537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:06:49.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:48.256605+0000 mgr.smithi067.rdualw (mgr.24569) 7589 : cluster [DBG] pgmap v6538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:48.256605+0000 mgr.smithi067.rdualw (mgr.24569) 7589 : cluster [DBG] pgmap v6538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:51.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:50.257246+0000 mgr.smithi067.rdualw (mgr.24569) 7590 : cluster [DBG] pgmap v6539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:50.257246+0000 mgr.smithi067.rdualw (mgr.24569) 7590 : cluster [DBG] pgmap v6539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:52.805 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:06:53.095 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:06:53.096 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 112s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:06:53.096 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 112s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:06:53.096 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 114s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:06:53.096 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 112s ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:06:53.097 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 112s ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:06:53.097 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 114s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:06:53.097 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 112s ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:06:53.097 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 114s ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:06:53.098 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 112s ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:06:53.098 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 114s ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:06:53.098 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 112s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:06:53.099 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 114s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:06:53.099 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 112s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:06:53.099 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 114s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:06:53.099 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 112s ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:06:53.100 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 112s ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:06:53.100 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 112s ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:06:53.100 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 112s ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:06:53.101 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 114s ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:06:53.101 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 114s ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:06:53.101 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 114s ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:06:53.101 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 114s ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:06:53.102 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 112s ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:06:53.441 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:06:53.441 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:06:53.441 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:06:53.441 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:06:53.442 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:06:53.442 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:06:53.442 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:06:53.442 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:06:53.443 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:06:53.443 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:06:53.443 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:06:53.443 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:06:53.443 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:06:53.444 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:06:53.444 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:06:53.444 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:06:53.444 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:06:53.445 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:06:53.445 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:06:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:52.258280+0000 mgr.smithi067.rdualw (mgr.24569) 7591 : cluster [DBG] pgmap v6540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:06:52.791684+0000 mgr.smithi067.rdualw (mgr.24569) 7592 : audit [DBG] from='client.39202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:06:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:06:53.078442+0000 mgr.smithi067.rdualw (mgr.24569) 7593 : audit [DBG] from='client.39206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:06:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:52.258280+0000 mgr.smithi067.rdualw (mgr.24569) 7591 : cluster [DBG] pgmap v6540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:06:52.791684+0000 mgr.smithi067.rdualw (mgr.24569) 7592 : audit [DBG] from='client.39202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:06:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:06:53.078442+0000 mgr.smithi067.rdualw (mgr.24569) 7593 : audit [DBG] from='client.39206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:06:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:06:53.439870+0000 mon.smithi061 (mon.0) 1661 : audit [DBG] from='client.? 172.21.15.61:0/2372803924' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:06:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:06:53.439870+0000 mon.smithi061 (mon.0) 1661 : audit [DBG] from='client.? 172.21.15.61:0/2372803924' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:06:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:54.258907+0000 mgr.smithi067.rdualw (mgr.24569) 7594 : cluster [DBG] pgmap v6541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:54.258907+0000 mgr.smithi067.rdualw (mgr.24569) 7594 : cluster [DBG] pgmap v6541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:56.259740+0000 mgr.smithi067.rdualw (mgr.24569) 7595 : cluster [DBG] pgmap v6542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:06:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:56.259740+0000 mgr.smithi067.rdualw (mgr.24569) 7595 : cluster [DBG] pgmap v6542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:06:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:06:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:06:58.260377+0000 mgr.smithi067.rdualw (mgr.24569) 7596 : cluster [DBG] pgmap v6543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:06:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:06:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:06:58.260377+0000 mgr.smithi067.rdualw (mgr.24569) 7596 : cluster [DBG] pgmap v6543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:01.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:00.260972+0000 mgr.smithi067.rdualw (mgr.24569) 7597 : cluster [DBG] pgmap v6544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:00.260972+0000 mgr.smithi067.rdualw (mgr.24569) 7597 : cluster [DBG] pgmap v6544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:07:01.815190+0000 mon.smithi067 (mon.1) 1163 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:07:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:07:01.816632+0000 mon.smithi067 (mon.1) 1164 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:07:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:07:01.817555+0000 mon.smithi067 (mon.1) 1165 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:07:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:07:01.818394+0000 mgr.smithi067.rdualw (mgr.24569) 7598 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:07:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:07:02.174252+0000 mon.smithi061 (mon.0) 1662 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:07:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:07:02.185343+0000 mon.smithi061 (mon.0) 1663 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:07:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:07:01.815190+0000 mon.smithi067 (mon.1) 1163 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:07:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:07:01.816632+0000 mon.smithi067 (mon.1) 1164 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:07:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:07:01.817555+0000 mon.smithi067 (mon.1) 1165 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:07:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:07:01.818394+0000 mgr.smithi067.rdualw (mgr.24569) 7598 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:07:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:07:02.174252+0000 mon.smithi061 (mon.0) 1662 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:07:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:07:02.185343+0000 mon.smithi061 (mon.0) 1663 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:07:03.855 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:02.261660+0000 mgr.smithi067.rdualw (mgr.24569) 7599 : cluster [DBG] pgmap v6545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:03.855 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:07:02.588982+0000 mon.smithi061 (mon.0) 1664 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:07:03.855 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:07:02.596830+0000 mon.smithi061 (mon.0) 1665 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:07:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:02.261660+0000 mgr.smithi067.rdualw (mgr.24569) 7599 : cluster [DBG] pgmap v6545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:07:02.588982+0000 mon.smithi061 (mon.0) 1664 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:07:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:07:02.596830+0000 mon.smithi061 (mon.0) 1665 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:07:05.855 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:04.262240+0000 mgr.smithi067.rdualw (mgr.24569) 7600 : cluster [DBG] pgmap v6546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:04.262240+0000 mgr.smithi067.rdualw (mgr.24569) 7600 : cluster [DBG] pgmap v6546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:07.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:06.263213+0000 mgr.smithi067.rdualw (mgr.24569) 7601 : cluster [DBG] pgmap v6547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:07:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:06.263213+0000 mgr.smithi067.rdualw (mgr.24569) 7601 : cluster [DBG] pgmap v6547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:07:09.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:08.263753+0000 mgr.smithi067.rdualw (mgr.24569) 7602 : cluster [DBG] pgmap v6548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:09.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:08.263753+0000 mgr.smithi067.rdualw (mgr.24569) 7602 : cluster [DBG] pgmap v6548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:11.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:10.264319+0000 mgr.smithi067.rdualw (mgr.24569) 7603 : cluster [DBG] pgmap v6549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:11.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:10.264319+0000 mgr.smithi067.rdualw (mgr.24569) 7603 : cluster [DBG] pgmap v6549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:13.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:12.265146+0000 mgr.smithi067.rdualw (mgr.24569) 7604 : cluster [DBG] pgmap v6550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:13.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:12.265146+0000 mgr.smithi067.rdualw (mgr.24569) 7604 : cluster [DBG] pgmap v6550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:15.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:14.265714+0000 mgr.smithi067.rdualw (mgr.24569) 7605 : cluster [DBG] pgmap v6551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:15.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:14.265714+0000 mgr.smithi067.rdualw (mgr.24569) 7605 : cluster [DBG] pgmap v6551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:17.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:16.266688+0000 mgr.smithi067.rdualw (mgr.24569) 7606 : cluster [DBG] pgmap v6552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:07:17.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:16.266688+0000 mgr.smithi067.rdualw (mgr.24569) 7606 : cluster [DBG] pgmap v6552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:07:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:18.267420+0000 mgr.smithi067.rdualw (mgr.24569) 7607 : cluster [DBG] pgmap v6553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:18.267420+0000 mgr.smithi067.rdualw (mgr.24569) 7607 : cluster [DBG] pgmap v6553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:20.268249+0000 mgr.smithi067.rdualw (mgr.24569) 7608 : cluster [DBG] pgmap v6554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:21.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:20.268249+0000 mgr.smithi067.rdualw (mgr.24569) 7608 : cluster [DBG] pgmap v6554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:23.748 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:07:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:22.269140+0000 mgr.smithi067.rdualw (mgr.24569) 7609 : cluster [DBG] pgmap v6555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:22.269140+0000 mgr.smithi067.rdualw (mgr.24569) 7609 : cluster [DBG] pgmap v6555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:24.043 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:07:24.043 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 2m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:07:24.043 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 2m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:07:24.044 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 2m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:07:24.044 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 2m ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:07:24.044 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 2m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:07:24.044 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 2m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:07:24.045 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 2m ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:07:24.045 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 2m ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:07:24.045 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 2m ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:07:24.045 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 2m ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:07:24.045 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 2m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:07:24.046 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 2m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:07:24.046 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 2m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:07:24.046 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 2m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:07:24.046 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 2m ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:07:24.047 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 2m ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:07:24.047 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 2m ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:07:24.047 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 2m ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:07:24.047 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 2m ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:07:24.047 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 2m ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:07:24.048 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 2m ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:07:24.048 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 2m ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:07:24.048 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 2m ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:07:24.383 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:07:24.383 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:07:24.384 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:07:24.384 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:07:24.384 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:07:24.384 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:07:24.385 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:07:24.385 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:07:24.385 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:07:24.385 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:07:24.386 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:07:24.386 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:07:24.386 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:07:24.386 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:07:24.386 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:07:24.387 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:07:24.387 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:07:24.387 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:07:24.387 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:07:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:07:23.735888+0000 mgr.smithi067.rdualw (mgr.24569) 7610 : audit [DBG] from='client.39214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:07:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:07:24.026024+0000 mgr.smithi067.rdualw (mgr.24569) 7611 : audit [DBG] from='client.39218 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:07:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:07:23.735888+0000 mgr.smithi067.rdualw (mgr.24569) 7610 : audit [DBG] from='client.39214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:07:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:07:24.026024+0000 mgr.smithi067.rdualw (mgr.24569) 7611 : audit [DBG] from='client.39218 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:07:25.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:24.269903+0000 mgr.smithi067.rdualw (mgr.24569) 7612 : cluster [DBG] pgmap v6556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:25.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:07:24.382419+0000 mon.smithi061 (mon.0) 1666 : audit [DBG] from='client.? 172.21.15.61:0/3866330813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:07:25.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:24.269903+0000 mgr.smithi067.rdualw (mgr.24569) 7612 : cluster [DBG] pgmap v6556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:25.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:07:24.382419+0000 mon.smithi061 (mon.0) 1666 : audit [DBG] from='client.? 172.21.15.61:0/3866330813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:07:27.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:26.270820+0000 mgr.smithi067.rdualw (mgr.24569) 7613 : cluster [DBG] pgmap v6557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:07:27.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:26.270820+0000 mgr.smithi067.rdualw (mgr.24569) 7613 : cluster [DBG] pgmap v6557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:07:29.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:28.271296+0000 mgr.smithi067.rdualw (mgr.24569) 7614 : cluster [DBG] pgmap v6558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:29.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:28.271296+0000 mgr.smithi067.rdualw (mgr.24569) 7614 : cluster [DBG] pgmap v6558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:31.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:30.272163+0000 mgr.smithi067.rdualw (mgr.24569) 7615 : cluster [DBG] pgmap v6559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:31.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:30.272163+0000 mgr.smithi067.rdualw (mgr.24569) 7615 : cluster [DBG] pgmap v6559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:33.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:32.273110+0000 mgr.smithi067.rdualw (mgr.24569) 7616 : cluster [DBG] pgmap v6560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:33.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:32.273110+0000 mgr.smithi067.rdualw (mgr.24569) 7616 : cluster [DBG] pgmap v6560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:34.273834+0000 mgr.smithi067.rdualw (mgr.24569) 7617 : cluster [DBG] pgmap v6561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:34.273834+0000 mgr.smithi067.rdualw (mgr.24569) 7617 : cluster [DBG] pgmap v6561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:07:35.636920+0000 mon.smithi067 (mon.1) 1166 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:07:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:07:35.637152+0000 mon.smithi067 (mon.1) 1167 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:07:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:07:35.637565+0000 mon.smithi061 (mon.0) 1667 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:07:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:07:35.638053+0000 mon.smithi061 (mon.0) 1668 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:07:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:07:35.636920+0000 mon.smithi067 (mon.1) 1166 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:07:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:07:35.637152+0000 mon.smithi067 (mon.1) 1167 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:07:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:07:35.637565+0000 mon.smithi061 (mon.0) 1667 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:07:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:07:35.638053+0000 mon.smithi061 (mon.0) 1668 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:07:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:36.274882+0000 mgr.smithi067.rdualw (mgr.24569) 7618 : cluster [DBG] pgmap v6562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:07:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:36.274882+0000 mgr.smithi067.rdualw (mgr.24569) 7618 : cluster [DBG] pgmap v6562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:07:39.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:38.275379+0000 mgr.smithi067.rdualw (mgr.24569) 7619 : cluster [DBG] pgmap v6563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:39.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:38.275379+0000 mgr.smithi067.rdualw (mgr.24569) 7619 : cluster [DBG] pgmap v6563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:41.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:40.276101+0000 mgr.smithi067.rdualw (mgr.24569) 7620 : cluster [DBG] pgmap v6564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:40.276101+0000 mgr.smithi067.rdualw (mgr.24569) 7620 : cluster [DBG] pgmap v6564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:43.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:42.277034+0000 mgr.smithi067.rdualw (mgr.24569) 7621 : cluster [DBG] pgmap v6565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:42.277034+0000 mgr.smithi067.rdualw (mgr.24569) 7621 : cluster [DBG] pgmap v6565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:45.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:44.277614+0000 mgr.smithi067.rdualw (mgr.24569) 7622 : cluster [DBG] pgmap v6566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:44.277614+0000 mgr.smithi067.rdualw (mgr.24569) 7622 : cluster [DBG] pgmap v6566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:47.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:46.278694+0000 mgr.smithi067.rdualw (mgr.24569) 7623 : cluster [DBG] pgmap v6567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:07:47.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:46.278694+0000 mgr.smithi067.rdualw (mgr.24569) 7623 : cluster [DBG] pgmap v6567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:07:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:48.279328+0000 mgr.smithi067.rdualw (mgr.24569) 7624 : cluster [DBG] pgmap v6568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:48.279328+0000 mgr.smithi067.rdualw (mgr.24569) 7624 : cluster [DBG] pgmap v6568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:51.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:50.279894+0000 mgr.smithi067.rdualw (mgr.24569) 7625 : cluster [DBG] pgmap v6569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:50.279894+0000 mgr.smithi067.rdualw (mgr.24569) 7625 : cluster [DBG] pgmap v6569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:52.280859+0000 mgr.smithi067.rdualw (mgr.24569) 7626 : cluster [DBG] pgmap v6570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:52.280859+0000 mgr.smithi067.rdualw (mgr.24569) 7626 : cluster [DBG] pgmap v6570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:54.692 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:07:54.983 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:07:54.983 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 2m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:07:54.983 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 2m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:07:54.984 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 2m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:07:54.984 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 2m ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:07:54.984 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 2m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:07:54.984 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 2m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:07:54.984 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 2m ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:07:54.985 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 2m ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:07:54.985 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 2m ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:07:54.985 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 2m ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:07:54.985 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 2m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:07:54.986 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 2m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:07:54.986 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 2m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:07:54.986 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 2m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:07:54.987 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 2m ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:07:54.987 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 2m ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:07:54.987 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 2m ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:07:54.987 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 2m ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:07:54.987 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 2m ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:07:54.988 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 2m ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:07:54.988 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 2m ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:07:54.988 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 2m ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:07:54.988 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 2m ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:07:55.327 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:07:55.327 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:07:55.327 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:07:55.328 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:07:55.328 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:07:55.328 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:07:55.328 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:07:55.328 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:07:55.329 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:07:55.329 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:07:55.329 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:07:55.329 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:07:55.330 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:07:55.330 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:07:55.330 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:07:55.330 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:07:55.331 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:07:55.331 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:07:55.331 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:07:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:54.281627+0000 mgr.smithi067.rdualw (mgr.24569) 7627 : cluster [DBG] pgmap v6571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:07:54.679016+0000 mgr.smithi067.rdualw (mgr.24569) 7628 : audit [DBG] from='client.39226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:07:55.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:07:54.965867+0000 mgr.smithi067.rdualw (mgr.24569) 7629 : audit [DBG] from='client.39230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:07:55.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:07:55.325863+0000 mon.smithi061 (mon.0) 1669 : audit [DBG] from='client.? 172.21.15.61:0/646458162' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:07:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:54.281627+0000 mgr.smithi067.rdualw (mgr.24569) 7627 : cluster [DBG] pgmap v6571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:07:54.679016+0000 mgr.smithi067.rdualw (mgr.24569) 7628 : audit [DBG] from='client.39226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:07:55.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:07:54.965867+0000 mgr.smithi067.rdualw (mgr.24569) 7629 : audit [DBG] from='client.39230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:07:55.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:07:55.325863+0000 mon.smithi061 (mon.0) 1669 : audit [DBG] from='client.? 172.21.15.61:0/646458162' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:07:57.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:56.282544+0000 mgr.smithi067.rdualw (mgr.24569) 7630 : cluster [DBG] pgmap v6572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:07:57.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:56.282544+0000 mgr.smithi067.rdualw (mgr.24569) 7630 : cluster [DBG] pgmap v6572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:07:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:07:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:07:58.283043+0000 mgr.smithi067.rdualw (mgr.24569) 7631 : cluster [DBG] pgmap v6573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:07:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:07:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:07:58.283043+0000 mgr.smithi067.rdualw (mgr.24569) 7631 : cluster [DBG] pgmap v6573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:01.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:00.283830+0000 mgr.smithi067.rdualw (mgr.24569) 7632 : cluster [DBG] pgmap v6574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:00.283830+0000 mgr.smithi067.rdualw (mgr.24569) 7632 : cluster [DBG] pgmap v6574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:03.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:02.284658+0000 mgr.smithi067.rdualw (mgr.24569) 7633 : cluster [DBG] pgmap v6575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:03.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:08:02.602378+0000 mon.smithi067 (mon.1) 1168 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:08:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:08:02.603875+0000 mon.smithi067 (mon.1) 1169 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:08:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:08:02.604843+0000 mon.smithi067 (mon.1) 1170 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:08:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:08:02.605688+0000 mgr.smithi067.rdualw (mgr.24569) 7634 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:08:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:08:03.022337+0000 mon.smithi061 (mon.0) 1670 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:08:03.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:08:03.028413+0000 mon.smithi061 (mon.0) 1671 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:08:03.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:02.284658+0000 mgr.smithi067.rdualw (mgr.24569) 7633 : cluster [DBG] pgmap v6575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:03.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:08:02.602378+0000 mon.smithi067 (mon.1) 1168 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:08:03.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:08:02.603875+0000 mon.smithi067 (mon.1) 1169 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:08:03.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:08:02.604843+0000 mon.smithi067 (mon.1) 1170 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:08:03.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:08:02.605688+0000 mgr.smithi067.rdualw (mgr.24569) 7634 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:08:03.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:08:03.022337+0000 mon.smithi061 (mon.0) 1670 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:08:03.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:08:03.028413+0000 mon.smithi061 (mon.0) 1671 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:08:05.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:04.285455+0000 mgr.smithi067.rdualw (mgr.24569) 7635 : cluster [DBG] pgmap v6576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:04.285455+0000 mgr.smithi067.rdualw (mgr.24569) 7635 : cluster [DBG] pgmap v6576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:07.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:06.286362+0000 mgr.smithi067.rdualw (mgr.24569) 7636 : cluster [DBG] pgmap v6577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:08:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:06.286362+0000 mgr.smithi067.rdualw (mgr.24569) 7636 : cluster [DBG] pgmap v6577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:08:09.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:08.286973+0000 mgr.smithi067.rdualw (mgr.24569) 7637 : cluster [DBG] pgmap v6578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:08.286973+0000 mgr.smithi067.rdualw (mgr.24569) 7637 : cluster [DBG] pgmap v6578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:10.287761+0000 mgr.smithi067.rdualw (mgr.24569) 7638 : cluster [DBG] pgmap v6579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:11.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:10.287761+0000 mgr.smithi067.rdualw (mgr.24569) 7638 : cluster [DBG] pgmap v6579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:13.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:12.288755+0000 mgr.smithi067.rdualw (mgr.24569) 7639 : cluster [DBG] pgmap v6580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:12.288755+0000 mgr.smithi067.rdualw (mgr.24569) 7639 : cluster [DBG] pgmap v6580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:14.289464+0000 mgr.smithi067.rdualw (mgr.24569) 7640 : cluster [DBG] pgmap v6581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:14.289464+0000 mgr.smithi067.rdualw (mgr.24569) 7640 : cluster [DBG] pgmap v6581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:17.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:16.290310+0000 mgr.smithi067.rdualw (mgr.24569) 7641 : cluster [DBG] pgmap v6582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:08:17.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:16.290310+0000 mgr.smithi067.rdualw (mgr.24569) 7641 : cluster [DBG] pgmap v6582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:08:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:18.290980+0000 mgr.smithi067.rdualw (mgr.24569) 7642 : cluster [DBG] pgmap v6583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:18.290980+0000 mgr.smithi067.rdualw (mgr.24569) 7642 : cluster [DBG] pgmap v6583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:20.291690+0000 mgr.smithi067.rdualw (mgr.24569) 7643 : cluster [DBG] pgmap v6584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:21.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:20.291690+0000 mgr.smithi067.rdualw (mgr.24569) 7643 : cluster [DBG] pgmap v6584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:22.292641+0000 mgr.smithi067.rdualw (mgr.24569) 7644 : cluster [DBG] pgmap v6585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:22.292641+0000 mgr.smithi067.rdualw (mgr.24569) 7644 : cluster [DBG] pgmap v6585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:25.718 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:08:25.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:24.293239+0000 mgr.smithi067.rdualw (mgr.24569) 7645 : cluster [DBG] pgmap v6586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:25.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:24.293239+0000 mgr.smithi067.rdualw (mgr.24569) 7645 : cluster [DBG] pgmap v6586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:26.007 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:08:26.008 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 3m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:08:26.008 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 3m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:08:26.008 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 3m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:08:26.009 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 3m ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:08:26.009 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 3m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:08:26.009 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 3m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:08:26.009 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 3m ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:08:26.009 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 3m ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:08:26.010 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 3m ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:08:26.010 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 3m ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:08:26.010 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 3m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:08:26.010 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 3m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:08:26.011 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 3m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:08:26.011 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 3m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:08:26.012 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 3m ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:08:26.012 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 3m ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:08:26.012 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 3m ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:08:26.012 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 3m ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:08:26.012 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 3m ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:08:26.013 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 3m ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:08:26.013 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 3m ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:08:26.013 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 3m ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:08:26.014 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 3m ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:08:26.365 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:08:26.366 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:08:26.366 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:08:26.366 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:08:26.366 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:08:26.366 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:08:26.367 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:08:26.367 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:08:26.367 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:08:26.367 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:08:26.368 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:08:26.368 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:08:26.368 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:08:26.368 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:08:26.368 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:08:26.369 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:08:26.369 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:08:26.369 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:08:26.369 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:08:26.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:08:25.705786+0000 mgr.smithi067.rdualw (mgr.24569) 7646 : audit [DBG] from='client.39238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:08:26.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:08:25.990479+0000 mgr.smithi067.rdualw (mgr.24569) 7647 : audit [DBG] from='client.39242 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:08:26.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:08:25.705786+0000 mgr.smithi067.rdualw (mgr.24569) 7646 : audit [DBG] from='client.39238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:08:26.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:08:25.990479+0000 mgr.smithi067.rdualw (mgr.24569) 7647 : audit [DBG] from='client.39242 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:08:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:26.294258+0000 mgr.smithi067.rdualw (mgr.24569) 7648 : cluster [DBG] pgmap v6587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:08:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:08:26.364560+0000 mon.smithi061 (mon.0) 1672 : audit [DBG] from='client.? 172.21.15.61:0/4059750545' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:08:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:26.294258+0000 mgr.smithi067.rdualw (mgr.24569) 7648 : cluster [DBG] pgmap v6587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:08:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:08:26.364560+0000 mon.smithi061 (mon.0) 1672 : audit [DBG] from='client.? 172.21.15.61:0/4059750545' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:08:29.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:28.294950+0000 mgr.smithi067.rdualw (mgr.24569) 7649 : cluster [DBG] pgmap v6588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:29.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:28.294950+0000 mgr.smithi067.rdualw (mgr.24569) 7649 : cluster [DBG] pgmap v6588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:31.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:30.295732+0000 mgr.smithi067.rdualw (mgr.24569) 7650 : cluster [DBG] pgmap v6589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:31.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:30.295732+0000 mgr.smithi067.rdualw (mgr.24569) 7650 : cluster [DBG] pgmap v6589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:33.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:32.296561+0000 mgr.smithi067.rdualw (mgr.24569) 7651 : cluster [DBG] pgmap v6590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:33.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:32.296561+0000 mgr.smithi067.rdualw (mgr.24569) 7651 : cluster [DBG] pgmap v6590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:34.297200+0000 mgr.smithi067.rdualw (mgr.24569) 7652 : cluster [DBG] pgmap v6591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:34.297200+0000 mgr.smithi067.rdualw (mgr.24569) 7652 : cluster [DBG] pgmap v6591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:08:35.642749+0000 mon.smithi067 (mon.1) 1171 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:08:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:08:35.642994+0000 mon.smithi067 (mon.1) 1172 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:08:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:08:35.643138+0000 mon.smithi061 (mon.0) 1673 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:08:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:08:35.643642+0000 mon.smithi061 (mon.0) 1674 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:08:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:08:35.642749+0000 mon.smithi067 (mon.1) 1171 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:08:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:08:35.642994+0000 mon.smithi067 (mon.1) 1172 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:08:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:08:35.643138+0000 mon.smithi061 (mon.0) 1673 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:08:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:08:35.643642+0000 mon.smithi061 (mon.0) 1674 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:08:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:36.298074+0000 mgr.smithi067.rdualw (mgr.24569) 7653 : cluster [DBG] pgmap v6592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:08:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:36.298074+0000 mgr.smithi067.rdualw (mgr.24569) 7653 : cluster [DBG] pgmap v6592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:08:39.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:38.298574+0000 mgr.smithi067.rdualw (mgr.24569) 7654 : cluster [DBG] pgmap v6593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:39.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:38.298574+0000 mgr.smithi067.rdualw (mgr.24569) 7654 : cluster [DBG] pgmap v6593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:41.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:40.299516+0000 mgr.smithi067.rdualw (mgr.24569) 7655 : cluster [DBG] pgmap v6594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:40.299516+0000 mgr.smithi067.rdualw (mgr.24569) 7655 : cluster [DBG] pgmap v6594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:43.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:42.300302+0000 mgr.smithi067.rdualw (mgr.24569) 7656 : cluster [DBG] pgmap v6595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:42.300302+0000 mgr.smithi067.rdualw (mgr.24569) 7656 : cluster [DBG] pgmap v6595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:45.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:44.300952+0000 mgr.smithi067.rdualw (mgr.24569) 7657 : cluster [DBG] pgmap v6596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:44.300952+0000 mgr.smithi067.rdualw (mgr.24569) 7657 : cluster [DBG] pgmap v6596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:47.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:46.302027+0000 mgr.smithi067.rdualw (mgr.24569) 7658 : cluster [DBG] pgmap v6597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:08:47.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:46.302027+0000 mgr.smithi067.rdualw (mgr.24569) 7658 : cluster [DBG] pgmap v6597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:08:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:48.302514+0000 mgr.smithi067.rdualw (mgr.24569) 7659 : cluster [DBG] pgmap v6598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:48.302514+0000 mgr.smithi067.rdualw (mgr.24569) 7659 : cluster [DBG] pgmap v6598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:51.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:50.303312+0000 mgr.smithi067.rdualw (mgr.24569) 7660 : cluster [DBG] pgmap v6599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:50.303312+0000 mgr.smithi067.rdualw (mgr.24569) 7660 : cluster [DBG] pgmap v6599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:52.304041+0000 mgr.smithi067.rdualw (mgr.24569) 7661 : cluster [DBG] pgmap v6600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:52.304041+0000 mgr.smithi067.rdualw (mgr.24569) 7661 : cluster [DBG] pgmap v6600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:54.304714+0000 mgr.smithi067.rdualw (mgr.24569) 7662 : cluster [DBG] pgmap v6601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:54.304714+0000 mgr.smithi067.rdualw (mgr.24569) 7662 : cluster [DBG] pgmap v6601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:56.672 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:08:56.960 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:08:56.960 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 3m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:08:56.961 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 3m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:08:56.961 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 3m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:08:56.961 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 3m ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:08:56.961 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 3m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:08:56.962 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 3m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:08:56.962 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 3m ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:08:56.962 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 3m ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:08:56.962 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 3m ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:08:56.962 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 3m ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:08:56.963 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 3m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:08:56.963 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 3m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:08:56.963 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 3m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:08:56.963 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 3m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:08:56.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 3m ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:08:56.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 3m ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:08:56.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 3m ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:08:56.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 3m ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:08:56.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 3m ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:08:56.965 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 3m ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:08:56.965 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 3m ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:08:56.965 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 3m ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:08:56.965 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 3m ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:08:57.307 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:08:57.307 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:08:57.308 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:08:57.308 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:08:57.308 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:08:57.309 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:08:57.309 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:08:57.309 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:08:57.309 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:08:57.309 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:08:57.310 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:08:57.310 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:08:57.310 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:08:57.311 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:08:57.311 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:08:57.311 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:08:57.312 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:08:57.312 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:08:57.312 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:08:57.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:56.305574+0000 mgr.smithi067.rdualw (mgr.24569) 7663 : cluster [DBG] pgmap v6602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:08:57.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:08:56.659155+0000 mgr.smithi067.rdualw (mgr.24569) 7664 : audit [DBG] from='client.39250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:08:57.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:08:56.943320+0000 mgr.smithi067.rdualw (mgr.24569) 7665 : audit [DBG] from='client.39254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:08:57.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:56.305574+0000 mgr.smithi067.rdualw (mgr.24569) 7663 : cluster [DBG] pgmap v6602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:08:57.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:08:56.659155+0000 mgr.smithi067.rdualw (mgr.24569) 7664 : audit [DBG] from='client.39250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:08:57.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:08:56.943320+0000 mgr.smithi067.rdualw (mgr.24569) 7665 : audit [DBG] from='client.39254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:08:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:08:57.306483+0000 mon.smithi061 (mon.0) 1675 : audit [DBG] from='client.? 172.21.15.61:0/303702819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:08:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:08:57.306483+0000 mon.smithi061 (mon.0) 1675 : audit [DBG] from='client.? 172.21.15.61:0/303702819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:08:59.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:08:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:08:58.306124+0000 mgr.smithi067.rdualw (mgr.24569) 7666 : cluster [DBG] pgmap v6603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:08:59.570 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:08:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:08:58.306124+0000 mgr.smithi067.rdualw (mgr.24569) 7666 : cluster [DBG] pgmap v6603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:01.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:00.306783+0000 mgr.smithi067.rdualw (mgr.24569) 7667 : cluster [DBG] pgmap v6604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:00.306783+0000 mgr.smithi067.rdualw (mgr.24569) 7667 : cluster [DBG] pgmap v6604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:03.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:02.307749+0000 mgr.smithi067.rdualw (mgr.24569) 7668 : cluster [DBG] pgmap v6605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:09:03.032046+0000 mon.smithi067 (mon.1) 1173 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:09:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:09:03.033413+0000 mon.smithi067 (mon.1) 1174 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:09:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:09:03.034329+0000 mon.smithi067 (mon.1) 1175 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:09:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:09:03.035201+0000 mgr.smithi067.rdualw (mgr.24569) 7669 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:09:03.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:02.307749+0000 mgr.smithi067.rdualw (mgr.24569) 7668 : cluster [DBG] pgmap v6605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:03.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:09:03.032046+0000 mon.smithi067 (mon.1) 1173 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:09:03.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:09:03.033413+0000 mon.smithi067 (mon.1) 1174 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:09:03.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:09:03.034329+0000 mon.smithi067 (mon.1) 1175 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:09:03.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:09:03.035201+0000 mgr.smithi067.rdualw (mgr.24569) 7669 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:09:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:09:03.453854+0000 mon.smithi061 (mon.0) 1676 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:09:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:09:03.458968+0000 mon.smithi061 (mon.0) 1677 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:09:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:09:03.453854+0000 mon.smithi061 (mon.0) 1676 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:09:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:09:03.458968+0000 mon.smithi061 (mon.0) 1677 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:09:05.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:04.308457+0000 mgr.smithi067.rdualw (mgr.24569) 7670 : cluster [DBG] pgmap v6606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:04.308457+0000 mgr.smithi067.rdualw (mgr.24569) 7670 : cluster [DBG] pgmap v6606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:07.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:06.309343+0000 mgr.smithi067.rdualw (mgr.24569) 7671 : cluster [DBG] pgmap v6607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:09:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:06.309343+0000 mgr.smithi067.rdualw (mgr.24569) 7671 : cluster [DBG] pgmap v6607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:09:09.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:08.310006+0000 mgr.smithi067.rdualw (mgr.24569) 7672 : cluster [DBG] pgmap v6608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:08.310006+0000 mgr.smithi067.rdualw (mgr.24569) 7672 : cluster [DBG] pgmap v6608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:10.310913+0000 mgr.smithi067.rdualw (mgr.24569) 7673 : cluster [DBG] pgmap v6609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:11.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:10.310913+0000 mgr.smithi067.rdualw (mgr.24569) 7673 : cluster [DBG] pgmap v6609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:13.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:12.311725+0000 mgr.smithi067.rdualw (mgr.24569) 7674 : cluster [DBG] pgmap v6610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:12.311725+0000 mgr.smithi067.rdualw (mgr.24569) 7674 : cluster [DBG] pgmap v6610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:15.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:14.312405+0000 mgr.smithi067.rdualw (mgr.24569) 7675 : cluster [DBG] pgmap v6611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:14.312405+0000 mgr.smithi067.rdualw (mgr.24569) 7675 : cluster [DBG] pgmap v6611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:17.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:16.313407+0000 mgr.smithi067.rdualw (mgr.24569) 7676 : cluster [DBG] pgmap v6612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:09:17.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:16.313407+0000 mgr.smithi067.rdualw (mgr.24569) 7676 : cluster [DBG] pgmap v6612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:09:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:18.313910+0000 mgr.smithi067.rdualw (mgr.24569) 7677 : cluster [DBG] pgmap v6613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:18.313910+0000 mgr.smithi067.rdualw (mgr.24569) 7677 : cluster [DBG] pgmap v6613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:20.314653+0000 mgr.smithi067.rdualw (mgr.24569) 7678 : cluster [DBG] pgmap v6614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:21.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:20.314653+0000 mgr.smithi067.rdualw (mgr.24569) 7678 : cluster [DBG] pgmap v6614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:22.315341+0000 mgr.smithi067.rdualw (mgr.24569) 7679 : cluster [DBG] pgmap v6615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:22.315341+0000 mgr.smithi067.rdualw (mgr.24569) 7679 : cluster [DBG] pgmap v6615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:25.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:24.316082+0000 mgr.smithi067.rdualw (mgr.24569) 7680 : cluster [DBG] pgmap v6616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:25.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:24.316082+0000 mgr.smithi067.rdualw (mgr.24569) 7680 : cluster [DBG] pgmap v6616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:27.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:26.317006+0000 mgr.smithi067.rdualw (mgr.24569) 7681 : cluster [DBG] pgmap v6617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:09:27.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:26.317006+0000 mgr.smithi067.rdualw (mgr.24569) 7681 : cluster [DBG] pgmap v6617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:09:27.613 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:09:27.906 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:09:27.907 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 4m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:09:27.907 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 4m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:09:27.907 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 4m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:09:27.907 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 4m ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:09:27.908 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 4m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:09:27.908 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 4m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:09:27.908 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 4m ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:09:27.908 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 4m ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:09:27.909 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 4m ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:09:27.909 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 4m ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:09:27.909 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 4m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:09:27.909 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 4m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:09:27.909 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 4m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:09:27.910 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 4m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:09:27.910 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 4m ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:09:27.910 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 4m ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:09:27.910 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 4m ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:09:27.911 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 4m ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:09:27.911 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 4m ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:09:27.911 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 4m ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:09:27.911 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 4m ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:09:27.912 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 4m ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:09:27.912 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 4m ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:09:28.276 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:09:28.277 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:09:28.277 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:09:28.277 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:09:28.277 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:09:28.278 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:09:28.278 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:09:28.278 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:09:28.278 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:09:28.279 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:09:28.279 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:09:28.279 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:09:28.279 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:09:28.280 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:09:28.280 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:09:28.280 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:09:28.280 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:09:28.280 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:09:28.281 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:09:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:09:27.599965+0000 mgr.smithi067.rdualw (mgr.24569) 7682 : audit [DBG] from='client.39262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:09:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:09:27.889009+0000 mgr.smithi067.rdualw (mgr.24569) 7683 : audit [DBG] from='client.39266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:09:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:09:28.275544+0000 mon.smithi061 (mon.0) 1678 : audit [DBG] from='client.? 172.21.15.61:0/775558333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:09:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:09:27.599965+0000 mgr.smithi067.rdualw (mgr.24569) 7682 : audit [DBG] from='client.39262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:09:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:09:27.889009+0000 mgr.smithi067.rdualw (mgr.24569) 7683 : audit [DBG] from='client.39266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:09:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:09:28.275544+0000 mon.smithi061 (mon.0) 1678 : audit [DBG] from='client.? 172.21.15.61:0/775558333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:09:29.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:28.317470+0000 mgr.smithi067.rdualw (mgr.24569) 7684 : cluster [DBG] pgmap v6618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:29.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:28.317470+0000 mgr.smithi067.rdualw (mgr.24569) 7684 : cluster [DBG] pgmap v6618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:31.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:30.318460+0000 mgr.smithi067.rdualw (mgr.24569) 7685 : cluster [DBG] pgmap v6619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:31.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:30.318460+0000 mgr.smithi067.rdualw (mgr.24569) 7685 : cluster [DBG] pgmap v6619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:33.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:32.319376+0000 mgr.smithi067.rdualw (mgr.24569) 7686 : cluster [DBG] pgmap v6620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:33.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:32.319376+0000 mgr.smithi067.rdualw (mgr.24569) 7686 : cluster [DBG] pgmap v6620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:34.319974+0000 mgr.smithi067.rdualw (mgr.24569) 7687 : cluster [DBG] pgmap v6621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:34.319974+0000 mgr.smithi067.rdualw (mgr.24569) 7687 : cluster [DBG] pgmap v6621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:09:35.646048+0000 mon.smithi067 (mon.1) 1176 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:09:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:09:35.646410+0000 mon.smithi061 (mon.0) 1679 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:09:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:09:35.650417+0000 mon.smithi067 (mon.1) 1177 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:09:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:09:35.650904+0000 mon.smithi061 (mon.0) 1680 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:09:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:09:35.646048+0000 mon.smithi067 (mon.1) 1176 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:09:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:09:35.646410+0000 mon.smithi061 (mon.0) 1679 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:09:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:09:35.650417+0000 mon.smithi067 (mon.1) 1177 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:09:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:09:35.650904+0000 mon.smithi061 (mon.0) 1680 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:09:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:36.320928+0000 mgr.smithi067.rdualw (mgr.24569) 7688 : cluster [DBG] pgmap v6622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:09:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:36.320928+0000 mgr.smithi067.rdualw (mgr.24569) 7688 : cluster [DBG] pgmap v6622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:09:39.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:38.321670+0000 mgr.smithi067.rdualw (mgr.24569) 7689 : cluster [DBG] pgmap v6623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:39.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:38.321670+0000 mgr.smithi067.rdualw (mgr.24569) 7689 : cluster [DBG] pgmap v6623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:41.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:40.322418+0000 mgr.smithi067.rdualw (mgr.24569) 7690 : cluster [DBG] pgmap v6624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:40.322418+0000 mgr.smithi067.rdualw (mgr.24569) 7690 : cluster [DBG] pgmap v6624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:43.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:42.323239+0000 mgr.smithi067.rdualw (mgr.24569) 7691 : cluster [DBG] pgmap v6625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:42.323239+0000 mgr.smithi067.rdualw (mgr.24569) 7691 : cluster [DBG] pgmap v6625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:45.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:44.323831+0000 mgr.smithi067.rdualw (mgr.24569) 7692 : cluster [DBG] pgmap v6626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:44.323831+0000 mgr.smithi067.rdualw (mgr.24569) 7692 : cluster [DBG] pgmap v6626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:47.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:46.324674+0000 mgr.smithi067.rdualw (mgr.24569) 7693 : cluster [DBG] pgmap v6627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:09:47.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:46.324674+0000 mgr.smithi067.rdualw (mgr.24569) 7693 : cluster [DBG] pgmap v6627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:09:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:48.325197+0000 mgr.smithi067.rdualw (mgr.24569) 7694 : cluster [DBG] pgmap v6628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:48.325197+0000 mgr.smithi067.rdualw (mgr.24569) 7694 : cluster [DBG] pgmap v6628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:51.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:50.325832+0000 mgr.smithi067.rdualw (mgr.24569) 7695 : cluster [DBG] pgmap v6629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:50.325832+0000 mgr.smithi067.rdualw (mgr.24569) 7695 : cluster [DBG] pgmap v6629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:52.326589+0000 mgr.smithi067.rdualw (mgr.24569) 7696 : cluster [DBG] pgmap v6630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:52.326589+0000 mgr.smithi067.rdualw (mgr.24569) 7696 : cluster [DBG] pgmap v6630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:54.327194+0000 mgr.smithi067.rdualw (mgr.24569) 7697 : cluster [DBG] pgmap v6631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:54.327194+0000 mgr.smithi067.rdualw (mgr.24569) 7697 : cluster [DBG] pgmap v6631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:57.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:56.328025+0000 mgr.smithi067.rdualw (mgr.24569) 7698 : cluster [DBG] pgmap v6632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:09:57.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:56.328025+0000 mgr.smithi067.rdualw (mgr.24569) 7698 : cluster [DBG] pgmap v6632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:09:58.585 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:09:58.877 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:09:58.877 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 4m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:09:58.877 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 4m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:09:58.877 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 5m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:09:58.878 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 4m ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:09:58.878 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 4m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:09:58.878 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 5m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:09:58.878 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 4m ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:09:58.879 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 5m ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:09:58.879 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 4m ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:09:58.879 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 5m ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:09:58.880 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 4m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:09:58.880 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 5m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:09:58.880 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 4m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:09:58.880 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 5m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:09:58.881 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 4m ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:09:58.881 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 4m ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:09:58.881 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 4m ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:09:58.881 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 4m ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:09:58.881 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 5m ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:09:58.882 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 5m ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:09:58.882 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 5m ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:09:58.882 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 5m ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:09:58.882 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 4m ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:09:59.221 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:09:59.222 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:09:59.222 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:09:59.222 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:09:59.222 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:09:59.223 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:09:59.223 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:09:59.223 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:09:59.223 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:09:59.223 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:09:59.224 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:09:59.224 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:09:59.224 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:09:59.224 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:09:59.225 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:09:59.225 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:09:59.225 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:09:59.225 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:09:59.225 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:09:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:09:58.328526+0000 mgr.smithi067.rdualw (mgr.24569) 7699 : cluster [DBG] pgmap v6633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:09:58.573078+0000 mgr.smithi067.rdualw (mgr.24569) 7700 : audit [DBG] from='client.39274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:09:59.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:09:58.859823+0000 mgr.smithi067.rdualw (mgr.24569) 7701 : audit [DBG] from='client.39278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:09:59.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:09:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:09:59.220543+0000 mon.smithi061 (mon.0) 1681 : audit [DBG] from='client.? 172.21.15.61:0/897591128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:09:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:09:58.328526+0000 mgr.smithi067.rdualw (mgr.24569) 7699 : cluster [DBG] pgmap v6633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:09:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:09:58.573078+0000 mgr.smithi067.rdualw (mgr.24569) 7700 : audit [DBG] from='client.39274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:09:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:09:58.859823+0000 mgr.smithi067.rdualw (mgr.24569) 7701 : audit [DBG] from='client.39278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:09:59.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:09:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:09:59.220543+0000 mon.smithi061 (mon.0) 1681 : audit [DBG] from='client.? 172.21.15.61:0/897591128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:10:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:00.000121+0000 mon.smithi061 (mon.0) 1682 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T19:10:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:00.000121+0000 mon.smithi061 (mon.0) 1682 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T19:10:01.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:00.329184+0000 mgr.smithi067.rdualw (mgr.24569) 7702 : cluster [DBG] pgmap v6634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:00.329184+0000 mgr.smithi067.rdualw (mgr.24569) 7702 : cluster [DBG] pgmap v6634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:03.655 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:02.329978+0000 mgr.smithi067.rdualw (mgr.24569) 7703 : cluster [DBG] pgmap v6635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:03.660 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:02.329978+0000 mgr.smithi067.rdualw (mgr.24569) 7703 : cluster [DBG] pgmap v6635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:10:03.464575+0000 mon.smithi067 (mon.1) 1178 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:10:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:10:03.466075+0000 mon.smithi067 (mon.1) 1179 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:10:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:10:03.467090+0000 mon.smithi067 (mon.1) 1180 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:10:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:10:03.467972+0000 mgr.smithi067.rdualw (mgr.24569) 7704 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:10:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:10:03.885848+0000 mon.smithi061 (mon.0) 1683 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:10:04.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:10:03.891178+0000 mon.smithi061 (mon.0) 1684 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:10:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:10:03.464575+0000 mon.smithi067 (mon.1) 1178 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:10:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:10:03.466075+0000 mon.smithi067 (mon.1) 1179 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:10:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:10:03.467090+0000 mon.smithi067 (mon.1) 1180 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:10:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:10:03.467972+0000 mgr.smithi067.rdualw (mgr.24569) 7704 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:10:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:10:03.885848+0000 mon.smithi061 (mon.0) 1683 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:10:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:10:03.891178+0000 mon.smithi061 (mon.0) 1684 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:10:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:04.330731+0000 mgr.smithi067.rdualw (mgr.24569) 7705 : cluster [DBG] pgmap v6636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:04.330731+0000 mgr.smithi067.rdualw (mgr.24569) 7705 : cluster [DBG] pgmap v6636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:07.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:06.331495+0000 mgr.smithi067.rdualw (mgr.24569) 7706 : cluster [DBG] pgmap v6637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:10:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:06.331495+0000 mgr.smithi067.rdualw (mgr.24569) 7706 : cluster [DBG] pgmap v6637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:10:09.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:08.332023+0000 mgr.smithi067.rdualw (mgr.24569) 7707 : cluster [DBG] pgmap v6638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:08.332023+0000 mgr.smithi067.rdualw (mgr.24569) 7707 : cluster [DBG] pgmap v6638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:10.332716+0000 mgr.smithi067.rdualw (mgr.24569) 7708 : cluster [DBG] pgmap v6639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:11.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:10.332716+0000 mgr.smithi067.rdualw (mgr.24569) 7708 : cluster [DBG] pgmap v6639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:13.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:12.333436+0000 mgr.smithi067.rdualw (mgr.24569) 7709 : cluster [DBG] pgmap v6640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:12.333436+0000 mgr.smithi067.rdualw (mgr.24569) 7709 : cluster [DBG] pgmap v6640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:15.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:14.334015+0000 mgr.smithi067.rdualw (mgr.24569) 7710 : cluster [DBG] pgmap v6641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:14.334015+0000 mgr.smithi067.rdualw (mgr.24569) 7710 : cluster [DBG] pgmap v6641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:17.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:16.334983+0000 mgr.smithi067.rdualw (mgr.24569) 7711 : cluster [DBG] pgmap v6642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:10:17.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:16.334983+0000 mgr.smithi067.rdualw (mgr.24569) 7711 : cluster [DBG] pgmap v6642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:10:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:18.335628+0000 mgr.smithi067.rdualw (mgr.24569) 7712 : cluster [DBG] pgmap v6643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:18.335628+0000 mgr.smithi067.rdualw (mgr.24569) 7712 : cluster [DBG] pgmap v6643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:20.336328+0000 mgr.smithi067.rdualw (mgr.24569) 7713 : cluster [DBG] pgmap v6644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:21.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:20.336328+0000 mgr.smithi067.rdualw (mgr.24569) 7713 : cluster [DBG] pgmap v6644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:22.337231+0000 mgr.smithi067.rdualw (mgr.24569) 7714 : cluster [DBG] pgmap v6645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:22.337231+0000 mgr.smithi067.rdualw (mgr.24569) 7714 : cluster [DBG] pgmap v6645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:25.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:24.337791+0000 mgr.smithi067.rdualw (mgr.24569) 7715 : cluster [DBG] pgmap v6646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:25.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:24.337791+0000 mgr.smithi067.rdualw (mgr.24569) 7715 : cluster [DBG] pgmap v6646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:27.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:26.338842+0000 mgr.smithi067.rdualw (mgr.24569) 7716 : cluster [DBG] pgmap v6647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:10:27.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:26.338842+0000 mgr.smithi067.rdualw (mgr.24569) 7716 : cluster [DBG] pgmap v6647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:10:29.531 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:10:29.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:28.339356+0000 mgr.smithi067.rdualw (mgr.24569) 7717 : cluster [DBG] pgmap v6648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:29.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:28.339356+0000 mgr.smithi067.rdualw (mgr.24569) 7717 : cluster [DBG] pgmap v6648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:29.824 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:10:29.824 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 5m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:10:29.824 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 5m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:10:29.825 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 5m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:10:29.825 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 5m ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:10:29.825 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 5m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:10:29.825 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 5m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:10:29.826 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 5m ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:10:29.826 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 5m ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:10:29.826 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 5m ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:10:29.826 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 5m ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:10:29.827 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 5m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:10:29.827 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 5m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:10:29.827 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 5m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:10:29.827 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 5m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:10:29.827 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 5m ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:10:29.828 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 5m ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:10:29.828 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 5m ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:10:29.828 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 5m ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:10:29.828 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 5m ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:10:29.829 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 5m ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:10:29.829 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 5m ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:10:29.829 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 5m ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:10:29.829 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 5m ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:10:30.169 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:10:30.169 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:10:30.169 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:10:30.170 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:10:30.170 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:10:30.170 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:10:30.170 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:10:30.171 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:10:30.171 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:10:30.171 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:10:30.171 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:10:30.172 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:10:30.172 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:10:30.172 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:10:30.172 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:10:30.172 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:10:30.173 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:10:30.173 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:10:30.173 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:10:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:10:29.518400+0000 mgr.smithi067.rdualw (mgr.24569) 7718 : audit [DBG] from='client.39286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:10:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:10:29.807034+0000 mgr.smithi067.rdualw (mgr.24569) 7719 : audit [DBG] from='client.39290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:10:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:10:30.167875+0000 mon.smithi061 (mon.0) 1685 : audit [DBG] from='client.? 172.21.15.61:0/739319127' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:10:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:10:29.518400+0000 mgr.smithi067.rdualw (mgr.24569) 7718 : audit [DBG] from='client.39286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:10:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:10:29.807034+0000 mgr.smithi067.rdualw (mgr.24569) 7719 : audit [DBG] from='client.39290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:10:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:10:30.167875+0000 mon.smithi061 (mon.0) 1685 : audit [DBG] from='client.? 172.21.15.61:0/739319127' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:10:31.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:30.340109+0000 mgr.smithi067.rdualw (mgr.24569) 7720 : cluster [DBG] pgmap v6649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:31.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:30.340109+0000 mgr.smithi067.rdualw (mgr.24569) 7720 : cluster [DBG] pgmap v6649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:33.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:32.341063+0000 mgr.smithi067.rdualw (mgr.24569) 7721 : cluster [DBG] pgmap v6650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:33.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:32.341063+0000 mgr.smithi067.rdualw (mgr.24569) 7721 : cluster [DBG] pgmap v6650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:34.341921+0000 mgr.smithi067.rdualw (mgr.24569) 7722 : cluster [DBG] pgmap v6651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:34.341921+0000 mgr.smithi067.rdualw (mgr.24569) 7722 : cluster [DBG] pgmap v6651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:10:35.649871+0000 mon.smithi067 (mon.1) 1181 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:10:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:10:35.650262+0000 mon.smithi061 (mon.0) 1686 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:10:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:10:35.657229+0000 mon.smithi067 (mon.1) 1182 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:10:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:10:35.657566+0000 mon.smithi061 (mon.0) 1687 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:10:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:10:35.649871+0000 mon.smithi067 (mon.1) 1181 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:10:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:10:35.650262+0000 mon.smithi061 (mon.0) 1686 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:10:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:10:35.657229+0000 mon.smithi067 (mon.1) 1182 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:10:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:10:35.657566+0000 mon.smithi061 (mon.0) 1687 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:10:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:36.342745+0000 mgr.smithi067.rdualw (mgr.24569) 7723 : cluster [DBG] pgmap v6652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:10:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:36.342745+0000 mgr.smithi067.rdualw (mgr.24569) 7723 : cluster [DBG] pgmap v6652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:10:39.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:38.343281+0000 mgr.smithi067.rdualw (mgr.24569) 7724 : cluster [DBG] pgmap v6653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:39.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:38.343281+0000 mgr.smithi067.rdualw (mgr.24569) 7724 : cluster [DBG] pgmap v6653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:41.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:40.344028+0000 mgr.smithi067.rdualw (mgr.24569) 7725 : cluster [DBG] pgmap v6654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:40.344028+0000 mgr.smithi067.rdualw (mgr.24569) 7725 : cluster [DBG] pgmap v6654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:43.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:42.344719+0000 mgr.smithi067.rdualw (mgr.24569) 7726 : cluster [DBG] pgmap v6655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:42.344719+0000 mgr.smithi067.rdualw (mgr.24569) 7726 : cluster [DBG] pgmap v6655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:45.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:44.345484+0000 mgr.smithi067.rdualw (mgr.24569) 7727 : cluster [DBG] pgmap v6656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:44.345484+0000 mgr.smithi067.rdualw (mgr.24569) 7727 : cluster [DBG] pgmap v6656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:47.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:46.346309+0000 mgr.smithi067.rdualw (mgr.24569) 7728 : cluster [DBG] pgmap v6657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:10:47.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:46.346309+0000 mgr.smithi067.rdualw (mgr.24569) 7728 : cluster [DBG] pgmap v6657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:10:49.660 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:48.347022+0000 mgr.smithi067.rdualw (mgr.24569) 7729 : cluster [DBG] pgmap v6658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:48.347022+0000 mgr.smithi067.rdualw (mgr.24569) 7729 : cluster [DBG] pgmap v6658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:51.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:50.347754+0000 mgr.smithi067.rdualw (mgr.24569) 7730 : cluster [DBG] pgmap v6659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:50.347754+0000 mgr.smithi067.rdualw (mgr.24569) 7730 : cluster [DBG] pgmap v6659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:52.348507+0000 mgr.smithi067.rdualw (mgr.24569) 7731 : cluster [DBG] pgmap v6660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:52.348507+0000 mgr.smithi067.rdualw (mgr.24569) 7731 : cluster [DBG] pgmap v6660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:54.349265+0000 mgr.smithi067.rdualw (mgr.24569) 7732 : cluster [DBG] pgmap v6661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:54.349265+0000 mgr.smithi067.rdualw (mgr.24569) 7732 : cluster [DBG] pgmap v6661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:57.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:56.350258+0000 mgr.smithi067.rdualw (mgr.24569) 7733 : cluster [DBG] pgmap v6662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:10:57.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:56.350258+0000 mgr.smithi067.rdualw (mgr.24569) 7733 : cluster [DBG] pgmap v6662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:10:59.740 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:10:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:10:58.350906+0000 mgr.smithi067.rdualw (mgr.24569) 7734 : cluster [DBG] pgmap v6663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:10:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:10:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:10:58.350906+0000 mgr.smithi067.rdualw (mgr.24569) 7734 : cluster [DBG] pgmap v6663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:00.486 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:11:00.777 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:11:00.777 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 5m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:11:00.777 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 5m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:11:00.778 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 6m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:11:00.778 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 5m ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:11:00.778 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 5m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:11:00.778 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 6m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:11:00.779 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 5m ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:11:00.779 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 6m ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:11:00.779 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 5m ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:11:00.779 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 6m ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:11:00.780 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 5m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:11:00.780 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 6m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:11:00.780 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 5m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:11:00.780 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 6m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:11:00.780 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 5m ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:11:00.781 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 5m ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:11:00.781 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 5m ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:11:00.782 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 5m ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:11:00.782 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 6m ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:11:00.782 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 6m ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:11:00.782 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 6m ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:11:00.783 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 6m ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:11:00.783 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 5m ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:11:01.117 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:11:01.117 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:11:01.117 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:11:01.118 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:11:01.118 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:11:01.118 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:11:01.118 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:11:01.119 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:11:01.119 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:11:01.119 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:11:01.119 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:11:01.120 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:11:01.120 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:11:01.120 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:11:01.120 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:11:01.121 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:11:01.121 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:11:01.121 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:11:01.121 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:11:01.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:00.351786+0000 mgr.smithi067.rdualw (mgr.24569) 7735 : cluster [DBG] pgmap v6664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:01.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:11:00.472434+0000 mgr.smithi067.rdualw (mgr.24569) 7736 : audit [DBG] from='client.39298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:11:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:11:00.759787+0000 mgr.smithi067.rdualw (mgr.24569) 7737 : audit [DBG] from='client.39302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:11:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:11:01.115739+0000 mon.smithi061 (mon.0) 1688 : audit [DBG] from='client.? 172.21.15.61:0/1734985325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:11:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:00.351786+0000 mgr.smithi067.rdualw (mgr.24569) 7735 : cluster [DBG] pgmap v6664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:11:00.472434+0000 mgr.smithi067.rdualw (mgr.24569) 7736 : audit [DBG] from='client.39298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:11:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:11:00.759787+0000 mgr.smithi067.rdualw (mgr.24569) 7737 : audit [DBG] from='client.39302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:11:01.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:11:01.115739+0000 mon.smithi061 (mon.0) 1688 : audit [DBG] from='client.? 172.21.15.61:0/1734985325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:11:03.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:02.352592+0000 mgr.smithi067.rdualw (mgr.24569) 7738 : cluster [DBG] pgmap v6665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:03.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:02.352592+0000 mgr.smithi067.rdualw (mgr.24569) 7738 : cluster [DBG] pgmap v6665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:11:03.894552+0000 mon.smithi067 (mon.1) 1183 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:11:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:11:03.895988+0000 mon.smithi067 (mon.1) 1184 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:11:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:11:03.896892+0000 mon.smithi067 (mon.1) 1185 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:11:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:11:03.897745+0000 mgr.smithi067.rdualw (mgr.24569) 7739 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:11:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:11:04.316620+0000 mon.smithi061 (mon.0) 1689 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:11:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:11:04.322528+0000 mon.smithi061 (mon.0) 1690 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:11:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:11:03.894552+0000 mon.smithi067 (mon.1) 1183 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:11:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:11:03.895988+0000 mon.smithi067 (mon.1) 1184 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:11:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:11:03.896892+0000 mon.smithi067 (mon.1) 1185 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:11:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:11:03.897745+0000 mgr.smithi067.rdualw (mgr.24569) 7739 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:11:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:11:04.316620+0000 mon.smithi061 (mon.0) 1689 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:11:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:11:04.322528+0000 mon.smithi061 (mon.0) 1690 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:11:05.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:04.353085+0000 mgr.smithi067.rdualw (mgr.24569) 7740 : cluster [DBG] pgmap v6666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:04.353085+0000 mgr.smithi067.rdualw (mgr.24569) 7740 : cluster [DBG] pgmap v6666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:07.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:06.354038+0000 mgr.smithi067.rdualw (mgr.24569) 7741 : cluster [DBG] pgmap v6667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:11:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:06.354038+0000 mgr.smithi067.rdualw (mgr.24569) 7741 : cluster [DBG] pgmap v6667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:11:09.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:08.354739+0000 mgr.smithi067.rdualw (mgr.24569) 7742 : cluster [DBG] pgmap v6668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:08.354739+0000 mgr.smithi067.rdualw (mgr.24569) 7742 : cluster [DBG] pgmap v6668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:10.355443+0000 mgr.smithi067.rdualw (mgr.24569) 7743 : cluster [DBG] pgmap v6669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:11.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:10.355443+0000 mgr.smithi067.rdualw (mgr.24569) 7743 : cluster [DBG] pgmap v6669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:13.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:12.356209+0000 mgr.smithi067.rdualw (mgr.24569) 7744 : cluster [DBG] pgmap v6670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:12.356209+0000 mgr.smithi067.rdualw (mgr.24569) 7744 : cluster [DBG] pgmap v6670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:14.356949+0000 mgr.smithi067.rdualw (mgr.24569) 7745 : cluster [DBG] pgmap v6671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:14.356949+0000 mgr.smithi067.rdualw (mgr.24569) 7745 : cluster [DBG] pgmap v6671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:17.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:16.357826+0000 mgr.smithi067.rdualw (mgr.24569) 7746 : cluster [DBG] pgmap v6672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:11:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:16.357826+0000 mgr.smithi067.rdualw (mgr.24569) 7746 : cluster [DBG] pgmap v6672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:11:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:18.358364+0000 mgr.smithi067.rdualw (mgr.24569) 7747 : cluster [DBG] pgmap v6673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:18.358364+0000 mgr.smithi067.rdualw (mgr.24569) 7747 : cluster [DBG] pgmap v6673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:20.359275+0000 mgr.smithi067.rdualw (mgr.24569) 7748 : cluster [DBG] pgmap v6674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:21.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:20.359275+0000 mgr.smithi067.rdualw (mgr.24569) 7748 : cluster [DBG] pgmap v6674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:22.359963+0000 mgr.smithi067.rdualw (mgr.24569) 7749 : cluster [DBG] pgmap v6675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:22.359963+0000 mgr.smithi067.rdualw (mgr.24569) 7749 : cluster [DBG] pgmap v6675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:25.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:24.360626+0000 mgr.smithi067.rdualw (mgr.24569) 7750 : cluster [DBG] pgmap v6676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:25.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:24.360626+0000 mgr.smithi067.rdualw (mgr.24569) 7750 : cluster [DBG] pgmap v6676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:27.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:26.361659+0000 mgr.smithi067.rdualw (mgr.24569) 7751 : cluster [DBG] pgmap v6677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:11:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:26.361659+0000 mgr.smithi067.rdualw (mgr.24569) 7751 : cluster [DBG] pgmap v6677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:11:29.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:28.362230+0000 mgr.smithi067.rdualw (mgr.24569) 7752 : cluster [DBG] pgmap v6678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:29.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:28.362230+0000 mgr.smithi067.rdualw (mgr.24569) 7752 : cluster [DBG] pgmap v6678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:31.424 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:11:31.717 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:11:31.717 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 6m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:11:31.717 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 6m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:11:31.718 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 6m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:11:31.718 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 6m ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:11:31.718 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 6m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:11:31.718 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 6m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:11:31.718 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 6m ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:11:31.719 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 6m ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:11:31.719 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 6m ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:11:31.719 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 6m ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:11:31.719 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 6m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:11:31.719 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 6m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:11:31.720 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 6m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:11:31.720 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 6m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:11:31.720 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 6m ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:11:31.720 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 6m ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:11:31.721 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 6m ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:11:31.721 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 6m ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:11:31.721 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 6m ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:11:31.721 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 6m ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:11:31.721 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 6m ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:11:31.722 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 6m ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:11:31.722 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 6m ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:11:31.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:30.362961+0000 mgr.smithi067.rdualw (mgr.24569) 7753 : cluster [DBG] pgmap v6679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:31.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:30.362961+0000 mgr.smithi067.rdualw (mgr.24569) 7753 : cluster [DBG] pgmap v6679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:32.063 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:11:32.064 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:11:32.064 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:11:32.064 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:11:32.064 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:11:32.064 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:11:32.065 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:11:32.065 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:11:32.065 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:11:32.065 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:11:32.066 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:11:32.066 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:11:32.066 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:11:32.066 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:11:32.067 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:11:32.067 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:11:32.067 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:11:32.067 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:11:32.067 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:11:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:11:31.411044+0000 mgr.smithi067.rdualw (mgr.24569) 7754 : audit [DBG] from='client.39310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:11:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:11:31.699635+0000 mgr.smithi067.rdualw (mgr.24569) 7755 : audit [DBG] from='client.39314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:11:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:11:32.062262+0000 mon.smithi061 (mon.0) 1691 : audit [DBG] from='client.? 172.21.15.61:0/2647733595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:11:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:11:31.411044+0000 mgr.smithi067.rdualw (mgr.24569) 7754 : audit [DBG] from='client.39310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:11:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:11:31.699635+0000 mgr.smithi067.rdualw (mgr.24569) 7755 : audit [DBG] from='client.39314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:11:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:11:32.062262+0000 mon.smithi061 (mon.0) 1691 : audit [DBG] from='client.? 172.21.15.61:0/2647733595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:11:33.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:32.363635+0000 mgr.smithi067.rdualw (mgr.24569) 7756 : cluster [DBG] pgmap v6680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:33.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:32.363635+0000 mgr.smithi067.rdualw (mgr.24569) 7756 : cluster [DBG] pgmap v6680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:34.364393+0000 mgr.smithi067.rdualw (mgr.24569) 7757 : cluster [DBG] pgmap v6681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:34.364393+0000 mgr.smithi067.rdualw (mgr.24569) 7757 : cluster [DBG] pgmap v6681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:11:35.661196+0000 mon.smithi067 (mon.1) 1186 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:11:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:11:35.661567+0000 mon.smithi067 (mon.1) 1187 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:11:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:11:35.661620+0000 mon.smithi061 (mon.0) 1692 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:11:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:11:35.661911+0000 mon.smithi061 (mon.0) 1693 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:11:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:11:35.661196+0000 mon.smithi067 (mon.1) 1186 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:11:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:11:35.661567+0000 mon.smithi067 (mon.1) 1187 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:11:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:11:35.661620+0000 mon.smithi061 (mon.0) 1692 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:11:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:11:35.661911+0000 mon.smithi061 (mon.0) 1693 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:11:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:36.365334+0000 mgr.smithi067.rdualw (mgr.24569) 7758 : cluster [DBG] pgmap v6682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:11:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:36.365334+0000 mgr.smithi067.rdualw (mgr.24569) 7758 : cluster [DBG] pgmap v6682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:11:39.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:38.365961+0000 mgr.smithi067.rdualw (mgr.24569) 7759 : cluster [DBG] pgmap v6683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:39.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:38.365961+0000 mgr.smithi067.rdualw (mgr.24569) 7759 : cluster [DBG] pgmap v6683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:41.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:40.366874+0000 mgr.smithi067.rdualw (mgr.24569) 7760 : cluster [DBG] pgmap v6684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:40.366874+0000 mgr.smithi067.rdualw (mgr.24569) 7760 : cluster [DBG] pgmap v6684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:43.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:42.367498+0000 mgr.smithi067.rdualw (mgr.24569) 7761 : cluster [DBG] pgmap v6685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:42.367498+0000 mgr.smithi067.rdualw (mgr.24569) 7761 : cluster [DBG] pgmap v6685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:45.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:44.368177+0000 mgr.smithi067.rdualw (mgr.24569) 7762 : cluster [DBG] pgmap v6686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:44.368177+0000 mgr.smithi067.rdualw (mgr.24569) 7762 : cluster [DBG] pgmap v6686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:47.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:46.369125+0000 mgr.smithi067.rdualw (mgr.24569) 7763 : cluster [DBG] pgmap v6687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:11:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:46.369125+0000 mgr.smithi067.rdualw (mgr.24569) 7763 : cluster [DBG] pgmap v6687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:11:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:48.369775+0000 mgr.smithi067.rdualw (mgr.24569) 7764 : cluster [DBG] pgmap v6688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:48.369775+0000 mgr.smithi067.rdualw (mgr.24569) 7764 : cluster [DBG] pgmap v6688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:51.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:50.370558+0000 mgr.smithi067.rdualw (mgr.24569) 7765 : cluster [DBG] pgmap v6689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:50.370558+0000 mgr.smithi067.rdualw (mgr.24569) 7765 : cluster [DBG] pgmap v6689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:52.371403+0000 mgr.smithi067.rdualw (mgr.24569) 7766 : cluster [DBG] pgmap v6690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:52.371403+0000 mgr.smithi067.rdualw (mgr.24569) 7766 : cluster [DBG] pgmap v6690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:54.371993+0000 mgr.smithi067.rdualw (mgr.24569) 7767 : cluster [DBG] pgmap v6691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:54.371993+0000 mgr.smithi067.rdualw (mgr.24569) 7767 : cluster [DBG] pgmap v6691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:57.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:56.372933+0000 mgr.smithi067.rdualw (mgr.24569) 7768 : cluster [DBG] pgmap v6692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:11:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:56.372933+0000 mgr.smithi067.rdualw (mgr.24569) 7768 : cluster [DBG] pgmap v6692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:11:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:11:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:11:58.373661+0000 mgr.smithi067.rdualw (mgr.24569) 7769 : cluster [DBG] pgmap v6693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:11:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:11:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:11:58.373661+0000 mgr.smithi067.rdualw (mgr.24569) 7769 : cluster [DBG] pgmap v6693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:01.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:00.374370+0000 mgr.smithi067.rdualw (mgr.24569) 7770 : cluster [DBG] pgmap v6694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:00.374370+0000 mgr.smithi067.rdualw (mgr.24569) 7770 : cluster [DBG] pgmap v6694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:02.377 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:12:02.669 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:12:02.669 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 7m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:12:02.669 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 7m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:12:02.670 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 7m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:12:02.670 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 7m ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:12:02.670 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 7m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:12:02.670 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 7m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:12:02.671 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 7m ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:12:02.671 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 7m ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:12:02.671 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 7m ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:12:02.671 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 7m ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:12:02.672 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 7m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:12:02.672 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 7m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:12:02.672 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 7m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:12:02.672 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 7m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:12:02.672 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 7m ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:12:02.673 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 7m ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:12:02.673 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 7m ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:12:02.673 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 7m ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:12:02.673 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 7m ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:12:02.673 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 7m ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:12:02.674 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 7m ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:12:02.674 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 7m ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:12:02.674 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 7m ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:12:03.009 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:12:03.010 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:12:03.010 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:12:03.010 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:12:03.010 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:12:03.011 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:12:03.011 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:12:03.011 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:12:03.012 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:12:03.012 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:12:03.012 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:12:03.012 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:12:03.012 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:12:03.013 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:12:03.013 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:12:03.013 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:12:03.013 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:12:03.013 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:12:03.014 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:12:03.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:12:02.364893+0000 mgr.smithi067.rdualw (mgr.24569) 7771 : audit [DBG] from='client.39322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:12:03.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:02.375048+0000 mgr.smithi067.rdualw (mgr.24569) 7772 : cluster [DBG] pgmap v6695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:12:02.651979+0000 mgr.smithi067.rdualw (mgr.24569) 7773 : audit [DBG] from='client.39326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:12:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:12:03.008226+0000 mon.smithi061 (mon.0) 1694 : audit [DBG] from='client.? 172.21.15.61:0/3376508606' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:12:03.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:12:02.364893+0000 mgr.smithi067.rdualw (mgr.24569) 7771 : audit [DBG] from='client.39322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:12:03.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:02.375048+0000 mgr.smithi067.rdualw (mgr.24569) 7772 : cluster [DBG] pgmap v6695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:03.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:12:02.651979+0000 mgr.smithi067.rdualw (mgr.24569) 7773 : audit [DBG] from='client.39326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:12:03.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:12:03.008226+0000 mon.smithi061 (mon.0) 1694 : audit [DBG] from='client.? 172.21.15.61:0/3376508606' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:12:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:12:04.325973+0000 mon.smithi067 (mon.1) 1188 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:12:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:12:04.327366+0000 mon.smithi067 (mon.1) 1189 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:12:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:12:04.328223+0000 mon.smithi067 (mon.1) 1190 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:12:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:12:04.325973+0000 mon.smithi067 (mon.1) 1188 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:12:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:12:04.327366+0000 mon.smithi067 (mon.1) 1189 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:12:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:12:04.328223+0000 mon.smithi067 (mon.1) 1190 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:12:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:12:04.329015+0000 mgr.smithi067.rdualw (mgr.24569) 7774 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:12:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:04.375652+0000 mgr.smithi067.rdualw (mgr.24569) 7775 : cluster [DBG] pgmap v6696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:12:04.747052+0000 mon.smithi061 (mon.0) 1695 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:12:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:12:04.752406+0000 mon.smithi061 (mon.0) 1696 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:12:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:12:04.329015+0000 mgr.smithi067.rdualw (mgr.24569) 7774 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:12:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:04.375652+0000 mgr.smithi067.rdualw (mgr.24569) 7775 : cluster [DBG] pgmap v6696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:12:04.747052+0000 mon.smithi061 (mon.0) 1695 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:12:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:12:04.752406+0000 mon.smithi061 (mon.0) 1696 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:12:07.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:06.376568+0000 mgr.smithi067.rdualw (mgr.24569) 7776 : cluster [DBG] pgmap v6697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:12:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:06.376568+0000 mgr.smithi067.rdualw (mgr.24569) 7776 : cluster [DBG] pgmap v6697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:12:09.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:08.377026+0000 mgr.smithi067.rdualw (mgr.24569) 7777 : cluster [DBG] pgmap v6698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:08.377026+0000 mgr.smithi067.rdualw (mgr.24569) 7777 : cluster [DBG] pgmap v6698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:10.378053+0000 mgr.smithi067.rdualw (mgr.24569) 7778 : cluster [DBG] pgmap v6699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:11.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:10.378053+0000 mgr.smithi067.rdualw (mgr.24569) 7778 : cluster [DBG] pgmap v6699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:13.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:12.378830+0000 mgr.smithi067.rdualw (mgr.24569) 7779 : cluster [DBG] pgmap v6700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:12.378830+0000 mgr.smithi067.rdualw (mgr.24569) 7779 : cluster [DBG] pgmap v6700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:15.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:14.379455+0000 mgr.smithi067.rdualw (mgr.24569) 7780 : cluster [DBG] pgmap v6701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:14.379455+0000 mgr.smithi067.rdualw (mgr.24569) 7780 : cluster [DBG] pgmap v6701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:17.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:16.380285+0000 mgr.smithi067.rdualw (mgr.24569) 7781 : cluster [DBG] pgmap v6702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:12:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:16.380285+0000 mgr.smithi067.rdualw (mgr.24569) 7781 : cluster [DBG] pgmap v6702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:12:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:18.380837+0000 mgr.smithi067.rdualw (mgr.24569) 7782 : cluster [DBG] pgmap v6703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:18.380837+0000 mgr.smithi067.rdualw (mgr.24569) 7782 : cluster [DBG] pgmap v6703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:20.381651+0000 mgr.smithi067.rdualw (mgr.24569) 7783 : cluster [DBG] pgmap v6704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:21.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:20.381651+0000 mgr.smithi067.rdualw (mgr.24569) 7783 : cluster [DBG] pgmap v6704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:22.382376+0000 mgr.smithi067.rdualw (mgr.24569) 7784 : cluster [DBG] pgmap v6705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:22.382376+0000 mgr.smithi067.rdualw (mgr.24569) 7784 : cluster [DBG] pgmap v6705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:25.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:24.383028+0000 mgr.smithi067.rdualw (mgr.24569) 7785 : cluster [DBG] pgmap v6706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:25.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:24.383028+0000 mgr.smithi067.rdualw (mgr.24569) 7785 : cluster [DBG] pgmap v6706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:27.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:26.384025+0000 mgr.smithi067.rdualw (mgr.24569) 7786 : cluster [DBG] pgmap v6707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:12:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:26.384025+0000 mgr.smithi067.rdualw (mgr.24569) 7786 : cluster [DBG] pgmap v6707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:12:29.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:28.384753+0000 mgr.smithi067.rdualw (mgr.24569) 7787 : cluster [DBG] pgmap v6708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:29.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:28.384753+0000 mgr.smithi067.rdualw (mgr.24569) 7787 : cluster [DBG] pgmap v6708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:31.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:30.385508+0000 mgr.smithi067.rdualw (mgr.24569) 7788 : cluster [DBG] pgmap v6709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:31.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:30.385508+0000 mgr.smithi067.rdualw (mgr.24569) 7788 : cluster [DBG] pgmap v6709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:33.325 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:12:33.615 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:12:33.615 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 7m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:12:33.615 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 7m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:12:33.616 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 7m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:12:33.616 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 7m ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:12:33.616 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 7m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:12:33.616 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 7m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:12:33.616 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 7m ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:12:33.617 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 7m ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:12:33.617 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 7m ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:12:33.617 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 7m ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:12:33.617 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 7m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:12:33.617 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 7m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:12:33.618 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 7m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:12:33.618 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 7m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:12:33.618 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 7m ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:12:33.618 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 7m ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:12:33.619 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 7m ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:12:33.619 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 7m ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:12:33.619 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 7m ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:12:33.619 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 7m ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:12:33.620 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 7m ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:12:33.620 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 7m ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:12:33.620 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 7m ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:12:33.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:32.386233+0000 mgr.smithi067.rdualw (mgr.24569) 7789 : cluster [DBG] pgmap v6710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:33.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:32.386233+0000 mgr.smithi067.rdualw (mgr.24569) 7789 : cluster [DBG] pgmap v6710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:33.956 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:12:33.957 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:12:33.957 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:12:33.958 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:12:33.958 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:12:33.958 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:12:33.958 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:12:33.959 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:12:33.959 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:12:33.959 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:12:33.959 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:12:33.960 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:12:33.960 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:12:33.960 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:12:33.960 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:12:33.960 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:12:33.961 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:12:33.961 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:12:33.961 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:12:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:12:33.311949+0000 mgr.smithi067.rdualw (mgr.24569) 7790 : audit [DBG] from='client.39334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:12:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:12:33.597591+0000 mgr.smithi067.rdualw (mgr.24569) 7791 : audit [DBG] from='client.39338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:12:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:12:33.955678+0000 mon.smithi061 (mon.0) 1697 : audit [DBG] from='client.? 172.21.15.61:0/3563966715' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:12:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:12:33.311949+0000 mgr.smithi067.rdualw (mgr.24569) 7790 : audit [DBG] from='client.39334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:12:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:12:33.597591+0000 mgr.smithi067.rdualw (mgr.24569) 7791 : audit [DBG] from='client.39338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:12:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:12:33.955678+0000 mon.smithi061 (mon.0) 1697 : audit [DBG] from='client.? 172.21.15.61:0/3563966715' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:12:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:34.386926+0000 mgr.smithi067.rdualw (mgr.24569) 7792 : cluster [DBG] pgmap v6711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:34.386926+0000 mgr.smithi067.rdualw (mgr.24569) 7792 : cluster [DBG] pgmap v6711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:12:35.666487+0000 mon.smithi067 (mon.1) 1191 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:12:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:12:35.666757+0000 mon.smithi067 (mon.1) 1192 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:12:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:12:35.666902+0000 mon.smithi061 (mon.0) 1698 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:12:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:12:35.667136+0000 mon.smithi061 (mon.0) 1699 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:12:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:12:35.666487+0000 mon.smithi067 (mon.1) 1191 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:12:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:12:35.666757+0000 mon.smithi067 (mon.1) 1192 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:12:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:12:35.666902+0000 mon.smithi061 (mon.0) 1698 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:12:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:12:35.667136+0000 mon.smithi061 (mon.0) 1699 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:12:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:36.387989+0000 mgr.smithi067.rdualw (mgr.24569) 7793 : cluster [DBG] pgmap v6712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:12:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:36.387989+0000 mgr.smithi067.rdualw (mgr.24569) 7793 : cluster [DBG] pgmap v6712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:12:39.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:38.388522+0000 mgr.smithi067.rdualw (mgr.24569) 7794 : cluster [DBG] pgmap v6713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:39.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:38.388522+0000 mgr.smithi067.rdualw (mgr.24569) 7794 : cluster [DBG] pgmap v6713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:41.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:40.389336+0000 mgr.smithi067.rdualw (mgr.24569) 7795 : cluster [DBG] pgmap v6714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:40.389336+0000 mgr.smithi067.rdualw (mgr.24569) 7795 : cluster [DBG] pgmap v6714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:43.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:42.390158+0000 mgr.smithi067.rdualw (mgr.24569) 7796 : cluster [DBG] pgmap v6715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:42.390158+0000 mgr.smithi067.rdualw (mgr.24569) 7796 : cluster [DBG] pgmap v6715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:45.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:44.390821+0000 mgr.smithi067.rdualw (mgr.24569) 7797 : cluster [DBG] pgmap v6716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:44.390821+0000 mgr.smithi067.rdualw (mgr.24569) 7797 : cluster [DBG] pgmap v6716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:47.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:46.391812+0000 mgr.smithi067.rdualw (mgr.24569) 7798 : cluster [DBG] pgmap v6717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:12:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:46.391812+0000 mgr.smithi067.rdualw (mgr.24569) 7798 : cluster [DBG] pgmap v6717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:12:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:48.392320+0000 mgr.smithi067.rdualw (mgr.24569) 7799 : cluster [DBG] pgmap v6718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:48.392320+0000 mgr.smithi067.rdualw (mgr.24569) 7799 : cluster [DBG] pgmap v6718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:51.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:50.393216+0000 mgr.smithi067.rdualw (mgr.24569) 7800 : cluster [DBG] pgmap v6719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:50.393216+0000 mgr.smithi067.rdualw (mgr.24569) 7800 : cluster [DBG] pgmap v6719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:52.394027+0000 mgr.smithi067.rdualw (mgr.24569) 7801 : cluster [DBG] pgmap v6720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:52.394027+0000 mgr.smithi067.rdualw (mgr.24569) 7801 : cluster [DBG] pgmap v6720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:54.394637+0000 mgr.smithi067.rdualw (mgr.24569) 7802 : cluster [DBG] pgmap v6721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:55.823 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:54.394637+0000 mgr.smithi067.rdualw (mgr.24569) 7802 : cluster [DBG] pgmap v6721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:56.395522+0000 mgr.smithi067.rdualw (mgr.24569) 7803 : cluster [DBG] pgmap v6722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:12:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:56.395522+0000 mgr.smithi067.rdualw (mgr.24569) 7803 : cluster [DBG] pgmap v6722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:12:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:12:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:12:58.396203+0000 mgr.smithi067.rdualw (mgr.24569) 7804 : cluster [DBG] pgmap v6723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:12:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:12:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:12:58.396203+0000 mgr.smithi067.rdualw (mgr.24569) 7804 : cluster [DBG] pgmap v6723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:01.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:00.397114+0000 mgr.smithi067.rdualw (mgr.24569) 7805 : cluster [DBG] pgmap v6724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:00.397114+0000 mgr.smithi067.rdualw (mgr.24569) 7805 : cluster [DBG] pgmap v6724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:03.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:02.397738+0000 mgr.smithi067.rdualw (mgr.24569) 7806 : cluster [DBG] pgmap v6725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:03.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:02.397738+0000 mgr.smithi067.rdualw (mgr.24569) 7806 : cluster [DBG] pgmap v6725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:04.260 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:13:04.552 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:13:04.553 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 8m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:13:04.553 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 8m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:13:04.553 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 8m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:13:04.554 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 8m ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:13:04.554 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 8m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:13:04.554 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 8m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:13:04.554 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 8m ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:13:04.555 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 8m ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:13:04.555 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 8m ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:13:04.555 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 8m ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:13:04.555 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 8m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:13:04.556 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 8m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:13:04.556 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 8m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:13:04.556 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 8m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:13:04.556 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 8m ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:13:04.556 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 8m ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:13:04.557 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 8m ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:13:04.557 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 8m ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:13:04.557 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 8m ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:13:04.557 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 8m ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:13:04.558 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 8m ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:13:04.558 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 8m ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:13:04.558 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 8m ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:13:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:13:04.246923+0000 mgr.smithi067.rdualw (mgr.24569) 7807 : audit [DBG] from='client.39346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:13:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:13:04.246923+0000 mgr.smithi067.rdualw (mgr.24569) 7807 : audit [DBG] from='client.39346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:13:04.897 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:13:04.897 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:13:04.898 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:13:04.898 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:13:04.898 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:13:04.898 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:13:04.899 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:13:04.899 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:13:04.899 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:13:04.899 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:13:04.900 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:13:04.900 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:13:04.900 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:13:04.900 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:13:04.901 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:13:04.901 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:13:04.901 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:13:04.901 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:13:04.901 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:13:05.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:04.398313+0000 mgr.smithi067.rdualw (mgr.24569) 7808 : cluster [DBG] pgmap v6726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:05.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:13:04.535260+0000 mgr.smithi067.rdualw (mgr.24569) 7809 : audit [DBG] from='client.39350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:13:05.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:13:04.756204+0000 mon.smithi067 (mon.1) 1193 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:13:05.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:13:04.757634+0000 mon.smithi067 (mon.1) 1194 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:13:05.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:13:04.758608+0000 mon.smithi067 (mon.1) 1195 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:13:05.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:13:04.759444+0000 mgr.smithi067.rdualw (mgr.24569) 7810 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:13:05.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:13:04.896442+0000 mon.smithi061 (mon.0) 1700 : audit [DBG] from='client.? 172.21.15.61:0/1129806186' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:13:05.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:13:05.170674+0000 mon.smithi061 (mon.0) 1701 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:13:05.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:13:05.177544+0000 mon.smithi061 (mon.0) 1702 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:13:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:04.398313+0000 mgr.smithi067.rdualw (mgr.24569) 7808 : cluster [DBG] pgmap v6726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:13:04.535260+0000 mgr.smithi067.rdualw (mgr.24569) 7809 : audit [DBG] from='client.39350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:13:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:13:04.756204+0000 mon.smithi067 (mon.1) 1193 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:13:05.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:13:04.757634+0000 mon.smithi067 (mon.1) 1194 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:13:05.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:13:04.758608+0000 mon.smithi067 (mon.1) 1195 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:13:05.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:13:04.759444+0000 mgr.smithi067.rdualw (mgr.24569) 7810 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:13:05.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:13:04.896442+0000 mon.smithi061 (mon.0) 1700 : audit [DBG] from='client.? 172.21.15.61:0/1129806186' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:13:05.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:13:05.170674+0000 mon.smithi061 (mon.0) 1701 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:13:05.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:13:05.177544+0000 mon.smithi061 (mon.0) 1702 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:13:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:06.399135+0000 mgr.smithi067.rdualw (mgr.24569) 7811 : cluster [DBG] pgmap v6727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:13:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:06.399135+0000 mgr.smithi067.rdualw (mgr.24569) 7811 : cluster [DBG] pgmap v6727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:13:09.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:08.399657+0000 mgr.smithi067.rdualw (mgr.24569) 7812 : cluster [DBG] pgmap v6728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:08.399657+0000 mgr.smithi067.rdualw (mgr.24569) 7812 : cluster [DBG] pgmap v6728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:10.400439+0000 mgr.smithi067.rdualw (mgr.24569) 7813 : cluster [DBG] pgmap v6729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:11.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:10.400439+0000 mgr.smithi067.rdualw (mgr.24569) 7813 : cluster [DBG] pgmap v6729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:13.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:12.401099+0000 mgr.smithi067.rdualw (mgr.24569) 7814 : cluster [DBG] pgmap v6730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:12.401099+0000 mgr.smithi067.rdualw (mgr.24569) 7814 : cluster [DBG] pgmap v6730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:15.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:14.401736+0000 mgr.smithi067.rdualw (mgr.24569) 7815 : cluster [DBG] pgmap v6731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:14.401736+0000 mgr.smithi067.rdualw (mgr.24569) 7815 : cluster [DBG] pgmap v6731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:16.402807+0000 mgr.smithi067.rdualw (mgr.24569) 7816 : cluster [DBG] pgmap v6732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:13:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:16.402807+0000 mgr.smithi067.rdualw (mgr.24569) 7816 : cluster [DBG] pgmap v6732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:13:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:18.403438+0000 mgr.smithi067.rdualw (mgr.24569) 7817 : cluster [DBG] pgmap v6733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:18.403438+0000 mgr.smithi067.rdualw (mgr.24569) 7817 : cluster [DBG] pgmap v6733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:20.404450+0000 mgr.smithi067.rdualw (mgr.24569) 7818 : cluster [DBG] pgmap v6734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:21.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:20.404450+0000 mgr.smithi067.rdualw (mgr.24569) 7818 : cluster [DBG] pgmap v6734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:22.404996+0000 mgr.smithi067.rdualw (mgr.24569) 7819 : cluster [DBG] pgmap v6735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:22.404996+0000 mgr.smithi067.rdualw (mgr.24569) 7819 : cluster [DBG] pgmap v6735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:25.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:24.405603+0000 mgr.smithi067.rdualw (mgr.24569) 7820 : cluster [DBG] pgmap v6736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:25.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:24.405603+0000 mgr.smithi067.rdualw (mgr.24569) 7820 : cluster [DBG] pgmap v6736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:26.406485+0000 mgr.smithi067.rdualw (mgr.24569) 7821 : cluster [DBG] pgmap v6737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:13:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:26.406485+0000 mgr.smithi067.rdualw (mgr.24569) 7821 : cluster [DBG] pgmap v6737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:13:29.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:28.407031+0000 mgr.smithi067.rdualw (mgr.24569) 7822 : cluster [DBG] pgmap v6738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:29.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:28.407031+0000 mgr.smithi067.rdualw (mgr.24569) 7822 : cluster [DBG] pgmap v6738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:31.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:30.407871+0000 mgr.smithi067.rdualw (mgr.24569) 7823 : cluster [DBG] pgmap v6739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:31.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:30.407871+0000 mgr.smithi067.rdualw (mgr.24569) 7823 : cluster [DBG] pgmap v6739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:33.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:32.408383+0000 mgr.smithi067.rdualw (mgr.24569) 7824 : cluster [DBG] pgmap v6740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:33.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:32.408383+0000 mgr.smithi067.rdualw (mgr.24569) 7824 : cluster [DBG] pgmap v6740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:35.206 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:13:35.527 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:13:35.527 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 8m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:13:35.528 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 8m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:13:35.528 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 8m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:13:35.529 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 8m ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:13:35.529 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 8m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:13:35.529 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 8m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:13:35.530 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 8m ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:13:35.530 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 8m ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:13:35.531 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 8m ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:13:35.531 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 8m ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:13:35.531 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 8m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:13:35.532 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 8m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:13:35.532 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 8m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:13:35.533 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 8m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:13:35.533 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 8m ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:13:35.533 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 8m ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:13:35.534 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 8m ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:13:35.534 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 8m ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:13:35.535 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 8m ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:13:35.535 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 8m ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:13:35.536 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 8m ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:13:35.536 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 8m ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:13:35.536 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 8m ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:13:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:34.409095+0000 mgr.smithi067.rdualw (mgr.24569) 7825 : cluster [DBG] pgmap v6741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:13:35.192427+0000 mgr.smithi067.rdualw (mgr.24569) 7826 : audit [DBG] from='client.39358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:13:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:34.409095+0000 mgr.smithi067.rdualw (mgr.24569) 7825 : cluster [DBG] pgmap v6741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:13:35.192427+0000 mgr.smithi067.rdualw (mgr.24569) 7826 : audit [DBG] from='client.39358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:13:35.870 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:13:35.870 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:13:35.870 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:13:35.871 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:13:35.871 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:13:35.871 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:13:35.871 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:13:35.871 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:13:35.872 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:13:35.872 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:13:35.872 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:13:35.872 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:13:35.872 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:13:35.873 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:13:35.873 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:13:35.873 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:13:35.873 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:13:35.873 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:13:35.874 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:13:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:13:35.509384+0000 mgr.smithi067.rdualw (mgr.24569) 7827 : audit [DBG] from='client.39362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:13:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:13:35.672320+0000 mon.smithi067 (mon.1) 1196 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:13:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:13:35.672602+0000 mon.smithi067 (mon.1) 1197 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:13:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:13:35.672746+0000 mon.smithi061 (mon.0) 1703 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:13:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:13:35.673371+0000 mon.smithi061 (mon.0) 1704 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:13:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:13:35.869277+0000 mon.smithi061 (mon.0) 1705 : audit [DBG] from='client.? 172.21.15.61:0/1222626744' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:13:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:13:35.509384+0000 mgr.smithi067.rdualw (mgr.24569) 7827 : audit [DBG] from='client.39362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:13:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:13:35.672320+0000 mon.smithi067 (mon.1) 1196 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:13:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:13:35.672602+0000 mon.smithi067 (mon.1) 1197 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:13:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:13:35.672746+0000 mon.smithi061 (mon.0) 1703 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:13:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:13:35.673371+0000 mon.smithi061 (mon.0) 1704 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:13:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:13:35.869277+0000 mon.smithi061 (mon.0) 1705 : audit [DBG] from='client.? 172.21.15.61:0/1222626744' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:13:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:36.409945+0000 mgr.smithi067.rdualw (mgr.24569) 7828 : cluster [DBG] pgmap v6742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:13:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:36.409945+0000 mgr.smithi067.rdualw (mgr.24569) 7828 : cluster [DBG] pgmap v6742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:13:39.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:38.410451+0000 mgr.smithi067.rdualw (mgr.24569) 7829 : cluster [DBG] pgmap v6743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:39.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:38.410451+0000 mgr.smithi067.rdualw (mgr.24569) 7829 : cluster [DBG] pgmap v6743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:41.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:40.411288+0000 mgr.smithi067.rdualw (mgr.24569) 7830 : cluster [DBG] pgmap v6744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:40.411288+0000 mgr.smithi067.rdualw (mgr.24569) 7830 : cluster [DBG] pgmap v6744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:43.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:42.411887+0000 mgr.smithi067.rdualw (mgr.24569) 7831 : cluster [DBG] pgmap v6745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:42.411887+0000 mgr.smithi067.rdualw (mgr.24569) 7831 : cluster [DBG] pgmap v6745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:45.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:44.412701+0000 mgr.smithi067.rdualw (mgr.24569) 7832 : cluster [DBG] pgmap v6746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:44.412701+0000 mgr.smithi067.rdualw (mgr.24569) 7832 : cluster [DBG] pgmap v6746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:46.413580+0000 mgr.smithi067.rdualw (mgr.24569) 7833 : cluster [DBG] pgmap v6747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:13:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:46.413580+0000 mgr.smithi067.rdualw (mgr.24569) 7833 : cluster [DBG] pgmap v6747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:13:49.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:48.414091+0000 mgr.smithi067.rdualw (mgr.24569) 7834 : cluster [DBG] pgmap v6748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:48.414091+0000 mgr.smithi067.rdualw (mgr.24569) 7834 : cluster [DBG] pgmap v6748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:51.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:50.414956+0000 mgr.smithi067.rdualw (mgr.24569) 7835 : cluster [DBG] pgmap v6749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:50.414956+0000 mgr.smithi067.rdualw (mgr.24569) 7835 : cluster [DBG] pgmap v6749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:52.415675+0000 mgr.smithi067.rdualw (mgr.24569) 7836 : cluster [DBG] pgmap v6750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:52.415675+0000 mgr.smithi067.rdualw (mgr.24569) 7836 : cluster [DBG] pgmap v6750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:54.416187+0000 mgr.smithi067.rdualw (mgr.24569) 7837 : cluster [DBG] pgmap v6751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:54.416187+0000 mgr.smithi067.rdualw (mgr.24569) 7837 : cluster [DBG] pgmap v6751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:56.417157+0000 mgr.smithi067.rdualw (mgr.24569) 7838 : cluster [DBG] pgmap v6752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:13:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:56.417157+0000 mgr.smithi067.rdualw (mgr.24569) 7838 : cluster [DBG] pgmap v6752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:13:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:13:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:13:58.417661+0000 mgr.smithi067.rdualw (mgr.24569) 7839 : cluster [DBG] pgmap v6753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:13:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:13:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:13:58.417661+0000 mgr.smithi067.rdualw (mgr.24569) 7839 : cluster [DBG] pgmap v6753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:01.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:00.418655+0000 mgr.smithi067.rdualw (mgr.24569) 7840 : cluster [DBG] pgmap v6754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:00.418655+0000 mgr.smithi067.rdualw (mgr.24569) 7840 : cluster [DBG] pgmap v6754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:03.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:02.419331+0000 mgr.smithi067.rdualw (mgr.24569) 7841 : cluster [DBG] pgmap v6755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:03.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:02.419331+0000 mgr.smithi067.rdualw (mgr.24569) 7841 : cluster [DBG] pgmap v6755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:05.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:04.419904+0000 mgr.smithi067.rdualw (mgr.24569) 7842 : cluster [DBG] pgmap v6756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:05.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:14:05.181094+0000 mon.smithi067 (mon.1) 1198 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:14:05.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:14:05.182669+0000 mon.smithi067 (mon.1) 1199 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:14:05.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:14:05.183675+0000 mon.smithi067 (mon.1) 1200 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:14:05.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:14:05.184585+0000 mgr.smithi067.rdualw (mgr.24569) 7843 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:14:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:04.419904+0000 mgr.smithi067.rdualw (mgr.24569) 7842 : cluster [DBG] pgmap v6756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:14:05.181094+0000 mon.smithi067 (mon.1) 1198 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:14:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:14:05.182669+0000 mon.smithi067 (mon.1) 1199 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:14:05.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:14:05.183675+0000 mon.smithi067 (mon.1) 1200 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:14:05.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:14:05.184585+0000 mgr.smithi067.rdualw (mgr.24569) 7843 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:14:06.260 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:14:06.550 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:14:06.551 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 9m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:14:06.551 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 9m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:14:06.551 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 9m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:14:06.552 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 9m ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:14:06.552 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 9m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:14:06.552 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 9m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:14:06.552 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 9m ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:14:06.552 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 9m ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:14:06.553 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 9m ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:14:06.553 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 9m ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:14:06.553 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 9m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:14:06.553 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 9m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:14:06.553 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 9m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:14:06.554 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 9m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:14:06.554 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 9m ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:14:06.554 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 9m ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:14:06.554 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 9m ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:14:06.555 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 9m ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:14:06.555 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 9m ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:14:06.555 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 9m ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:14:06.555 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 9m ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:14:06.555 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 9m ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:14:06.556 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 9m ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:14:06.927 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:14:05.604400+0000 mon.smithi061 (mon.0) 1706 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:14:06.927 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:14:05.610057+0000 mon.smithi061 (mon.0) 1707 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:14:06.928 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:14:06.246338+0000 mgr.smithi067.rdualw (mgr.24569) 7844 : audit [DBG] from='client.39370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:14:06.992 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:14:06.992 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:14:06.993 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:14:06.993 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:14:06.993 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:14:06.993 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:14:06.993 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:14:06.994 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:14:06.994 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:14:06.994 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:14:06.994 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:14:06.995 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:14:06.995 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:14:06.995 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:14:06.995 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:14:06.995 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:14:06.996 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:14:06.996 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:14:06.996 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:14:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:14:05.604400+0000 mon.smithi061 (mon.0) 1706 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:14:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:14:05.610057+0000 mon.smithi061 (mon.0) 1707 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:14:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:14:06.246338+0000 mgr.smithi067.rdualw (mgr.24569) 7844 : audit [DBG] from='client.39370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:14:07.927 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:06.420929+0000 mgr.smithi067.rdualw (mgr.24569) 7845 : cluster [DBG] pgmap v6757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:14:07.927 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:14:06.533488+0000 mgr.smithi067.rdualw (mgr.24569) 7846 : audit [DBG] from='client.39374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:14:07.928 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:14:06.991341+0000 mon.smithi061 (mon.0) 1708 : audit [DBG] from='client.? 172.21.15.61:0/1173664145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:14:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:06.420929+0000 mgr.smithi067.rdualw (mgr.24569) 7845 : cluster [DBG] pgmap v6757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:14:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:14:06.533488+0000 mgr.smithi067.rdualw (mgr.24569) 7846 : audit [DBG] from='client.39374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:14:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:14:06.991341+0000 mon.smithi061 (mon.0) 1708 : audit [DBG] from='client.? 172.21.15.61:0/1173664145' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:14:09.927 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:08.421475+0000 mgr.smithi067.rdualw (mgr.24569) 7847 : cluster [DBG] pgmap v6758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:08.421475+0000 mgr.smithi067.rdualw (mgr.24569) 7847 : cluster [DBG] pgmap v6758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:11.928 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:10.422310+0000 mgr.smithi067.rdualw (mgr.24569) 7848 : cluster [DBG] pgmap v6759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:10.422310+0000 mgr.smithi067.rdualw (mgr.24569) 7848 : cluster [DBG] pgmap v6759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:13.928 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:12.422986+0000 mgr.smithi067.rdualw (mgr.24569) 7849 : cluster [DBG] pgmap v6760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:12.422986+0000 mgr.smithi067.rdualw (mgr.24569) 7849 : cluster [DBG] pgmap v6760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:15.928 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:14.423671+0000 mgr.smithi067.rdualw (mgr.24569) 7850 : cluster [DBG] pgmap v6761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:14.423671+0000 mgr.smithi067.rdualw (mgr.24569) 7850 : cluster [DBG] pgmap v6761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:16.424506+0000 mgr.smithi067.rdualw (mgr.24569) 7851 : cluster [DBG] pgmap v6762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:14:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:16.424506+0000 mgr.smithi067.rdualw (mgr.24569) 7851 : cluster [DBG] pgmap v6762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:14:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:18.425124+0000 mgr.smithi067.rdualw (mgr.24569) 7852 : cluster [DBG] pgmap v6763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:18.425124+0000 mgr.smithi067.rdualw (mgr.24569) 7852 : cluster [DBG] pgmap v6763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:20.426017+0000 mgr.smithi067.rdualw (mgr.24569) 7853 : cluster [DBG] pgmap v6764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:21.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:20.426017+0000 mgr.smithi067.rdualw (mgr.24569) 7853 : cluster [DBG] pgmap v6764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:22.426761+0000 mgr.smithi067.rdualw (mgr.24569) 7854 : cluster [DBG] pgmap v6765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:22.426761+0000 mgr.smithi067.rdualw (mgr.24569) 7854 : cluster [DBG] pgmap v6765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:25.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:24.427383+0000 mgr.smithi067.rdualw (mgr.24569) 7855 : cluster [DBG] pgmap v6766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:25.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:24.427383+0000 mgr.smithi067.rdualw (mgr.24569) 7855 : cluster [DBG] pgmap v6766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:26.428263+0000 mgr.smithi067.rdualw (mgr.24569) 7856 : cluster [DBG] pgmap v6767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:14:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:26.428263+0000 mgr.smithi067.rdualw (mgr.24569) 7856 : cluster [DBG] pgmap v6767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:14:29.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:28.428812+0000 mgr.smithi067.rdualw (mgr.24569) 7857 : cluster [DBG] pgmap v6768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:29.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:28.428812+0000 mgr.smithi067.rdualw (mgr.24569) 7857 : cluster [DBG] pgmap v6768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:31.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:30.429620+0000 mgr.smithi067.rdualw (mgr.24569) 7858 : cluster [DBG] pgmap v6769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:31.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:30.429620+0000 mgr.smithi067.rdualw (mgr.24569) 7858 : cluster [DBG] pgmap v6769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:33.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:32.430319+0000 mgr.smithi067.rdualw (mgr.24569) 7859 : cluster [DBG] pgmap v6770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:33.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:32.430319+0000 mgr.smithi067.rdualw (mgr.24569) 7859 : cluster [DBG] pgmap v6770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:34.430935+0000 mgr.smithi067.rdualw (mgr.24569) 7860 : cluster [DBG] pgmap v6771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:34.430935+0000 mgr.smithi067.rdualw (mgr.24569) 7860 : cluster [DBG] pgmap v6771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:14:35.677182+0000 mon.smithi067 (mon.1) 1201 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:14:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:14:35.677452+0000 mon.smithi067 (mon.1) 1202 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:14:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:14:35.677491+0000 mon.smithi061 (mon.0) 1709 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:14:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:14:35.677785+0000 mon.smithi061 (mon.0) 1710 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:14:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:14:35.677182+0000 mon.smithi067 (mon.1) 1201 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:14:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:14:35.677452+0000 mon.smithi067 (mon.1) 1202 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:14:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:14:35.677491+0000 mon.smithi061 (mon.0) 1709 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:14:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:14:35.677785+0000 mon.smithi061 (mon.0) 1710 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:14:37.301 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:14:37.595 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:14:37.595 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 9m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:14:37.596 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 9m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:14:37.596 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 9m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:14:37.596 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 9m ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:14:37.596 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 9m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:14:37.597 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 9m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:14:37.597 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 9m ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:14:37.597 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 9m ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:14:37.597 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 9m ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:14:37.597 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 9m ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:14:37.598 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 9m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:14:37.598 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 9m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:14:37.598 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 9m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:14:37.598 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 9m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:14:37.599 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 9m ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:14:37.599 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 9m ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:14:37.599 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 9m ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:14:37.599 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 9m ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:14:37.599 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 9m ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:14:37.600 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 9m ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:14:37.600 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 9m ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:14:37.600 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 9m ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:14:37.600 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 9m ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:14:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:36.431898+0000 mgr.smithi067.rdualw (mgr.24569) 7861 : cluster [DBG] pgmap v6772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:14:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:14:37.288086+0000 mgr.smithi067.rdualw (mgr.24569) 7862 : audit [DBG] from='client.39382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:14:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:36.431898+0000 mgr.smithi067.rdualw (mgr.24569) 7861 : cluster [DBG] pgmap v6772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:14:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:14:37.288086+0000 mgr.smithi067.rdualw (mgr.24569) 7862 : audit [DBG] from='client.39382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:14:37.940 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:14:37.940 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:14:37.940 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:14:37.941 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:14:37.941 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:14:37.941 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:14:37.941 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:14:37.941 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:14:37.942 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:14:37.942 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:14:37.942 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:14:37.942 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:14:37.943 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:14:37.943 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:14:37.943 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:14:37.943 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:14:37.944 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:14:37.944 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:14:37.944 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:14:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:14:37.577787+0000 mgr.smithi067.rdualw (mgr.24569) 7863 : audit [DBG] from='client.39386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:14:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:14:37.938894+0000 mon.smithi061 (mon.0) 1711 : audit [DBG] from='client.? 172.21.15.61:0/862850224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:14:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:14:37.577787+0000 mgr.smithi067.rdualw (mgr.24569) 7863 : audit [DBG] from='client.39386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:14:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:14:37.938894+0000 mon.smithi061 (mon.0) 1711 : audit [DBG] from='client.? 172.21.15.61:0/862850224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:14:39.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:38.432618+0000 mgr.smithi067.rdualw (mgr.24569) 7864 : cluster [DBG] pgmap v6773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:39.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:38.432618+0000 mgr.smithi067.rdualw (mgr.24569) 7864 : cluster [DBG] pgmap v6773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:41.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:40.433629+0000 mgr.smithi067.rdualw (mgr.24569) 7865 : cluster [DBG] pgmap v6774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:40.433629+0000 mgr.smithi067.rdualw (mgr.24569) 7865 : cluster [DBG] pgmap v6774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:43.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:42.434220+0000 mgr.smithi067.rdualw (mgr.24569) 7866 : cluster [DBG] pgmap v6775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:42.434220+0000 mgr.smithi067.rdualw (mgr.24569) 7866 : cluster [DBG] pgmap v6775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:45.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:44.434840+0000 mgr.smithi067.rdualw (mgr.24569) 7867 : cluster [DBG] pgmap v6776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:44.434840+0000 mgr.smithi067.rdualw (mgr.24569) 7867 : cluster [DBG] pgmap v6776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:46.435809+0000 mgr.smithi067.rdualw (mgr.24569) 7868 : cluster [DBG] pgmap v6777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:14:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:46.435809+0000 mgr.smithi067.rdualw (mgr.24569) 7868 : cluster [DBG] pgmap v6777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:14:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:48.436263+0000 mgr.smithi067.rdualw (mgr.24569) 7869 : cluster [DBG] pgmap v6778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:48.436263+0000 mgr.smithi067.rdualw (mgr.24569) 7869 : cluster [DBG] pgmap v6778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:51.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:50.437178+0000 mgr.smithi067.rdualw (mgr.24569) 7870 : cluster [DBG] pgmap v6779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:50.437178+0000 mgr.smithi067.rdualw (mgr.24569) 7870 : cluster [DBG] pgmap v6779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:52.437958+0000 mgr.smithi067.rdualw (mgr.24569) 7871 : cluster [DBG] pgmap v6780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:52.437958+0000 mgr.smithi067.rdualw (mgr.24569) 7871 : cluster [DBG] pgmap v6780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:54.438781+0000 mgr.smithi067.rdualw (mgr.24569) 7872 : cluster [DBG] pgmap v6781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:54.438781+0000 mgr.smithi067.rdualw (mgr.24569) 7872 : cluster [DBG] pgmap v6781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:56.439641+0000 mgr.smithi067.rdualw (mgr.24569) 7873 : cluster [DBG] pgmap v6782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:14:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:56.439641+0000 mgr.smithi067.rdualw (mgr.24569) 7873 : cluster [DBG] pgmap v6782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:14:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:14:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:14:58.440175+0000 mgr.smithi067.rdualw (mgr.24569) 7874 : cluster [DBG] pgmap v6783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:14:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:14:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:14:58.440175+0000 mgr.smithi067.rdualw (mgr.24569) 7874 : cluster [DBG] pgmap v6783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:01.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:00.441166+0000 mgr.smithi067.rdualw (mgr.24569) 7875 : cluster [DBG] pgmap v6784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:00.441166+0000 mgr.smithi067.rdualw (mgr.24569) 7875 : cluster [DBG] pgmap v6784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:02.441708+0000 mgr.smithi067.rdualw (mgr.24569) 7876 : cluster [DBG] pgmap v6785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:03.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:02.441708+0000 mgr.smithi067.rdualw (mgr.24569) 7876 : cluster [DBG] pgmap v6785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:05.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:04.442411+0000 mgr.smithi067.rdualw (mgr.24569) 7877 : cluster [DBG] pgmap v6786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:04.442411+0000 mgr.smithi067.rdualw (mgr.24569) 7877 : cluster [DBG] pgmap v6786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:06.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:05.613418+0000 mon.smithi067 (mon.1) 1203 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:15:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:05.614862+0000 mon.smithi067 (mon.1) 1204 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:15:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:05.615817+0000 mon.smithi067 (mon.1) 1205 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:15:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:15:05.616685+0000 mgr.smithi067.rdualw (mgr.24569) 7878 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:15:06.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:05.613418+0000 mon.smithi067 (mon.1) 1203 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:15:06.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:05.614862+0000 mon.smithi067 (mon.1) 1204 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:15:06.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:05.615817+0000 mon.smithi067 (mon.1) 1205 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:15:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:15:05.616685+0000 mgr.smithi067.rdualw (mgr.24569) 7878 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:15:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:06.443386+0000 mgr.smithi067.rdualw (mgr.24569) 7879 : cluster [DBG] pgmap v6787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:15:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:06.443386+0000 mgr.smithi067.rdualw (mgr.24569) 7879 : cluster [DBG] pgmap v6787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:15:08.305 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:15:08.634 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:15:08.635 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 10m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:15:08.635 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 10m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:15:08.635 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 10m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:15:08.635 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 10m ago 3h 42.0M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:15:08.636 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 10m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:15:08.636 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 10m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:15:08.636 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 10m ago 3h 473M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:15:08.636 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 10m ago 3h 594M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:15:08.636 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 10m ago 3h 1447M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:15:08.637 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 10m ago 3h 753M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:15:08.637 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 10m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:15:08.637 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 10m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:15:08.637 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 10m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:15:08.638 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 10m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:15:08.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 10m ago 3h 981M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:15:08.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 10m ago 3h 1867M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:15:08.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 10m ago 3h 1168M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:15:08.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 10m ago 3h 2004M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:15:08.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 10m ago 3h 1850M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:15:08.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 10m ago 3h 2041M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:15:08.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 10m ago 3h 1648M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:15:08.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 10m ago 3h 2568M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:15:08.640 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 10m ago 3h 141M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:15:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:08.292309+0000 mgr.smithi067.rdualw (mgr.24569) 7880 : audit [DBG] from='client.47893 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:15:08.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:08.292309+0000 mgr.smithi067.rdualw (mgr.24569) 7880 : audit [DBG] from='client.47893 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:15:09.030 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:15:09.031 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:15:09.031 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:15:09.031 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:15:09.031 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:15:09.032 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:15:09.032 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:15:09.032 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:15:09.032 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:15:09.032 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:15:09.033 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:15:09.033 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:15:09.033 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:15:09.033 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:15:09.034 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:15:09.034 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:15:09.034 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:15:09.034 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:15:09.034 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:15:09.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:08.443841+0000 mgr.smithi067.rdualw (mgr.24569) 7881 : cluster [DBG] pgmap v6788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:09.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:08.614681+0000 mgr.smithi067.rdualw (mgr.24569) 7882 : audit [DBG] from='client.39398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:15:09.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:09.029601+0000 mon.smithi061 (mon.0) 1712 : audit [DBG] from='client.? 172.21.15.61:0/984365989' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:15:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:08.443841+0000 mgr.smithi067.rdualw (mgr.24569) 7881 : cluster [DBG] pgmap v6788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:08.614681+0000 mgr.smithi067.rdualw (mgr.24569) 7882 : audit [DBG] from='client.39398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:15:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:09.029601+0000 mon.smithi061 (mon.0) 1712 : audit [DBG] from='client.? 172.21.15.61:0/984365989' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:15:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:10.119076+0000 mon.smithi061 (mon.0) 1713 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:15:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:10.520411+0000 mon.smithi067 (mon.1) 1206 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:15:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:10.520797+0000 mon.smithi061 (mon.0) 1714 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:15:11.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:10.119076+0000 mon.smithi061 (mon.0) 1713 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:15:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:10.520411+0000 mon.smithi067 (mon.1) 1206 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:15:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:10.520797+0000 mon.smithi061 (mon.0) 1714 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:15:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:10.444708+0000 mgr.smithi067.rdualw (mgr.24569) 7883 : cluster [DBG] pgmap v6789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:10.444708+0000 mgr.smithi067.rdualw (mgr.24569) 7883 : cluster [DBG] pgmap v6789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:12.445193+0000 mgr.smithi067.rdualw (mgr.24569) 7884 : cluster [DBG] pgmap v6790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:14.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:12.768632+0000 mon.smithi061 (mon.0) 1715 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:15:14.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:13.198409+0000 mon.smithi067 (mon.1) 1207 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:15:14.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:13.198845+0000 mon.smithi061 (mon.0) 1716 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:15:14.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:13.204042+0000 mon.smithi061 (mon.0) 1717 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:15:14.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:13.213195+0000 mon.smithi061 (mon.0) 1718 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:15:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:12.445193+0000 mgr.smithi067.rdualw (mgr.24569) 7884 : cluster [DBG] pgmap v6790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:12.768632+0000 mon.smithi061 (mon.0) 1715 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:15:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:13.198409+0000 mon.smithi067 (mon.1) 1207 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:15:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:13.198845+0000 mon.smithi061 (mon.0) 1716 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:15:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:13.204042+0000 mon.smithi061 (mon.0) 1717 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:15:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:13.213195+0000 mon.smithi061 (mon.0) 1718 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:15:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:14.445925+0000 mgr.smithi067.rdualw (mgr.24569) 7885 : cluster [DBG] pgmap v6791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:14.445925+0000 mgr.smithi067.rdualw (mgr.24569) 7885 : cluster [DBG] pgmap v6791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:16.447043+0000 mgr.smithi067.rdualw (mgr.24569) 7886 : cluster [DBG] pgmap v6792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:15:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:16.447043+0000 mgr.smithi067.rdualw (mgr.24569) 7886 : cluster [DBG] pgmap v6792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:15:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:18.447643+0000 mgr.smithi067.rdualw (mgr.24569) 7887 : cluster [DBG] pgmap v6793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:18.447643+0000 mgr.smithi067.rdualw (mgr.24569) 7887 : cluster [DBG] pgmap v6793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:20.448607+0000 mgr.smithi067.rdualw (mgr.24569) 7888 : cluster [DBG] pgmap v6794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:21.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:20.448607+0000 mgr.smithi067.rdualw (mgr.24569) 7888 : cluster [DBG] pgmap v6794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:22.449257+0000 mgr.smithi067.rdualw (mgr.24569) 7889 : cluster [DBG] pgmap v6795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:22.449257+0000 mgr.smithi067.rdualw (mgr.24569) 7889 : cluster [DBG] pgmap v6795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:25.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:24.449958+0000 mgr.smithi067.rdualw (mgr.24569) 7890 : cluster [DBG] pgmap v6796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:25.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:24.449958+0000 mgr.smithi067.rdualw (mgr.24569) 7890 : cluster [DBG] pgmap v6796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:26.450843+0000 mgr.smithi067.rdualw (mgr.24569) 7891 : cluster [DBG] pgmap v6797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:15:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:26.450843+0000 mgr.smithi067.rdualw (mgr.24569) 7891 : cluster [DBG] pgmap v6797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:15:29.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:28.451420+0000 mgr.smithi067.rdualw (mgr.24569) 7892 : cluster [DBG] pgmap v6798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:29.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:28.451420+0000 mgr.smithi067.rdualw (mgr.24569) 7892 : cluster [DBG] pgmap v6798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:31.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:30.452307+0000 mgr.smithi067.rdualw (mgr.24569) 7893 : cluster [DBG] pgmap v6799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:31.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:30.452307+0000 mgr.smithi067.rdualw (mgr.24569) 7893 : cluster [DBG] pgmap v6799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:33.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:32.452865+0000 mgr.smithi067.rdualw (mgr.24569) 7894 : cluster [DBG] pgmap v6800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:33.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:32.452865+0000 mgr.smithi067.rdualw (mgr.24569) 7894 : cluster [DBG] pgmap v6800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:34.453402+0000 mgr.smithi067.rdualw (mgr.24569) 7895 : cluster [DBG] pgmap v6801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:34.453402+0000 mgr.smithi067.rdualw (mgr.24569) 7895 : cluster [DBG] pgmap v6801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:35.682221+0000 mon.smithi067 (mon.1) 1208 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:15:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:35.682514+0000 mon.smithi061 (mon.0) 1719 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:15:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:35.682602+0000 mon.smithi067 (mon.1) 1209 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:15:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:35.682758+0000 mon.smithi061 (mon.0) 1720 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:15:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:35.682221+0000 mon.smithi067 (mon.1) 1208 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:15:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:35.682514+0000 mon.smithi061 (mon.0) 1719 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:15:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:35.682602+0000 mon.smithi067 (mon.1) 1209 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:15:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:35.682758+0000 mon.smithi061 (mon.0) 1720 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:15:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:36.454299+0000 mgr.smithi067.rdualw (mgr.24569) 7896 : cluster [DBG] pgmap v6802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:15:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:36.454299+0000 mgr.smithi067.rdualw (mgr.24569) 7896 : cluster [DBG] pgmap v6802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:15:39.341 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:15:39.633 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:15:39.634 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 26s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:15:39.634 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 26s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:15:39.634 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 29s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:15:39.635 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 26s ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:15:39.635 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 26s ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:15:39.635 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 29s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:15:39.635 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 26s ago 3h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:15:39.636 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 29s ago 3h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:15:39.636 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 26s ago 3h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:15:39.636 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 29s ago 3h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:15:39.636 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 26s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:15:39.636 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 29s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:15:39.637 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 26s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:15:39.637 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 29s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:15:39.637 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 26s ago 3h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:15:39.637 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 26s ago 3h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:15:39.637 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 26s ago 3h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:15:39.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 26s ago 3h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:15:39.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 29s ago 3h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:15:39.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 29s ago 3h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:15:39.638 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 29s ago 3h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:15:39.639 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 29s ago 3h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:15:39.639 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 26s ago 3h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:15:39.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:38.454934+0000 mgr.smithi067.rdualw (mgr.24569) 7897 : cluster [DBG] pgmap v6803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:39.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:38.454934+0000 mgr.smithi067.rdualw (mgr.24569) 7897 : cluster [DBG] pgmap v6803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:39.975 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:15:39.975 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:15:39.975 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:15:39.976 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:15:39.976 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:15:39.976 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:15:39.976 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:15:39.977 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:15:39.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:15:39.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:15:39.977 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:15:39.977 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:15:39.978 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:15:39.978 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:15:39.978 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:15:39.978 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:15:39.979 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:15:39.979 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:15:39.979 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:15:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:39.327673+0000 mgr.smithi067.rdualw (mgr.24569) 7898 : audit [DBG] from='client.39406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:15:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:39.616375+0000 mgr.smithi067.rdualw (mgr.24569) 7899 : audit [DBG] from='client.39410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:15:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:15:39.973743+0000 mon.smithi061 (mon.0) 1721 : audit [DBG] from='client.? 172.21.15.61:0/2740499150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:15:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:39.327673+0000 mgr.smithi067.rdualw (mgr.24569) 7898 : audit [DBG] from='client.39406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:15:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:39.616375+0000 mgr.smithi067.rdualw (mgr.24569) 7899 : audit [DBG] from='client.39410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:15:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:15:39.973743+0000 mon.smithi061 (mon.0) 1721 : audit [DBG] from='client.? 172.21.15.61:0/2740499150' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:15:41.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:40.455829+0000 mgr.smithi067.rdualw (mgr.24569) 7900 : cluster [DBG] pgmap v6804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:40.455829+0000 mgr.smithi067.rdualw (mgr.24569) 7900 : cluster [DBG] pgmap v6804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:43.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:42.456326+0000 mgr.smithi067.rdualw (mgr.24569) 7901 : cluster [DBG] pgmap v6805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:42.456326+0000 mgr.smithi067.rdualw (mgr.24569) 7901 : cluster [DBG] pgmap v6805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:45.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:44.456926+0000 mgr.smithi067.rdualw (mgr.24569) 7902 : cluster [DBG] pgmap v6806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:44.456926+0000 mgr.smithi067.rdualw (mgr.24569) 7902 : cluster [DBG] pgmap v6806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:47.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:46.457842+0000 mgr.smithi067.rdualw (mgr.24569) 7903 : cluster [DBG] pgmap v6807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:15:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:46.457842+0000 mgr.smithi067.rdualw (mgr.24569) 7903 : cluster [DBG] pgmap v6807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:15:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:48.458348+0000 mgr.smithi067.rdualw (mgr.24569) 7904 : cluster [DBG] pgmap v6808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:48.458348+0000 mgr.smithi067.rdualw (mgr.24569) 7904 : cluster [DBG] pgmap v6808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:51.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:50.459148+0000 mgr.smithi067.rdualw (mgr.24569) 7905 : cluster [DBG] pgmap v6809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:50.459148+0000 mgr.smithi067.rdualw (mgr.24569) 7905 : cluster [DBG] pgmap v6809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:52.459665+0000 mgr.smithi067.rdualw (mgr.24569) 7906 : cluster [DBG] pgmap v6810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:52.459665+0000 mgr.smithi067.rdualw (mgr.24569) 7906 : cluster [DBG] pgmap v6810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:54.460201+0000 mgr.smithi067.rdualw (mgr.24569) 7907 : cluster [DBG] pgmap v6811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:54.460201+0000 mgr.smithi067.rdualw (mgr.24569) 7907 : cluster [DBG] pgmap v6811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:56.461155+0000 mgr.smithi067.rdualw (mgr.24569) 7908 : cluster [DBG] pgmap v6812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:15:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:56.461155+0000 mgr.smithi067.rdualw (mgr.24569) 7908 : cluster [DBG] pgmap v6812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:15:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:15:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:15:58.461712+0000 mgr.smithi067.rdualw (mgr.24569) 7909 : cluster [DBG] pgmap v6813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:15:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:15:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:15:58.461712+0000 mgr.smithi067.rdualw (mgr.24569) 7909 : cluster [DBG] pgmap v6813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:01.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:00.462739+0000 mgr.smithi067.rdualw (mgr.24569) 7910 : cluster [DBG] pgmap v6814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:00.462739+0000 mgr.smithi067.rdualw (mgr.24569) 7910 : cluster [DBG] pgmap v6814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:03.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:02.463391+0000 mgr.smithi067.rdualw (mgr.24569) 7911 : cluster [DBG] pgmap v6815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:03.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:02.463391+0000 mgr.smithi067.rdualw (mgr.24569) 7911 : cluster [DBG] pgmap v6815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:05.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:04.464201+0000 mgr.smithi067.rdualw (mgr.24569) 7912 : cluster [DBG] pgmap v6816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:04.464201+0000 mgr.smithi067.rdualw (mgr.24569) 7912 : cluster [DBG] pgmap v6816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:06.465052+0000 mgr.smithi067.rdualw (mgr.24569) 7913 : cluster [DBG] pgmap v6817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:16:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:06.465052+0000 mgr.smithi067.rdualw (mgr.24569) 7913 : cluster [DBG] pgmap v6817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:16:09.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:08.465572+0000 mgr.smithi067.rdualw (mgr.24569) 7914 : cluster [DBG] pgmap v6818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:08.465572+0000 mgr.smithi067.rdualw (mgr.24569) 7914 : cluster [DBG] pgmap v6818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:10.286 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:16:10.579 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:16:10.580 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 57s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:16:10.580 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 57s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:16:10.580 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 60s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:16:10.580 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 57s ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:16:10.581 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 57s ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:16:10.581 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 60s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:16:10.581 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 57s ago 3h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:16:10.581 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 60s ago 3h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:16:10.581 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 57s ago 3h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:16:10.582 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 60s ago 3h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:16:10.582 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 57s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:16:10.582 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 60s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:16:10.582 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 57s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:16:10.583 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 60s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:16:10.583 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 57s ago 3h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:16:10.583 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 57s ago 3h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:16:10.583 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 57s ago 3h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:16:10.584 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 57s ago 3h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:16:10.584 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 60s ago 3h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:16:10.584 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 60s ago 3h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:16:10.585 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 60s ago 3h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:16:10.585 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 60s ago 3h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:16:10.585 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 57s ago 3h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:16:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:16:10.273268+0000 mgr.smithi067.rdualw (mgr.24569) 7915 : audit [DBG] from='client.39418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:16:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:16:10.273268+0000 mgr.smithi067.rdualw (mgr.24569) 7915 : audit [DBG] from='client.39418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:16:10.922 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:16:10.922 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:16:10.923 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:16:10.923 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:16:10.923 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:16:10.923 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:16:10.924 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:16:10.924 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:16:10.924 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:16:10.924 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:16:10.925 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:16:10.925 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:16:10.925 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:16:10.925 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:16:10.925 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:16:10.926 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:16:10.926 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:16:10.926 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:16:10.926 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:16:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:10.466479+0000 mgr.smithi067.rdualw (mgr.24569) 7916 : cluster [DBG] pgmap v6819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:16:10.562208+0000 mgr.smithi067.rdualw (mgr.24569) 7917 : audit [DBG] from='client.39422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:16:11.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:16:10.920827+0000 mon.smithi061 (mon.0) 1722 : audit [DBG] from='client.? 172.21.15.61:0/166979368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:16:11.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:10.466479+0000 mgr.smithi067.rdualw (mgr.24569) 7916 : cluster [DBG] pgmap v6819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:11.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:16:10.562208+0000 mgr.smithi067.rdualw (mgr.24569) 7917 : audit [DBG] from='client.39422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:16:11.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:16:10.920827+0000 mon.smithi061 (mon.0) 1722 : audit [DBG] from='client.? 172.21.15.61:0/166979368' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:16:13.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:12.467051+0000 mgr.smithi067.rdualw (mgr.24569) 7918 : cluster [DBG] pgmap v6820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:13.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:16:13.220237+0000 mon.smithi067 (mon.1) 1210 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:16:13.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:16:13.221744+0000 mon.smithi067 (mon.1) 1211 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:16:13.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:16:13.222694+0000 mon.smithi067 (mon.1) 1212 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:16:13.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:16:13.223592+0000 mgr.smithi067.rdualw (mgr.24569) 7919 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:16:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:12.467051+0000 mgr.smithi067.rdualw (mgr.24569) 7918 : cluster [DBG] pgmap v6820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:16:13.220237+0000 mon.smithi067 (mon.1) 1210 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:16:13.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:16:13.221744+0000 mon.smithi067 (mon.1) 1211 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:16:13.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:16:13.222694+0000 mon.smithi067 (mon.1) 1212 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:16:13.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:16:13.223592+0000 mgr.smithi067.rdualw (mgr.24569) 7919 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:16:14.949 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:16:13.644900+0000 mon.smithi061 (mon.0) 1723 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:16:14.949 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:16:13.652805+0000 mon.smithi061 (mon.0) 1724 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:16:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:16:13.644900+0000 mon.smithi061 (mon.0) 1723 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:16:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:16:13.652805+0000 mon.smithi061 (mon.0) 1724 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:16:15.949 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:14.467692+0000 mgr.smithi067.rdualw (mgr.24569) 7920 : cluster [DBG] pgmap v6821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:14.467692+0000 mgr.smithi067.rdualw (mgr.24569) 7920 : cluster [DBG] pgmap v6821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:16.468490+0000 mgr.smithi067.rdualw (mgr.24569) 7921 : cluster [DBG] pgmap v6822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:16:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:16.468490+0000 mgr.smithi067.rdualw (mgr.24569) 7921 : cluster [DBG] pgmap v6822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:16:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:18.469086+0000 mgr.smithi067.rdualw (mgr.24569) 7922 : cluster [DBG] pgmap v6823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:18.469086+0000 mgr.smithi067.rdualw (mgr.24569) 7922 : cluster [DBG] pgmap v6823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:20.469921+0000 mgr.smithi067.rdualw (mgr.24569) 7923 : cluster [DBG] pgmap v6824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:21.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:20.469921+0000 mgr.smithi067.rdualw (mgr.24569) 7923 : cluster [DBG] pgmap v6824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:22.470515+0000 mgr.smithi067.rdualw (mgr.24569) 7924 : cluster [DBG] pgmap v6825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:22.470515+0000 mgr.smithi067.rdualw (mgr.24569) 7924 : cluster [DBG] pgmap v6825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:25.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:24.471035+0000 mgr.smithi067.rdualw (mgr.24569) 7925 : cluster [DBG] pgmap v6826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:25.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:24.471035+0000 mgr.smithi067.rdualw (mgr.24569) 7925 : cluster [DBG] pgmap v6826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:26.472001+0000 mgr.smithi067.rdualw (mgr.24569) 7926 : cluster [DBG] pgmap v6827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:16:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:26.472001+0000 mgr.smithi067.rdualw (mgr.24569) 7926 : cluster [DBG] pgmap v6827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:16:29.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:28.472476+0000 mgr.smithi067.rdualw (mgr.24569) 7927 : cluster [DBG] pgmap v6828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:29.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:28.472476+0000 mgr.smithi067.rdualw (mgr.24569) 7927 : cluster [DBG] pgmap v6828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:31.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:30.473401+0000 mgr.smithi067.rdualw (mgr.24569) 7928 : cluster [DBG] pgmap v6829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:31.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:30.473401+0000 mgr.smithi067.rdualw (mgr.24569) 7928 : cluster [DBG] pgmap v6829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:33.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:32.474213+0000 mgr.smithi067.rdualw (mgr.24569) 7929 : cluster [DBG] pgmap v6830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:33.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:32.474213+0000 mgr.smithi067.rdualw (mgr.24569) 7929 : cluster [DBG] pgmap v6830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:34.475030+0000 mgr.smithi067.rdualw (mgr.24569) 7930 : cluster [DBG] pgmap v6831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:34.475030+0000 mgr.smithi067.rdualw (mgr.24569) 7930 : cluster [DBG] pgmap v6831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:16:35.687852+0000 mon.smithi067 (mon.1) 1213 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:16:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:16:35.688097+0000 mon.smithi067 (mon.1) 1214 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:16:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:16:35.688286+0000 mon.smithi061 (mon.0) 1725 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:16:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:16:35.688517+0000 mon.smithi061 (mon.0) 1726 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:16:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:16:35.687852+0000 mon.smithi067 (mon.1) 1213 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:16:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:16:35.688097+0000 mon.smithi067 (mon.1) 1214 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:16:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:16:35.688286+0000 mon.smithi061 (mon.0) 1725 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:16:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:16:35.688517+0000 mon.smithi061 (mon.0) 1726 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:16:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:36.476096+0000 mgr.smithi067.rdualw (mgr.24569) 7931 : cluster [DBG] pgmap v6832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:16:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:36.476096+0000 mgr.smithi067.rdualw (mgr.24569) 7931 : cluster [DBG] pgmap v6832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:16:39.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:38.476643+0000 mgr.smithi067.rdualw (mgr.24569) 7932 : cluster [DBG] pgmap v6833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:39.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:38.476643+0000 mgr.smithi067.rdualw (mgr.24569) 7932 : cluster [DBG] pgmap v6833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:41.236 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:16:41.526 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:16:41.526 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 88s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:16:41.527 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 88s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:16:41.527 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 91s ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:16:41.527 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 88s ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:16:41.527 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 88s ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:16:41.527 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 91s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:16:41.528 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 88s ago 3h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:16:41.528 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 91s ago 3h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:16:41.528 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 88s ago 3h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:16:41.528 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 91s ago 3h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:16:41.529 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 88s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:16:41.529 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 91s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:16:41.529 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 88s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:16:41.529 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 91s ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:16:41.529 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 88s ago 3h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:16:41.530 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 88s ago 3h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:16:41.530 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 88s ago 3h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:16:41.530 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 88s ago 3h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:16:41.530 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 91s ago 3h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:16:41.531 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 91s ago 3h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:16:41.531 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 91s ago 3h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:16:41.531 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 91s ago 3h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:16:41.531 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 88s ago 3h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:16:41.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:40.477585+0000 mgr.smithi067.rdualw (mgr.24569) 7933 : cluster [DBG] pgmap v6834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:16:41.223106+0000 mgr.smithi067.rdualw (mgr.24569) 7934 : audit [DBG] from='client.39430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:16:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:40.477585+0000 mgr.smithi067.rdualw (mgr.24569) 7933 : cluster [DBG] pgmap v6834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:41.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:16:41.223106+0000 mgr.smithi067.rdualw (mgr.24569) 7934 : audit [DBG] from='client.39430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:16:41.898 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:16:41.899 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:16:41.899 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:16:41.899 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:16:41.900 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:16:41.900 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:16:41.900 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:16:41.900 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:16:41.900 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:16:41.901 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:16:41.901 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:16:41.901 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:16:41.901 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:16:41.902 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:16:41.902 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:16:41.902 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:16:41.902 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:16:41.902 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:16:41.903 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:16:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:16:41.508570+0000 mgr.smithi067.rdualw (mgr.24569) 7935 : audit [DBG] from='client.39434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:16:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:16:41.897578+0000 mon.smithi061 (mon.0) 1727 : audit [DBG] from='client.? 172.21.15.61:0/3225626884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:16:42.954 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:16:41.508570+0000 mgr.smithi067.rdualw (mgr.24569) 7935 : audit [DBG] from='client.39434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:16:42.954 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:16:41.897578+0000 mon.smithi061 (mon.0) 1727 : audit [DBG] from='client.? 172.21.15.61:0/3225626884' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:16:43.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:42.478121+0000 mgr.smithi067.rdualw (mgr.24569) 7936 : cluster [DBG] pgmap v6835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:43.954 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:42.478121+0000 mgr.smithi067.rdualw (mgr.24569) 7936 : cluster [DBG] pgmap v6835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:44.478823+0000 mgr.smithi067.rdualw (mgr.24569) 7937 : cluster [DBG] pgmap v6836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:45.954 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:44.478823+0000 mgr.smithi067.rdualw (mgr.24569) 7937 : cluster [DBG] pgmap v6836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:46.479797+0000 mgr.smithi067.rdualw (mgr.24569) 7938 : cluster [DBG] pgmap v6837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:16:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:46.479797+0000 mgr.smithi067.rdualw (mgr.24569) 7938 : cluster [DBG] pgmap v6837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:16:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:48.480416+0000 mgr.smithi067.rdualw (mgr.24569) 7939 : cluster [DBG] pgmap v6838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:48.480416+0000 mgr.smithi067.rdualw (mgr.24569) 7939 : cluster [DBG] pgmap v6838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:51.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:50.481236+0000 mgr.smithi067.rdualw (mgr.24569) 7940 : cluster [DBG] pgmap v6839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:50.481236+0000 mgr.smithi067.rdualw (mgr.24569) 7940 : cluster [DBG] pgmap v6839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:52.481771+0000 mgr.smithi067.rdualw (mgr.24569) 7941 : cluster [DBG] pgmap v6840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:52.481771+0000 mgr.smithi067.rdualw (mgr.24569) 7941 : cluster [DBG] pgmap v6840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:54.482317+0000 mgr.smithi067.rdualw (mgr.24569) 7942 : cluster [DBG] pgmap v6841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:54.482317+0000 mgr.smithi067.rdualw (mgr.24569) 7942 : cluster [DBG] pgmap v6841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:56.483266+0000 mgr.smithi067.rdualw (mgr.24569) 7943 : cluster [DBG] pgmap v6842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:16:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:56.483266+0000 mgr.smithi067.rdualw (mgr.24569) 7943 : cluster [DBG] pgmap v6842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:16:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:16:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:16:58.483957+0000 mgr.smithi067.rdualw (mgr.24569) 7944 : cluster [DBG] pgmap v6843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:16:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:16:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:16:58.483957+0000 mgr.smithi067.rdualw (mgr.24569) 7944 : cluster [DBG] pgmap v6843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:01.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:00.485023+0000 mgr.smithi067.rdualw (mgr.24569) 7945 : cluster [DBG] pgmap v6844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:00.485023+0000 mgr.smithi067.rdualw (mgr.24569) 7945 : cluster [DBG] pgmap v6844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:03.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:02.485481+0000 mgr.smithi067.rdualw (mgr.24569) 7946 : cluster [DBG] pgmap v6845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:03.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:02.485481+0000 mgr.smithi067.rdualw (mgr.24569) 7946 : cluster [DBG] pgmap v6845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:05.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:04.486015+0000 mgr.smithi067.rdualw (mgr.24569) 7947 : cluster [DBG] pgmap v6846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:04.486015+0000 mgr.smithi067.rdualw (mgr.24569) 7947 : cluster [DBG] pgmap v6846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:06.486993+0000 mgr.smithi067.rdualw (mgr.24569) 7948 : cluster [DBG] pgmap v6847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:17:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:06.486993+0000 mgr.smithi067.rdualw (mgr.24569) 7948 : cluster [DBG] pgmap v6847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:17:09.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:08.487621+0000 mgr.smithi067.rdualw (mgr.24569) 7949 : cluster [DBG] pgmap v6848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:08.487621+0000 mgr.smithi067.rdualw (mgr.24569) 7949 : cluster [DBG] pgmap v6848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:11.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:10.488430+0000 mgr.smithi067.rdualw (mgr.24569) 7950 : cluster [DBG] pgmap v6849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:11.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:10.488430+0000 mgr.smithi067.rdualw (mgr.24569) 7950 : cluster [DBG] pgmap v6849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:12.208 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:17:12.498 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:17:12.498 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 119s ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:17:12.499 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 119s ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:17:12.499 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 2m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:17:12.499 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 119s ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:17:12.499 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 119s ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:17:12.500 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 2m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:17:12.500 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 119s ago 3h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:17:12.500 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 2m ago 3h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:17:12.500 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 119s ago 3h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:17:12.501 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 2m ago 3h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:17:12.501 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 119s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:17:12.501 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 2m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:17:12.501 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 119s ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:17:12.502 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 2m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:17:12.502 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 119s ago 3h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:17:12.502 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 119s ago 3h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:17:12.503 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 119s ago 3h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:17:12.503 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 119s ago 3h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:17:12.503 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 2m ago 3h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:17:12.503 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 2m ago 3h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:17:12.504 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 2m ago 3h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:17:12.504 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 2m ago 3h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:17:12.504 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 119s ago 3h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:17:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:17:12.194828+0000 mgr.smithi067.rdualw (mgr.24569) 7951 : audit [DBG] from='client.39442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:17:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:17:12.194828+0000 mgr.smithi067.rdualw (mgr.24569) 7951 : audit [DBG] from='client.39442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:17:12.841 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:17:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:17:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:17:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:17:12.842 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:17:12.843 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:17:12.843 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:17:12.843 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:17:12.843 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:17:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:17:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:17:12.844 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:17:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:17:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:17:12.845 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:17:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:17:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:17:12.846 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:17:12.846 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:17:13.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:17:12.480747+0000 mgr.smithi067.rdualw (mgr.24569) 7952 : audit [DBG] from='client.39446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:17:13.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:12.488857+0000 mgr.smithi067.rdualw (mgr.24569) 7953 : cluster [DBG] pgmap v6850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:13.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:17:12.840496+0000 mon.smithi061 (mon.0) 1728 : audit [DBG] from='client.? 172.21.15.61:0/1699675056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:17:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:17:12.480747+0000 mgr.smithi067.rdualw (mgr.24569) 7952 : audit [DBG] from='client.39446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:17:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:12.488857+0000 mgr.smithi067.rdualw (mgr.24569) 7953 : cluster [DBG] pgmap v6850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:17:12.840496+0000 mon.smithi061 (mon.0) 1728 : audit [DBG] from='client.? 172.21.15.61:0/1699675056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:17:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:17:13.656518+0000 mon.smithi067 (mon.1) 1215 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:17:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:17:13.658031+0000 mon.smithi067 (mon.1) 1216 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:17:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:17:13.658958+0000 mon.smithi067 (mon.1) 1217 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:17:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:17:13.659794+0000 mgr.smithi067.rdualw (mgr.24569) 7954 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:17:14.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:17:14.012955+0000 mon.smithi061 (mon.0) 1729 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:17:14.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:17:14.022824+0000 mon.smithi061 (mon.0) 1730 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:17:14.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:17:14.425486+0000 mon.smithi061 (mon.0) 1731 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:17:14.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:17:14.431179+0000 mon.smithi061 (mon.0) 1732 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:17:14.959 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:17:13.656518+0000 mon.smithi067 (mon.1) 1215 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:17:14.959 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:17:13.658031+0000 mon.smithi067 (mon.1) 1216 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:17:14.960 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:17:13.658958+0000 mon.smithi067 (mon.1) 1217 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:17:14.960 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:17:13.659794+0000 mgr.smithi067.rdualw (mgr.24569) 7954 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:17:14.960 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:17:14.012955+0000 mon.smithi061 (mon.0) 1729 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:17:14.960 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:17:14.022824+0000 mon.smithi061 (mon.0) 1730 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:17:14.961 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:17:14.425486+0000 mon.smithi061 (mon.0) 1731 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:17:14.961 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:17:14.431179+0000 mon.smithi061 (mon.0) 1732 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:17:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:14.489620+0000 mgr.smithi067.rdualw (mgr.24569) 7955 : cluster [DBG] pgmap v6851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:15.959 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:14.489620+0000 mgr.smithi067.rdualw (mgr.24569) 7955 : cluster [DBG] pgmap v6851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:16.490580+0000 mgr.smithi067.rdualw (mgr.24569) 7956 : cluster [DBG] pgmap v6852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:17:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:16.490580+0000 mgr.smithi067.rdualw (mgr.24569) 7956 : cluster [DBG] pgmap v6852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:17:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:18.491125+0000 mgr.smithi067.rdualw (mgr.24569) 7957 : cluster [DBG] pgmap v6853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:18.491125+0000 mgr.smithi067.rdualw (mgr.24569) 7957 : cluster [DBG] pgmap v6853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:20.491902+0000 mgr.smithi067.rdualw (mgr.24569) 7958 : cluster [DBG] pgmap v6854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:21.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:20.491902+0000 mgr.smithi067.rdualw (mgr.24569) 7958 : cluster [DBG] pgmap v6854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:22.492408+0000 mgr.smithi067.rdualw (mgr.24569) 7959 : cluster [DBG] pgmap v6855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:23.960 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:22.492408+0000 mgr.smithi067.rdualw (mgr.24569) 7959 : cluster [DBG] pgmap v6855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:25.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:24.493077+0000 mgr.smithi067.rdualw (mgr.24569) 7960 : cluster [DBG] pgmap v6856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:25.961 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:24.493077+0000 mgr.smithi067.rdualw (mgr.24569) 7960 : cluster [DBG] pgmap v6856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:26.493959+0000 mgr.smithi067.rdualw (mgr.24569) 7961 : cluster [DBG] pgmap v6857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:17:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:26.493959+0000 mgr.smithi067.rdualw (mgr.24569) 7961 : cluster [DBG] pgmap v6857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:17:29.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:28.494678+0000 mgr.smithi067.rdualw (mgr.24569) 7962 : cluster [DBG] pgmap v6858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:29.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:28.494678+0000 mgr.smithi067.rdualw (mgr.24569) 7962 : cluster [DBG] pgmap v6858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:31.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:30.495556+0000 mgr.smithi067.rdualw (mgr.24569) 7963 : cluster [DBG] pgmap v6859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:31.962 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:30.495556+0000 mgr.smithi067.rdualw (mgr.24569) 7963 : cluster [DBG] pgmap v6859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:33.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:32.496305+0000 mgr.smithi067.rdualw (mgr.24569) 7964 : cluster [DBG] pgmap v6860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:33.962 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:32.496305+0000 mgr.smithi067.rdualw (mgr.24569) 7964 : cluster [DBG] pgmap v6860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:34.496931+0000 mgr.smithi067.rdualw (mgr.24569) 7965 : cluster [DBG] pgmap v6861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:35.962 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:34.496931+0000 mgr.smithi067.rdualw (mgr.24569) 7965 : cluster [DBG] pgmap v6861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:17:35.693044+0000 mon.smithi067 (mon.1) 1218 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:17:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:17:35.693291+0000 mon.smithi067 (mon.1) 1219 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:17:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:17:35.693318+0000 mon.smithi061 (mon.0) 1733 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:17:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:17:35.693595+0000 mon.smithi061 (mon.0) 1734 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:17:36.963 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:17:35.693044+0000 mon.smithi067 (mon.1) 1218 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:17:36.963 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:17:35.693291+0000 mon.smithi067 (mon.1) 1219 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:17:36.963 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:17:35.693318+0000 mon.smithi061 (mon.0) 1733 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:17:36.964 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:17:35.693595+0000 mon.smithi061 (mon.0) 1734 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:17:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:36.498020+0000 mgr.smithi067.rdualw (mgr.24569) 7966 : cluster [DBG] pgmap v6862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:17:37.963 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:36.498020+0000 mgr.smithi067.rdualw (mgr.24569) 7966 : cluster [DBG] pgmap v6862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:17:39.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:38.498793+0000 mgr.smithi067.rdualw (mgr.24569) 7967 : cluster [DBG] pgmap v6863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:39.963 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:38.498793+0000 mgr.smithi067.rdualw (mgr.24569) 7967 : cluster [DBG] pgmap v6863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:41.963 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:40.499690+0000 mgr.smithi067.rdualw (mgr.24569) 7968 : cluster [DBG] pgmap v6864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:40.499690+0000 mgr.smithi067.rdualw (mgr.24569) 7968 : cluster [DBG] pgmap v6864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:43.149 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:17:43.441 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:17:43.441 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 2m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:17:43.442 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 2m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:17:43.442 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 2m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:17:43.442 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 2m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:17:43.442 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 2m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:17:43.442 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 2m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:17:43.443 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 2m ago 3h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:17:43.443 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 2m ago 3h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:17:43.443 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 2m ago 3h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:17:43.443 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 2m ago 3h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:17:43.444 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 2m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:17:43.444 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 2m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:17:43.444 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 2m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:17:43.444 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 2m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:17:43.445 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 2m ago 3h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:17:43.445 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 2m ago 3h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:17:43.445 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 2m ago 3h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:17:43.445 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 2m ago 3h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:17:43.445 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 2m ago 3h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:17:43.446 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 2m ago 3h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:17:43.446 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 2m ago 3h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:17:43.446 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 2m ago 3h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:17:43.446 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 2m ago 3h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:17:43.786 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:17:43.786 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:17:43.787 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:17:43.787 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:17:43.787 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:17:43.787 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:17:43.788 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:17:43.788 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:17:43.788 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:17:43.788 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:17:43.788 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:17:43.789 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:17:43.789 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:17:43.789 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:17:43.789 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:17:43.790 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:17:43.790 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:17:43.790 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:17:43.790 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:17:43.964 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:42.500241+0000 mgr.smithi067.rdualw (mgr.24569) 7969 : cluster [DBG] pgmap v6865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:43.964 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:17:43.136858+0000 mgr.smithi067.rdualw (mgr.24569) 7970 : audit [DBG] from='client.39454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:17:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:42.500241+0000 mgr.smithi067.rdualw (mgr.24569) 7969 : cluster [DBG] pgmap v6865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:17:43.136858+0000 mgr.smithi067.rdualw (mgr.24569) 7970 : audit [DBG] from='client.39454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:17:44.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:17:43.423372+0000 mgr.smithi067.rdualw (mgr.24569) 7971 : audit [DBG] from='client.39458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:17:44.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:17:43.784868+0000 mon.smithi061 (mon.0) 1735 : audit [DBG] from='client.? 172.21.15.61:0/2405774974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:17:44.964 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:17:43.423372+0000 mgr.smithi067.rdualw (mgr.24569) 7971 : audit [DBG] from='client.39458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:17:44.964 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:17:43.784868+0000 mon.smithi061 (mon.0) 1735 : audit [DBG] from='client.? 172.21.15.61:0/2405774974' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:17:45.964 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:44.500857+0000 mgr.smithi067.rdualw (mgr.24569) 7972 : cluster [DBG] pgmap v6866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:44.500857+0000 mgr.smithi067.rdualw (mgr.24569) 7972 : cluster [DBG] pgmap v6866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:46.501854+0000 mgr.smithi067.rdualw (mgr.24569) 7973 : cluster [DBG] pgmap v6867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:17:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:46.501854+0000 mgr.smithi067.rdualw (mgr.24569) 7973 : cluster [DBG] pgmap v6867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:17:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:48.502398+0000 mgr.smithi067.rdualw (mgr.24569) 7974 : cluster [DBG] pgmap v6868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:49.964 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:48.502398+0000 mgr.smithi067.rdualw (mgr.24569) 7974 : cluster [DBG] pgmap v6868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:51.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:50.503332+0000 mgr.smithi067.rdualw (mgr.24569) 7975 : cluster [DBG] pgmap v6869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:51.965 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:50.503332+0000 mgr.smithi067.rdualw (mgr.24569) 7975 : cluster [DBG] pgmap v6869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:52.503819+0000 mgr.smithi067.rdualw (mgr.24569) 7976 : cluster [DBG] pgmap v6870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:53.965 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:52.503819+0000 mgr.smithi067.rdualw (mgr.24569) 7976 : cluster [DBG] pgmap v6870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:55.966 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:54.504592+0000 mgr.smithi067.rdualw (mgr.24569) 7977 : cluster [DBG] pgmap v6871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:54.504592+0000 mgr.smithi067.rdualw (mgr.24569) 7977 : cluster [DBG] pgmap v6871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:56.505442+0000 mgr.smithi067.rdualw (mgr.24569) 7978 : cluster [DBG] pgmap v6872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:17:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:56.505442+0000 mgr.smithi067.rdualw (mgr.24569) 7978 : cluster [DBG] pgmap v6872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:17:59.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:17:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:17:58.505992+0000 mgr.smithi067.rdualw (mgr.24569) 7979 : cluster [DBG] pgmap v6873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:17:59.966 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:17:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:17:58.505992+0000 mgr.smithi067.rdualw (mgr.24569) 7979 : cluster [DBG] pgmap v6873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:00.506897+0000 mgr.smithi067.rdualw (mgr.24569) 7980 : cluster [DBG] pgmap v6874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:01.967 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:00.506897+0000 mgr.smithi067.rdualw (mgr.24569) 7980 : cluster [DBG] pgmap v6874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:03.967 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:02.507506+0000 mgr.smithi067.rdualw (mgr.24569) 7981 : cluster [DBG] pgmap v6875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:02.507506+0000 mgr.smithi067.rdualw (mgr.24569) 7981 : cluster [DBG] pgmap v6875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:05.967 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:04.508304+0000 mgr.smithi067.rdualw (mgr.24569) 7982 : cluster [DBG] pgmap v6876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:04.508304+0000 mgr.smithi067.rdualw (mgr.24569) 7982 : cluster [DBG] pgmap v6876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:06.509141+0000 mgr.smithi067.rdualw (mgr.24569) 7983 : cluster [DBG] pgmap v6877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:18:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:06.509141+0000 mgr.smithi067.rdualw (mgr.24569) 7983 : cluster [DBG] pgmap v6877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:18:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:08.509782+0000 mgr.smithi067.rdualw (mgr.24569) 7984 : cluster [DBG] pgmap v6878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:09.968 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:08.509782+0000 mgr.smithi067.rdualw (mgr.24569) 7984 : cluster [DBG] pgmap v6878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:11.968 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:10.510693+0000 mgr.smithi067.rdualw (mgr.24569) 7985 : cluster [DBG] pgmap v6879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:10.510693+0000 mgr.smithi067.rdualw (mgr.24569) 7985 : cluster [DBG] pgmap v6879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:13.969 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:12.511382+0000 mgr.smithi067.rdualw (mgr.24569) 7986 : cluster [DBG] pgmap v6880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:12.511382+0000 mgr.smithi067.rdualw (mgr.24569) 7986 : cluster [DBG] pgmap v6880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:14.102 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:18:14.392 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:18:14.393 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 3m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:18:14.393 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 3m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:18:14.393 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 3m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:18:14.393 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 3m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:18:14.393 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 3m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:18:14.394 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 3m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:18:14.394 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 3m ago 3h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:18:14.394 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 3m ago 3h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:18:14.394 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 3m ago 3h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:18:14.395 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 3m ago 3h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:18:14.395 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 3m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:18:14.395 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 3m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:18:14.395 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 3m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:18:14.395 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 3m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:18:14.396 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 3m ago 3h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:18:14.396 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 3m ago 3h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:18:14.396 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 3m ago 3h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:18:14.396 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 3m ago 3h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:18:14.397 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 3m ago 3h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:18:14.397 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 3m ago 3h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:18:14.397 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 3m ago 3h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:18:14.397 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 3m ago 3h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:18:14.397 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 3m ago 3h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:18:14.746 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:18:14.747 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:18:14.747 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:18:14.747 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:18:14.748 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:18:14.748 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:18:14.748 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:18:14.748 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:18:14.749 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:18:14.749 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:18:14.749 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:18:14.749 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:18:14.749 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:18:14.750 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:18:14.750 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:18:14.750 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:18:14.750 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:18:14.751 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:18:14.751 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:18:14.837 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:18:14.089079+0000 mgr.smithi067.rdualw (mgr.24569) 7987 : audit [DBG] from='client.39466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:18:14.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:18:14.434655+0000 mon.smithi067 (mon.1) 1220 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:18:14.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:18:14.436011+0000 mon.smithi067 (mon.1) 1221 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:18:14.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:18:14.436912+0000 mon.smithi067 (mon.1) 1222 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:18:14.969 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:18:14.089079+0000 mgr.smithi067.rdualw (mgr.24569) 7987 : audit [DBG] from='client.39466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:18:14.969 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:18:14.434655+0000 mon.smithi067 (mon.1) 1220 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:18:14.970 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:18:14.436011+0000 mon.smithi067 (mon.1) 1221 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:18:14.970 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:18:14.436912+0000 mon.smithi067 (mon.1) 1222 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:18:15.969 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:18:14.375267+0000 mgr.smithi067.rdualw (mgr.24569) 7988 : audit [DBG] from='client.39470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:18:15.969 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:18:14.437732+0000 mgr.smithi067.rdualw (mgr.24569) 7989 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:18:15.970 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:14.511935+0000 mgr.smithi067.rdualw (mgr.24569) 7990 : cluster [DBG] pgmap v6881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:15.970 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:18:14.745558+0000 mon.smithi061 (mon.0) 1736 : audit [DBG] from='client.? 172.21.15.61:0/3049690403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:18:15.970 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:18:14.862752+0000 mon.smithi061 (mon.0) 1737 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:18:15.970 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:18:14.868519+0000 mon.smithi061 (mon.0) 1738 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:18:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:18:14.375267+0000 mgr.smithi067.rdualw (mgr.24569) 7988 : audit [DBG] from='client.39470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:18:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:18:14.437732+0000 mgr.smithi067.rdualw (mgr.24569) 7989 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:18:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:14.511935+0000 mgr.smithi067.rdualw (mgr.24569) 7990 : cluster [DBG] pgmap v6881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:18:14.745558+0000 mon.smithi061 (mon.0) 1736 : audit [DBG] from='client.? 172.21.15.61:0/3049690403' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:18:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:18:14.862752+0000 mon.smithi061 (mon.0) 1737 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:18:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:18:14.868519+0000 mon.smithi061 (mon.0) 1738 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:18:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:16.512996+0000 mgr.smithi067.rdualw (mgr.24569) 7991 : cluster [DBG] pgmap v6882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:18:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:16.512996+0000 mgr.smithi067.rdualw (mgr.24569) 7991 : cluster [DBG] pgmap v6882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:18:19.969 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:18.513575+0000 mgr.smithi067.rdualw (mgr.24569) 7992 : cluster [DBG] pgmap v6883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:18.513575+0000 mgr.smithi067.rdualw (mgr.24569) 7992 : cluster [DBG] pgmap v6883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:21.970 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:20.514406+0000 mgr.smithi067.rdualw (mgr.24569) 7993 : cluster [DBG] pgmap v6884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:20.514406+0000 mgr.smithi067.rdualw (mgr.24569) 7993 : cluster [DBG] pgmap v6884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:23.970 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:22.514927+0000 mgr.smithi067.rdualw (mgr.24569) 7994 : cluster [DBG] pgmap v6885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:22.514927+0000 mgr.smithi067.rdualw (mgr.24569) 7994 : cluster [DBG] pgmap v6885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:25.971 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:24.515697+0000 mgr.smithi067.rdualw (mgr.24569) 7995 : cluster [DBG] pgmap v6886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:24.515697+0000 mgr.smithi067.rdualw (mgr.24569) 7995 : cluster [DBG] pgmap v6886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:26.516568+0000 mgr.smithi067.rdualw (mgr.24569) 7996 : cluster [DBG] pgmap v6887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:18:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:26.516568+0000 mgr.smithi067.rdualw (mgr.24569) 7996 : cluster [DBG] pgmap v6887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:18:29.971 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:28.517039+0000 mgr.smithi067.rdualw (mgr.24569) 7997 : cluster [DBG] pgmap v6888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:28.517039+0000 mgr.smithi067.rdualw (mgr.24569) 7997 : cluster [DBG] pgmap v6888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:31.971 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:30.518168+0000 mgr.smithi067.rdualw (mgr.24569) 7998 : cluster [DBG] pgmap v6889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:30.518168+0000 mgr.smithi067.rdualw (mgr.24569) 7998 : cluster [DBG] pgmap v6889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:33.972 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:32.518762+0000 mgr.smithi067.rdualw (mgr.24569) 7999 : cluster [DBG] pgmap v6890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:32.518762+0000 mgr.smithi067.rdualw (mgr.24569) 7999 : cluster [DBG] pgmap v6890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:35.972 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:34.519396+0000 mgr.smithi067.rdualw (mgr.24569) 8000 : cluster [DBG] pgmap v6891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:34.519396+0000 mgr.smithi067.rdualw (mgr.24569) 8000 : cluster [DBG] pgmap v6891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:36.973 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:18:35.697970+0000 mon.smithi067 (mon.1) 1223 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:18:36.973 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:18:35.698327+0000 mon.smithi061 (mon.0) 1739 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:18:36.973 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:18:35.698334+0000 mon.smithi067 (mon.1) 1224 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:18:36.974 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:18:35.698627+0000 mon.smithi061 (mon.0) 1740 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:18:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:18:35.697970+0000 mon.smithi067 (mon.1) 1223 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:18:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:18:35.698327+0000 mon.smithi061 (mon.0) 1739 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:18:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:18:35.698334+0000 mon.smithi067 (mon.1) 1224 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:18:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:18:35.698627+0000 mon.smithi061 (mon.0) 1740 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:18:37.973 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:36.520421+0000 mgr.smithi067.rdualw (mgr.24569) 8001 : cluster [DBG] pgmap v6892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:18:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:36.520421+0000 mgr.smithi067.rdualw (mgr.24569) 8001 : cluster [DBG] pgmap v6892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:18:39.973 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:38.521160+0000 mgr.smithi067.rdualw (mgr.24569) 8002 : cluster [DBG] pgmap v6893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:38.521160+0000 mgr.smithi067.rdualw (mgr.24569) 8002 : cluster [DBG] pgmap v6893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:41.973 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:40.522004+0000 mgr.smithi067.rdualw (mgr.24569) 8003 : cluster [DBG] pgmap v6894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:40.522004+0000 mgr.smithi067.rdualw (mgr.24569) 8003 : cluster [DBG] pgmap v6894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:43.974 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:42.522659+0000 mgr.smithi067.rdualw (mgr.24569) 8004 : cluster [DBG] pgmap v6895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:42.522659+0000 mgr.smithi067.rdualw (mgr.24569) 8004 : cluster [DBG] pgmap v6895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:45.063 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:18:45.378 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:18:45.379 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 3m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:18:45.379 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 3m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:18:45.380 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 3m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:18:45.380 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 3m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:18:45.380 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 3m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:18:45.380 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 3m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:18:45.381 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 3m ago 3h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:18:45.381 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 3m ago 3h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:18:45.381 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 3m ago 3h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:18:45.381 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 3m ago 3h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:18:45.381 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 3m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:18:45.382 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 3m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:18:45.382 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 3m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:18:45.382 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 3m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:18:45.382 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 3m ago 3h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:18:45.383 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 3m ago 3h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:18:45.383 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 3m ago 3h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:18:45.383 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 3m ago 3h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:18:45.383 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 3m ago 3h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:18:45.384 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 3m ago 3h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:18:45.384 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 3m ago 3h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:18:45.384 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 3m ago 3h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:18:45.384 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 3m ago 3h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:18:45.763 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:18:45.764 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:18:45.764 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:18:45.764 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:18:45.764 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:18:45.764 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:18:45.765 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:18:45.765 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:18:45.765 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:18:45.765 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:18:45.766 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:18:45.766 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:18:45.766 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:18:45.766 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:18:45.767 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:18:45.767 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:18:45.767 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:18:45.767 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:18:45.767 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:18:45.974 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:44.523452+0000 mgr.smithi067.rdualw (mgr.24569) 8005 : cluster [DBG] pgmap v6896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:45.974 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:18:45.049653+0000 mgr.smithi067.rdualw (mgr.24569) 8006 : audit [DBG] from='client.39478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:18:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:44.523452+0000 mgr.smithi067.rdualw (mgr.24569) 8005 : cluster [DBG] pgmap v6896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:18:45.049653+0000 mgr.smithi067.rdualw (mgr.24569) 8006 : audit [DBG] from='client.39478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:18:46.974 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:18:45.361668+0000 mgr.smithi067.rdualw (mgr.24569) 8007 : audit [DBG] from='client.39482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:18:46.975 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:18:45.762194+0000 mon.smithi061 (mon.0) 1741 : audit [DBG] from='client.? 172.21.15.61:0/1847367707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:18:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:18:45.361668+0000 mgr.smithi067.rdualw (mgr.24569) 8007 : audit [DBG] from='client.39482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:18:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:18:45.762194+0000 mon.smithi061 (mon.0) 1741 : audit [DBG] from='client.? 172.21.15.61:0/1847367707' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:18:47.974 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:46.524273+0000 mgr.smithi067.rdualw (mgr.24569) 8008 : cluster [DBG] pgmap v6897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:18:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:46.524273+0000 mgr.smithi067.rdualw (mgr.24569) 8008 : cluster [DBG] pgmap v6897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:18:49.975 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:48.524811+0000 mgr.smithi067.rdualw (mgr.24569) 8009 : cluster [DBG] pgmap v6898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:48.524811+0000 mgr.smithi067.rdualw (mgr.24569) 8009 : cluster [DBG] pgmap v6898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:51.975 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:50.525724+0000 mgr.smithi067.rdualw (mgr.24569) 8010 : cluster [DBG] pgmap v6899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:50.525724+0000 mgr.smithi067.rdualw (mgr.24569) 8010 : cluster [DBG] pgmap v6899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:53.975 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:52.526342+0000 mgr.smithi067.rdualw (mgr.24569) 8011 : cluster [DBG] pgmap v6900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:52.526342+0000 mgr.smithi067.rdualw (mgr.24569) 8011 : cluster [DBG] pgmap v6900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:55.976 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:54.526974+0000 mgr.smithi067.rdualw (mgr.24569) 8012 : cluster [DBG] pgmap v6901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:54.526974+0000 mgr.smithi067.rdualw (mgr.24569) 8012 : cluster [DBG] pgmap v6901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:18:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:56.527997+0000 mgr.smithi067.rdualw (mgr.24569) 8013 : cluster [DBG] pgmap v6902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:18:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:56.527997+0000 mgr.smithi067.rdualw (mgr.24569) 8013 : cluster [DBG] pgmap v6902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:18:59.976 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:18:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:18:58.528527+0000 mgr.smithi067.rdualw (mgr.24569) 8014 : cluster [DBG] pgmap v6903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:18:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:18:58.528527+0000 mgr.smithi067.rdualw (mgr.24569) 8014 : cluster [DBG] pgmap v6903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:01.977 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:00.529564+0000 mgr.smithi067.rdualw (mgr.24569) 8015 : cluster [DBG] pgmap v6904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:00.529564+0000 mgr.smithi067.rdualw (mgr.24569) 8015 : cluster [DBG] pgmap v6904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:03.977 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:02.530100+0000 mgr.smithi067.rdualw (mgr.24569) 8016 : cluster [DBG] pgmap v6905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:02.530100+0000 mgr.smithi067.rdualw (mgr.24569) 8016 : cluster [DBG] pgmap v6905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:05.977 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:04.530819+0000 mgr.smithi067.rdualw (mgr.24569) 8017 : cluster [DBG] pgmap v6906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:04.530819+0000 mgr.smithi067.rdualw (mgr.24569) 8017 : cluster [DBG] pgmap v6906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:06.531656+0000 mgr.smithi067.rdualw (mgr.24569) 8018 : cluster [DBG] pgmap v6907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:19:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:06.531656+0000 mgr.smithi067.rdualw (mgr.24569) 8018 : cluster [DBG] pgmap v6907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:19:09.978 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:08.532307+0000 mgr.smithi067.rdualw (mgr.24569) 8019 : cluster [DBG] pgmap v6908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:08.532307+0000 mgr.smithi067.rdualw (mgr.24569) 8019 : cluster [DBG] pgmap v6908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:11.978 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:10.533205+0000 mgr.smithi067.rdualw (mgr.24569) 8020 : cluster [DBG] pgmap v6909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:10.533205+0000 mgr.smithi067.rdualw (mgr.24569) 8020 : cluster [DBG] pgmap v6909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:13.979 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:12.533720+0000 mgr.smithi067.rdualw (mgr.24569) 8021 : cluster [DBG] pgmap v6910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:12.533720+0000 mgr.smithi067.rdualw (mgr.24569) 8021 : cluster [DBG] pgmap v6910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:15.979 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:14.534301+0000 mgr.smithi067.rdualw (mgr.24569) 8022 : cluster [DBG] pgmap v6911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:15.980 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:19:14.872029+0000 mon.smithi067 (mon.1) 1225 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:19:15.980 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:19:14.873445+0000 mon.smithi067 (mon.1) 1226 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:19:15.980 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:19:14.874374+0000 mon.smithi067 (mon.1) 1227 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:19:15.980 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:19:14.875186+0000 mgr.smithi067.rdualw (mgr.24569) 8023 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:19:15.981 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:19:15.289725+0000 mon.smithi061 (mon.0) 1742 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:19:15.981 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:19:15.297157+0000 mon.smithi061 (mon.0) 1743 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:19:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:14.534301+0000 mgr.smithi067.rdualw (mgr.24569) 8022 : cluster [DBG] pgmap v6911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:19:14.872029+0000 mon.smithi067 (mon.1) 1225 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:19:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:19:14.873445+0000 mon.smithi067 (mon.1) 1226 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:19:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:19:14.874374+0000 mon.smithi067 (mon.1) 1227 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:19:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:19:14.875186+0000 mgr.smithi067.rdualw (mgr.24569) 8023 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:19:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:19:15.289725+0000 mon.smithi061 (mon.0) 1742 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:19:16.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:19:15.297157+0000 mon.smithi061 (mon.0) 1743 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:19:16.104 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:19:16.395 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:19:16.396 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 4m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:19:16.396 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 4m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:19:16.396 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 4m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:19:16.397 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 4m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:19:16.397 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 4m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:19:16.397 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 4m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:19:16.397 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 4m ago 3h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:19:16.398 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 4m ago 3h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:19:16.398 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 4m ago 3h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:19:16.398 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 4m ago 3h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:19:16.398 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 4m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:19:16.399 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 4m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:19:16.399 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 4m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:19:16.399 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 4m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:19:16.399 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 4m ago 3h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:19:16.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 4m ago 3h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:19:16.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 4m ago 3h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:19:16.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 4m ago 3h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:19:16.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 4m ago 3h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:19:16.400 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 4m ago 3h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:19:16.401 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 4m ago 3h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:19:16.401 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 4m ago 3h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:19:16.401 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 4m ago 3h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:19:16.738 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:19:16.738 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:19:16.738 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:19:16.739 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:19:16.739 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:19:16.739 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:19:16.739 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:19:16.739 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:19:16.740 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:19:16.740 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:19:16.740 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:19:16.740 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:19:16.741 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:19:16.741 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:19:16.741 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:19:16.741 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:19:16.742 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:19:16.742 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:19:16.742 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:19:16.979 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:19:16.091850+0000 mgr.smithi067.rdualw (mgr.24569) 8024 : audit [DBG] from='client.39490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:19:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:19:16.091850+0000 mgr.smithi067.rdualw (mgr.24569) 8024 : audit [DBG] from='client.39490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:19:17.979 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:19:16.378377+0000 mgr.smithi067.rdualw (mgr.24569) 8025 : audit [DBG] from='client.39494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:19:17.980 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:16.535182+0000 mgr.smithi067.rdualw (mgr.24569) 8026 : cluster [DBG] pgmap v6912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:19:17.980 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:19:16.736905+0000 mon.smithi061 (mon.0) 1744 : audit [DBG] from='client.? 172.21.15.61:0/1603622607' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:19:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:19:16.378377+0000 mgr.smithi067.rdualw (mgr.24569) 8025 : audit [DBG] from='client.39494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:19:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:16.535182+0000 mgr.smithi067.rdualw (mgr.24569) 8026 : cluster [DBG] pgmap v6912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:19:18.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:19:16.736905+0000 mon.smithi061 (mon.0) 1744 : audit [DBG] from='client.? 172.21.15.61:0/1603622607' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:19:19.980 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:18.535808+0000 mgr.smithi067.rdualw (mgr.24569) 8027 : cluster [DBG] pgmap v6913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:18.535808+0000 mgr.smithi067.rdualw (mgr.24569) 8027 : cluster [DBG] pgmap v6913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:21.980 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:20.536768+0000 mgr.smithi067.rdualw (mgr.24569) 8028 : cluster [DBG] pgmap v6914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:20.536768+0000 mgr.smithi067.rdualw (mgr.24569) 8028 : cluster [DBG] pgmap v6914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:23.981 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:22.537336+0000 mgr.smithi067.rdualw (mgr.24569) 8029 : cluster [DBG] pgmap v6915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:22.537336+0000 mgr.smithi067.rdualw (mgr.24569) 8029 : cluster [DBG] pgmap v6915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:25.981 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:24.537961+0000 mgr.smithi067.rdualw (mgr.24569) 8030 : cluster [DBG] pgmap v6916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:24.537961+0000 mgr.smithi067.rdualw (mgr.24569) 8030 : cluster [DBG] pgmap v6916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:26.538911+0000 mgr.smithi067.rdualw (mgr.24569) 8031 : cluster [DBG] pgmap v6917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:19:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:26.538911+0000 mgr.smithi067.rdualw (mgr.24569) 8031 : cluster [DBG] pgmap v6917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:19:29.981 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:28.539406+0000 mgr.smithi067.rdualw (mgr.24569) 8032 : cluster [DBG] pgmap v6918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:28.539406+0000 mgr.smithi067.rdualw (mgr.24569) 8032 : cluster [DBG] pgmap v6918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:31.982 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:30.540327+0000 mgr.smithi067.rdualw (mgr.24569) 8033 : cluster [DBG] pgmap v6919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:30.540327+0000 mgr.smithi067.rdualw (mgr.24569) 8033 : cluster [DBG] pgmap v6919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:33.982 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:32.540957+0000 mgr.smithi067.rdualw (mgr.24569) 8034 : cluster [DBG] pgmap v6920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:32.540957+0000 mgr.smithi067.rdualw (mgr.24569) 8034 : cluster [DBG] pgmap v6920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:35.982 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:34.541661+0000 mgr.smithi067.rdualw (mgr.24569) 8035 : cluster [DBG] pgmap v6921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:34.541661+0000 mgr.smithi067.rdualw (mgr.24569) 8035 : cluster [DBG] pgmap v6921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:36.982 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:19:35.702942+0000 mon.smithi067 (mon.1) 1228 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:19:36.983 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:19:35.703238+0000 mon.smithi061 (mon.0) 1745 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:19:36.983 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:19:35.703633+0000 mon.smithi067 (mon.1) 1229 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:19:36.983 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:19:35.703773+0000 mon.smithi061 (mon.0) 1746 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:19:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:19:35.702942+0000 mon.smithi067 (mon.1) 1228 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:19:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:19:35.703238+0000 mon.smithi061 (mon.0) 1745 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:19:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:19:35.703633+0000 mon.smithi067 (mon.1) 1229 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:19:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:19:35.703773+0000 mon.smithi061 (mon.0) 1746 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:19:37.983 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:36.542431+0000 mgr.smithi067.rdualw (mgr.24569) 8036 : cluster [DBG] pgmap v6922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:19:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:36.542431+0000 mgr.smithi067.rdualw (mgr.24569) 8036 : cluster [DBG] pgmap v6922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:19:39.983 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:38.542880+0000 mgr.smithi067.rdualw (mgr.24569) 8037 : cluster [DBG] pgmap v6923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:38.542880+0000 mgr.smithi067.rdualw (mgr.24569) 8037 : cluster [DBG] pgmap v6923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:41.983 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:40.543747+0000 mgr.smithi067.rdualw (mgr.24569) 8038 : cluster [DBG] pgmap v6924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:40.543747+0000 mgr.smithi067.rdualw (mgr.24569) 8038 : cluster [DBG] pgmap v6924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:43.984 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:42.544310+0000 mgr.smithi067.rdualw (mgr.24569) 8039 : cluster [DBG] pgmap v6925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:42.544310+0000 mgr.smithi067.rdualw (mgr.24569) 8039 : cluster [DBG] pgmap v6925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:45.984 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:44.545026+0000 mgr.smithi067.rdualw (mgr.24569) 8040 : cluster [DBG] pgmap v6926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:44.545026+0000 mgr.smithi067.rdualw (mgr.24569) 8040 : cluster [DBG] pgmap v6926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:47.049 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:19:47.340 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:19:47.340 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 4m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:19:47.341 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 4m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:19:47.341 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 4m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:19:47.341 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 4m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:19:47.341 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 4m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:19:47.341 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 4m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:19:47.342 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 4m ago 3h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:19:47.342 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 4m ago 3h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:19:47.343 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 4m ago 3h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:19:47.343 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 4m ago 3h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:19:47.344 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 4m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:19:47.344 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 4m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:19:47.345 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 4m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:19:47.345 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 4m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:19:47.345 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 4m ago 3h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:19:47.345 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 4m ago 3h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:19:47.346 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 4m ago 3h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:19:47.346 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 4m ago 3h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:19:47.346 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 4m ago 3h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:19:47.346 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 4m ago 3h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:19:47.347 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 4m ago 3h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:19:47.347 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 4m ago 3h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:19:47.347 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 4m ago 3h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:19:47.681 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:19:47.682 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:19:47.682 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:19:47.682 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:19:47.682 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:19:47.683 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:19:47.683 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:19:47.683 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:19:47.683 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:19:47.683 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:19:47.684 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:19:47.684 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:19:47.684 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:19:47.684 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:19:47.684 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:19:47.685 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:19:47.685 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:19:47.685 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:19:47.685 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:19:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:46.545859+0000 mgr.smithi067.rdualw (mgr.24569) 8041 : cluster [DBG] pgmap v6927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:19:47.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:19:47.035478+0000 mgr.smithi067.rdualw (mgr.24569) 8042 : audit [DBG] from='client.39502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:19:47.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:19:47.323076+0000 mgr.smithi067.rdualw (mgr.24569) 8043 : audit [DBG] from='client.39506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:19:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:46.545859+0000 mgr.smithi067.rdualw (mgr.24569) 8041 : cluster [DBG] pgmap v6927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:19:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:19:47.035478+0000 mgr.smithi067.rdualw (mgr.24569) 8042 : audit [DBG] from='client.39502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:19:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:19:47.323076+0000 mgr.smithi067.rdualw (mgr.24569) 8043 : audit [DBG] from='client.39506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:19:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:19:47.680227+0000 mon.smithi061 (mon.0) 1747 : audit [DBG] from='client.? 172.21.15.61:0/238978866' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:19:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:19:47.680227+0000 mon.smithi061 (mon.0) 1747 : audit [DBG] from='client.? 172.21.15.61:0/238978866' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:19:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:48.546392+0000 mgr.smithi067.rdualw (mgr.24569) 8044 : cluster [DBG] pgmap v6928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:48.546392+0000 mgr.smithi067.rdualw (mgr.24569) 8044 : cluster [DBG] pgmap v6928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:51.985 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:50.547271+0000 mgr.smithi067.rdualw (mgr.24569) 8045 : cluster [DBG] pgmap v6929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:50.547271+0000 mgr.smithi067.rdualw (mgr.24569) 8045 : cluster [DBG] pgmap v6929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:53.985 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:52.547909+0000 mgr.smithi067.rdualw (mgr.24569) 8046 : cluster [DBG] pgmap v6930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:52.547909+0000 mgr.smithi067.rdualw (mgr.24569) 8046 : cluster [DBG] pgmap v6930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:55.986 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:54.548526+0000 mgr.smithi067.rdualw (mgr.24569) 8047 : cluster [DBG] pgmap v6931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:54.548526+0000 mgr.smithi067.rdualw (mgr.24569) 8047 : cluster [DBG] pgmap v6931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:19:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:56.549524+0000 mgr.smithi067.rdualw (mgr.24569) 8048 : cluster [DBG] pgmap v6932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:19:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:56.549524+0000 mgr.smithi067.rdualw (mgr.24569) 8048 : cluster [DBG] pgmap v6932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:19:59.986 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:19:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:19:58.550290+0000 mgr.smithi067.rdualw (mgr.24569) 8049 : cluster [DBG] pgmap v6933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:19:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:19:58.550290+0000 mgr.smithi067.rdualw (mgr.24569) 8049 : cluster [DBG] pgmap v6933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:00.987 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:00.000168+0000 mon.smithi061 (mon.0) 1748 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T19:20:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:00.000168+0000 mon.smithi061 (mon.0) 1748 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T19:20:01.987 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:00.551130+0000 mgr.smithi067.rdualw (mgr.24569) 8050 : cluster [DBG] pgmap v6934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:00.551130+0000 mgr.smithi067.rdualw (mgr.24569) 8050 : cluster [DBG] pgmap v6934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:03.987 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:02.551716+0000 mgr.smithi067.rdualw (mgr.24569) 8051 : cluster [DBG] pgmap v6935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:02.551716+0000 mgr.smithi067.rdualw (mgr.24569) 8051 : cluster [DBG] pgmap v6935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:05.987 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:04.552500+0000 mgr.smithi067.rdualw (mgr.24569) 8052 : cluster [DBG] pgmap v6936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:04.552500+0000 mgr.smithi067.rdualw (mgr.24569) 8052 : cluster [DBG] pgmap v6936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:06.553483+0000 mgr.smithi067.rdualw (mgr.24569) 8053 : cluster [DBG] pgmap v6937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:20:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:06.553483+0000 mgr.smithi067.rdualw (mgr.24569) 8053 : cluster [DBG] pgmap v6937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:20:09.988 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:08.554269+0000 mgr.smithi067.rdualw (mgr.24569) 8054 : cluster [DBG] pgmap v6938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:08.554269+0000 mgr.smithi067.rdualw (mgr.24569) 8054 : cluster [DBG] pgmap v6938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:11.988 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:10.555236+0000 mgr.smithi067.rdualw (mgr.24569) 8055 : cluster [DBG] pgmap v6939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:10.555236+0000 mgr.smithi067.rdualw (mgr.24569) 8055 : cluster [DBG] pgmap v6939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:13.988 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:12.555830+0000 mgr.smithi067.rdualw (mgr.24569) 8056 : cluster [DBG] pgmap v6940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:12.555830+0000 mgr.smithi067.rdualw (mgr.24569) 8056 : cluster [DBG] pgmap v6940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:14.556660+0000 mgr.smithi067.rdualw (mgr.24569) 8057 : cluster [DBG] pgmap v6941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:20:15.300678+0000 mon.smithi067 (mon.1) 1230 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:20:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:20:15.302124+0000 mon.smithi067 (mon.1) 1231 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:20:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:20:15.303099+0000 mon.smithi067 (mon.1) 1232 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:20:15.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:20:15.303975+0000 mgr.smithi067.rdualw (mgr.24569) 8058 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:20:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:14.556660+0000 mgr.smithi067.rdualw (mgr.24569) 8057 : cluster [DBG] pgmap v6941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:20:15.300678+0000 mon.smithi067 (mon.1) 1230 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:20:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:20:15.302124+0000 mon.smithi067 (mon.1) 1231 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:20:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:20:15.303099+0000 mon.smithi067 (mon.1) 1232 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:20:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:20:15.303975+0000 mgr.smithi067.rdualw (mgr.24569) 8058 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:20:16.989 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:20:15.725021+0000 mon.smithi061 (mon.0) 1749 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:20:16.989 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:20:15.730449+0000 mon.smithi061 (mon.0) 1750 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:20:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:20:15.725021+0000 mon.smithi061 (mon.0) 1749 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:20:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:20:15.730449+0000 mon.smithi061 (mon.0) 1750 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:20:17.988 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:20:17.989 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:16.557465+0000 mgr.smithi067.rdualw (mgr.24569) 8059 : cluster [DBG] pgmap v6942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:20:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:16.557465+0000 mgr.smithi067.rdualw (mgr.24569) 8059 : cluster [DBG] pgmap v6942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:20:18.283 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:20:18.284 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 5m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:20:18.284 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 5m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:20:18.285 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 5m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:20:18.285 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 5m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:20:18.285 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 5m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:20:18.286 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 5m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:20:18.286 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 5m ago 4h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:20:18.287 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 5m ago 3h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:20:18.287 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 5m ago 4h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:20:18.287 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 5m ago 3h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:20:18.288 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 5m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:20:18.288 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 5m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:20:18.289 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 5m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:20:18.289 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 5m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:20:18.290 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 5m ago 3h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:20:18.290 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 5m ago 3h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:20:18.291 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 5m ago 3h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:20:18.291 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 5m ago 3h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:20:18.292 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 5m ago 3h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:20:18.292 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 5m ago 3h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:20:18.293 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 5m ago 3h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:20:18.293 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 5m ago 3h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:20:18.294 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 5m ago 3h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:20:18.622 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:20:18.623 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:20:18.623 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:20:18.623 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:20:18.623 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:20:18.624 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:20:18.624 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:20:18.624 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:20:18.624 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:20:18.625 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:20:18.625 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:20:18.625 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:20:18.625 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:20:18.626 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:20:18.626 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:20:18.626 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:20:18.626 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:20:18.627 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:20:18.627 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:20:18.989 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:20:17.975247+0000 mgr.smithi067.rdualw (mgr.24569) 8060 : audit [DBG] from='client.39514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:20:18.990 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:20:18.266188+0000 mgr.smithi067.rdualw (mgr.24569) 8061 : audit [DBG] from='client.39518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:20:18.990 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:20:18.621159+0000 mon.smithi061 (mon.0) 1751 : audit [DBG] from='client.? 172.21.15.61:0/3333662869' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:20:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:20:17.975247+0000 mgr.smithi067.rdualw (mgr.24569) 8060 : audit [DBG] from='client.39514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:20:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:20:18.266188+0000 mgr.smithi067.rdualw (mgr.24569) 8061 : audit [DBG] from='client.39518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:20:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:20:18.621159+0000 mon.smithi061 (mon.0) 1751 : audit [DBG] from='client.? 172.21.15.61:0/3333662869' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:20:19.989 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:18.558105+0000 mgr.smithi067.rdualw (mgr.24569) 8062 : cluster [DBG] pgmap v6943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:18.558105+0000 mgr.smithi067.rdualw (mgr.24569) 8062 : cluster [DBG] pgmap v6943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:21.990 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:20.559124+0000 mgr.smithi067.rdualw (mgr.24569) 8063 : cluster [DBG] pgmap v6944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:20.559124+0000 mgr.smithi067.rdualw (mgr.24569) 8063 : cluster [DBG] pgmap v6944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:23.990 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:22.559756+0000 mgr.smithi067.rdualw (mgr.24569) 8064 : cluster [DBG] pgmap v6945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:22.559756+0000 mgr.smithi067.rdualw (mgr.24569) 8064 : cluster [DBG] pgmap v6945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:24.560393+0000 mgr.smithi067.rdualw (mgr.24569) 8065 : cluster [DBG] pgmap v6946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:24.560393+0000 mgr.smithi067.rdualw (mgr.24569) 8065 : cluster [DBG] pgmap v6946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:26.561239+0000 mgr.smithi067.rdualw (mgr.24569) 8066 : cluster [DBG] pgmap v6947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:20:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:26.561239+0000 mgr.smithi067.rdualw (mgr.24569) 8066 : cluster [DBG] pgmap v6947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:20:29.991 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:28.561804+0000 mgr.smithi067.rdualw (mgr.24569) 8067 : cluster [DBG] pgmap v6948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:28.561804+0000 mgr.smithi067.rdualw (mgr.24569) 8067 : cluster [DBG] pgmap v6948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:31.992 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:30.562729+0000 mgr.smithi067.rdualw (mgr.24569) 8068 : cluster [DBG] pgmap v6949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:30.562729+0000 mgr.smithi067.rdualw (mgr.24569) 8068 : cluster [DBG] pgmap v6949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:33.992 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:32.563505+0000 mgr.smithi067.rdualw (mgr.24569) 8069 : cluster [DBG] pgmap v6950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:32.563505+0000 mgr.smithi067.rdualw (mgr.24569) 8069 : cluster [DBG] pgmap v6950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:35.992 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:34.564256+0000 mgr.smithi067.rdualw (mgr.24569) 8070 : cluster [DBG] pgmap v6951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:34.564256+0000 mgr.smithi067.rdualw (mgr.24569) 8070 : cluster [DBG] pgmap v6951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:36.993 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:20:35.709967+0000 mon.smithi067 (mon.1) 1233 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:20:36.993 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:20:35.710218+0000 mon.smithi061 (mon.0) 1752 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:20:36.993 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:20:35.710235+0000 mon.smithi067 (mon.1) 1234 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:20:36.994 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:20:35.710518+0000 mon.smithi061 (mon.0) 1753 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:20:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:20:35.709967+0000 mon.smithi067 (mon.1) 1233 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:20:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:20:35.710218+0000 mon.smithi061 (mon.0) 1752 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:20:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:20:35.710235+0000 mon.smithi067 (mon.1) 1234 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:20:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:20:35.710518+0000 mon.smithi061 (mon.0) 1753 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:20:37.993 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:36.565211+0000 mgr.smithi067.rdualw (mgr.24569) 8071 : cluster [DBG] pgmap v6952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:20:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:36.565211+0000 mgr.smithi067.rdualw (mgr.24569) 8071 : cluster [DBG] pgmap v6952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:20:39.993 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:38.565886+0000 mgr.smithi067.rdualw (mgr.24569) 8072 : cluster [DBG] pgmap v6953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:38.565886+0000 mgr.smithi067.rdualw (mgr.24569) 8072 : cluster [DBG] pgmap v6953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:41.993 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:40.566692+0000 mgr.smithi067.rdualw (mgr.24569) 8073 : cluster [DBG] pgmap v6954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:40.566692+0000 mgr.smithi067.rdualw (mgr.24569) 8073 : cluster [DBG] pgmap v6954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:43.994 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:42.567227+0000 mgr.smithi067.rdualw (mgr.24569) 8074 : cluster [DBG] pgmap v6955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:42.567227+0000 mgr.smithi067.rdualw (mgr.24569) 8074 : cluster [DBG] pgmap v6955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:45.994 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:44.567868+0000 mgr.smithi067.rdualw (mgr.24569) 8075 : cluster [DBG] pgmap v6956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:44.567868+0000 mgr.smithi067.rdualw (mgr.24569) 8075 : cluster [DBG] pgmap v6956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:46.568732+0000 mgr.smithi067.rdualw (mgr.24569) 8076 : cluster [DBG] pgmap v6957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:20:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:46.568732+0000 mgr.smithi067.rdualw (mgr.24569) 8076 : cluster [DBG] pgmap v6957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:20:48.979 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:20:49.270 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:20:49.271 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 5m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:20:49.271 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 5m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:20:49.271 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 5m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:20:49.271 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 5m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:20:49.272 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 5m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:20:49.272 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 5m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:20:49.272 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 5m ago 4h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:20:49.272 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 5m ago 3h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:20:49.273 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 5m ago 4h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:20:49.273 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 5m ago 3h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:20:49.273 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 5m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:20:49.273 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 5m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:20:49.274 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 5m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:20:49.274 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 5m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:20:49.274 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 5m ago 3h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:20:49.274 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 5m ago 3h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:20:49.275 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 5m ago 3h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:20:49.275 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 5m ago 3h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:20:49.275 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 5m ago 3h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:20:49.275 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 5m ago 3h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:20:49.276 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 5m ago 3h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:20:49.276 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 5m ago 3h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:20:49.276 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 5m ago 3h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:20:49.614 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:20:49.615 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:20:49.615 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:20:49.615 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:20:49.616 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:20:49.616 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:20:49.616 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:20:49.616 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:20:49.616 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:20:49.617 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:20:49.617 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:20:49.617 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:20:49.617 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:20:49.618 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:20:49.618 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:20:49.618 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:20:49.618 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:20:49.619 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:20:49.619 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:20:49.995 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:48.569379+0000 mgr.smithi067.rdualw (mgr.24569) 8077 : cluster [DBG] pgmap v6958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:49.995 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:20:48.966822+0000 mgr.smithi067.rdualw (mgr.24569) 8078 : audit [DBG] from='client.39526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:20:49.995 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:20:49.252754+0000 mgr.smithi067.rdualw (mgr.24569) 8079 : audit [DBG] from='client.39530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:20:49.996 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:20:49.613422+0000 mon.smithi061 (mon.0) 1754 : audit [DBG] from='client.? 172.21.15.61:0/3815462647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:20:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:48.569379+0000 mgr.smithi067.rdualw (mgr.24569) 8077 : cluster [DBG] pgmap v6958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:50.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:20:48.966822+0000 mgr.smithi067.rdualw (mgr.24569) 8078 : audit [DBG] from='client.39526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:20:50.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:20:49.252754+0000 mgr.smithi067.rdualw (mgr.24569) 8079 : audit [DBG] from='client.39530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:20:50.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:20:49.613422+0000 mon.smithi061 (mon.0) 1754 : audit [DBG] from='client.? 172.21.15.61:0/3815462647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:20:51.995 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:50.570362+0000 mgr.smithi067.rdualw (mgr.24569) 8080 : cluster [DBG] pgmap v6959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:50.570362+0000 mgr.smithi067.rdualw (mgr.24569) 8080 : cluster [DBG] pgmap v6959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:53.995 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:52.570951+0000 mgr.smithi067.rdualw (mgr.24569) 8081 : cluster [DBG] pgmap v6960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:52.570951+0000 mgr.smithi067.rdualw (mgr.24569) 8081 : cluster [DBG] pgmap v6960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:55.995 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:54.571651+0000 mgr.smithi067.rdualw (mgr.24569) 8082 : cluster [DBG] pgmap v6961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:54.571651+0000 mgr.smithi067.rdualw (mgr.24569) 8082 : cluster [DBG] pgmap v6961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:20:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:56.572517+0000 mgr.smithi067.rdualw (mgr.24569) 8083 : cluster [DBG] pgmap v6962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:20:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:56.572517+0000 mgr.smithi067.rdualw (mgr.24569) 8083 : cluster [DBG] pgmap v6962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:20:59.996 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:20:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:20:58.573007+0000 mgr.smithi067.rdualw (mgr.24569) 8084 : cluster [DBG] pgmap v6963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:20:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:20:58.573007+0000 mgr.smithi067.rdualw (mgr.24569) 8084 : cluster [DBG] pgmap v6963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:01.996 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:00.574000+0000 mgr.smithi067.rdualw (mgr.24569) 8085 : cluster [DBG] pgmap v6964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:00.574000+0000 mgr.smithi067.rdualw (mgr.24569) 8085 : cluster [DBG] pgmap v6964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:03.997 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:02.574642+0000 mgr.smithi067.rdualw (mgr.24569) 8086 : cluster [DBG] pgmap v6965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:02.574642+0000 mgr.smithi067.rdualw (mgr.24569) 8086 : cluster [DBG] pgmap v6965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:05.997 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:04.575297+0000 mgr.smithi067.rdualw (mgr.24569) 8087 : cluster [DBG] pgmap v6966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:04.575297+0000 mgr.smithi067.rdualw (mgr.24569) 8087 : cluster [DBG] pgmap v6966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:06.576194+0000 mgr.smithi067.rdualw (mgr.24569) 8088 : cluster [DBG] pgmap v6967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:21:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:06.576194+0000 mgr.smithi067.rdualw (mgr.24569) 8088 : cluster [DBG] pgmap v6967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:21:09.998 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:08.576775+0000 mgr.smithi067.rdualw (mgr.24569) 8089 : cluster [DBG] pgmap v6968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:08.576775+0000 mgr.smithi067.rdualw (mgr.24569) 8089 : cluster [DBG] pgmap v6968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:11.998 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:10.577781+0000 mgr.smithi067.rdualw (mgr.24569) 8090 : cluster [DBG] pgmap v6969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:10.577781+0000 mgr.smithi067.rdualw (mgr.24569) 8090 : cluster [DBG] pgmap v6969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:13.998 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:12.578510+0000 mgr.smithi067.rdualw (mgr.24569) 8091 : cluster [DBG] pgmap v6970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:12.578510+0000 mgr.smithi067.rdualw (mgr.24569) 8091 : cluster [DBG] pgmap v6970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:15.999 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:14.579284+0000 mgr.smithi067.rdualw (mgr.24569) 8092 : cluster [DBG] pgmap v6971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:14.579284+0000 mgr.smithi067.rdualw (mgr.24569) 8092 : cluster [DBG] pgmap v6971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:16.999 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:21:15.733883+0000 mon.smithi067 (mon.1) 1235 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:21:17.000 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:21:15.735316+0000 mon.smithi067 (mon.1) 1236 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:21:17.000 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:21:15.736320+0000 mon.smithi067 (mon.1) 1237 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:21:17.000 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:21:15.737165+0000 mgr.smithi067.rdualw (mgr.24569) 8093 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:21:17.001 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:21:16.159216+0000 mon.smithi061 (mon.0) 1755 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:21:17.001 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:21:16.166704+0000 mon.smithi061 (mon.0) 1756 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:21:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:21:15.733883+0000 mon.smithi067 (mon.1) 1235 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:21:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:21:15.735316+0000 mon.smithi067 (mon.1) 1236 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:21:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:21:15.736320+0000 mon.smithi067 (mon.1) 1237 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:21:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:21:15.737165+0000 mgr.smithi067.rdualw (mgr.24569) 8093 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:21:17.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:21:16.159216+0000 mon.smithi061 (mon.0) 1755 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:21:17.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:21:16.166704+0000 mon.smithi061 (mon.0) 1756 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:21:17.999 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:16.579995+0000 mgr.smithi067.rdualw (mgr.24569) 8094 : cluster [DBG] pgmap v6972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:21:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:16.579995+0000 mgr.smithi067.rdualw (mgr.24569) 8094 : cluster [DBG] pgmap v6972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:21:19.925 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:21:20.000 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:18.580639+0000 mgr.smithi067.rdualw (mgr.24569) 8095 : cluster [DBG] pgmap v6973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:18.580639+0000 mgr.smithi067.rdualw (mgr.24569) 8095 : cluster [DBG] pgmap v6973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:20.216 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:21:20.216 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 6m ago 3h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:21:20.216 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 6m ago 3h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:21:20.217 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 6m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:21:20.217 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 6m ago 3h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:21:20.217 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 6m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:21:20.217 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 6m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:21:20.218 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 6m ago 4h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:21:20.218 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 6m ago 3h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:21:20.218 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 6m ago 4h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:21:20.218 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 6m ago 3h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:21:20.218 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 6m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:21:20.219 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 6m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:21:20.219 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (3h) 6m ago 3h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:21:20.219 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 6m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:21:20.219 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 6m ago 3h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:21:20.220 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 6m ago 3h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:21:20.220 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 6m ago 3h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:21:20.220 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 6m ago 3h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:21:20.220 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 6m ago 3h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:21:20.220 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 6m ago 3h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:21:20.221 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 6m ago 3h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:21:20.221 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 6m ago 3h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:21:20.221 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 6m ago 3h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:21:20.559 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:21:20.560 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:21:20.560 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:21:20.560 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:21:20.560 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:21:20.561 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:21:20.561 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:21:20.561 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:21:20.561 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:21:20.561 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:21:20.562 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:21:20.562 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:21:20.562 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:21:20.562 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:21:20.563 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:21:20.563 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:21:20.563 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:21:20.563 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:21:20.563 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:21:21.000 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:21:19.911797+0000 mgr.smithi067.rdualw (mgr.24569) 8096 : audit [DBG] from='client.39538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:21:21.000 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:21:20.198115+0000 mgr.smithi067.rdualw (mgr.24569) 8097 : audit [DBG] from='client.39542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:21:21.000 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:21:20.558396+0000 mon.smithi061 (mon.0) 1757 : audit [DBG] from='client.? 172.21.15.61:0/3284283756' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:21:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:21:19.911797+0000 mgr.smithi067.rdualw (mgr.24569) 8096 : audit [DBG] from='client.39538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:21:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:21:20.198115+0000 mgr.smithi067.rdualw (mgr.24569) 8097 : audit [DBG] from='client.39542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:21:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:21:20.558396+0000 mon.smithi061 (mon.0) 1757 : audit [DBG] from='client.? 172.21.15.61:0/3284283756' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:21:22.000 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:20.581625+0000 mgr.smithi067.rdualw (mgr.24569) 8098 : cluster [DBG] pgmap v6974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:20.581625+0000 mgr.smithi067.rdualw (mgr.24569) 8098 : cluster [DBG] pgmap v6974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:24.000 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:22.582229+0000 mgr.smithi067.rdualw (mgr.24569) 8099 : cluster [DBG] pgmap v6975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:22.582229+0000 mgr.smithi067.rdualw (mgr.24569) 8099 : cluster [DBG] pgmap v6975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:26.001 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:24.583047+0000 mgr.smithi067.rdualw (mgr.24569) 8100 : cluster [DBG] pgmap v6976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:24.583047+0000 mgr.smithi067.rdualw (mgr.24569) 8100 : cluster [DBG] pgmap v6976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:26.583991+0000 mgr.smithi067.rdualw (mgr.24569) 8101 : cluster [DBG] pgmap v6977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:21:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:26.583991+0000 mgr.smithi067.rdualw (mgr.24569) 8101 : cluster [DBG] pgmap v6977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:21:30.002 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:28.584531+0000 mgr.smithi067.rdualw (mgr.24569) 8102 : cluster [DBG] pgmap v6978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:28.584531+0000 mgr.smithi067.rdualw (mgr.24569) 8102 : cluster [DBG] pgmap v6978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:32.002 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:30.585582+0000 mgr.smithi067.rdualw (mgr.24569) 8103 : cluster [DBG] pgmap v6979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:30.585582+0000 mgr.smithi067.rdualw (mgr.24569) 8103 : cluster [DBG] pgmap v6979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:34.002 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:32.586171+0000 mgr.smithi067.rdualw (mgr.24569) 8104 : cluster [DBG] pgmap v6980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:32.586171+0000 mgr.smithi067.rdualw (mgr.24569) 8104 : cluster [DBG] pgmap v6980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:36.003 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:34.586938+0000 mgr.smithi067.rdualw (mgr.24569) 8105 : cluster [DBG] pgmap v6981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:34.586938+0000 mgr.smithi067.rdualw (mgr.24569) 8105 : cluster [DBG] pgmap v6981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:37.003 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:21:35.714981+0000 mon.smithi067 (mon.1) 1238 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:21:37.003 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:21:35.715203+0000 mon.smithi061 (mon.0) 1758 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:21:37.003 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:21:35.715296+0000 mon.smithi067 (mon.1) 1239 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:21:37.004 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:21:35.715530+0000 mon.smithi061 (mon.0) 1759 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:21:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:21:35.714981+0000 mon.smithi067 (mon.1) 1238 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:21:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:21:35.715203+0000 mon.smithi061 (mon.0) 1758 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:21:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:21:35.715296+0000 mon.smithi067 (mon.1) 1239 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:21:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:21:35.715530+0000 mon.smithi061 (mon.0) 1759 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:21:38.003 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:36.587991+0000 mgr.smithi067.rdualw (mgr.24569) 8106 : cluster [DBG] pgmap v6982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:21:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:36.587991+0000 mgr.smithi067.rdualw (mgr.24569) 8106 : cluster [DBG] pgmap v6982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:21:40.003 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:38.588581+0000 mgr.smithi067.rdualw (mgr.24569) 8107 : cluster [DBG] pgmap v6983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:38.588581+0000 mgr.smithi067.rdualw (mgr.24569) 8107 : cluster [DBG] pgmap v6983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:42.004 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:40.589612+0000 mgr.smithi067.rdualw (mgr.24569) 8108 : cluster [DBG] pgmap v6984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:40.589612+0000 mgr.smithi067.rdualw (mgr.24569) 8108 : cluster [DBG] pgmap v6984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:44.004 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:42.590291+0000 mgr.smithi067.rdualw (mgr.24569) 8109 : cluster [DBG] pgmap v6985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:42.590291+0000 mgr.smithi067.rdualw (mgr.24569) 8109 : cluster [DBG] pgmap v6985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:46.004 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:44.591069+0000 mgr.smithi067.rdualw (mgr.24569) 8110 : cluster [DBG] pgmap v6986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:44.591069+0000 mgr.smithi067.rdualw (mgr.24569) 8110 : cluster [DBG] pgmap v6986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:46.591950+0000 mgr.smithi067.rdualw (mgr.24569) 8111 : cluster [DBG] pgmap v6987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:21:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:46.591950+0000 mgr.smithi067.rdualw (mgr.24569) 8111 : cluster [DBG] pgmap v6987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:21:50.005 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:48.592526+0000 mgr.smithi067.rdualw (mgr.24569) 8112 : cluster [DBG] pgmap v6988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:48.592526+0000 mgr.smithi067.rdualw (mgr.24569) 8112 : cluster [DBG] pgmap v6988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:50.880 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:21:51.223 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:21:51.224 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 6m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:21:51.225 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 6m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:21:51.225 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 6m ago 3h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:21:51.225 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 6m ago 4h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:21:51.225 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 6m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:21:51.225 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 6m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:21:51.226 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 6m ago 4h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:21:51.226 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 6m ago 3h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:21:51.226 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 6m ago 4h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:21:51.226 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 6m ago 3h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:21:51.227 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 6m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:21:51.227 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 6m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:21:51.227 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 6m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:21:51.227 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (3h) 6m ago 3h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:21:51.227 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 6m ago 3h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:21:51.228 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 6m ago 3h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:21:51.228 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 6m ago 3h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:21:51.228 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 6m ago 3h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:21:51.228 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 6m ago 3h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:21:51.228 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 6m ago 3h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:21:51.229 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 6m ago 3h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:21:51.229 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 6m ago 3h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:21:51.229 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 6m ago 4h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:21:51.617 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:21:51.617 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:21:51.617 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:21:51.618 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:21:51.618 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:21:51.618 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:21:51.618 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:21:51.619 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:21:51.619 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:21:51.619 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:21:51.619 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:21:51.620 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:21:51.620 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:21:51.620 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:21:51.621 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:21:51.621 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:21:51.621 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:21:51.621 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:21:51.621 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:21:52.005 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:50.593641+0000 mgr.smithi067.rdualw (mgr.24569) 8113 : cluster [DBG] pgmap v6989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:52.006 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:21:50.864998+0000 mgr.smithi067.rdualw (mgr.24569) 8114 : audit [DBG] from='client.39550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:21:52.006 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:21:51.206820+0000 mgr.smithi067.rdualw (mgr.24569) 8115 : audit [DBG] from='client.39554 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:21:52.006 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:21:51.615968+0000 mon.smithi061 (mon.0) 1760 : audit [DBG] from='client.? 172.21.15.61:0/4188615142' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:21:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:50.593641+0000 mgr.smithi067.rdualw (mgr.24569) 8113 : cluster [DBG] pgmap v6989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:52.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:21:50.864998+0000 mgr.smithi067.rdualw (mgr.24569) 8114 : audit [DBG] from='client.39550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:21:52.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:21:51.206820+0000 mgr.smithi067.rdualw (mgr.24569) 8115 : audit [DBG] from='client.39554 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:21:52.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:21:51.615968+0000 mon.smithi061 (mon.0) 1760 : audit [DBG] from='client.? 172.21.15.61:0/4188615142' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:21:54.006 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:52.594318+0000 mgr.smithi067.rdualw (mgr.24569) 8116 : cluster [DBG] pgmap v6990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:52.594318+0000 mgr.smithi067.rdualw (mgr.24569) 8116 : cluster [DBG] pgmap v6990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:56.006 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:54.595068+0000 mgr.smithi067.rdualw (mgr.24569) 8117 : cluster [DBG] pgmap v6991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:54.595068+0000 mgr.smithi067.rdualw (mgr.24569) 8117 : cluster [DBG] pgmap v6991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:21:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:56.596152+0000 mgr.smithi067.rdualw (mgr.24569) 8118 : cluster [DBG] pgmap v6992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:21:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:56.596152+0000 mgr.smithi067.rdualw (mgr.24569) 8118 : cluster [DBG] pgmap v6992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:22:00.007 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:21:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:21:58.596723+0000 mgr.smithi067.rdualw (mgr.24569) 8119 : cluster [DBG] pgmap v6993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:21:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:21:58.596723+0000 mgr.smithi067.rdualw (mgr.24569) 8119 : cluster [DBG] pgmap v6993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:02.007 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:00.597549+0000 mgr.smithi067.rdualw (mgr.24569) 8120 : cluster [DBG] pgmap v6994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:00.597549+0000 mgr.smithi067.rdualw (mgr.24569) 8120 : cluster [DBG] pgmap v6994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:04.007 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:02.598250+0000 mgr.smithi067.rdualw (mgr.24569) 8121 : cluster [DBG] pgmap v6995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:02.598250+0000 mgr.smithi067.rdualw (mgr.24569) 8121 : cluster [DBG] pgmap v6995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:06.007 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:04.598953+0000 mgr.smithi067.rdualw (mgr.24569) 8122 : cluster [DBG] pgmap v6996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:04.598953+0000 mgr.smithi067.rdualw (mgr.24569) 8122 : cluster [DBG] pgmap v6996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:06.599777+0000 mgr.smithi067.rdualw (mgr.24569) 8123 : cluster [DBG] pgmap v6997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:22:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:06.599777+0000 mgr.smithi067.rdualw (mgr.24569) 8123 : cluster [DBG] pgmap v6997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:22:10.008 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:08.600277+0000 mgr.smithi067.rdualw (mgr.24569) 8124 : cluster [DBG] pgmap v6998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:08.600277+0000 mgr.smithi067.rdualw (mgr.24569) 8124 : cluster [DBG] pgmap v6998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:12.008 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:10.601101+0000 mgr.smithi067.rdualw (mgr.24569) 8125 : cluster [DBG] pgmap v6999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:10.601101+0000 mgr.smithi067.rdualw (mgr.24569) 8125 : cluster [DBG] pgmap v6999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:14.009 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:12.601683+0000 mgr.smithi067.rdualw (mgr.24569) 8126 : cluster [DBG] pgmap v7000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:12.601683+0000 mgr.smithi067.rdualw (mgr.24569) 8126 : cluster [DBG] pgmap v7000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:16.009 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:14.602275+0000 mgr.smithi067.rdualw (mgr.24569) 8127 : cluster [DBG] pgmap v7001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:14.602275+0000 mgr.smithi067.rdualw (mgr.24569) 8127 : cluster [DBG] pgmap v7001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:17.009 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:22:16.170147+0000 mon.smithi067 (mon.1) 1240 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:22:17.010 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:22:16.171656+0000 mon.smithi067 (mon.1) 1241 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:22:17.010 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:22:16.172595+0000 mon.smithi067 (mon.1) 1242 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:22:17.010 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:22:16.173422+0000 mgr.smithi067.rdualw (mgr.24569) 8128 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:22:17.011 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:22:16.588139+0000 mon.smithi061 (mon.0) 1761 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:22:17.011 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:22:16.593558+0000 mon.smithi061 (mon.0) 1762 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:22:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:22:16.170147+0000 mon.smithi067 (mon.1) 1240 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:22:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:22:16.171656+0000 mon.smithi067 (mon.1) 1241 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:22:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:22:16.172595+0000 mon.smithi067 (mon.1) 1242 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:22:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:22:16.173422+0000 mgr.smithi067.rdualw (mgr.24569) 8128 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:22:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:22:16.588139+0000 mon.smithi061 (mon.0) 1761 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:22:17.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:22:16.593558+0000 mon.smithi061 (mon.0) 1762 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:22:18.009 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:16.603084+0000 mgr.smithi067.rdualw (mgr.24569) 8129 : cluster [DBG] pgmap v7002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:22:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:16.603084+0000 mgr.smithi067.rdualw (mgr.24569) 8129 : cluster [DBG] pgmap v7002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:22:20.010 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:18.603707+0000 mgr.smithi067.rdualw (mgr.24569) 8130 : cluster [DBG] pgmap v7003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:18.603707+0000 mgr.smithi067.rdualw (mgr.24569) 8130 : cluster [DBG] pgmap v7003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:21.929 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:22:22.010 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:20.604674+0000 mgr.smithi067.rdualw (mgr.24569) 8131 : cluster [DBG] pgmap v7004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:20.604674+0000 mgr.smithi067.rdualw (mgr.24569) 8131 : cluster [DBG] pgmap v7004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:22.221 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:22:22.221 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (3h) 7m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:22:22.221 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 7m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:22:22.222 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 7m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:22:22.222 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (3h) 7m ago 4h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:22:22.222 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 7m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:22:22.222 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 7m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:22:22.223 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 7m ago 4h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:22:22.223 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 7m ago 4h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:22:22.223 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 7m ago 4h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:22:22.223 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 7m ago 4h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:22:22.224 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 7m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:22:22.224 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 7m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:22:22.224 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 7m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:22:22.224 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 7m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:22:22.224 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 7m ago 3h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:22:22.225 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (3h) 7m ago 3h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:22:22.225 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 7m ago 3h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:22:22.225 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 7m ago 3h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:22:22.226 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 7m ago 3h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:22:22.226 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 7m ago 3h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:22:22.226 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 7m ago 3h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:22:22.226 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 7m ago 3h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:22:22.227 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (3h) 7m ago 4h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:22:22.562 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:22:22.563 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:22:22.563 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:22:22.563 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:22:22.564 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:22:22.564 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:22:22.564 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:22:22.564 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:22:22.565 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:22:22.565 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:22:22.565 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:22:22.565 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:22:22.565 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:22:22.566 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:22:22.566 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:22:22.566 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:22:22.566 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:22:22.567 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:22:22.567 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:22:23.010 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:22:21.916429+0000 mgr.smithi067.rdualw (mgr.24569) 8132 : audit [DBG] from='client.39562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:22:23.011 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:22:22.204005+0000 mgr.smithi067.rdualw (mgr.24569) 8133 : audit [DBG] from='client.39566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:22:23.011 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:22:22.561211+0000 mon.smithi061 (mon.0) 1763 : audit [DBG] from='client.? 172.21.15.61:0/3462409184' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:22:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:22:21.916429+0000 mgr.smithi067.rdualw (mgr.24569) 8132 : audit [DBG] from='client.39562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:22:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:22:22.204005+0000 mgr.smithi067.rdualw (mgr.24569) 8133 : audit [DBG] from='client.39566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:22:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:22:22.561211+0000 mon.smithi061 (mon.0) 1763 : audit [DBG] from='client.? 172.21.15.61:0/3462409184' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:22:24.010 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:22.605201+0000 mgr.smithi067.rdualw (mgr.24569) 8134 : cluster [DBG] pgmap v7005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:22.605201+0000 mgr.smithi067.rdualw (mgr.24569) 8134 : cluster [DBG] pgmap v7005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:26.011 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:24.605825+0000 mgr.smithi067.rdualw (mgr.24569) 8135 : cluster [DBG] pgmap v7006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:24.605825+0000 mgr.smithi067.rdualw (mgr.24569) 8135 : cluster [DBG] pgmap v7006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:26.606834+0000 mgr.smithi067.rdualw (mgr.24569) 8136 : cluster [DBG] pgmap v7007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:22:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:26.606834+0000 mgr.smithi067.rdualw (mgr.24569) 8136 : cluster [DBG] pgmap v7007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:22:30.011 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:28.607302+0000 mgr.smithi067.rdualw (mgr.24569) 8137 : cluster [DBG] pgmap v7008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:28.607302+0000 mgr.smithi067.rdualw (mgr.24569) 8137 : cluster [DBG] pgmap v7008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:32.012 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:30.608144+0000 mgr.smithi067.rdualw (mgr.24569) 8138 : cluster [DBG] pgmap v7009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:30.608144+0000 mgr.smithi067.rdualw (mgr.24569) 8138 : cluster [DBG] pgmap v7009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:34.012 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:32.608722+0000 mgr.smithi067.rdualw (mgr.24569) 8139 : cluster [DBG] pgmap v7010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:32.608722+0000 mgr.smithi067.rdualw (mgr.24569) 8139 : cluster [DBG] pgmap v7010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:36.012 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:34.609515+0000 mgr.smithi067.rdualw (mgr.24569) 8140 : cluster [DBG] pgmap v7011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:34.609515+0000 mgr.smithi067.rdualw (mgr.24569) 8140 : cluster [DBG] pgmap v7011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:37.012 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:22:35.719939+0000 mon.smithi067 (mon.1) 1243 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:22:37.013 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:22:35.720271+0000 mon.smithi061 (mon.0) 1764 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:22:37.013 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:22:35.720971+0000 mon.smithi067 (mon.1) 1244 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:22:37.013 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:22:35.721135+0000 mon.smithi061 (mon.0) 1765 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:22:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:22:35.719939+0000 mon.smithi067 (mon.1) 1243 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:22:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:22:35.720271+0000 mon.smithi061 (mon.0) 1764 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:22:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:22:35.720971+0000 mon.smithi067 (mon.1) 1244 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:22:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:22:35.721135+0000 mon.smithi061 (mon.0) 1765 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:22:38.013 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:36.610530+0000 mgr.smithi067.rdualw (mgr.24569) 8141 : cluster [DBG] pgmap v7012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:22:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:36.610530+0000 mgr.smithi067.rdualw (mgr.24569) 8141 : cluster [DBG] pgmap v7012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:22:40.013 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:38.611225+0000 mgr.smithi067.rdualw (mgr.24569) 8142 : cluster [DBG] pgmap v7013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:38.611225+0000 mgr.smithi067.rdualw (mgr.24569) 8142 : cluster [DBG] pgmap v7013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:42.013 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:40.612149+0000 mgr.smithi067.rdualw (mgr.24569) 8143 : cluster [DBG] pgmap v7014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:40.612149+0000 mgr.smithi067.rdualw (mgr.24569) 8143 : cluster [DBG] pgmap v7014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:44.014 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:42.612654+0000 mgr.smithi067.rdualw (mgr.24569) 8144 : cluster [DBG] pgmap v7015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:42.612654+0000 mgr.smithi067.rdualw (mgr.24569) 8144 : cluster [DBG] pgmap v7015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:46.014 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:44.613202+0000 mgr.smithi067.rdualw (mgr.24569) 8145 : cluster [DBG] pgmap v7016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:44.613202+0000 mgr.smithi067.rdualw (mgr.24569) 8145 : cluster [DBG] pgmap v7016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:46.614088+0000 mgr.smithi067.rdualw (mgr.24569) 8146 : cluster [DBG] pgmap v7017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:22:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:46.614088+0000 mgr.smithi067.rdualw (mgr.24569) 8146 : cluster [DBG] pgmap v7017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:22:50.014 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:48.614784+0000 mgr.smithi067.rdualw (mgr.24569) 8147 : cluster [DBG] pgmap v7018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:48.614784+0000 mgr.smithi067.rdualw (mgr.24569) 8147 : cluster [DBG] pgmap v7018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:52.015 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:50.615637+0000 mgr.smithi067.rdualw (mgr.24569) 8148 : cluster [DBG] pgmap v7019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:50.615637+0000 mgr.smithi067.rdualw (mgr.24569) 8148 : cluster [DBG] pgmap v7019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:52.870 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:22:53.162 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:22:53.162 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 7m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:22:53.162 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 7m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:22:53.163 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 7m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:22:53.163 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 7m ago 4h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:22:53.163 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 7m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:22:53.163 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 7m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:22:53.163 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 7m ago 4h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:22:53.164 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 7m ago 4h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:22:53.164 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 7m ago 4h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:22:53.164 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 7m ago 4h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:22:53.164 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 7m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:22:53.165 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 7m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:22:53.165 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 7m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:22:53.165 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 7m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:22:53.165 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 7m ago 4h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:22:53.165 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 7m ago 4h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:22:53.166 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (3h) 7m ago 3h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:22:53.166 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (3h) 7m ago 3h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:22:53.166 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 7m ago 3h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:22:53.166 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 7m ago 3h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:22:53.167 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 7m ago 3h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:22:53.167 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 7m ago 3h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:22:53.167 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 7m ago 4h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:22:53.505 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:22:53.505 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:22:53.506 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:22:53.506 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:22:53.507 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:22:53.507 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:22:53.508 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:22:53.508 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:22:53.508 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:22:53.509 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:22:53.509 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:22:53.509 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:22:53.509 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:22:53.510 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:22:53.510 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:22:53.511 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:22:53.511 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:22:53.512 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:22:53.512 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:22:54.015 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:52.616111+0000 mgr.smithi067.rdualw (mgr.24569) 8149 : cluster [DBG] pgmap v7020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:54.015 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:22:52.856650+0000 mgr.smithi067.rdualw (mgr.24569) 8150 : audit [DBG] from='client.39574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:22:54.016 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:22:53.143885+0000 mgr.smithi067.rdualw (mgr.24569) 8151 : audit [DBG] from='client.39578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:22:54.016 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:22:53.503609+0000 mon.smithi061 (mon.0) 1766 : audit [DBG] from='client.? 172.21.15.61:0/3510066346' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:22:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:52.616111+0000 mgr.smithi067.rdualw (mgr.24569) 8149 : cluster [DBG] pgmap v7020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:22:52.856650+0000 mgr.smithi067.rdualw (mgr.24569) 8150 : audit [DBG] from='client.39574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:22:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:22:53.143885+0000 mgr.smithi067.rdualw (mgr.24569) 8151 : audit [DBG] from='client.39578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:22:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:22:53.503609+0000 mon.smithi061 (mon.0) 1766 : audit [DBG] from='client.? 172.21.15.61:0/3510066346' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:22:56.015 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:54.616929+0000 mgr.smithi067.rdualw (mgr.24569) 8152 : cluster [DBG] pgmap v7021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:54.616929+0000 mgr.smithi067.rdualw (mgr.24569) 8152 : cluster [DBG] pgmap v7021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:22:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:56.617930+0000 mgr.smithi067.rdualw (mgr.24569) 8153 : cluster [DBG] pgmap v7022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:22:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:56.617930+0000 mgr.smithi067.rdualw (mgr.24569) 8153 : cluster [DBG] pgmap v7022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:23:00.016 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:22:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:22:58.618601+0000 mgr.smithi067.rdualw (mgr.24569) 8154 : cluster [DBG] pgmap v7023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:22:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:22:58.618601+0000 mgr.smithi067.rdualw (mgr.24569) 8154 : cluster [DBG] pgmap v7023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:02.016 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:00.619512+0000 mgr.smithi067.rdualw (mgr.24569) 8155 : cluster [DBG] pgmap v7024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:00.619512+0000 mgr.smithi067.rdualw (mgr.24569) 8155 : cluster [DBG] pgmap v7024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:04.017 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:02.620099+0000 mgr.smithi067.rdualw (mgr.24569) 8156 : cluster [DBG] pgmap v7025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:02.620099+0000 mgr.smithi067.rdualw (mgr.24569) 8156 : cluster [DBG] pgmap v7025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:06.017 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:04.620716+0000 mgr.smithi067.rdualw (mgr.24569) 8157 : cluster [DBG] pgmap v7026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:04.620716+0000 mgr.smithi067.rdualw (mgr.24569) 8157 : cluster [DBG] pgmap v7026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:06.621495+0000 mgr.smithi067.rdualw (mgr.24569) 8158 : cluster [DBG] pgmap v7027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:23:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:06.621495+0000 mgr.smithi067.rdualw (mgr.24569) 8158 : cluster [DBG] pgmap v7027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:23:10.018 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:08.622094+0000 mgr.smithi067.rdualw (mgr.24569) 8159 : cluster [DBG] pgmap v7028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:08.622094+0000 mgr.smithi067.rdualw (mgr.24569) 8159 : cluster [DBG] pgmap v7028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:12.018 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:10.623149+0000 mgr.smithi067.rdualw (mgr.24569) 8160 : cluster [DBG] pgmap v7029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:10.623149+0000 mgr.smithi067.rdualw (mgr.24569) 8160 : cluster [DBG] pgmap v7029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:14.019 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:12.623697+0000 mgr.smithi067.rdualw (mgr.24569) 8161 : cluster [DBG] pgmap v7030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:12.623697+0000 mgr.smithi067.rdualw (mgr.24569) 8161 : cluster [DBG] pgmap v7030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:16.021 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:14.624325+0000 mgr.smithi067.rdualw (mgr.24569) 8162 : cluster [DBG] pgmap v7031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:14.624325+0000 mgr.smithi067.rdualw (mgr.24569) 8162 : cluster [DBG] pgmap v7031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:23:16.596917+0000 mon.smithi067 (mon.1) 1245 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:23:17.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:23:16.598383+0000 mon.smithi067 (mon.1) 1246 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:23:17.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:23:16.599350+0000 mon.smithi067 (mon.1) 1247 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:23:17.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:23:16.600244+0000 mgr.smithi067.rdualw (mgr.24569) 8163 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:23:17.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:16.625189+0000 mgr.smithi067.rdualw (mgr.24569) 8164 : cluster [DBG] pgmap v7032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:23:17.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:23:17.014234+0000 mon.smithi061 (mon.0) 1767 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:23:17.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:23:17.019596+0000 mon.smithi061 (mon.0) 1768 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:23:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:23:16.596917+0000 mon.smithi067 (mon.1) 1245 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:23:17.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:23:16.598383+0000 mon.smithi067 (mon.1) 1246 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:23:17.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:23:16.599350+0000 mon.smithi067 (mon.1) 1247 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:23:17.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:23:16.600244+0000 mgr.smithi067.rdualw (mgr.24569) 8163 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:23:17.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:16.625189+0000 mgr.smithi067.rdualw (mgr.24569) 8164 : cluster [DBG] pgmap v7032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:23:17.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:23:17.014234+0000 mon.smithi061 (mon.0) 1767 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:23:17.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:23:17.019596+0000 mon.smithi061 (mon.0) 1768 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:23:20.019 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:18.625962+0000 mgr.smithi067.rdualw (mgr.24569) 8165 : cluster [DBG] pgmap v7033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:18.625962+0000 mgr.smithi067.rdualw (mgr.24569) 8165 : cluster [DBG] pgmap v7033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:22.020 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:20.626847+0000 mgr.smithi067.rdualw (mgr.24569) 8166 : cluster [DBG] pgmap v7034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:20.626847+0000 mgr.smithi067.rdualw (mgr.24569) 8166 : cluster [DBG] pgmap v7034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:23.816 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:23:24.020 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:22.627427+0000 mgr.smithi067.rdualw (mgr.24569) 8167 : cluster [DBG] pgmap v7035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:22.627427+0000 mgr.smithi067.rdualw (mgr.24569) 8167 : cluster [DBG] pgmap v7035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:24.110 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:23:24.110 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 8m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:23:24.111 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 8m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:23:24.111 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 8m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:23:24.111 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 8m ago 4h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:23:24.111 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 8m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:23:24.111 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 8m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:23:24.112 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 8m ago 4h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:23:24.112 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 8m ago 4h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:23:24.112 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 8m ago 4h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:23:24.112 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 8m ago 4h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:23:24.112 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 8m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:23:24.113 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 8m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:23:24.113 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 8m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:23:24.113 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 8m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:23:24.113 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 8m ago 4h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:23:24.113 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 8m ago 4h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:23:24.114 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 8m ago 4h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:23:24.114 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 8m ago 4h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:23:24.114 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (3h) 8m ago 3h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:23:24.114 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (3h) 8m ago 3h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:23:24.114 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 8m ago 3h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:23:24.115 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 8m ago 3h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:23:24.115 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 8m ago 4h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:23:24.456 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:23:24.457 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:23:24.457 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:23:24.457 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:23:24.457 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:23:24.458 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:23:24.458 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:23:24.458 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:23:24.458 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:23:24.459 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:23:24.459 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:23:24.459 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:23:24.459 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:23:24.459 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:23:24.460 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:23:24.460 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:23:24.460 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:23:24.460 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:23:24.461 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:23:25.020 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:23:23.802987+0000 mgr.smithi067.rdualw (mgr.24569) 8168 : audit [DBG] from='client.39586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:23:25.021 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:23:24.092935+0000 mgr.smithi067.rdualw (mgr.24569) 8169 : audit [DBG] from='client.39590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:23:25.021 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:23:24.455537+0000 mon.smithi061 (mon.0) 1769 : audit [DBG] from='client.? 172.21.15.61:0/438343802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:23:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:23:23.802987+0000 mgr.smithi067.rdualw (mgr.24569) 8168 : audit [DBG] from='client.39586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:23:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:23:24.092935+0000 mgr.smithi067.rdualw (mgr.24569) 8169 : audit [DBG] from='client.39590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:23:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:23:24.455537+0000 mon.smithi061 (mon.0) 1769 : audit [DBG] from='client.? 172.21.15.61:0/438343802' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:23:26.020 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:24.628067+0000 mgr.smithi067.rdualw (mgr.24569) 8170 : cluster [DBG] pgmap v7036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:24.628067+0000 mgr.smithi067.rdualw (mgr.24569) 8170 : cluster [DBG] pgmap v7036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:26.629038+0000 mgr.smithi067.rdualw (mgr.24569) 8171 : cluster [DBG] pgmap v7037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:23:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:26.629038+0000 mgr.smithi067.rdualw (mgr.24569) 8171 : cluster [DBG] pgmap v7037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:23:30.021 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:28.629597+0000 mgr.smithi067.rdualw (mgr.24569) 8172 : cluster [DBG] pgmap v7038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:28.629597+0000 mgr.smithi067.rdualw (mgr.24569) 8172 : cluster [DBG] pgmap v7038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:32.022 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:30.630474+0000 mgr.smithi067.rdualw (mgr.24569) 8173 : cluster [DBG] pgmap v7039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:30.630474+0000 mgr.smithi067.rdualw (mgr.24569) 8173 : cluster [DBG] pgmap v7039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:34.022 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:32.631056+0000 mgr.smithi067.rdualw (mgr.24569) 8174 : cluster [DBG] pgmap v7040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:32.631056+0000 mgr.smithi067.rdualw (mgr.24569) 8174 : cluster [DBG] pgmap v7040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:36.022 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:34.631727+0000 mgr.smithi067.rdualw (mgr.24569) 8175 : cluster [DBG] pgmap v7041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:34.631727+0000 mgr.smithi067.rdualw (mgr.24569) 8175 : cluster [DBG] pgmap v7041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:37.022 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:23:35.727047+0000 mon.smithi067 (mon.1) 1248 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:23:37.023 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:23:35.727299+0000 mon.smithi067 (mon.1) 1249 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:23:37.023 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:23:35.727349+0000 mon.smithi061 (mon.0) 1770 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:23:37.023 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:23:35.727604+0000 mon.smithi061 (mon.0) 1771 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:23:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:23:35.727047+0000 mon.smithi067 (mon.1) 1248 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:23:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:23:35.727299+0000 mon.smithi067 (mon.1) 1249 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:23:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:23:35.727349+0000 mon.smithi061 (mon.0) 1770 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:23:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:23:35.727604+0000 mon.smithi061 (mon.0) 1771 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:23:38.023 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:36.632706+0000 mgr.smithi067.rdualw (mgr.24569) 8176 : cluster [DBG] pgmap v7042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:23:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:36.632706+0000 mgr.smithi067.rdualw (mgr.24569) 8176 : cluster [DBG] pgmap v7042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:23:40.023 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:38.633206+0000 mgr.smithi067.rdualw (mgr.24569) 8177 : cluster [DBG] pgmap v7043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:38.633206+0000 mgr.smithi067.rdualw (mgr.24569) 8177 : cluster [DBG] pgmap v7043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:42.023 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:40.634126+0000 mgr.smithi067.rdualw (mgr.24569) 8178 : cluster [DBG] pgmap v7044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:42.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:40.634126+0000 mgr.smithi067.rdualw (mgr.24569) 8178 : cluster [DBG] pgmap v7044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:44.023 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:42.634670+0000 mgr.smithi067.rdualw (mgr.24569) 8179 : cluster [DBG] pgmap v7045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:42.634670+0000 mgr.smithi067.rdualw (mgr.24569) 8179 : cluster [DBG] pgmap v7045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:46.024 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:44.635418+0000 mgr.smithi067.rdualw (mgr.24569) 8180 : cluster [DBG] pgmap v7046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:44.635418+0000 mgr.smithi067.rdualw (mgr.24569) 8180 : cluster [DBG] pgmap v7046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:46.636302+0000 mgr.smithi067.rdualw (mgr.24569) 8181 : cluster [DBG] pgmap v7047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:23:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:46.636302+0000 mgr.smithi067.rdualw (mgr.24569) 8181 : cluster [DBG] pgmap v7047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:23:50.024 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:48.636916+0000 mgr.smithi067.rdualw (mgr.24569) 8182 : cluster [DBG] pgmap v7048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:48.636916+0000 mgr.smithi067.rdualw (mgr.24569) 8182 : cluster [DBG] pgmap v7048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:52.025 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:50.637831+0000 mgr.smithi067.rdualw (mgr.24569) 8183 : cluster [DBG] pgmap v7049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:50.637831+0000 mgr.smithi067.rdualw (mgr.24569) 8183 : cluster [DBG] pgmap v7049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:54.026 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:52.638379+0000 mgr.smithi067.rdualw (mgr.24569) 8184 : cluster [DBG] pgmap v7050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:52.638379+0000 mgr.smithi067.rdualw (mgr.24569) 8184 : cluster [DBG] pgmap v7050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:54.787 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:23:55.077 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:23:55.078 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 8m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:23:55.078 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 8m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:23:55.078 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 8m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:23:55.079 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 8m ago 4h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:23:55.079 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 8m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:23:55.079 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 8m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:23:55.079 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 8m ago 4h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:23:55.080 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 8m ago 4h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:23:55.080 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 8m ago 4h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:23:55.080 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 8m ago 4h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:23:55.080 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 8m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:23:55.080 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 8m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:23:55.081 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 8m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:23:55.081 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 8m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:23:55.081 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 8m ago 4h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:23:55.081 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 8m ago 4h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:23:55.082 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 8m ago 4h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:23:55.082 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 8m ago 4h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:23:55.082 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 8m ago 4h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:23:55.082 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 8m ago 4h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:23:55.082 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (3h) 8m ago 3h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:23:55.083 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (3h) 8m ago 3h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:23:55.083 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 8m ago 4h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:23:55.424 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:23:55.424 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:23:55.424 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:23:55.425 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:23:55.425 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:23:55.425 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:23:55.425 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:23:55.426 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:23:55.426 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:23:55.426 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:23:55.426 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:23:55.426 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:23:55.427 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:23:55.427 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:23:55.427 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:23:55.427 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:23:55.428 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:23:55.428 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:23:55.428 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:23:56.025 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:54.639050+0000 mgr.smithi067.rdualw (mgr.24569) 8185 : cluster [DBG] pgmap v7051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:56.026 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:23:54.771239+0000 mgr.smithi067.rdualw (mgr.24569) 8186 : audit [DBG] from='client.39598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:23:56.026 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:23:55.060430+0000 mgr.smithi067.rdualw (mgr.24569) 8187 : audit [DBG] from='client.39602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:23:56.026 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:23:55.422830+0000 mon.smithi061 (mon.0) 1772 : audit [DBG] from='client.? 172.21.15.61:0/2923199166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:23:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:54.639050+0000 mgr.smithi067.rdualw (mgr.24569) 8185 : cluster [DBG] pgmap v7051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:23:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:23:54.771239+0000 mgr.smithi067.rdualw (mgr.24569) 8186 : audit [DBG] from='client.39598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:23:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:23:55.060430+0000 mgr.smithi067.rdualw (mgr.24569) 8187 : audit [DBG] from='client.39602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:23:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:23:55.422830+0000 mon.smithi061 (mon.0) 1772 : audit [DBG] from='client.? 172.21.15.61:0/2923199166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:23:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:56.640099+0000 mgr.smithi067.rdualw (mgr.24569) 8188 : cluster [DBG] pgmap v7052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:23:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:56.640099+0000 mgr.smithi067.rdualw (mgr.24569) 8188 : cluster [DBG] pgmap v7052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:24:00.026 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:23:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:23:58.640835+0000 mgr.smithi067.rdualw (mgr.24569) 8189 : cluster [DBG] pgmap v7053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:23:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:23:58.640835+0000 mgr.smithi067.rdualw (mgr.24569) 8189 : cluster [DBG] pgmap v7053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:02.026 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:00.641601+0000 mgr.smithi067.rdualw (mgr.24569) 8190 : cluster [DBG] pgmap v7054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:00.641601+0000 mgr.smithi067.rdualw (mgr.24569) 8190 : cluster [DBG] pgmap v7054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:04.027 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:02.642163+0000 mgr.smithi067.rdualw (mgr.24569) 8191 : cluster [DBG] pgmap v7055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:02.642163+0000 mgr.smithi067.rdualw (mgr.24569) 8191 : cluster [DBG] pgmap v7055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:06.027 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:04.642928+0000 mgr.smithi067.rdualw (mgr.24569) 8192 : cluster [DBG] pgmap v7056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:04.642928+0000 mgr.smithi067.rdualw (mgr.24569) 8192 : cluster [DBG] pgmap v7056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:07.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:06.643795+0000 mgr.smithi067.rdualw (mgr.24569) 8193 : cluster [DBG] pgmap v7057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:24:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:06.643795+0000 mgr.smithi067.rdualw (mgr.24569) 8193 : cluster [DBG] pgmap v7057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:24:10.028 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:08.644448+0000 mgr.smithi067.rdualw (mgr.24569) 8194 : cluster [DBG] pgmap v7058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:08.644448+0000 mgr.smithi067.rdualw (mgr.24569) 8194 : cluster [DBG] pgmap v7058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:12.028 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:10.645358+0000 mgr.smithi067.rdualw (mgr.24569) 8195 : cluster [DBG] pgmap v7059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:10.645358+0000 mgr.smithi067.rdualw (mgr.24569) 8195 : cluster [DBG] pgmap v7059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:14.029 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:12.646073+0000 mgr.smithi067.rdualw (mgr.24569) 8196 : cluster [DBG] pgmap v7060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:12.646073+0000 mgr.smithi067.rdualw (mgr.24569) 8196 : cluster [DBG] pgmap v7060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:16.029 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:14.646945+0000 mgr.smithi067.rdualw (mgr.24569) 8197 : cluster [DBG] pgmap v7061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:14.646945+0000 mgr.smithi067.rdualw (mgr.24569) 8197 : cluster [DBG] pgmap v7061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:16.647837+0000 mgr.smithi067.rdualw (mgr.24569) 8198 : cluster [DBG] pgmap v7062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:24:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:24:17.022900+0000 mon.smithi067 (mon.1) 1250 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:24:17.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:24:17.024321+0000 mon.smithi067 (mon.1) 1251 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:24:17.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:24:17.025267+0000 mon.smithi067 (mon.1) 1252 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:24:17.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:24:17.026115+0000 mgr.smithi067.rdualw (mgr.24569) 8199 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:24:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:16.647837+0000 mgr.smithi067.rdualw (mgr.24569) 8198 : cluster [DBG] pgmap v7062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:24:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:24:17.022900+0000 mon.smithi067 (mon.1) 1250 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:24:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:24:17.024321+0000 mon.smithi067 (mon.1) 1251 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:24:17.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:24:17.025267+0000 mon.smithi067 (mon.1) 1252 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:24:17.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:24:17.026115+0000 mgr.smithi067.rdualw (mgr.24569) 8199 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:24:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:24:17.438061+0000 mon.smithi061 (mon.0) 1773 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:24:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:24:17.446286+0000 mon.smithi061 (mon.0) 1774 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:24:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:24:17.438061+0000 mon.smithi061 (mon.0) 1773 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:24:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:24:17.446286+0000 mon.smithi061 (mon.0) 1774 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:24:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:18.648382+0000 mgr.smithi067.rdualw (mgr.24569) 8200 : cluster [DBG] pgmap v7063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:18.648382+0000 mgr.smithi067.rdualw (mgr.24569) 8200 : cluster [DBG] pgmap v7063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:22.030 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:20.649230+0000 mgr.smithi067.rdualw (mgr.24569) 8201 : cluster [DBG] pgmap v7064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:20.649230+0000 mgr.smithi067.rdualw (mgr.24569) 8201 : cluster [DBG] pgmap v7064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:24.030 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:22.649730+0000 mgr.smithi067.rdualw (mgr.24569) 8202 : cluster [DBG] pgmap v7065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:22.649730+0000 mgr.smithi067.rdualw (mgr.24569) 8202 : cluster [DBG] pgmap v7065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:25.730 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:24:26.019 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:24:26.019 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 9m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:24:26.020 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 9m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:24:26.020 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 9m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:24:26.020 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 9m ago 4h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:24:26.020 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 9m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:24:26.021 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 9m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:24:26.021 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 9m ago 4h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:24:26.021 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 9m ago 4h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:24:26.021 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 9m ago 4h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:24:26.021 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 9m ago 4h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:24:26.022 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 9m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:24:26.022 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 9m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:24:26.022 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 9m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:24:26.022 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 9m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:24:26.023 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 9m ago 4h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:24:26.023 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 9m ago 4h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:24:26.023 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 9m ago 4h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:24:26.023 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 9m ago 4h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:24:26.023 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 9m ago 4h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:24:26.024 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 9m ago 4h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:24:26.024 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 9m ago 4h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:24:26.024 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 9m ago 4h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:24:26.024 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 9m ago 4h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:24:26.030 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:24.650341+0000 mgr.smithi067.rdualw (mgr.24569) 8203 : cluster [DBG] pgmap v7066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:24.650341+0000 mgr.smithi067.rdualw (mgr.24569) 8203 : cluster [DBG] pgmap v7066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:26.365 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:24:26.366 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:24:26.366 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:24:26.366 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:24:26.367 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:24:26.367 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:24:26.367 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:24:26.367 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:24:26.368 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:24:26.368 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:24:26.368 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:24:26.368 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:24:26.368 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:24:26.369 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:24:26.369 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:24:26.369 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:24:26.369 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:24:26.370 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:24:26.370 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:24:27.030 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:24:25.717007+0000 mgr.smithi067.rdualw (mgr.24569) 8204 : audit [DBG] from='client.39610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:24:27.031 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:24:26.002375+0000 mgr.smithi067.rdualw (mgr.24569) 8205 : audit [DBG] from='client.39614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:24:27.031 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:24:26.364574+0000 mon.smithi061 (mon.0) 1775 : audit [DBG] from='client.? 172.21.15.61:0/3051137119' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:24:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:24:25.717007+0000 mgr.smithi067.rdualw (mgr.24569) 8204 : audit [DBG] from='client.39610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:24:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:24:26.002375+0000 mgr.smithi067.rdualw (mgr.24569) 8205 : audit [DBG] from='client.39614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:24:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:24:26.364574+0000 mon.smithi061 (mon.0) 1775 : audit [DBG] from='client.? 172.21.15.61:0/3051137119' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:24:28.030 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:26.651285+0000 mgr.smithi067.rdualw (mgr.24569) 8206 : cluster [DBG] pgmap v7067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:24:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:26.651285+0000 mgr.smithi067.rdualw (mgr.24569) 8206 : cluster [DBG] pgmap v7067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:24:30.031 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:28.651923+0000 mgr.smithi067.rdualw (mgr.24569) 8207 : cluster [DBG] pgmap v7068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:28.651923+0000 mgr.smithi067.rdualw (mgr.24569) 8207 : cluster [DBG] pgmap v7068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:32.031 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:30.652849+0000 mgr.smithi067.rdualw (mgr.24569) 8208 : cluster [DBG] pgmap v7069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:30.652849+0000 mgr.smithi067.rdualw (mgr.24569) 8208 : cluster [DBG] pgmap v7069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:34.032 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:32.653506+0000 mgr.smithi067.rdualw (mgr.24569) 8209 : cluster [DBG] pgmap v7070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:32.653506+0000 mgr.smithi067.rdualw (mgr.24569) 8209 : cluster [DBG] pgmap v7070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:36.032 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:34.654231+0000 mgr.smithi067.rdualw (mgr.24569) 8210 : cluster [DBG] pgmap v7071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:34.654231+0000 mgr.smithi067.rdualw (mgr.24569) 8210 : cluster [DBG] pgmap v7071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:37.032 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:24:35.732216+0000 mon.smithi067 (mon.1) 1253 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:24:37.032 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:24:35.732418+0000 mon.smithi061 (mon.0) 1776 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:24:37.033 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:24:35.732458+0000 mon.smithi067 (mon.1) 1254 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:24:37.033 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:24:35.732797+0000 mon.smithi061 (mon.0) 1777 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:24:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:24:35.732216+0000 mon.smithi067 (mon.1) 1253 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:24:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:24:35.732418+0000 mon.smithi061 (mon.0) 1776 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:24:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:24:35.732458+0000 mon.smithi067 (mon.1) 1254 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:24:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:24:35.732797+0000 mon.smithi061 (mon.0) 1777 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:24:38.032 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:36.655258+0000 mgr.smithi067.rdualw (mgr.24569) 8211 : cluster [DBG] pgmap v7072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:24:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:36.655258+0000 mgr.smithi067.rdualw (mgr.24569) 8211 : cluster [DBG] pgmap v7072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:24:40.032 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:38.655810+0000 mgr.smithi067.rdualw (mgr.24569) 8212 : cluster [DBG] pgmap v7073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:38.655810+0000 mgr.smithi067.rdualw (mgr.24569) 8212 : cluster [DBG] pgmap v7073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:42.033 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:40.656840+0000 mgr.smithi067.rdualw (mgr.24569) 8213 : cluster [DBG] pgmap v7074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:40.656840+0000 mgr.smithi067.rdualw (mgr.24569) 8213 : cluster [DBG] pgmap v7074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:44.033 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:42.657410+0000 mgr.smithi067.rdualw (mgr.24569) 8214 : cluster [DBG] pgmap v7075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:42.657410+0000 mgr.smithi067.rdualw (mgr.24569) 8214 : cluster [DBG] pgmap v7075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:46.033 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:44.658254+0000 mgr.smithi067.rdualw (mgr.24569) 8215 : cluster [DBG] pgmap v7076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:44.658254+0000 mgr.smithi067.rdualw (mgr.24569) 8215 : cluster [DBG] pgmap v7076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:46.659264+0000 mgr.smithi067.rdualw (mgr.24569) 8216 : cluster [DBG] pgmap v7077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:24:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:46.659264+0000 mgr.smithi067.rdualw (mgr.24569) 8216 : cluster [DBG] pgmap v7077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:24:50.034 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:48.659854+0000 mgr.smithi067.rdualw (mgr.24569) 8217 : cluster [DBG] pgmap v7078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:48.659854+0000 mgr.smithi067.rdualw (mgr.24569) 8217 : cluster [DBG] pgmap v7078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:52.034 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:50.660707+0000 mgr.smithi067.rdualw (mgr.24569) 8218 : cluster [DBG] pgmap v7079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:50.660707+0000 mgr.smithi067.rdualw (mgr.24569) 8218 : cluster [DBG] pgmap v7079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:54.035 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:52.661380+0000 mgr.smithi067.rdualw (mgr.24569) 8219 : cluster [DBG] pgmap v7080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:52.661380+0000 mgr.smithi067.rdualw (mgr.24569) 8219 : cluster [DBG] pgmap v7080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:56.035 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:54.662088+0000 mgr.smithi067.rdualw (mgr.24569) 8220 : cluster [DBG] pgmap v7081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:54.662088+0000 mgr.smithi067.rdualw (mgr.24569) 8220 : cluster [DBG] pgmap v7081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:24:56.672 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:24:57.004 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:24:57.004 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 9m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:24:57.005 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 9m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:24:57.005 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 9m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:24:57.005 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 9m ago 4h 42.2M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:24:57.005 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 9m ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:24:57.006 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 9m ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:24:57.006 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 9m ago 4h 475M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:24:57.006 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 9m ago 4h 600M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:24:57.006 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 9m ago 4h 1512M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:24:57.007 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 9m ago 4h 777M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:24:57.007 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 9m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:24:57.007 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 9m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:24:57.007 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 9m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:24:57.007 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 9m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:24:57.008 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 9m ago 4h 1033M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:24:57.008 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 9m ago 4h 1901M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:24:57.008 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 9m ago 4h 1189M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:24:57.008 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 9m ago 4h 2039M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:24:57.009 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 9m ago 4h 1882M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:24:57.009 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 9m ago 4h 2069M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:24:57.009 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 9m ago 4h 1674M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:24:57.009 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 9m ago 4h 2599M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:24:57.010 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 9m ago 4h 143M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:24:57.347 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:24:57.347 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:24:57.347 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:24:57.348 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:24:57.348 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:24:57.348 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:24:57.348 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:24:57.348 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:24:57.349 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:24:57.349 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:24:57.349 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:24:57.349 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:24:57.350 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:24:57.350 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:24:57.350 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:24:57.350 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:24:57.351 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:24:57.351 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:24:57.351 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:24:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:24:56.659862+0000 mgr.smithi067.rdualw (mgr.24569) 8221 : audit [DBG] from='client.39622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:24:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:56.663103+0000 mgr.smithi067.rdualw (mgr.24569) 8222 : cluster [DBG] pgmap v7082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:24:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:24:56.987303+0000 mgr.smithi067.rdualw (mgr.24569) 8223 : audit [DBG] from='client.39626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:24:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:24:57.345771+0000 mon.smithi061 (mon.0) 1778 : audit [DBG] from='client.? 172.21.15.61:0/1980442442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:24:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:24:56.659862+0000 mgr.smithi067.rdualw (mgr.24569) 8221 : audit [DBG] from='client.39622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:24:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:56.663103+0000 mgr.smithi067.rdualw (mgr.24569) 8222 : cluster [DBG] pgmap v7082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:24:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:24:56.987303+0000 mgr.smithi067.rdualw (mgr.24569) 8223 : audit [DBG] from='client.39626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:24:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:24:57.345771+0000 mon.smithi061 (mon.0) 1778 : audit [DBG] from='client.? 172.21.15.61:0/1980442442' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:25:00.036 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:24:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:24:58.663655+0000 mgr.smithi067.rdualw (mgr.24569) 8224 : cluster [DBG] pgmap v7083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:24:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:24:58.663655+0000 mgr.smithi067.rdualw (mgr.24569) 8224 : cluster [DBG] pgmap v7083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:02.036 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:00.664528+0000 mgr.smithi067.rdualw (mgr.24569) 8225 : cluster [DBG] pgmap v7084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:02.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:00.664528+0000 mgr.smithi067.rdualw (mgr.24569) 8225 : cluster [DBG] pgmap v7084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:04.036 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:02.665254+0000 mgr.smithi067.rdualw (mgr.24569) 8226 : cluster [DBG] pgmap v7085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:02.665254+0000 mgr.smithi067.rdualw (mgr.24569) 8226 : cluster [DBG] pgmap v7085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:06.036 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:04.666102+0000 mgr.smithi067.rdualw (mgr.24569) 8227 : cluster [DBG] pgmap v7086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:04.666102+0000 mgr.smithi067.rdualw (mgr.24569) 8227 : cluster [DBG] pgmap v7086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:06.666969+0000 mgr.smithi067.rdualw (mgr.24569) 8228 : cluster [DBG] pgmap v7087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:25:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:06.666969+0000 mgr.smithi067.rdualw (mgr.24569) 8228 : cluster [DBG] pgmap v7087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:25:10.037 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:08.667616+0000 mgr.smithi067.rdualw (mgr.24569) 8229 : cluster [DBG] pgmap v7088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:08.667616+0000 mgr.smithi067.rdualw (mgr.24569) 8229 : cluster [DBG] pgmap v7088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:12.037 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:10.668433+0000 mgr.smithi067.rdualw (mgr.24569) 8230 : cluster [DBG] pgmap v7089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:10.668433+0000 mgr.smithi067.rdualw (mgr.24569) 8230 : cluster [DBG] pgmap v7089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:14.038 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:12.669013+0000 mgr.smithi067.rdualw (mgr.24569) 8231 : cluster [DBG] pgmap v7090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:12.669013+0000 mgr.smithi067.rdualw (mgr.24569) 8231 : cluster [DBG] pgmap v7090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:16.038 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:14.669655+0000 mgr.smithi067.rdualw (mgr.24569) 8232 : cluster [DBG] pgmap v7091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:14.669655+0000 mgr.smithi067.rdualw (mgr.24569) 8232 : cluster [DBG] pgmap v7091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:16.670574+0000 mgr.smithi067.rdualw (mgr.24569) 8233 : cluster [DBG] pgmap v7092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:25:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:16.670574+0000 mgr.smithi067.rdualw (mgr.24569) 8233 : cluster [DBG] pgmap v7092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:25:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:17.450087+0000 mon.smithi067 (mon.1) 1255 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:25:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:17.451606+0000 mon.smithi067 (mon.1) 1256 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:25:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:17.452525+0000 mon.smithi067 (mon.1) 1257 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:25:18.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:25:17.453386+0000 mgr.smithi067.rdualw (mgr.24569) 8234 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:25:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:17.450087+0000 mon.smithi067 (mon.1) 1255 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:25:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:17.451606+0000 mon.smithi067 (mon.1) 1256 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:25:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:17.452525+0000 mon.smithi067 (mon.1) 1257 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:25:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:25:17.453386+0000 mgr.smithi067.rdualw (mgr.24569) 8234 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:25:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:18.671022+0000 mgr.smithi067.rdualw (mgr.24569) 8235 : cluster [DBG] pgmap v7093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:18.671022+0000 mgr.smithi067.rdualw (mgr.24569) 8235 : cluster [DBG] pgmap v7093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:22.039 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:20.671784+0000 mgr.smithi067.rdualw (mgr.24569) 8236 : cluster [DBG] pgmap v7094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:20.671784+0000 mgr.smithi067.rdualw (mgr.24569) 8236 : cluster [DBG] pgmap v7094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:21.846339+0000 mon.smithi061 (mon.0) 1779 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:25:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:22.234782+0000 mon.smithi067 (mon.1) 1258 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:25:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:22.234987+0000 mon.smithi061 (mon.0) 1780 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:25:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:21.846339+0000 mon.smithi061 (mon.0) 1779 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:25:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:22.234782+0000 mon.smithi067 (mon.1) 1258 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:25:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:22.234987+0000 mon.smithi061 (mon.0) 1780 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:25:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:22.672195+0000 mgr.smithi067.rdualw (mgr.24569) 8237 : cluster [DBG] pgmap v7095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:22.672195+0000 mgr.smithi067.rdualw (mgr.24569) 8237 : cluster [DBG] pgmap v7095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:24.672861+0000 mgr.smithi067.rdualw (mgr.24569) 8238 : cluster [DBG] pgmap v7096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:24.890958+0000 mon.smithi061 (mon.0) 1781 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:25:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:25.307667+0000 mon.smithi067 (mon.1) 1259 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:25:26.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:25.308054+0000 mon.smithi061 (mon.0) 1782 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:25:26.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:25.312774+0000 mon.smithi061 (mon.0) 1783 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:25:26.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:25.319770+0000 mon.smithi061 (mon.0) 1784 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:25:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:24.672861+0000 mgr.smithi067.rdualw (mgr.24569) 8238 : cluster [DBG] pgmap v7096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:24.890958+0000 mon.smithi061 (mon.0) 1781 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:25:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:25.307667+0000 mon.smithi067 (mon.1) 1259 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:25:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:25.308054+0000 mon.smithi061 (mon.0) 1782 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:25:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:25.312774+0000 mon.smithi061 (mon.0) 1783 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:25:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:25.319770+0000 mon.smithi061 (mon.0) 1784 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:25:27.654 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:25:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:26.673890+0000 mgr.smithi067.rdualw (mgr.24569) 8239 : cluster [DBG] pgmap v7097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:25:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:26.673890+0000 mgr.smithi067.rdualw (mgr.24569) 8239 : cluster [DBG] pgmap v7097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:25:27.949 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:25:27.949 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 3s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:25:27.949 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 3s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:25:27.949 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 6s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:25:27.950 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 3s ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:25:27.950 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 3s ago 3h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:25:27.950 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 6s ago 3h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:25:27.950 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 3s ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:25:27.951 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 6s ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:25:27.951 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 3s ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:25:27.951 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 6s ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:25:27.951 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 3s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:25:27.952 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 6s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:25:27.952 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 3s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:25:27.952 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 6s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:25:27.952 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 3s ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:25:27.953 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 3s ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:25:27.953 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 3s ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:25:27.953 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 3s ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:25:27.953 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 6s ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:25:27.953 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 6s ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:25:27.954 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 6s ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:25:27.954 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 6s ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:25:27.954 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 3s ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:25:28.291 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:25:28.292 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:25:28.292 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:25:28.292 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:25:28.293 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:25:28.293 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:25:28.293 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:25:28.293 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:25:28.294 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:25:28.294 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:25:28.294 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:25:28.294 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:25:28.294 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:25:28.295 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:25:28.295 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:25:28.295 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:25:28.295 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:25:28.296 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:25:28.296 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:25:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:27.641158+0000 mgr.smithi067.rdualw (mgr.24569) 8240 : audit [DBG] from='client.39634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:25:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:27.931592+0000 mgr.smithi067.rdualw (mgr.24569) 8241 : audit [DBG] from='client.39638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:25:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:28.290522+0000 mon.smithi061 (mon.0) 1785 : audit [DBG] from='client.? 172.21.15.61:0/3577798952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:25:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:27.641158+0000 mgr.smithi067.rdualw (mgr.24569) 8240 : audit [DBG] from='client.39634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:25:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:27.931592+0000 mgr.smithi067.rdualw (mgr.24569) 8241 : audit [DBG] from='client.39638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:25:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:28.290522+0000 mon.smithi061 (mon.0) 1785 : audit [DBG] from='client.? 172.21.15.61:0/3577798952' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:25:29.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:28.674453+0000 mgr.smithi067.rdualw (mgr.24569) 8242 : cluster [DBG] pgmap v7098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:29.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:28.674453+0000 mgr.smithi067.rdualw (mgr.24569) 8242 : cluster [DBG] pgmap v7098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:32.041 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:30.675275+0000 mgr.smithi067.rdualw (mgr.24569) 8243 : cluster [DBG] pgmap v7099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:32.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:30.675275+0000 mgr.smithi067.rdualw (mgr.24569) 8243 : cluster [DBG] pgmap v7099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:34.041 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:32.675842+0000 mgr.smithi067.rdualw (mgr.24569) 8244 : cluster [DBG] pgmap v7100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:32.675842+0000 mgr.smithi067.rdualw (mgr.24569) 8244 : cluster [DBG] pgmap v7100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:36.041 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:34.676445+0000 mgr.smithi067.rdualw (mgr.24569) 8245 : cluster [DBG] pgmap v7101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:34.676445+0000 mgr.smithi067.rdualw (mgr.24569) 8245 : cluster [DBG] pgmap v7101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:37.042 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:35.739820+0000 mon.smithi067 (mon.1) 1260 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:25:37.042 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:35.740016+0000 mon.smithi061 (mon.0) 1786 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:25:37.042 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:35.740153+0000 mon.smithi067 (mon.1) 1261 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:25:37.043 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:35.740348+0000 mon.smithi061 (mon.0) 1787 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:25:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:35.739820+0000 mon.smithi067 (mon.1) 1260 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:25:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:35.740016+0000 mon.smithi061 (mon.0) 1786 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:25:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:35.740153+0000 mon.smithi067 (mon.1) 1261 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:25:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:35.740348+0000 mon.smithi061 (mon.0) 1787 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:25:38.042 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:36.677256+0000 mgr.smithi067.rdualw (mgr.24569) 8246 : cluster [DBG] pgmap v7102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:25:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:36.677256+0000 mgr.smithi067.rdualw (mgr.24569) 8246 : cluster [DBG] pgmap v7102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:25:40.042 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:38.677824+0000 mgr.smithi067.rdualw (mgr.24569) 8247 : cluster [DBG] pgmap v7103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:38.677824+0000 mgr.smithi067.rdualw (mgr.24569) 8247 : cluster [DBG] pgmap v7103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:42.042 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:40.678853+0000 mgr.smithi067.rdualw (mgr.24569) 8248 : cluster [DBG] pgmap v7104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:40.678853+0000 mgr.smithi067.rdualw (mgr.24569) 8248 : cluster [DBG] pgmap v7104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:44.043 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:42.679449+0000 mgr.smithi067.rdualw (mgr.24569) 8249 : cluster [DBG] pgmap v7105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:42.679449+0000 mgr.smithi067.rdualw (mgr.24569) 8249 : cluster [DBG] pgmap v7105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:46.043 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:44.680092+0000 mgr.smithi067.rdualw (mgr.24569) 8250 : cluster [DBG] pgmap v7106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:44.680092+0000 mgr.smithi067.rdualw (mgr.24569) 8250 : cluster [DBG] pgmap v7106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:46.681114+0000 mgr.smithi067.rdualw (mgr.24569) 8251 : cluster [DBG] pgmap v7107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:25:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:46.681114+0000 mgr.smithi067.rdualw (mgr.24569) 8251 : cluster [DBG] pgmap v7107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:25:50.043 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:48.681810+0000 mgr.smithi067.rdualw (mgr.24569) 8252 : cluster [DBG] pgmap v7108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:48.681810+0000 mgr.smithi067.rdualw (mgr.24569) 8252 : cluster [DBG] pgmap v7108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:52.044 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:50.682719+0000 mgr.smithi067.rdualw (mgr.24569) 8253 : cluster [DBG] pgmap v7109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:50.682719+0000 mgr.smithi067.rdualw (mgr.24569) 8253 : cluster [DBG] pgmap v7109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:54.044 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:52.683251+0000 mgr.smithi067.rdualw (mgr.24569) 8254 : cluster [DBG] pgmap v7110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:52.683251+0000 mgr.smithi067.rdualw (mgr.24569) 8254 : cluster [DBG] pgmap v7110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:56.045 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:54.684005+0000 mgr.smithi067.rdualw (mgr.24569) 8255 : cluster [DBG] pgmap v7111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:54.684005+0000 mgr.smithi067.rdualw (mgr.24569) 8255 : cluster [DBG] pgmap v7111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:25:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:56.685093+0000 mgr.smithi067.rdualw (mgr.24569) 8256 : cluster [DBG] pgmap v7112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:25:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:56.685093+0000 mgr.smithi067.rdualw (mgr.24569) 8256 : cluster [DBG] pgmap v7112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:25:58.597 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:25:58.886 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:25:58.887 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 33s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:25:58.887 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 33s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:25:58.887 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 37s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:25:58.888 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 33s ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:25:58.888 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 33s ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:25:58.888 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 37s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:25:58.888 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 33s ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:25:58.889 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 37s ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:25:58.889 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 33s ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:25:58.889 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 37s ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:25:58.889 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 33s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:25:58.889 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 37s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:25:58.890 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 33s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:25:58.890 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 37s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:25:58.890 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 33s ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:25:58.890 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 33s ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:25:58.890 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 33s ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:25:58.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 33s ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:25:58.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 37s ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:25:58.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 37s ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:25:58.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 37s ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:25:58.892 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 37s ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:25:58.892 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 33s ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:25:59.228 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:25:59.228 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:25:59.229 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:25:59.229 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:25:59.229 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:25:59.229 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:25:59.230 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:25:59.230 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:25:59.230 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:25:59.230 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:25:59.230 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:25:59.231 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:25:59.231 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:25:59.231 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:25:59.231 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:25:59.232 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:25:59.232 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:25:59.232 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:25:59.232 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:26:00.045 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:58.584628+0000 mgr.smithi067.rdualw (mgr.24569) 8257 : audit [DBG] from='client.39646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:26:00.046 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:25:58.685602+0000 mgr.smithi067.rdualw (mgr.24569) 8258 : cluster [DBG] pgmap v7113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:00.046 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:58.869095+0000 mgr.smithi067.rdualw (mgr.24569) 8259 : audit [DBG] from='client.39650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:26:00.046 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:25:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:25:59.227147+0000 mon.smithi061 (mon.0) 1788 : audit [DBG] from='client.? 172.21.15.61:0/1325404178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:26:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:58.584628+0000 mgr.smithi067.rdualw (mgr.24569) 8257 : audit [DBG] from='client.39646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:26:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:25:58.685602+0000 mgr.smithi067.rdualw (mgr.24569) 8258 : cluster [DBG] pgmap v7113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:58.869095+0000 mgr.smithi067.rdualw (mgr.24569) 8259 : audit [DBG] from='client.39650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:26:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:25:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:25:59.227147+0000 mon.smithi061 (mon.0) 1788 : audit [DBG] from='client.? 172.21.15.61:0/1325404178' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:26:02.046 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:00.686596+0000 mgr.smithi067.rdualw (mgr.24569) 8260 : cluster [DBG] pgmap v7114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:00.686596+0000 mgr.smithi067.rdualw (mgr.24569) 8260 : cluster [DBG] pgmap v7114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:04.046 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:02.687146+0000 mgr.smithi067.rdualw (mgr.24569) 8261 : cluster [DBG] pgmap v7115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:02.687146+0000 mgr.smithi067.rdualw (mgr.24569) 8261 : cluster [DBG] pgmap v7115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:06.046 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:04.687800+0000 mgr.smithi067.rdualw (mgr.24569) 8262 : cluster [DBG] pgmap v7116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:04.687800+0000 mgr.smithi067.rdualw (mgr.24569) 8262 : cluster [DBG] pgmap v7116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:06.688751+0000 mgr.smithi067.rdualw (mgr.24569) 8263 : cluster [DBG] pgmap v7117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:26:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:06.688751+0000 mgr.smithi067.rdualw (mgr.24569) 8263 : cluster [DBG] pgmap v7117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:26:10.047 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:08.689307+0000 mgr.smithi067.rdualw (mgr.24569) 8264 : cluster [DBG] pgmap v7118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:08.689307+0000 mgr.smithi067.rdualw (mgr.24569) 8264 : cluster [DBG] pgmap v7118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:12.047 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:10.690388+0000 mgr.smithi067.rdualw (mgr.24569) 8265 : cluster [DBG] pgmap v7119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:10.690388+0000 mgr.smithi067.rdualw (mgr.24569) 8265 : cluster [DBG] pgmap v7119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:14.047 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:12.691018+0000 mgr.smithi067.rdualw (mgr.24569) 8266 : cluster [DBG] pgmap v7120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:12.691018+0000 mgr.smithi067.rdualw (mgr.24569) 8266 : cluster [DBG] pgmap v7120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:16.047 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:14.691650+0000 mgr.smithi067.rdualw (mgr.24569) 8267 : cluster [DBG] pgmap v7121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:14.691650+0000 mgr.smithi067.rdualw (mgr.24569) 8267 : cluster [DBG] pgmap v7121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:16.692553+0000 mgr.smithi067.rdualw (mgr.24569) 8268 : cluster [DBG] pgmap v7122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:26:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:16.692553+0000 mgr.smithi067.rdualw (mgr.24569) 8268 : cluster [DBG] pgmap v7122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:26:20.048 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:18.693202+0000 mgr.smithi067.rdualw (mgr.24569) 8269 : cluster [DBG] pgmap v7123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:18.693202+0000 mgr.smithi067.rdualw (mgr.24569) 8269 : cluster [DBG] pgmap v7123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:22.048 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:20.693980+0000 mgr.smithi067.rdualw (mgr.24569) 8270 : cluster [DBG] pgmap v7124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:20.693980+0000 mgr.smithi067.rdualw (mgr.24569) 8270 : cluster [DBG] pgmap v7124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:24.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:22.694686+0000 mgr.smithi067.rdualw (mgr.24569) 8271 : cluster [DBG] pgmap v7125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:22.694686+0000 mgr.smithi067.rdualw (mgr.24569) 8271 : cluster [DBG] pgmap v7125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:26.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:24.695287+0000 mgr.smithi067.rdualw (mgr.24569) 8272 : cluster [DBG] pgmap v7126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:26.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:26:25.324619+0000 mon.smithi067 (mon.1) 1262 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:26:26.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:26:25.326159+0000 mon.smithi067 (mon.1) 1263 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:26:26.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:26:25.327076+0000 mon.smithi067 (mon.1) 1264 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:26:26.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:26:25.327898+0000 mgr.smithi067.rdualw (mgr.24569) 8273 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:26:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:26:25.736436+0000 mon.smithi061 (mon.0) 1789 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:26:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:26:25.741969+0000 mon.smithi061 (mon.0) 1790 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:26:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:24.695287+0000 mgr.smithi067.rdualw (mgr.24569) 8272 : cluster [DBG] pgmap v7126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:26:25.324619+0000 mon.smithi067 (mon.1) 1262 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:26:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:26:25.326159+0000 mon.smithi067 (mon.1) 1263 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:26:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:26:25.327076+0000 mon.smithi067 (mon.1) 1264 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:26:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:26:25.327898+0000 mgr.smithi067.rdualw (mgr.24569) 8273 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:26:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:26:25.736436+0000 mon.smithi061 (mon.0) 1789 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:26:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:26:25.741969+0000 mon.smithi061 (mon.0) 1790 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:26:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:26.696323+0000 mgr.smithi067.rdualw (mgr.24569) 8274 : cluster [DBG] pgmap v7127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:26:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:26.696323+0000 mgr.smithi067.rdualw (mgr.24569) 8274 : cluster [DBG] pgmap v7127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:26:29.536 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:26:29.830 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:26:29.830 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 64s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:26:29.831 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 64s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:26:29.831 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 67s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:26:29.832 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 64s ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:26:29.832 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 64s ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:26:29.833 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 67s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:26:29.833 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 64s ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:26:29.833 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 67s ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:26:29.834 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 64s ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:26:29.834 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 67s ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:26:29.835 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 64s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:26:29.835 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 67s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:26:29.835 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 64s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:26:29.836 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 67s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:26:29.836 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 64s ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:26:29.837 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 64s ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:26:29.837 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 64s ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:26:29.837 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 64s ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:26:29.838 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 67s ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:26:29.838 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 67s ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:26:29.838 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 67s ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:26:29.839 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 67s ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:26:29.839 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 64s ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:26:30.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:28.697051+0000 mgr.smithi067.rdualw (mgr.24569) 8275 : cluster [DBG] pgmap v7128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:28.697051+0000 mgr.smithi067.rdualw (mgr.24569) 8275 : cluster [DBG] pgmap v7128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:30.171 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:26:30.171 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:26:30.172 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:26:30.172 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:26:30.172 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:26:30.172 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:26:30.173 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:26:30.173 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:26:30.173 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:26:30.173 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:26:30.173 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:26:30.174 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:26:30.174 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:26:30.174 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:26:30.174 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:26:30.175 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:26:30.175 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:26:30.175 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:26:30.175 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:26:31.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:26:29.523230+0000 mgr.smithi067.rdualw (mgr.24569) 8276 : audit [DBG] from='client.39658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:26:31.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:26:29.811682+0000 mgr.smithi067.rdualw (mgr.24569) 8277 : audit [DBG] from='client.39662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:26:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:26:30.170345+0000 mon.smithi061 (mon.0) 1791 : audit [DBG] from='client.? 172.21.15.61:0/2134616262' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:26:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:26:29.523230+0000 mgr.smithi067.rdualw (mgr.24569) 8276 : audit [DBG] from='client.39658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:26:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:26:29.811682+0000 mgr.smithi067.rdualw (mgr.24569) 8277 : audit [DBG] from='client.39662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:26:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:26:30.170345+0000 mon.smithi061 (mon.0) 1791 : audit [DBG] from='client.? 172.21.15.61:0/2134616262' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:26:32.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:30.697997+0000 mgr.smithi067.rdualw (mgr.24569) 8278 : cluster [DBG] pgmap v7129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:30.697997+0000 mgr.smithi067.rdualw (mgr.24569) 8278 : cluster [DBG] pgmap v7129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:34.050 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:32.698712+0000 mgr.smithi067.rdualw (mgr.24569) 8279 : cluster [DBG] pgmap v7130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:32.698712+0000 mgr.smithi067.rdualw (mgr.24569) 8279 : cluster [DBG] pgmap v7130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:34.699410+0000 mgr.smithi067.rdualw (mgr.24569) 8280 : cluster [DBG] pgmap v7131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:26:35.744786+0000 mon.smithi067 (mon.1) 1265 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:26:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:26:35.745034+0000 mon.smithi061 (mon.0) 1792 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:26:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:26:35.745109+0000 mon.smithi067 (mon.1) 1266 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:26:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:26:35.745439+0000 mon.smithi061 (mon.0) 1793 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:26:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:34.699410+0000 mgr.smithi067.rdualw (mgr.24569) 8280 : cluster [DBG] pgmap v7131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:26:35.744786+0000 mon.smithi067 (mon.1) 1265 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:26:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:26:35.745034+0000 mon.smithi061 (mon.0) 1792 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:26:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:26:35.745109+0000 mon.smithi067 (mon.1) 1266 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:26:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:26:35.745439+0000 mon.smithi061 (mon.0) 1793 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:26:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:36.700288+0000 mgr.smithi067.rdualw (mgr.24569) 8281 : cluster [DBG] pgmap v7132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:26:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:36.700288+0000 mgr.smithi067.rdualw (mgr.24569) 8281 : cluster [DBG] pgmap v7132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:26:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:38.700897+0000 mgr.smithi067.rdualw (mgr.24569) 8282 : cluster [DBG] pgmap v7133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:38.700897+0000 mgr.smithi067.rdualw (mgr.24569) 8282 : cluster [DBG] pgmap v7133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:40.701792+0000 mgr.smithi067.rdualw (mgr.24569) 8283 : cluster [DBG] pgmap v7134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:40.701792+0000 mgr.smithi067.rdualw (mgr.24569) 8283 : cluster [DBG] pgmap v7134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:42.702442+0000 mgr.smithi067.rdualw (mgr.24569) 8284 : cluster [DBG] pgmap v7135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:42.702442+0000 mgr.smithi067.rdualw (mgr.24569) 8284 : cluster [DBG] pgmap v7135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:44.703156+0000 mgr.smithi067.rdualw (mgr.24569) 8285 : cluster [DBG] pgmap v7136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:44.703156+0000 mgr.smithi067.rdualw (mgr.24569) 8285 : cluster [DBG] pgmap v7136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:46.704235+0000 mgr.smithi067.rdualw (mgr.24569) 8286 : cluster [DBG] pgmap v7137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:26:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:46.704235+0000 mgr.smithi067.rdualw (mgr.24569) 8286 : cluster [DBG] pgmap v7137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:26:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:48.705005+0000 mgr.smithi067.rdualw (mgr.24569) 8287 : cluster [DBG] pgmap v7138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:48.705005+0000 mgr.smithi067.rdualw (mgr.24569) 8287 : cluster [DBG] pgmap v7138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:50.706117+0000 mgr.smithi067.rdualw (mgr.24569) 8288 : cluster [DBG] pgmap v7139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:50.706117+0000 mgr.smithi067.rdualw (mgr.24569) 8288 : cluster [DBG] pgmap v7139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:52.706788+0000 mgr.smithi067.rdualw (mgr.24569) 8289 : cluster [DBG] pgmap v7140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:52.706788+0000 mgr.smithi067.rdualw (mgr.24569) 8289 : cluster [DBG] pgmap v7140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:54.707428+0000 mgr.smithi067.rdualw (mgr.24569) 8290 : cluster [DBG] pgmap v7141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:54.707428+0000 mgr.smithi067.rdualw (mgr.24569) 8290 : cluster [DBG] pgmap v7141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:26:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:56.708558+0000 mgr.smithi067.rdualw (mgr.24569) 8291 : cluster [DBG] pgmap v7142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:26:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:56.708558+0000 mgr.smithi067.rdualw (mgr.24569) 8291 : cluster [DBG] pgmap v7142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:27:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:26:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:26:58.709352+0000 mgr.smithi067.rdualw (mgr.24569) 8292 : cluster [DBG] pgmap v7143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:26:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:26:58.709352+0000 mgr.smithi067.rdualw (mgr.24569) 8292 : cluster [DBG] pgmap v7143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:00.481 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:27:00.773 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:27:00.774 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 95s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:27:00.774 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 95s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:27:00.774 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 98s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:27:00.775 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 95s ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:27:00.775 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 95s ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:27:00.775 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 98s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:27:00.775 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 95s ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:27:00.775 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 98s ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:27:00.776 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 95s ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:27:00.776 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 98s ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:27:00.776 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 95s ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:27:00.776 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 98s ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:27:00.776 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 95s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:27:00.777 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 98s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:27:00.777 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 95s ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:27:00.777 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 95s ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:27:00.777 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 95s ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:27:00.777 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 95s ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:27:00.778 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 98s ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:27:00.778 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 98s ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:27:00.778 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 98s ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:27:00.778 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 98s ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:27:00.779 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 95s ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:27:01.117 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:27:01.117 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:27:01.118 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:27:01.118 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:27:01.118 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:27:01.118 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:27:01.119 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:27:01.119 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:27:01.119 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:27:01.119 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:27:01.119 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:27:01.120 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:27:01.120 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:27:01.120 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:27:01.120 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:27:01.121 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:27:01.121 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:27:01.121 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:27:01.121 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:27:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:27:00.467784+0000 mgr.smithi067.rdualw (mgr.24569) 8293 : audit [DBG] from='client.39670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:27:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:00.710219+0000 mgr.smithi067.rdualw (mgr.24569) 8294 : cluster [DBG] pgmap v7144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:27:00.756528+0000 mgr.smithi067.rdualw (mgr.24569) 8295 : audit [DBG] from='client.39674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:27:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:27:01.116016+0000 mon.smithi061 (mon.0) 1794 : audit [DBG] from='client.? 172.21.15.61:0/513562070' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:27:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:27:00.467784+0000 mgr.smithi067.rdualw (mgr.24569) 8293 : audit [DBG] from='client.39670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:27:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:00.710219+0000 mgr.smithi067.rdualw (mgr.24569) 8294 : cluster [DBG] pgmap v7144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:27:00.756528+0000 mgr.smithi067.rdualw (mgr.24569) 8295 : audit [DBG] from='client.39674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:27:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:27:01.116016+0000 mon.smithi061 (mon.0) 1794 : audit [DBG] from='client.? 172.21.15.61:0/513562070' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:27:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:02.710842+0000 mgr.smithi067.rdualw (mgr.24569) 8296 : cluster [DBG] pgmap v7145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:02.710842+0000 mgr.smithi067.rdualw (mgr.24569) 8296 : cluster [DBG] pgmap v7145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:04.711423+0000 mgr.smithi067.rdualw (mgr.24569) 8297 : cluster [DBG] pgmap v7146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:04.711423+0000 mgr.smithi067.rdualw (mgr.24569) 8297 : cluster [DBG] pgmap v7146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:06.712291+0000 mgr.smithi067.rdualw (mgr.24569) 8298 : cluster [DBG] pgmap v7147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:27:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:06.712291+0000 mgr.smithi067.rdualw (mgr.24569) 8298 : cluster [DBG] pgmap v7147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:27:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:08.712897+0000 mgr.smithi067.rdualw (mgr.24569) 8299 : cluster [DBG] pgmap v7148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:08.712897+0000 mgr.smithi067.rdualw (mgr.24569) 8299 : cluster [DBG] pgmap v7148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:10.713901+0000 mgr.smithi067.rdualw (mgr.24569) 8300 : cluster [DBG] pgmap v7149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:10.713901+0000 mgr.smithi067.rdualw (mgr.24569) 8300 : cluster [DBG] pgmap v7149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:12.714488+0000 mgr.smithi067.rdualw (mgr.24569) 8301 : cluster [DBG] pgmap v7150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:12.714488+0000 mgr.smithi067.rdualw (mgr.24569) 8301 : cluster [DBG] pgmap v7150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:14.715381+0000 mgr.smithi067.rdualw (mgr.24569) 8302 : cluster [DBG] pgmap v7151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:14.715381+0000 mgr.smithi067.rdualw (mgr.24569) 8302 : cluster [DBG] pgmap v7151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:16.716454+0000 mgr.smithi067.rdualw (mgr.24569) 8303 : cluster [DBG] pgmap v7152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:27:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:16.716454+0000 mgr.smithi067.rdualw (mgr.24569) 8303 : cluster [DBG] pgmap v7152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:27:20.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:18.717159+0000 mgr.smithi067.rdualw (mgr.24569) 8304 : cluster [DBG] pgmap v7153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:18.717159+0000 mgr.smithi067.rdualw (mgr.24569) 8304 : cluster [DBG] pgmap v7153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:20.718087+0000 mgr.smithi067.rdualw (mgr.24569) 8305 : cluster [DBG] pgmap v7154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:20.718087+0000 mgr.smithi067.rdualw (mgr.24569) 8305 : cluster [DBG] pgmap v7154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:24.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:22.718730+0000 mgr.smithi067.rdualw (mgr.24569) 8306 : cluster [DBG] pgmap v7155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:22.718730+0000 mgr.smithi067.rdualw (mgr.24569) 8306 : cluster [DBG] pgmap v7155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:24.719527+0000 mgr.smithi067.rdualw (mgr.24569) 8307 : cluster [DBG] pgmap v7156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:27:25.745685+0000 mon.smithi067 (mon.1) 1267 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:27:26.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:27:25.747266+0000 mon.smithi067 (mon.1) 1268 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:27:26.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:27:25.748235+0000 mon.smithi067 (mon.1) 1269 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:27:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:24.719527+0000 mgr.smithi067.rdualw (mgr.24569) 8307 : cluster [DBG] pgmap v7156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:27:25.745685+0000 mon.smithi067 (mon.1) 1267 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:27:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:27:25.747266+0000 mon.smithi067 (mon.1) 1268 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:27:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:27:25.748235+0000 mon.smithi067 (mon.1) 1269 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:27:27.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:27:25.749169+0000 mgr.smithi067.rdualw (mgr.24569) 8308 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:27:27.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:27:26.105547+0000 mon.smithi061 (mon.0) 1795 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:27:27.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:27:26.110753+0000 mon.smithi061 (mon.0) 1796 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:27:27.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:27:26.557141+0000 mon.smithi061 (mon.0) 1797 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:27:27.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:27:26.563286+0000 mon.smithi061 (mon.0) 1798 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:27:27.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:27:25.749169+0000 mgr.smithi067.rdualw (mgr.24569) 8308 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:27:27.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:27:26.105547+0000 mon.smithi061 (mon.0) 1795 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:27:27.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:27:26.110753+0000 mon.smithi061 (mon.0) 1796 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:27:27.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:27:26.557141+0000 mon.smithi061 (mon.0) 1797 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:27:27.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:27:26.563286+0000 mon.smithi061 (mon.0) 1798 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:27:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:26.720281+0000 mgr.smithi067.rdualw (mgr.24569) 8309 : cluster [DBG] pgmap v7157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:27:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:26.720281+0000 mgr.smithi067.rdualw (mgr.24569) 8309 : cluster [DBG] pgmap v7157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:27:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:28.720903+0000 mgr.smithi067.rdualw (mgr.24569) 8310 : cluster [DBG] pgmap v7158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:28.720903+0000 mgr.smithi067.rdualw (mgr.24569) 8310 : cluster [DBG] pgmap v7158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:31.429 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:27:31.720 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:27:31.720 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 2m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:27:31.720 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 2m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:27:31.720 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 2m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:27:31.721 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 2m ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:27:31.721 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 2m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:27:31.721 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 2m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:27:31.721 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 2m ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:27:31.722 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 2m ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:27:31.722 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 2m ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:27:31.722 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 2m ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:27:31.722 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (3h) 2m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:27:31.722 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 2m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:27:31.723 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 2m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:27:31.723 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 2m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:27:31.723 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 2m ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:27:31.723 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 2m ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:27:31.724 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 2m ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:27:31.724 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 2m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:27:31.724 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 2m ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:27:31.724 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 2m ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:27:31.724 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 2m ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:27:31.725 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 2m ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:27:31.725 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 2m ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:27:32.089 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:27:32.089 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:27:32.089 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:27:32.090 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:27:32.090 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:27:32.090 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:27:32.090 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:27:32.090 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:27:32.091 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:27:32.091 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:27:32.091 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:27:32.091 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:27:32.091 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:27:32.092 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:27:32.092 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:27:32.092 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:27:32.092 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:27:32.092 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:27:32.093 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:27:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:30.721726+0000 mgr.smithi067.rdualw (mgr.24569) 8311 : cluster [DBG] pgmap v7159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:32.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:27:31.413418+0000 mgr.smithi067.rdualw (mgr.24569) 8312 : audit [DBG] from='client.39682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:27:32.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:27:32.088143+0000 mon.smithi061 (mon.0) 1799 : audit [DBG] from='client.? 172.21.15.61:0/3806997280' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:27:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:30.721726+0000 mgr.smithi067.rdualw (mgr.24569) 8311 : cluster [DBG] pgmap v7159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:27:31.413418+0000 mgr.smithi067.rdualw (mgr.24569) 8312 : audit [DBG] from='client.39682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:27:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:27:32.088143+0000 mon.smithi061 (mon.0) 1799 : audit [DBG] from='client.? 172.21.15.61:0/3806997280' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:27:33.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:27:31.703023+0000 mgr.smithi067.rdualw (mgr.24569) 8313 : audit [DBG] from='client.39686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:27:33.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:27:31.703023+0000 mgr.smithi067.rdualw (mgr.24569) 8313 : audit [DBG] from='client.39686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:27:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:32.722165+0000 mgr.smithi067.rdualw (mgr.24569) 8314 : cluster [DBG] pgmap v7160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:32.722165+0000 mgr.smithi067.rdualw (mgr.24569) 8314 : cluster [DBG] pgmap v7160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:34.722854+0000 mgr.smithi067.rdualw (mgr.24569) 8315 : cluster [DBG] pgmap v7161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:27:35.750622+0000 mon.smithi067 (mon.1) 1270 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:27:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:27:35.750764+0000 mon.smithi061 (mon.0) 1800 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:27:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:27:35.750880+0000 mon.smithi067 (mon.1) 1271 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:27:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:27:35.751047+0000 mon.smithi061 (mon.0) 1801 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:27:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:34.722854+0000 mgr.smithi067.rdualw (mgr.24569) 8315 : cluster [DBG] pgmap v7161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:27:35.750622+0000 mon.smithi067 (mon.1) 1270 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:27:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:27:35.750764+0000 mon.smithi061 (mon.0) 1800 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:27:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:27:35.750880+0000 mon.smithi067 (mon.1) 1271 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:27:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:27:35.751047+0000 mon.smithi061 (mon.0) 1801 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:27:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:36.723856+0000 mgr.smithi067.rdualw (mgr.24569) 8316 : cluster [DBG] pgmap v7162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:27:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:36.723856+0000 mgr.smithi067.rdualw (mgr.24569) 8316 : cluster [DBG] pgmap v7162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:27:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:38.724623+0000 mgr.smithi067.rdualw (mgr.24569) 8317 : cluster [DBG] pgmap v7163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:38.724623+0000 mgr.smithi067.rdualw (mgr.24569) 8317 : cluster [DBG] pgmap v7163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:42.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:40.725643+0000 mgr.smithi067.rdualw (mgr.24569) 8318 : cluster [DBG] pgmap v7164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:40.725643+0000 mgr.smithi067.rdualw (mgr.24569) 8318 : cluster [DBG] pgmap v7164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:42.726197+0000 mgr.smithi067.rdualw (mgr.24569) 8319 : cluster [DBG] pgmap v7165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:42.726197+0000 mgr.smithi067.rdualw (mgr.24569) 8319 : cluster [DBG] pgmap v7165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:44.726895+0000 mgr.smithi067.rdualw (mgr.24569) 8320 : cluster [DBG] pgmap v7166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:44.726895+0000 mgr.smithi067.rdualw (mgr.24569) 8320 : cluster [DBG] pgmap v7166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:46.727946+0000 mgr.smithi067.rdualw (mgr.24569) 8321 : cluster [DBG] pgmap v7167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:27:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:46.727946+0000 mgr.smithi067.rdualw (mgr.24569) 8321 : cluster [DBG] pgmap v7167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:27:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:48.728407+0000 mgr.smithi067.rdualw (mgr.24569) 8322 : cluster [DBG] pgmap v7168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:48.728407+0000 mgr.smithi067.rdualw (mgr.24569) 8322 : cluster [DBG] pgmap v7168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:50.729457+0000 mgr.smithi067.rdualw (mgr.24569) 8323 : cluster [DBG] pgmap v7169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:50.729457+0000 mgr.smithi067.rdualw (mgr.24569) 8323 : cluster [DBG] pgmap v7169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:52.729990+0000 mgr.smithi067.rdualw (mgr.24569) 8324 : cluster [DBG] pgmap v7170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:52.729990+0000 mgr.smithi067.rdualw (mgr.24569) 8324 : cluster [DBG] pgmap v7170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:54.730564+0000 mgr.smithi067.rdualw (mgr.24569) 8325 : cluster [DBG] pgmap v7171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:54.730564+0000 mgr.smithi067.rdualw (mgr.24569) 8325 : cluster [DBG] pgmap v7171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:27:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:56.731376+0000 mgr.smithi067.rdualw (mgr.24569) 8326 : cluster [DBG] pgmap v7172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:27:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:56.731376+0000 mgr.smithi067.rdualw (mgr.24569) 8326 : cluster [DBG] pgmap v7172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:28:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:27:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:27:58.732100+0000 mgr.smithi067.rdualw (mgr.24569) 8327 : cluster [DBG] pgmap v7173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:27:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:27:58.732100+0000 mgr.smithi067.rdualw (mgr.24569) 8327 : cluster [DBG] pgmap v7173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:00.732969+0000 mgr.smithi067.rdualw (mgr.24569) 8328 : cluster [DBG] pgmap v7174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:00.732969+0000 mgr.smithi067.rdualw (mgr.24569) 8328 : cluster [DBG] pgmap v7174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:02.401 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:28:02.692 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:28:02.692 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 2m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:28:02.693 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 2m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:28:02.693 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 2m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:28:02.694 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 2m ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:28:02.694 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 2m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:28:02.694 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 2m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:28:02.695 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (3h) 2m ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:28:02.695 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 2m ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:28:02.695 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 2m ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:28:02.695 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 2m ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:28:02.696 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 2m ago 3h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:28:02.696 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (3h) 2m ago 3h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:28:02.696 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 2m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:28:02.696 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 2m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:28:02.697 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 2m ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:28:02.697 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 2m ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:28:02.697 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 2m ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:28:02.697 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 2m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:28:02.698 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 2m ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:28:02.698 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 2m ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:28:02.698 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 2m ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:28:02.698 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 2m ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:28:02.699 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 2m ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:28:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:28:02.388618+0000 mgr.smithi067.rdualw (mgr.24569) 8329 : audit [DBG] from='client.39694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:28:03.056 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:28:03.057 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:28:03.057 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:28:03.057 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:28:03.057 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:28:03.058 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:28:03.058 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:28:03.058 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:28:03.058 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:28:03.059 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:28:03.059 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:28:03.059 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:28:03.060 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:28:03.060 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:28:03.060 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:28:03.060 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:28:03.061 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:28:03.061 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:28:03.061 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:28:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:28:02.388618+0000 mgr.smithi067.rdualw (mgr.24569) 8329 : audit [DBG] from='client.39694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:28:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:28:02.674719+0000 mgr.smithi067.rdualw (mgr.24569) 8330 : audit [DBG] from='client.39698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:28:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:02.733501+0000 mgr.smithi067.rdualw (mgr.24569) 8331 : cluster [DBG] pgmap v7175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:28:03.055755+0000 mon.smithi061 (mon.0) 1802 : audit [DBG] from='client.? 172.21.15.61:0/1882190022' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:28:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:28:02.674719+0000 mgr.smithi067.rdualw (mgr.24569) 8330 : audit [DBG] from='client.39698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:28:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:02.733501+0000 mgr.smithi067.rdualw (mgr.24569) 8331 : cluster [DBG] pgmap v7175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:28:03.055755+0000 mon.smithi061 (mon.0) 1802 : audit [DBG] from='client.? 172.21.15.61:0/1882190022' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:28:06.065 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:04.734104+0000 mgr.smithi067.rdualw (mgr.24569) 8332 : cluster [DBG] pgmap v7176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:04.734104+0000 mgr.smithi067.rdualw (mgr.24569) 8332 : cluster [DBG] pgmap v7176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:06.735031+0000 mgr.smithi067.rdualw (mgr.24569) 8333 : cluster [DBG] pgmap v7177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:28:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:06.735031+0000 mgr.smithi067.rdualw (mgr.24569) 8333 : cluster [DBG] pgmap v7177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:28:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:08.735629+0000 mgr.smithi067.rdualw (mgr.24569) 8334 : cluster [DBG] pgmap v7178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:08.735629+0000 mgr.smithi067.rdualw (mgr.24569) 8334 : cluster [DBG] pgmap v7178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:12.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:10.736467+0000 mgr.smithi067.rdualw (mgr.24569) 8335 : cluster [DBG] pgmap v7179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:12.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:10.736467+0000 mgr.smithi067.rdualw (mgr.24569) 8335 : cluster [DBG] pgmap v7179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:12.737008+0000 mgr.smithi067.rdualw (mgr.24569) 8336 : cluster [DBG] pgmap v7180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:12.737008+0000 mgr.smithi067.rdualw (mgr.24569) 8336 : cluster [DBG] pgmap v7180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:14.737688+0000 mgr.smithi067.rdualw (mgr.24569) 8337 : cluster [DBG] pgmap v7181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:14.737688+0000 mgr.smithi067.rdualw (mgr.24569) 8337 : cluster [DBG] pgmap v7181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:16.738723+0000 mgr.smithi067.rdualw (mgr.24569) 8338 : cluster [DBG] pgmap v7182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:28:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:16.738723+0000 mgr.smithi067.rdualw (mgr.24569) 8338 : cluster [DBG] pgmap v7182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:28:20.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:18.739187+0000 mgr.smithi067.rdualw (mgr.24569) 8339 : cluster [DBG] pgmap v7183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:18.739187+0000 mgr.smithi067.rdualw (mgr.24569) 8339 : cluster [DBG] pgmap v7183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:20.739997+0000 mgr.smithi067.rdualw (mgr.24569) 8340 : cluster [DBG] pgmap v7184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:20.739997+0000 mgr.smithi067.rdualw (mgr.24569) 8340 : cluster [DBG] pgmap v7184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:24.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:22.740574+0000 mgr.smithi067.rdualw (mgr.24569) 8341 : cluster [DBG] pgmap v7185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:22.740574+0000 mgr.smithi067.rdualw (mgr.24569) 8341 : cluster [DBG] pgmap v7185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:24.741313+0000 mgr.smithi067.rdualw (mgr.24569) 8342 : cluster [DBG] pgmap v7186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:26.067 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:24.741313+0000 mgr.smithi067.rdualw (mgr.24569) 8342 : cluster [DBG] pgmap v7186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:27.766 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:28:26.567301+0000 mon.smithi067 (mon.1) 1272 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:28:27.766 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:28:26.568761+0000 mon.smithi067 (mon.1) 1273 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:28:27.766 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:28:26.569747+0000 mon.smithi067 (mon.1) 1274 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:28:27.767 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:28:26.570634+0000 mgr.smithi067.rdualw (mgr.24569) 8343 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:28:27.767 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:26.742032+0000 mgr.smithi067.rdualw (mgr.24569) 8344 : cluster [DBG] pgmap v7187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:28:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:28:26.567301+0000 mon.smithi067 (mon.1) 1272 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:28:27.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:28:26.568761+0000 mon.smithi067 (mon.1) 1273 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:28:27.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:28:26.569747+0000 mon.smithi067 (mon.1) 1274 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:28:27.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:28:26.570634+0000 mgr.smithi067.rdualw (mgr.24569) 8343 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:28:27.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:26.742032+0000 mgr.smithi067.rdualw (mgr.24569) 8344 : cluster [DBG] pgmap v7187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:28:30.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:28.742578+0000 mgr.smithi067.rdualw (mgr.24569) 8345 : cluster [DBG] pgmap v7188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:28.742578+0000 mgr.smithi067.rdualw (mgr.24569) 8345 : cluster [DBG] pgmap v7188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:31.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:28:30.116122+0000 mon.smithi061 (mon.0) 1803 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:28:31.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:28:30.528911+0000 mon.smithi061 (mon.0) 1804 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:28:31.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:28:30.537967+0000 mon.smithi061 (mon.0) 1805 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:28:31.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:28:30.116122+0000 mon.smithi061 (mon.0) 1803 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:28:31.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:28:30.528911+0000 mon.smithi061 (mon.0) 1804 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:28:31.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:28:30.537967+0000 mon.smithi061 (mon.0) 1805 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:28:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:30.743413+0000 mgr.smithi067.rdualw (mgr.24569) 8346 : cluster [DBG] pgmap v7189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:30.743413+0000 mgr.smithi067.rdualw (mgr.24569) 8346 : cluster [DBG] pgmap v7189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:33.363 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:28:33.659 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:28:33.659 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 3m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:28:33.659 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 3m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:28:33.659 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 3m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:28:33.660 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 3m ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:28:33.660 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 3m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:28:33.660 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 3m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:28:33.660 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 3m ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:28:33.661 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (3h) 3m ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:28:33.661 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (3h) 3m ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:28:33.661 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (3h) 3m ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:28:33.661 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 3m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:28:33.661 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 3m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:28:33.662 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 3m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:28:33.662 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 3m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:28:33.662 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 3m ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:28:33.663 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 3m ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:28:33.663 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 3m ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:28:33.663 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 3m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:28:33.663 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 3m ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:28:33.664 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 3m ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:28:33.664 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 3m ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:28:33.664 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 3m ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:28:33.664 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 3m ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:28:33.998 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:28:33.999 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:28:33.999 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:28:33.999 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:28:34.000 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:28:34.000 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:28:34.000 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:28:34.000 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:28:34.000 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:28:34.001 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:28:34.001 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:28:34.001 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:28:34.001 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:28:34.002 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:28:34.002 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:28:34.002 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:28:34.003 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:28:34.003 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:28:34.003 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:28:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:32.743897+0000 mgr.smithi067.rdualw (mgr.24569) 8347 : cluster [DBG] pgmap v7190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:28:33.350343+0000 mgr.smithi067.rdualw (mgr.24569) 8348 : audit [DBG] from='client.39706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:28:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:28:33.997575+0000 mon.smithi061 (mon.0) 1806 : audit [DBG] from='client.? 172.21.15.61:0/2739504256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:28:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:32.743897+0000 mgr.smithi067.rdualw (mgr.24569) 8347 : cluster [DBG] pgmap v7190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:28:33.350343+0000 mgr.smithi067.rdualw (mgr.24569) 8348 : audit [DBG] from='client.39706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:28:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:28:33.997575+0000 mon.smithi061 (mon.0) 1806 : audit [DBG] from='client.? 172.21.15.61:0/2739504256' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:28:35.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:28:33.641412+0000 mgr.smithi067.rdualw (mgr.24569) 8349 : audit [DBG] from='client.39710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:28:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:28:33.641412+0000 mgr.smithi067.rdualw (mgr.24569) 8349 : audit [DBG] from='client.39710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:28:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:34.744526+0000 mgr.smithi067.rdualw (mgr.24569) 8350 : cluster [DBG] pgmap v7191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:28:35.756460+0000 mon.smithi067 (mon.1) 1275 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:28:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:28:35.756593+0000 mon.smithi061 (mon.0) 1807 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:28:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:28:35.756715+0000 mon.smithi067 (mon.1) 1276 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:28:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:28:35.756877+0000 mon.smithi061 (mon.0) 1808 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:28:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:34.744526+0000 mgr.smithi067.rdualw (mgr.24569) 8350 : cluster [DBG] pgmap v7191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:28:35.756460+0000 mon.smithi067 (mon.1) 1275 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:28:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:28:35.756593+0000 mon.smithi061 (mon.0) 1807 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:28:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:28:35.756715+0000 mon.smithi067 (mon.1) 1276 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:28:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:28:35.756877+0000 mon.smithi061 (mon.0) 1808 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:28:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:36.745588+0000 mgr.smithi067.rdualw (mgr.24569) 8351 : cluster [DBG] pgmap v7192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:28:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:36.745588+0000 mgr.smithi067.rdualw (mgr.24569) 8351 : cluster [DBG] pgmap v7192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:28:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:38.746058+0000 mgr.smithi067.rdualw (mgr.24569) 8352 : cluster [DBG] pgmap v7193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:38.746058+0000 mgr.smithi067.rdualw (mgr.24569) 8352 : cluster [DBG] pgmap v7193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:42.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:40.746871+0000 mgr.smithi067.rdualw (mgr.24569) 8353 : cluster [DBG] pgmap v7194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:42.070 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:40.746871+0000 mgr.smithi067.rdualw (mgr.24569) 8353 : cluster [DBG] pgmap v7194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:42.747459+0000 mgr.smithi067.rdualw (mgr.24569) 8354 : cluster [DBG] pgmap v7195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:44.070 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:42.747459+0000 mgr.smithi067.rdualw (mgr.24569) 8354 : cluster [DBG] pgmap v7195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:44.748198+0000 mgr.smithi067.rdualw (mgr.24569) 8355 : cluster [DBG] pgmap v7196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:46.071 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:44.748198+0000 mgr.smithi067.rdualw (mgr.24569) 8355 : cluster [DBG] pgmap v7196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:46.749199+0000 mgr.smithi067.rdualw (mgr.24569) 8356 : cluster [DBG] pgmap v7197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:28:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:46.749199+0000 mgr.smithi067.rdualw (mgr.24569) 8356 : cluster [DBG] pgmap v7197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:28:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:48.749718+0000 mgr.smithi067.rdualw (mgr.24569) 8357 : cluster [DBG] pgmap v7198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:50.071 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:48.749718+0000 mgr.smithi067.rdualw (mgr.24569) 8357 : cluster [DBG] pgmap v7198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:50.750586+0000 mgr.smithi067.rdualw (mgr.24569) 8358 : cluster [DBG] pgmap v7199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:50.750586+0000 mgr.smithi067.rdualw (mgr.24569) 8358 : cluster [DBG] pgmap v7199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:52.751356+0000 mgr.smithi067.rdualw (mgr.24569) 8359 : cluster [DBG] pgmap v7200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:52.751356+0000 mgr.smithi067.rdualw (mgr.24569) 8359 : cluster [DBG] pgmap v7200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:54.752171+0000 mgr.smithi067.rdualw (mgr.24569) 8360 : cluster [DBG] pgmap v7201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:56.072 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:54.752171+0000 mgr.smithi067.rdualw (mgr.24569) 8360 : cluster [DBG] pgmap v7201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:28:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:56.753006+0000 mgr.smithi067.rdualw (mgr.24569) 8361 : cluster [DBG] pgmap v7202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:28:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:56.753006+0000 mgr.smithi067.rdualw (mgr.24569) 8361 : cluster [DBG] pgmap v7202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:29:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:28:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:28:58.753729+0000 mgr.smithi067.rdualw (mgr.24569) 8362 : cluster [DBG] pgmap v7203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:00.073 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:28:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:28:58.753729+0000 mgr.smithi067.rdualw (mgr.24569) 8362 : cluster [DBG] pgmap v7203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:00.754868+0000 mgr.smithi067.rdualw (mgr.24569) 8363 : cluster [DBG] pgmap v7204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:00.754868+0000 mgr.smithi067.rdualw (mgr.24569) 8363 : cluster [DBG] pgmap v7204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:03.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:02.755514+0000 mgr.smithi067.rdualw (mgr.24569) 8364 : cluster [DBG] pgmap v7205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:03.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:02.755514+0000 mgr.smithi067.rdualw (mgr.24569) 8364 : cluster [DBG] pgmap v7205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:04.308 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:29:04.600 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:29:04.601 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 3m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:29:04.601 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 3m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:29:04.602 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 3m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:29:04.602 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 3m ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:29:04.602 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (3h) 3m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:29:04.602 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (3h) 3m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:29:04.603 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 3m ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:29:04.603 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 3m ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:29:04.603 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 3m ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:29:04.604 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 3m ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:29:04.604 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 3m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:29:04.605 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 3m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:29:04.605 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 3m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:29:04.605 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 3m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:29:04.605 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 3m ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:29:04.606 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 3m ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:29:04.606 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 3m ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:29:04.606 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 3m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:29:04.607 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 3m ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:29:04.607 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 3m ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:29:04.607 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 3m ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:29:04.608 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 3m ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:29:04.608 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 3m ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:29:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:29:04.295063+0000 mgr.smithi067.rdualw (mgr.24569) 8365 : audit [DBG] from='client.39718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:29:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:29:04.295063+0000 mgr.smithi067.rdualw (mgr.24569) 8365 : audit [DBG] from='client.39718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:29:04.946 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:29:04.946 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:29:04.947 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:29:04.947 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:29:04.947 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:29:04.947 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:29:04.948 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:29:04.948 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:29:04.948 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:29:04.948 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:29:04.949 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:29:04.949 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:29:04.949 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:29:04.949 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:29:04.949 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:29:04.950 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:29:04.950 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:29:04.950 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:29:04.950 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:29:05.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:29:04.582584+0000 mgr.smithi067.rdualw (mgr.24569) 8366 : audit [DBG] from='client.39722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:29:05.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:04.756135+0000 mgr.smithi067.rdualw (mgr.24569) 8367 : cluster [DBG] pgmap v7206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:05.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:29:04.945322+0000 mon.smithi061 (mon.0) 1809 : audit [DBG] from='client.? 172.21.15.61:0/3938805941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:29:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:29:04.582584+0000 mgr.smithi067.rdualw (mgr.24569) 8366 : audit [DBG] from='client.39722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:29:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:04.756135+0000 mgr.smithi067.rdualw (mgr.24569) 8367 : cluster [DBG] pgmap v7206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:29:04.945322+0000 mon.smithi061 (mon.0) 1809 : audit [DBG] from='client.? 172.21.15.61:0/3938805941' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:29:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:06.756996+0000 mgr.smithi067.rdualw (mgr.24569) 8368 : cluster [DBG] pgmap v7207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:29:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:06.756996+0000 mgr.smithi067.rdualw (mgr.24569) 8368 : cluster [DBG] pgmap v7207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:29:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:08.757513+0000 mgr.smithi067.rdualw (mgr.24569) 8369 : cluster [DBG] pgmap v7208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:10.074 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:08.757513+0000 mgr.smithi067.rdualw (mgr.24569) 8369 : cluster [DBG] pgmap v7208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:10.758318+0000 mgr.smithi067.rdualw (mgr.24569) 8370 : cluster [DBG] pgmap v7209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:10.758318+0000 mgr.smithi067.rdualw (mgr.24569) 8370 : cluster [DBG] pgmap v7209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:13.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:12.758919+0000 mgr.smithi067.rdualw (mgr.24569) 8371 : cluster [DBG] pgmap v7210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:12.758919+0000 mgr.smithi067.rdualw (mgr.24569) 8371 : cluster [DBG] pgmap v7210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:16.079 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:14.759506+0000 mgr.smithi067.rdualw (mgr.24569) 8372 : cluster [DBG] pgmap v7211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:14.759506+0000 mgr.smithi067.rdualw (mgr.24569) 8372 : cluster [DBG] pgmap v7211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:16.760336+0000 mgr.smithi067.rdualw (mgr.24569) 8373 : cluster [DBG] pgmap v7212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:29:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:16.760336+0000 mgr.smithi067.rdualw (mgr.24569) 8373 : cluster [DBG] pgmap v7212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:29:20.076 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:18.760891+0000 mgr.smithi067.rdualw (mgr.24569) 8374 : cluster [DBG] pgmap v7213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:18.760891+0000 mgr.smithi067.rdualw (mgr.24569) 8374 : cluster [DBG] pgmap v7213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:20.761720+0000 mgr.smithi067.rdualw (mgr.24569) 8375 : cluster [DBG] pgmap v7214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:20.761720+0000 mgr.smithi067.rdualw (mgr.24569) 8375 : cluster [DBG] pgmap v7214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:22.762257+0000 mgr.smithi067.rdualw (mgr.24569) 8376 : cluster [DBG] pgmap v7215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:22.762257+0000 mgr.smithi067.rdualw (mgr.24569) 8376 : cluster [DBG] pgmap v7215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:26.077 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:24.762846+0000 mgr.smithi067.rdualw (mgr.24569) 8377 : cluster [DBG] pgmap v7216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:24.762846+0000 mgr.smithi067.rdualw (mgr.24569) 8377 : cluster [DBG] pgmap v7216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:26.763674+0000 mgr.smithi067.rdualw (mgr.24569) 8378 : cluster [DBG] pgmap v7217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:29:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:26.763674+0000 mgr.smithi067.rdualw (mgr.24569) 8378 : cluster [DBG] pgmap v7217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:29:29.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:28.764206+0000 mgr.smithi067.rdualw (mgr.24569) 8379 : cluster [DBG] pgmap v7218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:29.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:28.764206+0000 mgr.smithi067.rdualw (mgr.24569) 8379 : cluster [DBG] pgmap v7218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:29:30.544677+0000 mon.smithi067 (mon.1) 1277 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:29:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:29:30.546126+0000 mon.smithi067 (mon.1) 1278 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:29:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:29:30.547084+0000 mon.smithi067 (mon.1) 1279 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:29:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:29:30.544677+0000 mon.smithi067 (mon.1) 1277 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:29:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:29:30.546126+0000 mon.smithi067 (mon.1) 1278 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:29:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:29:30.547084+0000 mon.smithi067 (mon.1) 1279 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:29:32.727 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:29:30.547935+0000 mgr.smithi067.rdualw (mgr.24569) 8380 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:29:32.728 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:30.765127+0000 mgr.smithi067.rdualw (mgr.24569) 8381 : cluster [DBG] pgmap v7219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:29:30.547935+0000 mgr.smithi067.rdualw (mgr.24569) 8380 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:29:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:30.765127+0000 mgr.smithi067.rdualw (mgr.24569) 8381 : cluster [DBG] pgmap v7219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:32.765607+0000 mgr.smithi067.rdualw (mgr.24569) 8382 : cluster [DBG] pgmap v7220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:29:33.359148+0000 mon.smithi061 (mon.0) 1810 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:29:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:29:33.767004+0000 mon.smithi061 (mon.0) 1811 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:29:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:29:33.774438+0000 mon.smithi061 (mon.0) 1812 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:29:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:32.765607+0000 mgr.smithi067.rdualw (mgr.24569) 8382 : cluster [DBG] pgmap v7220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:29:33.359148+0000 mon.smithi061 (mon.0) 1810 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:29:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:29:33.767004+0000 mon.smithi061 (mon.0) 1811 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:29:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:29:33.774438+0000 mon.smithi061 (mon.0) 1812 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:29:35.276 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:29:35.569 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:29:35.569 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 4m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:29:35.570 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (3h) 4m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:29:35.570 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (3h) 4m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:29:35.570 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 4m ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:29:35.571 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 4m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:29:35.571 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 4m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:29:35.571 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 4m ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:29:35.571 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 4m ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:29:35.571 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 4m ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:29:35.572 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 4m ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:29:35.572 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 4m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:29:35.572 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 4m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:29:35.572 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 4m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:29:35.573 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 4m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:29:35.573 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 4m ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:29:35.573 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 4m ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:29:35.573 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 4m ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:29:35.573 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 4m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:29:35.574 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 4m ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:29:35.574 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 4m ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:29:35.574 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 4m ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:29:35.574 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 4m ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:29:35.575 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 4m ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:29:35.911 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:29:35.912 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:29:35.912 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:29:35.912 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:29:35.912 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:29:35.913 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:29:35.913 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:29:35.913 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:29:35.913 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:29:35.914 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:29:35.914 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:29:35.914 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:29:35.914 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:29:35.914 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:29:35.915 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:29:35.915 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:29:35.915 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:29:35.915 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:29:35.915 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:29:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:34.766142+0000 mgr.smithi067.rdualw (mgr.24569) 8383 : cluster [DBG] pgmap v7221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:29:35.260818+0000 mgr.smithi067.rdualw (mgr.24569) 8384 : audit [DBG] from='client.39730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:29:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:29:35.762128+0000 mon.smithi067 (mon.1) 1280 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:29:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:29:35.762318+0000 mon.smithi061 (mon.0) 1813 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:29:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:29:35.762393+0000 mon.smithi067 (mon.1) 1281 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:29:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:29:35.762621+0000 mon.smithi061 (mon.0) 1814 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:29:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:29:35.910580+0000 mon.smithi061 (mon.0) 1815 : audit [DBG] from='client.? 172.21.15.61:0/3259347722' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:29:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:34.766142+0000 mgr.smithi067.rdualw (mgr.24569) 8383 : cluster [DBG] pgmap v7221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:29:35.260818+0000 mgr.smithi067.rdualw (mgr.24569) 8384 : audit [DBG] from='client.39730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:29:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:29:35.762128+0000 mon.smithi067 (mon.1) 1280 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:29:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:29:35.762318+0000 mon.smithi061 (mon.0) 1813 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:29:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:29:35.762393+0000 mon.smithi067 (mon.1) 1281 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:29:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:29:35.762621+0000 mon.smithi061 (mon.0) 1814 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:29:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:29:35.910580+0000 mon.smithi061 (mon.0) 1815 : audit [DBG] from='client.? 172.21.15.61:0/3259347722' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:29:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:29:35.551956+0000 mgr.smithi067.rdualw (mgr.24569) 8385 : audit [DBG] from='client.39734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:29:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:36.767244+0000 mgr.smithi067.rdualw (mgr.24569) 8386 : cluster [DBG] pgmap v7222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:29:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:29:35.551956+0000 mgr.smithi067.rdualw (mgr.24569) 8385 : audit [DBG] from='client.39734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:29:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:36.767244+0000 mgr.smithi067.rdualw (mgr.24569) 8386 : cluster [DBG] pgmap v7222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:29:40.079 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:38.767894+0000 mgr.smithi067.rdualw (mgr.24569) 8387 : cluster [DBG] pgmap v7223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:38.767894+0000 mgr.smithi067.rdualw (mgr.24569) 8387 : cluster [DBG] pgmap v7223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:42.079 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:40.768771+0000 mgr.smithi067.rdualw (mgr.24569) 8388 : cluster [DBG] pgmap v7224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:40.768771+0000 mgr.smithi067.rdualw (mgr.24569) 8388 : cluster [DBG] pgmap v7224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:44.080 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:42.769290+0000 mgr.smithi067.rdualw (mgr.24569) 8389 : cluster [DBG] pgmap v7225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:42.769290+0000 mgr.smithi067.rdualw (mgr.24569) 8389 : cluster [DBG] pgmap v7225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:44.770079+0000 mgr.smithi067.rdualw (mgr.24569) 8390 : cluster [DBG] pgmap v7226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:46.326 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:44.770079+0000 mgr.smithi067.rdualw (mgr.24569) 8390 : cluster [DBG] pgmap v7226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:46.770957+0000 mgr.smithi067.rdualw (mgr.24569) 8391 : cluster [DBG] pgmap v7227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:29:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:46.770957+0000 mgr.smithi067.rdualw (mgr.24569) 8391 : cluster [DBG] pgmap v7227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:29:50.081 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:48.771556+0000 mgr.smithi067.rdualw (mgr.24569) 8392 : cluster [DBG] pgmap v7228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:48.771556+0000 mgr.smithi067.rdualw (mgr.24569) 8392 : cluster [DBG] pgmap v7228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:52.081 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:50.772302+0000 mgr.smithi067.rdualw (mgr.24569) 8393 : cluster [DBG] pgmap v7229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:50.772302+0000 mgr.smithi067.rdualw (mgr.24569) 8393 : cluster [DBG] pgmap v7229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:52.772793+0000 mgr.smithi067.rdualw (mgr.24569) 8394 : cluster [DBG] pgmap v7230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:52.772793+0000 mgr.smithi067.rdualw (mgr.24569) 8394 : cluster [DBG] pgmap v7230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:54.773547+0000 mgr.smithi067.rdualw (mgr.24569) 8395 : cluster [DBG] pgmap v7231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:54.773547+0000 mgr.smithi067.rdualw (mgr.24569) 8395 : cluster [DBG] pgmap v7231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:29:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:56.774336+0000 mgr.smithi067.rdualw (mgr.24569) 8396 : cluster [DBG] pgmap v7232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:29:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:56.774336+0000 mgr.smithi067.rdualw (mgr.24569) 8396 : cluster [DBG] pgmap v7232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:30:00.082 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:29:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:29:58.775067+0000 mgr.smithi067.rdualw (mgr.24569) 8397 : cluster [DBG] pgmap v7233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:29:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:29:58.775067+0000 mgr.smithi067.rdualw (mgr.24569) 8397 : cluster [DBG] pgmap v7233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:00.000127+0000 mon.smithi061 (mon.0) 1816 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T19:30:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:00.000127+0000 mon.smithi061 (mon.0) 1816 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T19:30:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:00.775874+0000 mgr.smithi067.rdualw (mgr.24569) 8398 : cluster [DBG] pgmap v7234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:00.775874+0000 mgr.smithi067.rdualw (mgr.24569) 8398 : cluster [DBG] pgmap v7234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:02.776455+0000 mgr.smithi067.rdualw (mgr.24569) 8399 : cluster [DBG] pgmap v7235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:02.776455+0000 mgr.smithi067.rdualw (mgr.24569) 8399 : cluster [DBG] pgmap v7235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:06.249 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:30:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:04.777017+0000 mgr.smithi067.rdualw (mgr.24569) 8400 : cluster [DBG] pgmap v7236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:04.777017+0000 mgr.smithi067.rdualw (mgr.24569) 8400 : cluster [DBG] pgmap v7236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:06.540 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:30:06.540 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 4m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:30:06.540 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 4m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:30:06.540 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 4m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:30:06.541 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 4m ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:30:06.541 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 4m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:30:06.541 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 4m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:30:06.541 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 4m ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:30:06.542 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 4m ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:30:06.542 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 4m ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:30:06.542 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 4m ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:30:06.542 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 4m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:30:06.543 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 4m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:30:06.543 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 4m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:30:06.543 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 4m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:30:06.543 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 4m ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:30:06.543 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 4m ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:30:06.544 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 4m ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:30:06.544 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 4m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:30:06.544 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 4m ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:30:06.544 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 4m ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:30:06.545 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 4m ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:30:06.545 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 4m ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:30:06.545 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 4m ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:30:06.881 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:30:06.881 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:30:06.882 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:30:06.882 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:30:06.882 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:30:06.882 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:30:06.882 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:30:06.883 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:30:06.883 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:30:06.883 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:30:06.883 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:30:06.884 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:30:06.884 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:30:06.884 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:30:06.884 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:30:06.884 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:30:06.885 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:30:06.885 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:30:06.885 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:30:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:30:06.236125+0000 mgr.smithi067.rdualw (mgr.24569) 8401 : audit [DBG] from='client.39742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:30:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:30:06.236125+0000 mgr.smithi067.rdualw (mgr.24569) 8401 : audit [DBG] from='client.39742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:30:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:30:06.522776+0000 mgr.smithi067.rdualw (mgr.24569) 8402 : audit [DBG] from='client.39746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:30:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:06.777934+0000 mgr.smithi067.rdualw (mgr.24569) 8403 : cluster [DBG] pgmap v7237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:30:08.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:30:06.879999+0000 mon.smithi061 (mon.0) 1817 : audit [DBG] from='client.? 172.21.15.61:0/4041184034' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:30:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:30:06.522776+0000 mgr.smithi067.rdualw (mgr.24569) 8402 : audit [DBG] from='client.39746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:30:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:06.777934+0000 mgr.smithi067.rdualw (mgr.24569) 8403 : cluster [DBG] pgmap v7237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:30:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:30:06.879999+0000 mon.smithi061 (mon.0) 1817 : audit [DBG] from='client.? 172.21.15.61:0/4041184034' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:30:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:08.778605+0000 mgr.smithi067.rdualw (mgr.24569) 8404 : cluster [DBG] pgmap v7238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:08.778605+0000 mgr.smithi067.rdualw (mgr.24569) 8404 : cluster [DBG] pgmap v7238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:10.779486+0000 mgr.smithi067.rdualw (mgr.24569) 8405 : cluster [DBG] pgmap v7239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:10.779486+0000 mgr.smithi067.rdualw (mgr.24569) 8405 : cluster [DBG] pgmap v7239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:12.779933+0000 mgr.smithi067.rdualw (mgr.24569) 8406 : cluster [DBG] pgmap v7240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:12.779933+0000 mgr.smithi067.rdualw (mgr.24569) 8406 : cluster [DBG] pgmap v7240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:14.780693+0000 mgr.smithi067.rdualw (mgr.24569) 8407 : cluster [DBG] pgmap v7241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:14.780693+0000 mgr.smithi067.rdualw (mgr.24569) 8407 : cluster [DBG] pgmap v7241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:16.781498+0000 mgr.smithi067.rdualw (mgr.24569) 8408 : cluster [DBG] pgmap v7242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:30:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:16.781498+0000 mgr.smithi067.rdualw (mgr.24569) 8408 : cluster [DBG] pgmap v7242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:30:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:18.782252+0000 mgr.smithi067.rdualw (mgr.24569) 8409 : cluster [DBG] pgmap v7243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:18.782252+0000 mgr.smithi067.rdualw (mgr.24569) 8409 : cluster [DBG] pgmap v7243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:20.783251+0000 mgr.smithi067.rdualw (mgr.24569) 8410 : cluster [DBG] pgmap v7244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:20.783251+0000 mgr.smithi067.rdualw (mgr.24569) 8410 : cluster [DBG] pgmap v7244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:22.783912+0000 mgr.smithi067.rdualw (mgr.24569) 8411 : cluster [DBG] pgmap v7245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:22.783912+0000 mgr.smithi067.rdualw (mgr.24569) 8411 : cluster [DBG] pgmap v7245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:24.784734+0000 mgr.smithi067.rdualw (mgr.24569) 8412 : cluster [DBG] pgmap v7246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:24.784734+0000 mgr.smithi067.rdualw (mgr.24569) 8412 : cluster [DBG] pgmap v7246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:26.785698+0000 mgr.smithi067.rdualw (mgr.24569) 8413 : cluster [DBG] pgmap v7247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:30:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:26.785698+0000 mgr.smithi067.rdualw (mgr.24569) 8413 : cluster [DBG] pgmap v7247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:30:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:28.786396+0000 mgr.smithi067.rdualw (mgr.24569) 8414 : cluster [DBG] pgmap v7248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:28.786396+0000 mgr.smithi067.rdualw (mgr.24569) 8414 : cluster [DBG] pgmap v7248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:30.787174+0000 mgr.smithi067.rdualw (mgr.24569) 8415 : cluster [DBG] pgmap v7249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:30.787174+0000 mgr.smithi067.rdualw (mgr.24569) 8415 : cluster [DBG] pgmap v7249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:32.787702+0000 mgr.smithi067.rdualw (mgr.24569) 8416 : cluster [DBG] pgmap v7250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:30:33.778060+0000 mon.smithi067 (mon.1) 1282 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:30:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:30:33.779476+0000 mon.smithi067 (mon.1) 1283 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:30:34.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:30:33.780383+0000 mon.smithi067 (mon.1) 1284 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:30:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:32.787702+0000 mgr.smithi067.rdualw (mgr.24569) 8416 : cluster [DBG] pgmap v7250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:30:33.778060+0000 mon.smithi067 (mon.1) 1282 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:30:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:30:33.779476+0000 mon.smithi067 (mon.1) 1283 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:30:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:30:33.780383+0000 mon.smithi067 (mon.1) 1284 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:30:35.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:30:33.781209+0000 mgr.smithi067.rdualw (mgr.24569) 8417 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:30:35.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:30:34.203259+0000 mon.smithi061 (mon.0) 1818 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:30:35.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:30:34.208526+0000 mon.smithi061 (mon.0) 1819 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:30:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:30:33.781209+0000 mgr.smithi067.rdualw (mgr.24569) 8417 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:30:35.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:30:34.203259+0000 mon.smithi061 (mon.0) 1818 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:30:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:30:34.208526+0000 mon.smithi061 (mon.0) 1819 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:30:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:34.788212+0000 mgr.smithi067.rdualw (mgr.24569) 8418 : cluster [DBG] pgmap v7251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:30:35.768106+0000 mon.smithi067 (mon.1) 1285 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:30:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:30:35.768294+0000 mon.smithi061 (mon.0) 1820 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:30:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:30:35.768456+0000 mon.smithi067 (mon.1) 1286 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:30:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:30:35.768758+0000 mon.smithi061 (mon.0) 1821 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:30:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:34.788212+0000 mgr.smithi067.rdualw (mgr.24569) 8418 : cluster [DBG] pgmap v7251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:30:35.768106+0000 mon.smithi067 (mon.1) 1285 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:30:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:30:35.768294+0000 mon.smithi061 (mon.0) 1820 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:30:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:30:35.768456+0000 mon.smithi067 (mon.1) 1286 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:30:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:30:35.768758+0000 mon.smithi061 (mon.0) 1821 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:30:37.188 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:30:37.484 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:30:37.484 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 5m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:30:37.485 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 5m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:30:37.485 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 5m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:30:37.485 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 5m ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:30:37.485 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 5m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:30:37.485 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 5m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:30:37.486 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 5m ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:30:37.486 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 5m ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:30:37.486 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 5m ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:30:37.487 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 5m ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:30:37.487 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 5m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:30:37.487 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 5m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:30:37.487 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 5m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:30:37.487 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 5m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:30:37.488 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 5m ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:30:37.488 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 5m ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:30:37.488 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 5m ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:30:37.488 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 5m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:30:37.489 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 5m ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:30:37.489 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 5m ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:30:37.489 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 5m ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:30:37.489 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 5m ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:30:37.489 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 5m ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:30:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:36.789137+0000 mgr.smithi067.rdualw (mgr.24569) 8419 : cluster [DBG] pgmap v7252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:30:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:30:37.175623+0000 mgr.smithi067.rdualw (mgr.24569) 8420 : audit [DBG] from='client.39754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:30:37.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:30:37.466873+0000 mgr.smithi067.rdualw (mgr.24569) 8421 : audit [DBG] from='client.39758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:30:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:36.789137+0000 mgr.smithi067.rdualw (mgr.24569) 8419 : cluster [DBG] pgmap v7252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:30:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:30:37.175623+0000 mgr.smithi067.rdualw (mgr.24569) 8420 : audit [DBG] from='client.39754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:30:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:30:37.466873+0000 mgr.smithi067.rdualw (mgr.24569) 8421 : audit [DBG] from='client.39758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:30:37.843 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:30:37.843 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:30:37.843 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:30:37.844 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:30:37.844 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:30:37.844 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:30:37.844 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:30:37.844 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:30:37.845 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:30:37.845 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:30:37.845 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:30:37.845 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:30:37.846 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:30:37.846 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:30:37.846 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:30:37.846 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:30:37.846 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:30:37.847 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:30:37.847 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:30:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:30:37.841962+0000 mon.smithi061 (mon.0) 1822 : audit [DBG] from='client.? 172.21.15.61:0/1700652559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:30:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:30:37.841962+0000 mon.smithi061 (mon.0) 1822 : audit [DBG] from='client.? 172.21.15.61:0/1700652559' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:30:39.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:38.789697+0000 mgr.smithi067.rdualw (mgr.24569) 8422 : cluster [DBG] pgmap v7253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:39.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:38.789697+0000 mgr.smithi067.rdualw (mgr.24569) 8422 : cluster [DBG] pgmap v7253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:42.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:40.790609+0000 mgr.smithi067.rdualw (mgr.24569) 8423 : cluster [DBG] pgmap v7254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:40.790609+0000 mgr.smithi067.rdualw (mgr.24569) 8423 : cluster [DBG] pgmap v7254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:42.791154+0000 mgr.smithi067.rdualw (mgr.24569) 8424 : cluster [DBG] pgmap v7255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:42.791154+0000 mgr.smithi067.rdualw (mgr.24569) 8424 : cluster [DBG] pgmap v7255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:44.791802+0000 mgr.smithi067.rdualw (mgr.24569) 8425 : cluster [DBG] pgmap v7256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:44.791802+0000 mgr.smithi067.rdualw (mgr.24569) 8425 : cluster [DBG] pgmap v7256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:46.792671+0000 mgr.smithi067.rdualw (mgr.24569) 8426 : cluster [DBG] pgmap v7257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:30:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:46.792671+0000 mgr.smithi067.rdualw (mgr.24569) 8426 : cluster [DBG] pgmap v7257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:30:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:48.793436+0000 mgr.smithi067.rdualw (mgr.24569) 8427 : cluster [DBG] pgmap v7258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:48.793436+0000 mgr.smithi067.rdualw (mgr.24569) 8427 : cluster [DBG] pgmap v7258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:50.794423+0000 mgr.smithi067.rdualw (mgr.24569) 8428 : cluster [DBG] pgmap v7259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:50.794423+0000 mgr.smithi067.rdualw (mgr.24569) 8428 : cluster [DBG] pgmap v7259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:52.795021+0000 mgr.smithi067.rdualw (mgr.24569) 8429 : cluster [DBG] pgmap v7260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:52.795021+0000 mgr.smithi067.rdualw (mgr.24569) 8429 : cluster [DBG] pgmap v7260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:54.795607+0000 mgr.smithi067.rdualw (mgr.24569) 8430 : cluster [DBG] pgmap v7261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:54.795607+0000 mgr.smithi067.rdualw (mgr.24569) 8430 : cluster [DBG] pgmap v7261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:30:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:56.796482+0000 mgr.smithi067.rdualw (mgr.24569) 8431 : cluster [DBG] pgmap v7262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:30:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:56.796482+0000 mgr.smithi067.rdualw (mgr.24569) 8431 : cluster [DBG] pgmap v7262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:31:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:30:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:30:58.797218+0000 mgr.smithi067.rdualw (mgr.24569) 8432 : cluster [DBG] pgmap v7263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:30:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:30:58.797218+0000 mgr.smithi067.rdualw (mgr.24569) 8432 : cluster [DBG] pgmap v7263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:00.798072+0000 mgr.smithi067.rdualw (mgr.24569) 8433 : cluster [DBG] pgmap v7264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:00.798072+0000 mgr.smithi067.rdualw (mgr.24569) 8433 : cluster [DBG] pgmap v7264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:02.798624+0000 mgr.smithi067.rdualw (mgr.24569) 8434 : cluster [DBG] pgmap v7265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:02.798624+0000 mgr.smithi067.rdualw (mgr.24569) 8434 : cluster [DBG] pgmap v7265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:04.799143+0000 mgr.smithi067.rdualw (mgr.24569) 8435 : cluster [DBG] pgmap v7266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:04.799143+0000 mgr.smithi067.rdualw (mgr.24569) 8435 : cluster [DBG] pgmap v7266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:06.800156+0000 mgr.smithi067.rdualw (mgr.24569) 8436 : cluster [DBG] pgmap v7267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:31:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:06.800156+0000 mgr.smithi067.rdualw (mgr.24569) 8436 : cluster [DBG] pgmap v7267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:31:08.155 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:31:08.446 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:31:08.446 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 5m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:31:08.447 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 5m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:31:08.447 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 5m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:31:08.447 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 5m ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:31:08.447 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 5m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:31:08.448 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 5m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:31:08.448 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 5m ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:31:08.448 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 5m ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:31:08.448 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 5m ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:31:08.448 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 5m ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:31:08.449 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 5m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:31:08.449 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 5m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:31:08.449 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 5m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:31:08.449 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 5m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:31:08.450 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 5m ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:31:08.450 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 5m ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:31:08.450 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 5m ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:31:08.450 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 5m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:31:08.450 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 5m ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:31:08.451 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 5m ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:31:08.451 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 5m ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:31:08.451 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 5m ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:31:08.451 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 5m ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:31:08.788 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:31:08.789 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:31:08.789 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:31:08.789 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:31:08.790 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:31:08.790 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:31:08.791 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:31:08.791 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:31:08.792 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:31:08.792 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:31:08.793 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:31:08.793 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:31:08.794 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:31:08.794 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:31:08.795 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:31:08.795 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:31:08.796 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:31:08.796 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:31:08.797 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:31:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:31:08.142276+0000 mgr.smithi067.rdualw (mgr.24569) 8437 : audit [DBG] from='client.39766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:31:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:31:08.428692+0000 mgr.smithi067.rdualw (mgr.24569) 8438 : audit [DBG] from='client.39770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:31:08.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:31:08.142276+0000 mgr.smithi067.rdualw (mgr.24569) 8437 : audit [DBG] from='client.39766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:31:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:31:08.428692+0000 mgr.smithi067.rdualw (mgr.24569) 8438 : audit [DBG] from='client.39770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:31:09.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:31:08.786970+0000 mon.smithi061 (mon.0) 1823 : audit [DBG] from='client.? 172.21.15.61:0/2191118179' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:31:09.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:08.800975+0000 mgr.smithi067.rdualw (mgr.24569) 8439 : cluster [DBG] pgmap v7268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:31:08.786970+0000 mon.smithi061 (mon.0) 1823 : audit [DBG] from='client.? 172.21.15.61:0/2191118179' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:31:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:08.800975+0000 mgr.smithi067.rdualw (mgr.24569) 8439 : cluster [DBG] pgmap v7268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:10.801840+0000 mgr.smithi067.rdualw (mgr.24569) 8440 : cluster [DBG] pgmap v7269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:10.801840+0000 mgr.smithi067.rdualw (mgr.24569) 8440 : cluster [DBG] pgmap v7269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:12.802494+0000 mgr.smithi067.rdualw (mgr.24569) 8441 : cluster [DBG] pgmap v7270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:12.802494+0000 mgr.smithi067.rdualw (mgr.24569) 8441 : cluster [DBG] pgmap v7270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:14.803117+0000 mgr.smithi067.rdualw (mgr.24569) 8442 : cluster [DBG] pgmap v7271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:14.803117+0000 mgr.smithi067.rdualw (mgr.24569) 8442 : cluster [DBG] pgmap v7271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:16.804139+0000 mgr.smithi067.rdualw (mgr.24569) 8443 : cluster [DBG] pgmap v7272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:31:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:16.804139+0000 mgr.smithi067.rdualw (mgr.24569) 8443 : cluster [DBG] pgmap v7272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:31:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:18.804778+0000 mgr.smithi067.rdualw (mgr.24569) 8444 : cluster [DBG] pgmap v7273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:20.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:18.804778+0000 mgr.smithi067.rdualw (mgr.24569) 8444 : cluster [DBG] pgmap v7273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:20.805725+0000 mgr.smithi067.rdualw (mgr.24569) 8445 : cluster [DBG] pgmap v7274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:20.805725+0000 mgr.smithi067.rdualw (mgr.24569) 8445 : cluster [DBG] pgmap v7274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:22.806333+0000 mgr.smithi067.rdualw (mgr.24569) 8446 : cluster [DBG] pgmap v7275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:22.806333+0000 mgr.smithi067.rdualw (mgr.24569) 8446 : cluster [DBG] pgmap v7275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:24.807073+0000 mgr.smithi067.rdualw (mgr.24569) 8447 : cluster [DBG] pgmap v7276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:24.807073+0000 mgr.smithi067.rdualw (mgr.24569) 8447 : cluster [DBG] pgmap v7276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:26.807946+0000 mgr.smithi067.rdualw (mgr.24569) 8448 : cluster [DBG] pgmap v7277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:31:27.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:26.807946+0000 mgr.smithi067.rdualw (mgr.24569) 8448 : cluster [DBG] pgmap v7277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:31:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:28.808613+0000 mgr.smithi067.rdualw (mgr.24569) 8449 : cluster [DBG] pgmap v7278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:28.808613+0000 mgr.smithi067.rdualw (mgr.24569) 8449 : cluster [DBG] pgmap v7278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:30.809450+0000 mgr.smithi067.rdualw (mgr.24569) 8450 : cluster [DBG] pgmap v7279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:30.809450+0000 mgr.smithi067.rdualw (mgr.24569) 8450 : cluster [DBG] pgmap v7279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:32.810085+0000 mgr.smithi067.rdualw (mgr.24569) 8451 : cluster [DBG] pgmap v7280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:32.810085+0000 mgr.smithi067.rdualw (mgr.24569) 8451 : cluster [DBG] pgmap v7280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:31:34.212620+0000 mon.smithi067 (mon.1) 1287 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:31:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:31:34.214084+0000 mon.smithi067 (mon.1) 1288 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:31:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:31:34.215063+0000 mon.smithi067 (mon.1) 1289 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:31:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:31:34.215901+0000 mgr.smithi067.rdualw (mgr.24569) 8452 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:31:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:31:34.630022+0000 mon.smithi061 (mon.0) 1824 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:31:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:31:34.638161+0000 mon.smithi061 (mon.0) 1825 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:31:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:31:34.212620+0000 mon.smithi067 (mon.1) 1287 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:31:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:31:34.214084+0000 mon.smithi067 (mon.1) 1288 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:31:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:31:34.215063+0000 mon.smithi067 (mon.1) 1289 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:31:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:31:34.215901+0000 mgr.smithi067.rdualw (mgr.24569) 8452 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:31:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:31:34.630022+0000 mon.smithi061 (mon.0) 1824 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:31:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:31:34.638161+0000 mon.smithi061 (mon.0) 1825 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:31:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:34.810671+0000 mgr.smithi067.rdualw (mgr.24569) 8453 : cluster [DBG] pgmap v7281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:31:35.773616+0000 mon.smithi067 (mon.1) 1290 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:31:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:31:35.773762+0000 mon.smithi061 (mon.0) 1826 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:31:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:31:35.773955+0000 mon.smithi067 (mon.1) 1291 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:31:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:31:35.774084+0000 mon.smithi061 (mon.0) 1827 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:31:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:34.810671+0000 mgr.smithi067.rdualw (mgr.24569) 8453 : cluster [DBG] pgmap v7281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:31:35.773616+0000 mon.smithi067 (mon.1) 1290 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:31:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:31:35.773762+0000 mon.smithi061 (mon.0) 1826 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:31:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:31:35.773955+0000 mon.smithi067 (mon.1) 1291 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:31:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:31:35.774084+0000 mon.smithi061 (mon.0) 1827 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:31:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:36.811484+0000 mgr.smithi067.rdualw (mgr.24569) 8454 : cluster [DBG] pgmap v7282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:31:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:36.811484+0000 mgr.smithi067.rdualw (mgr.24569) 8454 : cluster [DBG] pgmap v7282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:31:39.100 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:31:39.390 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:31:39.391 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 6m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:31:39.391 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 6m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:31:39.391 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 6m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:31:39.391 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 6m ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:31:39.391 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 6m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:31:39.392 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 6m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:31:39.392 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 6m ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:31:39.392 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 6m ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:31:39.392 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 6m ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:31:39.393 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 6m ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:31:39.393 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 6m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:31:39.393 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 6m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:31:39.393 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 6m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:31:39.393 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 6m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:31:39.394 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 6m ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:31:39.394 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 6m ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:31:39.394 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 6m ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:31:39.394 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 6m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:31:39.395 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 6m ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:31:39.395 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 6m ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:31:39.395 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 6m ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:31:39.395 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 6m ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:31:39.395 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 6m ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:31:39.732 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:31:39.732 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:31:39.732 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:31:39.733 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:31:39.733 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:31:39.733 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:31:39.733 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:31:39.733 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:31:39.734 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:31:39.734 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:31:39.734 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:31:39.734 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:31:39.735 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:31:39.735 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:31:39.735 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:31:39.735 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:31:39.736 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:31:39.736 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:31:39.736 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:31:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:38.812091+0000 mgr.smithi067.rdualw (mgr.24569) 8455 : cluster [DBG] pgmap v7283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:31:39.087472+0000 mgr.smithi067.rdualw (mgr.24569) 8456 : audit [DBG] from='client.39778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:31:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:31:39.373600+0000 mgr.smithi067.rdualw (mgr.24569) 8457 : audit [DBG] from='client.39782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:31:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:31:39.730940+0000 mon.smithi061 (mon.0) 1828 : audit [DBG] from='client.? 172.21.15.61:0/456351899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:31:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:38.812091+0000 mgr.smithi067.rdualw (mgr.24569) 8455 : cluster [DBG] pgmap v7283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:31:39.087472+0000 mgr.smithi067.rdualw (mgr.24569) 8456 : audit [DBG] from='client.39778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:31:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:31:39.373600+0000 mgr.smithi067.rdualw (mgr.24569) 8457 : audit [DBG] from='client.39782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:31:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:31:39.730940+0000 mon.smithi061 (mon.0) 1828 : audit [DBG] from='client.? 172.21.15.61:0/456351899' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:31:42.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:40.812956+0000 mgr.smithi067.rdualw (mgr.24569) 8458 : cluster [DBG] pgmap v7284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:40.812956+0000 mgr.smithi067.rdualw (mgr.24569) 8458 : cluster [DBG] pgmap v7284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:42.813557+0000 mgr.smithi067.rdualw (mgr.24569) 8459 : cluster [DBG] pgmap v7285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:42.813557+0000 mgr.smithi067.rdualw (mgr.24569) 8459 : cluster [DBG] pgmap v7285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:44.814304+0000 mgr.smithi067.rdualw (mgr.24569) 8460 : cluster [DBG] pgmap v7286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:44.814304+0000 mgr.smithi067.rdualw (mgr.24569) 8460 : cluster [DBG] pgmap v7286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:46.815147+0000 mgr.smithi067.rdualw (mgr.24569) 8461 : cluster [DBG] pgmap v7287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:31:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:46.815147+0000 mgr.smithi067.rdualw (mgr.24569) 8461 : cluster [DBG] pgmap v7287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:31:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:48.815795+0000 mgr.smithi067.rdualw (mgr.24569) 8462 : cluster [DBG] pgmap v7288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:48.815795+0000 mgr.smithi067.rdualw (mgr.24569) 8462 : cluster [DBG] pgmap v7288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:50.816667+0000 mgr.smithi067.rdualw (mgr.24569) 8463 : cluster [DBG] pgmap v7289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:50.816667+0000 mgr.smithi067.rdualw (mgr.24569) 8463 : cluster [DBG] pgmap v7289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:52.817414+0000 mgr.smithi067.rdualw (mgr.24569) 8464 : cluster [DBG] pgmap v7290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:52.817414+0000 mgr.smithi067.rdualw (mgr.24569) 8464 : cluster [DBG] pgmap v7290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:54.818099+0000 mgr.smithi067.rdualw (mgr.24569) 8465 : cluster [DBG] pgmap v7291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:54.818099+0000 mgr.smithi067.rdualw (mgr.24569) 8465 : cluster [DBG] pgmap v7291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:31:57.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:56.818996+0000 mgr.smithi067.rdualw (mgr.24569) 8466 : cluster [DBG] pgmap v7292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:31:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:56.818996+0000 mgr.smithi067.rdualw (mgr.24569) 8466 : cluster [DBG] pgmap v7292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:32:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:31:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:31:58.819575+0000 mgr.smithi067.rdualw (mgr.24569) 8467 : cluster [DBG] pgmap v7293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:31:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:31:58.819575+0000 mgr.smithi067.rdualw (mgr.24569) 8467 : cluster [DBG] pgmap v7293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:00.820607+0000 mgr.smithi067.rdualw (mgr.24569) 8468 : cluster [DBG] pgmap v7294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:00.820607+0000 mgr.smithi067.rdualw (mgr.24569) 8468 : cluster [DBG] pgmap v7294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:02.821348+0000 mgr.smithi067.rdualw (mgr.24569) 8469 : cluster [DBG] pgmap v7295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:02.821348+0000 mgr.smithi067.rdualw (mgr.24569) 8469 : cluster [DBG] pgmap v7295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:04.821923+0000 mgr.smithi067.rdualw (mgr.24569) 8470 : cluster [DBG] pgmap v7296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:04.821923+0000 mgr.smithi067.rdualw (mgr.24569) 8470 : cluster [DBG] pgmap v7296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:06.823069+0000 mgr.smithi067.rdualw (mgr.24569) 8471 : cluster [DBG] pgmap v7297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:32:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:06.823069+0000 mgr.smithi067.rdualw (mgr.24569) 8471 : cluster [DBG] pgmap v7297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:32:10.042 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:32:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:08.823912+0000 mgr.smithi067.rdualw (mgr.24569) 8472 : cluster [DBG] pgmap v7298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:08.823912+0000 mgr.smithi067.rdualw (mgr.24569) 8472 : cluster [DBG] pgmap v7298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:10.339 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:32:10.339 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 6m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:32:10.340 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 6m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:32:10.340 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 6m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:32:10.340 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 6m ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:32:10.341 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 6m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:32:10.341 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 6m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:32:10.342 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 6m ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:32:10.342 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 6m ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:32:10.342 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 6m ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:32:10.343 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 6m ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:32:10.343 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 6m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:32:10.344 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 6m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:32:10.344 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 6m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:32:10.344 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 6m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:32:10.345 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 6m ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:32:10.345 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 6m ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:32:10.346 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 6m ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:32:10.346 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 6m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:32:10.346 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 6m ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:32:10.347 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 6m ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:32:10.347 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 6m ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:32:10.348 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 6m ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:32:10.348 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 6m ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:32:10.682 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:32:10.682 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:32:10.682 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:32:10.683 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:32:10.683 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:32:10.683 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:32:10.683 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:32:10.683 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:32:10.684 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:32:10.684 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:32:10.684 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:32:10.684 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:32:10.684 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:32:10.685 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:32:10.685 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:32:10.685 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:32:10.685 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:32:10.686 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:32:10.686 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:32:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:32:10.029238+0000 mgr.smithi067.rdualw (mgr.24569) 8473 : audit [DBG] from='client.39790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:32:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:32:10.321186+0000 mgr.smithi067.rdualw (mgr.24569) 8474 : audit [DBG] from='client.39794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:32:11.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:32:10.680930+0000 mon.smithi061 (mon.0) 1829 : audit [DBG] from='client.? 172.21.15.61:0/901971397' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:32:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:32:10.029238+0000 mgr.smithi067.rdualw (mgr.24569) 8473 : audit [DBG] from='client.39790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:32:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:32:10.321186+0000 mgr.smithi067.rdualw (mgr.24569) 8474 : audit [DBG] from='client.39794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:32:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:32:10.680930+0000 mon.smithi061 (mon.0) 1829 : audit [DBG] from='client.? 172.21.15.61:0/901971397' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:32:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:10.824913+0000 mgr.smithi067.rdualw (mgr.24569) 8475 : cluster [DBG] pgmap v7299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:12.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:10.824913+0000 mgr.smithi067.rdualw (mgr.24569) 8475 : cluster [DBG] pgmap v7299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:12.825710+0000 mgr.smithi067.rdualw (mgr.24569) 8476 : cluster [DBG] pgmap v7300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:12.825710+0000 mgr.smithi067.rdualw (mgr.24569) 8476 : cluster [DBG] pgmap v7300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:14.826407+0000 mgr.smithi067.rdualw (mgr.24569) 8477 : cluster [DBG] pgmap v7301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:14.826407+0000 mgr.smithi067.rdualw (mgr.24569) 8477 : cluster [DBG] pgmap v7301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:16.827274+0000 mgr.smithi067.rdualw (mgr.24569) 8478 : cluster [DBG] pgmap v7302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:32:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:16.827274+0000 mgr.smithi067.rdualw (mgr.24569) 8478 : cluster [DBG] pgmap v7302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:32:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:18.827896+0000 mgr.smithi067.rdualw (mgr.24569) 8479 : cluster [DBG] pgmap v7303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:18.827896+0000 mgr.smithi067.rdualw (mgr.24569) 8479 : cluster [DBG] pgmap v7303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:20.828723+0000 mgr.smithi067.rdualw (mgr.24569) 8480 : cluster [DBG] pgmap v7304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:20.828723+0000 mgr.smithi067.rdualw (mgr.24569) 8480 : cluster [DBG] pgmap v7304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:22.829384+0000 mgr.smithi067.rdualw (mgr.24569) 8481 : cluster [DBG] pgmap v7305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:22.829384+0000 mgr.smithi067.rdualw (mgr.24569) 8481 : cluster [DBG] pgmap v7305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:24.830139+0000 mgr.smithi067.rdualw (mgr.24569) 8482 : cluster [DBG] pgmap v7306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:24.830139+0000 mgr.smithi067.rdualw (mgr.24569) 8482 : cluster [DBG] pgmap v7306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:26.831039+0000 mgr.smithi067.rdualw (mgr.24569) 8483 : cluster [DBG] pgmap v7307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:32:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:26.831039+0000 mgr.smithi067.rdualw (mgr.24569) 8483 : cluster [DBG] pgmap v7307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:32:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:28.831658+0000 mgr.smithi067.rdualw (mgr.24569) 8484 : cluster [DBG] pgmap v7308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:28.831658+0000 mgr.smithi067.rdualw (mgr.24569) 8484 : cluster [DBG] pgmap v7308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:30.832562+0000 mgr.smithi067.rdualw (mgr.24569) 8485 : cluster [DBG] pgmap v7309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:30.832562+0000 mgr.smithi067.rdualw (mgr.24569) 8485 : cluster [DBG] pgmap v7309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:33.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:32.833250+0000 mgr.smithi067.rdualw (mgr.24569) 8486 : cluster [DBG] pgmap v7310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:33.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:32.833250+0000 mgr.smithi067.rdualw (mgr.24569) 8486 : cluster [DBG] pgmap v7310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:32:34.641996+0000 mon.smithi067 (mon.1) 1292 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:32:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:32:34.643511+0000 mon.smithi067 (mon.1) 1293 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:32:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:32:34.644518+0000 mon.smithi067 (mon.1) 1294 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:32:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:32:34.641996+0000 mon.smithi067 (mon.1) 1292 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:32:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:32:34.643511+0000 mon.smithi067 (mon.1) 1293 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:32:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:32:34.644518+0000 mon.smithi067 (mon.1) 1294 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:32:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:32:34.645402+0000 mgr.smithi067.rdualw (mgr.24569) 8487 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:32:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:34.833775+0000 mgr.smithi067.rdualw (mgr.24569) 8488 : cluster [DBG] pgmap v7311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:32:35.056523+0000 mon.smithi061 (mon.0) 1830 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:32:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:32:35.062862+0000 mon.smithi061 (mon.0) 1831 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:32:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:32:35.779627+0000 mon.smithi067 (mon.1) 1295 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:32:36.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:32:35.779862+0000 mon.smithi061 (mon.0) 1832 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:32:36.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:32:35.779982+0000 mon.smithi067 (mon.1) 1296 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:32:36.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:32:35.780363+0000 mon.smithi061 (mon.0) 1833 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:32:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:32:34.645402+0000 mgr.smithi067.rdualw (mgr.24569) 8487 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:32:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:34.833775+0000 mgr.smithi067.rdualw (mgr.24569) 8488 : cluster [DBG] pgmap v7311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:32:35.056523+0000 mon.smithi061 (mon.0) 1830 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:32:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:32:35.062862+0000 mon.smithi061 (mon.0) 1831 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:32:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:32:35.779627+0000 mon.smithi067 (mon.1) 1295 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:32:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:32:35.779862+0000 mon.smithi061 (mon.0) 1832 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:32:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:32:35.779982+0000 mon.smithi067 (mon.1) 1296 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:32:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:32:35.780363+0000 mon.smithi061 (mon.0) 1833 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:32:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:36.834658+0000 mgr.smithi067.rdualw (mgr.24569) 8489 : cluster [DBG] pgmap v7312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:32:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:36.834658+0000 mgr.smithi067.rdualw (mgr.24569) 8489 : cluster [DBG] pgmap v7312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:32:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:38.835452+0000 mgr.smithi067.rdualw (mgr.24569) 8490 : cluster [DBG] pgmap v7313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:38.835452+0000 mgr.smithi067.rdualw (mgr.24569) 8490 : cluster [DBG] pgmap v7313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:40.991 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:32:41.281 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:32:41.281 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 7m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:32:41.281 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 7m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:32:41.282 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 7m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:32:41.282 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 7m ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:32:41.282 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 7m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:32:41.282 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 7m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:32:41.283 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 7m ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:32:41.283 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 7m ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:32:41.283 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 7m ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:32:41.283 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 7m ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:32:41.284 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 7m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:32:41.284 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 7m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:32:41.284 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 7m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:32:41.284 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 7m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:32:41.284 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 7m ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:32:41.285 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 7m ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:32:41.285 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 7m ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:32:41.285 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 7m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:32:41.285 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 7m ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:32:41.285 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 7m ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:32:41.286 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 7m ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:32:41.286 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 7m ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:32:41.286 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 7m ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:32:41.625 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:32:41.625 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:32:41.626 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:32:41.626 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:32:41.626 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:32:41.626 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:32:41.627 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:32:41.627 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:32:41.627 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:32:41.627 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:32:41.628 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:32:41.628 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:32:41.628 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:32:41.628 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:32:41.628 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:32:41.629 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:32:41.629 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:32:41.629 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:32:41.629 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:32:42.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:40.836440+0000 mgr.smithi067.rdualw (mgr.24569) 8491 : cluster [DBG] pgmap v7314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:32:40.977972+0000 mgr.smithi067.rdualw (mgr.24569) 8492 : audit [DBG] from='client.39802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:32:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:32:41.263997+0000 mgr.smithi067.rdualw (mgr.24569) 8493 : audit [DBG] from='client.39806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:32:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:32:41.624202+0000 mon.smithi061 (mon.0) 1834 : audit [DBG] from='client.? 172.21.15.61:0/2054031165' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:32:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:40.836440+0000 mgr.smithi067.rdualw (mgr.24569) 8491 : cluster [DBG] pgmap v7314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:32:40.977972+0000 mgr.smithi067.rdualw (mgr.24569) 8492 : audit [DBG] from='client.39802 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:32:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:32:41.263997+0000 mgr.smithi067.rdualw (mgr.24569) 8493 : audit [DBG] from='client.39806 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:32:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:32:41.624202+0000 mon.smithi061 (mon.0) 1834 : audit [DBG] from='client.? 172.21.15.61:0/2054031165' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:32:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:42.837173+0000 mgr.smithi067.rdualw (mgr.24569) 8494 : cluster [DBG] pgmap v7315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:42.837173+0000 mgr.smithi067.rdualw (mgr.24569) 8494 : cluster [DBG] pgmap v7315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:44.837773+0000 mgr.smithi067.rdualw (mgr.24569) 8495 : cluster [DBG] pgmap v7316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:44.837773+0000 mgr.smithi067.rdualw (mgr.24569) 8495 : cluster [DBG] pgmap v7316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:46.838708+0000 mgr.smithi067.rdualw (mgr.24569) 8496 : cluster [DBG] pgmap v7317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:32:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:46.838708+0000 mgr.smithi067.rdualw (mgr.24569) 8496 : cluster [DBG] pgmap v7317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:32:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:48.839364+0000 mgr.smithi067.rdualw (mgr.24569) 8497 : cluster [DBG] pgmap v7318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:48.839364+0000 mgr.smithi067.rdualw (mgr.24569) 8497 : cluster [DBG] pgmap v7318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:50.840400+0000 mgr.smithi067.rdualw (mgr.24569) 8498 : cluster [DBG] pgmap v7319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:50.840400+0000 mgr.smithi067.rdualw (mgr.24569) 8498 : cluster [DBG] pgmap v7319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:52.841007+0000 mgr.smithi067.rdualw (mgr.24569) 8499 : cluster [DBG] pgmap v7320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:52.841007+0000 mgr.smithi067.rdualw (mgr.24569) 8499 : cluster [DBG] pgmap v7320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:54.841654+0000 mgr.smithi067.rdualw (mgr.24569) 8500 : cluster [DBG] pgmap v7321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:54.841654+0000 mgr.smithi067.rdualw (mgr.24569) 8500 : cluster [DBG] pgmap v7321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:32:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:56.842598+0000 mgr.smithi067.rdualw (mgr.24569) 8501 : cluster [DBG] pgmap v7322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:32:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:56.842598+0000 mgr.smithi067.rdualw (mgr.24569) 8501 : cluster [DBG] pgmap v7322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:33:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:32:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:32:58.843332+0000 mgr.smithi067.rdualw (mgr.24569) 8502 : cluster [DBG] pgmap v7323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:32:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:32:58.843332+0000 mgr.smithi067.rdualw (mgr.24569) 8502 : cluster [DBG] pgmap v7323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:00.844184+0000 mgr.smithi067.rdualw (mgr.24569) 8503 : cluster [DBG] pgmap v7324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:00.844184+0000 mgr.smithi067.rdualw (mgr.24569) 8503 : cluster [DBG] pgmap v7324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:03.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:02.844856+0000 mgr.smithi067.rdualw (mgr.24569) 8504 : cluster [DBG] pgmap v7325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:03.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:02.844856+0000 mgr.smithi067.rdualw (mgr.24569) 8504 : cluster [DBG] pgmap v7325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:04.845388+0000 mgr.smithi067.rdualw (mgr.24569) 8505 : cluster [DBG] pgmap v7326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:04.845388+0000 mgr.smithi067.rdualw (mgr.24569) 8505 : cluster [DBG] pgmap v7326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:06.846199+0000 mgr.smithi067.rdualw (mgr.24569) 8506 : cluster [DBG] pgmap v7327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:33:08.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:06.846199+0000 mgr.smithi067.rdualw (mgr.24569) 8506 : cluster [DBG] pgmap v7327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:33:09.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:08.846930+0000 mgr.smithi067.rdualw (mgr.24569) 8507 : cluster [DBG] pgmap v7328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:09.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:08.846930+0000 mgr.smithi067.rdualw (mgr.24569) 8507 : cluster [DBG] pgmap v7328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:11.971 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:33:12.260 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:33:12.260 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 7m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:33:12.260 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 7m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:33:12.260 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 7m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:33:12.261 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 7m ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:33:12.261 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 7m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:33:12.261 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 7m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:33:12.261 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 7m ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:33:12.262 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 7m ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:33:12.262 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 7m ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:33:12.262 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 7m ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:33:12.262 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 7m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:33:12.263 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 7m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:33:12.263 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 7m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:33:12.263 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 7m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:33:12.263 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 7m ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:33:12.264 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 7m ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:33:12.264 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 7m ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:33:12.264 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 7m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:33:12.264 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 7m ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:33:12.264 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 7m ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:33:12.265 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 7m ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:33:12.265 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 7m ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:33:12.265 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 7m ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:33:12.600 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:33:12.600 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:33:12.600 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:33:12.601 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:33:12.601 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:33:12.601 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:33:12.601 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:33:12.602 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:33:12.602 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:33:12.602 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:33:12.602 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:33:12.602 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:33:12.603 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:33:12.603 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:33:12.603 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:33:12.603 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:33:12.604 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:33:12.604 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:33:12.604 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:33:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:10.847790+0000 mgr.smithi067.rdualw (mgr.24569) 8508 : cluster [DBG] pgmap v7329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:10.847790+0000 mgr.smithi067.rdualw (mgr.24569) 8508 : cluster [DBG] pgmap v7329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:13.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:33:11.957981+0000 mgr.smithi067.rdualw (mgr.24569) 8509 : audit [DBG] from='client.39814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:33:13.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:33:12.242812+0000 mgr.smithi067.rdualw (mgr.24569) 8510 : audit [DBG] from='client.39818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:33:13.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:33:12.599211+0000 mon.smithi061 (mon.0) 1835 : audit [DBG] from='client.? 172.21.15.61:0/3406625508' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:33:13.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:12.848300+0000 mgr.smithi067.rdualw (mgr.24569) 8511 : cluster [DBG] pgmap v7330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:33:11.957981+0000 mgr.smithi067.rdualw (mgr.24569) 8509 : audit [DBG] from='client.39814 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:33:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:33:12.242812+0000 mgr.smithi067.rdualw (mgr.24569) 8510 : audit [DBG] from='client.39818 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:33:13.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:33:12.599211+0000 mon.smithi061 (mon.0) 1835 : audit [DBG] from='client.? 172.21.15.61:0/3406625508' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:33:13.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:12.848300+0000 mgr.smithi067.rdualw (mgr.24569) 8511 : cluster [DBG] pgmap v7330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:16.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:14.848905+0000 mgr.smithi067.rdualw (mgr.24569) 8512 : cluster [DBG] pgmap v7331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:14.848905+0000 mgr.smithi067.rdualw (mgr.24569) 8512 : cluster [DBG] pgmap v7331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:16.849796+0000 mgr.smithi067.rdualw (mgr.24569) 8513 : cluster [DBG] pgmap v7332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:33:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:16.849796+0000 mgr.smithi067.rdualw (mgr.24569) 8513 : cluster [DBG] pgmap v7332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:33:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:18.850364+0000 mgr.smithi067.rdualw (mgr.24569) 8514 : cluster [DBG] pgmap v7333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:18.850364+0000 mgr.smithi067.rdualw (mgr.24569) 8514 : cluster [DBG] pgmap v7333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:20.851258+0000 mgr.smithi067.rdualw (mgr.24569) 8515 : cluster [DBG] pgmap v7334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:20.851258+0000 mgr.smithi067.rdualw (mgr.24569) 8515 : cluster [DBG] pgmap v7334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:22.851788+0000 mgr.smithi067.rdualw (mgr.24569) 8516 : cluster [DBG] pgmap v7335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:22.851788+0000 mgr.smithi067.rdualw (mgr.24569) 8516 : cluster [DBG] pgmap v7335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:24.852496+0000 mgr.smithi067.rdualw (mgr.24569) 8517 : cluster [DBG] pgmap v7336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:24.852496+0000 mgr.smithi067.rdualw (mgr.24569) 8517 : cluster [DBG] pgmap v7336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:26.853327+0000 mgr.smithi067.rdualw (mgr.24569) 8518 : cluster [DBG] pgmap v7337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:33:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:26.853327+0000 mgr.smithi067.rdualw (mgr.24569) 8518 : cluster [DBG] pgmap v7337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:33:29.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:28.853875+0000 mgr.smithi067.rdualw (mgr.24569) 8519 : cluster [DBG] pgmap v7338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:29.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:28.853875+0000 mgr.smithi067.rdualw (mgr.24569) 8519 : cluster [DBG] pgmap v7338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:30.854637+0000 mgr.smithi067.rdualw (mgr.24569) 8520 : cluster [DBG] pgmap v7339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:30.854637+0000 mgr.smithi067.rdualw (mgr.24569) 8520 : cluster [DBG] pgmap v7339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:32.855230+0000 mgr.smithi067.rdualw (mgr.24569) 8521 : cluster [DBG] pgmap v7340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:32.855230+0000 mgr.smithi067.rdualw (mgr.24569) 8521 : cluster [DBG] pgmap v7340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:34.856023+0000 mgr.smithi067.rdualw (mgr.24569) 8522 : cluster [DBG] pgmap v7341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:33:35.068742+0000 mon.smithi067 (mon.1) 1297 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:33:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:33:35.070137+0000 mon.smithi067 (mon.1) 1298 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:33:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:33:35.071091+0000 mon.smithi067 (mon.1) 1299 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:33:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:33:35.071921+0000 mgr.smithi067.rdualw (mgr.24569) 8523 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:33:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:33:35.487157+0000 mon.smithi061 (mon.0) 1836 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:33:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:33:35.492677+0000 mon.smithi061 (mon.0) 1837 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:33:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:33:35.784629+0000 mon.smithi067 (mon.1) 1300 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:33:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:33:35.784692+0000 mon.smithi061 (mon.0) 1838 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:33:36.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:33:35.784825+0000 mon.smithi067 (mon.1) 1301 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:33:36.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:33:35.784980+0000 mon.smithi061 (mon.0) 1839 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:33:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:34.856023+0000 mgr.smithi067.rdualw (mgr.24569) 8522 : cluster [DBG] pgmap v7341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:33:35.068742+0000 mon.smithi067 (mon.1) 1297 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:33:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:33:35.070137+0000 mon.smithi067 (mon.1) 1298 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:33:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:33:35.071091+0000 mon.smithi067 (mon.1) 1299 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:33:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:33:35.071921+0000 mgr.smithi067.rdualw (mgr.24569) 8523 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:33:36.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:33:35.487157+0000 mon.smithi061 (mon.0) 1836 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:33:36.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:33:35.492677+0000 mon.smithi061 (mon.0) 1837 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:33:36.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:33:35.784629+0000 mon.smithi067 (mon.1) 1300 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:33:36.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:33:35.784692+0000 mon.smithi061 (mon.0) 1838 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:33:36.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:33:35.784825+0000 mon.smithi067 (mon.1) 1301 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:33:36.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:33:35.784980+0000 mon.smithi061 (mon.0) 1839 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:33:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:36.856972+0000 mgr.smithi067.rdualw (mgr.24569) 8524 : cluster [DBG] pgmap v7342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:33:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:36.856972+0000 mgr.smithi067.rdualw (mgr.24569) 8524 : cluster [DBG] pgmap v7342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:33:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:38.857739+0000 mgr.smithi067.rdualw (mgr.24569) 8525 : cluster [DBG] pgmap v7343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:38.857739+0000 mgr.smithi067.rdualw (mgr.24569) 8525 : cluster [DBG] pgmap v7343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:42.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:40.858708+0000 mgr.smithi067.rdualw (mgr.24569) 8526 : cluster [DBG] pgmap v7344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:40.858708+0000 mgr.smithi067.rdualw (mgr.24569) 8526 : cluster [DBG] pgmap v7344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:42.927 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:33:43.217 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:33:43.217 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 8m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:33:43.218 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 8m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:33:43.218 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 8m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:33:43.218 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 8m ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:33:43.219 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 8m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:33:43.219 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 8m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:33:43.219 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 8m ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:33:43.219 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 8m ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:33:43.219 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 8m ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:33:43.220 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 8m ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:33:43.220 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 8m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:33:43.220 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 8m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:33:43.220 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 8m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:33:43.221 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 8m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:33:43.221 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 8m ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:33:43.221 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 8m ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:33:43.221 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 8m ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:33:43.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 8m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:33:43.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 8m ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:33:43.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 8m ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:33:43.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 8m ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:33:43.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 8m ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:33:43.223 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 8m ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:33:43.557 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:33:43.557 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:33:43.557 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:33:43.557 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:33:43.558 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:33:43.558 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:33:43.558 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:33:43.558 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:33:43.559 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:33:43.559 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:33:43.559 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:33:43.559 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:33:43.560 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:33:43.560 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:33:43.560 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:33:43.560 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:33:43.560 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:33:43.561 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:33:43.561 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:33:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:42.859286+0000 mgr.smithi067.rdualw (mgr.24569) 8527 : cluster [DBG] pgmap v7345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:33:42.914729+0000 mgr.smithi067.rdualw (mgr.24569) 8528 : audit [DBG] from='client.39826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:33:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:33:43.200243+0000 mgr.smithi067.rdualw (mgr.24569) 8529 : audit [DBG] from='client.39830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:33:44.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:33:43.555679+0000 mon.smithi061 (mon.0) 1840 : audit [DBG] from='client.? 172.21.15.61:0/2481001794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:33:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:42.859286+0000 mgr.smithi067.rdualw (mgr.24569) 8527 : cluster [DBG] pgmap v7345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:33:42.914729+0000 mgr.smithi067.rdualw (mgr.24569) 8528 : audit [DBG] from='client.39826 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:33:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:33:43.200243+0000 mgr.smithi067.rdualw (mgr.24569) 8529 : audit [DBG] from='client.39830 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:33:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:33:43.555679+0000 mon.smithi061 (mon.0) 1840 : audit [DBG] from='client.? 172.21.15.61:0/2481001794' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:33:45.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:44.859875+0000 mgr.smithi067.rdualw (mgr.24569) 8530 : cluster [DBG] pgmap v7346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:44.859875+0000 mgr.smithi067.rdualw (mgr.24569) 8530 : cluster [DBG] pgmap v7346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:46.860852+0000 mgr.smithi067.rdualw (mgr.24569) 8531 : cluster [DBG] pgmap v7347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:33:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:46.860852+0000 mgr.smithi067.rdualw (mgr.24569) 8531 : cluster [DBG] pgmap v7347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:33:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:48.861525+0000 mgr.smithi067.rdualw (mgr.24569) 8532 : cluster [DBG] pgmap v7348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:48.861525+0000 mgr.smithi067.rdualw (mgr.24569) 8532 : cluster [DBG] pgmap v7348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:50.862360+0000 mgr.smithi067.rdualw (mgr.24569) 8533 : cluster [DBG] pgmap v7349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:50.862360+0000 mgr.smithi067.rdualw (mgr.24569) 8533 : cluster [DBG] pgmap v7349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:52.862902+0000 mgr.smithi067.rdualw (mgr.24569) 8534 : cluster [DBG] pgmap v7350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:52.862902+0000 mgr.smithi067.rdualw (mgr.24569) 8534 : cluster [DBG] pgmap v7350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:54.863520+0000 mgr.smithi067.rdualw (mgr.24569) 8535 : cluster [DBG] pgmap v7351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:55.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:54.863520+0000 mgr.smithi067.rdualw (mgr.24569) 8535 : cluster [DBG] pgmap v7351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:33:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:33:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:56.864521+0000 mgr.smithi067.rdualw (mgr.24569) 8536 : cluster [DBG] pgmap v7352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:33:58.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:33:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:56.864521+0000 mgr.smithi067.rdualw (mgr.24569) 8536 : cluster [DBG] pgmap v7352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:34:00.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:33:58.865207+0000 mgr.smithi067.rdualw (mgr.24569) 8537 : cluster [DBG] pgmap v7353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:33:58.865207+0000 mgr.smithi067.rdualw (mgr.24569) 8537 : cluster [DBG] pgmap v7353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:00.866111+0000 mgr.smithi067.rdualw (mgr.24569) 8538 : cluster [DBG] pgmap v7354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:00.866111+0000 mgr.smithi067.rdualw (mgr.24569) 8538 : cluster [DBG] pgmap v7354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:02.866791+0000 mgr.smithi067.rdualw (mgr.24569) 8539 : cluster [DBG] pgmap v7355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:02.866791+0000 mgr.smithi067.rdualw (mgr.24569) 8539 : cluster [DBG] pgmap v7355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:05.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:04.867374+0000 mgr.smithi067.rdualw (mgr.24569) 8540 : cluster [DBG] pgmap v7356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:05.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:04.867374+0000 mgr.smithi067.rdualw (mgr.24569) 8540 : cluster [DBG] pgmap v7356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:06.868312+0000 mgr.smithi067.rdualw (mgr.24569) 8541 : cluster [DBG] pgmap v7357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:34:08.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:06.868312+0000 mgr.smithi067.rdualw (mgr.24569) 8541 : cluster [DBG] pgmap v7357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:34:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:08.869056+0000 mgr.smithi067.rdualw (mgr.24569) 8542 : cluster [DBG] pgmap v7358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:08.869056+0000 mgr.smithi067.rdualw (mgr.24569) 8542 : cluster [DBG] pgmap v7358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:10.869949+0000 mgr.smithi067.rdualw (mgr.24569) 8543 : cluster [DBG] pgmap v7359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:10.869949+0000 mgr.smithi067.rdualw (mgr.24569) 8543 : cluster [DBG] pgmap v7359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:13.865 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:34:14.156 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:34:14.157 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 8m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:34:14.157 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 8m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:34:14.157 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 8m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:34:14.157 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 8m ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:34:14.158 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 8m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:34:14.158 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 8m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:34:14.158 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 8m ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:34:14.158 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 8m ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:34:14.159 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 8m ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:34:14.159 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 8m ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:34:14.159 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 8m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:34:14.159 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 8m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:34:14.159 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 8m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:34:14.160 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 8m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:34:14.160 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 8m ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:34:14.160 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 8m ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:34:14.160 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 8m ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:34:14.160 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 8m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:34:14.161 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 8m ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:34:14.161 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 8m ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:34:14.161 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 8m ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:34:14.161 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 8m ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:34:14.162 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 8m ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:34:14.498 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:34:14.499 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:34:14.499 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:34:14.499 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:34:14.499 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:34:14.500 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:34:14.500 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:34:14.500 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:34:14.500 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:34:14.500 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:34:14.501 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:34:14.501 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:34:14.502 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:34:14.502 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:34:14.502 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:34:14.502 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:34:14.503 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:34:14.503 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:34:14.503 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:34:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:12.870508+0000 mgr.smithi067.rdualw (mgr.24569) 8544 : cluster [DBG] pgmap v7360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:34:14.497397+0000 mon.smithi061 (mon.0) 1841 : audit [DBG] from='client.? 172.21.15.61:0/1609379503' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:34:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:12.870508+0000 mgr.smithi067.rdualw (mgr.24569) 8544 : cluster [DBG] pgmap v7360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:34:14.497397+0000 mon.smithi061 (mon.0) 1841 : audit [DBG] from='client.? 172.21.15.61:0/1609379503' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:34:15.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:34:13.852216+0000 mgr.smithi067.rdualw (mgr.24569) 8545 : audit [DBG] from='client.39838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:34:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:34:14.139367+0000 mgr.smithi067.rdualw (mgr.24569) 8546 : audit [DBG] from='client.39842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:34:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:14.871297+0000 mgr.smithi067.rdualw (mgr.24569) 8547 : cluster [DBG] pgmap v7361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:34:13.852216+0000 mgr.smithi067.rdualw (mgr.24569) 8545 : audit [DBG] from='client.39838 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:34:15.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:34:14.139367+0000 mgr.smithi067.rdualw (mgr.24569) 8546 : audit [DBG] from='client.39842 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:34:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:14.871297+0000 mgr.smithi067.rdualw (mgr.24569) 8547 : cluster [DBG] pgmap v7361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:18.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:16.872237+0000 mgr.smithi067.rdualw (mgr.24569) 8548 : cluster [DBG] pgmap v7362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:34:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:16.872237+0000 mgr.smithi067.rdualw (mgr.24569) 8548 : cluster [DBG] pgmap v7362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:34:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:18.872862+0000 mgr.smithi067.rdualw (mgr.24569) 8549 : cluster [DBG] pgmap v7363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:18.872862+0000 mgr.smithi067.rdualw (mgr.24569) 8549 : cluster [DBG] pgmap v7363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:20.873722+0000 mgr.smithi067.rdualw (mgr.24569) 8550 : cluster [DBG] pgmap v7364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:20.873722+0000 mgr.smithi067.rdualw (mgr.24569) 8550 : cluster [DBG] pgmap v7364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:22.874349+0000 mgr.smithi067.rdualw (mgr.24569) 8551 : cluster [DBG] pgmap v7365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:22.874349+0000 mgr.smithi067.rdualw (mgr.24569) 8551 : cluster [DBG] pgmap v7365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:25.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:24.874991+0000 mgr.smithi067.rdualw (mgr.24569) 8552 : cluster [DBG] pgmap v7366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:25.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:24.874991+0000 mgr.smithi067.rdualw (mgr.24569) 8552 : cluster [DBG] pgmap v7366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:26.876065+0000 mgr.smithi067.rdualw (mgr.24569) 8553 : cluster [DBG] pgmap v7367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:34:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:26.876065+0000 mgr.smithi067.rdualw (mgr.24569) 8553 : cluster [DBG] pgmap v7367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:34:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:28.876693+0000 mgr.smithi067.rdualw (mgr.24569) 8554 : cluster [DBG] pgmap v7368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:28.876693+0000 mgr.smithi067.rdualw (mgr.24569) 8554 : cluster [DBG] pgmap v7368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:30.877509+0000 mgr.smithi067.rdualw (mgr.24569) 8555 : cluster [DBG] pgmap v7369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:30.877509+0000 mgr.smithi067.rdualw (mgr.24569) 8555 : cluster [DBG] pgmap v7369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:32.877980+0000 mgr.smithi067.rdualw (mgr.24569) 8556 : cluster [DBG] pgmap v7370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:32.877980+0000 mgr.smithi067.rdualw (mgr.24569) 8556 : cluster [DBG] pgmap v7370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:34.878784+0000 mgr.smithi067.rdualw (mgr.24569) 8557 : cluster [DBG] pgmap v7371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:34:35.496249+0000 mon.smithi067 (mon.1) 1302 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:34:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:34:35.497763+0000 mon.smithi067 (mon.1) 1303 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:34:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:34:35.498710+0000 mon.smithi067 (mon.1) 1304 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:34:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:34:35.499583+0000 mgr.smithi067.rdualw (mgr.24569) 8558 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:34:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:34.878784+0000 mgr.smithi067.rdualw (mgr.24569) 8557 : cluster [DBG] pgmap v7371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:34:35.496249+0000 mon.smithi067 (mon.1) 1302 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:34:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:34:35.497763+0000 mon.smithi067 (mon.1) 1303 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:34:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:34:35.498710+0000 mon.smithi067 (mon.1) 1304 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:34:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:34:35.499583+0000 mgr.smithi067.rdualw (mgr.24569) 8558 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:34:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:34:35.789052+0000 mon.smithi067 (mon.1) 1305 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:34:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:34:35.789235+0000 mon.smithi067 (mon.1) 1306 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:34:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:34:35.789238+0000 mon.smithi061 (mon.0) 1842 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:34:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:34:35.789568+0000 mon.smithi061 (mon.0) 1843 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:34:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:34:35.912077+0000 mon.smithi061 (mon.0) 1844 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:34:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:34:35.917468+0000 mon.smithi061 (mon.0) 1845 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:34:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:34:35.789052+0000 mon.smithi067 (mon.1) 1305 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:34:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:34:35.789235+0000 mon.smithi067 (mon.1) 1306 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:34:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:34:35.789238+0000 mon.smithi061 (mon.0) 1842 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:34:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:34:35.789568+0000 mon.smithi061 (mon.0) 1843 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:34:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:34:35.912077+0000 mon.smithi061 (mon.0) 1844 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:34:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:34:35.917468+0000 mon.smithi061 (mon.0) 1845 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:34:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:36.879602+0000 mgr.smithi067.rdualw (mgr.24569) 8559 : cluster [DBG] pgmap v7372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:34:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:36.879602+0000 mgr.smithi067.rdualw (mgr.24569) 8559 : cluster [DBG] pgmap v7372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:34:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:38.880326+0000 mgr.smithi067.rdualw (mgr.24569) 8560 : cluster [DBG] pgmap v7373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:38.880326+0000 mgr.smithi067.rdualw (mgr.24569) 8560 : cluster [DBG] pgmap v7373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:42.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:40.881356+0000 mgr.smithi067.rdualw (mgr.24569) 8561 : cluster [DBG] pgmap v7374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:40.881356+0000 mgr.smithi067.rdualw (mgr.24569) 8561 : cluster [DBG] pgmap v7374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:44.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:42.882042+0000 mgr.smithi067.rdualw (mgr.24569) 8562 : cluster [DBG] pgmap v7375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:44.807 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:34:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:42.882042+0000 mgr.smithi067.rdualw (mgr.24569) 8562 : cluster [DBG] pgmap v7375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:45.181 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:34:45.181 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 9m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:34:45.182 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 9m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:34:45.182 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 9m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:34:45.182 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 9m ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:34:45.182 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 9m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:34:45.183 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 9m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:34:45.183 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 9m ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:34:45.183 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 9m ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:34:45.183 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 9m ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:34:45.184 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 9m ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:34:45.184 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 9m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:34:45.184 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 9m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:34:45.184 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 9m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:34:45.184 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 9m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:34:45.185 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 9m ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:34:45.185 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 9m ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:34:45.185 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 9m ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:34:45.185 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 9m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:34:45.186 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 9m ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:34:45.186 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 9m ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:34:45.186 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 9m ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:34:45.186 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 9m ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:34:45.187 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 9m ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:34:45.524 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:34:45.524 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:34:45.524 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:34:45.525 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:34:45.525 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:34:45.525 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:34:45.525 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:34:45.526 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:34:45.526 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:34:45.526 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:34:45.527 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:34:45.527 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:34:45.527 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:34:45.527 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:34:45.528 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:34:45.528 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:34:45.528 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:34:45.528 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:34:45.529 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:34:45.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:34:44.794012+0000 mgr.smithi067.rdualw (mgr.24569) 8563 : audit [DBG] from='client.39850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:34:45.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:44.882749+0000 mgr.smithi067.rdualw (mgr.24569) 8564 : cluster [DBG] pgmap v7376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:45.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:34:45.163987+0000 mgr.smithi067.rdualw (mgr.24569) 8565 : audit [DBG] from='client.39854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:34:45.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:34:45.522807+0000 mon.smithi061 (mon.0) 1846 : audit [DBG] from='client.? 172.21.15.61:0/1643253421' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:34:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:34:44.794012+0000 mgr.smithi067.rdualw (mgr.24569) 8563 : audit [DBG] from='client.39850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:34:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:44.882749+0000 mgr.smithi067.rdualw (mgr.24569) 8564 : cluster [DBG] pgmap v7376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:34:45.163987+0000 mgr.smithi067.rdualw (mgr.24569) 8565 : audit [DBG] from='client.39854 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:34:45.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:34:45.522807+0000 mon.smithi061 (mon.0) 1846 : audit [DBG] from='client.? 172.21.15.61:0/1643253421' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:34:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:46.883651+0000 mgr.smithi067.rdualw (mgr.24569) 8566 : cluster [DBG] pgmap v7377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:34:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:46.883651+0000 mgr.smithi067.rdualw (mgr.24569) 8566 : cluster [DBG] pgmap v7377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:34:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:48.884506+0000 mgr.smithi067.rdualw (mgr.24569) 8567 : cluster [DBG] pgmap v7378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:48.884506+0000 mgr.smithi067.rdualw (mgr.24569) 8567 : cluster [DBG] pgmap v7378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:50.885331+0000 mgr.smithi067.rdualw (mgr.24569) 8568 : cluster [DBG] pgmap v7379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:50.885331+0000 mgr.smithi067.rdualw (mgr.24569) 8568 : cluster [DBG] pgmap v7379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:52.885982+0000 mgr.smithi067.rdualw (mgr.24569) 8569 : cluster [DBG] pgmap v7380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:52.885982+0000 mgr.smithi067.rdualw (mgr.24569) 8569 : cluster [DBG] pgmap v7380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:54.886895+0000 mgr.smithi067.rdualw (mgr.24569) 8570 : cluster [DBG] pgmap v7381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:54.886895+0000 mgr.smithi067.rdualw (mgr.24569) 8570 : cluster [DBG] pgmap v7381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:34:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:34:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:56.887826+0000 mgr.smithi067.rdualw (mgr.24569) 8571 : cluster [DBG] pgmap v7382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:34:58.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:34:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:56.887826+0000 mgr.smithi067.rdualw (mgr.24569) 8571 : cluster [DBG] pgmap v7382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:35:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:34:58.888580+0000 mgr.smithi067.rdualw (mgr.24569) 8572 : cluster [DBG] pgmap v7383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:34:58.888580+0000 mgr.smithi067.rdualw (mgr.24569) 8572 : cluster [DBG] pgmap v7383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:00.889462+0000 mgr.smithi067.rdualw (mgr.24569) 8573 : cluster [DBG] pgmap v7384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:00.889462+0000 mgr.smithi067.rdualw (mgr.24569) 8573 : cluster [DBG] pgmap v7384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:02.890084+0000 mgr.smithi067.rdualw (mgr.24569) 8574 : cluster [DBG] pgmap v7385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:02.890084+0000 mgr.smithi067.rdualw (mgr.24569) 8574 : cluster [DBG] pgmap v7385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:06.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:04.890726+0000 mgr.smithi067.rdualw (mgr.24569) 8575 : cluster [DBG] pgmap v7386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:06.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:04.890726+0000 mgr.smithi067.rdualw (mgr.24569) 8575 : cluster [DBG] pgmap v7386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:06.891715+0000 mgr.smithi067.rdualw (mgr.24569) 8576 : cluster [DBG] pgmap v7387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:35:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:06.891715+0000 mgr.smithi067.rdualw (mgr.24569) 8576 : cluster [DBG] pgmap v7387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:35:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:08.892437+0000 mgr.smithi067.rdualw (mgr.24569) 8577 : cluster [DBG] pgmap v7388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:08.892437+0000 mgr.smithi067.rdualw (mgr.24569) 8577 : cluster [DBG] pgmap v7388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:10.893261+0000 mgr.smithi067.rdualw (mgr.24569) 8578 : cluster [DBG] pgmap v7389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:10.893261+0000 mgr.smithi067.rdualw (mgr.24569) 8578 : cluster [DBG] pgmap v7389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:12.894009+0000 mgr.smithi067.rdualw (mgr.24569) 8579 : cluster [DBG] pgmap v7390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:12.894009+0000 mgr.smithi067.rdualw (mgr.24569) 8579 : cluster [DBG] pgmap v7390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:15.833 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:35:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:14.894795+0000 mgr.smithi067.rdualw (mgr.24569) 8580 : cluster [DBG] pgmap v7391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:14.894795+0000 mgr.smithi067.rdualw (mgr.24569) 8580 : cluster [DBG] pgmap v7391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:16.170 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:35:16.170 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 9m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:35:16.171 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 9m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:35:16.171 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 9m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:35:16.171 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 9m ago 4h 42.3M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:35:16.172 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 9m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:35:16.172 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 9m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:35:16.172 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 9m ago 4h 476M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:35:16.172 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 9m ago 4h 606M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:35:16.173 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 9m ago 4h 1573M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:35:16.173 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 9m ago 4h 813M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:35:16.173 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 9m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:35:16.173 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 9m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:35:16.174 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 9m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:35:16.174 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 9m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:35:16.174 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 9m ago 4h 1060M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:35:16.174 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 9m ago 4h 1934M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:35:16.175 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 9m ago 4h 1212M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:35:16.175 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 9m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:35:16.175 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 9m ago 4h 1913M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:35:16.175 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 9m ago 4h 2098M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:35:16.176 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 9m ago 4h 1699M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:35:16.176 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 9m ago 4h 2631M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:35:16.176 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 9m ago 4h 146M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:35:16.521 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:35:16.521 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:35:16.522 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:35:16.522 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:35:16.522 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:35:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:35:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:35:16.523 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:35:16.524 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:35:16.524 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:35:16.524 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:35:16.525 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:35:16.525 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:35:16.525 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:35:16.525 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:35:16.525 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:35:16.526 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:35:16.526 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:35:16.526 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:35:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:15.821062+0000 mgr.smithi067.rdualw (mgr.24569) 8581 : audit [DBG] from='client.39862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:35:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:16.152756+0000 mgr.smithi067.rdualw (mgr.24569) 8582 : audit [DBG] from='client.39866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:35:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:16.520051+0000 mon.smithi061 (mon.0) 1847 : audit [DBG] from='client.? 172.21.15.61:0/3115700371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:35:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:15.821062+0000 mgr.smithi067.rdualw (mgr.24569) 8581 : audit [DBG] from='client.39862 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:35:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:16.152756+0000 mgr.smithi067.rdualw (mgr.24569) 8582 : audit [DBG] from='client.39866 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:35:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:16.520051+0000 mon.smithi061 (mon.0) 1847 : audit [DBG] from='client.? 172.21.15.61:0/3115700371' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:35:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:16.895711+0000 mgr.smithi067.rdualw (mgr.24569) 8583 : cluster [DBG] pgmap v7392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:35:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:16.895711+0000 mgr.smithi067.rdualw (mgr.24569) 8583 : cluster [DBG] pgmap v7392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:35:20.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:18.896313+0000 mgr.smithi067.rdualw (mgr.24569) 8584 : cluster [DBG] pgmap v7393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:18.896313+0000 mgr.smithi067.rdualw (mgr.24569) 8584 : cluster [DBG] pgmap v7393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:20.897341+0000 mgr.smithi067.rdualw (mgr.24569) 8585 : cluster [DBG] pgmap v7394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:20.897341+0000 mgr.smithi067.rdualw (mgr.24569) 8585 : cluster [DBG] pgmap v7394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:22.897934+0000 mgr.smithi067.rdualw (mgr.24569) 8586 : cluster [DBG] pgmap v7395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:22.897934+0000 mgr.smithi067.rdualw (mgr.24569) 8586 : cluster [DBG] pgmap v7395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:24.898768+0000 mgr.smithi067.rdualw (mgr.24569) 8587 : cluster [DBG] pgmap v7396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:24.898768+0000 mgr.smithi067.rdualw (mgr.24569) 8587 : cluster [DBG] pgmap v7396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:26.899594+0000 mgr.smithi067.rdualw (mgr.24569) 8588 : cluster [DBG] pgmap v7397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:35:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:26.899594+0000 mgr.smithi067.rdualw (mgr.24569) 8588 : cluster [DBG] pgmap v7397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:35:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:28.900219+0000 mgr.smithi067.rdualw (mgr.24569) 8589 : cluster [DBG] pgmap v7398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:28.900219+0000 mgr.smithi067.rdualw (mgr.24569) 8589 : cluster [DBG] pgmap v7398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:30.901099+0000 mgr.smithi067.rdualw (mgr.24569) 8590 : cluster [DBG] pgmap v7399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:30.901099+0000 mgr.smithi067.rdualw (mgr.24569) 8590 : cluster [DBG] pgmap v7399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:32.901598+0000 mgr.smithi067.rdualw (mgr.24569) 8591 : cluster [DBG] pgmap v7400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:32.901598+0000 mgr.smithi067.rdualw (mgr.24569) 8591 : cluster [DBG] pgmap v7400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:34.902424+0000 mgr.smithi067.rdualw (mgr.24569) 8592 : cluster [DBG] pgmap v7401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:34.902424+0000 mgr.smithi067.rdualw (mgr.24569) 8592 : cluster [DBG] pgmap v7401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:35.796319+0000 mon.smithi067 (mon.1) 1307 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:35:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:35.796557+0000 mon.smithi061 (mon.0) 1848 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:35:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:35.796574+0000 mon.smithi067 (mon.1) 1308 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:35:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:35.796770+0000 mon.smithi061 (mon.0) 1849 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:35:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:35.920918+0000 mon.smithi067 (mon.1) 1309 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:35:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:35.922343+0000 mon.smithi067 (mon.1) 1310 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:35:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:35.923215+0000 mon.smithi067 (mon.1) 1311 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:35:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:35:35.924028+0000 mgr.smithi067.rdualw (mgr.24569) 8593 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:35:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:35.796319+0000 mon.smithi067 (mon.1) 1307 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:35:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:35.796557+0000 mon.smithi061 (mon.0) 1848 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:35:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:35.796574+0000 mon.smithi067 (mon.1) 1308 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:35:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:35.796770+0000 mon.smithi061 (mon.0) 1849 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:35:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:35.920918+0000 mon.smithi067 (mon.1) 1309 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:35:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:35.922343+0000 mon.smithi067 (mon.1) 1310 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:35:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:35.923215+0000 mon.smithi067 (mon.1) 1311 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:35:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:35:35.924028+0000 mgr.smithi067.rdualw (mgr.24569) 8593 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:35:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:36.903100+0000 mgr.smithi067.rdualw (mgr.24569) 8594 : cluster [DBG] pgmap v7402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:35:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:36.903100+0000 mgr.smithi067.rdualw (mgr.24569) 8594 : cluster [DBG] pgmap v7402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:35:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:38.903640+0000 mgr.smithi067.rdualw (mgr.24569) 8595 : cluster [DBG] pgmap v7403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:38.903640+0000 mgr.smithi067.rdualw (mgr.24569) 8595 : cluster [DBG] pgmap v7403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:41.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:40.516365+0000 mon.smithi061 (mon.0) 1850 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:35:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:40.903559+0000 mon.smithi067 (mon.1) 1312 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:35:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:40.903848+0000 mon.smithi061 (mon.0) 1851 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:35:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:40.516365+0000 mon.smithi061 (mon.0) 1850 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:35:41.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:40.903559+0000 mon.smithi067 (mon.1) 1312 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:35:41.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:40.903848+0000 mon.smithi061 (mon.0) 1851 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:35:42.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:40.904333+0000 mgr.smithi067.rdualw (mgr.24569) 8596 : cluster [DBG] pgmap v7404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:40.904333+0000 mgr.smithi067.rdualw (mgr.24569) 8596 : cluster [DBG] pgmap v7404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:42.904990+0000 mgr.smithi067.rdualw (mgr.24569) 8597 : cluster [DBG] pgmap v7405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:43.215303+0000 mon.smithi061 (mon.0) 1852 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:35:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:43.628799+0000 mon.smithi067 (mon.1) 1313 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:35:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:43.629046+0000 mon.smithi061 (mon.0) 1853 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:35:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:43.635817+0000 mon.smithi061 (mon.0) 1854 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:35:44.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:43.656134+0000 mon.smithi061 (mon.0) 1855 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:35:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:42.904990+0000 mgr.smithi067.rdualw (mgr.24569) 8597 : cluster [DBG] pgmap v7405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:43.215303+0000 mon.smithi061 (mon.0) 1852 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:35:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:43.628799+0000 mon.smithi067 (mon.1) 1313 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:35:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:43.629046+0000 mon.smithi061 (mon.0) 1853 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:35:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:43.635817+0000 mon.smithi061 (mon.0) 1854 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:35:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:43.656134+0000 mon.smithi061 (mon.0) 1855 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:35:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:44.905767+0000 mgr.smithi067.rdualw (mgr.24569) 8598 : cluster [DBG] pgmap v7406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:44.905767+0000 mgr.smithi067.rdualw (mgr.24569) 8598 : cluster [DBG] pgmap v7406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:46.827 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:35:47.120 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:35:47.121 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 3s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:35:47.121 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 3s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:35:47.121 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 6s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:35:47.122 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 3s ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:35:47.122 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 3s ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:35:47.122 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 6s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:35:47.122 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 3s ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:35:47.122 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 6s ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:35:47.123 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 3s ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:35:47.123 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 6s ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:35:47.123 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 3s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:35:47.123 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 6s ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:35:47.124 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 3s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:35:47.124 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 6s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:35:47.124 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 3s ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:35:47.125 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 3s ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:35:47.125 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 3s ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:35:47.125 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 3s ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:35:47.125 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 6s ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:35:47.125 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 6s ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:35:47.126 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 6s ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:35:47.126 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 6s ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:35:47.126 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 3s ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:35:47.460 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:35:47.460 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:35:47.460 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:35:47.461 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:35:47.461 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:35:47.461 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:35:47.461 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:35:47.462 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:35:47.462 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:35:47.462 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:35:47.462 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:35:47.463 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:35:47.463 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:35:47.463 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:35:47.463 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:35:47.463 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:35:47.464 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:35:47.464 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:35:47.464 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:35:47.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:47.458841+0000 mon.smithi061 (mon.0) 1856 : audit [DBG] from='client.? 172.21.15.61:0/174903360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:35:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:47.458841+0000 mon.smithi061 (mon.0) 1856 : audit [DBG] from='client.? 172.21.15.61:0/174903360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:35:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:46.813374+0000 mgr.smithi067.rdualw (mgr.24569) 8599 : audit [DBG] from='client.39874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:35:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:46.906619+0000 mgr.smithi067.rdualw (mgr.24569) 8600 : cluster [DBG] pgmap v7407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:35:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:35:47.103891+0000 mgr.smithi067.rdualw (mgr.24569) 8601 : audit [DBG] from='client.39878 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:35:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:46.813374+0000 mgr.smithi067.rdualw (mgr.24569) 8599 : audit [DBG] from='client.39874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:35:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:46.906619+0000 mgr.smithi067.rdualw (mgr.24569) 8600 : cluster [DBG] pgmap v7407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:35:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:35:47.103891+0000 mgr.smithi067.rdualw (mgr.24569) 8601 : audit [DBG] from='client.39878 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:35:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:48.907258+0000 mgr.smithi067.rdualw (mgr.24569) 8602 : cluster [DBG] pgmap v7408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:48.907258+0000 mgr.smithi067.rdualw (mgr.24569) 8602 : cluster [DBG] pgmap v7408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:50.908241+0000 mgr.smithi067.rdualw (mgr.24569) 8603 : cluster [DBG] pgmap v7409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:50.908241+0000 mgr.smithi067.rdualw (mgr.24569) 8603 : cluster [DBG] pgmap v7409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:52.908898+0000 mgr.smithi067.rdualw (mgr.24569) 8604 : cluster [DBG] pgmap v7410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:52.908898+0000 mgr.smithi067.rdualw (mgr.24569) 8604 : cluster [DBG] pgmap v7410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:54.909654+0000 mgr.smithi067.rdualw (mgr.24569) 8605 : cluster [DBG] pgmap v7411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:54.909654+0000 mgr.smithi067.rdualw (mgr.24569) 8605 : cluster [DBG] pgmap v7411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:35:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:35:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:56.910554+0000 mgr.smithi067.rdualw (mgr.24569) 8606 : cluster [DBG] pgmap v7412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:35:58.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:35:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:56.910554+0000 mgr.smithi067.rdualw (mgr.24569) 8606 : cluster [DBG] pgmap v7412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:36:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:35:58.911151+0000 mgr.smithi067.rdualw (mgr.24569) 8607 : cluster [DBG] pgmap v7413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:00.928 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:35:58.911151+0000 mgr.smithi067.rdualw (mgr.24569) 8607 : cluster [DBG] pgmap v7413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:00.911993+0000 mgr.smithi067.rdualw (mgr.24569) 8608 : cluster [DBG] pgmap v7414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:00.911993+0000 mgr.smithi067.rdualw (mgr.24569) 8608 : cluster [DBG] pgmap v7414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:02.912584+0000 mgr.smithi067.rdualw (mgr.24569) 8609 : cluster [DBG] pgmap v7415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:02.912584+0000 mgr.smithi067.rdualw (mgr.24569) 8609 : cluster [DBG] pgmap v7415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:06.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:04.913314+0000 mgr.smithi067.rdualw (mgr.24569) 8610 : cluster [DBG] pgmap v7416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:06.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:04.913314+0000 mgr.smithi067.rdualw (mgr.24569) 8610 : cluster [DBG] pgmap v7416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:06.914242+0000 mgr.smithi067.rdualw (mgr.24569) 8611 : cluster [DBG] pgmap v7417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:36:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:06.914242+0000 mgr.smithi067.rdualw (mgr.24569) 8611 : cluster [DBG] pgmap v7417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:36:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:08.914885+0000 mgr.smithi067.rdualw (mgr.24569) 8612 : cluster [DBG] pgmap v7418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:08.914885+0000 mgr.smithi067.rdualw (mgr.24569) 8612 : cluster [DBG] pgmap v7418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:10.915897+0000 mgr.smithi067.rdualw (mgr.24569) 8613 : cluster [DBG] pgmap v7419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:10.915897+0000 mgr.smithi067.rdualw (mgr.24569) 8613 : cluster [DBG] pgmap v7419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:12.916568+0000 mgr.smithi067.rdualw (mgr.24569) 8614 : cluster [DBG] pgmap v7420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:12.916568+0000 mgr.smithi067.rdualw (mgr.24569) 8614 : cluster [DBG] pgmap v7420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:14.917250+0000 mgr.smithi067.rdualw (mgr.24569) 8615 : cluster [DBG] pgmap v7421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:16.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:14.917250+0000 mgr.smithi067.rdualw (mgr.24569) 8615 : cluster [DBG] pgmap v7421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:17.770 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:36:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:16.918121+0000 mgr.smithi067.rdualw (mgr.24569) 8616 : cluster [DBG] pgmap v7422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:36:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:16.918121+0000 mgr.smithi067.rdualw (mgr.24569) 8616 : cluster [DBG] pgmap v7422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:36:18.071 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:36:18.072 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 34s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:36:18.072 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 34s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:36:18.072 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 37s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:36:18.073 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 34s ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:36:18.073 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 34s ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:36:18.073 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 37s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:36:18.074 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 34s ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:36:18.074 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 37s ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:36:18.074 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 34s ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:36:18.075 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 37s ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:36:18.075 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 34s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:36:18.075 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 37s ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:36:18.076 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 34s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:36:18.076 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 37s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:36:18.076 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 34s ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:36:18.076 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 34s ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:36:18.077 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 34s ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:36:18.077 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 34s ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:36:18.077 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 37s ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:36:18.078 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 37s ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:36:18.078 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 37s ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:36:18.078 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 37s ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:36:18.079 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 34s ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:36:18.415 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:36:18.416 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:36:18.416 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:36:18.416 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:36:18.416 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:36:18.417 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:36:18.417 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:36:18.417 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:36:18.418 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:36:18.418 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:36:18.418 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:36:18.418 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:36:18.419 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:36:18.419 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:36:18.419 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:36:18.419 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:36:18.420 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:36:18.420 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:36:18.420 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:36:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:36:17.757885+0000 mgr.smithi067.rdualw (mgr.24569) 8617 : audit [DBG] from='client.39886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:36:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:36:18.054469+0000 mgr.smithi067.rdualw (mgr.24569) 8618 : audit [DBG] from='client.39890 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:36:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:36:18.414506+0000 mon.smithi061 (mon.0) 1857 : audit [DBG] from='client.? 172.21.15.61:0/2852332754' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:36:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:36:17.757885+0000 mgr.smithi067.rdualw (mgr.24569) 8617 : audit [DBG] from='client.39886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:36:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:36:18.054469+0000 mgr.smithi067.rdualw (mgr.24569) 8618 : audit [DBG] from='client.39890 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:36:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:36:18.414506+0000 mon.smithi061 (mon.0) 1857 : audit [DBG] from='client.? 172.21.15.61:0/2852332754' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:36:19.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:18.918743+0000 mgr.smithi067.rdualw (mgr.24569) 8619 : cluster [DBG] pgmap v7423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:19.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:18.918743+0000 mgr.smithi067.rdualw (mgr.24569) 8619 : cluster [DBG] pgmap v7423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:20.919496+0000 mgr.smithi067.rdualw (mgr.24569) 8620 : cluster [DBG] pgmap v7424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:20.919496+0000 mgr.smithi067.rdualw (mgr.24569) 8620 : cluster [DBG] pgmap v7424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:22.920067+0000 mgr.smithi067.rdualw (mgr.24569) 8621 : cluster [DBG] pgmap v7425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:22.920067+0000 mgr.smithi067.rdualw (mgr.24569) 8621 : cluster [DBG] pgmap v7425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:24.920810+0000 mgr.smithi067.rdualw (mgr.24569) 8622 : cluster [DBG] pgmap v7426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:24.920810+0000 mgr.smithi067.rdualw (mgr.24569) 8622 : cluster [DBG] pgmap v7426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:26.921687+0000 mgr.smithi067.rdualw (mgr.24569) 8623 : cluster [DBG] pgmap v7427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:36:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:26.921687+0000 mgr.smithi067.rdualw (mgr.24569) 8623 : cluster [DBG] pgmap v7427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:36:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:28.922331+0000 mgr.smithi067.rdualw (mgr.24569) 8624 : cluster [DBG] pgmap v7428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:28.922331+0000 mgr.smithi067.rdualw (mgr.24569) 8624 : cluster [DBG] pgmap v7428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:30.923260+0000 mgr.smithi067.rdualw (mgr.24569) 8625 : cluster [DBG] pgmap v7429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:30.923260+0000 mgr.smithi067.rdualw (mgr.24569) 8625 : cluster [DBG] pgmap v7429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:32.923905+0000 mgr.smithi067.rdualw (mgr.24569) 8626 : cluster [DBG] pgmap v7430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:32.923905+0000 mgr.smithi067.rdualw (mgr.24569) 8626 : cluster [DBG] pgmap v7430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:34.924587+0000 mgr.smithi067.rdualw (mgr.24569) 8627 : cluster [DBG] pgmap v7431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:36:35.802325+0000 mon.smithi067 (mon.1) 1314 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:36:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:36:35.802466+0000 mon.smithi061 (mon.0) 1858 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:36:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:36:35.802571+0000 mon.smithi067 (mon.1) 1315 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:36:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:36:35.802836+0000 mon.smithi061 (mon.0) 1859 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:36:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:34.924587+0000 mgr.smithi067.rdualw (mgr.24569) 8627 : cluster [DBG] pgmap v7431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:36:35.802325+0000 mon.smithi067 (mon.1) 1314 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:36:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:36:35.802466+0000 mon.smithi061 (mon.0) 1858 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:36:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:36:35.802571+0000 mon.smithi067 (mon.1) 1315 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:36:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:36:35.802836+0000 mon.smithi061 (mon.0) 1859 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:36:37.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:36.925622+0000 mgr.smithi067.rdualw (mgr.24569) 8628 : cluster [DBG] pgmap v7432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:36:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:36.925622+0000 mgr.smithi067.rdualw (mgr.24569) 8628 : cluster [DBG] pgmap v7432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:36:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:38.926155+0000 mgr.smithi067.rdualw (mgr.24569) 8629 : cluster [DBG] pgmap v7433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:38.926155+0000 mgr.smithi067.rdualw (mgr.24569) 8629 : cluster [DBG] pgmap v7433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:42.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:40.927062+0000 mgr.smithi067.rdualw (mgr.24569) 8630 : cluster [DBG] pgmap v7434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:40.927062+0000 mgr.smithi067.rdualw (mgr.24569) 8630 : cluster [DBG] pgmap v7434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:44.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:42.927756+0000 mgr.smithi067.rdualw (mgr.24569) 8631 : cluster [DBG] pgmap v7435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:36:43.664476+0000 mon.smithi067 (mon.1) 1316 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:36:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:36:43.665883+0000 mon.smithi067 (mon.1) 1317 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:36:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:36:43.666807+0000 mon.smithi067 (mon.1) 1318 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:36:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:36:44.088016+0000 mon.smithi061 (mon.0) 1860 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:36:44.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:36:44.093616+0000 mon.smithi061 (mon.0) 1861 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:36:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:42.927756+0000 mgr.smithi067.rdualw (mgr.24569) 8631 : cluster [DBG] pgmap v7435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:36:43.664476+0000 mon.smithi067 (mon.1) 1316 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:36:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:36:43.665883+0000 mon.smithi067 (mon.1) 1317 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:36:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:36:43.666807+0000 mon.smithi067 (mon.1) 1318 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:36:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:36:44.088016+0000 mon.smithi061 (mon.0) 1860 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:36:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:36:44.093616+0000 mon.smithi061 (mon.0) 1861 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:36:45.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:36:43.667651+0000 mgr.smithi067.rdualw (mgr.24569) 8632 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:36:45.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:36:43.667651+0000 mgr.smithi067.rdualw (mgr.24569) 8632 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:36:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:44.928273+0000 mgr.smithi067.rdualw (mgr.24569) 8633 : cluster [DBG] pgmap v7436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:44.928273+0000 mgr.smithi067.rdualw (mgr.24569) 8633 : cluster [DBG] pgmap v7436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:46.929147+0000 mgr.smithi067.rdualw (mgr.24569) 8634 : cluster [DBG] pgmap v7437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:36:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:46.929147+0000 mgr.smithi067.rdualw (mgr.24569) 8634 : cluster [DBG] pgmap v7437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:36:48.724 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:36:49.036 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:36:49.036 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 65s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:36:49.037 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 65s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:36:49.037 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 68s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:36:49.037 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 65s ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:36:49.037 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 65s ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:36:49.038 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 68s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:36:49.038 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 65s ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:36:49.038 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 68s ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:36:49.038 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 65s ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:36:49.039 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 68s ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:36:49.039 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 65s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:36:49.039 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 68s ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:36:49.039 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 65s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:36:49.039 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 68s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:36:49.040 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 65s ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:36:49.040 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 65s ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:36:49.040 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 65s ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:36:49.040 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 65s ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:36:49.041 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 68s ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:36:49.041 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 68s ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:36:49.041 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 68s ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:36:49.041 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 68s ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:36:49.041 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 65s ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:36:49.380 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:36:49.380 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:36:49.381 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:36:49.381 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:36:49.381 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:36:49.381 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:36:49.382 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:36:49.382 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:36:49.382 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:36:49.383 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:36:49.383 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:36:49.383 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:36:49.384 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:36:49.384 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:36:49.384 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:36:49.385 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:36:49.385 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:36:49.385 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:36:49.386 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:36:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:36:48.711345+0000 mgr.smithi067.rdualw (mgr.24569) 8635 : audit [DBG] from='client.39898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:36:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:48.929719+0000 mgr.smithi067.rdualw (mgr.24569) 8636 : cluster [DBG] pgmap v7438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:36:49.019443+0000 mgr.smithi067.rdualw (mgr.24569) 8637 : audit [DBG] from='client.39902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:36:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:36:49.378973+0000 mon.smithi061 (mon.0) 1862 : audit [DBG] from='client.? 172.21.15.61:0/3464925692' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:36:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:36:48.711345+0000 mgr.smithi067.rdualw (mgr.24569) 8635 : audit [DBG] from='client.39898 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:36:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:48.929719+0000 mgr.smithi067.rdualw (mgr.24569) 8636 : cluster [DBG] pgmap v7438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:36:49.019443+0000 mgr.smithi067.rdualw (mgr.24569) 8637 : audit [DBG] from='client.39902 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:36:50.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:36:49.378973+0000 mon.smithi061 (mon.0) 1862 : audit [DBG] from='client.? 172.21.15.61:0/3464925692' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:36:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:50.930569+0000 mgr.smithi067.rdualw (mgr.24569) 8638 : cluster [DBG] pgmap v7439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:50.930569+0000 mgr.smithi067.rdualw (mgr.24569) 8638 : cluster [DBG] pgmap v7439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:52.931177+0000 mgr.smithi067.rdualw (mgr.24569) 8639 : cluster [DBG] pgmap v7440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:52.931177+0000 mgr.smithi067.rdualw (mgr.24569) 8639 : cluster [DBG] pgmap v7440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:56.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:54.932001+0000 mgr.smithi067.rdualw (mgr.24569) 8640 : cluster [DBG] pgmap v7441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:56.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:54.932001+0000 mgr.smithi067.rdualw (mgr.24569) 8640 : cluster [DBG] pgmap v7441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:36:57.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:56.932922+0000 mgr.smithi067.rdualw (mgr.24569) 8641 : cluster [DBG] pgmap v7442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:36:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:56.932922+0000 mgr.smithi067.rdualw (mgr.24569) 8641 : cluster [DBG] pgmap v7442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:37:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:36:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:36:58.933669+0000 mgr.smithi067.rdualw (mgr.24569) 8642 : cluster [DBG] pgmap v7443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:36:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:36:58.933669+0000 mgr.smithi067.rdualw (mgr.24569) 8642 : cluster [DBG] pgmap v7443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:00.934499+0000 mgr.smithi067.rdualw (mgr.24569) 8643 : cluster [DBG] pgmap v7444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:00.934499+0000 mgr.smithi067.rdualw (mgr.24569) 8643 : cluster [DBG] pgmap v7444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:02.935211+0000 mgr.smithi067.rdualw (mgr.24569) 8644 : cluster [DBG] pgmap v7445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:02.935211+0000 mgr.smithi067.rdualw (mgr.24569) 8644 : cluster [DBG] pgmap v7445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:06.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:04.935879+0000 mgr.smithi067.rdualw (mgr.24569) 8645 : cluster [DBG] pgmap v7446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:06.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:04.935879+0000 mgr.smithi067.rdualw (mgr.24569) 8645 : cluster [DBG] pgmap v7446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:07.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:06.936861+0000 mgr.smithi067.rdualw (mgr.24569) 8646 : cluster [DBG] pgmap v7447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:37:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:06.936861+0000 mgr.smithi067.rdualw (mgr.24569) 8646 : cluster [DBG] pgmap v7447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:37:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:08.937612+0000 mgr.smithi067.rdualw (mgr.24569) 8647 : cluster [DBG] pgmap v7448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:08.937612+0000 mgr.smithi067.rdualw (mgr.24569) 8647 : cluster [DBG] pgmap v7448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:10.938383+0000 mgr.smithi067.rdualw (mgr.24569) 8648 : cluster [DBG] pgmap v7449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:10.938383+0000 mgr.smithi067.rdualw (mgr.24569) 8648 : cluster [DBG] pgmap v7449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:12.938993+0000 mgr.smithi067.rdualw (mgr.24569) 8649 : cluster [DBG] pgmap v7450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:12.938993+0000 mgr.smithi067.rdualw (mgr.24569) 8649 : cluster [DBG] pgmap v7450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:14.939773+0000 mgr.smithi067.rdualw (mgr.24569) 8650 : cluster [DBG] pgmap v7451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:16.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:14.939773+0000 mgr.smithi067.rdualw (mgr.24569) 8650 : cluster [DBG] pgmap v7451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:17.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:16.940674+0000 mgr.smithi067.rdualw (mgr.24569) 8651 : cluster [DBG] pgmap v7452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:37:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:16.940674+0000 mgr.smithi067.rdualw (mgr.24569) 8651 : cluster [DBG] pgmap v7452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:37:19.690 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:37:19.980 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:37:19.980 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 96s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:37:19.981 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 96s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:37:19.981 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 99s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:37:19.981 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 96s ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:37:19.981 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 96s ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:37:19.981 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 99s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:37:19.982 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 96s ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:37:19.982 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 99s ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:37:19.982 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 96s ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:37:19.982 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 99s ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:37:19.983 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 96s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:37:19.983 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 99s ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:37:19.983 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 96s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:37:19.983 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 99s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:37:19.984 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 96s ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:37:19.984 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 96s ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:37:19.984 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 96s ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:37:19.984 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 96s ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:37:19.985 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 99s ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:37:19.985 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 99s ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:37:19.985 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 99s ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:37:19.985 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 99s ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:37:19.985 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 96s ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:37:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:18.941273+0000 mgr.smithi067.rdualw (mgr.24569) 8652 : cluster [DBG] pgmap v7453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:18.941273+0000 mgr.smithi067.rdualw (mgr.24569) 8652 : cluster [DBG] pgmap v7453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:20.320 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:37:20.321 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:37:20.321 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:37:20.321 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:37:20.321 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:37:20.322 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:37:20.322 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:37:20.322 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:37:20.322 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:37:20.323 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:37:20.323 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:37:20.323 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:37:20.323 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:37:20.324 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:37:20.324 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:37:20.324 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:37:20.325 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:37:20.325 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:37:20.325 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:37:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:37:19.675109+0000 mgr.smithi067.rdualw (mgr.24569) 8653 : audit [DBG] from='client.39910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:37:21.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:37:19.962891+0000 mgr.smithi067.rdualw (mgr.24569) 8654 : audit [DBG] from='client.39914 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:37:21.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:37:20.320006+0000 mon.smithi061 (mon.0) 1863 : audit [DBG] from='client.? 172.21.15.61:0/2304155819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:37:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:37:19.675109+0000 mgr.smithi067.rdualw (mgr.24569) 8653 : audit [DBG] from='client.39910 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:37:21.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:37:19.962891+0000 mgr.smithi067.rdualw (mgr.24569) 8654 : audit [DBG] from='client.39914 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:37:21.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:37:20.320006+0000 mon.smithi061 (mon.0) 1863 : audit [DBG] from='client.? 172.21.15.61:0/2304155819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:37:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:20.942293+0000 mgr.smithi067.rdualw (mgr.24569) 8655 : cluster [DBG] pgmap v7454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:20.942293+0000 mgr.smithi067.rdualw (mgr.24569) 8655 : cluster [DBG] pgmap v7454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:22.942902+0000 mgr.smithi067.rdualw (mgr.24569) 8656 : cluster [DBG] pgmap v7455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:22.942902+0000 mgr.smithi067.rdualw (mgr.24569) 8656 : cluster [DBG] pgmap v7455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:26.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:24.943687+0000 mgr.smithi067.rdualw (mgr.24569) 8657 : cluster [DBG] pgmap v7456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:24.943687+0000 mgr.smithi067.rdualw (mgr.24569) 8657 : cluster [DBG] pgmap v7456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:27.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:26.944808+0000 mgr.smithi067.rdualw (mgr.24569) 8658 : cluster [DBG] pgmap v7457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:37:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:26.944808+0000 mgr.smithi067.rdualw (mgr.24569) 8658 : cluster [DBG] pgmap v7457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:37:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:28.945555+0000 mgr.smithi067.rdualw (mgr.24569) 8659 : cluster [DBG] pgmap v7458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:28.945555+0000 mgr.smithi067.rdualw (mgr.24569) 8659 : cluster [DBG] pgmap v7458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:30.946409+0000 mgr.smithi067.rdualw (mgr.24569) 8660 : cluster [DBG] pgmap v7459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:30.946409+0000 mgr.smithi067.rdualw (mgr.24569) 8660 : cluster [DBG] pgmap v7459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:32.947149+0000 mgr.smithi067.rdualw (mgr.24569) 8661 : cluster [DBG] pgmap v7460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:32.947149+0000 mgr.smithi067.rdualw (mgr.24569) 8661 : cluster [DBG] pgmap v7460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:34.947903+0000 mgr.smithi067.rdualw (mgr.24569) 8662 : cluster [DBG] pgmap v7461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:37:35.808841+0000 mon.smithi067 (mon.1) 1319 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:37:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:37:35.809039+0000 mon.smithi061 (mon.0) 1864 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:37:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:37:35.809091+0000 mon.smithi067 (mon.1) 1320 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:37:36.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:37:35.809515+0000 mon.smithi061 (mon.0) 1865 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:37:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:34.947903+0000 mgr.smithi067.rdualw (mgr.24569) 8662 : cluster [DBG] pgmap v7461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:37:35.808841+0000 mon.smithi067 (mon.1) 1319 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:37:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:37:35.809039+0000 mon.smithi061 (mon.0) 1864 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:37:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:37:35.809091+0000 mon.smithi067 (mon.1) 1320 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:37:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:37:35.809515+0000 mon.smithi061 (mon.0) 1865 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:37:37.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:36.948733+0000 mgr.smithi067.rdualw (mgr.24569) 8663 : cluster [DBG] pgmap v7462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:37:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:36.948733+0000 mgr.smithi067.rdualw (mgr.24569) 8663 : cluster [DBG] pgmap v7462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:37:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:38.949397+0000 mgr.smithi067.rdualw (mgr.24569) 8664 : cluster [DBG] pgmap v7463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:38.949397+0000 mgr.smithi067.rdualw (mgr.24569) 8664 : cluster [DBG] pgmap v7463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:42.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:40.950151+0000 mgr.smithi067.rdualw (mgr.24569) 8665 : cluster [DBG] pgmap v7464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:40.950151+0000 mgr.smithi067.rdualw (mgr.24569) 8665 : cluster [DBG] pgmap v7464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:42.950693+0000 mgr.smithi067.rdualw (mgr.24569) 8666 : cluster [DBG] pgmap v7465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:42.950693+0000 mgr.smithi067.rdualw (mgr.24569) 8666 : cluster [DBG] pgmap v7465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:37:44.099611+0000 mon.smithi067 (mon.1) 1321 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:37:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:37:44.101077+0000 mon.smithi067 (mon.1) 1322 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:37:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:37:44.102020+0000 mon.smithi067 (mon.1) 1323 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:37:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:37:44.102879+0000 mgr.smithi067.rdualw (mgr.24569) 8667 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:37:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:37:44.456373+0000 mon.smithi061 (mon.0) 1866 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:37:45.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:37:44.468696+0000 mon.smithi061 (mon.0) 1867 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:37:45.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:37:44.869926+0000 mon.smithi061 (mon.0) 1868 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:37:45.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:37:44.877985+0000 mon.smithi061 (mon.0) 1869 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:37:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:37:44.099611+0000 mon.smithi067 (mon.1) 1321 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:37:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:37:44.101077+0000 mon.smithi067 (mon.1) 1322 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:37:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:37:44.102020+0000 mon.smithi067 (mon.1) 1323 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:37:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:37:44.102879+0000 mgr.smithi067.rdualw (mgr.24569) 8667 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:37:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:37:44.456373+0000 mon.smithi061 (mon.0) 1866 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:37:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:37:44.468696+0000 mon.smithi061 (mon.0) 1867 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:37:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:37:44.869926+0000 mon.smithi061 (mon.0) 1868 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:37:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:37:44.877985+0000 mon.smithi061 (mon.0) 1869 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:37:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:44.951431+0000 mgr.smithi067.rdualw (mgr.24569) 8668 : cluster [DBG] pgmap v7466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:44.951431+0000 mgr.smithi067.rdualw (mgr.24569) 8668 : cluster [DBG] pgmap v7466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:47.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:46.952373+0000 mgr.smithi067.rdualw (mgr.24569) 8669 : cluster [DBG] pgmap v7467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:37:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:46.952373+0000 mgr.smithi067.rdualw (mgr.24569) 8669 : cluster [DBG] pgmap v7467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:37:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:48.953150+0000 mgr.smithi067.rdualw (mgr.24569) 8670 : cluster [DBG] pgmap v7468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:48.953150+0000 mgr.smithi067.rdualw (mgr.24569) 8670 : cluster [DBG] pgmap v7468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:50.628 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:37:50.917 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:37:50.917 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 2m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:37:50.918 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 2m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:37:50.918 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 2m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:37:50.918 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 2m ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:37:50.918 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 2m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:37:50.918 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 2m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:37:50.919 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 2m ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:37:50.919 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 2m ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:37:50.919 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 2m ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:37:50.919 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 2m ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:37:50.920 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 2m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:37:50.920 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 2m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:37:50.920 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 2m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:37:50.920 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 2m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:37:50.920 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 2m ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:37:50.921 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 2m ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:37:50.921 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 2m ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:37:50.921 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 2m ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:37:50.921 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 2m ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:37:50.921 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 2m ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:37:50.922 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 2m ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:37:50.922 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 2m ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:37:50.922 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 2m ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:37:51.260 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:37:51.260 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:37:51.261 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:37:51.261 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:37:51.261 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:37:51.261 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:37:51.262 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:37:51.262 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:37:51.262 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:37:51.262 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:37:51.263 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:37:51.263 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:37:51.263 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:37:51.263 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:37:51.263 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:37:51.264 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:37:51.264 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:37:51.264 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:37:51.264 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:37:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:37:50.612570+0000 mgr.smithi067.rdualw (mgr.24569) 8671 : audit [DBG] from='client.39922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:37:52.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:37:50.900362+0000 mgr.smithi067.rdualw (mgr.24569) 8672 : audit [DBG] from='client.39926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:37:52.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:50.954147+0000 mgr.smithi067.rdualw (mgr.24569) 8673 : cluster [DBG] pgmap v7469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:52.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:37:51.259236+0000 mon.smithi061 (mon.0) 1870 : audit [DBG] from='client.? 172.21.15.61:0/1620230592' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:37:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:37:50.612570+0000 mgr.smithi067.rdualw (mgr.24569) 8671 : audit [DBG] from='client.39922 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:37:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:37:50.900362+0000 mgr.smithi067.rdualw (mgr.24569) 8672 : audit [DBG] from='client.39926 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:37:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:50.954147+0000 mgr.smithi067.rdualw (mgr.24569) 8673 : cluster [DBG] pgmap v7469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:52.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:37:51.259236+0000 mon.smithi061 (mon.0) 1870 : audit [DBG] from='client.? 172.21.15.61:0/1620230592' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:37:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:52.954832+0000 mgr.smithi067.rdualw (mgr.24569) 8674 : cluster [DBG] pgmap v7470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:52.954832+0000 mgr.smithi067.rdualw (mgr.24569) 8674 : cluster [DBG] pgmap v7470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:54.955483+0000 mgr.smithi067.rdualw (mgr.24569) 8675 : cluster [DBG] pgmap v7471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:54.955483+0000 mgr.smithi067.rdualw (mgr.24569) 8675 : cluster [DBG] pgmap v7471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:37:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:37:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:56.956316+0000 mgr.smithi067.rdualw (mgr.24569) 8676 : cluster [DBG] pgmap v7472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:37:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:37:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:56.956316+0000 mgr.smithi067.rdualw (mgr.24569) 8676 : cluster [DBG] pgmap v7472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:38:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:37:58.956995+0000 mgr.smithi067.rdualw (mgr.24569) 8677 : cluster [DBG] pgmap v7473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:37:58.956995+0000 mgr.smithi067.rdualw (mgr.24569) 8677 : cluster [DBG] pgmap v7473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:02.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:00.957822+0000 mgr.smithi067.rdualw (mgr.24569) 8678 : cluster [DBG] pgmap v7474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:00.957822+0000 mgr.smithi067.rdualw (mgr.24569) 8678 : cluster [DBG] pgmap v7474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:02.958503+0000 mgr.smithi067.rdualw (mgr.24569) 8679 : cluster [DBG] pgmap v7475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:02.958503+0000 mgr.smithi067.rdualw (mgr.24569) 8679 : cluster [DBG] pgmap v7475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:04.959098+0000 mgr.smithi067.rdualw (mgr.24569) 8680 : cluster [DBG] pgmap v7476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:04.959098+0000 mgr.smithi067.rdualw (mgr.24569) 8680 : cluster [DBG] pgmap v7476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:08.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:06.959969+0000 mgr.smithi067.rdualw (mgr.24569) 8681 : cluster [DBG] pgmap v7477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:38:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:06.959969+0000 mgr.smithi067.rdualw (mgr.24569) 8681 : cluster [DBG] pgmap v7477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:38:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:08.960659+0000 mgr.smithi067.rdualw (mgr.24569) 8682 : cluster [DBG] pgmap v7478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:08.960659+0000 mgr.smithi067.rdualw (mgr.24569) 8682 : cluster [DBG] pgmap v7478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:10.961585+0000 mgr.smithi067.rdualw (mgr.24569) 8683 : cluster [DBG] pgmap v7479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:10.961585+0000 mgr.smithi067.rdualw (mgr.24569) 8683 : cluster [DBG] pgmap v7479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:12.962082+0000 mgr.smithi067.rdualw (mgr.24569) 8684 : cluster [DBG] pgmap v7480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:12.962082+0000 mgr.smithi067.rdualw (mgr.24569) 8684 : cluster [DBG] pgmap v7480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:14.962741+0000 mgr.smithi067.rdualw (mgr.24569) 8685 : cluster [DBG] pgmap v7481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:14.962741+0000 mgr.smithi067.rdualw (mgr.24569) 8685 : cluster [DBG] pgmap v7481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:16.963700+0000 mgr.smithi067.rdualw (mgr.24569) 8686 : cluster [DBG] pgmap v7482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:38:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:16.963700+0000 mgr.smithi067.rdualw (mgr.24569) 8686 : cluster [DBG] pgmap v7482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:38:20.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:18.964342+0000 mgr.smithi067.rdualw (mgr.24569) 8687 : cluster [DBG] pgmap v7483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:18.964342+0000 mgr.smithi067.rdualw (mgr.24569) 8687 : cluster [DBG] pgmap v7483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:21.568 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:38:21.869 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:38:21.870 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 2m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:38:21.870 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 2m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:38:21.870 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 2m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:38:21.870 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 2m ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:38:21.871 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 2m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:38:21.871 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 2m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:38:21.871 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 2m ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:38:21.871 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 2m ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:38:21.872 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 2m ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:38:21.872 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 2m ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:38:21.872 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 2m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:38:21.872 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 2m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:38:21.872 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 2m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:38:21.873 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 2m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:38:21.873 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 2m ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:38:21.873 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 2m ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:38:21.873 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 2m ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:38:21.873 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 2m ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:38:21.874 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 2m ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:38:21.874 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 2m ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:38:21.874 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 2m ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:38:21.874 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 2m ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:38:21.875 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 2m ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:38:22.245 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:38:22.245 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:38:22.245 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:38:22.246 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:38:22.246 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:38:22.246 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:38:22.246 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:38:22.246 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:38:22.247 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:38:22.247 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:38:22.247 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:38:22.247 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:38:22.248 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:38:22.248 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:38:22.248 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:38:22.248 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:38:22.249 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:38:22.249 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:38:22.249 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:38:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:20.965324+0000 mgr.smithi067.rdualw (mgr.24569) 8688 : cluster [DBG] pgmap v7484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:38:21.555147+0000 mgr.smithi067.rdualw (mgr.24569) 8689 : audit [DBG] from='client.39934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:38:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:38:22.243959+0000 mon.smithi061 (mon.0) 1871 : audit [DBG] from='client.? 172.21.15.61:0/3707563390' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:38:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:20.965324+0000 mgr.smithi067.rdualw (mgr.24569) 8688 : cluster [DBG] pgmap v7484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:38:21.555147+0000 mgr.smithi067.rdualw (mgr.24569) 8689 : audit [DBG] from='client.39934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:38:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:38:22.243959+0000 mon.smithi061 (mon.0) 1871 : audit [DBG] from='client.? 172.21.15.61:0/3707563390' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:38:23.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:38:21.852205+0000 mgr.smithi067.rdualw (mgr.24569) 8690 : audit [DBG] from='client.48267 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:38:24.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:38:21.852205+0000 mgr.smithi067.rdualw (mgr.24569) 8690 : audit [DBG] from='client.48267 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:38:24.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:22.966020+0000 mgr.smithi067.rdualw (mgr.24569) 8691 : cluster [DBG] pgmap v7485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:22.966020+0000 mgr.smithi067.rdualw (mgr.24569) 8691 : cluster [DBG] pgmap v7485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:24.966752+0000 mgr.smithi067.rdualw (mgr.24569) 8692 : cluster [DBG] pgmap v7486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:24.966752+0000 mgr.smithi067.rdualw (mgr.24569) 8692 : cluster [DBG] pgmap v7486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:28.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:26.967812+0000 mgr.smithi067.rdualw (mgr.24569) 8693 : cluster [DBG] pgmap v7487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:38:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:26.967812+0000 mgr.smithi067.rdualw (mgr.24569) 8693 : cluster [DBG] pgmap v7487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:38:30.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:28.968469+0000 mgr.smithi067.rdualw (mgr.24569) 8694 : cluster [DBG] pgmap v7488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:28.968469+0000 mgr.smithi067.rdualw (mgr.24569) 8694 : cluster [DBG] pgmap v7488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:30.969335+0000 mgr.smithi067.rdualw (mgr.24569) 8695 : cluster [DBG] pgmap v7489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:30.969335+0000 mgr.smithi067.rdualw (mgr.24569) 8695 : cluster [DBG] pgmap v7489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:34.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:32.970069+0000 mgr.smithi067.rdualw (mgr.24569) 8696 : cluster [DBG] pgmap v7490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:32.970069+0000 mgr.smithi067.rdualw (mgr.24569) 8696 : cluster [DBG] pgmap v7490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:34.970749+0000 mgr.smithi067.rdualw (mgr.24569) 8697 : cluster [DBG] pgmap v7491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:34.970749+0000 mgr.smithi067.rdualw (mgr.24569) 8697 : cluster [DBG] pgmap v7491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:38:35.813266+0000 mon.smithi067 (mon.1) 1324 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:38:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:38:35.813539+0000 mon.smithi061 (mon.0) 1872 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:38:37.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:38:35.813720+0000 mon.smithi067 (mon.1) 1325 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:38:37.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:38:35.813840+0000 mon.smithi061 (mon.0) 1873 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:38:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:38:35.813266+0000 mon.smithi067 (mon.1) 1324 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:38:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:38:35.813539+0000 mon.smithi061 (mon.0) 1872 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:38:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:38:35.813720+0000 mon.smithi067 (mon.1) 1325 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:38:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:38:35.813840+0000 mon.smithi061 (mon.0) 1873 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:38:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:36.971649+0000 mgr.smithi067.rdualw (mgr.24569) 8698 : cluster [DBG] pgmap v7492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:38:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:36.971649+0000 mgr.smithi067.rdualw (mgr.24569) 8698 : cluster [DBG] pgmap v7492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:38:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:38.972290+0000 mgr.smithi067.rdualw (mgr.24569) 8699 : cluster [DBG] pgmap v7493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:38.972290+0000 mgr.smithi067.rdualw (mgr.24569) 8699 : cluster [DBG] pgmap v7493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:40.973373+0000 mgr.smithi067.rdualw (mgr.24569) 8700 : cluster [DBG] pgmap v7494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:40.973373+0000 mgr.smithi067.rdualw (mgr.24569) 8700 : cluster [DBG] pgmap v7494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:44.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:42.973939+0000 mgr.smithi067.rdualw (mgr.24569) 8701 : cluster [DBG] pgmap v7495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:42.973939+0000 mgr.smithi067.rdualw (mgr.24569) 8701 : cluster [DBG] pgmap v7495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:38:44.883849+0000 mon.smithi067 (mon.1) 1326 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:38:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:38:44.885275+0000 mon.smithi067 (mon.1) 1327 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:38:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:38:44.886176+0000 mon.smithi067 (mon.1) 1328 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:38:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:38:44.887017+0000 mgr.smithi067.rdualw (mgr.24569) 8702 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:38:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:44.974610+0000 mgr.smithi067.rdualw (mgr.24569) 8703 : cluster [DBG] pgmap v7496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:38:45.304989+0000 mon.smithi061 (mon.0) 1874 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:38:46.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:38:45.310473+0000 mon.smithi061 (mon.0) 1875 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:38:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:38:44.883849+0000 mon.smithi067 (mon.1) 1326 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:38:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:38:44.885275+0000 mon.smithi067 (mon.1) 1327 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:38:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:38:44.886176+0000 mon.smithi067 (mon.1) 1328 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:38:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:38:44.887017+0000 mgr.smithi067.rdualw (mgr.24569) 8702 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:38:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:44.974610+0000 mgr.smithi067.rdualw (mgr.24569) 8703 : cluster [DBG] pgmap v7496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:38:45.304989+0000 mon.smithi061 (mon.0) 1874 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:38:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:38:45.310473+0000 mon.smithi061 (mon.0) 1875 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:38:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:46.975681+0000 mgr.smithi067.rdualw (mgr.24569) 8704 : cluster [DBG] pgmap v7497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:38:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:46.975681+0000 mgr.smithi067.rdualw (mgr.24569) 8704 : cluster [DBG] pgmap v7497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:38:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:48.976432+0000 mgr.smithi067.rdualw (mgr.24569) 8705 : cluster [DBG] pgmap v7498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:48.976432+0000 mgr.smithi067.rdualw (mgr.24569) 8705 : cluster [DBG] pgmap v7498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:52.554 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:38:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:50.977335+0000 mgr.smithi067.rdualw (mgr.24569) 8706 : cluster [DBG] pgmap v7499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:52.850 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:38:52.851 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 3m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:38:52.851 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 3m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:38:52.851 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 3m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:38:52.852 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 3m ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:38:52.852 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 3m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:38:52.852 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 3m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:38:52.852 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 3m ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:38:52.853 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 3m ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:38:52.853 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 3m ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:38:52.853 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 3m ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:38:52.853 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 3m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:38:52.853 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 3m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:38:52.854 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 3m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:38:52.854 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 3m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:38:52.854 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (3h) 3m ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:38:52.854 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 3m ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:38:52.855 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 3m ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:38:52.855 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 3m ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:38:52.855 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 3m ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:38:52.855 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 3m ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:38:52.855 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 3m ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:38:52.856 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 3m ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:38:52.856 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 3m ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:38:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:50.977335+0000 mgr.smithi067.rdualw (mgr.24569) 8706 : cluster [DBG] pgmap v7499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:53.197 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:38:53.197 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:38:53.197 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:38:53.197 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:38:53.198 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:38:53.198 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:38:53.198 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:38:53.198 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:38:53.199 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:38:53.199 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:38:53.199 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:38:53.199 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:38:53.200 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:38:53.200 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:38:53.200 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:38:53.200 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:38:53.200 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:38:53.201 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:38:53.201 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:38:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:38:52.541473+0000 mgr.smithi067.rdualw (mgr.24569) 8707 : audit [DBG] from='client.39946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:38:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:38:53.195863+0000 mon.smithi061 (mon.0) 1876 : audit [DBG] from='client.? 172.21.15.61:0/3413369596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:38:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:38:52.541473+0000 mgr.smithi067.rdualw (mgr.24569) 8707 : audit [DBG] from='client.39946 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:38:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:38:53.195863+0000 mon.smithi061 (mon.0) 1876 : audit [DBG] from='client.? 172.21.15.61:0/3413369596' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:38:54.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:38:52.833049+0000 mgr.smithi067.rdualw (mgr.24569) 8708 : audit [DBG] from='client.39950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:38:54.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:52.978002+0000 mgr.smithi067.rdualw (mgr.24569) 8709 : cluster [DBG] pgmap v7500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:38:52.833049+0000 mgr.smithi067.rdualw (mgr.24569) 8708 : audit [DBG] from='client.39950 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:38:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:52.978002+0000 mgr.smithi067.rdualw (mgr.24569) 8709 : cluster [DBG] pgmap v7500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:54.978648+0000 mgr.smithi067.rdualw (mgr.24569) 8710 : cluster [DBG] pgmap v7501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:54.978648+0000 mgr.smithi067.rdualw (mgr.24569) 8710 : cluster [DBG] pgmap v7501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:38:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:56.979448+0000 mgr.smithi067.rdualw (mgr.24569) 8711 : cluster [DBG] pgmap v7502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:38:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:56.979448+0000 mgr.smithi067.rdualw (mgr.24569) 8711 : cluster [DBG] pgmap v7502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:39:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:38:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:38:58.980004+0000 mgr.smithi067.rdualw (mgr.24569) 8712 : cluster [DBG] pgmap v7503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:38:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:38:58.980004+0000 mgr.smithi067.rdualw (mgr.24569) 8712 : cluster [DBG] pgmap v7503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:00.980869+0000 mgr.smithi067.rdualw (mgr.24569) 8713 : cluster [DBG] pgmap v7504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:00.980869+0000 mgr.smithi067.rdualw (mgr.24569) 8713 : cluster [DBG] pgmap v7504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:04.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:02.981423+0000 mgr.smithi067.rdualw (mgr.24569) 8714 : cluster [DBG] pgmap v7505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:02.981423+0000 mgr.smithi067.rdualw (mgr.24569) 8714 : cluster [DBG] pgmap v7505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:04.982061+0000 mgr.smithi067.rdualw (mgr.24569) 8715 : cluster [DBG] pgmap v7506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:04.982061+0000 mgr.smithi067.rdualw (mgr.24569) 8715 : cluster [DBG] pgmap v7506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:06.982979+0000 mgr.smithi067.rdualw (mgr.24569) 8716 : cluster [DBG] pgmap v7507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:39:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:06.982979+0000 mgr.smithi067.rdualw (mgr.24569) 8716 : cluster [DBG] pgmap v7507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:39:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:08.983782+0000 mgr.smithi067.rdualw (mgr.24569) 8717 : cluster [DBG] pgmap v7508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:11.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:08.983782+0000 mgr.smithi067.rdualw (mgr.24569) 8717 : cluster [DBG] pgmap v7508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:10.984810+0000 mgr.smithi067.rdualw (mgr.24569) 8718 : cluster [DBG] pgmap v7509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:10.984810+0000 mgr.smithi067.rdualw (mgr.24569) 8718 : cluster [DBG] pgmap v7509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:14.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:12.985408+0000 mgr.smithi067.rdualw (mgr.24569) 8719 : cluster [DBG] pgmap v7510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:12.985408+0000 mgr.smithi067.rdualw (mgr.24569) 8719 : cluster [DBG] pgmap v7510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:14.986021+0000 mgr.smithi067.rdualw (mgr.24569) 8720 : cluster [DBG] pgmap v7511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:14.986021+0000 mgr.smithi067.rdualw (mgr.24569) 8720 : cluster [DBG] pgmap v7511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:16.986929+0000 mgr.smithi067.rdualw (mgr.24569) 8721 : cluster [DBG] pgmap v7512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:39:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:16.986929+0000 mgr.smithi067.rdualw (mgr.24569) 8721 : cluster [DBG] pgmap v7512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:39:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:18.987463+0000 mgr.smithi067.rdualw (mgr.24569) 8722 : cluster [DBG] pgmap v7513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:18.987463+0000 mgr.smithi067.rdualw (mgr.24569) 8722 : cluster [DBG] pgmap v7513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:20.988399+0000 mgr.smithi067.rdualw (mgr.24569) 8723 : cluster [DBG] pgmap v7514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:20.988399+0000 mgr.smithi067.rdualw (mgr.24569) 8723 : cluster [DBG] pgmap v7514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:23.532 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:39:23.822 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:39:23.823 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 3m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:39:23.823 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 3m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:39:23.823 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 3m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:39:23.824 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 3m ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:39:23.824 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 3m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:39:23.824 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 3m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:39:23.824 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 3m ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:39:23.825 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 3m ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:39:23.825 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 3m ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:39:23.826 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 3m ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:39:23.826 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 3m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:39:23.826 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 3m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:39:23.827 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 3m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:39:23.827 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 3m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:39:23.827 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 3m ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:39:23.827 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 3m ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:39:23.827 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 3m ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:39:23.828 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 3m ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:39:23.828 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 3m ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:39:23.828 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 3m ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:39:23.828 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 3m ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:39:23.829 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 3m ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:39:23.829 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 3m ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:39:24.173 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:39:24.173 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:39:24.173 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:39:24.174 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:39:24.174 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:39:24.174 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:39:24.174 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:39:24.174 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:39:24.175 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:39:24.175 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:39:24.175 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:39:24.175 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:39:24.176 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:39:24.176 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:39:24.176 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:39:24.176 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:39:24.176 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:39:24.177 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:39:24.177 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:39:24.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:22.989129+0000 mgr.smithi067.rdualw (mgr.24569) 8724 : cluster [DBG] pgmap v7515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:24.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:39:23.519046+0000 mgr.smithi067.rdualw (mgr.24569) 8725 : audit [DBG] from='client.39958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:39:24.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:39:24.172029+0000 mon.smithi061 (mon.0) 1877 : audit [DBG] from='client.? 172.21.15.61:0/3976009064' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:39:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:22.989129+0000 mgr.smithi067.rdualw (mgr.24569) 8724 : cluster [DBG] pgmap v7515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:39:23.519046+0000 mgr.smithi067.rdualw (mgr.24569) 8725 : audit [DBG] from='client.39958 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:39:25.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:39:24.172029+0000 mon.smithi061 (mon.0) 1877 : audit [DBG] from='client.? 172.21.15.61:0/3976009064' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:39:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:39:23.805198+0000 mgr.smithi067.rdualw (mgr.24569) 8726 : audit [DBG] from='client.39962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:39:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:39:23.805198+0000 mgr.smithi067.rdualw (mgr.24569) 8726 : audit [DBG] from='client.39962 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:39:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:24.989732+0000 mgr.smithi067.rdualw (mgr.24569) 8727 : cluster [DBG] pgmap v7516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:24.989732+0000 mgr.smithi067.rdualw (mgr.24569) 8727 : cluster [DBG] pgmap v7516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:26.990707+0000 mgr.smithi067.rdualw (mgr.24569) 8728 : cluster [DBG] pgmap v7517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:39:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:26.990707+0000 mgr.smithi067.rdualw (mgr.24569) 8728 : cluster [DBG] pgmap v7517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:39:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:28.991506+0000 mgr.smithi067.rdualw (mgr.24569) 8729 : cluster [DBG] pgmap v7518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:28.991506+0000 mgr.smithi067.rdualw (mgr.24569) 8729 : cluster [DBG] pgmap v7518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:30.992612+0000 mgr.smithi067.rdualw (mgr.24569) 8730 : cluster [DBG] pgmap v7519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:30.992612+0000 mgr.smithi067.rdualw (mgr.24569) 8730 : cluster [DBG] pgmap v7519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:34.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:32.993265+0000 mgr.smithi067.rdualw (mgr.24569) 8731 : cluster [DBG] pgmap v7520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:32.993265+0000 mgr.smithi067.rdualw (mgr.24569) 8731 : cluster [DBG] pgmap v7520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:34.993827+0000 mgr.smithi067.rdualw (mgr.24569) 8732 : cluster [DBG] pgmap v7521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:34.993827+0000 mgr.smithi067.rdualw (mgr.24569) 8732 : cluster [DBG] pgmap v7521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:39:35.820497+0000 mon.smithi067 (mon.1) 1329 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:39:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:39:35.820762+0000 mon.smithi067 (mon.1) 1330 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:39:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:39:35.820941+0000 mon.smithi061 (mon.0) 1878 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:39:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:39:35.821254+0000 mon.smithi061 (mon.0) 1879 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:39:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:39:35.820497+0000 mon.smithi067 (mon.1) 1329 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:39:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:39:35.820762+0000 mon.smithi067 (mon.1) 1330 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:39:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:39:35.820941+0000 mon.smithi061 (mon.0) 1878 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:39:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:39:35.821254+0000 mon.smithi061 (mon.0) 1879 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:39:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:36.994724+0000 mgr.smithi067.rdualw (mgr.24569) 8733 : cluster [DBG] pgmap v7522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:39:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:36.994724+0000 mgr.smithi067.rdualw (mgr.24569) 8733 : cluster [DBG] pgmap v7522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:39:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:38.995458+0000 mgr.smithi067.rdualw (mgr.24569) 8734 : cluster [DBG] pgmap v7523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:38.995458+0000 mgr.smithi067.rdualw (mgr.24569) 8734 : cluster [DBG] pgmap v7523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:40.996237+0000 mgr.smithi067.rdualw (mgr.24569) 8735 : cluster [DBG] pgmap v7524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:40.996237+0000 mgr.smithi067.rdualw (mgr.24569) 8735 : cluster [DBG] pgmap v7524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:44.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:42.996815+0000 mgr.smithi067.rdualw (mgr.24569) 8736 : cluster [DBG] pgmap v7525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:42.996815+0000 mgr.smithi067.rdualw (mgr.24569) 8736 : cluster [DBG] pgmap v7525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:44.997598+0000 mgr.smithi067.rdualw (mgr.24569) 8737 : cluster [DBG] pgmap v7526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:39:45.313963+0000 mon.smithi067 (mon.1) 1331 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:39:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:39:45.315411+0000 mon.smithi067 (mon.1) 1332 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:39:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:39:45.316314+0000 mon.smithi067 (mon.1) 1333 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:39:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:39:45.317139+0000 mgr.smithi067.rdualw (mgr.24569) 8738 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:39:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:44.997598+0000 mgr.smithi067.rdualw (mgr.24569) 8737 : cluster [DBG] pgmap v7526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:39:45.313963+0000 mon.smithi067 (mon.1) 1331 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:39:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:39:45.315411+0000 mon.smithi067 (mon.1) 1332 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:39:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:39:45.316314+0000 mon.smithi067 (mon.1) 1333 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:39:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:39:45.317139+0000 mgr.smithi067.rdualw (mgr.24569) 8738 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:39:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:39:45.731164+0000 mon.smithi061 (mon.0) 1880 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:39:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:39:45.736847+0000 mon.smithi061 (mon.0) 1881 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:39:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:39:45.731164+0000 mon.smithi061 (mon.0) 1880 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:39:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:39:45.736847+0000 mon.smithi061 (mon.0) 1881 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:39:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:46.998491+0000 mgr.smithi067.rdualw (mgr.24569) 8739 : cluster [DBG] pgmap v7527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:39:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:46.998491+0000 mgr.smithi067.rdualw (mgr.24569) 8739 : cluster [DBG] pgmap v7527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:39:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:48.999090+0000 mgr.smithi067.rdualw (mgr.24569) 8740 : cluster [DBG] pgmap v7528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:48.999090+0000 mgr.smithi067.rdualw (mgr.24569) 8740 : cluster [DBG] pgmap v7528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:51.000039+0000 mgr.smithi067.rdualw (mgr.24569) 8741 : cluster [DBG] pgmap v7529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:51.000039+0000 mgr.smithi067.rdualw (mgr.24569) 8741 : cluster [DBG] pgmap v7529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:54.484 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:39:54.781 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:39:54.782 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 4m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:39:54.782 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 4m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:39:54.782 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 4m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:39:54.782 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 4m ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:39:54.782 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 4m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:39:54.783 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 4m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:39:54.783 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 4m ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:39:54.783 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 4m ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:39:54.783 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 4m ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:39:54.784 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 4m ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:39:54.784 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 4m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:39:54.784 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 4m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:39:54.784 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 4m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:39:54.784 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 4m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:39:54.785 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 4m ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:39:54.785 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 4m ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:39:54.785 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 4m ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:39:54.785 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 4m ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:39:54.786 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 4m ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:39:54.786 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 4m ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:39:54.786 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 4m ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:39:54.786 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 4m ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:39:54.786 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 4m ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:39:54.837 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:53.000680+0000 mgr.smithi067.rdualw (mgr.24569) 8742 : cluster [DBG] pgmap v7530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:53.000680+0000 mgr.smithi067.rdualw (mgr.24569) 8742 : cluster [DBG] pgmap v7530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:55.182 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:39:55.182 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:39:55.182 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:39:55.183 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:39:55.183 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:39:55.183 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:39:55.183 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:39:55.184 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:39:55.184 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:39:55.184 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:39:55.184 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:39:55.184 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:39:55.185 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:39:55.185 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:39:55.185 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:39:55.186 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:39:55.186 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:39:55.186 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:39:55.186 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:39:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:39:54.470548+0000 mgr.smithi067.rdualw (mgr.24569) 8743 : audit [DBG] from='client.39970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:39:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:39:55.180987+0000 mon.smithi061 (mon.0) 1882 : audit [DBG] from='client.? 172.21.15.61:0/4055188736' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:39:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:39:54.470548+0000 mgr.smithi067.rdualw (mgr.24569) 8743 : audit [DBG] from='client.39970 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:39:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:39:55.180987+0000 mon.smithi061 (mon.0) 1882 : audit [DBG] from='client.? 172.21.15.61:0/4055188736' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:39:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:39:54.763661+0000 mgr.smithi067.rdualw (mgr.24569) 8744 : audit [DBG] from='client.39974 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:39:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:55.001383+0000 mgr.smithi067.rdualw (mgr.24569) 8745 : cluster [DBG] pgmap v7531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:57.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:39:54.763661+0000 mgr.smithi067.rdualw (mgr.24569) 8744 : audit [DBG] from='client.39974 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:39:57.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:55.001383+0000 mgr.smithi067.rdualw (mgr.24569) 8745 : cluster [DBG] pgmap v7531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:39:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:39:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:57.002270+0000 mgr.smithi067.rdualw (mgr.24569) 8746 : cluster [DBG] pgmap v7532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:39:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:39:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:57.002270+0000 mgr.smithi067.rdualw (mgr.24569) 8746 : cluster [DBG] pgmap v7532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:40:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:39:59.002966+0000 mgr.smithi067.rdualw (mgr.24569) 8747 : cluster [DBG] pgmap v7533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:00.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:00.000097+0000 mon.smithi061 (mon.0) 1883 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T19:40:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:39:59.002966+0000 mgr.smithi067.rdualw (mgr.24569) 8747 : cluster [DBG] pgmap v7533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:00.000097+0000 mon.smithi061 (mon.0) 1883 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T19:40:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:01.003761+0000 mgr.smithi067.rdualw (mgr.24569) 8748 : cluster [DBG] pgmap v7534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:01.003761+0000 mgr.smithi067.rdualw (mgr.24569) 8748 : cluster [DBG] pgmap v7534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:04.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:03.004236+0000 mgr.smithi067.rdualw (mgr.24569) 8749 : cluster [DBG] pgmap v7535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:03.004236+0000 mgr.smithi067.rdualw (mgr.24569) 8749 : cluster [DBG] pgmap v7535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:07.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:05.005046+0000 mgr.smithi067.rdualw (mgr.24569) 8750 : cluster [DBG] pgmap v7536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:05.005046+0000 mgr.smithi067.rdualw (mgr.24569) 8750 : cluster [DBG] pgmap v7536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:07.005967+0000 mgr.smithi067.rdualw (mgr.24569) 8751 : cluster [DBG] pgmap v7537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:40:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:07.005967+0000 mgr.smithi067.rdualw (mgr.24569) 8751 : cluster [DBG] pgmap v7537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:40:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:09.006696+0000 mgr.smithi067.rdualw (mgr.24569) 8752 : cluster [DBG] pgmap v7538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:09.006696+0000 mgr.smithi067.rdualw (mgr.24569) 8752 : cluster [DBG] pgmap v7538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:11.007493+0000 mgr.smithi067.rdualw (mgr.24569) 8753 : cluster [DBG] pgmap v7539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:11.007493+0000 mgr.smithi067.rdualw (mgr.24569) 8753 : cluster [DBG] pgmap v7539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:14.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:13.008068+0000 mgr.smithi067.rdualw (mgr.24569) 8754 : cluster [DBG] pgmap v7540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:13.008068+0000 mgr.smithi067.rdualw (mgr.24569) 8754 : cluster [DBG] pgmap v7540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:15.008826+0000 mgr.smithi067.rdualw (mgr.24569) 8755 : cluster [DBG] pgmap v7541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:15.008826+0000 mgr.smithi067.rdualw (mgr.24569) 8755 : cluster [DBG] pgmap v7541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:17.009801+0000 mgr.smithi067.rdualw (mgr.24569) 8756 : cluster [DBG] pgmap v7542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:40:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:17.009801+0000 mgr.smithi067.rdualw (mgr.24569) 8756 : cluster [DBG] pgmap v7542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:40:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:19.010525+0000 mgr.smithi067.rdualw (mgr.24569) 8757 : cluster [DBG] pgmap v7543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:19.010525+0000 mgr.smithi067.rdualw (mgr.24569) 8757 : cluster [DBG] pgmap v7543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:21.011291+0000 mgr.smithi067.rdualw (mgr.24569) 8758 : cluster [DBG] pgmap v7544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:21.011291+0000 mgr.smithi067.rdualw (mgr.24569) 8758 : cluster [DBG] pgmap v7544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:24.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:23.011981+0000 mgr.smithi067.rdualw (mgr.24569) 8759 : cluster [DBG] pgmap v7545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:23.011981+0000 mgr.smithi067.rdualw (mgr.24569) 8759 : cluster [DBG] pgmap v7545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:25.490 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:40:25.784 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:40:25.785 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 4m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:40:25.785 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 4m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:40:25.785 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 4m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:40:25.785 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 4m ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:40:25.786 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 4m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:40:25.786 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 4m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:40:25.786 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 4m ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:40:25.786 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 4m ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:40:25.787 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 4m ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:40:25.787 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 4m ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:40:25.787 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 4m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:40:25.787 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 4m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:40:25.787 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 4m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:40:25.788 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 4m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:40:25.788 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 4m ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:40:25.788 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 4m ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:40:25.788 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 4m ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:40:25.789 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 4m ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:40:25.789 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 4m ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:40:25.789 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 4m ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:40:25.789 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 4m ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:40:25.789 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 4m ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:40:25.790 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 4m ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:40:26.125 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:40:26.125 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:40:26.125 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:40:26.126 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:40:26.126 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:40:26.126 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:40:26.127 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:40:26.127 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:40:26.127 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:40:26.127 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:40:26.128 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:40:26.128 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:40:26.128 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:40:26.128 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:40:26.128 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:40:26.129 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:40:26.129 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:40:26.129 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:40:26.129 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:40:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:25.012689+0000 mgr.smithi067.rdualw (mgr.24569) 8760 : cluster [DBG] pgmap v7546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:27.156 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:40:25.476910+0000 mgr.smithi067.rdualw (mgr.24569) 8761 : audit [DBG] from='client.39982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:40:27.156 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:40:26.123931+0000 mon.smithi061 (mon.0) 1884 : audit [DBG] from='client.? 172.21.15.61:0/54253140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:40:27.157 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:25.012689+0000 mgr.smithi067.rdualw (mgr.24569) 8760 : cluster [DBG] pgmap v7546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:27.157 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:40:25.476910+0000 mgr.smithi067.rdualw (mgr.24569) 8761 : audit [DBG] from='client.39982 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:40:27.158 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:40:26.123931+0000 mon.smithi061 (mon.0) 1884 : audit [DBG] from='client.? 172.21.15.61:0/54253140' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:40:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:40:25.767601+0000 mgr.smithi067.rdualw (mgr.24569) 8762 : audit [DBG] from='client.39986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:40:28.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:27.013585+0000 mgr.smithi067.rdualw (mgr.24569) 8763 : cluster [DBG] pgmap v7547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:40:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:40:25.767601+0000 mgr.smithi067.rdualw (mgr.24569) 8762 : audit [DBG] from='client.39986 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:40:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:27.013585+0000 mgr.smithi067.rdualw (mgr.24569) 8763 : cluster [DBG] pgmap v7547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:40:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:29.014105+0000 mgr.smithi067.rdualw (mgr.24569) 8764 : cluster [DBG] pgmap v7548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:29.014105+0000 mgr.smithi067.rdualw (mgr.24569) 8764 : cluster [DBG] pgmap v7548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:31.015186+0000 mgr.smithi067.rdualw (mgr.24569) 8765 : cluster [DBG] pgmap v7549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:31.015186+0000 mgr.smithi067.rdualw (mgr.24569) 8765 : cluster [DBG] pgmap v7549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:34.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:33.015726+0000 mgr.smithi067.rdualw (mgr.24569) 8766 : cluster [DBG] pgmap v7550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:33.015726+0000 mgr.smithi067.rdualw (mgr.24569) 8766 : cluster [DBG] pgmap v7550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:35.016304+0000 mgr.smithi067.rdualw (mgr.24569) 8767 : cluster [DBG] pgmap v7551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:40:35.826412+0000 mon.smithi067 (mon.1) 1334 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:40:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:40:35.826568+0000 mon.smithi061 (mon.0) 1885 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:40:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:40:35.826692+0000 mon.smithi067 (mon.1) 1335 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:40:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:40:35.826845+0000 mon.smithi061 (mon.0) 1886 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:40:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:35.016304+0000 mgr.smithi067.rdualw (mgr.24569) 8767 : cluster [DBG] pgmap v7551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:40:35.826412+0000 mon.smithi067 (mon.1) 1334 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:40:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:40:35.826568+0000 mon.smithi061 (mon.0) 1885 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:40:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:40:35.826692+0000 mon.smithi067 (mon.1) 1335 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:40:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:40:35.826845+0000 mon.smithi061 (mon.0) 1886 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:40:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:37.017240+0000 mgr.smithi067.rdualw (mgr.24569) 8768 : cluster [DBG] pgmap v7552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:40:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:37.017240+0000 mgr.smithi067.rdualw (mgr.24569) 8768 : cluster [DBG] pgmap v7552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:40:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:39.017814+0000 mgr.smithi067.rdualw (mgr.24569) 8769 : cluster [DBG] pgmap v7553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:39.017814+0000 mgr.smithi067.rdualw (mgr.24569) 8769 : cluster [DBG] pgmap v7553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:41.018631+0000 mgr.smithi067.rdualw (mgr.24569) 8770 : cluster [DBG] pgmap v7554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:41.018631+0000 mgr.smithi067.rdualw (mgr.24569) 8770 : cluster [DBG] pgmap v7554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:44.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:43.019109+0000 mgr.smithi067.rdualw (mgr.24569) 8771 : cluster [DBG] pgmap v7555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:43.019109+0000 mgr.smithi067.rdualw (mgr.24569) 8771 : cluster [DBG] pgmap v7555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:45.019732+0000 mgr.smithi067.rdualw (mgr.24569) 8772 : cluster [DBG] pgmap v7556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:40:45.742269+0000 mon.smithi067 (mon.1) 1336 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:40:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:40:45.743766+0000 mon.smithi067 (mon.1) 1337 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:40:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:40:45.744820+0000 mon.smithi067 (mon.1) 1338 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:40:47.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:40:46.163356+0000 mon.smithi061 (mon.0) 1887 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:40:47.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:40:46.171206+0000 mon.smithi061 (mon.0) 1888 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:40:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:45.019732+0000 mgr.smithi067.rdualw (mgr.24569) 8772 : cluster [DBG] pgmap v7556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:40:45.742269+0000 mon.smithi067 (mon.1) 1336 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:40:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:40:45.743766+0000 mon.smithi067 (mon.1) 1337 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:40:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:40:45.744820+0000 mon.smithi067 (mon.1) 1338 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:40:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:40:46.163356+0000 mon.smithi061 (mon.0) 1887 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:40:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:40:46.171206+0000 mon.smithi061 (mon.0) 1888 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:40:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:40:45.745703+0000 mgr.smithi067.rdualw (mgr.24569) 8773 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:40:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:40:45.745703+0000 mgr.smithi067.rdualw (mgr.24569) 8773 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:40:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:47.020755+0000 mgr.smithi067.rdualw (mgr.24569) 8774 : cluster [DBG] pgmap v7557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:40:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:47.020755+0000 mgr.smithi067.rdualw (mgr.24569) 8774 : cluster [DBG] pgmap v7557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:40:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:49.021394+0000 mgr.smithi067.rdualw (mgr.24569) 8775 : cluster [DBG] pgmap v7558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:49.021394+0000 mgr.smithi067.rdualw (mgr.24569) 8775 : cluster [DBG] pgmap v7558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:51.022177+0000 mgr.smithi067.rdualw (mgr.24569) 8776 : cluster [DBG] pgmap v7559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:51.022177+0000 mgr.smithi067.rdualw (mgr.24569) 8776 : cluster [DBG] pgmap v7559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:54.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:53.022883+0000 mgr.smithi067.rdualw (mgr.24569) 8777 : cluster [DBG] pgmap v7560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:53.022883+0000 mgr.smithi067.rdualw (mgr.24569) 8777 : cluster [DBG] pgmap v7560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:56.434 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:40:56.725 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:40:56.725 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 5m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:40:56.726 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 5m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:40:56.726 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 5m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:40:56.726 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 5m ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:40:56.726 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 5m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:40:56.727 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 5m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:40:56.727 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 5m ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:40:56.727 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 5m ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:40:56.727 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 5m ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:40:56.727 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 5m ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:40:56.728 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 5m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:40:56.728 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 5m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:40:56.728 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 5m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:40:56.728 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 5m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:40:56.729 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 5m ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:40:56.729 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 5m ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:40:56.729 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 5m ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:40:56.730 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 5m ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:40:56.730 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 5m ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:40:56.730 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 5m ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:40:56.730 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 5m ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:40:56.731 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 5m ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:40:56.731 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 5m ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:40:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:55.023714+0000 mgr.smithi067.rdualw (mgr.24569) 8778 : cluster [DBG] pgmap v7561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:57.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:55.023714+0000 mgr.smithi067.rdualw (mgr.24569) 8778 : cluster [DBG] pgmap v7561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:40:57.069 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:40:57.069 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:40:57.070 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:40:57.070 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:40:57.070 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:40:57.070 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:40:57.071 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:40:57.071 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:40:57.071 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:40:57.071 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:40:57.072 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:40:57.072 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:40:57.072 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:40:57.072 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:40:57.073 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:40:57.073 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:40:57.073 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:40:57.073 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:40:57.073 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:40:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:40:56.420686+0000 mgr.smithi067.rdualw (mgr.24569) 8779 : audit [DBG] from='client.39994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:40:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:40:56.708026+0000 mgr.smithi067.rdualw (mgr.24569) 8780 : audit [DBG] from='client.39998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:40:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:57.024801+0000 mgr.smithi067.rdualw (mgr.24569) 8781 : cluster [DBG] pgmap v7562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:40:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:40:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:40:57.068594+0000 mon.smithi061 (mon.0) 1889 : audit [DBG] from='client.? 172.21.15.61:0/122101783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:40:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:40:56.420686+0000 mgr.smithi067.rdualw (mgr.24569) 8779 : audit [DBG] from='client.39994 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:40:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:40:56.708026+0000 mgr.smithi067.rdualw (mgr.24569) 8780 : audit [DBG] from='client.39998 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:40:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:57.024801+0000 mgr.smithi067.rdualw (mgr.24569) 8781 : cluster [DBG] pgmap v7562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:40:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:40:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:40:57.068594+0000 mon.smithi061 (mon.0) 1889 : audit [DBG] from='client.? 172.21.15.61:0/122101783' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:41:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:40:59.025487+0000 mgr.smithi067.rdualw (mgr.24569) 8782 : cluster [DBG] pgmap v7563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:40:59.025487+0000 mgr.smithi067.rdualw (mgr.24569) 8782 : cluster [DBG] pgmap v7563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:01.026439+0000 mgr.smithi067.rdualw (mgr.24569) 8783 : cluster [DBG] pgmap v7564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:01.026439+0000 mgr.smithi067.rdualw (mgr.24569) 8783 : cluster [DBG] pgmap v7564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:03.026947+0000 mgr.smithi067.rdualw (mgr.24569) 8784 : cluster [DBG] pgmap v7565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:03.026947+0000 mgr.smithi067.rdualw (mgr.24569) 8784 : cluster [DBG] pgmap v7565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:05.027594+0000 mgr.smithi067.rdualw (mgr.24569) 8785 : cluster [DBG] pgmap v7566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:05.027594+0000 mgr.smithi067.rdualw (mgr.24569) 8785 : cluster [DBG] pgmap v7566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:07.028471+0000 mgr.smithi067.rdualw (mgr.24569) 8786 : cluster [DBG] pgmap v7567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:41:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:07.028471+0000 mgr.smithi067.rdualw (mgr.24569) 8786 : cluster [DBG] pgmap v7567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:41:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:09.029146+0000 mgr.smithi067.rdualw (mgr.24569) 8787 : cluster [DBG] pgmap v7568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:09.029146+0000 mgr.smithi067.rdualw (mgr.24569) 8787 : cluster [DBG] pgmap v7568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:11.030090+0000 mgr.smithi067.rdualw (mgr.24569) 8788 : cluster [DBG] pgmap v7569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:11.030090+0000 mgr.smithi067.rdualw (mgr.24569) 8788 : cluster [DBG] pgmap v7569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:13.030762+0000 mgr.smithi067.rdualw (mgr.24569) 8789 : cluster [DBG] pgmap v7570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:13.030762+0000 mgr.smithi067.rdualw (mgr.24569) 8789 : cluster [DBG] pgmap v7570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:15.031600+0000 mgr.smithi067.rdualw (mgr.24569) 8790 : cluster [DBG] pgmap v7571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:15.031600+0000 mgr.smithi067.rdualw (mgr.24569) 8790 : cluster [DBG] pgmap v7571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:17.032441+0000 mgr.smithi067.rdualw (mgr.24569) 8791 : cluster [DBG] pgmap v7572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:41:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:17.032441+0000 mgr.smithi067.rdualw (mgr.24569) 8791 : cluster [DBG] pgmap v7572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:41:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:19.033192+0000 mgr.smithi067.rdualw (mgr.24569) 8792 : cluster [DBG] pgmap v7573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:19.033192+0000 mgr.smithi067.rdualw (mgr.24569) 8792 : cluster [DBG] pgmap v7573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:21.034095+0000 mgr.smithi067.rdualw (mgr.24569) 8793 : cluster [DBG] pgmap v7574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:21.034095+0000 mgr.smithi067.rdualw (mgr.24569) 8793 : cluster [DBG] pgmap v7574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:23.034658+0000 mgr.smithi067.rdualw (mgr.24569) 8794 : cluster [DBG] pgmap v7575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:23.034658+0000 mgr.smithi067.rdualw (mgr.24569) 8794 : cluster [DBG] pgmap v7575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:25.035291+0000 mgr.smithi067.rdualw (mgr.24569) 8795 : cluster [DBG] pgmap v7576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:25.035291+0000 mgr.smithi067.rdualw (mgr.24569) 8795 : cluster [DBG] pgmap v7576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:27.402 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:41:27.776 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:41:27.776 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 5m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:41:27.777 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 5m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:41:27.777 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 5m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:41:27.777 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 5m ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:41:27.777 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 5m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:41:27.778 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 5m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:41:27.778 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 5m ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:41:27.778 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 5m ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:41:27.778 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 5m ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:41:27.778 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 5m ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:41:27.779 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 5m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:41:27.779 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 5m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:41:27.779 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 5m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:41:27.779 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 5m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:41:27.780 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 5m ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:41:27.780 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 5m ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:41:27.780 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 5m ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:41:27.780 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 5m ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:41:27.780 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 5m ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:41:27.781 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 5m ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:41:27.781 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 5m ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:41:27.781 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 5m ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:41:27.781 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 5m ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:41:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:27.036100+0000 mgr.smithi067.rdualw (mgr.24569) 8796 : cluster [DBG] pgmap v7577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:41:28.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:41:27.389386+0000 mgr.smithi067.rdualw (mgr.24569) 8797 : audit [DBG] from='client.40006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:41:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:27.036100+0000 mgr.smithi067.rdualw (mgr.24569) 8796 : cluster [DBG] pgmap v7577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:41:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:41:27.389386+0000 mgr.smithi067.rdualw (mgr.24569) 8797 : audit [DBG] from='client.40006 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:41:28.119 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:41:28.120 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:41:28.120 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:41:28.120 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:41:28.121 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:41:28.121 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:41:28.122 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:41:28.122 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:41:28.122 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:41:28.122 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:41:28.123 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:41:28.123 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:41:28.123 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:41:28.124 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:41:28.124 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:41:28.124 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:41:28.125 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:41:28.125 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:41:28.125 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:41:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:41:27.759146+0000 mgr.smithi067.rdualw (mgr.24569) 8798 : audit [DBG] from='client.40010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:41:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:41:28.118373+0000 mon.smithi061 (mon.0) 1890 : audit [DBG] from='client.? 172.21.15.61:0/3622013811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:41:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:41:27.759146+0000 mgr.smithi067.rdualw (mgr.24569) 8798 : audit [DBG] from='client.40010 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:41:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:41:28.118373+0000 mon.smithi061 (mon.0) 1890 : audit [DBG] from='client.? 172.21.15.61:0/3622013811' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:41:30.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:29.036836+0000 mgr.smithi067.rdualw (mgr.24569) 8799 : cluster [DBG] pgmap v7578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:29.036836+0000 mgr.smithi067.rdualw (mgr.24569) 8799 : cluster [DBG] pgmap v7578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:31.037601+0000 mgr.smithi067.rdualw (mgr.24569) 8800 : cluster [DBG] pgmap v7579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:31.037601+0000 mgr.smithi067.rdualw (mgr.24569) 8800 : cluster [DBG] pgmap v7579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:33.038202+0000 mgr.smithi067.rdualw (mgr.24569) 8801 : cluster [DBG] pgmap v7580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:33.038202+0000 mgr.smithi067.rdualw (mgr.24569) 8801 : cluster [DBG] pgmap v7580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:35.038811+0000 mgr.smithi067.rdualw (mgr.24569) 8802 : cluster [DBG] pgmap v7581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:41:35.832474+0000 mon.smithi067 (mon.1) 1339 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:41:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:41:35.832726+0000 mon.smithi067 (mon.1) 1340 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:41:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:41:35.832770+0000 mon.smithi061 (mon.0) 1891 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:41:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:41:35.833358+0000 mon.smithi061 (mon.0) 1892 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:41:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:35.038811+0000 mgr.smithi067.rdualw (mgr.24569) 8802 : cluster [DBG] pgmap v7581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:41:35.832474+0000 mon.smithi067 (mon.1) 1339 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:41:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:41:35.832726+0000 mon.smithi067 (mon.1) 1340 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:41:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:41:35.832770+0000 mon.smithi061 (mon.0) 1891 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:41:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:41:35.833358+0000 mon.smithi061 (mon.0) 1892 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:41:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:37.039623+0000 mgr.smithi067.rdualw (mgr.24569) 8803 : cluster [DBG] pgmap v7582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:41:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:37.039623+0000 mgr.smithi067.rdualw (mgr.24569) 8803 : cluster [DBG] pgmap v7582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:41:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:39.040364+0000 mgr.smithi067.rdualw (mgr.24569) 8804 : cluster [DBG] pgmap v7583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:39.040364+0000 mgr.smithi067.rdualw (mgr.24569) 8804 : cluster [DBG] pgmap v7583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:41.041188+0000 mgr.smithi067.rdualw (mgr.24569) 8805 : cluster [DBG] pgmap v7584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:41.041188+0000 mgr.smithi067.rdualw (mgr.24569) 8805 : cluster [DBG] pgmap v7584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:43.041716+0000 mgr.smithi067.rdualw (mgr.24569) 8806 : cluster [DBG] pgmap v7585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:43.041716+0000 mgr.smithi067.rdualw (mgr.24569) 8806 : cluster [DBG] pgmap v7585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:45.042433+0000 mgr.smithi067.rdualw (mgr.24569) 8807 : cluster [DBG] pgmap v7586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:41:46.175010+0000 mon.smithi067 (mon.1) 1341 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:41:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:41:46.176356+0000 mon.smithi067 (mon.1) 1342 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:41:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:41:46.177277+0000 mon.smithi067 (mon.1) 1343 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:41:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:45.042433+0000 mgr.smithi067.rdualw (mgr.24569) 8807 : cluster [DBG] pgmap v7586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:41:46.175010+0000 mon.smithi067 (mon.1) 1341 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:41:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:41:46.176356+0000 mon.smithi067 (mon.1) 1342 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:41:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:41:46.177277+0000 mon.smithi067 (mon.1) 1343 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:41:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:41:46.178109+0000 mgr.smithi067.rdualw (mgr.24569) 8808 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:41:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:41:46.598099+0000 mon.smithi061 (mon.0) 1893 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:41:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:41:46.603806+0000 mon.smithi061 (mon.0) 1894 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:41:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:47.043405+0000 mgr.smithi067.rdualw (mgr.24569) 8809 : cluster [DBG] pgmap v7587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:41:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:41:46.178109+0000 mgr.smithi067.rdualw (mgr.24569) 8808 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:41:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:41:46.598099+0000 mon.smithi061 (mon.0) 1893 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:41:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:41:46.603806+0000 mon.smithi061 (mon.0) 1894 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:41:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:47.043405+0000 mgr.smithi067.rdualw (mgr.24569) 8809 : cluster [DBG] pgmap v7587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:41:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:49.043968+0000 mgr.smithi067.rdualw (mgr.24569) 8810 : cluster [DBG] pgmap v7588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:49.043968+0000 mgr.smithi067.rdualw (mgr.24569) 8810 : cluster [DBG] pgmap v7588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:51.044993+0000 mgr.smithi067.rdualw (mgr.24569) 8811 : cluster [DBG] pgmap v7589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:51.044993+0000 mgr.smithi067.rdualw (mgr.24569) 8811 : cluster [DBG] pgmap v7589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:53.045584+0000 mgr.smithi067.rdualw (mgr.24569) 8812 : cluster [DBG] pgmap v7590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:53.045584+0000 mgr.smithi067.rdualw (mgr.24569) 8812 : cluster [DBG] pgmap v7590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:55.046363+0000 mgr.smithi067.rdualw (mgr.24569) 8813 : cluster [DBG] pgmap v7591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:57.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:55.046363+0000 mgr.smithi067.rdualw (mgr.24569) 8813 : cluster [DBG] pgmap v7591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:41:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:57.047429+0000 mgr.smithi067.rdualw (mgr.24569) 8814 : cluster [DBG] pgmap v7592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:41:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:57.047429+0000 mgr.smithi067.rdualw (mgr.24569) 8814 : cluster [DBG] pgmap v7592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:41:58.429 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:41:58.720 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:41:58.720 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 6m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:41:58.720 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 6m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:41:58.721 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 6m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:41:58.721 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 6m ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:41:58.721 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 6m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:41:58.721 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 6m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:41:58.722 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 6m ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:41:58.722 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 6m ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:41:58.722 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 6m ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:41:58.722 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 6m ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:41:58.722 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 6m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:41:58.723 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 6m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:41:58.723 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 6m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:41:58.723 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 6m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:41:58.723 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 6m ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:41:58.724 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 6m ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:41:58.724 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 6m ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:41:58.724 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 6m ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:41:58.724 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 6m ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:41:58.724 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 6m ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:41:58.725 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 6m ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:41:58.725 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 6m ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:41:58.725 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 6m ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:41:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:41:58.416015+0000 mgr.smithi067.rdualw (mgr.24569) 8815 : audit [DBG] from='client.40018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:41:59.062 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:41:59.062 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:41:59.062 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:41:59.063 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:41:59.063 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:41:59.063 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:41:59.063 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:41:59.063 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:41:59.064 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:41:59.064 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:41:59.064 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:41:59.064 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:41:59.065 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:41:59.065 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:41:59.065 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:41:59.065 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:41:59.065 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:41:59.066 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:41:59.066 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:41:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:41:58.416015+0000 mgr.smithi067.rdualw (mgr.24569) 8815 : audit [DBG] from='client.40018 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:42:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:41:58.702753+0000 mgr.smithi067.rdualw (mgr.24569) 8816 : audit [DBG] from='client.40022 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:42:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:41:59.048191+0000 mgr.smithi067.rdualw (mgr.24569) 8817 : cluster [DBG] pgmap v7593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:41:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:41:59.061079+0000 mon.smithi061 (mon.0) 1895 : audit [DBG] from='client.? 172.21.15.61:0/1224270231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:42:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:41:58.702753+0000 mgr.smithi067.rdualw (mgr.24569) 8816 : audit [DBG] from='client.40022 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:42:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:41:59.048191+0000 mgr.smithi067.rdualw (mgr.24569) 8817 : cluster [DBG] pgmap v7593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:41:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:41:59.061079+0000 mon.smithi061 (mon.0) 1895 : audit [DBG] from='client.? 172.21.15.61:0/1224270231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:42:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:01.049140+0000 mgr.smithi067.rdualw (mgr.24569) 8818 : cluster [DBG] pgmap v7594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:01.049140+0000 mgr.smithi067.rdualw (mgr.24569) 8818 : cluster [DBG] pgmap v7594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:03.049722+0000 mgr.smithi067.rdualw (mgr.24569) 8819 : cluster [DBG] pgmap v7595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:03.049722+0000 mgr.smithi067.rdualw (mgr.24569) 8819 : cluster [DBG] pgmap v7595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:07.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:05.050343+0000 mgr.smithi067.rdualw (mgr.24569) 8820 : cluster [DBG] pgmap v7596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:05.050343+0000 mgr.smithi067.rdualw (mgr.24569) 8820 : cluster [DBG] pgmap v7596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:07.051197+0000 mgr.smithi067.rdualw (mgr.24569) 8821 : cluster [DBG] pgmap v7597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:42:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:07.051197+0000 mgr.smithi067.rdualw (mgr.24569) 8821 : cluster [DBG] pgmap v7597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:42:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:09.051963+0000 mgr.smithi067.rdualw (mgr.24569) 8822 : cluster [DBG] pgmap v7598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:09.051963+0000 mgr.smithi067.rdualw (mgr.24569) 8822 : cluster [DBG] pgmap v7598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:11.052791+0000 mgr.smithi067.rdualw (mgr.24569) 8823 : cluster [DBG] pgmap v7599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:11.052791+0000 mgr.smithi067.rdualw (mgr.24569) 8823 : cluster [DBG] pgmap v7599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:15.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:13.053399+0000 mgr.smithi067.rdualw (mgr.24569) 8824 : cluster [DBG] pgmap v7600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:13.053399+0000 mgr.smithi067.rdualw (mgr.24569) 8824 : cluster [DBG] pgmap v7600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:15.054132+0000 mgr.smithi067.rdualw (mgr.24569) 8825 : cluster [DBG] pgmap v7601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:15.054132+0000 mgr.smithi067.rdualw (mgr.24569) 8825 : cluster [DBG] pgmap v7601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:17.054999+0000 mgr.smithi067.rdualw (mgr.24569) 8826 : cluster [DBG] pgmap v7602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:42:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:17.054999+0000 mgr.smithi067.rdualw (mgr.24569) 8826 : cluster [DBG] pgmap v7602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:42:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:19.055584+0000 mgr.smithi067.rdualw (mgr.24569) 8827 : cluster [DBG] pgmap v7603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:19.055584+0000 mgr.smithi067.rdualw (mgr.24569) 8827 : cluster [DBG] pgmap v7603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:21.056626+0000 mgr.smithi067.rdualw (mgr.24569) 8828 : cluster [DBG] pgmap v7604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:21.056626+0000 mgr.smithi067.rdualw (mgr.24569) 8828 : cluster [DBG] pgmap v7604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:24.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:23.057156+0000 mgr.smithi067.rdualw (mgr.24569) 8829 : cluster [DBG] pgmap v7605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:23.057156+0000 mgr.smithi067.rdualw (mgr.24569) 8829 : cluster [DBG] pgmap v7605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:25.057995+0000 mgr.smithi067.rdualw (mgr.24569) 8830 : cluster [DBG] pgmap v7606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:25.057995+0000 mgr.smithi067.rdualw (mgr.24569) 8830 : cluster [DBG] pgmap v7606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:27.058823+0000 mgr.smithi067.rdualw (mgr.24569) 8831 : cluster [DBG] pgmap v7607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:42:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:27.058823+0000 mgr.smithi067.rdualw (mgr.24569) 8831 : cluster [DBG] pgmap v7607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:42:29.368 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:42:29.679 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:42:29.680 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 6m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:42:29.680 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 6m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:42:29.680 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 6m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:42:29.680 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 6m ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:42:29.680 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 6m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:42:29.681 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 6m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:42:29.681 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 6m ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:42:29.681 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 6m ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:42:29.681 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 6m ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:42:29.682 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 6m ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:42:29.682 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 6m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:42:29.682 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 6m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:42:29.682 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 6m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:42:29.682 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 6m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:42:29.683 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 6m ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:42:29.683 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 6m ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:42:29.683 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 6m ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:42:29.683 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 6m ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:42:29.684 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 6m ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:42:29.684 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 6m ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:42:29.684 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 6m ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:42:29.684 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 6m ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:42:29.685 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 6m ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:42:30.022 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:42:30.023 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:42:30.023 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:42:30.023 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:42:30.023 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:42:30.023 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:42:30.024 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:42:30.024 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:42:30.024 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:42:30.024 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:42:30.025 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:42:30.025 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:42:30.025 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:42:30.025 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:42:30.026 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:42:30.026 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:42:30.026 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:42:30.026 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:42:30.026 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:42:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:29.059589+0000 mgr.smithi067.rdualw (mgr.24569) 8832 : cluster [DBG] pgmap v7608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:42:29.355743+0000 mgr.smithi067.rdualw (mgr.24569) 8833 : audit [DBG] from='client.40030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:42:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:42:30.021436+0000 mon.smithi061 (mon.0) 1896 : audit [DBG] from='client.? 172.21.15.61:0/4064942878' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:42:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:29.059589+0000 mgr.smithi067.rdualw (mgr.24569) 8832 : cluster [DBG] pgmap v7608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:42:29.355743+0000 mgr.smithi067.rdualw (mgr.24569) 8833 : audit [DBG] from='client.40030 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:42:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:42:30.021436+0000 mon.smithi061 (mon.0) 1896 : audit [DBG] from='client.? 172.21.15.61:0/4064942878' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:42:32.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:42:29.662324+0000 mgr.smithi067.rdualw (mgr.24569) 8834 : audit [DBG] from='client.40034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:42:32.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:42:29.662324+0000 mgr.smithi067.rdualw (mgr.24569) 8834 : audit [DBG] from='client.40034 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:42:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:31.060337+0000 mgr.smithi067.rdualw (mgr.24569) 8835 : cluster [DBG] pgmap v7609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:31.060337+0000 mgr.smithi067.rdualw (mgr.24569) 8835 : cluster [DBG] pgmap v7609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:33.061019+0000 mgr.smithi067.rdualw (mgr.24569) 8836 : cluster [DBG] pgmap v7610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:33.061019+0000 mgr.smithi067.rdualw (mgr.24569) 8836 : cluster [DBG] pgmap v7610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:35.061595+0000 mgr.smithi067.rdualw (mgr.24569) 8837 : cluster [DBG] pgmap v7611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:42:35.838341+0000 mon.smithi067 (mon.1) 1344 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:42:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:42:35.838611+0000 mon.smithi067 (mon.1) 1345 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:42:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:42:35.838623+0000 mon.smithi061 (mon.0) 1897 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:42:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:42:35.839000+0000 mon.smithi061 (mon.0) 1898 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:42:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:35.061595+0000 mgr.smithi067.rdualw (mgr.24569) 8837 : cluster [DBG] pgmap v7611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:42:35.838341+0000 mon.smithi067 (mon.1) 1344 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:42:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:42:35.838611+0000 mon.smithi067 (mon.1) 1345 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:42:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:42:35.838623+0000 mon.smithi061 (mon.0) 1897 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:42:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:42:35.839000+0000 mon.smithi061 (mon.0) 1898 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:42:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:37.062605+0000 mgr.smithi067.rdualw (mgr.24569) 8838 : cluster [DBG] pgmap v7612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:42:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:37.062605+0000 mgr.smithi067.rdualw (mgr.24569) 8838 : cluster [DBG] pgmap v7612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:42:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:39.063350+0000 mgr.smithi067.rdualw (mgr.24569) 8839 : cluster [DBG] pgmap v7613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:39.063350+0000 mgr.smithi067.rdualw (mgr.24569) 8839 : cluster [DBG] pgmap v7613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:41.064176+0000 mgr.smithi067.rdualw (mgr.24569) 8840 : cluster [DBG] pgmap v7614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:41.064176+0000 mgr.smithi067.rdualw (mgr.24569) 8840 : cluster [DBG] pgmap v7614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:43.064741+0000 mgr.smithi067.rdualw (mgr.24569) 8841 : cluster [DBG] pgmap v7615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:43.064741+0000 mgr.smithi067.rdualw (mgr.24569) 8841 : cluster [DBG] pgmap v7615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:45.065293+0000 mgr.smithi067.rdualw (mgr.24569) 8842 : cluster [DBG] pgmap v7616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:45.065293+0000 mgr.smithi067.rdualw (mgr.24569) 8842 : cluster [DBG] pgmap v7616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:42:46.607771+0000 mon.smithi067 (mon.1) 1346 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:42:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:42:46.609253+0000 mon.smithi067 (mon.1) 1347 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:42:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:42:46.610238+0000 mon.smithi067 (mon.1) 1348 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:42:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:42:47.018908+0000 mon.smithi061 (mon.0) 1899 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:42:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:42:47.024286+0000 mon.smithi061 (mon.0) 1900 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:42:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:42:46.607771+0000 mon.smithi067 (mon.1) 1346 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:42:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:42:46.609253+0000 mon.smithi067 (mon.1) 1347 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:42:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:42:46.610238+0000 mon.smithi067 (mon.1) 1348 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:42:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:42:47.018908+0000 mon.smithi061 (mon.0) 1899 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:42:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:42:47.024286+0000 mon.smithi061 (mon.0) 1900 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:42:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:42:46.611127+0000 mgr.smithi067.rdualw (mgr.24569) 8843 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:42:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:47.066059+0000 mgr.smithi067.rdualw (mgr.24569) 8844 : cluster [DBG] pgmap v7617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:42:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:42:46.611127+0000 mgr.smithi067.rdualw (mgr.24569) 8843 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:42:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:47.066059+0000 mgr.smithi067.rdualw (mgr.24569) 8844 : cluster [DBG] pgmap v7617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:42:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:49.066687+0000 mgr.smithi067.rdualw (mgr.24569) 8845 : cluster [DBG] pgmap v7618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:49.066687+0000 mgr.smithi067.rdualw (mgr.24569) 8845 : cluster [DBG] pgmap v7618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:51.067747+0000 mgr.smithi067.rdualw (mgr.24569) 8846 : cluster [DBG] pgmap v7619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:51.067747+0000 mgr.smithi067.rdualw (mgr.24569) 8846 : cluster [DBG] pgmap v7619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:53.068262+0000 mgr.smithi067.rdualw (mgr.24569) 8847 : cluster [DBG] pgmap v7620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:53.068262+0000 mgr.smithi067.rdualw (mgr.24569) 8847 : cluster [DBG] pgmap v7620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:55.068866+0000 mgr.smithi067.rdualw (mgr.24569) 8848 : cluster [DBG] pgmap v7621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:55.068866+0000 mgr.smithi067.rdualw (mgr.24569) 8848 : cluster [DBG] pgmap v7621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:42:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:42:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:57.069658+0000 mgr.smithi067.rdualw (mgr.24569) 8849 : cluster [DBG] pgmap v7622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:42:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:42:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:57.069658+0000 mgr.smithi067.rdualw (mgr.24569) 8849 : cluster [DBG] pgmap v7622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:43:00.333 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:43:00.626 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:43:00.627 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 7m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:43:00.627 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 7m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:43:00.627 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 7m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:43:00.627 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 7m ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:43:00.627 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 7m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:43:00.628 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 7m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:43:00.628 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 7m ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:43:00.628 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 7m ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:43:00.628 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 7m ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:43:00.629 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 7m ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:43:00.629 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 7m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:43:00.629 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 7m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:43:00.629 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 7m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:43:00.629 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 7m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:43:00.630 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 7m ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:43:00.630 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 7m ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:43:00.630 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 7m ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:43:00.630 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 7m ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:43:00.630 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 7m ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:43:00.631 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 7m ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:43:00.631 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 7m ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:43:00.631 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 7m ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:43:00.631 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 7m ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:43:00.970 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:43:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:43:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:43:00.971 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:43:00.972 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:43:00.972 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:43:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:43:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:43:00.973 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:43:00.974 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:43:00.975 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:43:00.975 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:43:00.975 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:43:00.976 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:43:00.976 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:43:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:43:00.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:43:00.978 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:43:00.978 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:43:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:42:59.070262+0000 mgr.smithi067.rdualw (mgr.24569) 8850 : cluster [DBG] pgmap v7623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:42:59.070262+0000 mgr.smithi067.rdualw (mgr.24569) 8850 : cluster [DBG] pgmap v7623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:43:00.320461+0000 mgr.smithi067.rdualw (mgr.24569) 8851 : audit [DBG] from='client.40042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:43:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:43:00.969071+0000 mon.smithi061 (mon.0) 1901 : audit [DBG] from='client.? 172.21.15.61:0/1482892627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:43:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:43:00.320461+0000 mgr.smithi067.rdualw (mgr.24569) 8851 : audit [DBG] from='client.40042 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:43:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:43:00.969071+0000 mon.smithi061 (mon.0) 1901 : audit [DBG] from='client.? 172.21.15.61:0/1482892627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:43:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:43:00.608708+0000 mgr.smithi067.rdualw (mgr.24569) 8852 : audit [DBG] from='client.40046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:43:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:01.071073+0000 mgr.smithi067.rdualw (mgr.24569) 8853 : cluster [DBG] pgmap v7624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:43:00.608708+0000 mgr.smithi067.rdualw (mgr.24569) 8852 : audit [DBG] from='client.40046 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:43:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:01.071073+0000 mgr.smithi067.rdualw (mgr.24569) 8853 : cluster [DBG] pgmap v7624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:03.071784+0000 mgr.smithi067.rdualw (mgr.24569) 8854 : cluster [DBG] pgmap v7625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:03.071784+0000 mgr.smithi067.rdualw (mgr.24569) 8854 : cluster [DBG] pgmap v7625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:05.072408+0000 mgr.smithi067.rdualw (mgr.24569) 8855 : cluster [DBG] pgmap v7626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:05.072408+0000 mgr.smithi067.rdualw (mgr.24569) 8855 : cluster [DBG] pgmap v7626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:07.073243+0000 mgr.smithi067.rdualw (mgr.24569) 8856 : cluster [DBG] pgmap v7627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:43:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:07.073243+0000 mgr.smithi067.rdualw (mgr.24569) 8856 : cluster [DBG] pgmap v7627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:43:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:09.073886+0000 mgr.smithi067.rdualw (mgr.24569) 8857 : cluster [DBG] pgmap v7628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:09.073886+0000 mgr.smithi067.rdualw (mgr.24569) 8857 : cluster [DBG] pgmap v7628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:11.074710+0000 mgr.smithi067.rdualw (mgr.24569) 8858 : cluster [DBG] pgmap v7629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:11.074710+0000 mgr.smithi067.rdualw (mgr.24569) 8858 : cluster [DBG] pgmap v7629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:13.075395+0000 mgr.smithi067.rdualw (mgr.24569) 8859 : cluster [DBG] pgmap v7630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:13.075395+0000 mgr.smithi067.rdualw (mgr.24569) 8859 : cluster [DBG] pgmap v7630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:15.076156+0000 mgr.smithi067.rdualw (mgr.24569) 8860 : cluster [DBG] pgmap v7631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:15.076156+0000 mgr.smithi067.rdualw (mgr.24569) 8860 : cluster [DBG] pgmap v7631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:17.077049+0000 mgr.smithi067.rdualw (mgr.24569) 8861 : cluster [DBG] pgmap v7632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:43:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:17.077049+0000 mgr.smithi067.rdualw (mgr.24569) 8861 : cluster [DBG] pgmap v7632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:43:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:19.077716+0000 mgr.smithi067.rdualw (mgr.24569) 8862 : cluster [DBG] pgmap v7633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:19.077716+0000 mgr.smithi067.rdualw (mgr.24569) 8862 : cluster [DBG] pgmap v7633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:21.078518+0000 mgr.smithi067.rdualw (mgr.24569) 8863 : cluster [DBG] pgmap v7634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:21.078518+0000 mgr.smithi067.rdualw (mgr.24569) 8863 : cluster [DBG] pgmap v7634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:23.079139+0000 mgr.smithi067.rdualw (mgr.24569) 8864 : cluster [DBG] pgmap v7635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:23.079139+0000 mgr.smithi067.rdualw (mgr.24569) 8864 : cluster [DBG] pgmap v7635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:25.079804+0000 mgr.smithi067.rdualw (mgr.24569) 8865 : cluster [DBG] pgmap v7636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:25.079804+0000 mgr.smithi067.rdualw (mgr.24569) 8865 : cluster [DBG] pgmap v7636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:27.080584+0000 mgr.smithi067.rdualw (mgr.24569) 8866 : cluster [DBG] pgmap v7637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:43:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:27.080584+0000 mgr.smithi067.rdualw (mgr.24569) 8866 : cluster [DBG] pgmap v7637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:43:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:29.081268+0000 mgr.smithi067.rdualw (mgr.24569) 8867 : cluster [DBG] pgmap v7638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:29.081268+0000 mgr.smithi067.rdualw (mgr.24569) 8867 : cluster [DBG] pgmap v7638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:31.312 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:43:31.607 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:43:31.608 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 7m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:43:31.608 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 7m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:43:31.608 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 7m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:43:31.608 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 7m ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:43:31.608 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 7m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:43:31.609 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 7m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:43:31.609 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 7m ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:43:31.609 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 7m ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:43:31.609 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 7m ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:43:31.610 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 7m ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:43:31.610 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 7m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:43:31.610 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 7m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:43:31.610 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 7m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:43:31.610 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 7m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:43:31.611 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 7m ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:43:31.611 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 7m ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:43:31.611 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 7m ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:43:31.611 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 7m ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:43:31.612 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 7m ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:43:31.612 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 7m ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:43:31.612 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 7m ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:43:31.612 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 7m ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:43:31.612 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 7m ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:43:31.949 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:43:31.950 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:43:31.950 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:43:31.950 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:43:31.951 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:43:31.951 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:43:31.951 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:43:31.951 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:43:31.952 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:43:31.952 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:43:31.952 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:43:31.952 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:43:31.952 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:43:31.953 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:43:31.953 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:43:31.953 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:43:31.953 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:43:31.953 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:43:31.954 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:43:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:31.082262+0000 mgr.smithi067.rdualw (mgr.24569) 8868 : cluster [DBG] pgmap v7639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:43:31.297100+0000 mgr.smithi067.rdualw (mgr.24569) 8869 : audit [DBG] from='client.40054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:43:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:43:31.588732+0000 mgr.smithi067.rdualw (mgr.24569) 8870 : audit [DBG] from='client.40058 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:43:33.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:43:31.948568+0000 mon.smithi061 (mon.0) 1902 : audit [DBG] from='client.? 172.21.15.61:0/4148835961' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:43:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:31.082262+0000 mgr.smithi067.rdualw (mgr.24569) 8868 : cluster [DBG] pgmap v7639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:43:31.297100+0000 mgr.smithi067.rdualw (mgr.24569) 8869 : audit [DBG] from='client.40054 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:43:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:43:31.588732+0000 mgr.smithi067.rdualw (mgr.24569) 8870 : audit [DBG] from='client.40058 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:43:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:43:31.948568+0000 mon.smithi061 (mon.0) 1902 : audit [DBG] from='client.? 172.21.15.61:0/4148835961' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:43:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:33.082832+0000 mgr.smithi067.rdualw (mgr.24569) 8871 : cluster [DBG] pgmap v7640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:33.082832+0000 mgr.smithi067.rdualw (mgr.24569) 8871 : cluster [DBG] pgmap v7640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:35.083581+0000 mgr.smithi067.rdualw (mgr.24569) 8872 : cluster [DBG] pgmap v7641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:35.083581+0000 mgr.smithi067.rdualw (mgr.24569) 8872 : cluster [DBG] pgmap v7641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:43:35.844410+0000 mon.smithi067 (mon.1) 1349 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:43:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:43:35.844684+0000 mon.smithi067 (mon.1) 1350 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:43:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:43:35.844726+0000 mon.smithi061 (mon.0) 1903 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:43:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:43:35.845184+0000 mon.smithi061 (mon.0) 1904 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:43:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:43:35.844410+0000 mon.smithi067 (mon.1) 1349 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:43:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:43:35.844684+0000 mon.smithi067 (mon.1) 1350 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:43:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:43:35.844726+0000 mon.smithi061 (mon.0) 1903 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:43:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:43:35.845184+0000 mon.smithi061 (mon.0) 1904 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:43:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:37.084690+0000 mgr.smithi067.rdualw (mgr.24569) 8873 : cluster [DBG] pgmap v7642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:43:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:37.084690+0000 mgr.smithi067.rdualw (mgr.24569) 8873 : cluster [DBG] pgmap v7642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:43:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:39.085525+0000 mgr.smithi067.rdualw (mgr.24569) 8874 : cluster [DBG] pgmap v7643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:39.085525+0000 mgr.smithi067.rdualw (mgr.24569) 8874 : cluster [DBG] pgmap v7643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:41.086556+0000 mgr.smithi067.rdualw (mgr.24569) 8875 : cluster [DBG] pgmap v7644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:41.086556+0000 mgr.smithi067.rdualw (mgr.24569) 8875 : cluster [DBG] pgmap v7644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:43.087099+0000 mgr.smithi067.rdualw (mgr.24569) 8876 : cluster [DBG] pgmap v7645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:43.087099+0000 mgr.smithi067.rdualw (mgr.24569) 8876 : cluster [DBG] pgmap v7645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:45.087861+0000 mgr.smithi067.rdualw (mgr.24569) 8877 : cluster [DBG] pgmap v7646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:45.087861+0000 mgr.smithi067.rdualw (mgr.24569) 8877 : cluster [DBG] pgmap v7646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:43:47.027879+0000 mon.smithi067 (mon.1) 1351 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:43:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:43:47.029427+0000 mon.smithi067 (mon.1) 1352 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:43:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:43:47.030443+0000 mon.smithi067 (mon.1) 1353 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:43:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:43:47.440168+0000 mon.smithi061 (mon.0) 1905 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:43:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:43:47.446009+0000 mon.smithi061 (mon.0) 1906 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:43:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:43:47.027879+0000 mon.smithi067 (mon.1) 1351 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:43:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:43:47.029427+0000 mon.smithi067 (mon.1) 1352 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:43:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:43:47.030443+0000 mon.smithi067 (mon.1) 1353 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:43:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:43:47.440168+0000 mon.smithi061 (mon.0) 1905 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:43:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:43:47.446009+0000 mon.smithi061 (mon.0) 1906 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:43:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:43:47.031418+0000 mgr.smithi067.rdualw (mgr.24569) 8878 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:43:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:47.088760+0000 mgr.smithi067.rdualw (mgr.24569) 8879 : cluster [DBG] pgmap v7647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:43:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:43:47.031418+0000 mgr.smithi067.rdualw (mgr.24569) 8878 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:43:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:47.088760+0000 mgr.smithi067.rdualw (mgr.24569) 8879 : cluster [DBG] pgmap v7647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:43:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:49.089473+0000 mgr.smithi067.rdualw (mgr.24569) 8880 : cluster [DBG] pgmap v7648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:49.089473+0000 mgr.smithi067.rdualw (mgr.24569) 8880 : cluster [DBG] pgmap v7648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:51.090257+0000 mgr.smithi067.rdualw (mgr.24569) 8881 : cluster [DBG] pgmap v7649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:51.090257+0000 mgr.smithi067.rdualw (mgr.24569) 8881 : cluster [DBG] pgmap v7649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:53.090786+0000 mgr.smithi067.rdualw (mgr.24569) 8882 : cluster [DBG] pgmap v7650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:53.090786+0000 mgr.smithi067.rdualw (mgr.24569) 8882 : cluster [DBG] pgmap v7650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:55.091396+0000 mgr.smithi067.rdualw (mgr.24569) 8883 : cluster [DBG] pgmap v7651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:57.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:55.091396+0000 mgr.smithi067.rdualw (mgr.24569) 8883 : cluster [DBG] pgmap v7651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:43:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:43:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:57.092442+0000 mgr.smithi067.rdualw (mgr.24569) 8884 : cluster [DBG] pgmap v7652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:43:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:43:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:57.092442+0000 mgr.smithi067.rdualw (mgr.24569) 8884 : cluster [DBG] pgmap v7652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:44:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:43:59.093049+0000 mgr.smithi067.rdualw (mgr.24569) 8885 : cluster [DBG] pgmap v7653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:43:59.093049+0000 mgr.smithi067.rdualw (mgr.24569) 8885 : cluster [DBG] pgmap v7653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:02.259 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:44:02.554 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:44:02.554 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 8m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:44:02.555 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 8m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:44:02.555 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 8m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:44:02.555 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 8m ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:44:02.555 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 8m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:44:02.556 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 8m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:44:02.556 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 8m ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:44:02.556 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 8m ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:44:02.556 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 8m ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:44:02.556 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 8m ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:44:02.557 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 8m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:44:02.557 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 8m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:44:02.557 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 8m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:44:02.557 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 8m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:44:02.558 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 8m ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:44:02.558 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 8m ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:44:02.558 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 8m ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:44:02.558 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 8m ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:44:02.558 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 8m ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:44:02.559 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 8m ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:44:02.559 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 8m ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:44:02.559 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 8m ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:44:02.559 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 8m ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:44:02.898 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:44:02.898 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:44:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:44:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:44:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:44:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:44:02.899 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:44:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:44:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:44:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:44:02.900 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:44:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:44:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:44:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:44:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:44:02.901 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:44:02.902 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:44:02.902 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:44:02.902 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:44:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:01.093882+0000 mgr.smithi067.rdualw (mgr.24569) 8886 : cluster [DBG] pgmap v7654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:01.093882+0000 mgr.smithi067.rdualw (mgr.24569) 8886 : cluster [DBG] pgmap v7654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:44:02.246495+0000 mgr.smithi067.rdualw (mgr.24569) 8887 : audit [DBG] from='client.40066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:44:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:44:02.537384+0000 mgr.smithi067.rdualw (mgr.24569) 8888 : audit [DBG] from='client.40070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:44:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:44:02.897278+0000 mon.smithi061 (mon.0) 1907 : audit [DBG] from='client.? 172.21.15.61:0/3741190380' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:44:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:44:02.246495+0000 mgr.smithi067.rdualw (mgr.24569) 8887 : audit [DBG] from='client.40066 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:44:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:44:02.537384+0000 mgr.smithi067.rdualw (mgr.24569) 8888 : audit [DBG] from='client.40070 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:44:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:44:02.897278+0000 mon.smithi061 (mon.0) 1907 : audit [DBG] from='client.? 172.21.15.61:0/3741190380' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:44:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:03.094422+0000 mgr.smithi067.rdualw (mgr.24569) 8889 : cluster [DBG] pgmap v7655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:03.094422+0000 mgr.smithi067.rdualw (mgr.24569) 8889 : cluster [DBG] pgmap v7655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:07.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:05.095004+0000 mgr.smithi067.rdualw (mgr.24569) 8890 : cluster [DBG] pgmap v7656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:05.095004+0000 mgr.smithi067.rdualw (mgr.24569) 8890 : cluster [DBG] pgmap v7656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:07.095853+0000 mgr.smithi067.rdualw (mgr.24569) 8891 : cluster [DBG] pgmap v7657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:44:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:07.095853+0000 mgr.smithi067.rdualw (mgr.24569) 8891 : cluster [DBG] pgmap v7657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:44:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:09.096566+0000 mgr.smithi067.rdualw (mgr.24569) 8892 : cluster [DBG] pgmap v7658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:09.096566+0000 mgr.smithi067.rdualw (mgr.24569) 8892 : cluster [DBG] pgmap v7658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:11.097351+0000 mgr.smithi067.rdualw (mgr.24569) 8893 : cluster [DBG] pgmap v7659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:11.097351+0000 mgr.smithi067.rdualw (mgr.24569) 8893 : cluster [DBG] pgmap v7659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:13.097884+0000 mgr.smithi067.rdualw (mgr.24569) 8894 : cluster [DBG] pgmap v7660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:13.097884+0000 mgr.smithi067.rdualw (mgr.24569) 8894 : cluster [DBG] pgmap v7660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:15.098562+0000 mgr.smithi067.rdualw (mgr.24569) 8895 : cluster [DBG] pgmap v7661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:15.098562+0000 mgr.smithi067.rdualw (mgr.24569) 8895 : cluster [DBG] pgmap v7661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:17.099518+0000 mgr.smithi067.rdualw (mgr.24569) 8896 : cluster [DBG] pgmap v7662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:44:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:17.099518+0000 mgr.smithi067.rdualw (mgr.24569) 8896 : cluster [DBG] pgmap v7662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:44:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:19.100116+0000 mgr.smithi067.rdualw (mgr.24569) 8897 : cluster [DBG] pgmap v7663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:19.100116+0000 mgr.smithi067.rdualw (mgr.24569) 8897 : cluster [DBG] pgmap v7663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:21.101186+0000 mgr.smithi067.rdualw (mgr.24569) 8898 : cluster [DBG] pgmap v7664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:21.101186+0000 mgr.smithi067.rdualw (mgr.24569) 8898 : cluster [DBG] pgmap v7664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:23.101809+0000 mgr.smithi067.rdualw (mgr.24569) 8899 : cluster [DBG] pgmap v7665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:23.101809+0000 mgr.smithi067.rdualw (mgr.24569) 8899 : cluster [DBG] pgmap v7665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:25.102589+0000 mgr.smithi067.rdualw (mgr.24569) 8900 : cluster [DBG] pgmap v7666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:25.102589+0000 mgr.smithi067.rdualw (mgr.24569) 8900 : cluster [DBG] pgmap v7666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:27.103618+0000 mgr.smithi067.rdualw (mgr.24569) 8901 : cluster [DBG] pgmap v7667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:44:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:27.103618+0000 mgr.smithi067.rdualw (mgr.24569) 8901 : cluster [DBG] pgmap v7667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:44:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:29.104389+0000 mgr.smithi067.rdualw (mgr.24569) 8902 : cluster [DBG] pgmap v7668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:29.104389+0000 mgr.smithi067.rdualw (mgr.24569) 8902 : cluster [DBG] pgmap v7668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:31.105246+0000 mgr.smithi067.rdualw (mgr.24569) 8903 : cluster [DBG] pgmap v7669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:31.105246+0000 mgr.smithi067.rdualw (mgr.24569) 8903 : cluster [DBG] pgmap v7669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:33.206 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:44:33.494 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:44:33.494 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 8m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:44:33.495 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 8m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:44:33.495 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 8m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:44:33.495 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 8m ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:44:33.495 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 8m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:44:33.496 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 8m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:44:33.496 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 8m ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:44:33.496 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 8m ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:44:33.497 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 8m ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:44:33.497 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 8m ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:44:33.497 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 8m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:44:33.497 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 8m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:44:33.497 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 8m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:44:33.498 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 8m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:44:33.498 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 8m ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:44:33.498 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 8m ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:44:33.499 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 8m ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:44:33.499 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 8m ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:44:33.499 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 8m ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:44:33.499 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 8m ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:44:33.500 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 8m ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:44:33.500 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 8m ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:44:33.500 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 8m ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:44:33.839 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:44:33.839 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:44:33.839 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:44:33.840 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:44:33.840 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:44:33.840 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:44:33.840 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:44:33.841 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:44:33.841 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:44:33.841 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:44:33.841 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:44:33.841 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:44:33.842 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:44:33.842 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:44:33.842 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:44:33.842 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:44:33.843 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:44:33.843 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:44:33.843 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:44:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:33.105863+0000 mgr.smithi067.rdualw (mgr.24569) 8904 : cluster [DBG] pgmap v7670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:44:33.192809+0000 mgr.smithi067.rdualw (mgr.24569) 8905 : audit [DBG] from='client.40078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:44:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:44:33.477049+0000 mgr.smithi067.rdualw (mgr.24569) 8906 : audit [DBG] from='client.40082 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:44:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:44:33.837819+0000 mon.smithi061 (mon.0) 1908 : audit [DBG] from='client.? 172.21.15.61:0/3862164920' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:44:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:33.105863+0000 mgr.smithi067.rdualw (mgr.24569) 8904 : cluster [DBG] pgmap v7670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:44:33.192809+0000 mgr.smithi067.rdualw (mgr.24569) 8905 : audit [DBG] from='client.40078 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:44:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:44:33.477049+0000 mgr.smithi067.rdualw (mgr.24569) 8906 : audit [DBG] from='client.40082 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:44:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:44:33.837819+0000 mon.smithi061 (mon.0) 1908 : audit [DBG] from='client.? 172.21.15.61:0/3862164920' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:44:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:35.106505+0000 mgr.smithi067.rdualw (mgr.24569) 8907 : cluster [DBG] pgmap v7671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:44:35.850185+0000 mon.smithi067 (mon.1) 1354 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:44:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:44:35.850445+0000 mon.smithi067 (mon.1) 1355 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:44:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:44:35.850713+0000 mon.smithi061 (mon.0) 1909 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:44:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:44:35.851345+0000 mon.smithi061 (mon.0) 1910 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:44:37.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:35.106505+0000 mgr.smithi067.rdualw (mgr.24569) 8907 : cluster [DBG] pgmap v7671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:37.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:44:35.850185+0000 mon.smithi067 (mon.1) 1354 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:44:37.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:44:35.850445+0000 mon.smithi067 (mon.1) 1355 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:44:37.072 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:44:35.850713+0000 mon.smithi061 (mon.0) 1909 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:44:37.072 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:44:35.851345+0000 mon.smithi061 (mon.0) 1910 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:44:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:37.107501+0000 mgr.smithi067.rdualw (mgr.24569) 8908 : cluster [DBG] pgmap v7672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:44:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:37.107501+0000 mgr.smithi067.rdualw (mgr.24569) 8908 : cluster [DBG] pgmap v7672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:44:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:39.108078+0000 mgr.smithi067.rdualw (mgr.24569) 8909 : cluster [DBG] pgmap v7673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:39.108078+0000 mgr.smithi067.rdualw (mgr.24569) 8909 : cluster [DBG] pgmap v7673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:41.108915+0000 mgr.smithi067.rdualw (mgr.24569) 8910 : cluster [DBG] pgmap v7674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:41.108915+0000 mgr.smithi067.rdualw (mgr.24569) 8910 : cluster [DBG] pgmap v7674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:43.109451+0000 mgr.smithi067.rdualw (mgr.24569) 8911 : cluster [DBG] pgmap v7675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:43.109451+0000 mgr.smithi067.rdualw (mgr.24569) 8911 : cluster [DBG] pgmap v7675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:45.110290+0000 mgr.smithi067.rdualw (mgr.24569) 8912 : cluster [DBG] pgmap v7676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:45.110290+0000 mgr.smithi067.rdualw (mgr.24569) 8912 : cluster [DBG] pgmap v7676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:44:47.451891+0000 mon.smithi067 (mon.1) 1356 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:44:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:44:47.453349+0000 mon.smithi067 (mon.1) 1357 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:44:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:44:47.454211+0000 mon.smithi067 (mon.1) 1358 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:44:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:44:47.451891+0000 mon.smithi067 (mon.1) 1356 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:44:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:44:47.453349+0000 mon.smithi067 (mon.1) 1357 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:44:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:44:47.454211+0000 mon.smithi067 (mon.1) 1358 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:44:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:47.111231+0000 mgr.smithi067.rdualw (mgr.24569) 8913 : cluster [DBG] pgmap v7677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:44:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:44:47.455033+0000 mgr.smithi067.rdualw (mgr.24569) 8914 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:44:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:44:47.862697+0000 mon.smithi061 (mon.0) 1911 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:44:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:44:47.868869+0000 mon.smithi061 (mon.0) 1912 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:44:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:47.111231+0000 mgr.smithi067.rdualw (mgr.24569) 8913 : cluster [DBG] pgmap v7677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:44:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:44:47.455033+0000 mgr.smithi067.rdualw (mgr.24569) 8914 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:44:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:44:47.862697+0000 mon.smithi061 (mon.0) 1911 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:44:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:44:47.868869+0000 mon.smithi061 (mon.0) 1912 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:44:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:49.112008+0000 mgr.smithi067.rdualw (mgr.24569) 8915 : cluster [DBG] pgmap v7678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:49.112008+0000 mgr.smithi067.rdualw (mgr.24569) 8915 : cluster [DBG] pgmap v7678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:51.113108+0000 mgr.smithi067.rdualw (mgr.24569) 8916 : cluster [DBG] pgmap v7679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:51.113108+0000 mgr.smithi067.rdualw (mgr.24569) 8916 : cluster [DBG] pgmap v7679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:53.113717+0000 mgr.smithi067.rdualw (mgr.24569) 8917 : cluster [DBG] pgmap v7680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:53.113717+0000 mgr.smithi067.rdualw (mgr.24569) 8917 : cluster [DBG] pgmap v7680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:55.114309+0000 mgr.smithi067.rdualw (mgr.24569) 8918 : cluster [DBG] pgmap v7681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:55.114309+0000 mgr.smithi067.rdualw (mgr.24569) 8918 : cluster [DBG] pgmap v7681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:44:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:44:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:57.115274+0000 mgr.smithi067.rdualw (mgr.24569) 8919 : cluster [DBG] pgmap v7682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:44:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:44:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:57.115274+0000 mgr.smithi067.rdualw (mgr.24569) 8919 : cluster [DBG] pgmap v7682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:45:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:44:59.116020+0000 mgr.smithi067.rdualw (mgr.24569) 8920 : cluster [DBG] pgmap v7683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:44:59.116020+0000 mgr.smithi067.rdualw (mgr.24569) 8920 : cluster [DBG] pgmap v7683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:01.117021+0000 mgr.smithi067.rdualw (mgr.24569) 8921 : cluster [DBG] pgmap v7684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:01.117021+0000 mgr.smithi067.rdualw (mgr.24569) 8921 : cluster [DBG] pgmap v7684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:04.157 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:45:04.450 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:45:04.451 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 9m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:45:04.451 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 9m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:45:04.451 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 9m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:45:04.451 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 9m ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:45:04.452 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 9m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:45:04.452 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 9m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:45:04.452 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 9m ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:45:04.452 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 9m ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:45:04.452 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 9m ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:45:04.453 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 9m ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:45:04.453 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 9m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:45:04.453 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 9m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:45:04.453 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 9m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:45:04.453 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 9m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:45:04.454 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 9m ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:45:04.454 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 9m ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:45:04.454 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 9m ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:45:04.454 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 9m ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:45:04.455 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 9m ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:45:04.455 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 9m ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:45:04.455 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 9m ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:45:04.455 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 9m ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:45:04.455 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 9m ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:45:04.793 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:45:04.793 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:45:04.794 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:45:04.794 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:45:04.794 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:45:04.794 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:45:04.795 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:45:04.795 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:45:04.795 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:45:04.795 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:45:04.795 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:45:04.796 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:45:04.796 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:45:04.796 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:45:04.796 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:45:04.797 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:45:04.797 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:45:04.797 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:45:04.797 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:45:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:03.117736+0000 mgr.smithi067.rdualw (mgr.24569) 8922 : cluster [DBG] pgmap v7685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:03.117736+0000 mgr.smithi067.rdualw (mgr.24569) 8922 : cluster [DBG] pgmap v7685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:04.141960+0000 mgr.smithi067.rdualw (mgr.24569) 8923 : audit [DBG] from='client.40090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:45:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:04.433156+0000 mgr.smithi067.rdualw (mgr.24569) 8924 : audit [DBG] from='client.40094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:45:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:04.792148+0000 mon.smithi061 (mon.0) 1913 : audit [DBG] from='client.? 172.21.15.61:0/1145566969' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:45:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:05.118487+0000 mgr.smithi067.rdualw (mgr.24569) 8925 : cluster [DBG] pgmap v7686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:04.141960+0000 mgr.smithi067.rdualw (mgr.24569) 8923 : audit [DBG] from='client.40090 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:45:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:04.433156+0000 mgr.smithi067.rdualw (mgr.24569) 8924 : audit [DBG] from='client.40094 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:45:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:04.792148+0000 mon.smithi061 (mon.0) 1913 : audit [DBG] from='client.? 172.21.15.61:0/1145566969' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:45:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:05.118487+0000 mgr.smithi067.rdualw (mgr.24569) 8925 : cluster [DBG] pgmap v7686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:07.119550+0000 mgr.smithi067.rdualw (mgr.24569) 8926 : cluster [DBG] pgmap v7687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:45:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:07.119550+0000 mgr.smithi067.rdualw (mgr.24569) 8926 : cluster [DBG] pgmap v7687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:45:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:09.120182+0000 mgr.smithi067.rdualw (mgr.24569) 8927 : cluster [DBG] pgmap v7688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:09.120182+0000 mgr.smithi067.rdualw (mgr.24569) 8927 : cluster [DBG] pgmap v7688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:11.121095+0000 mgr.smithi067.rdualw (mgr.24569) 8928 : cluster [DBG] pgmap v7689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:11.121095+0000 mgr.smithi067.rdualw (mgr.24569) 8928 : cluster [DBG] pgmap v7689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:13.121673+0000 mgr.smithi067.rdualw (mgr.24569) 8929 : cluster [DBG] pgmap v7690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:13.121673+0000 mgr.smithi067.rdualw (mgr.24569) 8929 : cluster [DBG] pgmap v7690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:15.122481+0000 mgr.smithi067.rdualw (mgr.24569) 8930 : cluster [DBG] pgmap v7691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:15.122481+0000 mgr.smithi067.rdualw (mgr.24569) 8930 : cluster [DBG] pgmap v7691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:17.123347+0000 mgr.smithi067.rdualw (mgr.24569) 8931 : cluster [DBG] pgmap v7692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:45:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:17.123347+0000 mgr.smithi067.rdualw (mgr.24569) 8931 : cluster [DBG] pgmap v7692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:45:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:19.123917+0000 mgr.smithi067.rdualw (mgr.24569) 8932 : cluster [DBG] pgmap v7693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:19.123917+0000 mgr.smithi067.rdualw (mgr.24569) 8932 : cluster [DBG] pgmap v7693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:21.124733+0000 mgr.smithi067.rdualw (mgr.24569) 8933 : cluster [DBG] pgmap v7694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:21.124733+0000 mgr.smithi067.rdualw (mgr.24569) 8933 : cluster [DBG] pgmap v7694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:23.125185+0000 mgr.smithi067.rdualw (mgr.24569) 8934 : cluster [DBG] pgmap v7695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:23.125185+0000 mgr.smithi067.rdualw (mgr.24569) 8934 : cluster [DBG] pgmap v7695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:25.125866+0000 mgr.smithi067.rdualw (mgr.24569) 8935 : cluster [DBG] pgmap v7696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:25.125866+0000 mgr.smithi067.rdualw (mgr.24569) 8935 : cluster [DBG] pgmap v7696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:27.126776+0000 mgr.smithi067.rdualw (mgr.24569) 8936 : cluster [DBG] pgmap v7697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:45:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:27.126776+0000 mgr.smithi067.rdualw (mgr.24569) 8936 : cluster [DBG] pgmap v7697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:45:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:29.127552+0000 mgr.smithi067.rdualw (mgr.24569) 8937 : cluster [DBG] pgmap v7698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:29.127552+0000 mgr.smithi067.rdualw (mgr.24569) 8937 : cluster [DBG] pgmap v7698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:31.128472+0000 mgr.smithi067.rdualw (mgr.24569) 8938 : cluster [DBG] pgmap v7699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:31.128472+0000 mgr.smithi067.rdualw (mgr.24569) 8938 : cluster [DBG] pgmap v7699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:33.129079+0000 mgr.smithi067.rdualw (mgr.24569) 8939 : cluster [DBG] pgmap v7700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:33.129079+0000 mgr.smithi067.rdualw (mgr.24569) 8939 : cluster [DBG] pgmap v7700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:35.102 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:45:35.392 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:45:35.393 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 9m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:45:35.393 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 9m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:45:35.393 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 9m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:45:35.393 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 9m ago 4h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:45:35.393 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 9m ago 4h 42.8M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:45:35.394 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 9m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:45:35.394 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 9m ago 4h 478M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:45:35.394 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 9m ago 4h 612M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:45:35.394 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 9m ago 4h 1641M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:45:35.394 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 9m ago 4h 860M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:45:35.395 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 9m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:45:35.395 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 9m ago 4h 116M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:45:35.395 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 9m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:45:35.395 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 9m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:45:35.396 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 9m ago 4h 1089M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:45:35.396 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 9m ago 4h 1968M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:45:35.396 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 9m ago 4h 1233M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:45:35.396 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 9m ago 4h 2110M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:45:35.397 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 9m ago 4h 1945M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:45:35.397 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 9m ago 4h 2125M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:45:35.397 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 9m ago 4h 1725M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:45:35.397 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 9m ago 4h 2663M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:45:35.397 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 9m ago 4h 148M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:45:35.737 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:45:35.737 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:45:35.737 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:45:35.738 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:45:35.738 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:45:35.738 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:45:35.738 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:45:35.739 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:45:35.739 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:45:35.739 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:45:35.739 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:45:35.739 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:45:35.740 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:45:35.740 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:45:35.741 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:45:35.741 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:45:35.741 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:45:35.742 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:45:35.742 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:45:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:35.089444+0000 mgr.smithi067.rdualw (mgr.24569) 8940 : audit [DBG] from='client.40102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:45:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:35.129692+0000 mgr.smithi067.rdualw (mgr.24569) 8941 : cluster [DBG] pgmap v7701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:35.374991+0000 mgr.smithi067.rdualw (mgr.24569) 8942 : audit [DBG] from='client.40106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:45:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:35.735601+0000 mon.smithi061 (mon.0) 1914 : audit [DBG] from='client.? 172.21.15.61:0/3305515448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:45:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:35.855374+0000 mon.smithi067 (mon.1) 1359 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:45:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:35.855683+0000 mon.smithi067 (mon.1) 1360 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:45:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:35.855921+0000 mon.smithi061 (mon.0) 1915 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:45:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:35.856155+0000 mon.smithi061 (mon.0) 1916 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:45:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:35.089444+0000 mgr.smithi067.rdualw (mgr.24569) 8940 : audit [DBG] from='client.40102 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:45:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:35.129692+0000 mgr.smithi067.rdualw (mgr.24569) 8941 : cluster [DBG] pgmap v7701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:35.374991+0000 mgr.smithi067.rdualw (mgr.24569) 8942 : audit [DBG] from='client.40106 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:45:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:35.735601+0000 mon.smithi061 (mon.0) 1914 : audit [DBG] from='client.? 172.21.15.61:0/3305515448' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:45:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:35.855374+0000 mon.smithi067 (mon.1) 1359 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:45:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:35.855683+0000 mon.smithi067 (mon.1) 1360 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:45:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:35.855921+0000 mon.smithi061 (mon.0) 1915 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:45:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:35.856155+0000 mon.smithi061 (mon.0) 1916 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:45:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:37.130666+0000 mgr.smithi067.rdualw (mgr.24569) 8943 : cluster [DBG] pgmap v7702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:45:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:37.130666+0000 mgr.smithi067.rdualw (mgr.24569) 8943 : cluster [DBG] pgmap v7702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:45:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:39.131243+0000 mgr.smithi067.rdualw (mgr.24569) 8944 : cluster [DBG] pgmap v7703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:39.131243+0000 mgr.smithi067.rdualw (mgr.24569) 8944 : cluster [DBG] pgmap v7703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:41.132116+0000 mgr.smithi067.rdualw (mgr.24569) 8945 : cluster [DBG] pgmap v7704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:41.132116+0000 mgr.smithi067.rdualw (mgr.24569) 8945 : cluster [DBG] pgmap v7704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:43.132618+0000 mgr.smithi067.rdualw (mgr.24569) 8946 : cluster [DBG] pgmap v7705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:43.132618+0000 mgr.smithi067.rdualw (mgr.24569) 8946 : cluster [DBG] pgmap v7705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:45.133228+0000 mgr.smithi067.rdualw (mgr.24569) 8947 : cluster [DBG] pgmap v7706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:45.133228+0000 mgr.smithi067.rdualw (mgr.24569) 8947 : cluster [DBG] pgmap v7706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:47.134140+0000 mgr.smithi067.rdualw (mgr.24569) 8948 : cluster [DBG] pgmap v7707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:45:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:47.134140+0000 mgr.smithi067.rdualw (mgr.24569) 8948 : cluster [DBG] pgmap v7707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:45:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:47.872766+0000 mon.smithi067 (mon.1) 1361 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:45:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:47.874240+0000 mon.smithi067 (mon.1) 1362 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:45:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:47.875224+0000 mon.smithi067 (mon.1) 1363 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:45:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:45:47.876101+0000 mgr.smithi067.rdualw (mgr.24569) 8949 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:45:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:47.872766+0000 mon.smithi067 (mon.1) 1361 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:45:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:47.874240+0000 mon.smithi067 (mon.1) 1362 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:45:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:47.875224+0000 mon.smithi067 (mon.1) 1363 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:45:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:45:47.876101+0000 mgr.smithi067.rdualw (mgr.24569) 8949 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:45:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:49.134738+0000 mgr.smithi067.rdualw (mgr.24569) 8950 : cluster [DBG] pgmap v7708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:49.134738+0000 mgr.smithi067.rdualw (mgr.24569) 8950 : cluster [DBG] pgmap v7708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:51.135568+0000 mgr.smithi067.rdualw (mgr.24569) 8951 : cluster [DBG] pgmap v7709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:52.267201+0000 mon.smithi061 (mon.0) 1917 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:45:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:51.135568+0000 mgr.smithi067.rdualw (mgr.24569) 8951 : cluster [DBG] pgmap v7709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:52.267201+0000 mon.smithi061 (mon.0) 1917 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:45:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:52.658377+0000 mon.smithi067 (mon.1) 1364 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:45:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:52.658626+0000 mon.smithi061 (mon.0) 1918 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:45:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:52.658377+0000 mon.smithi067 (mon.1) 1364 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:45:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:52.658626+0000 mon.smithi061 (mon.0) 1918 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:45:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:53.136008+0000 mgr.smithi067.rdualw (mgr.24569) 8952 : cluster [DBG] pgmap v7710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:53.136008+0000 mgr.smithi067.rdualw (mgr.24569) 8952 : cluster [DBG] pgmap v7710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:56.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:55.012375+0000 mon.smithi061 (mon.0) 1919 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:45:56.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:55.136658+0000 mgr.smithi067.rdualw (mgr.24569) 8953 : cluster [DBG] pgmap v7711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:56.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:55.418159+0000 mon.smithi067 (mon.1) 1365 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:45:56.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:55.418602+0000 mon.smithi061 (mon.0) 1920 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:45:56.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:55.423648+0000 mon.smithi061 (mon.0) 1921 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:45:56.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:45:55.430746+0000 mon.smithi061 (mon.0) 1922 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:45:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:55.012375+0000 mon.smithi061 (mon.0) 1919 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:45:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:55.136658+0000 mgr.smithi067.rdualw (mgr.24569) 8953 : cluster [DBG] pgmap v7711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:45:56.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:55.418159+0000 mon.smithi067 (mon.1) 1365 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:45:56.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:55.418602+0000 mon.smithi061 (mon.0) 1920 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:45:56.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:55.423648+0000 mon.smithi061 (mon.0) 1921 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:45:56.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:45:55.430746+0000 mon.smithi061 (mon.0) 1922 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:45:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:45:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:57.137567+0000 mgr.smithi067.rdualw (mgr.24569) 8954 : cluster [DBG] pgmap v7712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:45:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:45:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:57.137567+0000 mgr.smithi067.rdualw (mgr.24569) 8954 : cluster [DBG] pgmap v7712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:46:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:45:59.138268+0000 mgr.smithi067.rdualw (mgr.24569) 8955 : cluster [DBG] pgmap v7713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:45:59.138268+0000 mgr.smithi067.rdualw (mgr.24569) 8955 : cluster [DBG] pgmap v7713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:01.139312+0000 mgr.smithi067.rdualw (mgr.24569) 8956 : cluster [DBG] pgmap v7714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:01.139312+0000 mgr.smithi067.rdualw (mgr.24569) 8956 : cluster [DBG] pgmap v7714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:03.139938+0000 mgr.smithi067.rdualw (mgr.24569) 8957 : cluster [DBG] pgmap v7715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:03.139938+0000 mgr.smithi067.rdualw (mgr.24569) 8957 : cluster [DBG] pgmap v7715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:06.043 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:46:06.334 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:46:06.334 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 11s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:46:06.335 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 11s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:46:06.335 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 14s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:46:06.335 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 11s ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:46:06.335 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 11s ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:46:06.336 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 14s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:46:06.336 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 11s ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:46:06.336 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 14s ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:46:06.336 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 11s ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:46:06.336 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 14s ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:46:06.337 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 11s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:46:06.337 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 14s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:46:06.337 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 11s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:46:06.337 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 14s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:46:06.337 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 11s ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:46:06.338 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 11s ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:46:06.338 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 11s ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:46:06.338 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 11s ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:46:06.338 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 14s ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:46:06.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 14s ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:46:06.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 14s ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:46:06.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 14s ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:46:06.339 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 11s ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:46:06.684 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:46:06.685 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:46:06.685 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:46:06.685 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:46:06.685 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:46:06.686 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:46:06.686 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:46:06.686 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:46:06.686 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:46:06.686 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:46:06.687 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:46:06.687 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:46:06.687 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:46:06.687 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:46:06.688 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:46:06.688 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:46:06.688 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:46:06.688 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:46:06.688 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:46:07.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:05.140760+0000 mgr.smithi067.rdualw (mgr.24569) 8958 : cluster [DBG] pgmap v7716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:05.140760+0000 mgr.smithi067.rdualw (mgr.24569) 8958 : cluster [DBG] pgmap v7716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:46:06.029590+0000 mgr.smithi067.rdualw (mgr.24569) 8959 : audit [DBG] from='client.40114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:46:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:46:06.316819+0000 mgr.smithi067.rdualw (mgr.24569) 8960 : audit [DBG] from='client.40118 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:46:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:46:06.683371+0000 mon.smithi061 (mon.0) 1923 : audit [DBG] from='client.? 172.21.15.61:0/2443514358' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:46:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:07.141647+0000 mgr.smithi067.rdualw (mgr.24569) 8961 : cluster [DBG] pgmap v7717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:46:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:46:06.029590+0000 mgr.smithi067.rdualw (mgr.24569) 8959 : audit [DBG] from='client.40114 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:46:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:46:06.316819+0000 mgr.smithi067.rdualw (mgr.24569) 8960 : audit [DBG] from='client.40118 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:46:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:46:06.683371+0000 mon.smithi061 (mon.0) 1923 : audit [DBG] from='client.? 172.21.15.61:0/2443514358' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:46:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:07.141647+0000 mgr.smithi067.rdualw (mgr.24569) 8961 : cluster [DBG] pgmap v7717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:46:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:09.142189+0000 mgr.smithi067.rdualw (mgr.24569) 8962 : cluster [DBG] pgmap v7718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:09.142189+0000 mgr.smithi067.rdualw (mgr.24569) 8962 : cluster [DBG] pgmap v7718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:11.143230+0000 mgr.smithi067.rdualw (mgr.24569) 8963 : cluster [DBG] pgmap v7719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:11.143230+0000 mgr.smithi067.rdualw (mgr.24569) 8963 : cluster [DBG] pgmap v7719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:13.144023+0000 mgr.smithi067.rdualw (mgr.24569) 8964 : cluster [DBG] pgmap v7720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:13.144023+0000 mgr.smithi067.rdualw (mgr.24569) 8964 : cluster [DBG] pgmap v7720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:15.144836+0000 mgr.smithi067.rdualw (mgr.24569) 8965 : cluster [DBG] pgmap v7721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:15.144836+0000 mgr.smithi067.rdualw (mgr.24569) 8965 : cluster [DBG] pgmap v7721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:17.145737+0000 mgr.smithi067.rdualw (mgr.24569) 8966 : cluster [DBG] pgmap v7722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:46:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:17.145737+0000 mgr.smithi067.rdualw (mgr.24569) 8966 : cluster [DBG] pgmap v7722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:46:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:19.146483+0000 mgr.smithi067.rdualw (mgr.24569) 8967 : cluster [DBG] pgmap v7723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:19.146483+0000 mgr.smithi067.rdualw (mgr.24569) 8967 : cluster [DBG] pgmap v7723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:21.147511+0000 mgr.smithi067.rdualw (mgr.24569) 8968 : cluster [DBG] pgmap v7724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:21.147511+0000 mgr.smithi067.rdualw (mgr.24569) 8968 : cluster [DBG] pgmap v7724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:23.148048+0000 mgr.smithi067.rdualw (mgr.24569) 8969 : cluster [DBG] pgmap v7725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:23.148048+0000 mgr.smithi067.rdualw (mgr.24569) 8969 : cluster [DBG] pgmap v7725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:25.148815+0000 mgr.smithi067.rdualw (mgr.24569) 8970 : cluster [DBG] pgmap v7726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:25.148815+0000 mgr.smithi067.rdualw (mgr.24569) 8970 : cluster [DBG] pgmap v7726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:27.149652+0000 mgr.smithi067.rdualw (mgr.24569) 8971 : cluster [DBG] pgmap v7727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:46:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:27.149652+0000 mgr.smithi067.rdualw (mgr.24569) 8971 : cluster [DBG] pgmap v7727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:46:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:29.150202+0000 mgr.smithi067.rdualw (mgr.24569) 8972 : cluster [DBG] pgmap v7728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:30.623 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:29.150202+0000 mgr.smithi067.rdualw (mgr.24569) 8972 : cluster [DBG] pgmap v7728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:31.151047+0000 mgr.smithi067.rdualw (mgr.24569) 8973 : cluster [DBG] pgmap v7729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:31.151047+0000 mgr.smithi067.rdualw (mgr.24569) 8973 : cluster [DBG] pgmap v7729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:33.151642+0000 mgr.smithi067.rdualw (mgr.24569) 8974 : cluster [DBG] pgmap v7730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:33.151642+0000 mgr.smithi067.rdualw (mgr.24569) 8974 : cluster [DBG] pgmap v7730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:35.152195+0000 mgr.smithi067.rdualw (mgr.24569) 8975 : cluster [DBG] pgmap v7731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:35.152195+0000 mgr.smithi067.rdualw (mgr.24569) 8975 : cluster [DBG] pgmap v7731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:36.992 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:46:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:46:35.860825+0000 mon.smithi067 (mon.1) 1366 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:46:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:46:35.861072+0000 mon.smithi067 (mon.1) 1367 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:46:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:46:35.861384+0000 mon.smithi061 (mon.0) 1924 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:46:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:46:35.861698+0000 mon.smithi061 (mon.0) 1925 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:46:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:46:35.860825+0000 mon.smithi067 (mon.1) 1366 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:46:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:46:35.861072+0000 mon.smithi067 (mon.1) 1367 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:46:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:46:35.861384+0000 mon.smithi061 (mon.0) 1924 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:46:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:46:35.861698+0000 mon.smithi061 (mon.0) 1925 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:46:37.284 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:46:37.285 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 42s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:46:37.285 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 42s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:46:37.285 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 45s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:46:37.286 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 42s ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:46:37.286 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 42s ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:46:37.286 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 45s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:46:37.286 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 42s ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:46:37.286 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 45s ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:46:37.287 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 42s ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:46:37.287 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 45s ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:46:37.287 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 42s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:46:37.287 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 45s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:46:37.287 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 42s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:46:37.288 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 45s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:46:37.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 42s ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:46:37.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 42s ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:46:37.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 42s ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:46:37.288 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 42s ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:46:37.289 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 45s ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:46:37.289 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 45s ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:46:37.289 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 45s ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:46:37.289 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 45s ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:46:37.289 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 42s ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:46:37.630 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:46:37.630 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:46:37.630 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:46:37.631 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:46:37.631 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:46:37.631 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:46:37.631 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:46:37.632 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:46:37.632 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:46:37.632 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:46:37.632 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:46:37.632 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:46:37.633 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:46:37.633 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:46:37.633 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:46:37.633 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:46:37.633 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:46:37.634 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:46:37.634 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:46:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:46:36.979775+0000 mgr.smithi067.rdualw (mgr.24569) 8976 : audit [DBG] from='client.40126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:46:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:37.153028+0000 mgr.smithi067.rdualw (mgr.24569) 8977 : cluster [DBG] pgmap v7732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:46:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:46:37.267325+0000 mgr.smithi067.rdualw (mgr.24569) 8978 : audit [DBG] from='client.40130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:46:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:46:37.628745+0000 mon.smithi061 (mon.0) 1926 : audit [DBG] from='client.? 172.21.15.61:0/1226811216' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:46:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:46:36.979775+0000 mgr.smithi067.rdualw (mgr.24569) 8976 : audit [DBG] from='client.40126 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:46:38.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:37.153028+0000 mgr.smithi067.rdualw (mgr.24569) 8977 : cluster [DBG] pgmap v7732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:46:38.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:46:37.267325+0000 mgr.smithi067.rdualw (mgr.24569) 8978 : audit [DBG] from='client.40130 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:46:38.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:46:37.628745+0000 mon.smithi061 (mon.0) 1926 : audit [DBG] from='client.? 172.21.15.61:0/1226811216' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:46:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:39.153618+0000 mgr.smithi067.rdualw (mgr.24569) 8979 : cluster [DBG] pgmap v7733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:39.153618+0000 mgr.smithi067.rdualw (mgr.24569) 8979 : cluster [DBG] pgmap v7733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:41.154521+0000 mgr.smithi067.rdualw (mgr.24569) 8980 : cluster [DBG] pgmap v7734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:41.154521+0000 mgr.smithi067.rdualw (mgr.24569) 8980 : cluster [DBG] pgmap v7734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:43.155126+0000 mgr.smithi067.rdualw (mgr.24569) 8981 : cluster [DBG] pgmap v7735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:43.155126+0000 mgr.smithi067.rdualw (mgr.24569) 8981 : cluster [DBG] pgmap v7735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:45.155916+0000 mgr.smithi067.rdualw (mgr.24569) 8982 : cluster [DBG] pgmap v7736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:45.155916+0000 mgr.smithi067.rdualw (mgr.24569) 8982 : cluster [DBG] pgmap v7736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:47.156778+0000 mgr.smithi067.rdualw (mgr.24569) 8983 : cluster [DBG] pgmap v7737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:46:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:47.156778+0000 mgr.smithi067.rdualw (mgr.24569) 8983 : cluster [DBG] pgmap v7737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:46:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:49.157501+0000 mgr.smithi067.rdualw (mgr.24569) 8984 : cluster [DBG] pgmap v7738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:49.157501+0000 mgr.smithi067.rdualw (mgr.24569) 8984 : cluster [DBG] pgmap v7738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:51.158549+0000 mgr.smithi067.rdualw (mgr.24569) 8985 : cluster [DBG] pgmap v7739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:51.158549+0000 mgr.smithi067.rdualw (mgr.24569) 8985 : cluster [DBG] pgmap v7739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:53.159265+0000 mgr.smithi067.rdualw (mgr.24569) 8986 : cluster [DBG] pgmap v7740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:53.159265+0000 mgr.smithi067.rdualw (mgr.24569) 8986 : cluster [DBG] pgmap v7740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:55.159922+0000 mgr.smithi067.rdualw (mgr.24569) 8987 : cluster [DBG] pgmap v7741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:46:55.437257+0000 mon.smithi067 (mon.1) 1368 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:46:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:46:55.438689+0000 mon.smithi067 (mon.1) 1369 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:46:56.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:46:55.439622+0000 mon.smithi067 (mon.1) 1370 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:46:56.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:46:55.440464+0000 mgr.smithi067.rdualw (mgr.24569) 8988 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:46:56.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:46:55.873110+0000 mon.smithi061 (mon.0) 1927 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:46:56.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:46:55.878458+0000 mon.smithi061 (mon.0) 1928 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:46:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:55.159922+0000 mgr.smithi067.rdualw (mgr.24569) 8987 : cluster [DBG] pgmap v7741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:46:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:46:55.437257+0000 mon.smithi067 (mon.1) 1368 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:46:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:46:55.438689+0000 mon.smithi067 (mon.1) 1369 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:46:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:46:55.439622+0000 mon.smithi067 (mon.1) 1370 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:46:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:46:55.440464+0000 mgr.smithi067.rdualw (mgr.24569) 8988 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:46:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:46:55.873110+0000 mon.smithi061 (mon.0) 1927 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:46:56.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:46:55.878458+0000 mon.smithi061 (mon.0) 1928 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:46:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:46:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:57.160776+0000 mgr.smithi067.rdualw (mgr.24569) 8989 : cluster [DBG] pgmap v7742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:46:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:46:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:57.160776+0000 mgr.smithi067.rdualw (mgr.24569) 8989 : cluster [DBG] pgmap v7742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:47:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:46:59.161340+0000 mgr.smithi067.rdualw (mgr.24569) 8990 : cluster [DBG] pgmap v7743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:46:59.161340+0000 mgr.smithi067.rdualw (mgr.24569) 8990 : cluster [DBG] pgmap v7743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:01.162312+0000 mgr.smithi067.rdualw (mgr.24569) 8991 : cluster [DBG] pgmap v7744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:01.162312+0000 mgr.smithi067.rdualw (mgr.24569) 8991 : cluster [DBG] pgmap v7744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:03.163012+0000 mgr.smithi067.rdualw (mgr.24569) 8992 : cluster [DBG] pgmap v7745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:03.163012+0000 mgr.smithi067.rdualw (mgr.24569) 8992 : cluster [DBG] pgmap v7745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:06.555 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:05.163817+0000 mgr.smithi067.rdualw (mgr.24569) 8993 : cluster [DBG] pgmap v7746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:05.163817+0000 mgr.smithi067.rdualw (mgr.24569) 8993 : cluster [DBG] pgmap v7746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:07.936 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:47:08.227 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:47:08.228 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 73s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:47:08.228 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 73s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:47:08.229 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 75s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:47:08.229 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 73s ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:47:08.230 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 73s ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:47:08.230 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 75s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:47:08.231 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 73s ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:47:08.231 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 75s ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:47:08.232 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 73s ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:47:08.232 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 75s ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:47:08.232 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 73s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:47:08.233 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 75s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:47:08.233 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 73s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:47:08.234 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 75s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:47:08.234 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 73s ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:47:08.235 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 73s ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:47:08.235 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 73s ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:47:08.236 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 73s ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:47:08.236 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 75s ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:47:08.237 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 75s ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:47:08.237 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 75s ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:47:08.237 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 75s ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:47:08.238 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 73s ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:47:08.574 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:47:08.575 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:47:08.575 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:47:08.575 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:47:08.575 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:47:08.576 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:47:08.576 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:47:08.576 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:47:08.576 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:47:08.577 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:47:08.577 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:47:08.577 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:47:08.577 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:47:08.578 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:47:08.578 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:47:08.578 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:47:08.578 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:47:08.579 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:47:08.579 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:47:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:07.164733+0000 mgr.smithi067.rdualw (mgr.24569) 8994 : cluster [DBG] pgmap v7747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:47:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:47:08.573459+0000 mon.smithi061 (mon.0) 1929 : audit [DBG] from='client.? 172.21.15.61:0/4267585647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:47:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:07.164733+0000 mgr.smithi067.rdualw (mgr.24569) 8994 : cluster [DBG] pgmap v7747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:47:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:47:08.573459+0000 mon.smithi061 (mon.0) 1929 : audit [DBG] from='client.? 172.21.15.61:0/4267585647' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:47:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:47:07.922651+0000 mgr.smithi067.rdualw (mgr.24569) 8995 : audit [DBG] from='client.40138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:47:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:47:08.210034+0000 mgr.smithi067.rdualw (mgr.24569) 8996 : audit [DBG] from='client.40142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:47:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:47:07.922651+0000 mgr.smithi067.rdualw (mgr.24569) 8995 : audit [DBG] from='client.40138 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:47:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:47:08.210034+0000 mgr.smithi067.rdualw (mgr.24569) 8996 : audit [DBG] from='client.40142 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:47:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:09.165382+0000 mgr.smithi067.rdualw (mgr.24569) 8997 : cluster [DBG] pgmap v7748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:09.165382+0000 mgr.smithi067.rdualw (mgr.24569) 8997 : cluster [DBG] pgmap v7748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:11.166283+0000 mgr.smithi067.rdualw (mgr.24569) 8998 : cluster [DBG] pgmap v7749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:11.166283+0000 mgr.smithi067.rdualw (mgr.24569) 8998 : cluster [DBG] pgmap v7749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:13.166870+0000 mgr.smithi067.rdualw (mgr.24569) 8999 : cluster [DBG] pgmap v7750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:13.166870+0000 mgr.smithi067.rdualw (mgr.24569) 8999 : cluster [DBG] pgmap v7750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:15.167636+0000 mgr.smithi067.rdualw (mgr.24569) 9000 : cluster [DBG] pgmap v7751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:15.167636+0000 mgr.smithi067.rdualw (mgr.24569) 9000 : cluster [DBG] pgmap v7751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:17.168521+0000 mgr.smithi067.rdualw (mgr.24569) 9001 : cluster [DBG] pgmap v7752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:47:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:17.168521+0000 mgr.smithi067.rdualw (mgr.24569) 9001 : cluster [DBG] pgmap v7752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:47:20.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:19.169132+0000 mgr.smithi067.rdualw (mgr.24569) 9002 : cluster [DBG] pgmap v7753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:19.169132+0000 mgr.smithi067.rdualw (mgr.24569) 9002 : cluster [DBG] pgmap v7753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:21.170001+0000 mgr.smithi067.rdualw (mgr.24569) 9003 : cluster [DBG] pgmap v7754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:21.170001+0000 mgr.smithi067.rdualw (mgr.24569) 9003 : cluster [DBG] pgmap v7754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:23.170632+0000 mgr.smithi067.rdualw (mgr.24569) 9004 : cluster [DBG] pgmap v7755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:23.170632+0000 mgr.smithi067.rdualw (mgr.24569) 9004 : cluster [DBG] pgmap v7755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:25.171333+0000 mgr.smithi067.rdualw (mgr.24569) 9005 : cluster [DBG] pgmap v7756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:25.171333+0000 mgr.smithi067.rdualw (mgr.24569) 9005 : cluster [DBG] pgmap v7756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:27.172278+0000 mgr.smithi067.rdualw (mgr.24569) 9006 : cluster [DBG] pgmap v7757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:47:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:27.172278+0000 mgr.smithi067.rdualw (mgr.24569) 9006 : cluster [DBG] pgmap v7757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:47:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:29.173038+0000 mgr.smithi067.rdualw (mgr.24569) 9007 : cluster [DBG] pgmap v7758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:29.173038+0000 mgr.smithi067.rdualw (mgr.24569) 9007 : cluster [DBG] pgmap v7758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:31.173971+0000 mgr.smithi067.rdualw (mgr.24569) 9008 : cluster [DBG] pgmap v7759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:31.173971+0000 mgr.smithi067.rdualw (mgr.24569) 9008 : cluster [DBG] pgmap v7759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:33.174584+0000 mgr.smithi067.rdualw (mgr.24569) 9009 : cluster [DBG] pgmap v7760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:33.174584+0000 mgr.smithi067.rdualw (mgr.24569) 9009 : cluster [DBG] pgmap v7760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:35.175104+0000 mgr.smithi067.rdualw (mgr.24569) 9010 : cluster [DBG] pgmap v7761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:47:35.866129+0000 mon.smithi067 (mon.1) 1371 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:47:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:47:35.866356+0000 mon.smithi067 (mon.1) 1372 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:47:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:47:35.866547+0000 mon.smithi061 (mon.0) 1930 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:47:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:47:35.866836+0000 mon.smithi061 (mon.0) 1931 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:47:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:35.175104+0000 mgr.smithi067.rdualw (mgr.24569) 9010 : cluster [DBG] pgmap v7761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:47:35.866129+0000 mon.smithi067 (mon.1) 1371 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:47:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:47:35.866356+0000 mon.smithi067 (mon.1) 1372 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:47:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:47:35.866547+0000 mon.smithi061 (mon.0) 1930 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:47:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:47:35.866836+0000 mon.smithi061 (mon.0) 1931 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:47:38.903 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:47:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:37.176012+0000 mgr.smithi067.rdualw (mgr.24569) 9011 : cluster [DBG] pgmap v7762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:47:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:37.176012+0000 mgr.smithi067.rdualw (mgr.24569) 9011 : cluster [DBG] pgmap v7762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:47:39.195 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:47:39.195 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 104s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:47:39.195 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 104s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:47:39.196 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 106s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:47:39.196 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 104s ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:47:39.196 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 104s ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:47:39.197 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 106s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:47:39.197 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 104s ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:47:39.197 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 106s ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:47:39.197 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 104s ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:47:39.198 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 106s ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:47:39.198 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 104s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:47:39.198 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 106s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:47:39.198 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 104s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:47:39.199 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 106s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:47:39.199 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 104s ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:47:39.199 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 104s ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:47:39.199 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 104s ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:47:39.200 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 104s ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:47:39.200 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 106s ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:47:39.200 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 106s ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:47:39.200 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 106s ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:47:39.201 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 106s ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:47:39.201 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 104s ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:47:39.533 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:47:39.534 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:47:39.534 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:47:39.534 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:47:39.535 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:47:39.535 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:47:39.535 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:47:39.535 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:47:39.536 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:47:39.536 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:47:39.536 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:47:39.536 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:47:39.537 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:47:39.537 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:47:39.537 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:47:39.537 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:47:39.537 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:47:39.538 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:47:39.538 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:47:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:47:38.890333+0000 mgr.smithi067.rdualw (mgr.24569) 9012 : audit [DBG] from='client.40150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:47:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:39.176736+0000 mgr.smithi067.rdualw (mgr.24569) 9013 : cluster [DBG] pgmap v7763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:47:39.177775+0000 mgr.smithi067.rdualw (mgr.24569) 9014 : audit [DBG] from='client.40154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:47:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:47:39.532626+0000 mon.smithi061 (mon.0) 1932 : audit [DBG] from='client.? 172.21.15.61:0/529956597' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:47:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:47:38.890333+0000 mgr.smithi067.rdualw (mgr.24569) 9012 : audit [DBG] from='client.40150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:47:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:39.176736+0000 mgr.smithi067.rdualw (mgr.24569) 9013 : cluster [DBG] pgmap v7763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:47:39.177775+0000 mgr.smithi067.rdualw (mgr.24569) 9014 : audit [DBG] from='client.40154 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:47:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:47:39.532626+0000 mon.smithi061 (mon.0) 1932 : audit [DBG] from='client.? 172.21.15.61:0/529956597' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:47:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:41.177570+0000 mgr.smithi067.rdualw (mgr.24569) 9015 : cluster [DBG] pgmap v7764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:41.177570+0000 mgr.smithi067.rdualw (mgr.24569) 9015 : cluster [DBG] pgmap v7764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:43.178166+0000 mgr.smithi067.rdualw (mgr.24569) 9016 : cluster [DBG] pgmap v7765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:43.178166+0000 mgr.smithi067.rdualw (mgr.24569) 9016 : cluster [DBG] pgmap v7765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:45.178790+0000 mgr.smithi067.rdualw (mgr.24569) 9017 : cluster [DBG] pgmap v7766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:45.178790+0000 mgr.smithi067.rdualw (mgr.24569) 9017 : cluster [DBG] pgmap v7766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:47.179668+0000 mgr.smithi067.rdualw (mgr.24569) 9018 : cluster [DBG] pgmap v7767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:47:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:47.179668+0000 mgr.smithi067.rdualw (mgr.24569) 9018 : cluster [DBG] pgmap v7767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:47:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:49.180302+0000 mgr.smithi067.rdualw (mgr.24569) 9019 : cluster [DBG] pgmap v7768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:49.180302+0000 mgr.smithi067.rdualw (mgr.24569) 9019 : cluster [DBG] pgmap v7768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:51.181272+0000 mgr.smithi067.rdualw (mgr.24569) 9020 : cluster [DBG] pgmap v7769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:51.181272+0000 mgr.smithi067.rdualw (mgr.24569) 9020 : cluster [DBG] pgmap v7769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:53.182007+0000 mgr.smithi067.rdualw (mgr.24569) 9021 : cluster [DBG] pgmap v7770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:53.182007+0000 mgr.smithi067.rdualw (mgr.24569) 9021 : cluster [DBG] pgmap v7770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:55.182781+0000 mgr.smithi067.rdualw (mgr.24569) 9022 : cluster [DBG] pgmap v7771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:47:55.884309+0000 mon.smithi067 (mon.1) 1373 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:47:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:47:55.885733+0000 mon.smithi067 (mon.1) 1374 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:47:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:47:55.886698+0000 mon.smithi067 (mon.1) 1375 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:47:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:47:56.242292+0000 mon.smithi061 (mon.0) 1933 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:47:57.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:47:56.251070+0000 mon.smithi061 (mon.0) 1934 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:47:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:55.182781+0000 mgr.smithi067.rdualw (mgr.24569) 9022 : cluster [DBG] pgmap v7771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:47:57.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:47:55.884309+0000 mon.smithi067 (mon.1) 1373 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:47:57.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:47:55.885733+0000 mon.smithi067 (mon.1) 1374 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:47:57.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:47:55.886698+0000 mon.smithi067 (mon.1) 1375 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:47:57.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:47:56.242292+0000 mon.smithi061 (mon.0) 1933 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:47:57.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:47:56.251070+0000 mon.smithi061 (mon.0) 1934 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:47:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:47:55.887565+0000 mgr.smithi067.rdualw (mgr.24569) 9023 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:47:58.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:47:56.653332+0000 mon.smithi061 (mon.0) 1935 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:47:58.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:47:56.661085+0000 mon.smithi061 (mon.0) 1936 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:47:58.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:47:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:57.183899+0000 mgr.smithi067.rdualw (mgr.24569) 9024 : cluster [DBG] pgmap v7772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:47:58.304 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:47:55.887565+0000 mgr.smithi067.rdualw (mgr.24569) 9023 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:47:58.304 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:47:56.653332+0000 mon.smithi061 (mon.0) 1935 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:47:58.304 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:47:56.661085+0000 mon.smithi061 (mon.0) 1936 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:47:58.304 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:47:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:57.183899+0000 mgr.smithi067.rdualw (mgr.24569) 9024 : cluster [DBG] pgmap v7772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:48:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:47:59.184510+0000 mgr.smithi067.rdualw (mgr.24569) 9025 : cluster [DBG] pgmap v7773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:47:59.184510+0000 mgr.smithi067.rdualw (mgr.24569) 9025 : cluster [DBG] pgmap v7773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:01.185425+0000 mgr.smithi067.rdualw (mgr.24569) 9026 : cluster [DBG] pgmap v7774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:01.185425+0000 mgr.smithi067.rdualw (mgr.24569) 9026 : cluster [DBG] pgmap v7774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:03.186147+0000 mgr.smithi067.rdualw (mgr.24569) 9027 : cluster [DBG] pgmap v7775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:03.186147+0000 mgr.smithi067.rdualw (mgr.24569) 9027 : cluster [DBG] pgmap v7775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:07.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:05.186917+0000 mgr.smithi067.rdualw (mgr.24569) 9028 : cluster [DBG] pgmap v7776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:05.186917+0000 mgr.smithi067.rdualw (mgr.24569) 9028 : cluster [DBG] pgmap v7776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:07.187774+0000 mgr.smithi067.rdualw (mgr.24569) 9029 : cluster [DBG] pgmap v7777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:48:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:07.187774+0000 mgr.smithi067.rdualw (mgr.24569) 9029 : cluster [DBG] pgmap v7777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:48:09.912 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:48:10.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:09.188357+0000 mgr.smithi067.rdualw (mgr.24569) 9030 : cluster [DBG] pgmap v7778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:09.188357+0000 mgr.smithi067.rdualw (mgr.24569) 9030 : cluster [DBG] pgmap v7778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:10.201 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:48:10.202 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 2m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:48:10.202 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 2m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:48:10.202 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 2m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:48:10.203 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 2m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:48:10.203 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 2m ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:48:10.203 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 2m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:48:10.203 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 2m ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:48:10.204 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 2m ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:48:10.204 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 2m ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:48:10.204 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 2m ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:48:10.204 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 2m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:48:10.205 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 2m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:48:10.205 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 2m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:48:10.205 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 2m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:48:10.205 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 2m ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:48:10.205 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 2m ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:48:10.206 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 2m ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:48:10.206 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 2m ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:48:10.206 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 2m ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:48:10.207 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 2m ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:48:10.207 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 2m ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:48:10.207 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 2m ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:48:10.208 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 2m ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:48:10.549 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:48:10.549 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:48:10.550 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:48:10.550 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:48:10.550 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:48:10.550 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:48:10.551 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:48:10.551 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:48:10.551 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:48:10.551 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:48:10.551 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:48:10.552 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:48:10.552 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:48:10.552 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:48:10.552 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:48:10.552 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:48:10.553 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:48:10.553 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:48:10.553 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:48:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:48:09.899034+0000 mgr.smithi067.rdualw (mgr.24569) 9031 : audit [DBG] from='client.40162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:48:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:48:10.183566+0000 mgr.smithi067.rdualw (mgr.24569) 9032 : audit [DBG] from='client.40166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:48:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:48:10.547967+0000 mon.smithi061 (mon.0) 1937 : audit [DBG] from='client.? 172.21.15.61:0/1025974325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:48:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:48:09.899034+0000 mgr.smithi067.rdualw (mgr.24569) 9031 : audit [DBG] from='client.40162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:48:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:48:10.183566+0000 mgr.smithi067.rdualw (mgr.24569) 9032 : audit [DBG] from='client.40166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:48:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:48:10.547967+0000 mon.smithi061 (mon.0) 1937 : audit [DBG] from='client.? 172.21.15.61:0/1025974325' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:48:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:11.189187+0000 mgr.smithi067.rdualw (mgr.24569) 9033 : cluster [DBG] pgmap v7779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:11.189187+0000 mgr.smithi067.rdualw (mgr.24569) 9033 : cluster [DBG] pgmap v7779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:13.189861+0000 mgr.smithi067.rdualw (mgr.24569) 9034 : cluster [DBG] pgmap v7780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:13.189861+0000 mgr.smithi067.rdualw (mgr.24569) 9034 : cluster [DBG] pgmap v7780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:15.190665+0000 mgr.smithi067.rdualw (mgr.24569) 9035 : cluster [DBG] pgmap v7781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:15.190665+0000 mgr.smithi067.rdualw (mgr.24569) 9035 : cluster [DBG] pgmap v7781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:17.191553+0000 mgr.smithi067.rdualw (mgr.24569) 9036 : cluster [DBG] pgmap v7782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:48:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:17.191553+0000 mgr.smithi067.rdualw (mgr.24569) 9036 : cluster [DBG] pgmap v7782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:48:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:19.192124+0000 mgr.smithi067.rdualw (mgr.24569) 9037 : cluster [DBG] pgmap v7783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:19.192124+0000 mgr.smithi067.rdualw (mgr.24569) 9037 : cluster [DBG] pgmap v7783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:21.193000+0000 mgr.smithi067.rdualw (mgr.24569) 9038 : cluster [DBG] pgmap v7784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:21.193000+0000 mgr.smithi067.rdualw (mgr.24569) 9038 : cluster [DBG] pgmap v7784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:23.193618+0000 mgr.smithi067.rdualw (mgr.24569) 9039 : cluster [DBG] pgmap v7785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:23.193618+0000 mgr.smithi067.rdualw (mgr.24569) 9039 : cluster [DBG] pgmap v7785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:25.194328+0000 mgr.smithi067.rdualw (mgr.24569) 9040 : cluster [DBG] pgmap v7786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:25.194328+0000 mgr.smithi067.rdualw (mgr.24569) 9040 : cluster [DBG] pgmap v7786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:27.195368+0000 mgr.smithi067.rdualw (mgr.24569) 9041 : cluster [DBG] pgmap v7787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:48:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:27.195368+0000 mgr.smithi067.rdualw (mgr.24569) 9041 : cluster [DBG] pgmap v7787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:48:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:29.196012+0000 mgr.smithi067.rdualw (mgr.24569) 9042 : cluster [DBG] pgmap v7788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:29.196012+0000 mgr.smithi067.rdualw (mgr.24569) 9042 : cluster [DBG] pgmap v7788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:31.196955+0000 mgr.smithi067.rdualw (mgr.24569) 9043 : cluster [DBG] pgmap v7789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:31.196955+0000 mgr.smithi067.rdualw (mgr.24569) 9043 : cluster [DBG] pgmap v7789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:33.197490+0000 mgr.smithi067.rdualw (mgr.24569) 9044 : cluster [DBG] pgmap v7790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:33.197490+0000 mgr.smithi067.rdualw (mgr.24569) 9044 : cluster [DBG] pgmap v7790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:35.198111+0000 mgr.smithi067.rdualw (mgr.24569) 9045 : cluster [DBG] pgmap v7791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:48:35.871954+0000 mon.smithi067 (mon.1) 1376 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:48:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:48:35.872205+0000 mon.smithi067 (mon.1) 1377 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:48:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:48:35.872338+0000 mon.smithi061 (mon.0) 1938 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:48:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:48:35.872644+0000 mon.smithi061 (mon.0) 1939 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:48:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:35.198111+0000 mgr.smithi067.rdualw (mgr.24569) 9045 : cluster [DBG] pgmap v7791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:48:35.871954+0000 mon.smithi067 (mon.1) 1376 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:48:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:48:35.872205+0000 mon.smithi067 (mon.1) 1377 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:48:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:48:35.872338+0000 mon.smithi061 (mon.0) 1938 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:48:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:48:35.872644+0000 mon.smithi061 (mon.0) 1939 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:48:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:37.199044+0000 mgr.smithi067.rdualw (mgr.24569) 9046 : cluster [DBG] pgmap v7792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:48:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:37.199044+0000 mgr.smithi067.rdualw (mgr.24569) 9046 : cluster [DBG] pgmap v7792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:48:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:39.199639+0000 mgr.smithi067.rdualw (mgr.24569) 9047 : cluster [DBG] pgmap v7793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:39.199639+0000 mgr.smithi067.rdualw (mgr.24569) 9047 : cluster [DBG] pgmap v7793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:40.857 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:48:41.148 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:48:41.148 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 2m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:48:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 2m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:48:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 2m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:48:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 2m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:48:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 2m ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:48:41.149 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 2m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:48:41.150 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 2m ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:48:41.150 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 2m ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:48:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 2m ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:48:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 2m ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:48:41.151 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 2m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:48:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 2m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:48:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 2m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:48:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 2m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:48:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 2m ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:48:41.152 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 2m ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:48:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 2m ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:48:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 2m ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:48:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 2m ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:48:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 2m ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:48:41.153 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 2m ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:48:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 2m ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:48:41.154 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 2m ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:48:41.487 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:48:41.487 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:48:41.488 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:48:41.488 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:48:41.488 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:48:41.488 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:48:41.489 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:48:41.489 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:48:41.489 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:48:41.489 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:48:41.489 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:48:41.490 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:48:41.490 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:48:41.490 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:48:41.490 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:48:41.490 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:48:41.491 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:48:41.492 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:48:41.492 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:48:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:48:40.844564+0000 mgr.smithi067.rdualw (mgr.24569) 9048 : audit [DBG] from='client.40174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:48:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:48:41.130743+0000 mgr.smithi067.rdualw (mgr.24569) 9049 : audit [DBG] from='client.40178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:48:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:41.200480+0000 mgr.smithi067.rdualw (mgr.24569) 9050 : cluster [DBG] pgmap v7794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:48:41.486223+0000 mon.smithi061 (mon.0) 1940 : audit [DBG] from='client.? 172.21.15.61:0/3630065352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:48:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:48:40.844564+0000 mgr.smithi067.rdualw (mgr.24569) 9048 : audit [DBG] from='client.40174 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:48:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:48:41.130743+0000 mgr.smithi067.rdualw (mgr.24569) 9049 : audit [DBG] from='client.40178 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:48:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:41.200480+0000 mgr.smithi067.rdualw (mgr.24569) 9050 : cluster [DBG] pgmap v7794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:48:41.486223+0000 mon.smithi061 (mon.0) 1940 : audit [DBG] from='client.? 172.21.15.61:0/3630065352' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:48:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:43.201113+0000 mgr.smithi067.rdualw (mgr.24569) 9051 : cluster [DBG] pgmap v7795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:43.201113+0000 mgr.smithi067.rdualw (mgr.24569) 9051 : cluster [DBG] pgmap v7795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:45.201923+0000 mgr.smithi067.rdualw (mgr.24569) 9052 : cluster [DBG] pgmap v7796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:45.201923+0000 mgr.smithi067.rdualw (mgr.24569) 9052 : cluster [DBG] pgmap v7796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:47.202870+0000 mgr.smithi067.rdualw (mgr.24569) 9053 : cluster [DBG] pgmap v7797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:48:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:47.202870+0000 mgr.smithi067.rdualw (mgr.24569) 9053 : cluster [DBG] pgmap v7797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:48:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:49.203390+0000 mgr.smithi067.rdualw (mgr.24569) 9054 : cluster [DBG] pgmap v7798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:49.203390+0000 mgr.smithi067.rdualw (mgr.24569) 9054 : cluster [DBG] pgmap v7798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:51.204381+0000 mgr.smithi067.rdualw (mgr.24569) 9055 : cluster [DBG] pgmap v7799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:51.204381+0000 mgr.smithi067.rdualw (mgr.24569) 9055 : cluster [DBG] pgmap v7799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:53.205034+0000 mgr.smithi067.rdualw (mgr.24569) 9056 : cluster [DBG] pgmap v7800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:53.205034+0000 mgr.smithi067.rdualw (mgr.24569) 9056 : cluster [DBG] pgmap v7800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:55.205668+0000 mgr.smithi067.rdualw (mgr.24569) 9057 : cluster [DBG] pgmap v7801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:55.205668+0000 mgr.smithi067.rdualw (mgr.24569) 9057 : cluster [DBG] pgmap v7801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:48:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:48:56.665147+0000 mon.smithi067 (mon.1) 1378 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:48:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:48:56.666557+0000 mon.smithi067 (mon.1) 1379 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:48:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:48:56.667524+0000 mon.smithi067 (mon.1) 1380 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:48:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:48:57.081891+0000 mon.smithi061 (mon.0) 1941 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:48:58.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:48:57.089414+0000 mon.smithi061 (mon.0) 1942 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:48:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:48:56.665147+0000 mon.smithi067 (mon.1) 1378 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:48:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:48:56.666557+0000 mon.smithi067 (mon.1) 1379 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:48:58.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:48:56.667524+0000 mon.smithi067 (mon.1) 1380 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:48:58.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:48:57.081891+0000 mon.smithi061 (mon.0) 1941 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:48:58.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:48:57.089414+0000 mon.smithi061 (mon.0) 1942 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:48:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:48:56.668407+0000 mgr.smithi067.rdualw (mgr.24569) 9058 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:48:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:48:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:57.206390+0000 mgr.smithi067.rdualw (mgr.24569) 9059 : cluster [DBG] pgmap v7802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:48:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:48:56.668407+0000 mgr.smithi067.rdualw (mgr.24569) 9058 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:48:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:48:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:57.206390+0000 mgr.smithi067.rdualw (mgr.24569) 9059 : cluster [DBG] pgmap v7802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:49:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:48:59.207075+0000 mgr.smithi067.rdualw (mgr.24569) 9060 : cluster [DBG] pgmap v7803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:48:59.207075+0000 mgr.smithi067.rdualw (mgr.24569) 9060 : cluster [DBG] pgmap v7803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:01.208056+0000 mgr.smithi067.rdualw (mgr.24569) 9061 : cluster [DBG] pgmap v7804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:01.208056+0000 mgr.smithi067.rdualw (mgr.24569) 9061 : cluster [DBG] pgmap v7804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:03.208495+0000 mgr.smithi067.rdualw (mgr.24569) 9062 : cluster [DBG] pgmap v7805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:03.208495+0000 mgr.smithi067.rdualw (mgr.24569) 9062 : cluster [DBG] pgmap v7805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:05.209099+0000 mgr.smithi067.rdualw (mgr.24569) 9063 : cluster [DBG] pgmap v7806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:05.209099+0000 mgr.smithi067.rdualw (mgr.24569) 9063 : cluster [DBG] pgmap v7806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:07.210074+0000 mgr.smithi067.rdualw (mgr.24569) 9064 : cluster [DBG] pgmap v7807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:49:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:07.210074+0000 mgr.smithi067.rdualw (mgr.24569) 9064 : cluster [DBG] pgmap v7807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:49:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:09.210805+0000 mgr.smithi067.rdualw (mgr.24569) 9065 : cluster [DBG] pgmap v7808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:09.210805+0000 mgr.smithi067.rdualw (mgr.24569) 9065 : cluster [DBG] pgmap v7808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:11.803 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:49:12.094 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:49:12.095 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 3m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:49:12.095 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 3m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:49:12.095 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 3m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:49:12.095 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 3m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:49:12.095 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 3m ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:49:12.096 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 3m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:49:12.096 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 3m ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:49:12.096 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 3m ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:49:12.096 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 3m ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:49:12.097 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 3m ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:49:12.097 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 3m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:49:12.097 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 3m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:49:12.097 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 3m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:49:12.098 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 3m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:49:12.098 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 3m ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:49:12.098 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 3m ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:49:12.098 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 3m ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:49:12.099 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 3m ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:49:12.099 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 3m ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:49:12.099 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 3m ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:49:12.099 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 3m ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:49:12.099 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 3m ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:49:12.100 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 3m ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:49:12.437 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:49:12.437 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:49:12.438 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:49:12.438 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:49:12.438 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:49:12.438 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:49:12.439 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:49:12.439 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:49:12.439 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:49:12.439 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:49:12.440 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:49:12.440 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:49:12.440 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:49:12.440 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:49:12.441 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:49:12.441 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:49:12.441 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:49:12.441 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:49:12.441 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:49:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:11.211933+0000 mgr.smithi067.rdualw (mgr.24569) 9066 : cluster [DBG] pgmap v7809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:49:12.436204+0000 mon.smithi061 (mon.0) 1943 : audit [DBG] from='client.? 172.21.15.61:0/3444446826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:49:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:11.211933+0000 mgr.smithi067.rdualw (mgr.24569) 9066 : cluster [DBG] pgmap v7809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:49:12.436204+0000 mon.smithi061 (mon.0) 1943 : audit [DBG] from='client.? 172.21.15.61:0/3444446826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:49:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:49:11.789383+0000 mgr.smithi067.rdualw (mgr.24569) 9067 : audit [DBG] from='client.40186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:49:14.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:49:12.076896+0000 mgr.smithi067.rdualw (mgr.24569) 9068 : audit [DBG] from='client.40190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:49:14.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:49:11.789383+0000 mgr.smithi067.rdualw (mgr.24569) 9067 : audit [DBG] from='client.40186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:49:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:49:12.076896+0000 mgr.smithi067.rdualw (mgr.24569) 9068 : audit [DBG] from='client.40190 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:49:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:13.212548+0000 mgr.smithi067.rdualw (mgr.24569) 9069 : cluster [DBG] pgmap v7810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:13.212548+0000 mgr.smithi067.rdualw (mgr.24569) 9069 : cluster [DBG] pgmap v7810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:15.213130+0000 mgr.smithi067.rdualw (mgr.24569) 9070 : cluster [DBG] pgmap v7811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:15.213130+0000 mgr.smithi067.rdualw (mgr.24569) 9070 : cluster [DBG] pgmap v7811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:17.213948+0000 mgr.smithi067.rdualw (mgr.24569) 9071 : cluster [DBG] pgmap v7812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:49:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:17.213948+0000 mgr.smithi067.rdualw (mgr.24569) 9071 : cluster [DBG] pgmap v7812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:49:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:19.214756+0000 mgr.smithi067.rdualw (mgr.24569) 9072 : cluster [DBG] pgmap v7813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:19.214756+0000 mgr.smithi067.rdualw (mgr.24569) 9072 : cluster [DBG] pgmap v7813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:21.215624+0000 mgr.smithi067.rdualw (mgr.24569) 9073 : cluster [DBG] pgmap v7814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:21.215624+0000 mgr.smithi067.rdualw (mgr.24569) 9073 : cluster [DBG] pgmap v7814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:24.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:23.216107+0000 mgr.smithi067.rdualw (mgr.24569) 9074 : cluster [DBG] pgmap v7815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:23.216107+0000 mgr.smithi067.rdualw (mgr.24569) 9074 : cluster [DBG] pgmap v7815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:25.216719+0000 mgr.smithi067.rdualw (mgr.24569) 9075 : cluster [DBG] pgmap v7816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:25.216719+0000 mgr.smithi067.rdualw (mgr.24569) 9075 : cluster [DBG] pgmap v7816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:27.217746+0000 mgr.smithi067.rdualw (mgr.24569) 9076 : cluster [DBG] pgmap v7817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:49:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:27.217746+0000 mgr.smithi067.rdualw (mgr.24569) 9076 : cluster [DBG] pgmap v7817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:49:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:29.218509+0000 mgr.smithi067.rdualw (mgr.24569) 9077 : cluster [DBG] pgmap v7818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:29.218509+0000 mgr.smithi067.rdualw (mgr.24569) 9077 : cluster [DBG] pgmap v7818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:31.219564+0000 mgr.smithi067.rdualw (mgr.24569) 9078 : cluster [DBG] pgmap v7819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:31.219564+0000 mgr.smithi067.rdualw (mgr.24569) 9078 : cluster [DBG] pgmap v7819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:33.220093+0000 mgr.smithi067.rdualw (mgr.24569) 9079 : cluster [DBG] pgmap v7820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:33.220093+0000 mgr.smithi067.rdualw (mgr.24569) 9079 : cluster [DBG] pgmap v7820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:35.220669+0000 mgr.smithi067.rdualw (mgr.24569) 9080 : cluster [DBG] pgmap v7821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:49:35.877325+0000 mon.smithi067 (mon.1) 1381 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:49:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:49:35.877584+0000 mon.smithi067 (mon.1) 1382 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:49:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:49:35.877755+0000 mon.smithi061 (mon.0) 1944 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:49:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:49:35.878214+0000 mon.smithi061 (mon.0) 1945 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:49:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:35.220669+0000 mgr.smithi067.rdualw (mgr.24569) 9080 : cluster [DBG] pgmap v7821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:49:35.877325+0000 mon.smithi067 (mon.1) 1381 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:49:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:49:35.877584+0000 mon.smithi067 (mon.1) 1382 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:49:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:49:35.877755+0000 mon.smithi061 (mon.0) 1944 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:49:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:49:35.878214+0000 mon.smithi061 (mon.0) 1945 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:49:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:37.221678+0000 mgr.smithi067.rdualw (mgr.24569) 9081 : cluster [DBG] pgmap v7822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:49:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:37.221678+0000 mgr.smithi067.rdualw (mgr.24569) 9081 : cluster [DBG] pgmap v7822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:49:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:39.222267+0000 mgr.smithi067.rdualw (mgr.24569) 9082 : cluster [DBG] pgmap v7823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:39.222267+0000 mgr.smithi067.rdualw (mgr.24569) 9082 : cluster [DBG] pgmap v7823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:42.750 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:49:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:41.223195+0000 mgr.smithi067.rdualw (mgr.24569) 9083 : cluster [DBG] pgmap v7824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:41.223195+0000 mgr.smithi067.rdualw (mgr.24569) 9083 : cluster [DBG] pgmap v7824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:43.123 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:49:43.123 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 3m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:49:43.124 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 3m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:49:43.124 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 3m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:49:43.124 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 3m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:49:43.124 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 3m ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:49:43.124 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 3m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:49:43.125 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 3m ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:49:43.125 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 3m ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:49:43.125 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 3m ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:49:43.125 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 3m ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:49:43.126 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 3m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:49:43.126 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 3m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:49:43.126 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 3m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:49:43.126 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 3m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:49:43.126 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 3m ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:49:43.127 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 3m ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:49:43.127 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 3m ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:49:43.127 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 3m ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:49:43.127 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 3m ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:49:43.127 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 3m ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:49:43.128 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 3m ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:49:43.128 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 3m ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:49:43.128 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 3m ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:49:43.468 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:49:43.469 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:49:43.469 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:49:43.469 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:49:43.469 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:49:43.470 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:49:43.470 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:49:43.470 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:49:43.470 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:49:43.471 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:49:43.471 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:49:43.471 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:49:43.471 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:49:43.471 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:49:43.472 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:49:43.472 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:49:43.472 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:49:43.472 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:49:43.472 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:49:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:49:43.467372+0000 mon.smithi061 (mon.0) 1946 : audit [DBG] from='client.? 172.21.15.61:0/818650914' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:49:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:49:43.467372+0000 mon.smithi061 (mon.0) 1946 : audit [DBG] from='client.? 172.21.15.61:0/818650914' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:49:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:49:42.736682+0000 mgr.smithi067.rdualw (mgr.24569) 9084 : audit [DBG] from='client.40198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:49:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:49:43.105781+0000 mgr.smithi067.rdualw (mgr.24569) 9085 : audit [DBG] from='client.40202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:49:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:43.223874+0000 mgr.smithi067.rdualw (mgr.24569) 9086 : cluster [DBG] pgmap v7825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:49:42.736682+0000 mgr.smithi067.rdualw (mgr.24569) 9084 : audit [DBG] from='client.40198 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:49:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:49:43.105781+0000 mgr.smithi067.rdualw (mgr.24569) 9085 : audit [DBG] from='client.40202 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:49:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:43.223874+0000 mgr.smithi067.rdualw (mgr.24569) 9086 : cluster [DBG] pgmap v7825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:45.224411+0000 mgr.smithi067.rdualw (mgr.24569) 9087 : cluster [DBG] pgmap v7826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:45.224411+0000 mgr.smithi067.rdualw (mgr.24569) 9087 : cluster [DBG] pgmap v7826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:47.225353+0000 mgr.smithi067.rdualw (mgr.24569) 9088 : cluster [DBG] pgmap v7827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:49:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:47.225353+0000 mgr.smithi067.rdualw (mgr.24569) 9088 : cluster [DBG] pgmap v7827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:49:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:49.226056+0000 mgr.smithi067.rdualw (mgr.24569) 9089 : cluster [DBG] pgmap v7828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:49.226056+0000 mgr.smithi067.rdualw (mgr.24569) 9089 : cluster [DBG] pgmap v7828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:51.226987+0000 mgr.smithi067.rdualw (mgr.24569) 9090 : cluster [DBG] pgmap v7829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:51.226987+0000 mgr.smithi067.rdualw (mgr.24569) 9090 : cluster [DBG] pgmap v7829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:53.227723+0000 mgr.smithi067.rdualw (mgr.24569) 9091 : cluster [DBG] pgmap v7830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:53.227723+0000 mgr.smithi067.rdualw (mgr.24569) 9091 : cluster [DBG] pgmap v7830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:55.228517+0000 mgr.smithi067.rdualw (mgr.24569) 9092 : cluster [DBG] pgmap v7831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:55.228517+0000 mgr.smithi067.rdualw (mgr.24569) 9092 : cluster [DBG] pgmap v7831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:49:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:49:57.092980+0000 mon.smithi067 (mon.1) 1383 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:49:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:49:57.094475+0000 mon.smithi067 (mon.1) 1384 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:49:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:49:57.095420+0000 mon.smithi067 (mon.1) 1385 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:49:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:49:57.504676+0000 mon.smithi061 (mon.0) 1947 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:49:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:49:57.510916+0000 mon.smithi061 (mon.0) 1948 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:49:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:49:57.092980+0000 mon.smithi067 (mon.1) 1383 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:49:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:49:57.094475+0000 mon.smithi067 (mon.1) 1384 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:49:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:49:57.095420+0000 mon.smithi067 (mon.1) 1385 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:49:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:49:57.504676+0000 mon.smithi061 (mon.0) 1947 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:49:58.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:49:57.510916+0000 mon.smithi061 (mon.0) 1948 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:49:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:49:57.096274+0000 mgr.smithi067.rdualw (mgr.24569) 9093 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:49:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:49:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:57.229250+0000 mgr.smithi067.rdualw (mgr.24569) 9094 : cluster [DBG] pgmap v7832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:49:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:49:57.096274+0000 mgr.smithi067.rdualw (mgr.24569) 9093 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:49:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:49:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:57.229250+0000 mgr.smithi067.rdualw (mgr.24569) 9094 : cluster [DBG] pgmap v7832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:50:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:49:59.229964+0000 mgr.smithi067.rdualw (mgr.24569) 9095 : cluster [DBG] pgmap v7833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:00.000159+0000 mon.smithi061 (mon.0) 1949 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T19:50:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:49:59.229964+0000 mgr.smithi067.rdualw (mgr.24569) 9095 : cluster [DBG] pgmap v7833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:00.000159+0000 mon.smithi061 (mon.0) 1949 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T19:50:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:01.230876+0000 mgr.smithi067.rdualw (mgr.24569) 9096 : cluster [DBG] pgmap v7834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:01.230876+0000 mgr.smithi067.rdualw (mgr.24569) 9096 : cluster [DBG] pgmap v7834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:03.231330+0000 mgr.smithi067.rdualw (mgr.24569) 9097 : cluster [DBG] pgmap v7835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:03.231330+0000 mgr.smithi067.rdualw (mgr.24569) 9097 : cluster [DBG] pgmap v7835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:07.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:05.231963+0000 mgr.smithi067.rdualw (mgr.24569) 9098 : cluster [DBG] pgmap v7836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:05.231963+0000 mgr.smithi067.rdualw (mgr.24569) 9098 : cluster [DBG] pgmap v7836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:07.232873+0000 mgr.smithi067.rdualw (mgr.24569) 9099 : cluster [DBG] pgmap v7837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:50:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:07.232873+0000 mgr.smithi067.rdualw (mgr.24569) 9099 : cluster [DBG] pgmap v7837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:50:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:09.233412+0000 mgr.smithi067.rdualw (mgr.24569) 9100 : cluster [DBG] pgmap v7838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:09.233412+0000 mgr.smithi067.rdualw (mgr.24569) 9100 : cluster [DBG] pgmap v7838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:11.234314+0000 mgr.smithi067.rdualw (mgr.24569) 9101 : cluster [DBG] pgmap v7839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:11.234314+0000 mgr.smithi067.rdualw (mgr.24569) 9101 : cluster [DBG] pgmap v7839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:13.780 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:50:14.071 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:50:14.071 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 4m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:50:14.072 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 4m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:50:14.072 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 4m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:50:14.072 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 4m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:50:14.072 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 4m ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:50:14.073 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 4m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:50:14.073 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 4m ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:50:14.073 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 4m ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:50:14.074 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 4m ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:50:14.074 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 4m ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:50:14.074 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 4m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:50:14.074 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 4m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:50:14.074 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 4m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:50:14.075 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 4m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:50:14.075 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 4m ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:50:14.075 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 4m ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:50:14.075 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 4m ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:50:14.076 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 4m ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:50:14.076 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 4m ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:50:14.076 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 4m ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:50:14.077 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 4m ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:50:14.077 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 4m ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:50:14.077 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 4m ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:50:14.411 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:50:14.412 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:50:14.412 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:50:14.412 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:50:14.413 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:50:14.413 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:50:14.413 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:50:14.413 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:50:14.414 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:50:14.414 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:50:14.414 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:50:14.414 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:50:14.415 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:50:14.415 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:50:14.415 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:50:14.415 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:50:14.416 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:50:14.416 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:50:14.416 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:50:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:13.234972+0000 mgr.smithi067.rdualw (mgr.24569) 9102 : cluster [DBG] pgmap v7840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:50:14.410439+0000 mon.smithi061 (mon.0) 1950 : audit [DBG] from='client.? 172.21.15.61:0/3973259571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:50:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:13.234972+0000 mgr.smithi067.rdualw (mgr.24569) 9102 : cluster [DBG] pgmap v7840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:50:14.410439+0000 mon.smithi061 (mon.0) 1950 : audit [DBG] from='client.? 172.21.15.61:0/3973259571' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:50:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:50:13.766377+0000 mgr.smithi067.rdualw (mgr.24569) 9103 : audit [DBG] from='client.40210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:50:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:50:14.053660+0000 mgr.smithi067.rdualw (mgr.24569) 9104 : audit [DBG] from='client.40214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:50:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:50:13.766377+0000 mgr.smithi067.rdualw (mgr.24569) 9103 : audit [DBG] from='client.40210 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:50:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:50:14.053660+0000 mgr.smithi067.rdualw (mgr.24569) 9104 : audit [DBG] from='client.40214 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:50:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:15.235679+0000 mgr.smithi067.rdualw (mgr.24569) 9105 : cluster [DBG] pgmap v7841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:15.235679+0000 mgr.smithi067.rdualw (mgr.24569) 9105 : cluster [DBG] pgmap v7841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:17.236704+0000 mgr.smithi067.rdualw (mgr.24569) 9106 : cluster [DBG] pgmap v7842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:50:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:17.236704+0000 mgr.smithi067.rdualw (mgr.24569) 9106 : cluster [DBG] pgmap v7842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:50:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:19.237292+0000 mgr.smithi067.rdualw (mgr.24569) 9107 : cluster [DBG] pgmap v7843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:19.237292+0000 mgr.smithi067.rdualw (mgr.24569) 9107 : cluster [DBG] pgmap v7843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:21.238228+0000 mgr.smithi067.rdualw (mgr.24569) 9108 : cluster [DBG] pgmap v7844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:21.238228+0000 mgr.smithi067.rdualw (mgr.24569) 9108 : cluster [DBG] pgmap v7844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:23.238766+0000 mgr.smithi067.rdualw (mgr.24569) 9109 : cluster [DBG] pgmap v7845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:23.238766+0000 mgr.smithi067.rdualw (mgr.24569) 9109 : cluster [DBG] pgmap v7845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:25.239452+0000 mgr.smithi067.rdualw (mgr.24569) 9110 : cluster [DBG] pgmap v7846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:25.239452+0000 mgr.smithi067.rdualw (mgr.24569) 9110 : cluster [DBG] pgmap v7846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:27.240438+0000 mgr.smithi067.rdualw (mgr.24569) 9111 : cluster [DBG] pgmap v7847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:50:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:27.240438+0000 mgr.smithi067.rdualw (mgr.24569) 9111 : cluster [DBG] pgmap v7847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:50:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:29.241080+0000 mgr.smithi067.rdualw (mgr.24569) 9112 : cluster [DBG] pgmap v7848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:29.241080+0000 mgr.smithi067.rdualw (mgr.24569) 9112 : cluster [DBG] pgmap v7848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:31.242023+0000 mgr.smithi067.rdualw (mgr.24569) 9113 : cluster [DBG] pgmap v7849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:31.242023+0000 mgr.smithi067.rdualw (mgr.24569) 9113 : cluster [DBG] pgmap v7849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:33.242661+0000 mgr.smithi067.rdualw (mgr.24569) 9114 : cluster [DBG] pgmap v7850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:33.242661+0000 mgr.smithi067.rdualw (mgr.24569) 9114 : cluster [DBG] pgmap v7850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:35.243208+0000 mgr.smithi067.rdualw (mgr.24569) 9115 : cluster [DBG] pgmap v7851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:50:35.882303+0000 mon.smithi067 (mon.1) 1386 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:50:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:50:35.882663+0000 mon.smithi067 (mon.1) 1387 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:50:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:50:35.882745+0000 mon.smithi061 (mon.0) 1951 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:50:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:50:35.882981+0000 mon.smithi061 (mon.0) 1952 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:50:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:35.243208+0000 mgr.smithi067.rdualw (mgr.24569) 9115 : cluster [DBG] pgmap v7851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:50:35.882303+0000 mon.smithi067 (mon.1) 1386 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:50:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:50:35.882663+0000 mon.smithi067 (mon.1) 1387 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:50:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:50:35.882745+0000 mon.smithi061 (mon.0) 1951 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:50:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:50:35.882981+0000 mon.smithi061 (mon.0) 1952 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:50:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:37.244193+0000 mgr.smithi067.rdualw (mgr.24569) 9116 : cluster [DBG] pgmap v7852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:50:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:37.244193+0000 mgr.smithi067.rdualw (mgr.24569) 9116 : cluster [DBG] pgmap v7852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:50:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:39.244937+0000 mgr.smithi067.rdualw (mgr.24569) 9117 : cluster [DBG] pgmap v7853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:39.244937+0000 mgr.smithi067.rdualw (mgr.24569) 9117 : cluster [DBG] pgmap v7853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:41.245801+0000 mgr.smithi067.rdualw (mgr.24569) 9118 : cluster [DBG] pgmap v7854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:41.245801+0000 mgr.smithi067.rdualw (mgr.24569) 9118 : cluster [DBG] pgmap v7854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:44.725 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:50:45.021 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:50:45.021 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 4m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:50:45.021 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 4m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:50:45.022 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 4m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:50:45.022 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 4m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:50:45.022 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 4m ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:50:45.022 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 4m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:50:45.022 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 4m ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:50:45.023 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 4m ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:50:45.023 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 4m ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:50:45.023 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 4m ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:50:45.023 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 4m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:50:45.024 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 4m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:50:45.024 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 4m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:50:45.024 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 4m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:50:45.024 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 4m ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:50:45.024 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 4m ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:50:45.025 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 4m ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:50:45.025 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 4m ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:50:45.025 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 4m ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:50:45.025 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 4m ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:50:45.026 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 4m ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:50:45.026 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 4m ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:50:45.026 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 4m ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:50:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:43.246449+0000 mgr.smithi067.rdualw (mgr.24569) 9119 : cluster [DBG] pgmap v7855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:43.246449+0000 mgr.smithi067.rdualw (mgr.24569) 9119 : cluster [DBG] pgmap v7855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:45.383 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:50:45.383 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:50:45.383 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:50:45.384 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:50:45.384 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:50:45.384 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:50:45.384 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:50:45.385 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:50:45.385 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:50:45.385 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:50:45.385 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:50:45.385 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:50:45.386 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:50:45.386 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:50:45.386 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:50:45.386 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:50:45.386 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:50:45.387 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:50:45.387 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:50:46.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:50:45.381988+0000 mon.smithi061 (mon.0) 1953 : audit [DBG] from='client.? 172.21.15.61:0/2401622768' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:50:46.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:50:45.381988+0000 mon.smithi061 (mon.0) 1953 : audit [DBG] from='client.? 172.21.15.61:0/2401622768' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:50:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:50:44.711656+0000 mgr.smithi067.rdualw (mgr.24569) 9120 : audit [DBG] from='client.40222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:50:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:50:45.003515+0000 mgr.smithi067.rdualw (mgr.24569) 9121 : audit [DBG] from='client.40226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:50:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:45.247149+0000 mgr.smithi067.rdualw (mgr.24569) 9122 : cluster [DBG] pgmap v7856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:50:44.711656+0000 mgr.smithi067.rdualw (mgr.24569) 9120 : audit [DBG] from='client.40222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:50:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:50:45.003515+0000 mgr.smithi067.rdualw (mgr.24569) 9121 : audit [DBG] from='client.40226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:50:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:45.247149+0000 mgr.smithi067.rdualw (mgr.24569) 9122 : cluster [DBG] pgmap v7856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:47.248045+0000 mgr.smithi067.rdualw (mgr.24569) 9123 : cluster [DBG] pgmap v7857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:50:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:47.248045+0000 mgr.smithi067.rdualw (mgr.24569) 9123 : cluster [DBG] pgmap v7857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:50:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:49.248806+0000 mgr.smithi067.rdualw (mgr.24569) 9124 : cluster [DBG] pgmap v7858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:49.248806+0000 mgr.smithi067.rdualw (mgr.24569) 9124 : cluster [DBG] pgmap v7858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:51.249761+0000 mgr.smithi067.rdualw (mgr.24569) 9125 : cluster [DBG] pgmap v7859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:51.249761+0000 mgr.smithi067.rdualw (mgr.24569) 9125 : cluster [DBG] pgmap v7859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:53.250349+0000 mgr.smithi067.rdualw (mgr.24569) 9126 : cluster [DBG] pgmap v7860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:53.250349+0000 mgr.smithi067.rdualw (mgr.24569) 9126 : cluster [DBG] pgmap v7860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:55.251189+0000 mgr.smithi067.rdualw (mgr.24569) 9127 : cluster [DBG] pgmap v7861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:57.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:55.251189+0000 mgr.smithi067.rdualw (mgr.24569) 9127 : cluster [DBG] pgmap v7861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:50:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:50:57.514633+0000 mon.smithi067 (mon.1) 1388 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:50:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:50:57.516084+0000 mon.smithi067 (mon.1) 1389 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:50:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:50:57.517018+0000 mon.smithi067 (mon.1) 1390 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:50:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:50:57.514633+0000 mon.smithi067 (mon.1) 1388 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:50:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:50:57.516084+0000 mon.smithi067 (mon.1) 1389 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:50:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:50:57.517018+0000 mon.smithi067 (mon.1) 1390 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:50:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:57.252040+0000 mgr.smithi067.rdualw (mgr.24569) 9128 : cluster [DBG] pgmap v7862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:50:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:50:57.517878+0000 mgr.smithi067.rdualw (mgr.24569) 9129 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:50:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:50:57.937132+0000 mon.smithi061 (mon.0) 1954 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:50:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:50:57.944823+0000 mon.smithi061 (mon.0) 1955 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:50:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:57.252040+0000 mgr.smithi067.rdualw (mgr.24569) 9128 : cluster [DBG] pgmap v7862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:50:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:50:57.517878+0000 mgr.smithi067.rdualw (mgr.24569) 9129 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:50:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:50:57.937132+0000 mon.smithi061 (mon.0) 1954 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:50:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:50:57.944823+0000 mon.smithi061 (mon.0) 1955 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:51:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:50:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:50:59.252746+0000 mgr.smithi067.rdualw (mgr.24569) 9130 : cluster [DBG] pgmap v7863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:50:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:50:59.252746+0000 mgr.smithi067.rdualw (mgr.24569) 9130 : cluster [DBG] pgmap v7863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:01.253746+0000 mgr.smithi067.rdualw (mgr.24569) 9131 : cluster [DBG] pgmap v7864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:01.253746+0000 mgr.smithi067.rdualw (mgr.24569) 9131 : cluster [DBG] pgmap v7864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:03.254260+0000 mgr.smithi067.rdualw (mgr.24569) 9132 : cluster [DBG] pgmap v7865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:03.254260+0000 mgr.smithi067.rdualw (mgr.24569) 9132 : cluster [DBG] pgmap v7865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:07.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:05.254929+0000 mgr.smithi067.rdualw (mgr.24569) 9133 : cluster [DBG] pgmap v7866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:05.254929+0000 mgr.smithi067.rdualw (mgr.24569) 9133 : cluster [DBG] pgmap v7866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:07.255874+0000 mgr.smithi067.rdualw (mgr.24569) 9134 : cluster [DBG] pgmap v7867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:51:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:07.255874+0000 mgr.smithi067.rdualw (mgr.24569) 9134 : cluster [DBG] pgmap v7867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:51:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:09.256528+0000 mgr.smithi067.rdualw (mgr.24569) 9135 : cluster [DBG] pgmap v7868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:09.256528+0000 mgr.smithi067.rdualw (mgr.24569) 9135 : cluster [DBG] pgmap v7868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:11.257514+0000 mgr.smithi067.rdualw (mgr.24569) 9136 : cluster [DBG] pgmap v7869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:11.257514+0000 mgr.smithi067.rdualw (mgr.24569) 9136 : cluster [DBG] pgmap v7869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:13.258081+0000 mgr.smithi067.rdualw (mgr.24569) 9137 : cluster [DBG] pgmap v7870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:13.258081+0000 mgr.smithi067.rdualw (mgr.24569) 9137 : cluster [DBG] pgmap v7870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:15.700 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:51:16.017 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:51:16.018 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 5m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:51:16.018 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 5m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:51:16.018 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 5m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:51:16.018 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 5m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:51:16.019 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 5m ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:51:16.019 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 5m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:51:16.019 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 5m ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:51:16.019 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 5m ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:51:16.019 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 5m ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:51:16.020 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 5m ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:51:16.020 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 5m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:51:16.020 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 5m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:51:16.020 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 5m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:51:16.021 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 5m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:51:16.021 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 5m ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:51:16.021 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 5m ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:51:16.021 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 5m ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:51:16.021 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 5m ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:51:16.022 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 5m ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:51:16.022 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 5m ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:51:16.022 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 5m ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:51:16.022 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 5m ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:51:16.023 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 5m ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:51:16.362 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:51:16.363 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:51:16.363 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:51:16.363 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:51:16.363 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:51:16.364 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:51:16.364 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:51:16.364 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:51:16.364 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:51:16.364 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:51:16.365 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:51:16.365 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:51:16.365 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:51:16.365 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:51:16.366 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:51:16.366 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:51:16.366 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:51:16.366 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:51:16.366 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:51:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:15.258887+0000 mgr.smithi067.rdualw (mgr.24569) 9138 : cluster [DBG] pgmap v7871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:51:16.361281+0000 mon.smithi061 (mon.0) 1956 : audit [DBG] from='client.? 172.21.15.61:0/2188918798' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:51:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:15.258887+0000 mgr.smithi067.rdualw (mgr.24569) 9138 : cluster [DBG] pgmap v7871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:51:16.361281+0000 mon.smithi061 (mon.0) 1956 : audit [DBG] from='client.? 172.21.15.61:0/2188918798' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:51:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:51:15.687413+0000 mgr.smithi067.rdualw (mgr.24569) 9139 : audit [DBG] from='client.40234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:51:18.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:51:15.999921+0000 mgr.smithi067.rdualw (mgr.24569) 9140 : audit [DBG] from='client.40238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:51:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:51:15.687413+0000 mgr.smithi067.rdualw (mgr.24569) 9139 : audit [DBG] from='client.40234 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:51:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:51:15.999921+0000 mgr.smithi067.rdualw (mgr.24569) 9140 : audit [DBG] from='client.40238 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:51:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:17.259766+0000 mgr.smithi067.rdualw (mgr.24569) 9141 : cluster [DBG] pgmap v7872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:51:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:17.259766+0000 mgr.smithi067.rdualw (mgr.24569) 9141 : cluster [DBG] pgmap v7872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:51:20.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:19.260480+0000 mgr.smithi067.rdualw (mgr.24569) 9142 : cluster [DBG] pgmap v7873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:19.260480+0000 mgr.smithi067.rdualw (mgr.24569) 9142 : cluster [DBG] pgmap v7873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:21.261406+0000 mgr.smithi067.rdualw (mgr.24569) 9143 : cluster [DBG] pgmap v7874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:21.261406+0000 mgr.smithi067.rdualw (mgr.24569) 9143 : cluster [DBG] pgmap v7874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:23.262002+0000 mgr.smithi067.rdualw (mgr.24569) 9144 : cluster [DBG] pgmap v7875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:23.262002+0000 mgr.smithi067.rdualw (mgr.24569) 9144 : cluster [DBG] pgmap v7875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:25.262821+0000 mgr.smithi067.rdualw (mgr.24569) 9145 : cluster [DBG] pgmap v7876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:51:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:25.262821+0000 mgr.smithi067.rdualw (mgr.24569) 9145 : cluster [DBG] pgmap v7876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:51:29.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:27.263795+0000 mgr.smithi067.rdualw (mgr.24569) 9146 : cluster [DBG] pgmap v7877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:51:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:27.263795+0000 mgr.smithi067.rdualw (mgr.24569) 9146 : cluster [DBG] pgmap v7877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:51:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:29.264393+0000 mgr.smithi067.rdualw (mgr.24569) 9147 : cluster [DBG] pgmap v7878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:29.264393+0000 mgr.smithi067.rdualw (mgr.24569) 9147 : cluster [DBG] pgmap v7878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:31.265287+0000 mgr.smithi067.rdualw (mgr.24569) 9148 : cluster [DBG] pgmap v7879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:31.265287+0000 mgr.smithi067.rdualw (mgr.24569) 9148 : cluster [DBG] pgmap v7879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:33.265914+0000 mgr.smithi067.rdualw (mgr.24569) 9149 : cluster [DBG] pgmap v7880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:33.265914+0000 mgr.smithi067.rdualw (mgr.24569) 9149 : cluster [DBG] pgmap v7880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:35.266807+0000 mgr.smithi067.rdualw (mgr.24569) 9150 : cluster [DBG] pgmap v7881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:51:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:51:35.887691+0000 mon.smithi067 (mon.1) 1391 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:51:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:51:35.888081+0000 mon.smithi061 (mon.0) 1957 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:51:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:51:35.888313+0000 mon.smithi067 (mon.1) 1392 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:51:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:51:35.888630+0000 mon.smithi061 (mon.0) 1958 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:51:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:35.266807+0000 mgr.smithi067.rdualw (mgr.24569) 9150 : cluster [DBG] pgmap v7881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:51:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:51:35.887691+0000 mon.smithi067 (mon.1) 1391 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:51:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:51:35.888081+0000 mon.smithi061 (mon.0) 1957 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:51:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:51:35.888313+0000 mon.smithi067 (mon.1) 1392 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:51:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:51:35.888630+0000 mon.smithi061 (mon.0) 1958 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:51:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:37.267633+0000 mgr.smithi067.rdualw (mgr.24569) 9151 : cluster [DBG] pgmap v7882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:37.267633+0000 mgr.smithi067.rdualw (mgr.24569) 9151 : cluster [DBG] pgmap v7882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:39.268168+0000 mgr.smithi067.rdualw (mgr.24569) 9152 : cluster [DBG] pgmap v7883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:39.268168+0000 mgr.smithi067.rdualw (mgr.24569) 9152 : cluster [DBG] pgmap v7883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:41.269213+0000 mgr.smithi067.rdualw (mgr.24569) 9153 : cluster [DBG] pgmap v7884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:41.269213+0000 mgr.smithi067.rdualw (mgr.24569) 9153 : cluster [DBG] pgmap v7884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:43.269725+0000 mgr.smithi067.rdualw (mgr.24569) 9154 : cluster [DBG] pgmap v7885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:43.269725+0000 mgr.smithi067.rdualw (mgr.24569) 9154 : cluster [DBG] pgmap v7885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:45.270570+0000 mgr.smithi067.rdualw (mgr.24569) 9155 : cluster [DBG] pgmap v7886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:51:46.670 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:51:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:45.270570+0000 mgr.smithi067.rdualw (mgr.24569) 9155 : cluster [DBG] pgmap v7886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:51:46.960 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:51:46.960 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 5m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:51:46.961 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 5m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:51:46.961 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 5m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:51:46.961 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 5m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:51:46.961 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 5m ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:51:46.962 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 5m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:51:46.962 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 5m ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:51:46.962 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 5m ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:51:46.962 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 5m ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:51:46.963 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 5m ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:51:46.963 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 5m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:51:46.963 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 5m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:51:46.963 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 5m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:51:46.963 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 5m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:51:46.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 5m ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:51:46.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 5m ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:51:46.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 5m ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:51:46.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 5m ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:51:46.965 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 5m ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:51:46.965 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 5m ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:51:46.965 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 5m ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:51:46.965 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 5m ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:51:46.965 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 5m ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:51:47.303 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:51:47.303 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:51:47.304 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:51:47.304 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:51:47.304 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:51:47.304 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:51:47.305 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:51:47.305 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:51:47.305 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:51:47.305 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:51:47.307 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:51:47.307 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:51:47.307 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:51:47.307 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:51:47.308 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:51:47.308 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:51:47.308 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:51:47.308 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:51:47.308 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:51:48.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:51:46.657101+0000 mgr.smithi067.rdualw (mgr.24569) 9156 : audit [DBG] from='client.40246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:51:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:51:47.302220+0000 mon.smithi061 (mon.0) 1959 : audit [DBG] from='client.? 172.21.15.61:0/3545607304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:51:48.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:51:46.657101+0000 mgr.smithi067.rdualw (mgr.24569) 9156 : audit [DBG] from='client.40246 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:51:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:51:47.302220+0000 mon.smithi061 (mon.0) 1959 : audit [DBG] from='client.? 172.21.15.61:0/3545607304' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:51:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:51:46.942796+0000 mgr.smithi067.rdualw (mgr.24569) 9157 : audit [DBG] from='client.40250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:51:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:47.271278+0000 mgr.smithi067.rdualw (mgr.24569) 9158 : cluster [DBG] pgmap v7887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:51:46.942796+0000 mgr.smithi067.rdualw (mgr.24569) 9157 : audit [DBG] from='client.40250 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:51:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:47.271278+0000 mgr.smithi067.rdualw (mgr.24569) 9158 : cluster [DBG] pgmap v7887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:49.271910+0000 mgr.smithi067.rdualw (mgr.24569) 9159 : cluster [DBG] pgmap v7888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:49.271910+0000 mgr.smithi067.rdualw (mgr.24569) 9159 : cluster [DBG] pgmap v7888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:51.272879+0000 mgr.smithi067.rdualw (mgr.24569) 9160 : cluster [DBG] pgmap v7889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:51.272879+0000 mgr.smithi067.rdualw (mgr.24569) 9160 : cluster [DBG] pgmap v7889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:53.273401+0000 mgr.smithi067.rdualw (mgr.24569) 9161 : cluster [DBG] pgmap v7890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:53.273401+0000 mgr.smithi067.rdualw (mgr.24569) 9161 : cluster [DBG] pgmap v7890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:55.274097+0000 mgr.smithi067.rdualw (mgr.24569) 9162 : cluster [DBG] pgmap v7891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:51:57.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:55.274097+0000 mgr.smithi067.rdualw (mgr.24569) 9162 : cluster [DBG] pgmap v7891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:51:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:57.274976+0000 mgr.smithi067.rdualw (mgr.24569) 9163 : cluster [DBG] pgmap v7892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:57.274976+0000 mgr.smithi067.rdualw (mgr.24569) 9163 : cluster [DBG] pgmap v7892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:51:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:51:57.948391+0000 mon.smithi067 (mon.1) 1393 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:51:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:51:57.949794+0000 mon.smithi067 (mon.1) 1394 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:51:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:51:57.950720+0000 mon.smithi067 (mon.1) 1395 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:51:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:51:57.951591+0000 mgr.smithi067.rdualw (mgr.24569) 9164 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:51:59.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:51:58.368944+0000 mon.smithi061 (mon.0) 1960 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:51:59.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:51:58.376477+0000 mon.smithi061 (mon.0) 1961 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:51:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:51:57.948391+0000 mon.smithi067 (mon.1) 1393 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:51:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:51:57.949794+0000 mon.smithi067 (mon.1) 1394 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:51:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:51:57.950720+0000 mon.smithi067 (mon.1) 1395 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:51:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:51:57.951591+0000 mgr.smithi067.rdualw (mgr.24569) 9164 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:51:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:51:58.368944+0000 mon.smithi061 (mon.0) 1960 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:51:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:51:58.376477+0000 mon.smithi061 (mon.0) 1961 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:52:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:51:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:51:59.275684+0000 mgr.smithi067.rdualw (mgr.24569) 9165 : cluster [DBG] pgmap v7893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:51:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:51:59.275684+0000 mgr.smithi067.rdualw (mgr.24569) 9165 : cluster [DBG] pgmap v7893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:01.276713+0000 mgr.smithi067.rdualw (mgr.24569) 9166 : cluster [DBG] pgmap v7894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:01.276713+0000 mgr.smithi067.rdualw (mgr.24569) 9166 : cluster [DBG] pgmap v7894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:03.277445+0000 mgr.smithi067.rdualw (mgr.24569) 9167 : cluster [DBG] pgmap v7895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:03.277445+0000 mgr.smithi067.rdualw (mgr.24569) 9167 : cluster [DBG] pgmap v7895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:07.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:05.278312+0000 mgr.smithi067.rdualw (mgr.24569) 9168 : cluster [DBG] pgmap v7896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:52:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:05.278312+0000 mgr.smithi067.rdualw (mgr.24569) 9168 : cluster [DBG] pgmap v7896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:52:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:07.279185+0000 mgr.smithi067.rdualw (mgr.24569) 9169 : cluster [DBG] pgmap v7897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:07.279185+0000 mgr.smithi067.rdualw (mgr.24569) 9169 : cluster [DBG] pgmap v7897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:09.279759+0000 mgr.smithi067.rdualw (mgr.24569) 9170 : cluster [DBG] pgmap v7898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:09.279759+0000 mgr.smithi067.rdualw (mgr.24569) 9170 : cluster [DBG] pgmap v7898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:11.280693+0000 mgr.smithi067.rdualw (mgr.24569) 9171 : cluster [DBG] pgmap v7899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:11.280693+0000 mgr.smithi067.rdualw (mgr.24569) 9171 : cluster [DBG] pgmap v7899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:13.281321+0000 mgr.smithi067.rdualw (mgr.24569) 9172 : cluster [DBG] pgmap v7900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:13.281321+0000 mgr.smithi067.rdualw (mgr.24569) 9172 : cluster [DBG] pgmap v7900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:15.282195+0000 mgr.smithi067.rdualw (mgr.24569) 9173 : cluster [DBG] pgmap v7901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:52:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:15.282195+0000 mgr.smithi067.rdualw (mgr.24569) 9173 : cluster [DBG] pgmap v7901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:52:17.615 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:52:17.908 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:52:17.909 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 6m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:52:17.909 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 6m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:52:17.909 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 6m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:52:17.909 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 6m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:52:17.910 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 6m ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:52:17.910 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 6m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:52:17.911 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 6m ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:52:17.911 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 6m ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:52:17.911 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 6m ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:52:17.911 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 6m ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:52:17.911 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 6m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:52:17.912 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 6m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:52:17.912 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 6m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:52:17.912 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 6m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:52:17.912 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 6m ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:52:17.913 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 6m ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:52:17.913 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 6m ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:52:17.913 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 6m ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:52:17.913 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 6m ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:52:17.913 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 6m ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:52:17.914 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 6m ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:52:17.914 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 6m ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:52:17.914 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 6m ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:52:18.360 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:52:18.361 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:52:18.361 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:52:18.361 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:52:18.361 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:52:18.362 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:52:18.362 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:52:18.362 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:52:18.362 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:52:18.363 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:52:18.363 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:52:18.363 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:52:18.363 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:52:18.364 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:52:18.364 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:52:18.364 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:52:18.365 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:52:18.365 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:52:18.365 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:52:19.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:17.282919+0000 mgr.smithi067.rdualw (mgr.24569) 9174 : cluster [DBG] pgmap v7902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:19.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:52:17.602624+0000 mgr.smithi067.rdualw (mgr.24569) 9175 : audit [DBG] from='client.40258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:52:19.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:52:18.359340+0000 mon.smithi061 (mon.0) 1962 : audit [DBG] from='client.? 172.21.15.61:0/3723945772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:52:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:17.282919+0000 mgr.smithi067.rdualw (mgr.24569) 9174 : cluster [DBG] pgmap v7902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:52:17.602624+0000 mgr.smithi067.rdualw (mgr.24569) 9175 : audit [DBG] from='client.40258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:52:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:52:18.359340+0000 mon.smithi061 (mon.0) 1962 : audit [DBG] from='client.? 172.21.15.61:0/3723945772' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:52:20.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:52:17.891101+0000 mgr.smithi067.rdualw (mgr.24569) 9176 : audit [DBG] from='client.40262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:52:20.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:52:17.891101+0000 mgr.smithi067.rdualw (mgr.24569) 9176 : audit [DBG] from='client.40262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:52:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:19.283576+0000 mgr.smithi067.rdualw (mgr.24569) 9177 : cluster [DBG] pgmap v7903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:19.283576+0000 mgr.smithi067.rdualw (mgr.24569) 9177 : cluster [DBG] pgmap v7903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:21.284466+0000 mgr.smithi067.rdualw (mgr.24569) 9178 : cluster [DBG] pgmap v7904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:21.284466+0000 mgr.smithi067.rdualw (mgr.24569) 9178 : cluster [DBG] pgmap v7904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:23.285004+0000 mgr.smithi067.rdualw (mgr.24569) 9179 : cluster [DBG] pgmap v7905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:23.285004+0000 mgr.smithi067.rdualw (mgr.24569) 9179 : cluster [DBG] pgmap v7905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:25.285721+0000 mgr.smithi067.rdualw (mgr.24569) 9180 : cluster [DBG] pgmap v7906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:52:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:25.285721+0000 mgr.smithi067.rdualw (mgr.24569) 9180 : cluster [DBG] pgmap v7906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:52:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:27.286715+0000 mgr.smithi067.rdualw (mgr.24569) 9181 : cluster [DBG] pgmap v7907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:27.286715+0000 mgr.smithi067.rdualw (mgr.24569) 9181 : cluster [DBG] pgmap v7907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:29.287317+0000 mgr.smithi067.rdualw (mgr.24569) 9182 : cluster [DBG] pgmap v7908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:29.287317+0000 mgr.smithi067.rdualw (mgr.24569) 9182 : cluster [DBG] pgmap v7908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:31.288244+0000 mgr.smithi067.rdualw (mgr.24569) 9183 : cluster [DBG] pgmap v7909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:31.288244+0000 mgr.smithi067.rdualw (mgr.24569) 9183 : cluster [DBG] pgmap v7909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:33.288893+0000 mgr.smithi067.rdualw (mgr.24569) 9184 : cluster [DBG] pgmap v7910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:33.288893+0000 mgr.smithi067.rdualw (mgr.24569) 9184 : cluster [DBG] pgmap v7910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:35.289592+0000 mgr.smithi067.rdualw (mgr.24569) 9185 : cluster [DBG] pgmap v7911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:52:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:52:35.893332+0000 mon.smithi067 (mon.1) 1396 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:52:37.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:52:35.893605+0000 mon.smithi067 (mon.1) 1397 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:52:37.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:52:35.893910+0000 mon.smithi061 (mon.0) 1963 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:52:37.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:52:35.894402+0000 mon.smithi061 (mon.0) 1964 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:52:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:35.289592+0000 mgr.smithi067.rdualw (mgr.24569) 9185 : cluster [DBG] pgmap v7911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:52:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:52:35.893332+0000 mon.smithi067 (mon.1) 1396 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:52:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:52:35.893605+0000 mon.smithi067 (mon.1) 1397 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:52:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:52:35.893910+0000 mon.smithi061 (mon.0) 1963 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:52:37.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:52:35.894402+0000 mon.smithi061 (mon.0) 1964 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:52:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:37.290391+0000 mgr.smithi067.rdualw (mgr.24569) 9186 : cluster [DBG] pgmap v7912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:37.290391+0000 mgr.smithi067.rdualw (mgr.24569) 9186 : cluster [DBG] pgmap v7912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:40.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:39.291219+0000 mgr.smithi067.rdualw (mgr.24569) 9187 : cluster [DBG] pgmap v7913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:40.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:39.291219+0000 mgr.smithi067.rdualw (mgr.24569) 9187 : cluster [DBG] pgmap v7913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:41.292296+0000 mgr.smithi067.rdualw (mgr.24569) 9188 : cluster [DBG] pgmap v7914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:41.292296+0000 mgr.smithi067.rdualw (mgr.24569) 9188 : cluster [DBG] pgmap v7914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:43.292903+0000 mgr.smithi067.rdualw (mgr.24569) 9189 : cluster [DBG] pgmap v7915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:43.292903+0000 mgr.smithi067.rdualw (mgr.24569) 9189 : cluster [DBG] pgmap v7915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:45.293925+0000 mgr.smithi067.rdualw (mgr.24569) 9190 : cluster [DBG] pgmap v7916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:52:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:45.293925+0000 mgr.smithi067.rdualw (mgr.24569) 9190 : cluster [DBG] pgmap v7916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:52:48.673 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:52:48.968 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:52:48.969 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 6m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:52:48.969 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 6m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:52:48.969 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 6m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:52:48.970 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 6m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:52:48.970 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 6m ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:52:48.970 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 6m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:52:48.970 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 6m ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:52:48.970 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 6m ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:52:48.971 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 6m ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:52:48.971 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 6m ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:52:48.971 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 6m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:52:48.971 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 6m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:52:48.972 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 6m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:52:48.972 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 6m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:52:48.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 6m ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:52:48.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 6m ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:52:48.972 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 6m ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:52:48.973 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 6m ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:52:48.973 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 6m ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:52:48.973 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 6m ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:52:48.973 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 6m ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:52:48.974 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 6m ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:52:48.974 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 6m ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:52:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:47.294614+0000 mgr.smithi067.rdualw (mgr.24569) 9191 : cluster [DBG] pgmap v7917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:47.294614+0000 mgr.smithi067.rdualw (mgr.24569) 9191 : cluster [DBG] pgmap v7917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:49.338 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:52:49.338 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:52:49.338 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:52:49.339 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:52:49.339 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:52:49.339 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:52:49.339 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:52:49.340 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:52:49.340 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:52:49.340 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:52:49.340 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:52:49.340 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:52:49.341 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:52:49.341 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:52:49.341 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:52:49.341 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:52:49.342 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:52:49.342 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:52:49.342 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:52:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:52:48.659337+0000 mgr.smithi067.rdualw (mgr.24569) 9192 : audit [DBG] from='client.40270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:52:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:52:49.336917+0000 mon.smithi061 (mon.0) 1965 : audit [DBG] from='client.? 172.21.15.61:0/441458358' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:52:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:52:48.659337+0000 mgr.smithi067.rdualw (mgr.24569) 9192 : audit [DBG] from='client.40270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:52:50.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:52:49.336917+0000 mon.smithi061 (mon.0) 1965 : audit [DBG] from='client.? 172.21.15.61:0/441458358' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:52:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:52:48.951271+0000 mgr.smithi067.rdualw (mgr.24569) 9193 : audit [DBG] from='client.40274 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:52:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:49.295368+0000 mgr.smithi067.rdualw (mgr.24569) 9194 : cluster [DBG] pgmap v7918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:52:48.951271+0000 mgr.smithi067.rdualw (mgr.24569) 9193 : audit [DBG] from='client.40274 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:52:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:49.295368+0000 mgr.smithi067.rdualw (mgr.24569) 9194 : cluster [DBG] pgmap v7918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:51.296284+0000 mgr.smithi067.rdualw (mgr.24569) 9195 : cluster [DBG] pgmap v7919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:51.296284+0000 mgr.smithi067.rdualw (mgr.24569) 9195 : cluster [DBG] pgmap v7919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:53.296877+0000 mgr.smithi067.rdualw (mgr.24569) 9196 : cluster [DBG] pgmap v7920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:53.296877+0000 mgr.smithi067.rdualw (mgr.24569) 9196 : cluster [DBG] pgmap v7920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:55.297784+0000 mgr.smithi067.rdualw (mgr.24569) 9197 : cluster [DBG] pgmap v7921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:52:57.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:55.297784+0000 mgr.smithi067.rdualw (mgr.24569) 9197 : cluster [DBG] pgmap v7921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:52:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:57.298569+0000 mgr.smithi067.rdualw (mgr.24569) 9198 : cluster [DBG] pgmap v7922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:52:58.379934+0000 mon.smithi067 (mon.1) 1398 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:52:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:52:58.381411+0000 mon.smithi067 (mon.1) 1399 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:52:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:52:58.382363+0000 mon.smithi067 (mon.1) 1400 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:52:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:57.298569+0000 mgr.smithi067.rdualw (mgr.24569) 9198 : cluster [DBG] pgmap v7922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:52:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:52:58.379934+0000 mon.smithi067 (mon.1) 1398 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:52:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:52:58.381411+0000 mon.smithi067 (mon.1) 1399 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:52:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:52:58.382363+0000 mon.smithi067 (mon.1) 1400 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:53:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:52:58.383262+0000 mgr.smithi067.rdualw (mgr.24569) 9199 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:53:00.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:52:58.797328+0000 mon.smithi061 (mon.0) 1966 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:53:00.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:52:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:52:58.803229+0000 mon.smithi061 (mon.0) 1967 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:53:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:52:58.383262+0000 mgr.smithi067.rdualw (mgr.24569) 9199 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:53:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:52:58.797328+0000 mon.smithi061 (mon.0) 1966 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:53:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:52:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:52:58.803229+0000 mon.smithi061 (mon.0) 1967 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:53:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:52:59.299164+0000 mgr.smithi067.rdualw (mgr.24569) 9200 : cluster [DBG] pgmap v7923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:52:59.299164+0000 mgr.smithi067.rdualw (mgr.24569) 9200 : cluster [DBG] pgmap v7923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:01.300112+0000 mgr.smithi067.rdualw (mgr.24569) 9201 : cluster [DBG] pgmap v7924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:01.300112+0000 mgr.smithi067.rdualw (mgr.24569) 9201 : cluster [DBG] pgmap v7924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:03.300756+0000 mgr.smithi067.rdualw (mgr.24569) 9202 : cluster [DBG] pgmap v7925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:03.300756+0000 mgr.smithi067.rdualw (mgr.24569) 9202 : cluster [DBG] pgmap v7925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:06.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:05.301509+0000 mgr.smithi067.rdualw (mgr.24569) 9203 : cluster [DBG] pgmap v7926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:53:06.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:05.301509+0000 mgr.smithi067.rdualw (mgr.24569) 9203 : cluster [DBG] pgmap v7926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:53:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:07.302204+0000 mgr.smithi067.rdualw (mgr.24569) 9204 : cluster [DBG] pgmap v7927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:07.302204+0000 mgr.smithi067.rdualw (mgr.24569) 9204 : cluster [DBG] pgmap v7927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:09.302932+0000 mgr.smithi067.rdualw (mgr.24569) 9205 : cluster [DBG] pgmap v7928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:09.302932+0000 mgr.smithi067.rdualw (mgr.24569) 9205 : cluster [DBG] pgmap v7928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:11.304018+0000 mgr.smithi067.rdualw (mgr.24569) 9206 : cluster [DBG] pgmap v7929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:11.304018+0000 mgr.smithi067.rdualw (mgr.24569) 9206 : cluster [DBG] pgmap v7929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:13.304570+0000 mgr.smithi067.rdualw (mgr.24569) 9207 : cluster [DBG] pgmap v7930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:13.304570+0000 mgr.smithi067.rdualw (mgr.24569) 9207 : cluster [DBG] pgmap v7930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:15.305338+0000 mgr.smithi067.rdualw (mgr.24569) 9208 : cluster [DBG] pgmap v7931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:53:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:15.305338+0000 mgr.smithi067.rdualw (mgr.24569) 9208 : cluster [DBG] pgmap v7931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:53:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:17.306145+0000 mgr.smithi067.rdualw (mgr.24569) 9209 : cluster [DBG] pgmap v7932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:17.306145+0000 mgr.smithi067.rdualw (mgr.24569) 9209 : cluster [DBG] pgmap v7932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:19.644 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:53:19.937 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:53:19.938 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 7m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:53:19.938 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 7m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:53:19.938 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 7m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:53:19.938 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 7m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:53:19.939 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 7m ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:53:19.939 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 7m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:53:19.939 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 7m ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:53:19.939 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 7m ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:53:19.940 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 7m ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:53:19.940 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 7m ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:53:19.940 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 7m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:53:19.941 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 7m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:53:19.941 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 7m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:53:19.942 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 7m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:53:19.942 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 7m ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:53:19.942 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 7m ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:53:19.943 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 7m ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:53:19.943 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 7m ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:53:19.943 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 7m ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:53:19.943 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 7m ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:53:19.944 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 7m ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:53:19.944 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 7m ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:53:19.944 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 7m ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:53:20.281 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:53:20.282 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:53:20.282 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:53:20.282 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:53:20.282 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:53:20.283 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:53:20.283 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:53:20.283 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:53:20.283 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:53:20.284 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:53:20.284 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:53:20.284 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:53:20.284 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:53:20.285 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:53:20.285 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:53:20.285 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:53:20.285 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:53:20.285 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:53:20.286 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:53:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:19.306896+0000 mgr.smithi067.rdualw (mgr.24569) 9210 : cluster [DBG] pgmap v7933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:53:19.631484+0000 mgr.smithi067.rdualw (mgr.24569) 9211 : audit [DBG] from='client.40282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:53:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:53:20.280120+0000 mon.smithi061 (mon.0) 1968 : audit [DBG] from='client.? 172.21.15.61:0/2956713987' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:53:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:19.306896+0000 mgr.smithi067.rdualw (mgr.24569) 9210 : cluster [DBG] pgmap v7933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:53:19.631484+0000 mgr.smithi067.rdualw (mgr.24569) 9211 : audit [DBG] from='client.40282 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:53:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:53:20.280120+0000 mon.smithi061 (mon.0) 1968 : audit [DBG] from='client.? 172.21.15.61:0/2956713987' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:53:22.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:53:19.919327+0000 mgr.smithi067.rdualw (mgr.24569) 9212 : audit [DBG] from='client.40286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:53:22.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:53:19.919327+0000 mgr.smithi067.rdualw (mgr.24569) 9212 : audit [DBG] from='client.40286 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:53:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:21.307774+0000 mgr.smithi067.rdualw (mgr.24569) 9213 : cluster [DBG] pgmap v7934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:21.307774+0000 mgr.smithi067.rdualw (mgr.24569) 9213 : cluster [DBG] pgmap v7934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:24.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:23.308406+0000 mgr.smithi067.rdualw (mgr.24569) 9214 : cluster [DBG] pgmap v7935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:23.308406+0000 mgr.smithi067.rdualw (mgr.24569) 9214 : cluster [DBG] pgmap v7935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:26.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:25.309149+0000 mgr.smithi067.rdualw (mgr.24569) 9215 : cluster [DBG] pgmap v7936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:53:26.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:25.309149+0000 mgr.smithi067.rdualw (mgr.24569) 9215 : cluster [DBG] pgmap v7936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:53:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:27.309874+0000 mgr.smithi067.rdualw (mgr.24569) 9216 : cluster [DBG] pgmap v7937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:27.309874+0000 mgr.smithi067.rdualw (mgr.24569) 9216 : cluster [DBG] pgmap v7937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:29.310490+0000 mgr.smithi067.rdualw (mgr.24569) 9217 : cluster [DBG] pgmap v7938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:29.310490+0000 mgr.smithi067.rdualw (mgr.24569) 9217 : cluster [DBG] pgmap v7938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:31.311444+0000 mgr.smithi067.rdualw (mgr.24569) 9218 : cluster [DBG] pgmap v7939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:31.311444+0000 mgr.smithi067.rdualw (mgr.24569) 9218 : cluster [DBG] pgmap v7939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:33.312096+0000 mgr.smithi067.rdualw (mgr.24569) 9219 : cluster [DBG] pgmap v7940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:33.312096+0000 mgr.smithi067.rdualw (mgr.24569) 9219 : cluster [DBG] pgmap v7940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:35.312978+0000 mgr.smithi067.rdualw (mgr.24569) 9220 : cluster [DBG] pgmap v7941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:53:37.212 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:53:35.898878+0000 mon.smithi067 (mon.1) 1401 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:53:37.212 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:53:35.899166+0000 mon.smithi067 (mon.1) 1402 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:53:37.213 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:53:35.899649+0000 mon.smithi061 (mon.0) 1969 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:53:37.213 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:53:35.900316+0000 mon.smithi061 (mon.0) 1970 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:53:37.213 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:35.312978+0000 mgr.smithi067.rdualw (mgr.24569) 9220 : cluster [DBG] pgmap v7941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:53:37.213 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:53:35.898878+0000 mon.smithi067 (mon.1) 1401 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:53:37.214 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:53:35.899166+0000 mon.smithi067 (mon.1) 1402 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:53:37.214 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:53:35.899649+0000 mon.smithi061 (mon.0) 1969 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:53:37.214 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:53:35.900316+0000 mon.smithi061 (mon.0) 1970 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:53:38.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:37.313716+0000 mgr.smithi067.rdualw (mgr.24569) 9221 : cluster [DBG] pgmap v7942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:37.313716+0000 mgr.smithi067.rdualw (mgr.24569) 9221 : cluster [DBG] pgmap v7942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:39.314328+0000 mgr.smithi067.rdualw (mgr.24569) 9222 : cluster [DBG] pgmap v7943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:39.314328+0000 mgr.smithi067.rdualw (mgr.24569) 9222 : cluster [DBG] pgmap v7943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:41.315269+0000 mgr.smithi067.rdualw (mgr.24569) 9223 : cluster [DBG] pgmap v7944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:41.315269+0000 mgr.smithi067.rdualw (mgr.24569) 9223 : cluster [DBG] pgmap v7944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:43.315819+0000 mgr.smithi067.rdualw (mgr.24569) 9224 : cluster [DBG] pgmap v7945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:43.315819+0000 mgr.smithi067.rdualw (mgr.24569) 9224 : cluster [DBG] pgmap v7945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:45.316584+0000 mgr.smithi067.rdualw (mgr.24569) 9225 : cluster [DBG] pgmap v7946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:53:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:45.316584+0000 mgr.smithi067.rdualw (mgr.24569) 9225 : cluster [DBG] pgmap v7946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:53:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:47.317459+0000 mgr.smithi067.rdualw (mgr.24569) 9226 : cluster [DBG] pgmap v7947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:47.317459+0000 mgr.smithi067.rdualw (mgr.24569) 9226 : cluster [DBG] pgmap v7947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:50.592 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:53:50.930 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:53:50.930 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 7m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:53:50.930 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 7m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:53:50.931 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 7m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:53:50.931 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 7m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:53:50.931 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 7m ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:53:50.931 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 7m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:53:50.932 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 7m ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:53:50.932 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 7m ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:53:50.932 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 7m ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:53:50.932 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 7m ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:53:50.932 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 7m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:53:50.933 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 7m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:53:50.933 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 7m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:53:50.933 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 7m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:53:50.933 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 7m ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:53:50.934 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 7m ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:53:50.934 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 7m ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:53:50.934 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 7m ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:53:50.935 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 7m ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:53:50.935 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 7m ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:53:50.935 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 7m ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:53:50.935 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 7m ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:53:50.936 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 7m ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:53:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:49.318152+0000 mgr.smithi067.rdualw (mgr.24569) 9227 : cluster [DBG] pgmap v7948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:49.318152+0000 mgr.smithi067.rdualw (mgr.24569) 9227 : cluster [DBG] pgmap v7948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:51.290 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:53:51.291 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:53:51.291 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:53:51.291 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:53:51.292 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:53:51.292 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:53:51.292 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:53:51.292 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:53:51.293 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:53:51.293 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:53:51.293 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:53:51.293 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:53:51.294 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:53:51.294 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:53:51.294 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:53:51.294 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:53:51.295 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:53:51.295 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:53:51.295 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:53:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:53:50.578159+0000 mgr.smithi067.rdualw (mgr.24569) 9228 : audit [DBG] from='client.40294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:53:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:53:51.289145+0000 mon.smithi061 (mon.0) 1971 : audit [DBG] from='client.? 172.21.15.61:0/1347443033' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:53:52.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:53:50.578159+0000 mgr.smithi067.rdualw (mgr.24569) 9228 : audit [DBG] from='client.40294 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:53:52.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:53:51.289145+0000 mon.smithi061 (mon.0) 1971 : audit [DBG] from='client.? 172.21.15.61:0/1347443033' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:53:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:53:50.912082+0000 mgr.smithi067.rdualw (mgr.24569) 9229 : audit [DBG] from='client.40298 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:53:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:51.319015+0000 mgr.smithi067.rdualw (mgr.24569) 9230 : cluster [DBG] pgmap v7949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:53:50.912082+0000 mgr.smithi067.rdualw (mgr.24569) 9229 : audit [DBG] from='client.40298 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:53:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:51.319015+0000 mgr.smithi067.rdualw (mgr.24569) 9230 : cluster [DBG] pgmap v7949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:53.319729+0000 mgr.smithi067.rdualw (mgr.24569) 9231 : cluster [DBG] pgmap v7950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:53.319729+0000 mgr.smithi067.rdualw (mgr.24569) 9231 : cluster [DBG] pgmap v7950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:56.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:55.320464+0000 mgr.smithi067.rdualw (mgr.24569) 9232 : cluster [DBG] pgmap v7951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:53:56.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:55.320464+0000 mgr.smithi067.rdualw (mgr.24569) 9232 : cluster [DBG] pgmap v7951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:53:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:57.321267+0000 mgr.smithi067.rdualw (mgr.24569) 9233 : cluster [DBG] pgmap v7952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:53:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:57.321267+0000 mgr.smithi067.rdualw (mgr.24569) 9233 : cluster [DBG] pgmap v7952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:53:58.808838+0000 mon.smithi067 (mon.1) 1403 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:54:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:53:58.810322+0000 mon.smithi067 (mon.1) 1404 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:54:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:53:58.811334+0000 mon.smithi067 (mon.1) 1405 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:54:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:53:59.225028+0000 mon.smithi061 (mon.0) 1972 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:54:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:53:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:53:59.233467+0000 mon.smithi061 (mon.0) 1973 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:54:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:53:58.808838+0000 mon.smithi067 (mon.1) 1403 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:54:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:53:58.810322+0000 mon.smithi067 (mon.1) 1404 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:54:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:53:58.811334+0000 mon.smithi067 (mon.1) 1405 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:54:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:53:59.225028+0000 mon.smithi061 (mon.0) 1972 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:54:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:53:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:53:59.233467+0000 mon.smithi061 (mon.0) 1973 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:54:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:53:58.812176+0000 mgr.smithi067.rdualw (mgr.24569) 9234 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:54:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:53:59.321785+0000 mgr.smithi067.rdualw (mgr.24569) 9235 : cluster [DBG] pgmap v7953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:53:58.812176+0000 mgr.smithi067.rdualw (mgr.24569) 9234 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:54:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:53:59.321785+0000 mgr.smithi067.rdualw (mgr.24569) 9235 : cluster [DBG] pgmap v7953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:01.322743+0000 mgr.smithi067.rdualw (mgr.24569) 9236 : cluster [DBG] pgmap v7954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:01.322743+0000 mgr.smithi067.rdualw (mgr.24569) 9236 : cluster [DBG] pgmap v7954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:03.323300+0000 mgr.smithi067.rdualw (mgr.24569) 9237 : cluster [DBG] pgmap v7955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:03.323300+0000 mgr.smithi067.rdualw (mgr.24569) 9237 : cluster [DBG] pgmap v7955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:05.324114+0000 mgr.smithi067.rdualw (mgr.24569) 9238 : cluster [DBG] pgmap v7956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:54:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:05.324114+0000 mgr.smithi067.rdualw (mgr.24569) 9238 : cluster [DBG] pgmap v7956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:54:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:07.324909+0000 mgr.smithi067.rdualw (mgr.24569) 9239 : cluster [DBG] pgmap v7957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:07.324909+0000 mgr.smithi067.rdualw (mgr.24569) 9239 : cluster [DBG] pgmap v7957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:09.325681+0000 mgr.smithi067.rdualw (mgr.24569) 9240 : cluster [DBG] pgmap v7958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:09.325681+0000 mgr.smithi067.rdualw (mgr.24569) 9240 : cluster [DBG] pgmap v7958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:11.326635+0000 mgr.smithi067.rdualw (mgr.24569) 9241 : cluster [DBG] pgmap v7959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:11.326635+0000 mgr.smithi067.rdualw (mgr.24569) 9241 : cluster [DBG] pgmap v7959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:13.327278+0000 mgr.smithi067.rdualw (mgr.24569) 9242 : cluster [DBG] pgmap v7960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:13.327278+0000 mgr.smithi067.rdualw (mgr.24569) 9242 : cluster [DBG] pgmap v7960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:15.328068+0000 mgr.smithi067.rdualw (mgr.24569) 9243 : cluster [DBG] pgmap v7961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:54:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:15.328068+0000 mgr.smithi067.rdualw (mgr.24569) 9243 : cluster [DBG] pgmap v7961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:54:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:17.328781+0000 mgr.smithi067.rdualw (mgr.24569) 9244 : cluster [DBG] pgmap v7962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:17.328781+0000 mgr.smithi067.rdualw (mgr.24569) 9244 : cluster [DBG] pgmap v7962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:19.329415+0000 mgr.smithi067.rdualw (mgr.24569) 9245 : cluster [DBG] pgmap v7963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:19.329415+0000 mgr.smithi067.rdualw (mgr.24569) 9245 : cluster [DBG] pgmap v7963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:21.597 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:54:21.893 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:54:21.893 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 8m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:54:21.893 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 8m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:54:21.894 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 8m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:54:21.894 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 8m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:54:21.894 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 8m ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:54:21.894 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 8m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:54:21.895 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 8m ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:54:21.895 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 8m ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:54:21.895 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 8m ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:54:21.895 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 8m ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:54:21.896 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 8m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:54:21.896 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 8m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:54:21.896 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 8m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:54:21.896 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 8m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:54:21.896 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 8m ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:54:21.897 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 8m ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:54:21.897 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 8m ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:54:21.897 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 8m ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:54:21.897 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 8m ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:54:21.898 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 8m ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:54:21.898 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 8m ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:54:21.898 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 8m ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:54:21.898 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 8m ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:54:22.234 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:54:22.235 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:54:22.235 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:54:22.235 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:54:22.235 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:54:22.236 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:54:22.236 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:54:22.236 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:54:22.236 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:54:22.236 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:54:22.237 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:54:22.237 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:54:22.237 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:54:22.237 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:54:22.238 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:54:22.238 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:54:22.238 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:54:22.238 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:54:22.238 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:54:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:21.330346+0000 mgr.smithi067.rdualw (mgr.24569) 9246 : cluster [DBG] pgmap v7964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:54:21.583956+0000 mgr.smithi067.rdualw (mgr.24569) 9247 : audit [DBG] from='client.40306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:54:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:54:22.233420+0000 mon.smithi061 (mon.0) 1974 : audit [DBG] from='client.? 172.21.15.61:0/159672554' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:54:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:21.330346+0000 mgr.smithi067.rdualw (mgr.24569) 9246 : cluster [DBG] pgmap v7964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:54:21.583956+0000 mgr.smithi067.rdualw (mgr.24569) 9247 : audit [DBG] from='client.40306 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:54:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:54:22.233420+0000 mon.smithi061 (mon.0) 1974 : audit [DBG] from='client.? 172.21.15.61:0/159672554' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:54:24.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:54:21.875606+0000 mgr.smithi067.rdualw (mgr.24569) 9248 : audit [DBG] from='client.40310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:54:24.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:54:21.875606+0000 mgr.smithi067.rdualw (mgr.24569) 9248 : audit [DBG] from='client.40310 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:54:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:23.330964+0000 mgr.smithi067.rdualw (mgr.24569) 9249 : cluster [DBG] pgmap v7965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:23.330964+0000 mgr.smithi067.rdualw (mgr.24569) 9249 : cluster [DBG] pgmap v7965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:25.331762+0000 mgr.smithi067.rdualw (mgr.24569) 9250 : cluster [DBG] pgmap v7966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:54:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:25.331762+0000 mgr.smithi067.rdualw (mgr.24569) 9250 : cluster [DBG] pgmap v7966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:54:27.727 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:27.332550+0000 mgr.smithi067.rdualw (mgr.24569) 9251 : cluster [DBG] pgmap v7967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:27.332550+0000 mgr.smithi067.rdualw (mgr.24569) 9251 : cluster [DBG] pgmap v7967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:29.333365+0000 mgr.smithi067.rdualw (mgr.24569) 9252 : cluster [DBG] pgmap v7968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:29.333365+0000 mgr.smithi067.rdualw (mgr.24569) 9252 : cluster [DBG] pgmap v7968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:31.334217+0000 mgr.smithi067.rdualw (mgr.24569) 9253 : cluster [DBG] pgmap v7969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:31.334217+0000 mgr.smithi067.rdualw (mgr.24569) 9253 : cluster [DBG] pgmap v7969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:33.334849+0000 mgr.smithi067.rdualw (mgr.24569) 9254 : cluster [DBG] pgmap v7970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:33.334849+0000 mgr.smithi067.rdualw (mgr.24569) 9254 : cluster [DBG] pgmap v7970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:35.335592+0000 mgr.smithi067.rdualw (mgr.24569) 9255 : cluster [DBG] pgmap v7971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:54:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:54:35.904876+0000 mon.smithi067 (mon.1) 1406 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:54:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:54:35.905194+0000 mon.smithi067 (mon.1) 1407 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:54:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:54:35.905665+0000 mon.smithi061 (mon.0) 1975 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:54:37.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:54:35.906310+0000 mon.smithi061 (mon.0) 1976 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:54:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:35.335592+0000 mgr.smithi067.rdualw (mgr.24569) 9255 : cluster [DBG] pgmap v7971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:54:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:54:35.904876+0000 mon.smithi067 (mon.1) 1406 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:54:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:54:35.905194+0000 mon.smithi067 (mon.1) 1407 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:54:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:54:35.905665+0000 mon.smithi061 (mon.0) 1975 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:54:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:54:35.906310+0000 mon.smithi061 (mon.0) 1976 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:54:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:37.336460+0000 mgr.smithi067.rdualw (mgr.24569) 9256 : cluster [DBG] pgmap v7972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:37.336460+0000 mgr.smithi067.rdualw (mgr.24569) 9256 : cluster [DBG] pgmap v7972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:39.337079+0000 mgr.smithi067.rdualw (mgr.24569) 9257 : cluster [DBG] pgmap v7973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:39.337079+0000 mgr.smithi067.rdualw (mgr.24569) 9257 : cluster [DBG] pgmap v7973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:41.337956+0000 mgr.smithi067.rdualw (mgr.24569) 9258 : cluster [DBG] pgmap v7974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:43.191 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:41.337956+0000 mgr.smithi067.rdualw (mgr.24569) 9258 : cluster [DBG] pgmap v7974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:43.338602+0000 mgr.smithi067.rdualw (mgr.24569) 9259 : cluster [DBG] pgmap v7975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:44.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:43.338602+0000 mgr.smithi067.rdualw (mgr.24569) 9259 : cluster [DBG] pgmap v7975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:46.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:45.339563+0000 mgr.smithi067.rdualw (mgr.24569) 9260 : cluster [DBG] pgmap v7976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:54:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:45.339563+0000 mgr.smithi067.rdualw (mgr.24569) 9260 : cluster [DBG] pgmap v7976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:54:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:47.340249+0000 mgr.smithi067.rdualw (mgr.24569) 9261 : cluster [DBG] pgmap v7977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:47.340249+0000 mgr.smithi067.rdualw (mgr.24569) 9261 : cluster [DBG] pgmap v7977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:49.340944+0000 mgr.smithi067.rdualw (mgr.24569) 9262 : cluster [DBG] pgmap v7978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:49.340944+0000 mgr.smithi067.rdualw (mgr.24569) 9262 : cluster [DBG] pgmap v7978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:52.544 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:54:52.721 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:51.341894+0000 mgr.smithi067.rdualw (mgr.24569) 9263 : cluster [DBG] pgmap v7979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:52.838 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:54:52.839 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 8m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:54:52.839 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 8m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:54:52.839 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 9m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:54:52.840 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 8m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:54:52.840 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 8m ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:54:52.840 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 9m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:54:52.841 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 8m ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:54:52.841 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 9m ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:54:52.842 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 8m ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:54:52.842 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 9m ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:54:52.842 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 8m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:54:52.843 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 9m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:54:52.843 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 8m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:54:52.843 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 9m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:54:52.844 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 8m ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:54:52.844 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 8m ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:54:52.845 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 8m ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:54:52.845 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 8m ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:54:52.845 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 9m ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:54:52.846 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 9m ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:54:52.846 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 9m ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:54:52.846 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 9m ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:54:52.847 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 8m ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:54:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:51.341894+0000 mgr.smithi067.rdualw (mgr.24569) 9263 : cluster [DBG] pgmap v7979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:53.179 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:54:53.179 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:54:53.180 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:54:53.180 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:54:53.180 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:54:53.180 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:54:53.181 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:54:53.181 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:54:53.181 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:54:53.181 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:54:53.181 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:54:53.182 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:54:53.182 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:54:53.182 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:54:53.182 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:54:53.183 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:54:53.183 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:54:53.183 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:54:53.183 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:54:54.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:54:52.528790+0000 mgr.smithi067.rdualw (mgr.24569) 9264 : audit [DBG] from='client.40318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:54:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:54:53.177784+0000 mon.smithi061 (mon.0) 1977 : audit [DBG] from='client.? 172.21.15.61:0/1785284128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:54:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:54:52.528790+0000 mgr.smithi067.rdualw (mgr.24569) 9264 : audit [DBG] from='client.40318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:54:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:54:53.177784+0000 mon.smithi061 (mon.0) 1977 : audit [DBG] from='client.? 172.21.15.61:0/1785284128' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:54:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:54:52.820917+0000 mgr.smithi067.rdualw (mgr.24569) 9265 : audit [DBG] from='client.40322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:54:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:53.342418+0000 mgr.smithi067.rdualw (mgr.24569) 9266 : cluster [DBG] pgmap v7980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:54:52.820917+0000 mgr.smithi067.rdualw (mgr.24569) 9265 : audit [DBG] from='client.40322 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:54:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:53.342418+0000 mgr.smithi067.rdualw (mgr.24569) 9266 : cluster [DBG] pgmap v7980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:55.343197+0000 mgr.smithi067.rdualw (mgr.24569) 9267 : cluster [DBG] pgmap v7981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:54:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:55.343197+0000 mgr.smithi067.rdualw (mgr.24569) 9267 : cluster [DBG] pgmap v7981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:54:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:57.343860+0000 mgr.smithi067.rdualw (mgr.24569) 9268 : cluster [DBG] pgmap v7982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:54:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:57.343860+0000 mgr.smithi067.rdualw (mgr.24569) 9268 : cluster [DBG] pgmap v7982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:54:59.237165+0000 mon.smithi067 (mon.1) 1408 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:55:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:54:59.238670+0000 mon.smithi067 (mon.1) 1409 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:55:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:54:59.239625+0000 mon.smithi067 (mon.1) 1410 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:55:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:54:59.656529+0000 mon.smithi061 (mon.0) 1978 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:55:00.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:54:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:54:59.664293+0000 mon.smithi061 (mon.0) 1979 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:55:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:54:59.237165+0000 mon.smithi067 (mon.1) 1408 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:55:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:54:59.238670+0000 mon.smithi067 (mon.1) 1409 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:55:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:54:59.239625+0000 mon.smithi067 (mon.1) 1410 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:55:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:54:59.656529+0000 mon.smithi061 (mon.0) 1978 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:55:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:54:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:54:59.664293+0000 mon.smithi061 (mon.0) 1979 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:55:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:54:59.240510+0000 mgr.smithi067.rdualw (mgr.24569) 9269 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:55:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:54:59.344509+0000 mgr.smithi067.rdualw (mgr.24569) 9270 : cluster [DBG] pgmap v7983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:54:59.240510+0000 mgr.smithi067.rdualw (mgr.24569) 9269 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:55:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:54:59.344509+0000 mgr.smithi067.rdualw (mgr.24569) 9270 : cluster [DBG] pgmap v7983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:01.345592+0000 mgr.smithi067.rdualw (mgr.24569) 9271 : cluster [DBG] pgmap v7984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:01.345592+0000 mgr.smithi067.rdualw (mgr.24569) 9271 : cluster [DBG] pgmap v7984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:05.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:03.346037+0000 mgr.smithi067.rdualw (mgr.24569) 9272 : cluster [DBG] pgmap v7985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:03.346037+0000 mgr.smithi067.rdualw (mgr.24569) 9272 : cluster [DBG] pgmap v7985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:05.347013+0000 mgr.smithi067.rdualw (mgr.24569) 9273 : cluster [DBG] pgmap v7986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:55:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:05.347013+0000 mgr.smithi067.rdualw (mgr.24569) 9273 : cluster [DBG] pgmap v7986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:55:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:07.347885+0000 mgr.smithi067.rdualw (mgr.24569) 9274 : cluster [DBG] pgmap v7987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:07.347885+0000 mgr.smithi067.rdualw (mgr.24569) 9274 : cluster [DBG] pgmap v7987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:09.348624+0000 mgr.smithi067.rdualw (mgr.24569) 9275 : cluster [DBG] pgmap v7988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:09.348624+0000 mgr.smithi067.rdualw (mgr.24569) 9275 : cluster [DBG] pgmap v7988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:11.349694+0000 mgr.smithi067.rdualw (mgr.24569) 9276 : cluster [DBG] pgmap v7989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:11.349694+0000 mgr.smithi067.rdualw (mgr.24569) 9276 : cluster [DBG] pgmap v7989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:13.350389+0000 mgr.smithi067.rdualw (mgr.24569) 9277 : cluster [DBG] pgmap v7990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:13.350389+0000 mgr.smithi067.rdualw (mgr.24569) 9277 : cluster [DBG] pgmap v7990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:15.351232+0000 mgr.smithi067.rdualw (mgr.24569) 9278 : cluster [DBG] pgmap v7991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:55:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:15.351232+0000 mgr.smithi067.rdualw (mgr.24569) 9278 : cluster [DBG] pgmap v7991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:55:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:17.352011+0000 mgr.smithi067.rdualw (mgr.24569) 9279 : cluster [DBG] pgmap v7992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:17.352011+0000 mgr.smithi067.rdualw (mgr.24569) 9279 : cluster [DBG] pgmap v7992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:19.352664+0000 mgr.smithi067.rdualw (mgr.24569) 9280 : cluster [DBG] pgmap v7993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:19.352664+0000 mgr.smithi067.rdualw (mgr.24569) 9280 : cluster [DBG] pgmap v7993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:21.353674+0000 mgr.smithi067.rdualw (mgr.24569) 9281 : cluster [DBG] pgmap v7994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:21.353674+0000 mgr.smithi067.rdualw (mgr.24569) 9281 : cluster [DBG] pgmap v7994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:23.486 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:55:23.779 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:55:23.779 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 9m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:55:23.779 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 9m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:55:23.780 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 9m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:55:23.780 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 9m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:55:23.780 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 9m ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:55:23.780 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 9m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:55:23.780 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 9m ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:55:23.781 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 9m ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:55:23.781 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 9m ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:55:23.781 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 9m ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:55:23.781 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 9m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:55:23.782 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 9m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:55:23.782 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 9m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:55:23.782 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 9m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:55:23.782 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 9m ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:55:23.783 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 9m ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:55:23.783 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 9m ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:55:23.783 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 9m ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:55:23.783 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 9m ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:55:23.784 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 9m ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:55:23.784 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 9m ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:55:23.784 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 9m ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:55:23.784 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 9m ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:55:24.205 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:55:24.205 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:55:24.206 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:55:24.206 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:55:24.206 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:55:24.206 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:55:24.207 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:55:24.207 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:55:24.207 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:55:24.208 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:55:24.208 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:55:24.208 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:55:24.208 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:55:24.209 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:55:24.209 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:55:24.209 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:55:24.210 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:55:24.210 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:55:24.210 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:55:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:23.354138+0000 mgr.smithi067.rdualw (mgr.24569) 9282 : cluster [DBG] pgmap v7995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:55:23.472389+0000 mgr.smithi067.rdualw (mgr.24569) 9283 : audit [DBG] from='client.40330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:55:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:55:24.203955+0000 mon.smithi061 (mon.0) 1980 : audit [DBG] from='client.? 172.21.15.61:0/3060868451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:55:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:23.354138+0000 mgr.smithi067.rdualw (mgr.24569) 9282 : cluster [DBG] pgmap v7995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:55:23.472389+0000 mgr.smithi067.rdualw (mgr.24569) 9283 : audit [DBG] from='client.40330 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:55:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:55:24.203955+0000 mon.smithi061 (mon.0) 1980 : audit [DBG] from='client.? 172.21.15.61:0/3060868451' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:55:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:55:23.760910+0000 mgr.smithi067.rdualw (mgr.24569) 9284 : audit [DBG] from='client.40334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:55:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:55:23.760910+0000 mgr.smithi067.rdualw (mgr.24569) 9284 : audit [DBG] from='client.40334 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:55:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:25.354950+0000 mgr.smithi067.rdualw (mgr.24569) 9285 : cluster [DBG] pgmap v7996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:55:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:25.354950+0000 mgr.smithi067.rdualw (mgr.24569) 9285 : cluster [DBG] pgmap v7996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:55:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:27.355777+0000 mgr.smithi067.rdualw (mgr.24569) 9286 : cluster [DBG] pgmap v7997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:27.355777+0000 mgr.smithi067.rdualw (mgr.24569) 9286 : cluster [DBG] pgmap v7997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:30.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:29.356577+0000 mgr.smithi067.rdualw (mgr.24569) 9287 : cluster [DBG] pgmap v7998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:30.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:29.356577+0000 mgr.smithi067.rdualw (mgr.24569) 9287 : cluster [DBG] pgmap v7998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:31.357604+0000 mgr.smithi067.rdualw (mgr.24569) 9288 : cluster [DBG] pgmap v7999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:31.357604+0000 mgr.smithi067.rdualw (mgr.24569) 9288 : cluster [DBG] pgmap v7999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:33.358273+0000 mgr.smithi067.rdualw (mgr.24569) 9289 : cluster [DBG] pgmap v8000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:33.358273+0000 mgr.smithi067.rdualw (mgr.24569) 9289 : cluster [DBG] pgmap v8000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:35.359049+0000 mgr.smithi067.rdualw (mgr.24569) 9290 : cluster [DBG] pgmap v8001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:55:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:55:35.910647+0000 mon.smithi067 (mon.1) 1411 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:55:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:55:35.910884+0000 mon.smithi067 (mon.1) 1412 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:55:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:55:35.911159+0000 mon.smithi061 (mon.0) 1981 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:55:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:55:35.911498+0000 mon.smithi061 (mon.0) 1982 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:55:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:35.359049+0000 mgr.smithi067.rdualw (mgr.24569) 9290 : cluster [DBG] pgmap v8001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:55:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:55:35.910647+0000 mon.smithi067 (mon.1) 1411 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:55:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:55:35.910884+0000 mon.smithi067 (mon.1) 1412 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:55:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:55:35.911159+0000 mon.smithi061 (mon.0) 1981 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:55:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:55:35.911498+0000 mon.smithi061 (mon.0) 1982 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:55:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:37.359704+0000 mgr.smithi067.rdualw (mgr.24569) 9291 : cluster [DBG] pgmap v8002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:37.359704+0000 mgr.smithi067.rdualw (mgr.24569) 9291 : cluster [DBG] pgmap v8002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:39.360279+0000 mgr.smithi067.rdualw (mgr.24569) 9292 : cluster [DBG] pgmap v8003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:39.360279+0000 mgr.smithi067.rdualw (mgr.24569) 9292 : cluster [DBG] pgmap v8003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:41.361293+0000 mgr.smithi067.rdualw (mgr.24569) 9293 : cluster [DBG] pgmap v8004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:41.361293+0000 mgr.smithi067.rdualw (mgr.24569) 9293 : cluster [DBG] pgmap v8004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:43.361872+0000 mgr.smithi067.rdualw (mgr.24569) 9294 : cluster [DBG] pgmap v8005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:43.361872+0000 mgr.smithi067.rdualw (mgr.24569) 9294 : cluster [DBG] pgmap v8005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:45.362743+0000 mgr.smithi067.rdualw (mgr.24569) 9295 : cluster [DBG] pgmap v8006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:55:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:45.362743+0000 mgr.smithi067.rdualw (mgr.24569) 9295 : cluster [DBG] pgmap v8006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:55:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:47.363316+0000 mgr.smithi067.rdualw (mgr.24569) 9296 : cluster [DBG] pgmap v8007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:47.363316+0000 mgr.smithi067.rdualw (mgr.24569) 9296 : cluster [DBG] pgmap v8007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:49.364033+0000 mgr.smithi067.rdualw (mgr.24569) 9297 : cluster [DBG] pgmap v8008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:49.364033+0000 mgr.smithi067.rdualw (mgr.24569) 9297 : cluster [DBG] pgmap v8008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:51.365006+0000 mgr.smithi067.rdualw (mgr.24569) 9298 : cluster [DBG] pgmap v8009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:51.365006+0000 mgr.smithi067.rdualw (mgr.24569) 9298 : cluster [DBG] pgmap v8009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:54.516 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:55:54.812 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:55:54.813 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 9m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:55:54.813 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 9m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:55:54.813 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 10m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:55:54.813 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 9m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:55:54.814 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 9m ago 4h 43.0M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:55:54.814 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 10m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:55:54.814 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 9m ago 4h 480M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:55:54.814 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 10m ago 4h 618M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:55:54.814 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 9m ago 4h 1696M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:55:54.815 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 10m ago 4h 870M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:55:54.815 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 9m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:55:54.815 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 10m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:55:54.815 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 9m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:55:54.816 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 10m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:55:54.816 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 9m ago 4h 1118M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:55:54.816 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 9m ago 4h 2000M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:55:54.816 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 9m ago 4h 1255M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:55:54.816 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 9m ago 4h 2145M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:55:54.817 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 10m ago 4h 1978M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:55:54.817 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 10m ago 4h 2154M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:55:54.817 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 10m ago 4h 1751M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:55:54.817 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 10m ago 4h 2695M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:55:54.817 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 9m ago 4h 151M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:55:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:53.365714+0000 mgr.smithi067.rdualw (mgr.24569) 9299 : cluster [DBG] pgmap v8010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:53.365714+0000 mgr.smithi067.rdualw (mgr.24569) 9299 : cluster [DBG] pgmap v8010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:55.152 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:55:55.153 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:55:55.153 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:55:55.153 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:55:55.154 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:55:55.154 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:55:55.154 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:55:55.154 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:55:55.155 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:55:55.155 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:55:55.155 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:55:55.156 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:55:55.156 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:55:55.156 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:55:55.156 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:55:55.156 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:55:55.157 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:55:55.157 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:55:55.157 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:55:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:55:54.502488+0000 mgr.smithi067.rdualw (mgr.24569) 9300 : audit [DBG] from='client.40342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:55:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:55:54.794906+0000 mgr.smithi067.rdualw (mgr.24569) 9301 : audit [DBG] from='client.40346 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:55:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:55:55.151696+0000 mon.smithi061 (mon.0) 1983 : audit [DBG] from='client.? 172.21.15.61:0/1401696321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:55:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:55.366515+0000 mgr.smithi067.rdualw (mgr.24569) 9302 : cluster [DBG] pgmap v8011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:55:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:55:54.502488+0000 mgr.smithi067.rdualw (mgr.24569) 9300 : audit [DBG] from='client.40342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:55:56.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:55:54.794906+0000 mgr.smithi067.rdualw (mgr.24569) 9301 : audit [DBG] from='client.40346 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:55:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:55:55.151696+0000 mon.smithi061 (mon.0) 1983 : audit [DBG] from='client.? 172.21.15.61:0/1401696321' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:55:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:55.366515+0000 mgr.smithi067.rdualw (mgr.24569) 9302 : cluster [DBG] pgmap v8011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:55:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:57.367318+0000 mgr.smithi067.rdualw (mgr.24569) 9303 : cluster [DBG] pgmap v8012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:55:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:57.367318+0000 mgr.smithi067.rdualw (mgr.24569) 9303 : cluster [DBG] pgmap v8012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:55:59.667861+0000 mon.smithi067 (mon.1) 1413 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:56:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:55:59.669308+0000 mon.smithi067 (mon.1) 1414 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:56:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:55:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:55:59.670218+0000 mon.smithi067 (mon.1) 1415 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:56:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:55:59.667861+0000 mon.smithi067 (mon.1) 1413 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:56:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:55:59.669308+0000 mon.smithi067 (mon.1) 1414 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:56:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:55:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:55:59.670218+0000 mon.smithi067 (mon.1) 1415 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:56:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:55:59.367885+0000 mgr.smithi067.rdualw (mgr.24569) 9304 : cluster [DBG] pgmap v8013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:55:59.671076+0000 mgr.smithi067.rdualw (mgr.24569) 9305 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:56:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:55:59.367885+0000 mgr.smithi067.rdualw (mgr.24569) 9304 : cluster [DBG] pgmap v8013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:55:59.671076+0000 mgr.smithi067.rdualw (mgr.24569) 9305 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:56:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:01.368940+0000 mgr.smithi067.rdualw (mgr.24569) 9306 : cluster [DBG] pgmap v8014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:01.368940+0000 mgr.smithi067.rdualw (mgr.24569) 9306 : cluster [DBG] pgmap v8014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:03.369415+0000 mgr.smithi067.rdualw (mgr.24569) 9307 : cluster [DBG] pgmap v8015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:04.265380+0000 mon.smithi061 (mon.0) 1984 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:56:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:04.664111+0000 mon.smithi067 (mon.1) 1416 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:56:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:04.664853+0000 mon.smithi061 (mon.0) 1985 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:56:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:03.369415+0000 mgr.smithi067.rdualw (mgr.24569) 9307 : cluster [DBG] pgmap v8015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:04.265380+0000 mon.smithi061 (mon.0) 1984 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:56:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:04.664111+0000 mon.smithi067 (mon.1) 1416 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:56:05.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:04.664853+0000 mon.smithi061 (mon.0) 1985 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:56:07.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:05.370094+0000 mgr.smithi067.rdualw (mgr.24569) 9308 : cluster [DBG] pgmap v8016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:56:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:05.370094+0000 mgr.smithi067.rdualw (mgr.24569) 9308 : cluster [DBG] pgmap v8016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:56:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:06.848443+0000 mon.smithi061 (mon.0) 1986 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:56:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:07.254005+0000 mon.smithi067 (mon.1) 1417 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:56:08.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:07.254480+0000 mon.smithi061 (mon.0) 1987 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:56:08.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:07.258779+0000 mon.smithi061 (mon.0) 1988 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:56:08.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:07.268375+0000 mon.smithi061 (mon.0) 1989 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:56:08.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:07.370836+0000 mgr.smithi067.rdualw (mgr.24569) 9309 : cluster [DBG] pgmap v8017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:06.848443+0000 mon.smithi061 (mon.0) 1986 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:56:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:07.254005+0000 mon.smithi067 (mon.1) 1417 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:56:08.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:07.254480+0000 mon.smithi061 (mon.0) 1987 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T19:56:08.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:07.258779+0000 mon.smithi061 (mon.0) 1988 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:56:08.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:07.268375+0000 mon.smithi061 (mon.0) 1989 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:56:08.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:07.370836+0000 mgr.smithi067.rdualw (mgr.24569) 9309 : cluster [DBG] pgmap v8017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:09.371441+0000 mgr.smithi067.rdualw (mgr.24569) 9310 : cluster [DBG] pgmap v8018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:10.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:09.371441+0000 mgr.smithi067.rdualw (mgr.24569) 9310 : cluster [DBG] pgmap v8018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:11.372268+0000 mgr.smithi067.rdualw (mgr.24569) 9311 : cluster [DBG] pgmap v8019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:11.372268+0000 mgr.smithi067.rdualw (mgr.24569) 9311 : cluster [DBG] pgmap v8019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:13.372934+0000 mgr.smithi067.rdualw (mgr.24569) 9312 : cluster [DBG] pgmap v8020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:13.372934+0000 mgr.smithi067.rdualw (mgr.24569) 9312 : cluster [DBG] pgmap v8020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:15.373745+0000 mgr.smithi067.rdualw (mgr.24569) 9313 : cluster [DBG] pgmap v8021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:56:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:15.373745+0000 mgr.smithi067.rdualw (mgr.24569) 9313 : cluster [DBG] pgmap v8021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:56:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:17.374402+0000 mgr.smithi067.rdualw (mgr.24569) 9314 : cluster [DBG] pgmap v8022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:17.374402+0000 mgr.smithi067.rdualw (mgr.24569) 9314 : cluster [DBG] pgmap v8022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:19.374959+0000 mgr.smithi067.rdualw (mgr.24569) 9315 : cluster [DBG] pgmap v8023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:19.374959+0000 mgr.smithi067.rdualw (mgr.24569) 9315 : cluster [DBG] pgmap v8023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:21.375878+0000 mgr.smithi067.rdualw (mgr.24569) 9316 : cluster [DBG] pgmap v8024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:21.375878+0000 mgr.smithi067.rdualw (mgr.24569) 9316 : cluster [DBG] pgmap v8024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:23.376438+0000 mgr.smithi067.rdualw (mgr.24569) 9317 : cluster [DBG] pgmap v8025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:23.376438+0000 mgr.smithi067.rdualw (mgr.24569) 9317 : cluster [DBG] pgmap v8025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:25.461 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:56:25.792 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:56:25.792 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 18s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:56:25.792 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 18s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:56:25.792 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 21s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:56:25.793 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 18s ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:56:25.793 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 18s ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:56:25.793 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 21s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:56:25.793 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 18s ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:56:25.794 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 21s ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:56:25.794 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 18s ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:56:25.794 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 21s ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:56:25.794 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 18s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:56:25.794 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 21s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:56:25.795 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 18s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:56:25.795 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 21s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:56:25.795 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 18s ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:56:25.795 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 18s ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:56:25.796 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 18s ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:56:25.796 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 18s ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:56:25.796 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 21s ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:56:25.796 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 21s ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:56:25.796 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 21s ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:56:25.797 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 21s ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:56:25.797 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 18s ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:56:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:25.377236+0000 mgr.smithi067.rdualw (mgr.24569) 9318 : cluster [DBG] pgmap v8026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:56:26.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:25.447556+0000 mgr.smithi067.rdualw (mgr.24569) 9319 : audit [DBG] from='client.40354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:56:26.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:25.377236+0000 mgr.smithi067.rdualw (mgr.24569) 9318 : cluster [DBG] pgmap v8026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:56:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:25.447556+0000 mgr.smithi067.rdualw (mgr.24569) 9319 : audit [DBG] from='client.40354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:56:26.137 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:56:26.137 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:56:26.137 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:56:26.138 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:56:26.138 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:56:26.138 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:56:26.138 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:56:26.139 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:56:26.139 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:56:26.139 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:56:26.139 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:56:26.139 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:56:26.140 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:56:26.140 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:56:26.140 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:56:26.140 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:56:26.141 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:56:26.141 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:56:26.141 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:56:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:25.774224+0000 mgr.smithi067.rdualw (mgr.24569) 9320 : audit [DBG] from='client.40358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:56:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:26.135941+0000 mon.smithi061 (mon.0) 1990 : audit [DBG] from='client.? 172.21.15.61:0/134942472' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:56:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:25.774224+0000 mgr.smithi067.rdualw (mgr.24569) 9320 : audit [DBG] from='client.40358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:56:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:26.135941+0000 mon.smithi061 (mon.0) 1990 : audit [DBG] from='client.? 172.21.15.61:0/134942472' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:56:28.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:27.377858+0000 mgr.smithi067.rdualw (mgr.24569) 9321 : cluster [DBG] pgmap v8027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:28.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:27.377858+0000 mgr.smithi067.rdualw (mgr.24569) 9321 : cluster [DBG] pgmap v8027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:29.378621+0000 mgr.smithi067.rdualw (mgr.24569) 9322 : cluster [DBG] pgmap v8028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:29.378621+0000 mgr.smithi067.rdualw (mgr.24569) 9322 : cluster [DBG] pgmap v8028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:31.379543+0000 mgr.smithi067.rdualw (mgr.24569) 9323 : cluster [DBG] pgmap v8029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:31.379543+0000 mgr.smithi067.rdualw (mgr.24569) 9323 : cluster [DBG] pgmap v8029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:33.380229+0000 mgr.smithi067.rdualw (mgr.24569) 9324 : cluster [DBG] pgmap v8030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:33.380229+0000 mgr.smithi067.rdualw (mgr.24569) 9324 : cluster [DBG] pgmap v8030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:35.381045+0000 mgr.smithi067.rdualw (mgr.24569) 9325 : cluster [DBG] pgmap v8031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:56:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:35.916318+0000 mon.smithi067 (mon.1) 1418 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:56:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:35.916589+0000 mon.smithi067 (mon.1) 1419 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:56:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:35.916772+0000 mon.smithi061 (mon.0) 1991 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:56:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:35.917172+0000 mon.smithi061 (mon.0) 1992 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:56:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:35.381045+0000 mgr.smithi067.rdualw (mgr.24569) 9325 : cluster [DBG] pgmap v8031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:56:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:35.916318+0000 mon.smithi067 (mon.1) 1418 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:56:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:35.916589+0000 mon.smithi067 (mon.1) 1419 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:56:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:35.916772+0000 mon.smithi061 (mon.0) 1991 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:56:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:35.917172+0000 mon.smithi061 (mon.0) 1992 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:56:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:37.381833+0000 mgr.smithi067.rdualw (mgr.24569) 9326 : cluster [DBG] pgmap v8032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:37.381833+0000 mgr.smithi067.rdualw (mgr.24569) 9326 : cluster [DBG] pgmap v8032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:39.382559+0000 mgr.smithi067.rdualw (mgr.24569) 9327 : cluster [DBG] pgmap v8033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:39.382559+0000 mgr.smithi067.rdualw (mgr.24569) 9327 : cluster [DBG] pgmap v8033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:41.383470+0000 mgr.smithi067.rdualw (mgr.24569) 9328 : cluster [DBG] pgmap v8034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:41.383470+0000 mgr.smithi067.rdualw (mgr.24569) 9328 : cluster [DBG] pgmap v8034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:44.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:43.384125+0000 mgr.smithi067.rdualw (mgr.24569) 9329 : cluster [DBG] pgmap v8035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:44.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:43.384125+0000 mgr.smithi067.rdualw (mgr.24569) 9329 : cluster [DBG] pgmap v8035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:45.384895+0000 mgr.smithi067.rdualw (mgr.24569) 9330 : cluster [DBG] pgmap v8036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:56:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:45.384895+0000 mgr.smithi067.rdualw (mgr.24569) 9330 : cluster [DBG] pgmap v8036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:56:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:47.385633+0000 mgr.smithi067.rdualw (mgr.24569) 9331 : cluster [DBG] pgmap v8037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:47.385633+0000 mgr.smithi067.rdualw (mgr.24569) 9331 : cluster [DBG] pgmap v8037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:49.386414+0000 mgr.smithi067.rdualw (mgr.24569) 9332 : cluster [DBG] pgmap v8038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:49.386414+0000 mgr.smithi067.rdualw (mgr.24569) 9332 : cluster [DBG] pgmap v8038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:51.387439+0000 mgr.smithi067.rdualw (mgr.24569) 9333 : cluster [DBG] pgmap v8039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:51.387439+0000 mgr.smithi067.rdualw (mgr.24569) 9333 : cluster [DBG] pgmap v8039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:53.387955+0000 mgr.smithi067.rdualw (mgr.24569) 9334 : cluster [DBG] pgmap v8040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:53.387955+0000 mgr.smithi067.rdualw (mgr.24569) 9334 : cluster [DBG] pgmap v8040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:56.445 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:56:56.737 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:56:56.905 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 49s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:56:56.905 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 49s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:56:56.905 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 52s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:56:56.906 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 49s ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:56:56.906 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 49s ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:56:56.906 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 52s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:56:56.906 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 49s ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:56:56.907 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 52s ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:56:56.907 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 49s ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:56:56.908 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 52s ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:56:56.908 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 49s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:56:56.909 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 52s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:56:56.909 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 49s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:56:56.910 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 52s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:56:56.910 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 49s ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:56:56.910 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 49s ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:56:56.911 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 49s ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:56:56.911 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 49s ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:56:56.911 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 52s ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:56:56.911 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 52s ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:56:56.911 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 52s ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:56:56.912 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 52s ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:56:56.912 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 49s ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:56:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:55.388726+0000 mgr.smithi067.rdualw (mgr.24569) 9335 : cluster [DBG] pgmap v8041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:56:57.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:55.388726+0000 mgr.smithi067.rdualw (mgr.24569) 9335 : cluster [DBG] pgmap v8041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:56:57.081 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:56:57.081 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:56:57.082 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:56:57.082 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:56:57.082 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:56:57.082 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:56:57.083 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:56:57.083 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:56:57.083 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:56:57.083 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:56:57.083 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:56:57.084 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:56:57.084 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:56:57.084 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:56:57.084 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:56:57.084 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:56:57.085 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:56:57.085 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:56:57.085 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:56:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:56.431231+0000 mgr.smithi067.rdualw (mgr.24569) 9336 : audit [DBG] from='client.40366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:56:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:56.719677+0000 mgr.smithi067.rdualw (mgr.24569) 9337 : audit [DBG] from='client.40370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:56:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:56:57.080433+0000 mon.smithi061 (mon.0) 1993 : audit [DBG] from='client.? 172.21.15.61:0/3397909249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:56:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:56.431231+0000 mgr.smithi067.rdualw (mgr.24569) 9336 : audit [DBG] from='client.40366 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:56:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:56.719677+0000 mgr.smithi067.rdualw (mgr.24569) 9337 : audit [DBG] from='client.40370 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:56:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:56:57.080433+0000 mon.smithi061 (mon.0) 1993 : audit [DBG] from='client.? 172.21.15.61:0/3397909249' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:56:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:57.389342+0000 mgr.smithi067.rdualw (mgr.24569) 9338 : cluster [DBG] pgmap v8042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:56:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:57.389342+0000 mgr.smithi067.rdualw (mgr.24569) 9338 : cluster [DBG] pgmap v8042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:56:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:56:59.389899+0000 mgr.smithi067.rdualw (mgr.24569) 9339 : cluster [DBG] pgmap v8043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:56:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:56:59.389899+0000 mgr.smithi067.rdualw (mgr.24569) 9339 : cluster [DBG] pgmap v8043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:02.731 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:01.390901+0000 mgr.smithi067.rdualw (mgr.24569) 9340 : cluster [DBG] pgmap v8044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:01.390901+0000 mgr.smithi067.rdualw (mgr.24569) 9340 : cluster [DBG] pgmap v8044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:03.391634+0000 mgr.smithi067.rdualw (mgr.24569) 9341 : cluster [DBG] pgmap v8045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:03.391634+0000 mgr.smithi067.rdualw (mgr.24569) 9341 : cluster [DBG] pgmap v8045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:07.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:05.392445+0000 mgr.smithi067.rdualw (mgr.24569) 9342 : cluster [DBG] pgmap v8046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:57:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:05.392445+0000 mgr.smithi067.rdualw (mgr.24569) 9342 : cluster [DBG] pgmap v8046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:57:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:57:07.272940+0000 mon.smithi067 (mon.1) 1420 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:57:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:57:07.274467+0000 mon.smithi067 (mon.1) 1421 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:57:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:57:07.275440+0000 mon.smithi067 (mon.1) 1422 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:57:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:57:07.695005+0000 mon.smithi061 (mon.0) 1994 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:57:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:57:07.700774+0000 mon.smithi061 (mon.0) 1995 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:57:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:57:07.272940+0000 mon.smithi067 (mon.1) 1420 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:57:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:57:07.274467+0000 mon.smithi067 (mon.1) 1421 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:57:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:57:07.275440+0000 mon.smithi067 (mon.1) 1422 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:57:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:57:07.695005+0000 mon.smithi061 (mon.0) 1994 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:57:08.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:57:07.700774+0000 mon.smithi061 (mon.0) 1995 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:57:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:57:07.276289+0000 mgr.smithi067.rdualw (mgr.24569) 9343 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:57:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:07.393015+0000 mgr.smithi067.rdualw (mgr.24569) 9344 : cluster [DBG] pgmap v8047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:57:07.276289+0000 mgr.smithi067.rdualw (mgr.24569) 9343 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:57:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:07.393015+0000 mgr.smithi067.rdualw (mgr.24569) 9344 : cluster [DBG] pgmap v8047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:09.393636+0000 mgr.smithi067.rdualw (mgr.24569) 9345 : cluster [DBG] pgmap v8048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:09.393636+0000 mgr.smithi067.rdualw (mgr.24569) 9345 : cluster [DBG] pgmap v8048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:11.394553+0000 mgr.smithi067.rdualw (mgr.24569) 9346 : cluster [DBG] pgmap v8049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:11.394553+0000 mgr.smithi067.rdualw (mgr.24569) 9346 : cluster [DBG] pgmap v8049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:13.395135+0000 mgr.smithi067.rdualw (mgr.24569) 9347 : cluster [DBG] pgmap v8050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:13.395135+0000 mgr.smithi067.rdualw (mgr.24569) 9347 : cluster [DBG] pgmap v8050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:15.395964+0000 mgr.smithi067.rdualw (mgr.24569) 9348 : cluster [DBG] pgmap v8051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:57:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:15.395964+0000 mgr.smithi067.rdualw (mgr.24569) 9348 : cluster [DBG] pgmap v8051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:57:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:17.396548+0000 mgr.smithi067.rdualw (mgr.24569) 9349 : cluster [DBG] pgmap v8052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:17.396548+0000 mgr.smithi067.rdualw (mgr.24569) 9349 : cluster [DBG] pgmap v8052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:19.397072+0000 mgr.smithi067.rdualw (mgr.24569) 9350 : cluster [DBG] pgmap v8053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:19.397072+0000 mgr.smithi067.rdualw (mgr.24569) 9350 : cluster [DBG] pgmap v8053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:21.398109+0000 mgr.smithi067.rdualw (mgr.24569) 9351 : cluster [DBG] pgmap v8054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:21.398109+0000 mgr.smithi067.rdualw (mgr.24569) 9351 : cluster [DBG] pgmap v8054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:23.398766+0000 mgr.smithi067.rdualw (mgr.24569) 9352 : cluster [DBG] pgmap v8055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:23.398766+0000 mgr.smithi067.rdualw (mgr.24569) 9352 : cluster [DBG] pgmap v8055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:25.399647+0000 mgr.smithi067.rdualw (mgr.24569) 9353 : cluster [DBG] pgmap v8056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:57:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:25.399647+0000 mgr.smithi067.rdualw (mgr.24569) 9353 : cluster [DBG] pgmap v8056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:57:27.392 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:57:27.686 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:57:27.687 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 80s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:57:27.687 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 80s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:57:27.687 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 83s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:57:27.687 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 80s ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:57:27.688 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 80s ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:57:27.688 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 83s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:57:27.688 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 80s ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:57:27.688 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 83s ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:57:27.688 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 80s ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:57:27.689 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 83s ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:57:27.689 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 80s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:57:27.689 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 83s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:57:27.689 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 80s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:57:27.690 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 83s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:57:27.690 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 80s ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:57:27.690 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 80s ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:57:27.690 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 80s ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:57:27.691 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 80s ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:57:27.691 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 83s ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:57:27.691 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 83s ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:57:27.691 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 83s ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:57:27.691 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 83s ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:57:27.692 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 80s ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:57:28.027 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:57:28.028 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:57:28.028 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:57:28.028 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:57:28.028 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:57:28.029 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:57:28.029 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:57:28.030 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:57:28.030 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:57:28.030 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:57:28.030 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:57:28.031 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:57:28.031 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:57:28.031 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:57:28.031 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:57:28.032 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:57:28.032 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:57:28.032 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:57:28.032 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:57:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:57:27.377968+0000 mgr.smithi067.rdualw (mgr.24569) 9354 : audit [DBG] from='client.40378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:57:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:27.400214+0000 mgr.smithi067.rdualw (mgr.24569) 9355 : cluster [DBG] pgmap v8057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:57:27.669219+0000 mgr.smithi067.rdualw (mgr.24569) 9356 : audit [DBG] from='client.40382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:57:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:57:28.026417+0000 mon.smithi061 (mon.0) 1996 : audit [DBG] from='client.? 172.21.15.61:0/3720107857' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:57:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:57:27.377968+0000 mgr.smithi067.rdualw (mgr.24569) 9354 : audit [DBG] from='client.40378 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:57:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:27.400214+0000 mgr.smithi067.rdualw (mgr.24569) 9355 : cluster [DBG] pgmap v8057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:57:27.669219+0000 mgr.smithi067.rdualw (mgr.24569) 9356 : audit [DBG] from='client.40382 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:57:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:57:28.026417+0000 mon.smithi061 (mon.0) 1996 : audit [DBG] from='client.? 172.21.15.61:0/3720107857' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:57:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:29.400781+0000 mgr.smithi067.rdualw (mgr.24569) 9357 : cluster [DBG] pgmap v8058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:29.400781+0000 mgr.smithi067.rdualw (mgr.24569) 9357 : cluster [DBG] pgmap v8058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:31.401705+0000 mgr.smithi067.rdualw (mgr.24569) 9358 : cluster [DBG] pgmap v8059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:31.401705+0000 mgr.smithi067.rdualw (mgr.24569) 9358 : cluster [DBG] pgmap v8059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:33.402378+0000 mgr.smithi067.rdualw (mgr.24569) 9359 : cluster [DBG] pgmap v8060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:33.402378+0000 mgr.smithi067.rdualw (mgr.24569) 9359 : cluster [DBG] pgmap v8060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:35.403284+0000 mgr.smithi067.rdualw (mgr.24569) 9360 : cluster [DBG] pgmap v8061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:57:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:57:35.922222+0000 mon.smithi067 (mon.1) 1423 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:57:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:57:35.922574+0000 mon.smithi067 (mon.1) 1424 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:57:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:57:35.922690+0000 mon.smithi061 (mon.0) 1997 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:57:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:57:35.922958+0000 mon.smithi061 (mon.0) 1998 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:57:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:35.403284+0000 mgr.smithi067.rdualw (mgr.24569) 9360 : cluster [DBG] pgmap v8061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:57:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:57:35.922222+0000 mon.smithi067 (mon.1) 1423 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:57:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:57:35.922574+0000 mon.smithi067 (mon.1) 1424 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:57:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:57:35.922690+0000 mon.smithi061 (mon.0) 1997 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:57:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:57:35.922958+0000 mon.smithi061 (mon.0) 1998 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:57:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:37.403822+0000 mgr.smithi067.rdualw (mgr.24569) 9361 : cluster [DBG] pgmap v8062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:37.403822+0000 mgr.smithi067.rdualw (mgr.24569) 9361 : cluster [DBG] pgmap v8062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:39.404386+0000 mgr.smithi067.rdualw (mgr.24569) 9362 : cluster [DBG] pgmap v8063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:39.404386+0000 mgr.smithi067.rdualw (mgr.24569) 9362 : cluster [DBG] pgmap v8063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:41.405457+0000 mgr.smithi067.rdualw (mgr.24569) 9363 : cluster [DBG] pgmap v8064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:41.405457+0000 mgr.smithi067.rdualw (mgr.24569) 9363 : cluster [DBG] pgmap v8064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:43.405952+0000 mgr.smithi067.rdualw (mgr.24569) 9364 : cluster [DBG] pgmap v8065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:43.405952+0000 mgr.smithi067.rdualw (mgr.24569) 9364 : cluster [DBG] pgmap v8065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:45.406855+0000 mgr.smithi067.rdualw (mgr.24569) 9365 : cluster [DBG] pgmap v8066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:57:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:45.406855+0000 mgr.smithi067.rdualw (mgr.24569) 9365 : cluster [DBG] pgmap v8066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:57:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:47.407516+0000 mgr.smithi067.rdualw (mgr.24569) 9366 : cluster [DBG] pgmap v8067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:47.407516+0000 mgr.smithi067.rdualw (mgr.24569) 9366 : cluster [DBG] pgmap v8067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:49.408293+0000 mgr.smithi067.rdualw (mgr.24569) 9367 : cluster [DBG] pgmap v8068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:49.408293+0000 mgr.smithi067.rdualw (mgr.24569) 9367 : cluster [DBG] pgmap v8068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:51.409216+0000 mgr.smithi067.rdualw (mgr.24569) 9368 : cluster [DBG] pgmap v8069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:51.409216+0000 mgr.smithi067.rdualw (mgr.24569) 9368 : cluster [DBG] pgmap v8069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:53.409747+0000 mgr.smithi067.rdualw (mgr.24569) 9369 : cluster [DBG] pgmap v8070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:53.409747+0000 mgr.smithi067.rdualw (mgr.24569) 9369 : cluster [DBG] pgmap v8070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:55.410576+0000 mgr.smithi067.rdualw (mgr.24569) 9370 : cluster [DBG] pgmap v8071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:57:57.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:55.410576+0000 mgr.smithi067.rdualw (mgr.24569) 9370 : cluster [DBG] pgmap v8071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:57:58.337 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:57:58.628 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:57:58.628 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 111s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:57:58.628 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 111s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:57:58.629 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 114s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:57:58.629 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 111s ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:57:58.629 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 111s ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:57:58.629 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 114s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:57:58.630 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 111s ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:57:58.630 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 114s ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:57:58.630 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 111s ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:57:58.630 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 114s ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:57:58.631 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 111s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:57:58.631 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 114s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:57:58.631 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 111s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:57:58.631 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 114s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:57:58.631 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 111s ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:57:58.632 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 111s ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:57:58.632 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 111s ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:57:58.632 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 111s ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:57:58.632 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 114s ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:57:58.633 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 114s ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:57:58.633 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 114s ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:57:58.633 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 114s ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:57:58.633 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 111s ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:57:58.975 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:57:58.975 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:57:58.976 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:57:58.976 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:57:58.976 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:57:58.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:57:58.977 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:57:58.977 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:57:58.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:57:58.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:57:58.978 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:57:58.978 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:57:58.978 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:57:58.979 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:57:58.979 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:57:58.979 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:57:58.979 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:57:58.979 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:57:58.980 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:57:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:57.411050+0000 mgr.smithi067.rdualw (mgr.24569) 9371 : cluster [DBG] pgmap v8072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:57:59.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:57.411050+0000 mgr.smithi067.rdualw (mgr.24569) 9371 : cluster [DBG] pgmap v8072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:57:58.323702+0000 mgr.smithi067.rdualw (mgr.24569) 9372 : audit [DBG] from='client.40390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:58:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:57:58.610327+0000 mgr.smithi067.rdualw (mgr.24569) 9373 : audit [DBG] from='client.40394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:58:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:57:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:57:58.973788+0000 mon.smithi061 (mon.0) 1999 : audit [DBG] from='client.? 172.21.15.61:0/665543199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:58:00.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:57:58.323702+0000 mgr.smithi067.rdualw (mgr.24569) 9372 : audit [DBG] from='client.40390 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:58:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:57:58.610327+0000 mgr.smithi067.rdualw (mgr.24569) 9373 : audit [DBG] from='client.40394 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:58:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:57:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:57:58.973788+0000 mon.smithi061 (mon.0) 1999 : audit [DBG] from='client.? 172.21.15.61:0/665543199' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:58:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:57:59.411574+0000 mgr.smithi067.rdualw (mgr.24569) 9374 : cluster [DBG] pgmap v8073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:57:59.411574+0000 mgr.smithi067.rdualw (mgr.24569) 9374 : cluster [DBG] pgmap v8073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:01.412360+0000 mgr.smithi067.rdualw (mgr.24569) 9375 : cluster [DBG] pgmap v8074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:01.412360+0000 mgr.smithi067.rdualw (mgr.24569) 9375 : cluster [DBG] pgmap v8074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:03.413061+0000 mgr.smithi067.rdualw (mgr.24569) 9376 : cluster [DBG] pgmap v8075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:03.413061+0000 mgr.smithi067.rdualw (mgr.24569) 9376 : cluster [DBG] pgmap v8075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:05.413912+0000 mgr.smithi067.rdualw (mgr.24569) 9377 : cluster [DBG] pgmap v8076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:58:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:05.413912+0000 mgr.smithi067.rdualw (mgr.24569) 9377 : cluster [DBG] pgmap v8076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:58:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:58:07.703910+0000 mon.smithi067 (mon.1) 1425 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:58:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:58:07.705326+0000 mon.smithi067 (mon.1) 1426 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:58:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:58:07.706251+0000 mon.smithi067 (mon.1) 1427 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:58:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:58:07.703910+0000 mon.smithi067 (mon.1) 1425 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:58:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:58:07.705326+0000 mon.smithi067 (mon.1) 1426 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:58:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:58:07.706251+0000 mon.smithi067 (mon.1) 1427 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:58:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:07.414420+0000 mgr.smithi067.rdualw (mgr.24569) 9378 : cluster [DBG] pgmap v8077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:58:07.707091+0000 mgr.smithi067.rdualw (mgr.24569) 9379 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:58:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:58:08.062873+0000 mon.smithi061 (mon.0) 2000 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:58:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:58:08.075158+0000 mon.smithi061 (mon.0) 2001 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:58:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:58:08.478508+0000 mon.smithi061 (mon.0) 2002 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:58:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:58:08.486417+0000 mon.smithi061 (mon.0) 2003 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:58:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:07.414420+0000 mgr.smithi067.rdualw (mgr.24569) 9378 : cluster [DBG] pgmap v8077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:58:07.707091+0000 mgr.smithi067.rdualw (mgr.24569) 9379 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:58:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:58:08.062873+0000 mon.smithi061 (mon.0) 2000 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:58:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:58:08.075158+0000 mon.smithi061 (mon.0) 2001 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:58:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:58:08.478508+0000 mon.smithi061 (mon.0) 2002 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:58:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:58:08.486417+0000 mon.smithi061 (mon.0) 2003 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:58:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:09.415022+0000 mgr.smithi067.rdualw (mgr.24569) 9380 : cluster [DBG] pgmap v8078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:09.415022+0000 mgr.smithi067.rdualw (mgr.24569) 9380 : cluster [DBG] pgmap v8078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:11.416126+0000 mgr.smithi067.rdualw (mgr.24569) 9381 : cluster [DBG] pgmap v8079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:11.416126+0000 mgr.smithi067.rdualw (mgr.24569) 9381 : cluster [DBG] pgmap v8079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:13.416862+0000 mgr.smithi067.rdualw (mgr.24569) 9382 : cluster [DBG] pgmap v8080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:13.416862+0000 mgr.smithi067.rdualw (mgr.24569) 9382 : cluster [DBG] pgmap v8080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:15.417861+0000 mgr.smithi067.rdualw (mgr.24569) 9383 : cluster [DBG] pgmap v8081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:58:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:15.417861+0000 mgr.smithi067.rdualw (mgr.24569) 9383 : cluster [DBG] pgmap v8081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:58:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:17.418582+0000 mgr.smithi067.rdualw (mgr.24569) 9384 : cluster [DBG] pgmap v8082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:17.418582+0000 mgr.smithi067.rdualw (mgr.24569) 9384 : cluster [DBG] pgmap v8082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:19.419135+0000 mgr.smithi067.rdualw (mgr.24569) 9385 : cluster [DBG] pgmap v8083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:19.419135+0000 mgr.smithi067.rdualw (mgr.24569) 9385 : cluster [DBG] pgmap v8083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:21.419994+0000 mgr.smithi067.rdualw (mgr.24569) 9386 : cluster [DBG] pgmap v8084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:21.419994+0000 mgr.smithi067.rdualw (mgr.24569) 9386 : cluster [DBG] pgmap v8084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:23.420569+0000 mgr.smithi067.rdualw (mgr.24569) 9387 : cluster [DBG] pgmap v8085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:23.420569+0000 mgr.smithi067.rdualw (mgr.24569) 9387 : cluster [DBG] pgmap v8085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:25.421456+0000 mgr.smithi067.rdualw (mgr.24569) 9388 : cluster [DBG] pgmap v8086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:58:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:25.421456+0000 mgr.smithi067.rdualw (mgr.24569) 9388 : cluster [DBG] pgmap v8086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:58:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:27.421930+0000 mgr.smithi067.rdualw (mgr.24569) 9389 : cluster [DBG] pgmap v8087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:27.421930+0000 mgr.smithi067.rdualw (mgr.24569) 9389 : cluster [DBG] pgmap v8087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:29.392 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:58:29.733 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:58:29.733 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 2m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:58:29.734 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 2m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:58:29.734 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 2m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:58:29.734 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 2m ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:58:29.734 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 2m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:58:29.735 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 2m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:58:29.735 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 2m ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:58:29.735 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 2m ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:58:29.735 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 2m ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:58:29.736 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 2m ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:58:29.736 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 2m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:58:29.736 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 2m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:58:29.736 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 2m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:58:29.736 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 2m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:58:29.737 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 2m ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:58:29.737 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 2m ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:58:29.737 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 2m ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:58:29.737 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 2m ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:58:29.738 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 2m ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:58:29.738 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 2m ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:58:29.738 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 2m ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:58:29.738 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 2m ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:58:29.739 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 2m ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:58:30.075 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:58:30.076 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:58:30.076 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:58:30.076 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:58:30.077 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:58:30.077 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:58:30.077 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:58:30.077 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:58:30.077 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:58:30.078 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:58:30.078 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:58:30.078 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:58:30.078 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:58:30.079 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:58:30.079 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:58:30.079 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:58:30.079 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:58:30.080 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:58:30.080 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:58:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:58:29.378190+0000 mgr.smithi067.rdualw (mgr.24569) 9390 : audit [DBG] from='client.40402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:58:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:29.422702+0000 mgr.smithi067.rdualw (mgr.24569) 9391 : cluster [DBG] pgmap v8088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:58:29.715474+0000 mgr.smithi067.rdualw (mgr.24569) 9392 : audit [DBG] from='client.40406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:58:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:58:30.074587+0000 mon.smithi061 (mon.0) 2004 : audit [DBG] from='client.? 172.21.15.61:0/3417548826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:58:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:58:29.378190+0000 mgr.smithi067.rdualw (mgr.24569) 9390 : audit [DBG] from='client.40402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:58:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:29.422702+0000 mgr.smithi067.rdualw (mgr.24569) 9391 : cluster [DBG] pgmap v8088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:58:29.715474+0000 mgr.smithi067.rdualw (mgr.24569) 9392 : audit [DBG] from='client.40406 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:58:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:58:30.074587+0000 mon.smithi061 (mon.0) 2004 : audit [DBG] from='client.? 172.21.15.61:0/3417548826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:58:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:31.423577+0000 mgr.smithi067.rdualw (mgr.24569) 9393 : cluster [DBG] pgmap v8089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:31.423577+0000 mgr.smithi067.rdualw (mgr.24569) 9393 : cluster [DBG] pgmap v8089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:33.424147+0000 mgr.smithi067.rdualw (mgr.24569) 9394 : cluster [DBG] pgmap v8090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:33.424147+0000 mgr.smithi067.rdualw (mgr.24569) 9394 : cluster [DBG] pgmap v8090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:35.424999+0000 mgr.smithi067.rdualw (mgr.24569) 9395 : cluster [DBG] pgmap v8091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:58:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:58:35.928076+0000 mon.smithi067 (mon.1) 1428 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:58:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:58:35.928316+0000 mon.smithi067 (mon.1) 1429 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:58:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:58:35.928573+0000 mon.smithi061 (mon.0) 2005 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:58:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:58:35.929066+0000 mon.smithi061 (mon.0) 2006 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:58:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:35.424999+0000 mgr.smithi067.rdualw (mgr.24569) 9395 : cluster [DBG] pgmap v8091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:58:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:58:35.928076+0000 mon.smithi067 (mon.1) 1428 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:58:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:58:35.928316+0000 mon.smithi067 (mon.1) 1429 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:58:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:58:35.928573+0000 mon.smithi061 (mon.0) 2005 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:58:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:58:35.929066+0000 mon.smithi061 (mon.0) 2006 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:58:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:37.425750+0000 mgr.smithi067.rdualw (mgr.24569) 9396 : cluster [DBG] pgmap v8092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:38.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:37.425750+0000 mgr.smithi067.rdualw (mgr.24569) 9396 : cluster [DBG] pgmap v8092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:39.426352+0000 mgr.smithi067.rdualw (mgr.24569) 9397 : cluster [DBG] pgmap v8093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:39.426352+0000 mgr.smithi067.rdualw (mgr.24569) 9397 : cluster [DBG] pgmap v8093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:41.427411+0000 mgr.smithi067.rdualw (mgr.24569) 9398 : cluster [DBG] pgmap v8094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:41.427411+0000 mgr.smithi067.rdualw (mgr.24569) 9398 : cluster [DBG] pgmap v8094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:43.428009+0000 mgr.smithi067.rdualw (mgr.24569) 9399 : cluster [DBG] pgmap v8095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:43.428009+0000 mgr.smithi067.rdualw (mgr.24569) 9399 : cluster [DBG] pgmap v8095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:45.428957+0000 mgr.smithi067.rdualw (mgr.24569) 9400 : cluster [DBG] pgmap v8096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:58:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:45.428957+0000 mgr.smithi067.rdualw (mgr.24569) 9400 : cluster [DBG] pgmap v8096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:58:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:47.429607+0000 mgr.smithi067.rdualw (mgr.24569) 9401 : cluster [DBG] pgmap v8097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:47.429607+0000 mgr.smithi067.rdualw (mgr.24569) 9401 : cluster [DBG] pgmap v8097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:49.430238+0000 mgr.smithi067.rdualw (mgr.24569) 9402 : cluster [DBG] pgmap v8098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:49.430238+0000 mgr.smithi067.rdualw (mgr.24569) 9402 : cluster [DBG] pgmap v8098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:51.431226+0000 mgr.smithi067.rdualw (mgr.24569) 9403 : cluster [DBG] pgmap v8099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:51.431226+0000 mgr.smithi067.rdualw (mgr.24569) 9403 : cluster [DBG] pgmap v8099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:53.431904+0000 mgr.smithi067.rdualw (mgr.24569) 9404 : cluster [DBG] pgmap v8100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:53.431904+0000 mgr.smithi067.rdualw (mgr.24569) 9404 : cluster [DBG] pgmap v8100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:55.432752+0000 mgr.smithi067.rdualw (mgr.24569) 9405 : cluster [DBG] pgmap v8101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:58:57.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:55.432752+0000 mgr.smithi067.rdualw (mgr.24569) 9405 : cluster [DBG] pgmap v8101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:58:58.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:58:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:57.433366+0000 mgr.smithi067.rdualw (mgr.24569) 9406 : cluster [DBG] pgmap v8102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:58:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:58:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:57.433366+0000 mgr.smithi067.rdualw (mgr.24569) 9406 : cluster [DBG] pgmap v8102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:00.385 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:59:00.682 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:59:00.682 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 2m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:59:00.683 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 2m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:59:00.683 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 2m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:59:00.683 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 2m ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:59:00.684 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 2m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:59:00.684 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 2m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:59:00.684 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 2m ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:59:00.684 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 2m ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:59:00.685 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 2m ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:59:00.685 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 2m ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:59:00.685 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 2m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:59:00.685 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 2m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:59:00.685 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 2m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:59:00.686 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 2m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:59:00.686 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 2m ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:59:00.686 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 2m ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:59:00.686 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 2m ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:59:00.687 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 2m ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:59:00.687 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 2m ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:59:00.687 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 2m ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:59:00.687 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 2m ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:59:00.688 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 2m ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:59:00.688 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 2m ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:59:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:58:59.434069+0000 mgr.smithi067.rdualw (mgr.24569) 9407 : cluster [DBG] pgmap v8103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:58:59.434069+0000 mgr.smithi067.rdualw (mgr.24569) 9407 : cluster [DBG] pgmap v8103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:01.025 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:59:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:59:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:59:01.026 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:59:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:59:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:59:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:59:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:59:01.027 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:59:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:59:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:59:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:59:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:59:01.028 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:59:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:59:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:59:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:59:01.029 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:59:01.030 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:59:01.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:59:00.372123+0000 mgr.smithi067.rdualw (mgr.24569) 9408 : audit [DBG] from='client.40414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:59:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:59:00.664451+0000 mgr.smithi067.rdualw (mgr.24569) 9409 : audit [DBG] from='client.40418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:59:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:59:01.024278+0000 mon.smithi061 (mon.0) 2007 : audit [DBG] from='client.? 172.21.15.61:0/3482781868' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:59:01.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:59:00.372123+0000 mgr.smithi067.rdualw (mgr.24569) 9408 : audit [DBG] from='client.40414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:59:01.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:59:00.664451+0000 mgr.smithi067.rdualw (mgr.24569) 9409 : audit [DBG] from='client.40418 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:59:01.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:59:01.024278+0000 mon.smithi061 (mon.0) 2007 : audit [DBG] from='client.? 172.21.15.61:0/3482781868' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:59:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:01.435038+0000 mgr.smithi067.rdualw (mgr.24569) 9410 : cluster [DBG] pgmap v8104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:01.435038+0000 mgr.smithi067.rdualw (mgr.24569) 9410 : cluster [DBG] pgmap v8104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:03.435799+0000 mgr.smithi067.rdualw (mgr.24569) 9411 : cluster [DBG] pgmap v8105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:03.435799+0000 mgr.smithi067.rdualw (mgr.24569) 9411 : cluster [DBG] pgmap v8105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:07.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:05.436773+0000 mgr.smithi067.rdualw (mgr.24569) 9412 : cluster [DBG] pgmap v8106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:59:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:05.436773+0000 mgr.smithi067.rdualw (mgr.24569) 9412 : cluster [DBG] pgmap v8106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:59:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:07.437293+0000 mgr.smithi067.rdualw (mgr.24569) 9413 : cluster [DBG] pgmap v8107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:59:08.489588+0000 mon.smithi067 (mon.1) 1430 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:59:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:59:08.491117+0000 mon.smithi067 (mon.1) 1431 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:59:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:59:08.492056+0000 mon.smithi067 (mon.1) 1432 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:59:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:07.437293+0000 mgr.smithi067.rdualw (mgr.24569) 9413 : cluster [DBG] pgmap v8107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:59:08.489588+0000 mon.smithi067 (mon.1) 1430 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T19:59:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:59:08.491117+0000 mon.smithi067 (mon.1) 1431 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T19:59:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:59:08.492056+0000 mon.smithi067 (mon.1) 1432 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T19:59:10.019 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T19:59:08.492909+0000 mgr.smithi067.rdualw (mgr.24569) 9414 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:59:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T19:59:08.492909+0000 mgr.smithi067.rdualw (mgr.24569) 9414 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T19:59:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:09.437980+0000 mgr.smithi067.rdualw (mgr.24569) 9415 : cluster [DBG] pgmap v8108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:09.437980+0000 mgr.smithi067.rdualw (mgr.24569) 9415 : cluster [DBG] pgmap v8108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:11.439036+0000 mgr.smithi067.rdualw (mgr.24569) 9416 : cluster [DBG] pgmap v8109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:59:11.714455+0000 mon.smithi061 (mon.0) 2008 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:59:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:59:12.122112+0000 mon.smithi061 (mon.0) 2009 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:59:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:59:12.128809+0000 mon.smithi061 (mon.0) 2010 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:59:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:11.439036+0000 mgr.smithi067.rdualw (mgr.24569) 9416 : cluster [DBG] pgmap v8109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:59:11.714455+0000 mon.smithi061 (mon.0) 2008 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:59:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:59:12.122112+0000 mon.smithi061 (mon.0) 2009 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:59:13.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:59:12.128809+0000 mon.smithi061 (mon.0) 2010 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T19:59:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:13.439742+0000 mgr.smithi067.rdualw (mgr.24569) 9417 : cluster [DBG] pgmap v8110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:13.439742+0000 mgr.smithi067.rdualw (mgr.24569) 9417 : cluster [DBG] pgmap v8110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:15.440582+0000 mgr.smithi067.rdualw (mgr.24569) 9418 : cluster [DBG] pgmap v8111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:59:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:15.440582+0000 mgr.smithi067.rdualw (mgr.24569) 9418 : cluster [DBG] pgmap v8111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:59:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:17.441082+0000 mgr.smithi067.rdualw (mgr.24569) 9419 : cluster [DBG] pgmap v8112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:17.441082+0000 mgr.smithi067.rdualw (mgr.24569) 9419 : cluster [DBG] pgmap v8112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:19.441749+0000 mgr.smithi067.rdualw (mgr.24569) 9420 : cluster [DBG] pgmap v8113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:19.441749+0000 mgr.smithi067.rdualw (mgr.24569) 9420 : cluster [DBG] pgmap v8113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:21.442625+0000 mgr.smithi067.rdualw (mgr.24569) 9421 : cluster [DBG] pgmap v8114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:23.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:21.442625+0000 mgr.smithi067.rdualw (mgr.24569) 9421 : cluster [DBG] pgmap v8114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:23.443244+0000 mgr.smithi067.rdualw (mgr.24569) 9422 : cluster [DBG] pgmap v8115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:23.443244+0000 mgr.smithi067.rdualw (mgr.24569) 9422 : cluster [DBG] pgmap v8115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:25.444134+0000 mgr.smithi067.rdualw (mgr.24569) 9423 : cluster [DBG] pgmap v8116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:59:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:25.444134+0000 mgr.smithi067.rdualw (mgr.24569) 9423 : cluster [DBG] pgmap v8116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:59:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:27.444723+0000 mgr.smithi067.rdualw (mgr.24569) 9424 : cluster [DBG] pgmap v8117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:27.444723+0000 mgr.smithi067.rdualw (mgr.24569) 9424 : cluster [DBG] pgmap v8117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:29.445374+0000 mgr.smithi067.rdualw (mgr.24569) 9425 : cluster [DBG] pgmap v8118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:29.445374+0000 mgr.smithi067.rdualw (mgr.24569) 9425 : cluster [DBG] pgmap v8118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:31.333 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T19:59:31.624 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T19:59:31.624 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 3m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T19:59:31.624 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 3m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T19:59:31.625 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 3m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T19:59:31.625 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 3m ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T19:59:31.625 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 3m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T19:59:31.625 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 3m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T19:59:31.626 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 3m ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T19:59:31.626 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 3m ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T19:59:31.626 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 3m ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T19:59:31.626 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 3m ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T19:59:31.626 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 3m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T19:59:31.627 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 3m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T19:59:31.627 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 3m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T19:59:31.628 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 3m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T19:59:31.628 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 3m ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T19:59:31.628 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 3m ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T19:59:31.628 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 3m ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T19:59:31.629 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 3m ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T19:59:31.629 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 3m ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T19:59:31.629 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 3m ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T19:59:31.629 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 3m ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T19:59:31.630 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 3m ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T19:59:31.630 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 3m ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T19:59:31.969 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T19:59:31.970 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T19:59:31.970 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T19:59:31.970 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:59:31.970 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T19:59:31.970 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:59:31.971 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:59:31.971 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T19:59:31.971 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T19:59:31.971 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T19:59:31.972 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:59:31.972 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T19:59:31.972 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T19:59:31.972 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T19:59:31.972 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T19:59:31.973 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T19:59:31.973 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T19:59:31.973 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T19:59:31.973 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T19:59:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:59:31.319370+0000 mgr.smithi067.rdualw (mgr.24569) 9426 : audit [DBG] from='client.40426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:59:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:31.446239+0000 mgr.smithi067.rdualw (mgr.24569) 9427 : cluster [DBG] pgmap v8119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:59:31.605896+0000 mgr.smithi067.rdualw (mgr.24569) 9428 : audit [DBG] from='client.40430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:59:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:59:31.967848+0000 mon.smithi061 (mon.0) 2011 : audit [DBG] from='client.? 172.21.15.61:0/1062312365' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:59:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:59:31.319370+0000 mgr.smithi067.rdualw (mgr.24569) 9426 : audit [DBG] from='client.40426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:59:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:31.446239+0000 mgr.smithi067.rdualw (mgr.24569) 9427 : cluster [DBG] pgmap v8119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:59:31.605896+0000 mgr.smithi067.rdualw (mgr.24569) 9428 : audit [DBG] from='client.40430 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T19:59:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:59:31.967848+0000 mon.smithi061 (mon.0) 2011 : audit [DBG] from='client.? 172.21.15.61:0/1062312365' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T19:59:34.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:33.446777+0000 mgr.smithi067.rdualw (mgr.24569) 9429 : cluster [DBG] pgmap v8120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:34.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:33.446777+0000 mgr.smithi067.rdualw (mgr.24569) 9429 : cluster [DBG] pgmap v8120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:35.447778+0000 mgr.smithi067.rdualw (mgr.24569) 9430 : cluster [DBG] pgmap v8121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:59:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:59:35.933391+0000 mon.smithi067 (mon.1) 1433 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:59:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:59:35.933640+0000 mon.smithi067 (mon.1) 1434 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:59:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:59:35.933986+0000 mon.smithi061 (mon.0) 2012 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:59:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T19:59:35.934488+0000 mon.smithi061 (mon.0) 2013 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:59:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:35.447778+0000 mgr.smithi067.rdualw (mgr.24569) 9430 : cluster [DBG] pgmap v8121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:59:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:59:35.933391+0000 mon.smithi067 (mon.1) 1433 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:59:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:59:35.933640+0000 mon.smithi067 (mon.1) 1434 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:59:36.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:59:35.933986+0000 mon.smithi061 (mon.0) 2012 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T19:59:36.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T19:59:35.934488+0000 mon.smithi061 (mon.0) 2013 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T19:59:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:37.448511+0000 mgr.smithi067.rdualw (mgr.24569) 9431 : cluster [DBG] pgmap v8122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:37.448511+0000 mgr.smithi067.rdualw (mgr.24569) 9431 : cluster [DBG] pgmap v8122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:39.449162+0000 mgr.smithi067.rdualw (mgr.24569) 9432 : cluster [DBG] pgmap v8123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:39.449162+0000 mgr.smithi067.rdualw (mgr.24569) 9432 : cluster [DBG] pgmap v8123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:41.450244+0000 mgr.smithi067.rdualw (mgr.24569) 9433 : cluster [DBG] pgmap v8124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:41.450244+0000 mgr.smithi067.rdualw (mgr.24569) 9433 : cluster [DBG] pgmap v8124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:43.450982+0000 mgr.smithi067.rdualw (mgr.24569) 9434 : cluster [DBG] pgmap v8125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:43.450982+0000 mgr.smithi067.rdualw (mgr.24569) 9434 : cluster [DBG] pgmap v8125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:45.451773+0000 mgr.smithi067.rdualw (mgr.24569) 9435 : cluster [DBG] pgmap v8126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:59:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:45.451773+0000 mgr.smithi067.rdualw (mgr.24569) 9435 : cluster [DBG] pgmap v8126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:59:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:47.452266+0000 mgr.smithi067.rdualw (mgr.24569) 9436 : cluster [DBG] pgmap v8127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:47.452266+0000 mgr.smithi067.rdualw (mgr.24569) 9436 : cluster [DBG] pgmap v8127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:49.452856+0000 mgr.smithi067.rdualw (mgr.24569) 9437 : cluster [DBG] pgmap v8128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:49.452856+0000 mgr.smithi067.rdualw (mgr.24569) 9437 : cluster [DBG] pgmap v8128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:51.453771+0000 mgr.smithi067.rdualw (mgr.24569) 9438 : cluster [DBG] pgmap v8129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:51.453771+0000 mgr.smithi067.rdualw (mgr.24569) 9438 : cluster [DBG] pgmap v8129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:53.454362+0000 mgr.smithi067.rdualw (mgr.24569) 9439 : cluster [DBG] pgmap v8130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:53.454362+0000 mgr.smithi067.rdualw (mgr.24569) 9439 : cluster [DBG] pgmap v8130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:55.455276+0000 mgr.smithi067.rdualw (mgr.24569) 9440 : cluster [DBG] pgmap v8131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:59:57.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:55.455276+0000 mgr.smithi067.rdualw (mgr.24569) 9440 : cluster [DBG] pgmap v8131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T19:59:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 19:59:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:57.455878+0000 mgr.smithi067.rdualw (mgr.24569) 9441 : cluster [DBG] pgmap v8132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T19:59:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 19:59:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:57.455878+0000 mgr.smithi067.rdualw (mgr.24569) 9441 : cluster [DBG] pgmap v8132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T19:59:59.456517+0000 mgr.smithi067.rdualw (mgr.24569) 9442 : cluster [DBG] pgmap v8133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:00.000176+0000 mon.smithi061 (mon.0) 2014 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T20:00:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T19:59:59.456517+0000 mgr.smithi067.rdualw (mgr.24569) 9442 : cluster [DBG] pgmap v8133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:00.000176+0000 mon.smithi061 (mon.0) 2014 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T20:00:02.277 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:00:02.575 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:00:02.575 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 3m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:00:02.575 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 3m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:00:02.575 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 3m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:00:02.576 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 3m ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:00:02.576 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 3m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:00:02.576 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 3m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:00:02.576 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 3m ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:00:02.577 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 3m ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:00:02.577 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 3m ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:00:02.577 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 3m ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:00:02.577 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 3m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:00:02.577 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 3m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:00:02.578 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 3m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:00:02.578 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 3m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:00:02.578 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 3m ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:00:02.578 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 3m ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:00:02.579 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 3m ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:00:02.579 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 3m ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:00:02.579 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 3m ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:00:02.579 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 3m ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:00:02.580 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 3m ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:00:02.580 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 3m ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:00:02.580 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 3m ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:00:02.913 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:00:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:00:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:00:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:00:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:00:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:00:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:00:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:00:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:00:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:00:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:00:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:00:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:00:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:00:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:00:02.917 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:00:02.918 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:00:02.918 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:00:02.918 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:00:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:01.457625+0000 mgr.smithi067.rdualw (mgr.24569) 9443 : cluster [DBG] pgmap v8134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:01.457625+0000 mgr.smithi067.rdualw (mgr.24569) 9443 : cluster [DBG] pgmap v8134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:04.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:00:02.262279+0000 mgr.smithi067.rdualw (mgr.24569) 9444 : audit [DBG] from='client.40438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:00:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:00:02.557456+0000 mgr.smithi067.rdualw (mgr.24569) 9445 : audit [DBG] from='client.40442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:00:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:00:02.912482+0000 mon.smithi061 (mon.0) 2015 : audit [DBG] from='client.? 172.21.15.61:0/2954777638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:00:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:00:02.262279+0000 mgr.smithi067.rdualw (mgr.24569) 9444 : audit [DBG] from='client.40438 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:00:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:00:02.557456+0000 mgr.smithi067.rdualw (mgr.24569) 9445 : audit [DBG] from='client.40442 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:00:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:00:02.912482+0000 mon.smithi061 (mon.0) 2015 : audit [DBG] from='client.? 172.21.15.61:0/2954777638' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:00:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:03.458132+0000 mgr.smithi067.rdualw (mgr.24569) 9446 : cluster [DBG] pgmap v8135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:03.458132+0000 mgr.smithi067.rdualw (mgr.24569) 9446 : cluster [DBG] pgmap v8135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:05.459184+0000 mgr.smithi067.rdualw (mgr.24569) 9447 : cluster [DBG] pgmap v8136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:00:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:05.459184+0000 mgr.smithi067.rdualw (mgr.24569) 9447 : cluster [DBG] pgmap v8136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:00:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:07.459908+0000 mgr.smithi067.rdualw (mgr.24569) 9448 : cluster [DBG] pgmap v8137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:07.459908+0000 mgr.smithi067.rdualw (mgr.24569) 9448 : cluster [DBG] pgmap v8137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:09.460599+0000 mgr.smithi067.rdualw (mgr.24569) 9449 : cluster [DBG] pgmap v8138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:09.460599+0000 mgr.smithi067.rdualw (mgr.24569) 9449 : cluster [DBG] pgmap v8138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:11.461497+0000 mgr.smithi067.rdualw (mgr.24569) 9450 : cluster [DBG] pgmap v8139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:00:12.133212+0000 mon.smithi067 (mon.1) 1435 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:00:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:00:12.134657+0000 mon.smithi067 (mon.1) 1436 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:00:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:00:12.135672+0000 mon.smithi067 (mon.1) 1437 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:00:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:11.461497+0000 mgr.smithi067.rdualw (mgr.24569) 9450 : cluster [DBG] pgmap v8139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:00:12.133212+0000 mon.smithi067 (mon.1) 1435 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:00:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:00:12.134657+0000 mon.smithi067 (mon.1) 1436 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:00:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:00:12.135672+0000 mon.smithi067 (mon.1) 1437 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:00:13.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:00:12.136472+0000 mgr.smithi067.rdualw (mgr.24569) 9451 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:00:14.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:00:12.136472+0000 mgr.smithi067.rdualw (mgr.24569) 9451 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:00:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:13.462223+0000 mgr.smithi067.rdualw (mgr.24569) 9452 : cluster [DBG] pgmap v8140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:13.462223+0000 mgr.smithi067.rdualw (mgr.24569) 9452 : cluster [DBG] pgmap v8140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:00:15.152037+0000 mon.smithi061 (mon.0) 2016 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:00:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:00:15.455292+0000 mon.smithi061 (mon.0) 2017 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:00:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:00:15.460919+0000 mon.smithi061 (mon.0) 2018 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:00:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:15.463080+0000 mgr.smithi067.rdualw (mgr.24569) 9453 : cluster [DBG] pgmap v8141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:00:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:00:15.152037+0000 mon.smithi061 (mon.0) 2016 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:00:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:00:15.455292+0000 mon.smithi061 (mon.0) 2017 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:00:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:00:15.460919+0000 mon.smithi061 (mon.0) 2018 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:00:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:15.463080+0000 mgr.smithi067.rdualw (mgr.24569) 9453 : cluster [DBG] pgmap v8141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:00:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:17.463582+0000 mgr.smithi067.rdualw (mgr.24569) 9454 : cluster [DBG] pgmap v8142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:17.463582+0000 mgr.smithi067.rdualw (mgr.24569) 9454 : cluster [DBG] pgmap v8142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:21.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:19.464353+0000 mgr.smithi067.rdualw (mgr.24569) 9455 : cluster [DBG] pgmap v8143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:19.464353+0000 mgr.smithi067.rdualw (mgr.24569) 9455 : cluster [DBG] pgmap v8143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:21.465416+0000 mgr.smithi067.rdualw (mgr.24569) 9456 : cluster [DBG] pgmap v8144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:21.465416+0000 mgr.smithi067.rdualw (mgr.24569) 9456 : cluster [DBG] pgmap v8144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:23.466019+0000 mgr.smithi067.rdualw (mgr.24569) 9457 : cluster [DBG] pgmap v8145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:23.466019+0000 mgr.smithi067.rdualw (mgr.24569) 9457 : cluster [DBG] pgmap v8145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:25.466820+0000 mgr.smithi067.rdualw (mgr.24569) 9458 : cluster [DBG] pgmap v8146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:00:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:25.466820+0000 mgr.smithi067.rdualw (mgr.24569) 9458 : cluster [DBG] pgmap v8146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:00:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:27.467518+0000 mgr.smithi067.rdualw (mgr.24569) 9459 : cluster [DBG] pgmap v8147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:27.467518+0000 mgr.smithi067.rdualw (mgr.24569) 9459 : cluster [DBG] pgmap v8147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:29.468308+0000 mgr.smithi067.rdualw (mgr.24569) 9460 : cluster [DBG] pgmap v8148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:29.468308+0000 mgr.smithi067.rdualw (mgr.24569) 9460 : cluster [DBG] pgmap v8148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:31.469242+0000 mgr.smithi067.rdualw (mgr.24569) 9461 : cluster [DBG] pgmap v8149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:31.469242+0000 mgr.smithi067.rdualw (mgr.24569) 9461 : cluster [DBG] pgmap v8149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:33.224 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:00:33.516 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:00:33.516 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 4m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:00:33.516 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 4m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:00:33.517 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 4m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:00:33.517 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 4m ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:00:33.517 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 4m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:00:33.517 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 4m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:00:33.517 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 4m ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:00:33.518 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 4m ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:00:33.518 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 4m ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:00:33.518 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 4m ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:00:33.518 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 4m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:00:33.519 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 4m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:00:33.519 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 4m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:00:33.520 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 4m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:00:33.520 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 4m ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:00:33.520 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 4m ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:00:33.520 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 4m ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:00:33.521 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 4m ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:00:33.521 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 4m ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:00:33.521 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 4m ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:00:33.521 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 4m ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:00:33.522 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 4m ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:00:33.522 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 4m ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:00:33.858 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:00:33.858 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:00:33.858 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:00:33.859 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:00:33.859 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:00:33.859 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:00:33.859 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:00:33.860 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:00:33.860 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:00:33.860 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:00:33.860 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:00:33.860 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:00:33.861 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:00:33.861 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:00:33.861 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:00:33.861 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:00:33.862 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:00:33.862 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:00:33.862 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:00:35.059 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:00:33.210605+0000 mgr.smithi067.rdualw (mgr.24569) 9462 : audit [DBG] from='client.40450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:00:35.060 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:33.469981+0000 mgr.smithi067.rdualw (mgr.24569) 9463 : cluster [DBG] pgmap v8150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:35.060 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:00:33.497929+0000 mgr.smithi067.rdualw (mgr.24569) 9464 : audit [DBG] from='client.40454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:00:35.061 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:00:33.856950+0000 mon.smithi061 (mon.0) 2019 : audit [DBG] from='client.? 172.21.15.61:0/3297577979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:00:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:00:33.210605+0000 mgr.smithi067.rdualw (mgr.24569) 9462 : audit [DBG] from='client.40450 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:00:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:33.469981+0000 mgr.smithi067.rdualw (mgr.24569) 9463 : cluster [DBG] pgmap v8150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:00:33.497929+0000 mgr.smithi067.rdualw (mgr.24569) 9464 : audit [DBG] from='client.40454 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:00:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:00:33.856950+0000 mon.smithi061 (mon.0) 2019 : audit [DBG] from='client.? 172.21.15.61:0/3297577979' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:00:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:35.470892+0000 mgr.smithi067.rdualw (mgr.24569) 9465 : cluster [DBG] pgmap v8151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:00:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:00:35.938174+0000 mon.smithi067 (mon.1) 1438 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:00:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:00:35.938545+0000 mon.smithi067 (mon.1) 1439 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:00:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:00:35.938902+0000 mon.smithi061 (mon.0) 2020 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:00:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:00:35.939216+0000 mon.smithi061 (mon.0) 2021 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:00:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:35.470892+0000 mgr.smithi067.rdualw (mgr.24569) 9465 : cluster [DBG] pgmap v8151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:00:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:00:35.938174+0000 mon.smithi067 (mon.1) 1438 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:00:37.072 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:00:35.938545+0000 mon.smithi067 (mon.1) 1439 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:00:37.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:00:35.938902+0000 mon.smithi061 (mon.0) 2020 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:00:37.073 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:00:35.939216+0000 mon.smithi061 (mon.0) 2021 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:00:39.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:37.471565+0000 mgr.smithi067.rdualw (mgr.24569) 9466 : cluster [DBG] pgmap v8152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:39.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:37.471565+0000 mgr.smithi067.rdualw (mgr.24569) 9466 : cluster [DBG] pgmap v8152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:39.472187+0000 mgr.smithi067.rdualw (mgr.24569) 9467 : cluster [DBG] pgmap v8153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:39.472187+0000 mgr.smithi067.rdualw (mgr.24569) 9467 : cluster [DBG] pgmap v8153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:41.473133+0000 mgr.smithi067.rdualw (mgr.24569) 9468 : cluster [DBG] pgmap v8154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:41.473133+0000 mgr.smithi067.rdualw (mgr.24569) 9468 : cluster [DBG] pgmap v8154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:43.473696+0000 mgr.smithi067.rdualw (mgr.24569) 9469 : cluster [DBG] pgmap v8155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:43.473696+0000 mgr.smithi067.rdualw (mgr.24569) 9469 : cluster [DBG] pgmap v8155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:45.474672+0000 mgr.smithi067.rdualw (mgr.24569) 9470 : cluster [DBG] pgmap v8156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:00:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:45.474672+0000 mgr.smithi067.rdualw (mgr.24569) 9470 : cluster [DBG] pgmap v8156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:00:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:47.475377+0000 mgr.smithi067.rdualw (mgr.24569) 9471 : cluster [DBG] pgmap v8157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:47.475377+0000 mgr.smithi067.rdualw (mgr.24569) 9471 : cluster [DBG] pgmap v8157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:50.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:49.476083+0000 mgr.smithi067.rdualw (mgr.24569) 9472 : cluster [DBG] pgmap v8158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:49.476083+0000 mgr.smithi067.rdualw (mgr.24569) 9472 : cluster [DBG] pgmap v8158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:51.476970+0000 mgr.smithi067.rdualw (mgr.24569) 9473 : cluster [DBG] pgmap v8159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:51.476970+0000 mgr.smithi067.rdualw (mgr.24569) 9473 : cluster [DBG] pgmap v8159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:55.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:53.477517+0000 mgr.smithi067.rdualw (mgr.24569) 9474 : cluster [DBG] pgmap v8160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:53.477517+0000 mgr.smithi067.rdualw (mgr.24569) 9474 : cluster [DBG] pgmap v8160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:55.478616+0000 mgr.smithi067.rdualw (mgr.24569) 9475 : cluster [DBG] pgmap v8161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:00:57.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:55.478616+0000 mgr.smithi067.rdualw (mgr.24569) 9475 : cluster [DBG] pgmap v8161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:00:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:00:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:57.479304+0000 mgr.smithi067.rdualw (mgr.24569) 9476 : cluster [DBG] pgmap v8162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:00:59.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:00:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:57.479304+0000 mgr.smithi067.rdualw (mgr.24569) 9476 : cluster [DBG] pgmap v8162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:00:59.479978+0000 mgr.smithi067.rdualw (mgr.24569) 9477 : cluster [DBG] pgmap v8163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:00:59.479978+0000 mgr.smithi067.rdualw (mgr.24569) 9477 : cluster [DBG] pgmap v8163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:01.480949+0000 mgr.smithi067.rdualw (mgr.24569) 9478 : cluster [DBG] pgmap v8164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:03.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:01.480949+0000 mgr.smithi067.rdualw (mgr.24569) 9478 : cluster [DBG] pgmap v8164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:03.481477+0000 mgr.smithi067.rdualw (mgr.24569) 9479 : cluster [DBG] pgmap v8165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:04.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:03.481477+0000 mgr.smithi067.rdualw (mgr.24569) 9479 : cluster [DBG] pgmap v8165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:04.167 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:01:04.459 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:01:04.460 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 4m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:01:04.460 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 4m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:01:04.460 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 5m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:01:04.461 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 4m ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:01:04.461 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 4m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:01:04.461 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 5m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:01:04.461 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 4m ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:01:04.461 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 5m ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:01:04.462 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 4m ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:01:04.462 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 5m ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:01:04.462 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 4m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:01:04.462 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 5m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:01:04.463 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 4m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:01:04.463 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 5m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:01:04.463 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 4m ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:01:04.463 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 4m ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:01:04.463 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 4m ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:01:04.464 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 4m ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:01:04.464 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 5m ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:01:04.464 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 5m ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:01:04.464 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 5m ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:01:04.465 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 5m ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:01:04.465 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 4m ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:01:04.805 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:01:04.805 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:01:04.805 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:01:04.806 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:01:04.806 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:01:04.806 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:01:04.807 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:01:04.807 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:01:04.807 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:01:04.807 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:01:04.807 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:01:04.808 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:01:04.808 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:01:04.808 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:01:04.808 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:01:04.809 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:01:04.809 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:01:04.809 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:01:04.809 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:01:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:01:04.151038+0000 mgr.smithi067.rdualw (mgr.24569) 9480 : audit [DBG] from='client.40462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:01:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:01:04.441891+0000 mgr.smithi067.rdualw (mgr.24569) 9481 : audit [DBG] from='client.40466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:01:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:01:04.151038+0000 mgr.smithi067.rdualw (mgr.24569) 9480 : audit [DBG] from='client.40462 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:01:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:01:04.441891+0000 mgr.smithi067.rdualw (mgr.24569) 9481 : audit [DBG] from='client.40466 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:01:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:01:04.803705+0000 mon.smithi061 (mon.0) 2022 : audit [DBG] from='client.? 172.21.15.61:0/994476139' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:01:06.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:05.482314+0000 mgr.smithi067.rdualw (mgr.24569) 9482 : cluster [DBG] pgmap v8166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:01:06.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:01:04.803705+0000 mon.smithi061 (mon.0) 2022 : audit [DBG] from='client.? 172.21.15.61:0/994476139' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:01:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:05.482314+0000 mgr.smithi067.rdualw (mgr.24569) 9482 : cluster [DBG] pgmap v8166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:01:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:07.482832+0000 mgr.smithi067.rdualw (mgr.24569) 9483 : cluster [DBG] pgmap v8167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:07.482832+0000 mgr.smithi067.rdualw (mgr.24569) 9483 : cluster [DBG] pgmap v8167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:11.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:09.483464+0000 mgr.smithi067.rdualw (mgr.24569) 9484 : cluster [DBG] pgmap v8168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:09.483464+0000 mgr.smithi067.rdualw (mgr.24569) 9484 : cluster [DBG] pgmap v8168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:11.484406+0000 mgr.smithi067.rdualw (mgr.24569) 9485 : cluster [DBG] pgmap v8169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:11.484406+0000 mgr.smithi067.rdualw (mgr.24569) 9485 : cluster [DBG] pgmap v8169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:13.485133+0000 mgr.smithi067.rdualw (mgr.24569) 9486 : cluster [DBG] pgmap v8170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:13.485133+0000 mgr.smithi067.rdualw (mgr.24569) 9486 : cluster [DBG] pgmap v8170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:16.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:01:15.467116+0000 mon.smithi067 (mon.1) 1440 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:01:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:01:15.468586+0000 mon.smithi067 (mon.1) 1441 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:01:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:01:15.469530+0000 mon.smithi067 (mon.1) 1442 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:01:16.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:01:15.467116+0000 mon.smithi067 (mon.1) 1440 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:01:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:01:15.468586+0000 mon.smithi067 (mon.1) 1441 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:01:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:01:15.469530+0000 mon.smithi067 (mon.1) 1442 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:01:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:01:15.470430+0000 mgr.smithi067.rdualw (mgr.24569) 9487 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:01:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:15.486011+0000 mgr.smithi067.rdualw (mgr.24569) 9488 : cluster [DBG] pgmap v8171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:01:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:01:15.918810+0000 mon.smithi061 (mon.0) 2023 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:01:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:01:15.924253+0000 mon.smithi061 (mon.0) 2024 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:01:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:01:15.470430+0000 mgr.smithi067.rdualw (mgr.24569) 9487 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:01:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:15.486011+0000 mgr.smithi067.rdualw (mgr.24569) 9488 : cluster [DBG] pgmap v8171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:01:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:01:15.918810+0000 mon.smithi061 (mon.0) 2023 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:01:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:01:15.924253+0000 mon.smithi061 (mon.0) 2024 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:01:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:17.486732+0000 mgr.smithi067.rdualw (mgr.24569) 9489 : cluster [DBG] pgmap v8172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:17.486732+0000 mgr.smithi067.rdualw (mgr.24569) 9489 : cluster [DBG] pgmap v8172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:19.487333+0000 mgr.smithi067.rdualw (mgr.24569) 9490 : cluster [DBG] pgmap v8173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:19.487333+0000 mgr.smithi067.rdualw (mgr.24569) 9490 : cluster [DBG] pgmap v8173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:21.488188+0000 mgr.smithi067.rdualw (mgr.24569) 9491 : cluster [DBG] pgmap v8174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:21.488188+0000 mgr.smithi067.rdualw (mgr.24569) 9491 : cluster [DBG] pgmap v8174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:23.488876+0000 mgr.smithi067.rdualw (mgr.24569) 9492 : cluster [DBG] pgmap v8175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:23.488876+0000 mgr.smithi067.rdualw (mgr.24569) 9492 : cluster [DBG] pgmap v8175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:25.489708+0000 mgr.smithi067.rdualw (mgr.24569) 9493 : cluster [DBG] pgmap v8176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:01:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:25.489708+0000 mgr.smithi067.rdualw (mgr.24569) 9493 : cluster [DBG] pgmap v8176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:01:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:27.490191+0000 mgr.smithi067.rdualw (mgr.24569) 9494 : cluster [DBG] pgmap v8177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:27.490191+0000 mgr.smithi067.rdualw (mgr.24569) 9494 : cluster [DBG] pgmap v8177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:29.490885+0000 mgr.smithi067.rdualw (mgr.24569) 9495 : cluster [DBG] pgmap v8178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:29.490885+0000 mgr.smithi067.rdualw (mgr.24569) 9495 : cluster [DBG] pgmap v8178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:31.491891+0000 mgr.smithi067.rdualw (mgr.24569) 9496 : cluster [DBG] pgmap v8179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:31.491891+0000 mgr.smithi067.rdualw (mgr.24569) 9496 : cluster [DBG] pgmap v8179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:35.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:33.492457+0000 mgr.smithi067.rdualw (mgr.24569) 9497 : cluster [DBG] pgmap v8180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:33.492457+0000 mgr.smithi067.rdualw (mgr.24569) 9497 : cluster [DBG] pgmap v8180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:35.115 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:01:35.415 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:01:35.415 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 5m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:01:35.415 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 5m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:01:35.416 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 5m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:01:35.416 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 5m ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:01:35.416 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 5m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:01:35.416 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 5m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:01:35.417 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 5m ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:01:35.417 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 5m ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:01:35.417 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 5m ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:01:35.417 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 5m ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:01:35.417 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 5m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:01:35.418 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 5m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:01:35.418 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 5m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:01:35.418 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 5m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:01:35.418 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 5m ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:01:35.419 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 5m ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:01:35.419 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 5m ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:01:35.419 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 5m ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:01:35.419 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 5m ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:01:35.420 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 5m ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:01:35.420 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 5m ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:01:35.420 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 5m ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:01:35.420 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 5m ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:01:35.808 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:01:35.809 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:01:35.809 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:01:35.809 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:01:35.809 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:01:35.809 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:01:35.810 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:01:35.810 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:01:35.810 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:01:35.810 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:01:35.811 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:01:35.811 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:01:35.811 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:01:35.811 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:01:35.812 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:01:35.812 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:01:35.812 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:01:35.812 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:01:35.812 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:01:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:01:35.102118+0000 mgr.smithi067.rdualw (mgr.24569) 9498 : audit [DBG] from='client.40474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:01:36.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:01:35.397388+0000 mgr.smithi067.rdualw (mgr.24569) 9499 : audit [DBG] from='client.40478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:01:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:35.493340+0000 mgr.smithi067.rdualw (mgr.24569) 9500 : cluster [DBG] pgmap v8181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:01:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:01:35.102118+0000 mgr.smithi067.rdualw (mgr.24569) 9498 : audit [DBG] from='client.40474 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:01:36.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:01:35.397388+0000 mgr.smithi067.rdualw (mgr.24569) 9499 : audit [DBG] from='client.40478 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:01:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:35.493340+0000 mgr.smithi067.rdualw (mgr.24569) 9500 : cluster [DBG] pgmap v8181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:01:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:01:35.807364+0000 mon.smithi061 (mon.0) 2025 : audit [DBG] from='client.? 172.21.15.61:0/35734401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:01:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:01:35.944131+0000 mon.smithi067 (mon.1) 1443 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:01:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:01:35.944369+0000 mon.smithi067 (mon.1) 1444 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:01:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:01:35.944668+0000 mon.smithi061 (mon.0) 2026 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:01:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:01:35.944961+0000 mon.smithi061 (mon.0) 2027 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:01:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:01:35.807364+0000 mon.smithi061 (mon.0) 2025 : audit [DBG] from='client.? 172.21.15.61:0/35734401' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:01:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:01:35.944131+0000 mon.smithi067 (mon.1) 1443 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:01:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:01:35.944369+0000 mon.smithi067 (mon.1) 1444 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:01:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:01:35.944668+0000 mon.smithi061 (mon.0) 2026 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:01:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:01:35.944961+0000 mon.smithi061 (mon.0) 2027 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:01:38.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:37.493952+0000 mgr.smithi067.rdualw (mgr.24569) 9501 : cluster [DBG] pgmap v8182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:37.493952+0000 mgr.smithi067.rdualw (mgr.24569) 9501 : cluster [DBG] pgmap v8182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:39.494597+0000 mgr.smithi067.rdualw (mgr.24569) 9502 : cluster [DBG] pgmap v8183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:39.494597+0000 mgr.smithi067.rdualw (mgr.24569) 9502 : cluster [DBG] pgmap v8183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:41.495445+0000 mgr.smithi067.rdualw (mgr.24569) 9503 : cluster [DBG] pgmap v8184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:41.495445+0000 mgr.smithi067.rdualw (mgr.24569) 9503 : cluster [DBG] pgmap v8184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:43.496018+0000 mgr.smithi067.rdualw (mgr.24569) 9504 : cluster [DBG] pgmap v8185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:43.496018+0000 mgr.smithi067.rdualw (mgr.24569) 9504 : cluster [DBG] pgmap v8185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:45.496826+0000 mgr.smithi067.rdualw (mgr.24569) 9505 : cluster [DBG] pgmap v8186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:01:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:45.496826+0000 mgr.smithi067.rdualw (mgr.24569) 9505 : cluster [DBG] pgmap v8186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:01:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:47.497507+0000 mgr.smithi067.rdualw (mgr.24569) 9506 : cluster [DBG] pgmap v8187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:47.497507+0000 mgr.smithi067.rdualw (mgr.24569) 9506 : cluster [DBG] pgmap v8187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:49.498299+0000 mgr.smithi067.rdualw (mgr.24569) 9507 : cluster [DBG] pgmap v8188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:49.498299+0000 mgr.smithi067.rdualw (mgr.24569) 9507 : cluster [DBG] pgmap v8188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:53.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:51.499279+0000 mgr.smithi067.rdualw (mgr.24569) 9508 : cluster [DBG] pgmap v8189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:51.499279+0000 mgr.smithi067.rdualw (mgr.24569) 9508 : cluster [DBG] pgmap v8189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:54.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:53.499897+0000 mgr.smithi067.rdualw (mgr.24569) 9509 : cluster [DBG] pgmap v8190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:53.499897+0000 mgr.smithi067.rdualw (mgr.24569) 9509 : cluster [DBG] pgmap v8190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:56.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:55.500738+0000 mgr.smithi067.rdualw (mgr.24569) 9510 : cluster [DBG] pgmap v8191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:01:56.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:55.500738+0000 mgr.smithi067.rdualw (mgr.24569) 9510 : cluster [DBG] pgmap v8191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:01:59.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:01:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:57.501376+0000 mgr.smithi067.rdualw (mgr.24569) 9511 : cluster [DBG] pgmap v8192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:01:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:01:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:57.501376+0000 mgr.smithi067.rdualw (mgr.24569) 9511 : cluster [DBG] pgmap v8192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:01:59.501982+0000 mgr.smithi067.rdualw (mgr.24569) 9512 : cluster [DBG] pgmap v8193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:01:59.501982+0000 mgr.smithi067.rdualw (mgr.24569) 9512 : cluster [DBG] pgmap v8193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:01.502906+0000 mgr.smithi067.rdualw (mgr.24569) 9513 : cluster [DBG] pgmap v8194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:01.502906+0000 mgr.smithi067.rdualw (mgr.24569) 9513 : cluster [DBG] pgmap v8194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:03.503629+0000 mgr.smithi067.rdualw (mgr.24569) 9514 : cluster [DBG] pgmap v8195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:03.503629+0000 mgr.smithi067.rdualw (mgr.24569) 9514 : cluster [DBG] pgmap v8195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:06.116 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:02:06.408 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:02:06.409 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 5m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:02:06.409 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 5m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:02:06.409 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 6m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:02:06.409 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 5m ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:02:06.409 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 5m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:02:06.410 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 6m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:02:06.410 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 5m ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:02:06.410 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 6m ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:02:06.410 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 5m ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:02:06.411 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 6m ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:02:06.411 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 5m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:02:06.411 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 6m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:02:06.411 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 5m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:02:06.412 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 6m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:02:06.412 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 5m ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:02:06.412 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 5m ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:02:06.412 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 5m ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:02:06.412 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 5m ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:02:06.413 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 6m ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:02:06.413 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 6m ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:02:06.413 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 6m ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:02:06.413 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 6m ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:02:06.413 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 5m ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:02:06.748 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:02:06.748 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:02:06.748 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:02:06.749 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:02:06.749 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:02:06.749 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:02:06.749 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:02:06.750 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:02:06.750 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:02:06.750 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:02:06.750 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:02:06.751 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:02:06.751 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:02:06.751 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:02:06.751 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:02:06.751 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:02:06.752 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:02:06.752 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:02:06.752 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:02:07.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:05.504463+0000 mgr.smithi067.rdualw (mgr.24569) 9515 : cluster [DBG] pgmap v8196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:02:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:02:06.746857+0000 mon.smithi061 (mon.0) 2028 : audit [DBG] from='client.? 172.21.15.61:0/2574519222' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:02:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:05.504463+0000 mgr.smithi067.rdualw (mgr.24569) 9515 : cluster [DBG] pgmap v8196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:02:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:02:06.746857+0000 mon.smithi061 (mon.0) 2028 : audit [DBG] from='client.? 172.21.15.61:0/2574519222' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:02:08.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:02:06.102963+0000 mgr.smithi067.rdualw (mgr.24569) 9516 : audit [DBG] from='client.40486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:02:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:02:06.390993+0000 mgr.smithi067.rdualw (mgr.24569) 9517 : audit [DBG] from='client.40490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:02:08.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:02:06.102963+0000 mgr.smithi067.rdualw (mgr.24569) 9516 : audit [DBG] from='client.40486 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:02:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:02:06.390993+0000 mgr.smithi067.rdualw (mgr.24569) 9517 : audit [DBG] from='client.40490 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:02:09.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:07.504951+0000 mgr.smithi067.rdualw (mgr.24569) 9518 : cluster [DBG] pgmap v8197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:07.504951+0000 mgr.smithi067.rdualw (mgr.24569) 9518 : cluster [DBG] pgmap v8197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:09.505495+0000 mgr.smithi067.rdualw (mgr.24569) 9519 : cluster [DBG] pgmap v8198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:09.505495+0000 mgr.smithi067.rdualw (mgr.24569) 9519 : cluster [DBG] pgmap v8198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:11.506388+0000 mgr.smithi067.rdualw (mgr.24569) 9520 : cluster [DBG] pgmap v8199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:11.506388+0000 mgr.smithi067.rdualw (mgr.24569) 9520 : cluster [DBG] pgmap v8199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:13.506872+0000 mgr.smithi067.rdualw (mgr.24569) 9521 : cluster [DBG] pgmap v8200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:13.506872+0000 mgr.smithi067.rdualw (mgr.24569) 9521 : cluster [DBG] pgmap v8200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:15.507690+0000 mgr.smithi067.rdualw (mgr.24569) 9522 : cluster [DBG] pgmap v8201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:02:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:02:15.927613+0000 mon.smithi067 (mon.1) 1445 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:02:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:02:15.929052+0000 mon.smithi067 (mon.1) 1446 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:02:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:02:15.929937+0000 mon.smithi067 (mon.1) 1447 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:02:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:02:16.345231+0000 mon.smithi061 (mon.0) 2029 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:02:17.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:02:16.351547+0000 mon.smithi061 (mon.0) 2030 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:02:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:15.507690+0000 mgr.smithi067.rdualw (mgr.24569) 9522 : cluster [DBG] pgmap v8201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:02:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:02:15.927613+0000 mon.smithi067 (mon.1) 1445 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:02:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:02:15.929052+0000 mon.smithi067 (mon.1) 1446 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:02:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:02:15.929937+0000 mon.smithi067 (mon.1) 1447 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:02:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:02:16.345231+0000 mon.smithi061 (mon.0) 2029 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:02:17.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:02:16.351547+0000 mon.smithi061 (mon.0) 2030 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:02:18.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:02:15.930760+0000 mgr.smithi067.rdualw (mgr.24569) 9523 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:02:18.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:02:15.930760+0000 mgr.smithi067.rdualw (mgr.24569) 9523 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:02:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:17.508228+0000 mgr.smithi067.rdualw (mgr.24569) 9524 : cluster [DBG] pgmap v8202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:17.508228+0000 mgr.smithi067.rdualw (mgr.24569) 9524 : cluster [DBG] pgmap v8202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:21.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:19.508976+0000 mgr.smithi067.rdualw (mgr.24569) 9525 : cluster [DBG] pgmap v8203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:19.508976+0000 mgr.smithi067.rdualw (mgr.24569) 9525 : cluster [DBG] pgmap v8203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:23.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:21.509930+0000 mgr.smithi067.rdualw (mgr.24569) 9526 : cluster [DBG] pgmap v8204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:21.509930+0000 mgr.smithi067.rdualw (mgr.24569) 9526 : cluster [DBG] pgmap v8204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:25.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:23.510445+0000 mgr.smithi067.rdualw (mgr.24569) 9527 : cluster [DBG] pgmap v8205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:23.510445+0000 mgr.smithi067.rdualw (mgr.24569) 9527 : cluster [DBG] pgmap v8205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:25.511237+0000 mgr.smithi067.rdualw (mgr.24569) 9528 : cluster [DBG] pgmap v8206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:02:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:25.511237+0000 mgr.smithi067.rdualw (mgr.24569) 9528 : cluster [DBG] pgmap v8206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:02:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:27.511876+0000 mgr.smithi067.rdualw (mgr.24569) 9529 : cluster [DBG] pgmap v8207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:27.511876+0000 mgr.smithi067.rdualw (mgr.24569) 9529 : cluster [DBG] pgmap v8207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:29.512743+0000 mgr.smithi067.rdualw (mgr.24569) 9530 : cluster [DBG] pgmap v8208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:29.512743+0000 mgr.smithi067.rdualw (mgr.24569) 9530 : cluster [DBG] pgmap v8208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:31.513821+0000 mgr.smithi067.rdualw (mgr.24569) 9531 : cluster [DBG] pgmap v8209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:31.513821+0000 mgr.smithi067.rdualw (mgr.24569) 9531 : cluster [DBG] pgmap v8209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:33.514513+0000 mgr.smithi067.rdualw (mgr.24569) 9532 : cluster [DBG] pgmap v8210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:33.514513+0000 mgr.smithi067.rdualw (mgr.24569) 9532 : cluster [DBG] pgmap v8210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:37.054 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:02:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:35.515346+0000 mgr.smithi067.rdualw (mgr.24569) 9533 : cluster [DBG] pgmap v8211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:02:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:02:35.949390+0000 mon.smithi067 (mon.1) 1448 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:02:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:02:35.949681+0000 mon.smithi067 (mon.1) 1449 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:02:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:02:35.950030+0000 mon.smithi061 (mon.0) 2031 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:02:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:02:35.950334+0000 mon.smithi061 (mon.0) 2032 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:02:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:35.515346+0000 mgr.smithi067.rdualw (mgr.24569) 9533 : cluster [DBG] pgmap v8211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:02:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:02:35.949390+0000 mon.smithi067 (mon.1) 1448 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:02:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:02:35.949681+0000 mon.smithi067 (mon.1) 1449 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:02:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:02:35.950030+0000 mon.smithi061 (mon.0) 2031 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:02:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:02:35.950334+0000 mon.smithi061 (mon.0) 2032 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:02:37.347 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:02:37.347 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 6m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:02:37.347 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 6m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:02:37.348 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 6m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:02:37.348 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 6m ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:02:37.348 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 6m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:02:37.348 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 6m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:02:37.349 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 6m ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:02:37.349 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 6m ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:02:37.349 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 6m ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:02:37.349 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 6m ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:02:37.350 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 6m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:02:37.351 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 6m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:02:37.351 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 6m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:02:37.351 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 6m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:02:37.351 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 6m ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:02:37.352 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 6m ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:02:37.352 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 6m ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:02:37.352 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 6m ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:02:37.352 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 6m ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:02:37.353 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 6m ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:02:37.353 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 6m ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:02:37.353 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 6m ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:02:37.353 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 6m ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:02:37.689 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:02:37.689 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:02:37.689 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:02:37.690 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:02:37.690 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:02:37.690 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:02:37.691 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:02:37.691 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:02:37.691 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:02:37.692 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:02:37.692 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:02:37.692 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:02:37.692 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:02:37.693 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:02:37.693 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:02:37.693 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:02:37.693 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:02:37.693 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:02:37.694 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:02:38.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:02:37.041378+0000 mgr.smithi067.rdualw (mgr.24569) 9534 : audit [DBG] from='client.40498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:02:38.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:02:37.328971+0000 mgr.smithi067.rdualw (mgr.24569) 9535 : audit [DBG] from='client.40502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:02:38.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:37.515913+0000 mgr.smithi067.rdualw (mgr.24569) 9536 : cluster [DBG] pgmap v8212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:38.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:02:37.687845+0000 mon.smithi061 (mon.0) 2033 : audit [DBG] from='client.? 172.21.15.61:0/496666430' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:02:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:02:37.041378+0000 mgr.smithi067.rdualw (mgr.24569) 9534 : audit [DBG] from='client.40498 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:02:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:02:37.328971+0000 mgr.smithi067.rdualw (mgr.24569) 9535 : audit [DBG] from='client.40502 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:02:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:37.515913+0000 mgr.smithi067.rdualw (mgr.24569) 9536 : cluster [DBG] pgmap v8212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:02:37.687845+0000 mon.smithi061 (mon.0) 2033 : audit [DBG] from='client.? 172.21.15.61:0/496666430' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:02:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:39.516470+0000 mgr.smithi067.rdualw (mgr.24569) 9537 : cluster [DBG] pgmap v8213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:39.516470+0000 mgr.smithi067.rdualw (mgr.24569) 9537 : cluster [DBG] pgmap v8213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:41.517286+0000 mgr.smithi067.rdualw (mgr.24569) 9538 : cluster [DBG] pgmap v8214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:41.517286+0000 mgr.smithi067.rdualw (mgr.24569) 9538 : cluster [DBG] pgmap v8214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:45.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:43.517809+0000 mgr.smithi067.rdualw (mgr.24569) 9539 : cluster [DBG] pgmap v8215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:43.517809+0000 mgr.smithi067.rdualw (mgr.24569) 9539 : cluster [DBG] pgmap v8215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:45.519025+0000 mgr.smithi067.rdualw (mgr.24569) 9540 : cluster [DBG] pgmap v8216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:02:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:45.519025+0000 mgr.smithi067.rdualw (mgr.24569) 9540 : cluster [DBG] pgmap v8216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:02:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:47.519710+0000 mgr.smithi067.rdualw (mgr.24569) 9541 : cluster [DBG] pgmap v8217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:47.519710+0000 mgr.smithi067.rdualw (mgr.24569) 9541 : cluster [DBG] pgmap v8217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:49.520458+0000 mgr.smithi067.rdualw (mgr.24569) 9542 : cluster [DBG] pgmap v8218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:49.520458+0000 mgr.smithi067.rdualw (mgr.24569) 9542 : cluster [DBG] pgmap v8218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:51.521441+0000 mgr.smithi067.rdualw (mgr.24569) 9543 : cluster [DBG] pgmap v8219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:51.521441+0000 mgr.smithi067.rdualw (mgr.24569) 9543 : cluster [DBG] pgmap v8219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:53.521938+0000 mgr.smithi067.rdualw (mgr.24569) 9544 : cluster [DBG] pgmap v8220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:53.521938+0000 mgr.smithi067.rdualw (mgr.24569) 9544 : cluster [DBG] pgmap v8220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:57.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:55.522795+0000 mgr.smithi067.rdualw (mgr.24569) 9545 : cluster [DBG] pgmap v8221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:02:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:55.522795+0000 mgr.smithi067.rdualw (mgr.24569) 9545 : cluster [DBG] pgmap v8221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:02:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:02:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:57.523441+0000 mgr.smithi067.rdualw (mgr.24569) 9546 : cluster [DBG] pgmap v8222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:02:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:02:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:57.523441+0000 mgr.smithi067.rdualw (mgr.24569) 9546 : cluster [DBG] pgmap v8222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:02:59.524023+0000 mgr.smithi067.rdualw (mgr.24569) 9547 : cluster [DBG] pgmap v8223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:02:59.524023+0000 mgr.smithi067.rdualw (mgr.24569) 9547 : cluster [DBG] pgmap v8223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:01.524836+0000 mgr.smithi067.rdualw (mgr.24569) 9548 : cluster [DBG] pgmap v8224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:01.524836+0000 mgr.smithi067.rdualw (mgr.24569) 9548 : cluster [DBG] pgmap v8224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:03.525340+0000 mgr.smithi067.rdualw (mgr.24569) 9549 : cluster [DBG] pgmap v8225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:03.525340+0000 mgr.smithi067.rdualw (mgr.24569) 9549 : cluster [DBG] pgmap v8225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:07.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:05.526360+0000 mgr.smithi067.rdualw (mgr.24569) 9550 : cluster [DBG] pgmap v8226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:03:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:05.526360+0000 mgr.smithi067.rdualw (mgr.24569) 9550 : cluster [DBG] pgmap v8226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:03:07.994 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:03:08.289 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:03:08.289 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 7m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:03:08.289 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 7m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:03:08.289 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 7m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:03:08.290 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 7m ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:03:08.290 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 7m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:03:08.290 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 7m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:03:08.290 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 7m ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:03:08.291 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 7m ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:03:08.291 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 7m ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:03:08.291 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 7m ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:03:08.291 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 7m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:03:08.292 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 7m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:03:08.292 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 7m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:03:08.292 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 7m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:03:08.293 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 7m ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:03:08.293 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 7m ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:03:08.293 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 7m ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:03:08.293 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 7m ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:03:08.293 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 7m ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:03:08.294 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 7m ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:03:08.294 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 7m ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:03:08.294 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 7m ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:03:08.295 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 7m ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:03:08.668 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:03:08.668 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:03:08.669 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:03:08.669 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:03:08.669 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:03:08.669 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:03:08.669 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:03:08.670 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:03:08.670 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:03:08.670 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:03:08.670 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:03:08.671 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:03:08.671 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:03:08.671 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:03:08.671 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:03:08.672 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:03:08.672 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:03:08.672 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:03:08.672 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:03:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:07.526976+0000 mgr.smithi067.rdualw (mgr.24569) 9551 : cluster [DBG] pgmap v8227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:03:08.666955+0000 mon.smithi061 (mon.0) 2034 : audit [DBG] from='client.? 172.21.15.61:0/3529693056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:03:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:07.526976+0000 mgr.smithi067.rdualw (mgr.24569) 9551 : cluster [DBG] pgmap v8227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:03:08.666955+0000 mon.smithi061 (mon.0) 2034 : audit [DBG] from='client.? 172.21.15.61:0/3529693056' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:03:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:03:07.981657+0000 mgr.smithi067.rdualw (mgr.24569) 9552 : audit [DBG] from='client.40510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:03:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:03:08.271211+0000 mgr.smithi067.rdualw (mgr.24569) 9553 : audit [DBG] from='client.40514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:03:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:03:07.981657+0000 mgr.smithi067.rdualw (mgr.24569) 9552 : audit [DBG] from='client.40510 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:03:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:03:08.271211+0000 mgr.smithi067.rdualw (mgr.24569) 9553 : audit [DBG] from='client.40514 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:03:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:09.527632+0000 mgr.smithi067.rdualw (mgr.24569) 9554 : cluster [DBG] pgmap v8228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:09.527632+0000 mgr.smithi067.rdualw (mgr.24569) 9554 : cluster [DBG] pgmap v8228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:13.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:11.528735+0000 mgr.smithi067.rdualw (mgr.24569) 9555 : cluster [DBG] pgmap v8229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:13.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:11.528735+0000 mgr.smithi067.rdualw (mgr.24569) 9555 : cluster [DBG] pgmap v8229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:13.529323+0000 mgr.smithi067.rdualw (mgr.24569) 9556 : cluster [DBG] pgmap v8230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:15.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:13.529323+0000 mgr.smithi067.rdualw (mgr.24569) 9556 : cluster [DBG] pgmap v8230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:15.530225+0000 mgr.smithi067.rdualw (mgr.24569) 9557 : cluster [DBG] pgmap v8231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:03:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:03:16.354648+0000 mon.smithi067 (mon.1) 1450 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:03:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:03:16.356111+0000 mon.smithi067 (mon.1) 1451 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:03:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:03:16.357081+0000 mon.smithi067 (mon.1) 1452 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:03:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:03:16.772101+0000 mon.smithi061 (mon.0) 2035 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:03:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:03:16.777745+0000 mon.smithi061 (mon.0) 2036 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:03:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:15.530225+0000 mgr.smithi067.rdualw (mgr.24569) 9557 : cluster [DBG] pgmap v8231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:03:17.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:03:16.354648+0000 mon.smithi067 (mon.1) 1450 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:03:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:03:16.356111+0000 mon.smithi067 (mon.1) 1451 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:03:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:03:16.357081+0000 mon.smithi067 (mon.1) 1452 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:03:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:03:16.772101+0000 mon.smithi061 (mon.0) 2035 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:03:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:03:16.777745+0000 mon.smithi061 (mon.0) 2036 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:03:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:03:16.357924+0000 mgr.smithi067.rdualw (mgr.24569) 9558 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:03:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:03:16.357924+0000 mgr.smithi067.rdualw (mgr.24569) 9558 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:03:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:17.530902+0000 mgr.smithi067.rdualw (mgr.24569) 9559 : cluster [DBG] pgmap v8232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:17.530902+0000 mgr.smithi067.rdualw (mgr.24569) 9559 : cluster [DBG] pgmap v8232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:19.531452+0000 mgr.smithi067.rdualw (mgr.24569) 9560 : cluster [DBG] pgmap v8233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:19.531452+0000 mgr.smithi067.rdualw (mgr.24569) 9560 : cluster [DBG] pgmap v8233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:23.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:21.532530+0000 mgr.smithi067.rdualw (mgr.24569) 9561 : cluster [DBG] pgmap v8234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:21.532530+0000 mgr.smithi067.rdualw (mgr.24569) 9561 : cluster [DBG] pgmap v8234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:23.533277+0000 mgr.smithi067.rdualw (mgr.24569) 9562 : cluster [DBG] pgmap v8235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:23.533277+0000 mgr.smithi067.rdualw (mgr.24569) 9562 : cluster [DBG] pgmap v8235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:26.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:25.534125+0000 mgr.smithi067.rdualw (mgr.24569) 9563 : cluster [DBG] pgmap v8236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:03:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:25.534125+0000 mgr.smithi067.rdualw (mgr.24569) 9563 : cluster [DBG] pgmap v8236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:03:29.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:27.534816+0000 mgr.smithi067.rdualw (mgr.24569) 9564 : cluster [DBG] pgmap v8237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:27.534816+0000 mgr.smithi067.rdualw (mgr.24569) 9564 : cluster [DBG] pgmap v8237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:31.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:29.535521+0000 mgr.smithi067.rdualw (mgr.24569) 9565 : cluster [DBG] pgmap v8238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:29.535521+0000 mgr.smithi067.rdualw (mgr.24569) 9565 : cluster [DBG] pgmap v8238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:31.536552+0000 mgr.smithi067.rdualw (mgr.24569) 9566 : cluster [DBG] pgmap v8239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:31.536552+0000 mgr.smithi067.rdualw (mgr.24569) 9566 : cluster [DBG] pgmap v8239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:35.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:33.537237+0000 mgr.smithi067.rdualw (mgr.24569) 9567 : cluster [DBG] pgmap v8240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:33.537237+0000 mgr.smithi067.rdualw (mgr.24569) 9567 : cluster [DBG] pgmap v8240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:37.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:35.538253+0000 mgr.smithi067.rdualw (mgr.24569) 9568 : cluster [DBG] pgmap v8241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:03:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:03:35.954649+0000 mon.smithi067 (mon.1) 1453 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:03:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:03:35.955006+0000 mon.smithi067 (mon.1) 1454 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:03:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:03:35.955422+0000 mon.smithi061 (mon.0) 2037 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:03:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:03:35.955883+0000 mon.smithi061 (mon.0) 2038 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:03:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:35.538253+0000 mgr.smithi067.rdualw (mgr.24569) 9568 : cluster [DBG] pgmap v8241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:03:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:03:35.954649+0000 mon.smithi067 (mon.1) 1453 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:03:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:03:35.955006+0000 mon.smithi067 (mon.1) 1454 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:03:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:03:35.955422+0000 mon.smithi061 (mon.0) 2037 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:03:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:03:35.955883+0000 mon.smithi061 (mon.0) 2038 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:03:38.977 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:03:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:37.538727+0000 mgr.smithi067.rdualw (mgr.24569) 9569 : cluster [DBG] pgmap v8242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:39.271 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:03:39.272 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 7m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:03:39.272 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 7m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:03:39.272 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 7m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:03:39.273 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 7m ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:03:39.273 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 7m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:03:39.273 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 7m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:03:39.273 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 7m ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:03:39.273 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 7m ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:03:39.274 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 7m ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:03:39.274 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 7m ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:03:39.274 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 7m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:03:39.274 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 7m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:03:39.275 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 7m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:03:39.275 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 7m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:03:39.275 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 7m ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:03:39.275 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 7m ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:03:39.276 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 7m ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:03:39.276 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 7m ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:03:39.276 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 7m ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:03:39.276 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 7m ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:03:39.277 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 7m ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:03:39.277 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 7m ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:03:39.277 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 7m ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:03:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:37.538727+0000 mgr.smithi067.rdualw (mgr.24569) 9569 : cluster [DBG] pgmap v8242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:39.614 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:03:39.615 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:03:39.615 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:03:39.615 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:03:39.615 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:03:39.616 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:03:39.616 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:03:39.616 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:03:39.616 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:03:39.617 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:03:39.617 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:03:39.617 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:03:39.617 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:03:39.617 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:03:39.618 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:03:39.618 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:03:39.618 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:03:39.618 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:03:39.619 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:03:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:03:39.613710+0000 mon.smithi061 (mon.0) 2039 : audit [DBG] from='client.? 172.21.15.61:0/770449142' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:03:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:03:39.613710+0000 mon.smithi061 (mon.0) 2039 : audit [DBG] from='client.? 172.21.15.61:0/770449142' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:03:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:03:38.961285+0000 mgr.smithi067.rdualw (mgr.24569) 9570 : audit [DBG] from='client.40522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:03:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:03:39.254068+0000 mgr.smithi067.rdualw (mgr.24569) 9571 : audit [DBG] from='client.40526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:03:41.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:39.539437+0000 mgr.smithi067.rdualw (mgr.24569) 9572 : cluster [DBG] pgmap v8243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:03:38.961285+0000 mgr.smithi067.rdualw (mgr.24569) 9570 : audit [DBG] from='client.40522 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:03:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:03:39.254068+0000 mgr.smithi067.rdualw (mgr.24569) 9571 : audit [DBG] from='client.40526 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:03:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:39.539437+0000 mgr.smithi067.rdualw (mgr.24569) 9572 : cluster [DBG] pgmap v8243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:43.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:41.540385+0000 mgr.smithi067.rdualw (mgr.24569) 9573 : cluster [DBG] pgmap v8244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:41.540385+0000 mgr.smithi067.rdualw (mgr.24569) 9573 : cluster [DBG] pgmap v8244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:43.540876+0000 mgr.smithi067.rdualw (mgr.24569) 9574 : cluster [DBG] pgmap v8245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:43.540876+0000 mgr.smithi067.rdualw (mgr.24569) 9574 : cluster [DBG] pgmap v8245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:45.541918+0000 mgr.smithi067.rdualw (mgr.24569) 9575 : cluster [DBG] pgmap v8246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:03:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:45.541918+0000 mgr.smithi067.rdualw (mgr.24569) 9575 : cluster [DBG] pgmap v8246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:03:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:47.542482+0000 mgr.smithi067.rdualw (mgr.24569) 9576 : cluster [DBG] pgmap v8247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:47.542482+0000 mgr.smithi067.rdualw (mgr.24569) 9576 : cluster [DBG] pgmap v8247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:49.543220+0000 mgr.smithi067.rdualw (mgr.24569) 9577 : cluster [DBG] pgmap v8248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:49.543220+0000 mgr.smithi067.rdualw (mgr.24569) 9577 : cluster [DBG] pgmap v8248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:51.544171+0000 mgr.smithi067.rdualw (mgr.24569) 9578 : cluster [DBG] pgmap v8249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:51.544171+0000 mgr.smithi067.rdualw (mgr.24569) 9578 : cluster [DBG] pgmap v8249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:55.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:53.544831+0000 mgr.smithi067.rdualw (mgr.24569) 9579 : cluster [DBG] pgmap v8250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:53.544831+0000 mgr.smithi067.rdualw (mgr.24569) 9579 : cluster [DBG] pgmap v8250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:55.545699+0000 mgr.smithi067.rdualw (mgr.24569) 9580 : cluster [DBG] pgmap v8251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:03:57.330 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:55.545699+0000 mgr.smithi067.rdualw (mgr.24569) 9580 : cluster [DBG] pgmap v8251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:03:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:03:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:57.546301+0000 mgr.smithi067.rdualw (mgr.24569) 9581 : cluster [DBG] pgmap v8252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:03:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:03:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:57.546301+0000 mgr.smithi067.rdualw (mgr.24569) 9581 : cluster [DBG] pgmap v8252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:03:59.546953+0000 mgr.smithi067.rdualw (mgr.24569) 9582 : cluster [DBG] pgmap v8253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:03:59.546953+0000 mgr.smithi067.rdualw (mgr.24569) 9582 : cluster [DBG] pgmap v8253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:03.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:01.547932+0000 mgr.smithi067.rdualw (mgr.24569) 9583 : cluster [DBG] pgmap v8254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:01.547932+0000 mgr.smithi067.rdualw (mgr.24569) 9583 : cluster [DBG] pgmap v8254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:05.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:03.548430+0000 mgr.smithi067.rdualw (mgr.24569) 9584 : cluster [DBG] pgmap v8255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:03.548430+0000 mgr.smithi067.rdualw (mgr.24569) 9584 : cluster [DBG] pgmap v8255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:05.549274+0000 mgr.smithi067.rdualw (mgr.24569) 9585 : cluster [DBG] pgmap v8256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:04:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:05.549274+0000 mgr.smithi067.rdualw (mgr.24569) 9585 : cluster [DBG] pgmap v8256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:04:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:07.549789+0000 mgr.smithi067.rdualw (mgr.24569) 9586 : cluster [DBG] pgmap v8257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:07.549789+0000 mgr.smithi067.rdualw (mgr.24569) 9586 : cluster [DBG] pgmap v8257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:09.972 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:04:10.275 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:04:10.275 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 8m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:04:10.275 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 8m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:04:10.275 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 8m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:04:10.276 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 8m ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:04:10.276 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 8m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:04:10.276 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 8m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:04:10.276 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 8m ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:04:10.277 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 8m ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:04:10.277 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 8m ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:04:10.277 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 8m ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:04:10.277 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 8m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:04:10.277 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 8m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:04:10.278 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 8m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:04:10.278 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 8m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:04:10.278 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 8m ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:04:10.278 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 8m ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:04:10.279 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 8m ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:04:10.279 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 8m ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:04:10.279 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 8m ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:04:10.279 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 8m ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:04:10.280 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 8m ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:04:10.280 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 8m ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:04:10.280 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 8m ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:04:10.614 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:04:10.615 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:04:10.615 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:04:10.615 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:04:10.615 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:04:10.616 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:04:10.616 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:04:10.616 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:04:10.616 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:04:10.616 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:04:10.617 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:04:10.617 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:04:10.617 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:04:10.617 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:04:10.618 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:04:10.618 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:04:10.618 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:04:10.618 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:04:10.618 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:04:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:09.550499+0000 mgr.smithi067.rdualw (mgr.24569) 9587 : cluster [DBG] pgmap v8258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:04:10.613574+0000 mon.smithi061 (mon.0) 2040 : audit [DBG] from='client.? 172.21.15.61:0/1008021572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:04:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:09.550499+0000 mgr.smithi067.rdualw (mgr.24569) 9587 : cluster [DBG] pgmap v8258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:04:10.613574+0000 mon.smithi061 (mon.0) 2040 : audit [DBG] from='client.? 172.21.15.61:0/1008021572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:04:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:04:09.956041+0000 mgr.smithi067.rdualw (mgr.24569) 9588 : audit [DBG] from='client.40534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:04:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:04:10.256871+0000 mgr.smithi067.rdualw (mgr.24569) 9589 : audit [DBG] from='client.40538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:04:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:04:09.956041+0000 mgr.smithi067.rdualw (mgr.24569) 9588 : audit [DBG] from='client.40534 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:04:12.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:04:10.256871+0000 mgr.smithi067.rdualw (mgr.24569) 9589 : audit [DBG] from='client.40538 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:04:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:11.551396+0000 mgr.smithi067.rdualw (mgr.24569) 9590 : cluster [DBG] pgmap v8259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:11.551396+0000 mgr.smithi067.rdualw (mgr.24569) 9590 : cluster [DBG] pgmap v8259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:13.551948+0000 mgr.smithi067.rdualw (mgr.24569) 9591 : cluster [DBG] pgmap v8260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:13.551948+0000 mgr.smithi067.rdualw (mgr.24569) 9591 : cluster [DBG] pgmap v8260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:15.552737+0000 mgr.smithi067.rdualw (mgr.24569) 9592 : cluster [DBG] pgmap v8261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:04:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:04:16.780732+0000 mon.smithi067 (mon.1) 1455 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:04:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:04:16.782174+0000 mon.smithi067 (mon.1) 1456 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:04:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:04:16.783125+0000 mon.smithi067 (mon.1) 1457 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:04:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:15.552737+0000 mgr.smithi067.rdualw (mgr.24569) 9592 : cluster [DBG] pgmap v8261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:04:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:04:16.780732+0000 mon.smithi067 (mon.1) 1455 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:04:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:04:16.782174+0000 mon.smithi067 (mon.1) 1456 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:04:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:04:16.783125+0000 mon.smithi067 (mon.1) 1457 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:04:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:04:16.784012+0000 mgr.smithi067.rdualw (mgr.24569) 9593 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:04:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:04:17.198855+0000 mon.smithi061 (mon.0) 2041 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:04:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:04:17.204586+0000 mon.smithi061 (mon.0) 2042 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:04:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:04:16.784012+0000 mgr.smithi067.rdualw (mgr.24569) 9593 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:04:18.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:04:17.198855+0000 mon.smithi061 (mon.0) 2041 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:04:18.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:04:17.204586+0000 mon.smithi061 (mon.0) 2042 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:04:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:17.553335+0000 mgr.smithi067.rdualw (mgr.24569) 9594 : cluster [DBG] pgmap v8262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:17.553335+0000 mgr.smithi067.rdualw (mgr.24569) 9594 : cluster [DBG] pgmap v8262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:19.554074+0000 mgr.smithi067.rdualw (mgr.24569) 9595 : cluster [DBG] pgmap v8263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:19.554074+0000 mgr.smithi067.rdualw (mgr.24569) 9595 : cluster [DBG] pgmap v8263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:21.555132+0000 mgr.smithi067.rdualw (mgr.24569) 9596 : cluster [DBG] pgmap v8264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:21.555132+0000 mgr.smithi067.rdualw (mgr.24569) 9596 : cluster [DBG] pgmap v8264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:25.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:23.555775+0000 mgr.smithi067.rdualw (mgr.24569) 9597 : cluster [DBG] pgmap v8265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:23.555775+0000 mgr.smithi067.rdualw (mgr.24569) 9597 : cluster [DBG] pgmap v8265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:25.556751+0000 mgr.smithi067.rdualw (mgr.24569) 9598 : cluster [DBG] pgmap v8266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:04:27.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:25.556751+0000 mgr.smithi067.rdualw (mgr.24569) 9598 : cluster [DBG] pgmap v8266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:04:29.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:27.557435+0000 mgr.smithi067.rdualw (mgr.24569) 9599 : cluster [DBG] pgmap v8267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:27.557435+0000 mgr.smithi067.rdualw (mgr.24569) 9599 : cluster [DBG] pgmap v8267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:31.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:29.558098+0000 mgr.smithi067.rdualw (mgr.24569) 9600 : cluster [DBG] pgmap v8268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:29.558098+0000 mgr.smithi067.rdualw (mgr.24569) 9600 : cluster [DBG] pgmap v8268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:31.559027+0000 mgr.smithi067.rdualw (mgr.24569) 9601 : cluster [DBG] pgmap v8269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:31.559027+0000 mgr.smithi067.rdualw (mgr.24569) 9601 : cluster [DBG] pgmap v8269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:33.559518+0000 mgr.smithi067.rdualw (mgr.24569) 9602 : cluster [DBG] pgmap v8270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:33.559518+0000 mgr.smithi067.rdualw (mgr.24569) 9602 : cluster [DBG] pgmap v8270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:35.560276+0000 mgr.smithi067.rdualw (mgr.24569) 9603 : cluster [DBG] pgmap v8271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:04:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:04:35.960273+0000 mon.smithi067 (mon.1) 1458 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:04:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:04:35.960517+0000 mon.smithi067 (mon.1) 1459 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:04:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:04:35.961019+0000 mon.smithi061 (mon.0) 2043 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:04:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:04:35.961313+0000 mon.smithi061 (mon.0) 2044 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:04:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:35.560276+0000 mgr.smithi067.rdualw (mgr.24569) 9603 : cluster [DBG] pgmap v8271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:04:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:04:35.960273+0000 mon.smithi067 (mon.1) 1458 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:04:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:04:35.960517+0000 mon.smithi067 (mon.1) 1459 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:04:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:04:35.961019+0000 mon.smithi061 (mon.0) 2043 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:04:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:04:35.961313+0000 mon.smithi061 (mon.0) 2044 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:04:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:37.560890+0000 mgr.smithi067.rdualw (mgr.24569) 9604 : cluster [DBG] pgmap v8272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:38.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:37.560890+0000 mgr.smithi067.rdualw (mgr.24569) 9604 : cluster [DBG] pgmap v8272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:39.561573+0000 mgr.smithi067.rdualw (mgr.24569) 9605 : cluster [DBG] pgmap v8273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:40.934 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:04:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:39.561573+0000 mgr.smithi067.rdualw (mgr.24569) 9605 : cluster [DBG] pgmap v8273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:41.225 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:04:41.225 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 8m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:04:41.225 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 8m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:04:41.225 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 8m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:04:41.226 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 8m ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:04:41.226 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 8m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:04:41.226 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 8m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:04:41.226 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 8m ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:04:41.227 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 8m ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:04:41.227 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 8m ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:04:41.227 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 8m ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:04:41.228 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 8m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:04:41.228 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 8m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:04:41.230 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 8m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:04:41.231 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 8m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:04:41.231 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 8m ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:04:41.231 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 8m ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:04:41.231 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 8m ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:04:41.232 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 8m ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:04:41.232 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 8m ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:04:41.232 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 8m ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:04:41.232 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 8m ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:04:41.233 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 8m ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:04:41.233 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 8m ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:04:41.564 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:04:41.565 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:04:41.565 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:04:41.565 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:04:41.566 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:04:41.566 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:04:41.566 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:04:41.566 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:04:41.567 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:04:41.567 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:04:41.567 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:04:41.567 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:04:41.567 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:04:41.568 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:04:41.568 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:04:41.568 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:04:41.568 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:04:41.569 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:04:41.569 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:04:41.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:04:41.563698+0000 mon.smithi061 (mon.0) 2045 : audit [DBG] from='client.? 172.21.15.61:0/1123016906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:04:42.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:04:41.563698+0000 mon.smithi061 (mon.0) 2045 : audit [DBG] from='client.? 172.21.15.61:0/1123016906' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:04:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:04:40.920483+0000 mgr.smithi067.rdualw (mgr.24569) 9606 : audit [DBG] from='client.40546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:04:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:04:41.207319+0000 mgr.smithi067.rdualw (mgr.24569) 9607 : audit [DBG] from='client.40550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:04:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:41.562428+0000 mgr.smithi067.rdualw (mgr.24569) 9608 : cluster [DBG] pgmap v8274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:04:40.920483+0000 mgr.smithi067.rdualw (mgr.24569) 9606 : audit [DBG] from='client.40546 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:04:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:04:41.207319+0000 mgr.smithi067.rdualw (mgr.24569) 9607 : audit [DBG] from='client.40550 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:04:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:41.562428+0000 mgr.smithi067.rdualw (mgr.24569) 9608 : cluster [DBG] pgmap v8274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:45.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:43.563016+0000 mgr.smithi067.rdualw (mgr.24569) 9609 : cluster [DBG] pgmap v8275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:43.563016+0000 mgr.smithi067.rdualw (mgr.24569) 9609 : cluster [DBG] pgmap v8275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:45.563883+0000 mgr.smithi067.rdualw (mgr.24569) 9610 : cluster [DBG] pgmap v8276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:04:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:45.563883+0000 mgr.smithi067.rdualw (mgr.24569) 9610 : cluster [DBG] pgmap v8276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:04:49.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:47.564513+0000 mgr.smithi067.rdualw (mgr.24569) 9611 : cluster [DBG] pgmap v8277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:47.564513+0000 mgr.smithi067.rdualw (mgr.24569) 9611 : cluster [DBG] pgmap v8277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:49.565277+0000 mgr.smithi067.rdualw (mgr.24569) 9612 : cluster [DBG] pgmap v8278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:49.565277+0000 mgr.smithi067.rdualw (mgr.24569) 9612 : cluster [DBG] pgmap v8278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:51.566203+0000 mgr.smithi067.rdualw (mgr.24569) 9613 : cluster [DBG] pgmap v8279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:51.566203+0000 mgr.smithi067.rdualw (mgr.24569) 9613 : cluster [DBG] pgmap v8279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:53.566862+0000 mgr.smithi067.rdualw (mgr.24569) 9614 : cluster [DBG] pgmap v8280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:53.566862+0000 mgr.smithi067.rdualw (mgr.24569) 9614 : cluster [DBG] pgmap v8280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:55.567791+0000 mgr.smithi067.rdualw (mgr.24569) 9615 : cluster [DBG] pgmap v8281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:04:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:55.567791+0000 mgr.smithi067.rdualw (mgr.24569) 9615 : cluster [DBG] pgmap v8281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:04:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:04:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:57.568469+0000 mgr.smithi067.rdualw (mgr.24569) 9616 : cluster [DBG] pgmap v8282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:04:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:04:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:57.568469+0000 mgr.smithi067.rdualw (mgr.24569) 9616 : cluster [DBG] pgmap v8282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:04:59.569174+0000 mgr.smithi067.rdualw (mgr.24569) 9617 : cluster [DBG] pgmap v8283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:04:59.569174+0000 mgr.smithi067.rdualw (mgr.24569) 9617 : cluster [DBG] pgmap v8283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:01.570306+0000 mgr.smithi067.rdualw (mgr.24569) 9618 : cluster [DBG] pgmap v8284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:01.570306+0000 mgr.smithi067.rdualw (mgr.24569) 9618 : cluster [DBG] pgmap v8284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:05.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:03.570891+0000 mgr.smithi067.rdualw (mgr.24569) 9619 : cluster [DBG] pgmap v8285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:03.570891+0000 mgr.smithi067.rdualw (mgr.24569) 9619 : cluster [DBG] pgmap v8285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:07.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:05.571841+0000 mgr.smithi067.rdualw (mgr.24569) 9620 : cluster [DBG] pgmap v8286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:05:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:05.571841+0000 mgr.smithi067.rdualw (mgr.24569) 9620 : cluster [DBG] pgmap v8286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:05:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:07.572371+0000 mgr.smithi067.rdualw (mgr.24569) 9621 : cluster [DBG] pgmap v8287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:07.572371+0000 mgr.smithi067.rdualw (mgr.24569) 9621 : cluster [DBG] pgmap v8287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:09.573049+0000 mgr.smithi067.rdualw (mgr.24569) 9622 : cluster [DBG] pgmap v8288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:09.573049+0000 mgr.smithi067.rdualw (mgr.24569) 9622 : cluster [DBG] pgmap v8288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:11.878 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:05:12.169 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:05:12.169 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 9m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:05:12.169 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 9m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:05:12.170 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 9m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:05:12.170 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 9m ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:05:12.170 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 9m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:05:12.170 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 9m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:05:12.171 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 9m ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:05:12.171 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 9m ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:05:12.171 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 9m ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:05:12.171 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 9m ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:05:12.172 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 9m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:05:12.172 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 9m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:05:12.172 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 9m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:05:12.172 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 9m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:05:12.172 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 9m ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:05:12.173 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 9m ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:05:12.173 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 9m ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:05:12.173 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 9m ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:05:12.173 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 9m ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:05:12.173 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 9m ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:05:12.174 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 9m ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:05:12.174 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 9m ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:05:12.174 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 9m ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:05:12.508 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:05:12.509 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:05:12.509 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:05:12.510 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:05:12.510 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:05:12.511 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:05:12.511 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:05:12.512 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:05:12.512 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:05:12.512 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:05:12.513 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:05:12.513 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:05:12.514 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:05:12.514 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:05:12.515 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:05:12.515 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:05:12.516 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:05:12.516 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:05:12.517 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:05:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:11.573929+0000 mgr.smithi067.rdualw (mgr.24569) 9623 : cluster [DBG] pgmap v8289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:05:12.507398+0000 mon.smithi061 (mon.0) 2046 : audit [DBG] from='client.? 172.21.15.61:0/3393002480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:05:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:11.573929+0000 mgr.smithi067.rdualw (mgr.24569) 9623 : cluster [DBG] pgmap v8289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:05:12.507398+0000 mon.smithi061 (mon.0) 2046 : audit [DBG] from='client.? 172.21.15.61:0/3393002480' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:05:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:05:11.864855+0000 mgr.smithi067.rdualw (mgr.24569) 9624 : audit [DBG] from='client.40558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:05:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:05:12.151846+0000 mgr.smithi067.rdualw (mgr.24569) 9625 : audit [DBG] from='client.40562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:05:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:05:11.864855+0000 mgr.smithi067.rdualw (mgr.24569) 9624 : audit [DBG] from='client.40558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:05:14.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:05:12.151846+0000 mgr.smithi067.rdualw (mgr.24569) 9625 : audit [DBG] from='client.40562 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:05:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:13.574525+0000 mgr.smithi067.rdualw (mgr.24569) 9626 : cluster [DBG] pgmap v8290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:13.574525+0000 mgr.smithi067.rdualw (mgr.24569) 9626 : cluster [DBG] pgmap v8290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:15.575411+0000 mgr.smithi067.rdualw (mgr.24569) 9627 : cluster [DBG] pgmap v8291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:05:16.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:15.575411+0000 mgr.smithi067.rdualw (mgr.24569) 9627 : cluster [DBG] pgmap v8291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:05:18.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:05:17.207843+0000 mon.smithi067 (mon.1) 1460 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:05:18.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:05:17.209281+0000 mon.smithi067 (mon.1) 1461 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:05:18.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:05:17.210239+0000 mon.smithi067 (mon.1) 1462 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:05:18.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:05:17.624325+0000 mon.smithi061 (mon.0) 2047 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:05:18.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:05:17.629687+0000 mon.smithi061 (mon.0) 2048 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:05:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:05:17.207843+0000 mon.smithi067 (mon.1) 1460 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:05:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:05:17.209281+0000 mon.smithi067 (mon.1) 1461 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:05:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:05:17.210239+0000 mon.smithi067 (mon.1) 1462 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:05:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:05:17.624325+0000 mon.smithi061 (mon.0) 2047 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:05:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:05:17.629687+0000 mon.smithi061 (mon.0) 2048 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:05:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:05:17.211085+0000 mgr.smithi067.rdualw (mgr.24569) 9628 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:05:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:17.575856+0000 mgr.smithi067.rdualw (mgr.24569) 9629 : cluster [DBG] pgmap v8292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:05:17.211085+0000 mgr.smithi067.rdualw (mgr.24569) 9628 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:05:19.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:17.575856+0000 mgr.smithi067.rdualw (mgr.24569) 9629 : cluster [DBG] pgmap v8292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:21.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:19.576652+0000 mgr.smithi067.rdualw (mgr.24569) 9630 : cluster [DBG] pgmap v8293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:19.576652+0000 mgr.smithi067.rdualw (mgr.24569) 9630 : cluster [DBG] pgmap v8293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:21.577768+0000 mgr.smithi067.rdualw (mgr.24569) 9631 : cluster [DBG] pgmap v8294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:21.577768+0000 mgr.smithi067.rdualw (mgr.24569) 9631 : cluster [DBG] pgmap v8294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:23.578442+0000 mgr.smithi067.rdualw (mgr.24569) 9632 : cluster [DBG] pgmap v8295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:23.578442+0000 mgr.smithi067.rdualw (mgr.24569) 9632 : cluster [DBG] pgmap v8295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:27.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:25.579446+0000 mgr.smithi067.rdualw (mgr.24569) 9633 : cluster [DBG] pgmap v8296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:05:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:25.579446+0000 mgr.smithi067.rdualw (mgr.24569) 9633 : cluster [DBG] pgmap v8296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:05:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:27.580033+0000 mgr.smithi067.rdualw (mgr.24569) 9634 : cluster [DBG] pgmap v8297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:27.580033+0000 mgr.smithi067.rdualw (mgr.24569) 9634 : cluster [DBG] pgmap v8297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:29.580809+0000 mgr.smithi067.rdualw (mgr.24569) 9635 : cluster [DBG] pgmap v8298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:29.580809+0000 mgr.smithi067.rdualw (mgr.24569) 9635 : cluster [DBG] pgmap v8298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:31.581795+0000 mgr.smithi067.rdualw (mgr.24569) 9636 : cluster [DBG] pgmap v8299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:31.581795+0000 mgr.smithi067.rdualw (mgr.24569) 9636 : cluster [DBG] pgmap v8299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:33.582420+0000 mgr.smithi067.rdualw (mgr.24569) 9637 : cluster [DBG] pgmap v8300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:33.582420+0000 mgr.smithi067.rdualw (mgr.24569) 9637 : cluster [DBG] pgmap v8300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:35.583475+0000 mgr.smithi067.rdualw (mgr.24569) 9638 : cluster [DBG] pgmap v8301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:05:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:05:35.966310+0000 mon.smithi067 (mon.1) 1463 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:05:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:05:35.966661+0000 mon.smithi067 (mon.1) 1464 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:05:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:05:35.966938+0000 mon.smithi061 (mon.0) 2049 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:05:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:05:35.967445+0000 mon.smithi061 (mon.0) 2050 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:05:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:35.583475+0000 mgr.smithi067.rdualw (mgr.24569) 9638 : cluster [DBG] pgmap v8301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:05:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:05:35.966310+0000 mon.smithi067 (mon.1) 1463 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:05:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:05:35.966661+0000 mon.smithi067 (mon.1) 1464 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:05:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:05:35.966938+0000 mon.smithi061 (mon.0) 2049 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:05:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:05:35.967445+0000 mon.smithi061 (mon.0) 2050 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:05:39.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:37.584238+0000 mgr.smithi067.rdualw (mgr.24569) 9639 : cluster [DBG] pgmap v8302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:37.584238+0000 mgr.smithi067.rdualw (mgr.24569) 9639 : cluster [DBG] pgmap v8302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:39.585089+0000 mgr.smithi067.rdualw (mgr.24569) 9640 : cluster [DBG] pgmap v8303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:39.585089+0000 mgr.smithi067.rdualw (mgr.24569) 9640 : cluster [DBG] pgmap v8303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:42.897 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:05:43.193 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:05:43.193 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 9m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:05:43.193 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 9m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:05:43.194 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 9m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:05:43.194 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 9m ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:05:43.194 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 9m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:05:43.194 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 9m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:05:43.195 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 9m ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:05:43.195 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 9m ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:05:43.195 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 9m ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:05:43.195 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 9m ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:05:43.195 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 9m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:05:43.196 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 9m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:05:43.196 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 9m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:05:43.196 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 9m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:05:43.196 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 9m ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:05:43.197 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 9m ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:05:43.197 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 9m ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:05:43.197 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 9m ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:05:43.197 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 9m ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:05:43.197 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 9m ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:05:43.198 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 9m ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:05:43.198 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 9m ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:05:43.198 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 9m ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:05:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:41.586223+0000 mgr.smithi067.rdualw (mgr.24569) 9641 : cluster [DBG] pgmap v8304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:41.586223+0000 mgr.smithi067.rdualw (mgr.24569) 9641 : cluster [DBG] pgmap v8304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:43.537 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:05:43.538 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:05:43.538 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:05:43.538 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:05:43.539 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:05:43.539 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:05:43.539 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:05:43.539 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:05:43.540 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:05:43.540 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:05:43.540 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:05:43.540 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:05:43.541 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:05:43.541 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:05:43.541 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:05:43.541 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:05:43.541 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:05:43.542 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:05:43.542 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:05:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:05:43.535438+0000 mon.smithi061 (mon.0) 2051 : audit [DBG] from='client.? 172.21.15.61:0/312266478' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:05:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:05:43.535438+0000 mon.smithi061 (mon.0) 2051 : audit [DBG] from='client.? 172.21.15.61:0/312266478' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:05:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:05:42.883336+0000 mgr.smithi067.rdualw (mgr.24569) 9642 : audit [DBG] from='client.40570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:05:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:05:43.175517+0000 mgr.smithi067.rdualw (mgr.24569) 9643 : audit [DBG] from='client.40574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:05:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:43.586936+0000 mgr.smithi067.rdualw (mgr.24569) 9644 : cluster [DBG] pgmap v8305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:05:42.883336+0000 mgr.smithi067.rdualw (mgr.24569) 9642 : audit [DBG] from='client.40570 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:05:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:05:43.175517+0000 mgr.smithi067.rdualw (mgr.24569) 9643 : audit [DBG] from='client.40574 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:05:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:43.586936+0000 mgr.smithi067.rdualw (mgr.24569) 9644 : cluster [DBG] pgmap v8305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:45.587768+0000 mgr.smithi067.rdualw (mgr.24569) 9645 : cluster [DBG] pgmap v8306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:05:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:45.587768+0000 mgr.smithi067.rdualw (mgr.24569) 9645 : cluster [DBG] pgmap v8306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:05:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:47.588343+0000 mgr.smithi067.rdualw (mgr.24569) 9646 : cluster [DBG] pgmap v8307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:47.588343+0000 mgr.smithi067.rdualw (mgr.24569) 9646 : cluster [DBG] pgmap v8307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:49.589020+0000 mgr.smithi067.rdualw (mgr.24569) 9647 : cluster [DBG] pgmap v8308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:49.589020+0000 mgr.smithi067.rdualw (mgr.24569) 9647 : cluster [DBG] pgmap v8308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:51.589905+0000 mgr.smithi067.rdualw (mgr.24569) 9648 : cluster [DBG] pgmap v8309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:51.589905+0000 mgr.smithi067.rdualw (mgr.24569) 9648 : cluster [DBG] pgmap v8309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:53.590500+0000 mgr.smithi067.rdualw (mgr.24569) 9649 : cluster [DBG] pgmap v8310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:53.590500+0000 mgr.smithi067.rdualw (mgr.24569) 9649 : cluster [DBG] pgmap v8310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:55.591645+0000 mgr.smithi067.rdualw (mgr.24569) 9650 : cluster [DBG] pgmap v8311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:05:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:55.591645+0000 mgr.smithi067.rdualw (mgr.24569) 9650 : cluster [DBG] pgmap v8311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:05:59.306 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:05:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:57.592169+0000 mgr.smithi067.rdualw (mgr.24569) 9651 : cluster [DBG] pgmap v8312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:05:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:05:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:57.592169+0000 mgr.smithi067.rdualw (mgr.24569) 9651 : cluster [DBG] pgmap v8312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:05:59.592789+0000 mgr.smithi067.rdualw (mgr.24569) 9652 : cluster [DBG] pgmap v8313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:01.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:05:59.592789+0000 mgr.smithi067.rdualw (mgr.24569) 9652 : cluster [DBG] pgmap v8313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:01.593722+0000 mgr.smithi067.rdualw (mgr.24569) 9653 : cluster [DBG] pgmap v8314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:01.593722+0000 mgr.smithi067.rdualw (mgr.24569) 9653 : cluster [DBG] pgmap v8314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:03.594310+0000 mgr.smithi067.rdualw (mgr.24569) 9654 : cluster [DBG] pgmap v8315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:03.594310+0000 mgr.smithi067.rdualw (mgr.24569) 9654 : cluster [DBG] pgmap v8315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:05.595213+0000 mgr.smithi067.rdualw (mgr.24569) 9655 : cluster [DBG] pgmap v8316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:06:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:05.595213+0000 mgr.smithi067.rdualw (mgr.24569) 9655 : cluster [DBG] pgmap v8316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:06:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:07.595772+0000 mgr.smithi067.rdualw (mgr.24569) 9656 : cluster [DBG] pgmap v8317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:07.595772+0000 mgr.smithi067.rdualw (mgr.24569) 9656 : cluster [DBG] pgmap v8317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:09.596413+0000 mgr.smithi067.rdualw (mgr.24569) 9657 : cluster [DBG] pgmap v8318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:09.596413+0000 mgr.smithi067.rdualw (mgr.24569) 9657 : cluster [DBG] pgmap v8318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:11.597497+0000 mgr.smithi067.rdualw (mgr.24569) 9658 : cluster [DBG] pgmap v8319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:11.597497+0000 mgr.smithi067.rdualw (mgr.24569) 9658 : cluster [DBG] pgmap v8319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:13.843 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:06:14.135 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:06:14.136 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 10m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:06:14.136 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 10m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:06:14.136 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 10m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:06:14.136 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 10m ago 4h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:06:14.137 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 10m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:06:14.137 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 10m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:06:14.137 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 10m ago 4h 481M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:06:14.137 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 10m ago 4h 624M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:06:14.137 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 10m ago 4h 1762M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:06:14.138 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 10m ago 4h 909M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:06:14.138 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 10m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:06:14.138 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 10m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:06:14.138 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 10m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:06:14.139 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 10m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:06:14.139 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 10m ago 4h 1146M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:06:14.139 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 10m ago 4h 2034M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:06:14.139 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 10m ago 4h 1277M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:06:14.139 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 10m ago 4h 2180M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:06:14.140 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 10m ago 4h 2010M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:06:14.140 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 10m ago 4h 2182M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:06:14.140 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 10m ago 4h 1776M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:06:14.140 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 10m ago 4h 2726M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:06:14.141 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 10m ago 4h 153M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:06:14.480 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:06:14.481 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:06:14.481 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:06:14.481 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:06:14.482 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:06:14.482 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:06:14.482 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:06:14.482 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:06:14.482 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:06:14.483 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:06:14.483 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:06:14.483 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:06:14.483 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:06:14.484 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:06:14.484 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:06:14.484 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:06:14.484 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:06:14.484 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:06:14.485 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:06:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:13.598254+0000 mgr.smithi067.rdualw (mgr.24569) 9659 : cluster [DBG] pgmap v8320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:13.829632+0000 mgr.smithi067.rdualw (mgr.24569) 9660 : audit [DBG] from='client.40582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:06:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:14.479641+0000 mon.smithi061 (mon.0) 2052 : audit [DBG] from='client.? 172.21.15.61:0/796131804' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:06:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:13.598254+0000 mgr.smithi067.rdualw (mgr.24569) 9659 : cluster [DBG] pgmap v8320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:13.829632+0000 mgr.smithi067.rdualw (mgr.24569) 9660 : audit [DBG] from='client.40582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:06:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:14.479641+0000 mon.smithi061 (mon.0) 2052 : audit [DBG] from='client.? 172.21.15.61:0/796131804' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:06:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:14.117996+0000 mgr.smithi067.rdualw (mgr.24569) 9661 : audit [DBG] from='client.40586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:06:16.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:14.117996+0000 mgr.smithi067.rdualw (mgr.24569) 9661 : audit [DBG] from='client.40586 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:06:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:15.599257+0000 mgr.smithi067.rdualw (mgr.24569) 9662 : cluster [DBG] pgmap v8321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:06:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:15.599257+0000 mgr.smithi067.rdualw (mgr.24569) 9662 : cluster [DBG] pgmap v8321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:06:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:17.599808+0000 mgr.smithi067.rdualw (mgr.24569) 9663 : cluster [DBG] pgmap v8322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:17.632953+0000 mon.smithi067 (mon.1) 1465 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:06:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:17.634373+0000 mon.smithi067 (mon.1) 1466 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:06:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:17.635308+0000 mon.smithi067 (mon.1) 1467 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:06:18.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:06:17.636169+0000 mgr.smithi067.rdualw (mgr.24569) 9664 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:06:18.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:17.599808+0000 mgr.smithi067.rdualw (mgr.24569) 9663 : cluster [DBG] pgmap v8322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:18.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:17.632953+0000 mon.smithi067 (mon.1) 1465 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:06:18.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:17.634373+0000 mon.smithi067 (mon.1) 1466 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:06:18.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:17.635308+0000 mon.smithi067 (mon.1) 1467 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:06:18.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:06:17.636169+0000 mgr.smithi067.rdualw (mgr.24569) 9664 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:06:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:19.600483+0000 mgr.smithi067.rdualw (mgr.24569) 9665 : cluster [DBG] pgmap v8323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:19.600483+0000 mgr.smithi067.rdualw (mgr.24569) 9665 : cluster [DBG] pgmap v8323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:21.601219+0000 mgr.smithi067.rdualw (mgr.24569) 9666 : cluster [DBG] pgmap v8324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:22.323485+0000 mon.smithi061 (mon.0) 2053 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:06:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:22.712317+0000 mon.smithi067 (mon.1) 1468 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:06:23.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:22.712980+0000 mon.smithi061 (mon.0) 2054 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:06:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:21.601219+0000 mgr.smithi067.rdualw (mgr.24569) 9666 : cluster [DBG] pgmap v8324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:22.323485+0000 mon.smithi061 (mon.0) 2053 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:06:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:22.712317+0000 mon.smithi067 (mon.1) 1468 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:06:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:22.712980+0000 mon.smithi061 (mon.0) 2054 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:06:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:23.601956+0000 mgr.smithi067.rdualw (mgr.24569) 9667 : cluster [DBG] pgmap v8325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:24.592230+0000 mon.smithi061 (mon.0) 2055 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:06:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:23.601956+0000 mgr.smithi067.rdualw (mgr.24569) 9667 : cluster [DBG] pgmap v8325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:24.592230+0000 mon.smithi061 (mon.0) 2055 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:06:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:24.999465+0000 mon.smithi067 (mon.1) 1469 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:06:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:25.000202+0000 mon.smithi061 (mon.0) 2056 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:06:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:25.004644+0000 mon.smithi061 (mon.0) 2057 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:06:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:25.014911+0000 mon.smithi061 (mon.0) 2058 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:06:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:24.999465+0000 mon.smithi067 (mon.1) 1469 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:06:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:25.000202+0000 mon.smithi061 (mon.0) 2056 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:06:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:25.004644+0000 mon.smithi061 (mon.0) 2057 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:06:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:25.014911+0000 mon.smithi061 (mon.0) 2058 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:06:27.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:25.602814+0000 mgr.smithi067.rdualw (mgr.24569) 9668 : cluster [DBG] pgmap v8326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:06:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:25.602814+0000 mgr.smithi067.rdualw (mgr.24569) 9668 : cluster [DBG] pgmap v8326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:06:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:27.603495+0000 mgr.smithi067.rdualw (mgr.24569) 9669 : cluster [DBG] pgmap v8327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:27.603495+0000 mgr.smithi067.rdualw (mgr.24569) 9669 : cluster [DBG] pgmap v8327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:29.604297+0000 mgr.smithi067.rdualw (mgr.24569) 9670 : cluster [DBG] pgmap v8328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:29.604297+0000 mgr.smithi067.rdualw (mgr.24569) 9670 : cluster [DBG] pgmap v8328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:31.605290+0000 mgr.smithi067.rdualw (mgr.24569) 9671 : cluster [DBG] pgmap v8329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:31.605290+0000 mgr.smithi067.rdualw (mgr.24569) 9671 : cluster [DBG] pgmap v8329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:33.605926+0000 mgr.smithi067.rdualw (mgr.24569) 9672 : cluster [DBG] pgmap v8330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:33.605926+0000 mgr.smithi067.rdualw (mgr.24569) 9672 : cluster [DBG] pgmap v8330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:35.606855+0000 mgr.smithi067.rdualw (mgr.24569) 9673 : cluster [DBG] pgmap v8331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:06:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:35.972278+0000 mon.smithi067 (mon.1) 1470 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:06:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:35.972657+0000 mon.smithi067 (mon.1) 1471 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:06:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:35.972831+0000 mon.smithi061 (mon.0) 2059 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:06:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:35.973152+0000 mon.smithi061 (mon.0) 2060 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:06:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:35.606855+0000 mgr.smithi067.rdualw (mgr.24569) 9673 : cluster [DBG] pgmap v8331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:06:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:35.972278+0000 mon.smithi067 (mon.1) 1470 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:06:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:35.972657+0000 mon.smithi067 (mon.1) 1471 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:06:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:35.972831+0000 mon.smithi061 (mon.0) 2059 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:06:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:35.973152+0000 mon.smithi061 (mon.0) 2060 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:06:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:37.607337+0000 mgr.smithi067.rdualw (mgr.24569) 9674 : cluster [DBG] pgmap v8332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:38.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:37.607337+0000 mgr.smithi067.rdualw (mgr.24569) 9674 : cluster [DBG] pgmap v8332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:39.607920+0000 mgr.smithi067.rdualw (mgr.24569) 9675 : cluster [DBG] pgmap v8333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:39.607920+0000 mgr.smithi067.rdualw (mgr.24569) 9675 : cluster [DBG] pgmap v8333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:41.608991+0000 mgr.smithi067.rdualw (mgr.24569) 9676 : cluster [DBG] pgmap v8334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:41.608991+0000 mgr.smithi067.rdualw (mgr.24569) 9676 : cluster [DBG] pgmap v8334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:44.791 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:06:45.083 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:06:45.084 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 20s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:06:45.084 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 20s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:06:45.084 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 22s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:06:45.084 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 20s ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:06:45.085 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 20s ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:06:45.085 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 22s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:06:45.085 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 20s ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:06:45.085 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 22s ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:06:45.085 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 20s ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:06:45.086 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 22s ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:06:45.086 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 20s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:06:45.086 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 22s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:06:45.086 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 20s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:06:45.087 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 22s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:06:45.087 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 20s ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:06:45.087 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 20s ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:06:45.087 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 20s ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:06:45.088 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 20s ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:06:45.088 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 22s ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:06:45.088 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 22s ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:06:45.088 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 22s ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:06:45.088 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 22s ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:06:45.089 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 20s ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:06:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:43.609732+0000 mgr.smithi067.rdualw (mgr.24569) 9677 : cluster [DBG] pgmap v8335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:43.609732+0000 mgr.smithi067.rdualw (mgr.24569) 9677 : cluster [DBG] pgmap v8335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:45.433 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:06:45.433 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:06:45.433 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:06:45.434 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:06:45.434 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:06:45.434 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:06:45.434 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:06:45.435 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:06:45.435 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:06:45.435 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:06:45.435 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:06:45.436 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:06:45.436 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:06:45.436 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:06:45.436 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:06:45.436 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:06:45.437 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:06:45.437 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:06:45.437 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:06:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:44.776939+0000 mgr.smithi067.rdualw (mgr.24569) 9678 : audit [DBG] from='client.40594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:06:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:45.432152+0000 mon.smithi061 (mon.0) 2061 : audit [DBG] from='client.? 172.21.15.61:0/2259442535' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:06:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:44.776939+0000 mgr.smithi067.rdualw (mgr.24569) 9678 : audit [DBG] from='client.40594 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:06:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:45.432152+0000 mon.smithi061 (mon.0) 2061 : audit [DBG] from='client.? 172.21.15.61:0/2259442535' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:06:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:06:45.065440+0000 mgr.smithi067.rdualw (mgr.24569) 9679 : audit [DBG] from='client.40598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:06:47.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:45.610508+0000 mgr.smithi067.rdualw (mgr.24569) 9680 : cluster [DBG] pgmap v8336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:06:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:06:45.065440+0000 mgr.smithi067.rdualw (mgr.24569) 9679 : audit [DBG] from='client.40598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:06:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:45.610508+0000 mgr.smithi067.rdualw (mgr.24569) 9680 : cluster [DBG] pgmap v8336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:06:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:47.611003+0000 mgr.smithi067.rdualw (mgr.24569) 9681 : cluster [DBG] pgmap v8337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:47.611003+0000 mgr.smithi067.rdualw (mgr.24569) 9681 : cluster [DBG] pgmap v8337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:49.611671+0000 mgr.smithi067.rdualw (mgr.24569) 9682 : cluster [DBG] pgmap v8338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:49.611671+0000 mgr.smithi067.rdualw (mgr.24569) 9682 : cluster [DBG] pgmap v8338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:51.612578+0000 mgr.smithi067.rdualw (mgr.24569) 9683 : cluster [DBG] pgmap v8339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:51.612578+0000 mgr.smithi067.rdualw (mgr.24569) 9683 : cluster [DBG] pgmap v8339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:53.613049+0000 mgr.smithi067.rdualw (mgr.24569) 9684 : cluster [DBG] pgmap v8340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:53.613049+0000 mgr.smithi067.rdualw (mgr.24569) 9684 : cluster [DBG] pgmap v8340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:55.613943+0000 mgr.smithi067.rdualw (mgr.24569) 9685 : cluster [DBG] pgmap v8341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:06:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:55.613943+0000 mgr.smithi067.rdualw (mgr.24569) 9685 : cluster [DBG] pgmap v8341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:06:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:06:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:57.614420+0000 mgr.smithi067.rdualw (mgr.24569) 9686 : cluster [DBG] pgmap v8342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:06:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:06:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:57.614420+0000 mgr.smithi067.rdualw (mgr.24569) 9686 : cluster [DBG] pgmap v8342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:06:59.615025+0000 mgr.smithi067.rdualw (mgr.24569) 9687 : cluster [DBG] pgmap v8343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:06:59.615025+0000 mgr.smithi067.rdualw (mgr.24569) 9687 : cluster [DBG] pgmap v8343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:01.616063+0000 mgr.smithi067.rdualw (mgr.24569) 9688 : cluster [DBG] pgmap v8344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:01.616063+0000 mgr.smithi067.rdualw (mgr.24569) 9688 : cluster [DBG] pgmap v8344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:03.616708+0000 mgr.smithi067.rdualw (mgr.24569) 9689 : cluster [DBG] pgmap v8345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:03.616708+0000 mgr.smithi067.rdualw (mgr.24569) 9689 : cluster [DBG] pgmap v8345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:05.617677+0000 mgr.smithi067.rdualw (mgr.24569) 9690 : cluster [DBG] pgmap v8346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:07:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:05.617677+0000 mgr.smithi067.rdualw (mgr.24569) 9690 : cluster [DBG] pgmap v8346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:07:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:07.618127+0000 mgr.smithi067.rdualw (mgr.24569) 9691 : cluster [DBG] pgmap v8347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:07.618127+0000 mgr.smithi067.rdualw (mgr.24569) 9691 : cluster [DBG] pgmap v8347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:09.618744+0000 mgr.smithi067.rdualw (mgr.24569) 9692 : cluster [DBG] pgmap v8348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:09.618744+0000 mgr.smithi067.rdualw (mgr.24569) 9692 : cluster [DBG] pgmap v8348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:11.619769+0000 mgr.smithi067.rdualw (mgr.24569) 9693 : cluster [DBG] pgmap v8349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:11.619769+0000 mgr.smithi067.rdualw (mgr.24569) 9693 : cluster [DBG] pgmap v8349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:13.620480+0000 mgr.smithi067.rdualw (mgr.24569) 9694 : cluster [DBG] pgmap v8350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:13.620480+0000 mgr.smithi067.rdualw (mgr.24569) 9694 : cluster [DBG] pgmap v8350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:15.763 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:07:16.056 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:07:16.057 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 51s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:07:16.057 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 51s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:07:16.057 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 53s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:07:16.058 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 51s ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:07:16.058 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 51s ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:07:16.058 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 53s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:07:16.058 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 51s ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:07:16.058 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 53s ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:07:16.059 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 51s ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:07:16.059 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 53s ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:07:16.059 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 51s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:07:16.059 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 53s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:07:16.060 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 51s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:07:16.060 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 53s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:07:16.060 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 51s ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:07:16.060 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 51s ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:07:16.061 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 51s ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:07:16.061 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 51s ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:07:16.061 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 53s ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:07:16.061 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 53s ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:07:16.061 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 53s ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:07:16.062 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 53s ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:07:16.062 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 51s ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:07:16.400 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:07:16.400 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:07:16.401 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:07:16.401 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:07:16.401 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:07:16.401 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:07:16.402 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:07:16.402 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:07:16.402 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:07:16.402 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:07:16.403 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:07:16.403 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:07:16.403 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:07:16.403 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:07:16.404 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:07:16.404 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:07:16.404 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:07:16.404 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:07:16.405 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:07:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:15.621270+0000 mgr.smithi067.rdualw (mgr.24569) 9695 : cluster [DBG] pgmap v8351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:07:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:07:15.749553+0000 mgr.smithi067.rdualw (mgr.24569) 9696 : audit [DBG] from='client.40606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:07:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:07:16.398851+0000 mon.smithi061 (mon.0) 2062 : audit [DBG] from='client.? 172.21.15.61:0/4272891164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:07:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:15.621270+0000 mgr.smithi067.rdualw (mgr.24569) 9695 : cluster [DBG] pgmap v8351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:07:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:07:15.749553+0000 mgr.smithi067.rdualw (mgr.24569) 9696 : audit [DBG] from='client.40606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:07:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:07:16.398851+0000 mon.smithi061 (mon.0) 2062 : audit [DBG] from='client.? 172.21.15.61:0/4272891164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:07:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:07:16.038956+0000 mgr.smithi067.rdualw (mgr.24569) 9697 : audit [DBG] from='client.40610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:07:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:07:16.038956+0000 mgr.smithi067.rdualw (mgr.24569) 9697 : audit [DBG] from='client.40610 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:07:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:17.621780+0000 mgr.smithi067.rdualw (mgr.24569) 9698 : cluster [DBG] pgmap v8352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:17.621780+0000 mgr.smithi067.rdualw (mgr.24569) 9698 : cluster [DBG] pgmap v8352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:19.622545+0000 mgr.smithi067.rdualw (mgr.24569) 9699 : cluster [DBG] pgmap v8353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:21.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:19.622545+0000 mgr.smithi067.rdualw (mgr.24569) 9699 : cluster [DBG] pgmap v8353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:21.623481+0000 mgr.smithi067.rdualw (mgr.24569) 9700 : cluster [DBG] pgmap v8354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:21.623481+0000 mgr.smithi067.rdualw (mgr.24569) 9700 : cluster [DBG] pgmap v8354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:23.624163+0000 mgr.smithi067.rdualw (mgr.24569) 9701 : cluster [DBG] pgmap v8355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:23.624163+0000 mgr.smithi067.rdualw (mgr.24569) 9701 : cluster [DBG] pgmap v8355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:07:25.021842+0000 mon.smithi067 (mon.1) 1472 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:07:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:07:25.023220+0000 mon.smithi067 (mon.1) 1473 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:07:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:07:25.024171+0000 mon.smithi067 (mon.1) 1474 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:07:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:07:25.443242+0000 mon.smithi061 (mon.0) 2063 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:07:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:07:25.449072+0000 mon.smithi061 (mon.0) 2064 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:07:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:07:25.021842+0000 mon.smithi067 (mon.1) 1472 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:07:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:07:25.023220+0000 mon.smithi067 (mon.1) 1473 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:07:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:07:25.024171+0000 mon.smithi067 (mon.1) 1474 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:07:26.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:07:25.443242+0000 mon.smithi061 (mon.0) 2063 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:07:26.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:07:25.449072+0000 mon.smithi061 (mon.0) 2064 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:07:27.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:07:25.025037+0000 mgr.smithi067.rdualw (mgr.24569) 9702 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:07:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:25.625181+0000 mgr.smithi067.rdualw (mgr.24569) 9703 : cluster [DBG] pgmap v8356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:07:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:07:25.025037+0000 mgr.smithi067.rdualw (mgr.24569) 9702 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:07:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:25.625181+0000 mgr.smithi067.rdualw (mgr.24569) 9703 : cluster [DBG] pgmap v8356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:07:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:27.625923+0000 mgr.smithi067.rdualw (mgr.24569) 9704 : cluster [DBG] pgmap v8357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:27.625923+0000 mgr.smithi067.rdualw (mgr.24569) 9704 : cluster [DBG] pgmap v8357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:29.626560+0000 mgr.smithi067.rdualw (mgr.24569) 9705 : cluster [DBG] pgmap v8358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:29.626560+0000 mgr.smithi067.rdualw (mgr.24569) 9705 : cluster [DBG] pgmap v8358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:31.627446+0000 mgr.smithi067.rdualw (mgr.24569) 9706 : cluster [DBG] pgmap v8359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:31.627446+0000 mgr.smithi067.rdualw (mgr.24569) 9706 : cluster [DBG] pgmap v8359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:33.628005+0000 mgr.smithi067.rdualw (mgr.24569) 9707 : cluster [DBG] pgmap v8360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:33.628005+0000 mgr.smithi067.rdualw (mgr.24569) 9707 : cluster [DBG] pgmap v8360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:35.628802+0000 mgr.smithi067.rdualw (mgr.24569) 9708 : cluster [DBG] pgmap v8361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:07:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:07:35.977614+0000 mon.smithi067 (mon.1) 1475 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:07:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:07:35.977853+0000 mon.smithi067 (mon.1) 1476 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:07:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:07:35.978187+0000 mon.smithi061 (mon.0) 2065 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:07:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:07:35.978487+0000 mon.smithi061 (mon.0) 2066 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:07:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:35.628802+0000 mgr.smithi067.rdualw (mgr.24569) 9708 : cluster [DBG] pgmap v8361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:07:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:07:35.977614+0000 mon.smithi067 (mon.1) 1475 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:07:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:07:35.977853+0000 mon.smithi067 (mon.1) 1476 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:07:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:07:35.978187+0000 mon.smithi061 (mon.0) 2065 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:07:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:07:35.978487+0000 mon.smithi061 (mon.0) 2066 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:07:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:37.629327+0000 mgr.smithi067.rdualw (mgr.24569) 9709 : cluster [DBG] pgmap v8362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:37.629327+0000 mgr.smithi067.rdualw (mgr.24569) 9709 : cluster [DBG] pgmap v8362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:39.630145+0000 mgr.smithi067.rdualw (mgr.24569) 9710 : cluster [DBG] pgmap v8363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:41.321 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:39.630145+0000 mgr.smithi067.rdualw (mgr.24569) 9710 : cluster [DBG] pgmap v8363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:41.631260+0000 mgr.smithi067.rdualw (mgr.24569) 9711 : cluster [DBG] pgmap v8364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:41.631260+0000 mgr.smithi067.rdualw (mgr.24569) 9711 : cluster [DBG] pgmap v8364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:43.631939+0000 mgr.smithi067.rdualw (mgr.24569) 9712 : cluster [DBG] pgmap v8365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:43.631939+0000 mgr.smithi067.rdualw (mgr.24569) 9712 : cluster [DBG] pgmap v8365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:46.708 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:07:47.006 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:07:47.006 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 82s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:07:47.007 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 82s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:07:47.007 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 84s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:07:47.007 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 82s ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:07:47.007 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 82s ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:07:47.008 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 84s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:07:47.008 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 82s ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:07:47.008 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 84s ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:07:47.008 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 82s ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:07:47.009 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 84s ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:07:47.009 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 82s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:07:47.009 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 84s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:07:47.009 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 82s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:07:47.009 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 84s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:07:47.010 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 82s ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:07:47.010 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 82s ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:07:47.010 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 82s ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:07:47.010 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 82s ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:07:47.011 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 84s ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:07:47.011 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 84s ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:07:47.011 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 84s ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:07:47.011 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 84s ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:07:47.011 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 82s ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:07:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:45.632803+0000 mgr.smithi067.rdualw (mgr.24569) 9713 : cluster [DBG] pgmap v8366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:07:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:45.632803+0000 mgr.smithi067.rdualw (mgr.24569) 9713 : cluster [DBG] pgmap v8366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:07:47.350 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:07:47.351 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:07:47.351 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:07:47.351 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:07:47.351 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:07:47.352 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:07:47.352 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:07:47.352 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:07:47.352 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:07:47.352 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:07:47.353 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:07:47.353 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:07:47.353 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:07:47.353 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:07:47.354 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:07:47.354 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:07:47.354 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:07:47.354 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:07:47.354 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:07:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:07:46.694952+0000 mgr.smithi067.rdualw (mgr.24569) 9714 : audit [DBG] from='client.40618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:07:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:07:46.987906+0000 mgr.smithi067.rdualw (mgr.24569) 9715 : audit [DBG] from='client.40622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:07:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:07:47.349336+0000 mon.smithi061 (mon.0) 2067 : audit [DBG] from='client.? 172.21.15.61:0/1697121826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:07:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:47.633390+0000 mgr.smithi067.rdualw (mgr.24569) 9716 : cluster [DBG] pgmap v8367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:07:46.694952+0000 mgr.smithi067.rdualw (mgr.24569) 9714 : audit [DBG] from='client.40618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:07:48.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:07:46.987906+0000 mgr.smithi067.rdualw (mgr.24569) 9715 : audit [DBG] from='client.40622 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:07:48.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:07:47.349336+0000 mon.smithi061 (mon.0) 2067 : audit [DBG] from='client.? 172.21.15.61:0/1697121826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:07:48.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:47.633390+0000 mgr.smithi067.rdualw (mgr.24569) 9716 : cluster [DBG] pgmap v8367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:49.633981+0000 mgr.smithi067.rdualw (mgr.24569) 9717 : cluster [DBG] pgmap v8368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:49.633981+0000 mgr.smithi067.rdualw (mgr.24569) 9717 : cluster [DBG] pgmap v8368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:51.634896+0000 mgr.smithi067.rdualw (mgr.24569) 9718 : cluster [DBG] pgmap v8369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:51.634896+0000 mgr.smithi067.rdualw (mgr.24569) 9718 : cluster [DBG] pgmap v8369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:53.635507+0000 mgr.smithi067.rdualw (mgr.24569) 9719 : cluster [DBG] pgmap v8370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:53.635507+0000 mgr.smithi067.rdualw (mgr.24569) 9719 : cluster [DBG] pgmap v8370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:55.636266+0000 mgr.smithi067.rdualw (mgr.24569) 9720 : cluster [DBG] pgmap v8371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:07:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:55.636266+0000 mgr.smithi067.rdualw (mgr.24569) 9720 : cluster [DBG] pgmap v8371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:07:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:07:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:57.636841+0000 mgr.smithi067.rdualw (mgr.24569) 9721 : cluster [DBG] pgmap v8372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:07:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:07:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:57.636841+0000 mgr.smithi067.rdualw (mgr.24569) 9721 : cluster [DBG] pgmap v8372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:07:59.637494+0000 mgr.smithi067.rdualw (mgr.24569) 9722 : cluster [DBG] pgmap v8373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:07:59.637494+0000 mgr.smithi067.rdualw (mgr.24569) 9722 : cluster [DBG] pgmap v8373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:01.638462+0000 mgr.smithi067.rdualw (mgr.24569) 9723 : cluster [DBG] pgmap v8374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:01.638462+0000 mgr.smithi067.rdualw (mgr.24569) 9723 : cluster [DBG] pgmap v8374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:03.639111+0000 mgr.smithi067.rdualw (mgr.24569) 9724 : cluster [DBG] pgmap v8375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:03.639111+0000 mgr.smithi067.rdualw (mgr.24569) 9724 : cluster [DBG] pgmap v8375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:05.639975+0000 mgr.smithi067.rdualw (mgr.24569) 9725 : cluster [DBG] pgmap v8376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:08:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:05.639975+0000 mgr.smithi067.rdualw (mgr.24569) 9725 : cluster [DBG] pgmap v8376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:08:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:07.640453+0000 mgr.smithi067.rdualw (mgr.24569) 9726 : cluster [DBG] pgmap v8377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:07.640453+0000 mgr.smithi067.rdualw (mgr.24569) 9726 : cluster [DBG] pgmap v8377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:09.641085+0000 mgr.smithi067.rdualw (mgr.24569) 9727 : cluster [DBG] pgmap v8378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:09.641085+0000 mgr.smithi067.rdualw (mgr.24569) 9727 : cluster [DBG] pgmap v8378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:11.642033+0000 mgr.smithi067.rdualw (mgr.24569) 9728 : cluster [DBG] pgmap v8379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:11.642033+0000 mgr.smithi067.rdualw (mgr.24569) 9728 : cluster [DBG] pgmap v8379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:13.642548+0000 mgr.smithi067.rdualw (mgr.24569) 9729 : cluster [DBG] pgmap v8380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:13.642548+0000 mgr.smithi067.rdualw (mgr.24569) 9729 : cluster [DBG] pgmap v8380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:15.643439+0000 mgr.smithi067.rdualw (mgr.24569) 9730 : cluster [DBG] pgmap v8381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:08:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:15.643439+0000 mgr.smithi067.rdualw (mgr.24569) 9730 : cluster [DBG] pgmap v8381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:08:17.658 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:08:17.950 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:08:17.951 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 113s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:08:17.951 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 113s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:08:17.951 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 115s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:08:17.951 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 113s ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:08:17.951 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 113s ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:08:17.952 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 115s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:08:17.952 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 113s ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:08:17.952 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 115s ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:08:17.952 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 113s ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:08:17.953 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 115s ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:08:17.953 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 113s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:08:17.953 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 115s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:08:17.953 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 113s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:08:17.953 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 115s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:08:17.954 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 113s ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:08:17.954 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 113s ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:08:17.954 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 113s ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:08:17.954 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 113s ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:08:17.954 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 115s ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:08:17.955 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 115s ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:08:17.955 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 115s ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:08:17.955 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 115s ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:08:17.955 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 113s ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:08:18.291 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:08:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:08:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:08:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:08:18.292 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:08:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:08:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:08:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:08:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:08:18.293 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:08:18.294 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:08:18.294 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:08:18.294 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:08:18.294 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:08:18.295 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:08:18.295 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:08:18.295 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:08:18.295 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:08:18.295 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:08:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:17.643956+0000 mgr.smithi067.rdualw (mgr.24569) 9731 : cluster [DBG] pgmap v8382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:08:17.645151+0000 mgr.smithi067.rdualw (mgr.24569) 9732 : audit [DBG] from='client.40630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:08:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:08:18.290571+0000 mon.smithi061 (mon.0) 2068 : audit [DBG] from='client.? 172.21.15.61:0/3899358755' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:08:19.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:17.643956+0000 mgr.smithi067.rdualw (mgr.24569) 9731 : cluster [DBG] pgmap v8382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:19.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:08:17.645151+0000 mgr.smithi067.rdualw (mgr.24569) 9732 : audit [DBG] from='client.40630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:08:19.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:08:18.290571+0000 mon.smithi061 (mon.0) 2068 : audit [DBG] from='client.? 172.21.15.61:0/3899358755' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:08:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:08:17.933226+0000 mgr.smithi067.rdualw (mgr.24569) 9733 : audit [DBG] from='client.40634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:08:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:08:17.933226+0000 mgr.smithi067.rdualw (mgr.24569) 9733 : audit [DBG] from='client.40634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:08:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:19.644579+0000 mgr.smithi067.rdualw (mgr.24569) 9734 : cluster [DBG] pgmap v8383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:19.644579+0000 mgr.smithi067.rdualw (mgr.24569) 9734 : cluster [DBG] pgmap v8383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:21.645447+0000 mgr.smithi067.rdualw (mgr.24569) 9735 : cluster [DBG] pgmap v8384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:21.645447+0000 mgr.smithi067.rdualw (mgr.24569) 9735 : cluster [DBG] pgmap v8384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:23.645956+0000 mgr.smithi067.rdualw (mgr.24569) 9736 : cluster [DBG] pgmap v8385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:23.645956+0000 mgr.smithi067.rdualw (mgr.24569) 9736 : cluster [DBG] pgmap v8385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:08:25.452813+0000 mon.smithi067 (mon.1) 1477 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:08:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:08:25.454342+0000 mon.smithi067 (mon.1) 1478 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:08:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:08:25.455297+0000 mon.smithi067 (mon.1) 1479 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:08:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:08:25.811890+0000 mon.smithi061 (mon.0) 2069 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:08:26.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:08:25.822052+0000 mon.smithi061 (mon.0) 2070 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:08:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:08:25.452813+0000 mon.smithi067 (mon.1) 1477 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:08:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:08:25.454342+0000 mon.smithi067 (mon.1) 1478 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:08:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:08:25.455297+0000 mon.smithi067 (mon.1) 1479 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:08:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:08:25.811890+0000 mon.smithi061 (mon.0) 2069 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:08:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:08:25.822052+0000 mon.smithi061 (mon.0) 2070 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:08:27.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:08:25.456162+0000 mgr.smithi067.rdualw (mgr.24569) 9737 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:08:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:25.646837+0000 mgr.smithi067.rdualw (mgr.24569) 9738 : cluster [DBG] pgmap v8386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:08:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:08:26.222882+0000 mon.smithi061 (mon.0) 2071 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:08:27.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:08:26.228564+0000 mon.smithi061 (mon.0) 2072 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:08:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:08:25.456162+0000 mgr.smithi067.rdualw (mgr.24569) 9737 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:08:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:25.646837+0000 mgr.smithi067.rdualw (mgr.24569) 9738 : cluster [DBG] pgmap v8386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:08:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:08:26.222882+0000 mon.smithi061 (mon.0) 2071 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:08:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:08:26.228564+0000 mon.smithi061 (mon.0) 2072 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:08:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:27.647515+0000 mgr.smithi067.rdualw (mgr.24569) 9739 : cluster [DBG] pgmap v8387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:27.647515+0000 mgr.smithi067.rdualw (mgr.24569) 9739 : cluster [DBG] pgmap v8387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:29.648071+0000 mgr.smithi067.rdualw (mgr.24569) 9740 : cluster [DBG] pgmap v8388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:29.648071+0000 mgr.smithi067.rdualw (mgr.24569) 9740 : cluster [DBG] pgmap v8388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:31.648921+0000 mgr.smithi067.rdualw (mgr.24569) 9741 : cluster [DBG] pgmap v8389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:31.648921+0000 mgr.smithi067.rdualw (mgr.24569) 9741 : cluster [DBG] pgmap v8389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:33.649619+0000 mgr.smithi067.rdualw (mgr.24569) 9742 : cluster [DBG] pgmap v8390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:33.649619+0000 mgr.smithi067.rdualw (mgr.24569) 9742 : cluster [DBG] pgmap v8390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:35.650587+0000 mgr.smithi067.rdualw (mgr.24569) 9743 : cluster [DBG] pgmap v8391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:08:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:08:35.983833+0000 mon.smithi067 (mon.1) 1480 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:08:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:08:35.984076+0000 mon.smithi067 (mon.1) 1481 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:08:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:08:35.984621+0000 mon.smithi061 (mon.0) 2073 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:08:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:08:35.984899+0000 mon.smithi061 (mon.0) 2074 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:08:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:35.650587+0000 mgr.smithi067.rdualw (mgr.24569) 9743 : cluster [DBG] pgmap v8391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:08:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:08:35.983833+0000 mon.smithi067 (mon.1) 1480 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:08:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:08:35.984076+0000 mon.smithi067 (mon.1) 1481 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:08:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:08:35.984621+0000 mon.smithi061 (mon.0) 2073 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:08:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:08:35.984899+0000 mon.smithi061 (mon.0) 2074 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:08:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:37.651172+0000 mgr.smithi067.rdualw (mgr.24569) 9744 : cluster [DBG] pgmap v8392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:37.651172+0000 mgr.smithi067.rdualw (mgr.24569) 9744 : cluster [DBG] pgmap v8392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:39.651820+0000 mgr.smithi067.rdualw (mgr.24569) 9745 : cluster [DBG] pgmap v8393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:39.651820+0000 mgr.smithi067.rdualw (mgr.24569) 9745 : cluster [DBG] pgmap v8393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:41.652756+0000 mgr.smithi067.rdualw (mgr.24569) 9746 : cluster [DBG] pgmap v8394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:41.652756+0000 mgr.smithi067.rdualw (mgr.24569) 9746 : cluster [DBG] pgmap v8394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:43.653201+0000 mgr.smithi067.rdualw (mgr.24569) 9747 : cluster [DBG] pgmap v8395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:43.653201+0000 mgr.smithi067.rdualw (mgr.24569) 9747 : cluster [DBG] pgmap v8395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:45.654090+0000 mgr.smithi067.rdualw (mgr.24569) 9748 : cluster [DBG] pgmap v8396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:08:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:45.654090+0000 mgr.smithi067.rdualw (mgr.24569) 9748 : cluster [DBG] pgmap v8396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:08:48.603 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:08:48.894 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:08:48.894 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 2m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:08:48.894 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 2m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:08:48.895 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 2m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:08:48.895 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 2m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:08:48.895 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 2m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:08:48.895 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 2m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:08:48.896 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 2m ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:08:48.896 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 2m ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:08:48.896 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 2m ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:08:48.896 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 2m ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:08:48.896 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 2m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:08:48.897 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 2m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:08:48.897 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 2m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:08:48.897 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 2m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:08:48.897 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 2m ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:08:48.898 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 2m ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:08:48.898 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 2m ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:08:48.898 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 2m ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:08:48.898 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 2m ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:08:48.898 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 2m ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:08:48.899 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 2m ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:08:48.899 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 2m ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:08:48.899 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 2m ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:08:49.233 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:08:49.233 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:08:49.233 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:08:49.234 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:08:49.234 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:08:49.234 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:08:49.234 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:08:49.235 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:08:49.235 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:08:49.235 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:08:49.235 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:08:49.235 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:08:49.236 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:08:49.236 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:08:49.236 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:08:49.236 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:08:49.237 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:08:49.237 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:08:49.237 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:08:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:47.654626+0000 mgr.smithi067.rdualw (mgr.24569) 9749 : cluster [DBG] pgmap v8397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:47.654626+0000 mgr.smithi067.rdualw (mgr.24569) 9749 : cluster [DBG] pgmap v8397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:08:48.590025+0000 mgr.smithi067.rdualw (mgr.24569) 9750 : audit [DBG] from='client.40642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:08:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:08:48.876427+0000 mgr.smithi067.rdualw (mgr.24569) 9751 : audit [DBG] from='client.40646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:08:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:08:49.232049+0000 mon.smithi061 (mon.0) 2075 : audit [DBG] from='client.? 172.21.15.61:0/2374190367' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:08:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:49.655162+0000 mgr.smithi067.rdualw (mgr.24569) 9752 : cluster [DBG] pgmap v8398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:08:48.590025+0000 mgr.smithi067.rdualw (mgr.24569) 9750 : audit [DBG] from='client.40642 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:08:50.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:08:48.876427+0000 mgr.smithi067.rdualw (mgr.24569) 9751 : audit [DBG] from='client.40646 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:08:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:08:49.232049+0000 mon.smithi061 (mon.0) 2075 : audit [DBG] from='client.? 172.21.15.61:0/2374190367' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:08:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:49.655162+0000 mgr.smithi067.rdualw (mgr.24569) 9752 : cluster [DBG] pgmap v8398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:51.656209+0000 mgr.smithi067.rdualw (mgr.24569) 9753 : cluster [DBG] pgmap v8399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:51.656209+0000 mgr.smithi067.rdualw (mgr.24569) 9753 : cluster [DBG] pgmap v8399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:53.656805+0000 mgr.smithi067.rdualw (mgr.24569) 9754 : cluster [DBG] pgmap v8400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:53.656805+0000 mgr.smithi067.rdualw (mgr.24569) 9754 : cluster [DBG] pgmap v8400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:55.657645+0000 mgr.smithi067.rdualw (mgr.24569) 9755 : cluster [DBG] pgmap v8401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:08:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:55.657645+0000 mgr.smithi067.rdualw (mgr.24569) 9755 : cluster [DBG] pgmap v8401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:08:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:08:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:57.658128+0000 mgr.smithi067.rdualw (mgr.24569) 9756 : cluster [DBG] pgmap v8402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:08:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:08:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:57.658128+0000 mgr.smithi067.rdualw (mgr.24569) 9756 : cluster [DBG] pgmap v8402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:08:59.658859+0000 mgr.smithi067.rdualw (mgr.24569) 9757 : cluster [DBG] pgmap v8403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:08:59.658859+0000 mgr.smithi067.rdualw (mgr.24569) 9757 : cluster [DBG] pgmap v8403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:01.659725+0000 mgr.smithi067.rdualw (mgr.24569) 9758 : cluster [DBG] pgmap v8404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:01.659725+0000 mgr.smithi067.rdualw (mgr.24569) 9758 : cluster [DBG] pgmap v8404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:03.660182+0000 mgr.smithi067.rdualw (mgr.24569) 9759 : cluster [DBG] pgmap v8405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:03.660182+0000 mgr.smithi067.rdualw (mgr.24569) 9759 : cluster [DBG] pgmap v8405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:05.661166+0000 mgr.smithi067.rdualw (mgr.24569) 9760 : cluster [DBG] pgmap v8406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:09:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:05.661166+0000 mgr.smithi067.rdualw (mgr.24569) 9760 : cluster [DBG] pgmap v8406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:09:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:07.661769+0000 mgr.smithi067.rdualw (mgr.24569) 9761 : cluster [DBG] pgmap v8407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:07.661769+0000 mgr.smithi067.rdualw (mgr.24569) 9761 : cluster [DBG] pgmap v8407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:09.662306+0000 mgr.smithi067.rdualw (mgr.24569) 9762 : cluster [DBG] pgmap v8408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:09.662306+0000 mgr.smithi067.rdualw (mgr.24569) 9762 : cluster [DBG] pgmap v8408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:11.663302+0000 mgr.smithi067.rdualw (mgr.24569) 9763 : cluster [DBG] pgmap v8409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:11.663302+0000 mgr.smithi067.rdualw (mgr.24569) 9763 : cluster [DBG] pgmap v8409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:13.663883+0000 mgr.smithi067.rdualw (mgr.24569) 9764 : cluster [DBG] pgmap v8410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:13.663883+0000 mgr.smithi067.rdualw (mgr.24569) 9764 : cluster [DBG] pgmap v8410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:15.664725+0000 mgr.smithi067.rdualw (mgr.24569) 9765 : cluster [DBG] pgmap v8411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:09:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:15.664725+0000 mgr.smithi067.rdualw (mgr.24569) 9765 : cluster [DBG] pgmap v8411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:09:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:17.665273+0000 mgr.smithi067.rdualw (mgr.24569) 9766 : cluster [DBG] pgmap v8412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:17.665273+0000 mgr.smithi067.rdualw (mgr.24569) 9766 : cluster [DBG] pgmap v8412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:19.538 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:09:19.827 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:09:19.827 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 2m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:09:19.828 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 2m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:09:19.828 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 2m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:09:19.828 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 2m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:09:19.828 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 2m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:09:19.829 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 2m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:09:19.829 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 2m ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:09:19.829 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 2m ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:09:19.831 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 2m ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:09:19.831 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 2m ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:09:19.831 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 2m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:09:19.831 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 2m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:09:19.832 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 2m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:09:19.832 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 2m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:09:19.832 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 2m ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:09:19.832 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 2m ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:09:19.833 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 2m ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:09:19.833 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 2m ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:09:19.833 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 2m ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:09:19.833 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 2m ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:09:19.834 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 2m ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:09:19.834 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 2m ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:09:19.834 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 2m ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:09:20.167 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:09:20.168 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:09:20.168 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:09:20.168 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:09:20.168 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:09:20.169 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:09:20.169 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:09:20.169 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:09:20.169 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:09:20.170 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:09:20.170 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:09:20.170 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:09:20.170 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:09:20.171 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:09:20.171 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:09:20.171 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:09:20.171 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:09:20.171 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:09:20.172 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:09:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:09:19.525430+0000 mgr.smithi067.rdualw (mgr.24569) 9767 : audit [DBG] from='client.40654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:09:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:19.666112+0000 mgr.smithi067.rdualw (mgr.24569) 9768 : cluster [DBG] pgmap v8413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:21.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:09:19.810320+0000 mgr.smithi067.rdualw (mgr.24569) 9769 : audit [DBG] from='client.40658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:09:21.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:09:20.166734+0000 mon.smithi061 (mon.0) 2076 : audit [DBG] from='client.? 172.21.15.61:0/984294314' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:09:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:09:19.525430+0000 mgr.smithi067.rdualw (mgr.24569) 9767 : audit [DBG] from='client.40654 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:09:21.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:19.666112+0000 mgr.smithi067.rdualw (mgr.24569) 9768 : cluster [DBG] pgmap v8413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:21.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:09:19.810320+0000 mgr.smithi067.rdualw (mgr.24569) 9769 : audit [DBG] from='client.40658 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:09:21.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:09:20.166734+0000 mon.smithi061 (mon.0) 2076 : audit [DBG] from='client.? 172.21.15.61:0/984294314' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:09:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:21.666942+0000 mgr.smithi067.rdualw (mgr.24569) 9770 : cluster [DBG] pgmap v8414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:21.666942+0000 mgr.smithi067.rdualw (mgr.24569) 9770 : cluster [DBG] pgmap v8414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:23.667433+0000 mgr.smithi067.rdualw (mgr.24569) 9771 : cluster [DBG] pgmap v8415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:23.667433+0000 mgr.smithi067.rdualw (mgr.24569) 9771 : cluster [DBG] pgmap v8415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:27.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:25.668240+0000 mgr.smithi067.rdualw (mgr.24569) 9772 : cluster [DBG] pgmap v8416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:09:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:09:26.231876+0000 mon.smithi067 (mon.1) 1482 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:09:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:09:26.233310+0000 mon.smithi067 (mon.1) 1483 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:09:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:09:26.234240+0000 mon.smithi067 (mon.1) 1484 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:09:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:09:26.650728+0000 mon.smithi061 (mon.0) 2077 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:09:27.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:09:26.658191+0000 mon.smithi061 (mon.0) 2078 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:09:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:25.668240+0000 mgr.smithi067.rdualw (mgr.24569) 9772 : cluster [DBG] pgmap v8416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:09:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:09:26.231876+0000 mon.smithi067 (mon.1) 1482 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:09:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:09:26.233310+0000 mon.smithi067 (mon.1) 1483 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:09:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:09:26.234240+0000 mon.smithi067 (mon.1) 1484 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:09:27.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:09:26.650728+0000 mon.smithi061 (mon.0) 2077 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:09:27.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:09:26.658191+0000 mon.smithi061 (mon.0) 2078 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:09:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:09:26.235109+0000 mgr.smithi067.rdualw (mgr.24569) 9773 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:09:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:09:26.235109+0000 mgr.smithi067.rdualw (mgr.24569) 9773 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:09:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:27.668768+0000 mgr.smithi067.rdualw (mgr.24569) 9774 : cluster [DBG] pgmap v8417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:27.668768+0000 mgr.smithi067.rdualw (mgr.24569) 9774 : cluster [DBG] pgmap v8417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:29.669388+0000 mgr.smithi067.rdualw (mgr.24569) 9775 : cluster [DBG] pgmap v8418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:29.669388+0000 mgr.smithi067.rdualw (mgr.24569) 9775 : cluster [DBG] pgmap v8418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:31.670250+0000 mgr.smithi067.rdualw (mgr.24569) 9776 : cluster [DBG] pgmap v8419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:31.670250+0000 mgr.smithi067.rdualw (mgr.24569) 9776 : cluster [DBG] pgmap v8419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:33.670904+0000 mgr.smithi067.rdualw (mgr.24569) 9777 : cluster [DBG] pgmap v8420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:33.670904+0000 mgr.smithi067.rdualw (mgr.24569) 9777 : cluster [DBG] pgmap v8420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:35.671801+0000 mgr.smithi067.rdualw (mgr.24569) 9778 : cluster [DBG] pgmap v8421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:09:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:09:35.989905+0000 mon.smithi067 (mon.1) 1485 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:09:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:09:35.990143+0000 mon.smithi067 (mon.1) 1486 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:09:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:09:35.990650+0000 mon.smithi061 (mon.0) 2079 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:09:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:09:35.991020+0000 mon.smithi061 (mon.0) 2080 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:09:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:35.671801+0000 mgr.smithi067.rdualw (mgr.24569) 9778 : cluster [DBG] pgmap v8421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:09:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:09:35.989905+0000 mon.smithi067 (mon.1) 1485 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:09:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:09:35.990143+0000 mon.smithi067 (mon.1) 1486 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:09:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:09:35.990650+0000 mon.smithi061 (mon.0) 2079 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:09:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:09:35.991020+0000 mon.smithi061 (mon.0) 2080 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:09:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:37.672336+0000 mgr.smithi067.rdualw (mgr.24569) 9779 : cluster [DBG] pgmap v8422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:37.672336+0000 mgr.smithi067.rdualw (mgr.24569) 9779 : cluster [DBG] pgmap v8422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:39.672971+0000 mgr.smithi067.rdualw (mgr.24569) 9780 : cluster [DBG] pgmap v8423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:39.672971+0000 mgr.smithi067.rdualw (mgr.24569) 9780 : cluster [DBG] pgmap v8423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:41.673836+0000 mgr.smithi067.rdualw (mgr.24569) 9781 : cluster [DBG] pgmap v8424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:41.673836+0000 mgr.smithi067.rdualw (mgr.24569) 9781 : cluster [DBG] pgmap v8424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:43.674495+0000 mgr.smithi067.rdualw (mgr.24569) 9782 : cluster [DBG] pgmap v8425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:43.674495+0000 mgr.smithi067.rdualw (mgr.24569) 9782 : cluster [DBG] pgmap v8425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:45.675336+0000 mgr.smithi067.rdualw (mgr.24569) 9783 : cluster [DBG] pgmap v8426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:09:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:45.675336+0000 mgr.smithi067.rdualw (mgr.24569) 9783 : cluster [DBG] pgmap v8426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:09:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:47.675831+0000 mgr.smithi067.rdualw (mgr.24569) 9784 : cluster [DBG] pgmap v8427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:47.675831+0000 mgr.smithi067.rdualw (mgr.24569) 9784 : cluster [DBG] pgmap v8427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:50.478 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:09:50.770 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:09:50.771 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 3m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:09:50.771 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 3m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:09:50.771 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 3m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:09:50.771 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 3m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:09:50.772 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 3m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:09:50.772 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 3m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:09:50.772 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 3m ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:09:50.772 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 3m ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:09:50.773 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 3m ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:09:50.773 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 3m ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:09:50.773 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 3m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:09:50.773 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 3m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:09:50.774 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 3m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:09:50.774 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 3m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:09:50.774 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 3m ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:09:50.774 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 3m ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:09:50.774 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 3m ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:09:50.775 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 3m ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:09:50.775 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 3m ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:09:50.775 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 3m ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:09:50.775 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 3m ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:09:50.776 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 3m ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:09:50.776 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 3m ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:09:51.204 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:09:51.205 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:09:51.205 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:09:51.205 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:09:51.205 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:09:51.206 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:09:51.206 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:09:51.206 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:09:51.206 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:09:51.206 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:09:51.207 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:09:51.207 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:09:51.207 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:09:51.207 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:09:51.208 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:09:51.208 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:09:51.208 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:09:51.208 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:09:51.209 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:09:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:49.676530+0000 mgr.smithi067.rdualw (mgr.24569) 9785 : cluster [DBG] pgmap v8428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:49.676530+0000 mgr.smithi067.rdualw (mgr.24569) 9785 : cluster [DBG] pgmap v8428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:52.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:09:50.464685+0000 mgr.smithi067.rdualw (mgr.24569) 9786 : audit [DBG] from='client.40666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:09:52.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:09:50.752918+0000 mgr.smithi067.rdualw (mgr.24569) 9787 : audit [DBG] from='client.40670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:09:52.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:09:51.203687+0000 mon.smithi061 (mon.0) 2081 : audit [DBG] from='client.? 172.21.15.61:0/4283901730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:09:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:09:50.464685+0000 mgr.smithi067.rdualw (mgr.24569) 9786 : audit [DBG] from='client.40666 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:09:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:09:50.752918+0000 mgr.smithi067.rdualw (mgr.24569) 9787 : audit [DBG] from='client.40670 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:09:52.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:09:51.203687+0000 mon.smithi061 (mon.0) 2081 : audit [DBG] from='client.? 172.21.15.61:0/4283901730' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:09:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:51.677635+0000 mgr.smithi067.rdualw (mgr.24569) 9788 : cluster [DBG] pgmap v8429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:51.677635+0000 mgr.smithi067.rdualw (mgr.24569) 9788 : cluster [DBG] pgmap v8429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:53.678175+0000 mgr.smithi067.rdualw (mgr.24569) 9789 : cluster [DBG] pgmap v8430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:53.678175+0000 mgr.smithi067.rdualw (mgr.24569) 9789 : cluster [DBG] pgmap v8430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:55.679017+0000 mgr.smithi067.rdualw (mgr.24569) 9790 : cluster [DBG] pgmap v8431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:09:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:55.679017+0000 mgr.smithi067.rdualw (mgr.24569) 9790 : cluster [DBG] pgmap v8431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:09:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:09:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:57.679588+0000 mgr.smithi067.rdualw (mgr.24569) 9791 : cluster [DBG] pgmap v8432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:09:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:09:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:57.679588+0000 mgr.smithi067.rdualw (mgr.24569) 9791 : cluster [DBG] pgmap v8432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:09:59.680299+0000 mgr.smithi067.rdualw (mgr.24569) 9792 : cluster [DBG] pgmap v8433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:00.000167+0000 mon.smithi061 (mon.0) 2082 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T20:10:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:09:59.680299+0000 mgr.smithi067.rdualw (mgr.24569) 9792 : cluster [DBG] pgmap v8433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:01.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:00.000167+0000 mon.smithi061 (mon.0) 2082 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T20:10:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:01.681237+0000 mgr.smithi067.rdualw (mgr.24569) 9793 : cluster [DBG] pgmap v8434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:01.681237+0000 mgr.smithi067.rdualw (mgr.24569) 9793 : cluster [DBG] pgmap v8434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:03.681741+0000 mgr.smithi067.rdualw (mgr.24569) 9794 : cluster [DBG] pgmap v8435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:03.681741+0000 mgr.smithi067.rdualw (mgr.24569) 9794 : cluster [DBG] pgmap v8435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:05.682510+0000 mgr.smithi067.rdualw (mgr.24569) 9795 : cluster [DBG] pgmap v8436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:10:07.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:05.682510+0000 mgr.smithi067.rdualw (mgr.24569) 9795 : cluster [DBG] pgmap v8436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:10:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:07.682979+0000 mgr.smithi067.rdualw (mgr.24569) 9796 : cluster [DBG] pgmap v8437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:07.682979+0000 mgr.smithi067.rdualw (mgr.24569) 9796 : cluster [DBG] pgmap v8437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:09.683588+0000 mgr.smithi067.rdualw (mgr.24569) 9797 : cluster [DBG] pgmap v8438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:09.683588+0000 mgr.smithi067.rdualw (mgr.24569) 9797 : cluster [DBG] pgmap v8438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:11.684451+0000 mgr.smithi067.rdualw (mgr.24569) 9798 : cluster [DBG] pgmap v8439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:11.684451+0000 mgr.smithi067.rdualw (mgr.24569) 9798 : cluster [DBG] pgmap v8439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:13.685167+0000 mgr.smithi067.rdualw (mgr.24569) 9799 : cluster [DBG] pgmap v8440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:13.685167+0000 mgr.smithi067.rdualw (mgr.24569) 9799 : cluster [DBG] pgmap v8440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:15.686285+0000 mgr.smithi067.rdualw (mgr.24569) 9800 : cluster [DBG] pgmap v8441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:10:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:15.686285+0000 mgr.smithi067.rdualw (mgr.24569) 9800 : cluster [DBG] pgmap v8441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:10:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:17.686827+0000 mgr.smithi067.rdualw (mgr.24569) 9801 : cluster [DBG] pgmap v8442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:17.686827+0000 mgr.smithi067.rdualw (mgr.24569) 9801 : cluster [DBG] pgmap v8442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:19.687559+0000 mgr.smithi067.rdualw (mgr.24569) 9802 : cluster [DBG] pgmap v8443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:19.687559+0000 mgr.smithi067.rdualw (mgr.24569) 9802 : cluster [DBG] pgmap v8443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:21.513 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:10:21.809 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:10:21.810 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 3m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:10:21.810 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 3m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:10:21.810 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 3m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:10:21.811 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 3m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:10:21.811 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 3m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:10:21.811 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 3m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:10:21.811 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 3m ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:10:21.812 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 3m ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:10:21.812 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 3m ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:10:21.812 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 3m ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:10:21.812 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 3m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:10:21.813 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 3m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:10:21.813 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 3m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:10:21.813 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 3m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:10:21.813 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 3m ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:10:21.813 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 3m ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:10:21.814 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 3m ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:10:21.814 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 3m ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:10:21.814 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 3m ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:10:21.814 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 3m ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:10:21.815 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 3m ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:10:21.815 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 3m ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:10:21.815 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 3m ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:10:22.150 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:10:22.151 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:10:22.151 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:10:22.151 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:10:22.152 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:10:22.152 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:10:22.153 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:10:22.153 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:10:22.154 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:10:22.154 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:10:22.154 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:10:22.155 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:10:22.155 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:10:22.156 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:10:22.156 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:10:22.157 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:10:22.157 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:10:22.157 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:10:22.158 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:10:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:10:21.500348+0000 mgr.smithi067.rdualw (mgr.24569) 9803 : audit [DBG] from='client.40678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:10:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:21.688316+0000 mgr.smithi067.rdualw (mgr.24569) 9804 : cluster [DBG] pgmap v8444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:10:21.791262+0000 mgr.smithi067.rdualw (mgr.24569) 9805 : audit [DBG] from='client.40682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:10:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:10:22.149013+0000 mon.smithi061 (mon.0) 2083 : audit [DBG] from='client.? 172.21.15.61:0/1885414949' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:10:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:10:21.500348+0000 mgr.smithi067.rdualw (mgr.24569) 9803 : audit [DBG] from='client.40678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:10:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:21.688316+0000 mgr.smithi067.rdualw (mgr.24569) 9804 : cluster [DBG] pgmap v8444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:10:21.791262+0000 mgr.smithi067.rdualw (mgr.24569) 9805 : audit [DBG] from='client.40682 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:10:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:10:22.149013+0000 mon.smithi061 (mon.0) 2083 : audit [DBG] from='client.? 172.21.15.61:0/1885414949' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:10:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:23.688864+0000 mgr.smithi067.rdualw (mgr.24569) 9806 : cluster [DBG] pgmap v8445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:23.688864+0000 mgr.smithi067.rdualw (mgr.24569) 9806 : cluster [DBG] pgmap v8445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:25.689765+0000 mgr.smithi067.rdualw (mgr.24569) 9807 : cluster [DBG] pgmap v8446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:10:27.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:10:26.661688+0000 mon.smithi067 (mon.1) 1487 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:10:27.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:10:26.663156+0000 mon.smithi067 (mon.1) 1488 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:10:27.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:10:26.664118+0000 mon.smithi067 (mon.1) 1489 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:10:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:25.689765+0000 mgr.smithi067.rdualw (mgr.24569) 9807 : cluster [DBG] pgmap v8446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:10:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:10:26.661688+0000 mon.smithi067 (mon.1) 1487 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:10:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:10:26.663156+0000 mon.smithi067 (mon.1) 1488 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:10:27.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:10:26.664118+0000 mon.smithi067 (mon.1) 1489 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:10:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:10:26.664982+0000 mgr.smithi067.rdualw (mgr.24569) 9808 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:10:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:10:27.084916+0000 mon.smithi061 (mon.0) 2084 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:10:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:10:27.090523+0000 mon.smithi061 (mon.0) 2085 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:10:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:10:26.664982+0000 mgr.smithi067.rdualw (mgr.24569) 9808 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:10:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:10:27.084916+0000 mon.smithi061 (mon.0) 2084 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:10:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:10:27.090523+0000 mon.smithi061 (mon.0) 2085 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:10:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:27.690329+0000 mgr.smithi067.rdualw (mgr.24569) 9809 : cluster [DBG] pgmap v8447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:27.690329+0000 mgr.smithi067.rdualw (mgr.24569) 9809 : cluster [DBG] pgmap v8447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:29.691007+0000 mgr.smithi067.rdualw (mgr.24569) 9810 : cluster [DBG] pgmap v8448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:29.691007+0000 mgr.smithi067.rdualw (mgr.24569) 9810 : cluster [DBG] pgmap v8448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:31.691943+0000 mgr.smithi067.rdualw (mgr.24569) 9811 : cluster [DBG] pgmap v8449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:31.691943+0000 mgr.smithi067.rdualw (mgr.24569) 9811 : cluster [DBG] pgmap v8449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:33.692462+0000 mgr.smithi067.rdualw (mgr.24569) 9812 : cluster [DBG] pgmap v8450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:33.692462+0000 mgr.smithi067.rdualw (mgr.24569) 9812 : cluster [DBG] pgmap v8450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:35.693381+0000 mgr.smithi067.rdualw (mgr.24569) 9813 : cluster [DBG] pgmap v8451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:10:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:10:35.995010+0000 mon.smithi067 (mon.1) 1490 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:10:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:10:35.995674+0000 mon.smithi061 (mon.0) 2086 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:10:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:10:35.995752+0000 mon.smithi067 (mon.1) 1491 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:10:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:10:35.996327+0000 mon.smithi061 (mon.0) 2087 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:10:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:35.693381+0000 mgr.smithi067.rdualw (mgr.24569) 9813 : cluster [DBG] pgmap v8451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:10:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:10:35.995010+0000 mon.smithi067 (mon.1) 1490 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:10:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:10:35.995674+0000 mon.smithi061 (mon.0) 2086 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:10:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:10:35.995752+0000 mon.smithi067 (mon.1) 1491 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:10:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:10:35.996327+0000 mon.smithi061 (mon.0) 2087 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:10:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:37.693905+0000 mgr.smithi067.rdualw (mgr.24569) 9814 : cluster [DBG] pgmap v8452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:37.693905+0000 mgr.smithi067.rdualw (mgr.24569) 9814 : cluster [DBG] pgmap v8452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:39.694615+0000 mgr.smithi067.rdualw (mgr.24569) 9815 : cluster [DBG] pgmap v8453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:39.694615+0000 mgr.smithi067.rdualw (mgr.24569) 9815 : cluster [DBG] pgmap v8453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:41.695577+0000 mgr.smithi067.rdualw (mgr.24569) 9816 : cluster [DBG] pgmap v8454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:43.324 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:41.695577+0000 mgr.smithi067.rdualw (mgr.24569) 9816 : cluster [DBG] pgmap v8454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:43.696339+0000 mgr.smithi067.rdualw (mgr.24569) 9817 : cluster [DBG] pgmap v8455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:43.696339+0000 mgr.smithi067.rdualw (mgr.24569) 9817 : cluster [DBG] pgmap v8455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:47.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:45.697288+0000 mgr.smithi067.rdualw (mgr.24569) 9818 : cluster [DBG] pgmap v8456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:10:47.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:45.697288+0000 mgr.smithi067.rdualw (mgr.24569) 9818 : cluster [DBG] pgmap v8456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:10:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:47.697907+0000 mgr.smithi067.rdualw (mgr.24569) 9819 : cluster [DBG] pgmap v8457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:47.697907+0000 mgr.smithi067.rdualw (mgr.24569) 9819 : cluster [DBG] pgmap v8457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:49.698486+0000 mgr.smithi067.rdualw (mgr.24569) 9820 : cluster [DBG] pgmap v8458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:49.698486+0000 mgr.smithi067.rdualw (mgr.24569) 9820 : cluster [DBG] pgmap v8458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:52.470 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:10:52.760 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:10:52.761 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 4m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:10:52.761 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 4m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:10:52.761 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 4m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:10:52.761 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 4m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:10:52.762 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 4m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:10:52.762 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 4m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:10:52.762 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 4m ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:10:52.762 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 4m ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:10:52.763 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 4m ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:10:52.763 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 4m ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:10:52.763 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 4m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:10:52.763 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 4m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:10:52.764 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 4m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:10:52.764 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 4m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:10:52.764 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 4m ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:10:52.764 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 4m ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:10:52.764 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 4m ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:10:52.765 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 4m ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:10:52.765 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 4m ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:10:52.765 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 4m ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:10:52.765 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 4m ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:10:52.765 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 4m ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:10:52.766 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 4m ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:10:53.206 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:10:53.206 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:10:53.206 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:10:53.207 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:10:53.207 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:10:53.207 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:10:53.208 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:10:53.208 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:10:53.208 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:10:53.209 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:10:53.209 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:10:53.209 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:10:53.209 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:10:53.210 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:10:53.210 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:10:53.210 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:10:53.210 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:10:53.211 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:10:53.211 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:10:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:51.699430+0000 mgr.smithi067.rdualw (mgr.24569) 9821 : cluster [DBG] pgmap v8459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:51.699430+0000 mgr.smithi067.rdualw (mgr.24569) 9821 : cluster [DBG] pgmap v8459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:10:52.456524+0000 mgr.smithi067.rdualw (mgr.24569) 9822 : audit [DBG] from='client.40690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:10:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:10:52.743519+0000 mgr.smithi067.rdualw (mgr.24569) 9823 : audit [DBG] from='client.40694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:10:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:10:53.204668+0000 mon.smithi061 (mon.0) 2088 : audit [DBG] from='client.? 172.21.15.61:0/3130123978' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:10:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:10:52.456524+0000 mgr.smithi067.rdualw (mgr.24569) 9822 : audit [DBG] from='client.40690 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:10:54.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:10:52.743519+0000 mgr.smithi067.rdualw (mgr.24569) 9823 : audit [DBG] from='client.40694 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:10:54.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:10:53.204668+0000 mon.smithi061 (mon.0) 2088 : audit [DBG] from='client.? 172.21.15.61:0/3130123978' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:10:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:53.700086+0000 mgr.smithi067.rdualw (mgr.24569) 9824 : cluster [DBG] pgmap v8460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:53.700086+0000 mgr.smithi067.rdualw (mgr.24569) 9824 : cluster [DBG] pgmap v8460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:55.701015+0000 mgr.smithi067.rdualw (mgr.24569) 9825 : cluster [DBG] pgmap v8461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:10:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:55.701015+0000 mgr.smithi067.rdualw (mgr.24569) 9825 : cluster [DBG] pgmap v8461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:10:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:10:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:57.701726+0000 mgr.smithi067.rdualw (mgr.24569) 9826 : cluster [DBG] pgmap v8462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:10:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:10:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:57.701726+0000 mgr.smithi067.rdualw (mgr.24569) 9826 : cluster [DBG] pgmap v8462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:10:59.702468+0000 mgr.smithi067.rdualw (mgr.24569) 9827 : cluster [DBG] pgmap v8463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:10:59.702468+0000 mgr.smithi067.rdualw (mgr.24569) 9827 : cluster [DBG] pgmap v8463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:01.703403+0000 mgr.smithi067.rdualw (mgr.24569) 9828 : cluster [DBG] pgmap v8464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:01.703403+0000 mgr.smithi067.rdualw (mgr.24569) 9828 : cluster [DBG] pgmap v8464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:03.703938+0000 mgr.smithi067.rdualw (mgr.24569) 9829 : cluster [DBG] pgmap v8465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:03.703938+0000 mgr.smithi067.rdualw (mgr.24569) 9829 : cluster [DBG] pgmap v8465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:07.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:05.704772+0000 mgr.smithi067.rdualw (mgr.24569) 9830 : cluster [DBG] pgmap v8466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:11:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:05.704772+0000 mgr.smithi067.rdualw (mgr.24569) 9830 : cluster [DBG] pgmap v8466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:11:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:07.705262+0000 mgr.smithi067.rdualw (mgr.24569) 9831 : cluster [DBG] pgmap v8467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:07.705262+0000 mgr.smithi067.rdualw (mgr.24569) 9831 : cluster [DBG] pgmap v8467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:09.706125+0000 mgr.smithi067.rdualw (mgr.24569) 9832 : cluster [DBG] pgmap v8468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:09.706125+0000 mgr.smithi067.rdualw (mgr.24569) 9832 : cluster [DBG] pgmap v8468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:11.707101+0000 mgr.smithi067.rdualw (mgr.24569) 9833 : cluster [DBG] pgmap v8469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:11.707101+0000 mgr.smithi067.rdualw (mgr.24569) 9833 : cluster [DBG] pgmap v8469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:13.707715+0000 mgr.smithi067.rdualw (mgr.24569) 9834 : cluster [DBG] pgmap v8470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:13.707715+0000 mgr.smithi067.rdualw (mgr.24569) 9834 : cluster [DBG] pgmap v8470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:15.708603+0000 mgr.smithi067.rdualw (mgr.24569) 9835 : cluster [DBG] pgmap v8471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:11:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:15.708603+0000 mgr.smithi067.rdualw (mgr.24569) 9835 : cluster [DBG] pgmap v8471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:11:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:17.709082+0000 mgr.smithi067.rdualw (mgr.24569) 9836 : cluster [DBG] pgmap v8472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:17.709082+0000 mgr.smithi067.rdualw (mgr.24569) 9836 : cluster [DBG] pgmap v8472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:19.709865+0000 mgr.smithi067.rdualw (mgr.24569) 9837 : cluster [DBG] pgmap v8473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:19.709865+0000 mgr.smithi067.rdualw (mgr.24569) 9837 : cluster [DBG] pgmap v8473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:21.710811+0000 mgr.smithi067.rdualw (mgr.24569) 9838 : cluster [DBG] pgmap v8474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:21.710811+0000 mgr.smithi067.rdualw (mgr.24569) 9838 : cluster [DBG] pgmap v8474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:23.511 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:11:23.826 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:11:23.826 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 4m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:11:23.826 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 4m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:11:23.827 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 5m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:11:23.827 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 4m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:11:23.827 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 4m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:11:23.827 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 5m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:11:23.827 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 4m ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:11:23.828 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 5m ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:11:23.828 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 4m ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:11:23.828 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 5m ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:11:23.828 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 4m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:11:23.828 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 5m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:11:23.829 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 4m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:11:23.829 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 5m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:11:23.829 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 4m ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:11:23.829 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 4m ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:11:23.830 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 4m ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:11:23.830 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 4m ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:11:23.830 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 5m ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:11:23.830 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 5m ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:11:23.830 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 5m ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:11:23.831 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 5m ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:11:23.831 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 4m ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:11:24.174 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:11:24.174 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:11:24.175 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:11:24.175 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:11:24.175 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:11:24.175 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:11:24.175 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:11:24.176 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:11:24.176 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:11:24.176 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:11:24.176 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:11:24.177 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:11:24.177 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:11:24.177 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:11:24.177 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:11:24.177 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:11:24.178 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:11:24.178 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:11:24.178 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:11:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:11:23.497616+0000 mgr.smithi067.rdualw (mgr.24569) 9839 : audit [DBG] from='client.40702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:11:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:23.711307+0000 mgr.smithi067.rdualw (mgr.24569) 9840 : cluster [DBG] pgmap v8475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:11:23.808295+0000 mgr.smithi067.rdualw (mgr.24569) 9841 : audit [DBG] from='client.40706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:11:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:11:23.497616+0000 mgr.smithi067.rdualw (mgr.24569) 9839 : audit [DBG] from='client.40702 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:11:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:23.711307+0000 mgr.smithi067.rdualw (mgr.24569) 9840 : cluster [DBG] pgmap v8475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:11:23.808295+0000 mgr.smithi067.rdualw (mgr.24569) 9841 : audit [DBG] from='client.40706 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:11:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:11:24.172975+0000 mon.smithi061 (mon.0) 2089 : audit [DBG] from='client.? 172.21.15.61:0/3658670350' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:11:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:11:24.172975+0000 mon.smithi061 (mon.0) 2089 : audit [DBG] from='client.? 172.21.15.61:0/3658670350' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:11:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:25.712248+0000 mgr.smithi067.rdualw (mgr.24569) 9842 : cluster [DBG] pgmap v8476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:11:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:25.712248+0000 mgr.smithi067.rdualw (mgr.24569) 9842 : cluster [DBG] pgmap v8476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:11:28.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:11:27.093997+0000 mon.smithi067 (mon.1) 1492 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:11:28.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:11:27.095459+0000 mon.smithi067 (mon.1) 1493 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:11:28.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:11:27.096371+0000 mon.smithi067 (mon.1) 1494 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:11:28.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:11:27.516239+0000 mon.smithi061 (mon.0) 2090 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:11:28.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:11:27.521938+0000 mon.smithi061 (mon.0) 2091 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:11:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:11:27.093997+0000 mon.smithi067 (mon.1) 1492 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:11:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:11:27.095459+0000 mon.smithi067 (mon.1) 1493 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:11:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:11:27.096371+0000 mon.smithi067 (mon.1) 1494 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:11:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:11:27.516239+0000 mon.smithi061 (mon.0) 2090 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:11:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:11:27.521938+0000 mon.smithi061 (mon.0) 2091 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:11:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:11:27.097228+0000 mgr.smithi067.rdualw (mgr.24569) 9843 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:11:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:27.712723+0000 mgr.smithi067.rdualw (mgr.24569) 9844 : cluster [DBG] pgmap v8477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:11:27.097228+0000 mgr.smithi067.rdualw (mgr.24569) 9843 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:11:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:27.712723+0000 mgr.smithi067.rdualw (mgr.24569) 9844 : cluster [DBG] pgmap v8477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:29.713390+0000 mgr.smithi067.rdualw (mgr.24569) 9845 : cluster [DBG] pgmap v8478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:29.713390+0000 mgr.smithi067.rdualw (mgr.24569) 9845 : cluster [DBG] pgmap v8478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:31.714268+0000 mgr.smithi067.rdualw (mgr.24569) 9846 : cluster [DBG] pgmap v8479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:31.714268+0000 mgr.smithi067.rdualw (mgr.24569) 9846 : cluster [DBG] pgmap v8479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:33.714879+0000 mgr.smithi067.rdualw (mgr.24569) 9847 : cluster [DBG] pgmap v8480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:33.714879+0000 mgr.smithi067.rdualw (mgr.24569) 9847 : cluster [DBG] pgmap v8480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:35.715846+0000 mgr.smithi067.rdualw (mgr.24569) 9848 : cluster [DBG] pgmap v8481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:11:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:11:36.002015+0000 mon.smithi067 (mon.1) 1495 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:11:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:11:36.002255+0000 mon.smithi067 (mon.1) 1496 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:11:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:11:36.002655+0000 mon.smithi061 (mon.0) 2092 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:11:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:11:36.003132+0000 mon.smithi061 (mon.0) 2093 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:11:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:35.715846+0000 mgr.smithi067.rdualw (mgr.24569) 9848 : cluster [DBG] pgmap v8481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:11:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:11:36.002015+0000 mon.smithi067 (mon.1) 1495 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:11:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:11:36.002255+0000 mon.smithi067 (mon.1) 1496 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:11:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:11:36.002655+0000 mon.smithi061 (mon.0) 2092 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:11:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:11:36.003132+0000 mon.smithi061 (mon.0) 2093 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:11:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:37.716577+0000 mgr.smithi067.rdualw (mgr.24569) 9849 : cluster [DBG] pgmap v8482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:37.716577+0000 mgr.smithi067.rdualw (mgr.24569) 9849 : cluster [DBG] pgmap v8482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:39.717228+0000 mgr.smithi067.rdualw (mgr.24569) 9850 : cluster [DBG] pgmap v8483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:39.717228+0000 mgr.smithi067.rdualw (mgr.24569) 9850 : cluster [DBG] pgmap v8483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:41.718198+0000 mgr.smithi067.rdualw (mgr.24569) 9851 : cluster [DBG] pgmap v8484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:41.718198+0000 mgr.smithi067.rdualw (mgr.24569) 9851 : cluster [DBG] pgmap v8484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:43.718705+0000 mgr.smithi067.rdualw (mgr.24569) 9852 : cluster [DBG] pgmap v8485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:43.718705+0000 mgr.smithi067.rdualw (mgr.24569) 9852 : cluster [DBG] pgmap v8485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:45.719639+0000 mgr.smithi067.rdualw (mgr.24569) 9853 : cluster [DBG] pgmap v8486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:11:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:45.719639+0000 mgr.smithi067.rdualw (mgr.24569) 9853 : cluster [DBG] pgmap v8486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:11:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:47.720267+0000 mgr.smithi067.rdualw (mgr.24569) 9854 : cluster [DBG] pgmap v8487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:47.720267+0000 mgr.smithi067.rdualw (mgr.24569) 9854 : cluster [DBG] pgmap v8487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:50.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:49.720918+0000 mgr.smithi067.rdualw (mgr.24569) 9855 : cluster [DBG] pgmap v8488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:49.720918+0000 mgr.smithi067.rdualw (mgr.24569) 9855 : cluster [DBG] pgmap v8488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:51.721844+0000 mgr.smithi067.rdualw (mgr.24569) 9856 : cluster [DBG] pgmap v8489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:51.721844+0000 mgr.smithi067.rdualw (mgr.24569) 9856 : cluster [DBG] pgmap v8489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:54.484 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:11:54.774 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:11:54.774 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 5m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:11:54.774 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 5m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:11:54.775 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 5m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:11:54.775 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 5m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:11:54.775 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 5m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:11:54.775 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 5m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:11:54.776 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 5m ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:11:54.776 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 5m ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:11:54.776 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 5m ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:11:54.776 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 5m ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:11:54.776 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 5m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:11:54.777 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 5m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:11:54.777 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 5m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:11:54.777 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 5m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:11:54.777 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 5m ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:11:54.778 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 5m ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:11:54.778 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 5m ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:11:54.778 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 5m ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:11:54.778 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 5m ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:11:54.779 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 5m ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:11:54.779 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 5m ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:11:54.779 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 5m ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:11:54.779 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 5m ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:11:55.121 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:11:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:11:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:11:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:11:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:11:55.122 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:11:55.123 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:11:55.123 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:11:55.123 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:11:55.123 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:11:55.124 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:11:55.124 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:11:55.124 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:11:55.124 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:11:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:11:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:11:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:11:55.125 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:11:55.126 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:11:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:53.722431+0000 mgr.smithi067.rdualw (mgr.24569) 9857 : cluster [DBG] pgmap v8490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:53.722431+0000 mgr.smithi067.rdualw (mgr.24569) 9857 : cluster [DBG] pgmap v8490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:56.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:11:54.467930+0000 mgr.smithi067.rdualw (mgr.24569) 9858 : audit [DBG] from='client.40714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:11:56.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:11:54.756272+0000 mgr.smithi067.rdualw (mgr.24569) 9859 : audit [DBG] from='client.40718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:11:56.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:11:55.120350+0000 mon.smithi061 (mon.0) 2094 : audit [DBG] from='client.? 172.21.15.61:0/3348661004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:11:56.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:11:54.467930+0000 mgr.smithi067.rdualw (mgr.24569) 9858 : audit [DBG] from='client.40714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:11:56.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:11:54.756272+0000 mgr.smithi067.rdualw (mgr.24569) 9859 : audit [DBG] from='client.40718 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:11:56.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:11:55.120350+0000 mon.smithi061 (mon.0) 2094 : audit [DBG] from='client.? 172.21.15.61:0/3348661004' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:11:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:55.723383+0000 mgr.smithi067.rdualw (mgr.24569) 9860 : cluster [DBG] pgmap v8491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:11:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:55.723383+0000 mgr.smithi067.rdualw (mgr.24569) 9860 : cluster [DBG] pgmap v8491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:11:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:11:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:57.724123+0000 mgr.smithi067.rdualw (mgr.24569) 9861 : cluster [DBG] pgmap v8492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:11:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:11:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:57.724123+0000 mgr.smithi067.rdualw (mgr.24569) 9861 : cluster [DBG] pgmap v8492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:11:59.724743+0000 mgr.smithi067.rdualw (mgr.24569) 9862 : cluster [DBG] pgmap v8493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:01.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:11:59.724743+0000 mgr.smithi067.rdualw (mgr.24569) 9862 : cluster [DBG] pgmap v8493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:01.725679+0000 mgr.smithi067.rdualw (mgr.24569) 9863 : cluster [DBG] pgmap v8494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:01.725679+0000 mgr.smithi067.rdualw (mgr.24569) 9863 : cluster [DBG] pgmap v8494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:03.726332+0000 mgr.smithi067.rdualw (mgr.24569) 9864 : cluster [DBG] pgmap v8495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:03.726332+0000 mgr.smithi067.rdualw (mgr.24569) 9864 : cluster [DBG] pgmap v8495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:05.727386+0000 mgr.smithi067.rdualw (mgr.24569) 9865 : cluster [DBG] pgmap v8496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:12:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:05.727386+0000 mgr.smithi067.rdualw (mgr.24569) 9865 : cluster [DBG] pgmap v8496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:12:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:07.728059+0000 mgr.smithi067.rdualw (mgr.24569) 9866 : cluster [DBG] pgmap v8497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:07.728059+0000 mgr.smithi067.rdualw (mgr.24569) 9866 : cluster [DBG] pgmap v8497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:09.728634+0000 mgr.smithi067.rdualw (mgr.24569) 9867 : cluster [DBG] pgmap v8498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:09.728634+0000 mgr.smithi067.rdualw (mgr.24569) 9867 : cluster [DBG] pgmap v8498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:11.729706+0000 mgr.smithi067.rdualw (mgr.24569) 9868 : cluster [DBG] pgmap v8499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:11.729706+0000 mgr.smithi067.rdualw (mgr.24569) 9868 : cluster [DBG] pgmap v8499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:13.730374+0000 mgr.smithi067.rdualw (mgr.24569) 9869 : cluster [DBG] pgmap v8500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:13.730374+0000 mgr.smithi067.rdualw (mgr.24569) 9869 : cluster [DBG] pgmap v8500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:15.731244+0000 mgr.smithi067.rdualw (mgr.24569) 9870 : cluster [DBG] pgmap v8501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:12:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:15.731244+0000 mgr.smithi067.rdualw (mgr.24569) 9870 : cluster [DBG] pgmap v8501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:12:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:17.731751+0000 mgr.smithi067.rdualw (mgr.24569) 9871 : cluster [DBG] pgmap v8502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:17.731751+0000 mgr.smithi067.rdualw (mgr.24569) 9871 : cluster [DBG] pgmap v8502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:19.732362+0000 mgr.smithi067.rdualw (mgr.24569) 9872 : cluster [DBG] pgmap v8503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:19.732362+0000 mgr.smithi067.rdualw (mgr.24569) 9872 : cluster [DBG] pgmap v8503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:21.733251+0000 mgr.smithi067.rdualw (mgr.24569) 9873 : cluster [DBG] pgmap v8504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:21.733251+0000 mgr.smithi067.rdualw (mgr.24569) 9873 : cluster [DBG] pgmap v8504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:23.733876+0000 mgr.smithi067.rdualw (mgr.24569) 9874 : cluster [DBG] pgmap v8505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:23.733876+0000 mgr.smithi067.rdualw (mgr.24569) 9874 : cluster [DBG] pgmap v8505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:25.428 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:12:25.719 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:12:25.720 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 6m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:12:25.720 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 6m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:12:25.720 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 6m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:12:25.720 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 6m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:12:25.721 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 6m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:12:25.721 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 6m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:12:25.721 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 6m ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:12:25.721 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 6m ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:12:25.721 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 6m ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:12:25.722 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 6m ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:12:25.722 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 6m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:12:25.722 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 6m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:12:25.723 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 6m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:12:25.723 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 6m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:12:25.723 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 6m ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:12:25.723 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 6m ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:12:25.723 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 6m ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:12:25.724 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 6m ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:12:25.724 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 6m ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:12:25.724 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 6m ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:12:25.724 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 6m ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:12:25.725 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 6m ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:12:25.725 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 6m ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:12:26.059 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:12:26.060 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:12:26.060 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:12:26.060 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:12:26.061 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:12:26.061 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:12:26.061 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:12:26.061 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:12:26.062 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:12:26.062 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:12:26.062 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:12:26.062 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:12:26.063 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:12:26.063 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:12:26.063 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:12:26.063 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:12:26.063 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:12:26.064 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:12:26.064 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:12:27.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:12:25.415306+0000 mgr.smithi067.rdualw (mgr.24569) 9875 : audit [DBG] from='client.40726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:12:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:12:25.701970+0000 mgr.smithi067.rdualw (mgr.24569) 9876 : audit [DBG] from='client.40730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:12:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:25.734922+0000 mgr.smithi067.rdualw (mgr.24569) 9877 : cluster [DBG] pgmap v8506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:12:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:12:26.058506+0000 mon.smithi061 (mon.0) 2095 : audit [DBG] from='client.? 172.21.15.61:0/1420314469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:12:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:12:25.415306+0000 mgr.smithi067.rdualw (mgr.24569) 9875 : audit [DBG] from='client.40726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:12:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:12:25.701970+0000 mgr.smithi067.rdualw (mgr.24569) 9876 : audit [DBG] from='client.40730 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:12:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:25.734922+0000 mgr.smithi067.rdualw (mgr.24569) 9877 : cluster [DBG] pgmap v8506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:12:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:12:26.058506+0000 mon.smithi061 (mon.0) 2095 : audit [DBG] from='client.? 172.21.15.61:0/1420314469' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:12:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:12:27.525103+0000 mon.smithi067 (mon.1) 1497 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:12:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:12:27.526563+0000 mon.smithi067 (mon.1) 1498 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:12:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:12:27.527496+0000 mon.smithi067 (mon.1) 1499 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:12:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:12:27.525103+0000 mon.smithi067 (mon.1) 1497 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:12:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:12:27.526563+0000 mon.smithi067 (mon.1) 1498 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:12:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:12:27.527496+0000 mon.smithi067 (mon.1) 1499 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:12:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:12:27.528326+0000 mgr.smithi067.rdualw (mgr.24569) 9878 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:12:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:27.735359+0000 mgr.smithi067.rdualw (mgr.24569) 9879 : cluster [DBG] pgmap v8507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:12:27.950142+0000 mon.smithi061 (mon.0) 2096 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:12:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:12:27.955660+0000 mon.smithi061 (mon.0) 2097 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:12:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:12:27.528326+0000 mgr.smithi067.rdualw (mgr.24569) 9878 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:12:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:27.735359+0000 mgr.smithi067.rdualw (mgr.24569) 9879 : cluster [DBG] pgmap v8507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:12:27.950142+0000 mon.smithi061 (mon.0) 2096 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:12:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:12:27.955660+0000 mon.smithi061 (mon.0) 2097 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:12:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:29.735933+0000 mgr.smithi067.rdualw (mgr.24569) 9880 : cluster [DBG] pgmap v8508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:29.735933+0000 mgr.smithi067.rdualw (mgr.24569) 9880 : cluster [DBG] pgmap v8508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:31.736871+0000 mgr.smithi067.rdualw (mgr.24569) 9881 : cluster [DBG] pgmap v8509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:31.736871+0000 mgr.smithi067.rdualw (mgr.24569) 9881 : cluster [DBG] pgmap v8509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:33.737443+0000 mgr.smithi067.rdualw (mgr.24569) 9882 : cluster [DBG] pgmap v8510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:34.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:33.737443+0000 mgr.smithi067.rdualw (mgr.24569) 9882 : cluster [DBG] pgmap v8510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:37.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:35.738348+0000 mgr.smithi067.rdualw (mgr.24569) 9883 : cluster [DBG] pgmap v8511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:12:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:12:36.007317+0000 mon.smithi067 (mon.1) 1500 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:12:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:12:36.008106+0000 mon.smithi067 (mon.1) 1501 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:12:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:12:36.008218+0000 mon.smithi061 (mon.0) 2098 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:12:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:12:36.008642+0000 mon.smithi061 (mon.0) 2099 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:12:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:35.738348+0000 mgr.smithi067.rdualw (mgr.24569) 9883 : cluster [DBG] pgmap v8511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:12:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:12:36.007317+0000 mon.smithi067 (mon.1) 1500 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:12:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:12:36.008106+0000 mon.smithi067 (mon.1) 1501 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:12:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:12:36.008218+0000 mon.smithi061 (mon.0) 2098 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:12:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:12:36.008642+0000 mon.smithi061 (mon.0) 2099 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:12:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:37.738953+0000 mgr.smithi067.rdualw (mgr.24569) 9884 : cluster [DBG] pgmap v8512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:37.738953+0000 mgr.smithi067.rdualw (mgr.24569) 9884 : cluster [DBG] pgmap v8512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:39.739569+0000 mgr.smithi067.rdualw (mgr.24569) 9885 : cluster [DBG] pgmap v8513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:39.739569+0000 mgr.smithi067.rdualw (mgr.24569) 9885 : cluster [DBG] pgmap v8513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:41.740409+0000 mgr.smithi067.rdualw (mgr.24569) 9886 : cluster [DBG] pgmap v8514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:41.740409+0000 mgr.smithi067.rdualw (mgr.24569) 9886 : cluster [DBG] pgmap v8514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:43.741246+0000 mgr.smithi067.rdualw (mgr.24569) 9887 : cluster [DBG] pgmap v8515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:43.741246+0000 mgr.smithi067.rdualw (mgr.24569) 9887 : cluster [DBG] pgmap v8515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:45.742221+0000 mgr.smithi067.rdualw (mgr.24569) 9888 : cluster [DBG] pgmap v8516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:12:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:45.742221+0000 mgr.smithi067.rdualw (mgr.24569) 9888 : cluster [DBG] pgmap v8516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:12:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:47.742868+0000 mgr.smithi067.rdualw (mgr.24569) 9889 : cluster [DBG] pgmap v8517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:47.742868+0000 mgr.smithi067.rdualw (mgr.24569) 9889 : cluster [DBG] pgmap v8517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:49.743435+0000 mgr.smithi067.rdualw (mgr.24569) 9890 : cluster [DBG] pgmap v8518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:49.743435+0000 mgr.smithi067.rdualw (mgr.24569) 9890 : cluster [DBG] pgmap v8518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:51.744339+0000 mgr.smithi067.rdualw (mgr.24569) 9891 : cluster [DBG] pgmap v8519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:51.744339+0000 mgr.smithi067.rdualw (mgr.24569) 9891 : cluster [DBG] pgmap v8519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:53.744941+0000 mgr.smithi067.rdualw (mgr.24569) 9892 : cluster [DBG] pgmap v8520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:53.744941+0000 mgr.smithi067.rdualw (mgr.24569) 9892 : cluster [DBG] pgmap v8520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:56.366 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:12:56.654 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:12:56.655 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 6m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:12:56.655 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 6m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:12:56.655 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 6m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:12:56.655 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 6m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:12:56.655 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 6m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:12:56.656 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 6m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:12:56.656 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 6m ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:12:56.656 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 6m ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:12:56.656 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 6m ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:12:56.657 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 6m ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:12:56.657 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 6m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:12:56.657 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 6m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:12:56.657 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 6m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:12:56.657 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 6m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:12:56.658 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 6m ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:12:56.658 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 6m ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:12:56.658 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 6m ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:12:56.658 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 6m ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:12:56.658 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 6m ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:12:56.659 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 6m ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:12:56.659 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 6m ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:12:56.659 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 6m ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:12:56.659 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 6m ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:12:56.994 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:12:56.994 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:12:56.995 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:12:56.995 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:12:56.995 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:12:56.995 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:12:56.996 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:12:56.996 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:12:56.996 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:12:56.996 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:12:56.997 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:12:56.997 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:12:56.997 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:12:56.997 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:12:56.997 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:12:56.998 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:12:56.998 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:12:56.998 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:12:56.998 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:12:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:55.745879+0000 mgr.smithi067.rdualw (mgr.24569) 9893 : cluster [DBG] pgmap v8521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:12:57.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:55.745879+0000 mgr.smithi067.rdualw (mgr.24569) 9893 : cluster [DBG] pgmap v8521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:12:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:12:56.353652+0000 mgr.smithi067.rdualw (mgr.24569) 9894 : audit [DBG] from='client.40738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:12:58.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:12:56.637026+0000 mgr.smithi067.rdualw (mgr.24569) 9895 : audit [DBG] from='client.40742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:12:58.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:12:56.993114+0000 mon.smithi061 (mon.0) 2100 : audit [DBG] from='client.? 172.21.15.61:0/2789726176' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:12:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:12:56.353652+0000 mgr.smithi067.rdualw (mgr.24569) 9894 : audit [DBG] from='client.40738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:12:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:12:56.637026+0000 mgr.smithi067.rdualw (mgr.24569) 9895 : audit [DBG] from='client.40742 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:12:58.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:12:56.993114+0000 mon.smithi061 (mon.0) 2100 : audit [DBG] from='client.? 172.21.15.61:0/2789726176' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:12:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:12:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:57.746579+0000 mgr.smithi067.rdualw (mgr.24569) 9896 : cluster [DBG] pgmap v8522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:12:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:12:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:57.746579+0000 mgr.smithi067.rdualw (mgr.24569) 9896 : cluster [DBG] pgmap v8522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:12:59.747151+0000 mgr.smithi067.rdualw (mgr.24569) 9897 : cluster [DBG] pgmap v8523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:12:59.747151+0000 mgr.smithi067.rdualw (mgr.24569) 9897 : cluster [DBG] pgmap v8523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:01.748024+0000 mgr.smithi067.rdualw (mgr.24569) 9898 : cluster [DBG] pgmap v8524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:01.748024+0000 mgr.smithi067.rdualw (mgr.24569) 9898 : cluster [DBG] pgmap v8524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:03.748507+0000 mgr.smithi067.rdualw (mgr.24569) 9899 : cluster [DBG] pgmap v8525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:03.748507+0000 mgr.smithi067.rdualw (mgr.24569) 9899 : cluster [DBG] pgmap v8525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:05.749326+0000 mgr.smithi067.rdualw (mgr.24569) 9900 : cluster [DBG] pgmap v8526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:13:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:05.749326+0000 mgr.smithi067.rdualw (mgr.24569) 9900 : cluster [DBG] pgmap v8526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:13:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:07.749926+0000 mgr.smithi067.rdualw (mgr.24569) 9901 : cluster [DBG] pgmap v8527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:07.749926+0000 mgr.smithi067.rdualw (mgr.24569) 9901 : cluster [DBG] pgmap v8527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:09.750684+0000 mgr.smithi067.rdualw (mgr.24569) 9902 : cluster [DBG] pgmap v8528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:09.750684+0000 mgr.smithi067.rdualw (mgr.24569) 9902 : cluster [DBG] pgmap v8528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:11.751600+0000 mgr.smithi067.rdualw (mgr.24569) 9903 : cluster [DBG] pgmap v8529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:11.751600+0000 mgr.smithi067.rdualw (mgr.24569) 9903 : cluster [DBG] pgmap v8529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:13.752189+0000 mgr.smithi067.rdualw (mgr.24569) 9904 : cluster [DBG] pgmap v8530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:13.752189+0000 mgr.smithi067.rdualw (mgr.24569) 9904 : cluster [DBG] pgmap v8530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:15.753112+0000 mgr.smithi067.rdualw (mgr.24569) 9905 : cluster [DBG] pgmap v8531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:13:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:15.753112+0000 mgr.smithi067.rdualw (mgr.24569) 9905 : cluster [DBG] pgmap v8531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:13:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:17.753692+0000 mgr.smithi067.rdualw (mgr.24569) 9906 : cluster [DBG] pgmap v8532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:17.753692+0000 mgr.smithi067.rdualw (mgr.24569) 9906 : cluster [DBG] pgmap v8532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:19.754230+0000 mgr.smithi067.rdualw (mgr.24569) 9907 : cluster [DBG] pgmap v8533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:19.754230+0000 mgr.smithi067.rdualw (mgr.24569) 9907 : cluster [DBG] pgmap v8533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:21.755179+0000 mgr.smithi067.rdualw (mgr.24569) 9908 : cluster [DBG] pgmap v8534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:21.755179+0000 mgr.smithi067.rdualw (mgr.24569) 9908 : cluster [DBG] pgmap v8534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:23.755797+0000 mgr.smithi067.rdualw (mgr.24569) 9909 : cluster [DBG] pgmap v8535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:23.755797+0000 mgr.smithi067.rdualw (mgr.24569) 9909 : cluster [DBG] pgmap v8535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:27.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:25.756921+0000 mgr.smithi067.rdualw (mgr.24569) 9910 : cluster [DBG] pgmap v8536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:13:27.309 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:13:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:25.756921+0000 mgr.smithi067.rdualw (mgr.24569) 9910 : cluster [DBG] pgmap v8536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:13:27.626 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:13:27.627 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 7m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:13:27.627 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 7m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:13:27.627 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 7m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:13:27.627 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 7m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:13:27.628 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 7m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:13:27.628 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 7m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:13:27.628 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 7m ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:13:27.629 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 7m ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:13:27.629 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 7m ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:13:27.629 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 7m ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:13:27.629 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 7m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:13:27.629 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 7m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:13:27.630 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 7m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:13:27.630 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 7m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:13:27.630 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 7m ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:13:27.630 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 7m ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:13:27.631 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 7m ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:13:27.631 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 7m ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:13:27.631 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 7m ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:13:27.631 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 7m ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:13:27.631 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 7m ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:13:27.632 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 7m ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:13:27.632 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 7m ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:13:27.975 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:13:27.975 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:13:27.975 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:13:27.975 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:13:27.976 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:13:27.976 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:13:27.976 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:13:27.976 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:13:27.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:13:27.977 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:13:27.977 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:13:27.977 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:13:27.978 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:13:27.978 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:13:27.978 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:13:27.978 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:13:27.979 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:13:27.979 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:13:27.979 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:13:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:13:27.296180+0000 mgr.smithi067.rdualw (mgr.24569) 9911 : audit [DBG] from='client.40750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:13:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:13:27.608972+0000 mgr.smithi067.rdualw (mgr.24569) 9912 : audit [DBG] from='client.40754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:13:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:27.757344+0000 mgr.smithi067.rdualw (mgr.24569) 9913 : cluster [DBG] pgmap v8537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:13:27.959295+0000 mon.smithi067 (mon.1) 1502 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:13:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:13:27.960712+0000 mon.smithi067 (mon.1) 1503 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:13:29.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:13:27.961643+0000 mon.smithi067 (mon.1) 1504 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:13:29.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:13:27.973699+0000 mon.smithi061 (mon.0) 2101 : audit [DBG] from='client.? 172.21.15.61:0/2190828536' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:13:29.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:13:28.376613+0000 mon.smithi061 (mon.0) 2102 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:13:29.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:13:28.384939+0000 mon.smithi061 (mon.0) 2103 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:13:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:13:27.296180+0000 mgr.smithi067.rdualw (mgr.24569) 9911 : audit [DBG] from='client.40750 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:13:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:13:27.608972+0000 mgr.smithi067.rdualw (mgr.24569) 9912 : audit [DBG] from='client.40754 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:13:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:27.757344+0000 mgr.smithi067.rdualw (mgr.24569) 9913 : cluster [DBG] pgmap v8537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:13:27.959295+0000 mon.smithi067 (mon.1) 1502 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:13:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:13:27.960712+0000 mon.smithi067 (mon.1) 1503 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:13:29.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:13:27.961643+0000 mon.smithi067 (mon.1) 1504 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:13:29.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:13:27.973699+0000 mon.smithi061 (mon.0) 2101 : audit [DBG] from='client.? 172.21.15.61:0/2190828536' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:13:29.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:13:28.376613+0000 mon.smithi061 (mon.0) 2102 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:13:29.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:13:28.384939+0000 mon.smithi061 (mon.0) 2103 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:13:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:13:27.962497+0000 mgr.smithi067.rdualw (mgr.24569) 9914 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:13:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:29.757913+0000 mgr.smithi067.rdualw (mgr.24569) 9915 : cluster [DBG] pgmap v8538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:13:27.962497+0000 mgr.smithi067.rdualw (mgr.24569) 9914 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:13:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:29.757913+0000 mgr.smithi067.rdualw (mgr.24569) 9915 : cluster [DBG] pgmap v8538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:31.758851+0000 mgr.smithi067.rdualw (mgr.24569) 9916 : cluster [DBG] pgmap v8539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:31.758851+0000 mgr.smithi067.rdualw (mgr.24569) 9916 : cluster [DBG] pgmap v8539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:33.759459+0000 mgr.smithi067.rdualw (mgr.24569) 9917 : cluster [DBG] pgmap v8540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:33.759459+0000 mgr.smithi067.rdualw (mgr.24569) 9917 : cluster [DBG] pgmap v8540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:35.760423+0000 mgr.smithi067.rdualw (mgr.24569) 9918 : cluster [DBG] pgmap v8541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:13:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:13:36.014379+0000 mon.smithi067 (mon.1) 1505 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:13:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:13:36.014748+0000 mon.smithi067 (mon.1) 1506 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:13:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:13:36.015039+0000 mon.smithi061 (mon.0) 2104 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:13:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:13:36.015320+0000 mon.smithi061 (mon.0) 2105 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:13:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:35.760423+0000 mgr.smithi067.rdualw (mgr.24569) 9918 : cluster [DBG] pgmap v8541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:13:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:13:36.014379+0000 mon.smithi067 (mon.1) 1505 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:13:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:13:36.014748+0000 mon.smithi067 (mon.1) 1506 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:13:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:13:36.015039+0000 mon.smithi061 (mon.0) 2104 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:13:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:13:36.015320+0000 mon.smithi061 (mon.0) 2105 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:13:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:37.760911+0000 mgr.smithi067.rdualw (mgr.24569) 9919 : cluster [DBG] pgmap v8542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:37.760911+0000 mgr.smithi067.rdualw (mgr.24569) 9919 : cluster [DBG] pgmap v8542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:41.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:39.761629+0000 mgr.smithi067.rdualw (mgr.24569) 9920 : cluster [DBG] pgmap v8543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:39.761629+0000 mgr.smithi067.rdualw (mgr.24569) 9920 : cluster [DBG] pgmap v8543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:41.762479+0000 mgr.smithi067.rdualw (mgr.24569) 9921 : cluster [DBG] pgmap v8544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:41.762479+0000 mgr.smithi067.rdualw (mgr.24569) 9921 : cluster [DBG] pgmap v8544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:43.762967+0000 mgr.smithi067.rdualw (mgr.24569) 9922 : cluster [DBG] pgmap v8545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:43.762967+0000 mgr.smithi067.rdualw (mgr.24569) 9922 : cluster [DBG] pgmap v8545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:45.763929+0000 mgr.smithi067.rdualw (mgr.24569) 9923 : cluster [DBG] pgmap v8546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:13:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:45.763929+0000 mgr.smithi067.rdualw (mgr.24569) 9923 : cluster [DBG] pgmap v8546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:13:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:47.764430+0000 mgr.smithi067.rdualw (mgr.24569) 9924 : cluster [DBG] pgmap v8547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:47.764430+0000 mgr.smithi067.rdualw (mgr.24569) 9924 : cluster [DBG] pgmap v8547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:49.765089+0000 mgr.smithi067.rdualw (mgr.24569) 9925 : cluster [DBG] pgmap v8548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:49.765089+0000 mgr.smithi067.rdualw (mgr.24569) 9925 : cluster [DBG] pgmap v8548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:51.766139+0000 mgr.smithi067.rdualw (mgr.24569) 9926 : cluster [DBG] pgmap v8549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:51.766139+0000 mgr.smithi067.rdualw (mgr.24569) 9926 : cluster [DBG] pgmap v8549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:53.766640+0000 mgr.smithi067.rdualw (mgr.24569) 9927 : cluster [DBG] pgmap v8550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:53.766640+0000 mgr.smithi067.rdualw (mgr.24569) 9927 : cluster [DBG] pgmap v8550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:55.767548+0000 mgr.smithi067.rdualw (mgr.24569) 9928 : cluster [DBG] pgmap v8551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:13:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:55.767548+0000 mgr.smithi067.rdualw (mgr.24569) 9928 : cluster [DBG] pgmap v8551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:13:58.282 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:13:58.653 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:13:58.654 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 7m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:13:58.654 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 7m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:13:58.654 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 7m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:13:58.655 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 7m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:13:58.655 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 7m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:13:58.655 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 7m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:13:58.655 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 7m ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:13:58.655 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 7m ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:13:58.656 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 7m ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:13:58.656 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 7m ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:13:58.656 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 7m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:13:58.656 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 7m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:13:58.656 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 7m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:13:58.657 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 7m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:13:58.657 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 7m ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:13:58.657 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 7m ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:13:58.657 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 7m ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:13:58.658 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 7m ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:13:58.658 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 7m ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:13:58.658 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 7m ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:13:58.658 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 7m ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:13:58.658 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 7m ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:13:58.659 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 7m ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:13:58.997 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:13:58.998 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:13:58.998 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:13:58.998 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:13:58.998 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:13:58.999 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:13:58.999 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:13:58.999 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:13:58.999 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:13:59.000 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:13:59.000 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:13:59.000 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:13:59.000 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:13:59.001 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:13:59.001 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:13:59.001 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:13:59.001 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:13:59.001 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:13:59.002 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:13:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:57.768127+0000 mgr.smithi067.rdualw (mgr.24569) 9929 : cluster [DBG] pgmap v8552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:13:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:57.768127+0000 mgr.smithi067.rdualw (mgr.24569) 9929 : cluster [DBG] pgmap v8552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:13:58.268599+0000 mgr.smithi067.rdualw (mgr.24569) 9930 : audit [DBG] from='client.40762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:14:00.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:13:58.636151+0000 mgr.smithi067.rdualw (mgr.24569) 9931 : audit [DBG] from='client.40766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:14:00.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:13:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:13:58.996541+0000 mon.smithi061 (mon.0) 2106 : audit [DBG] from='client.? 172.21.15.61:0/2670713922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:14:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:13:58.268599+0000 mgr.smithi067.rdualw (mgr.24569) 9930 : audit [DBG] from='client.40762 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:14:00.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:13:58.636151+0000 mgr.smithi067.rdualw (mgr.24569) 9931 : audit [DBG] from='client.40766 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:14:00.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:13:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:13:58.996541+0000 mon.smithi061 (mon.0) 2106 : audit [DBG] from='client.? 172.21.15.61:0/2670713922' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:14:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:13:59.768789+0000 mgr.smithi067.rdualw (mgr.24569) 9932 : cluster [DBG] pgmap v8553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:13:59.768789+0000 mgr.smithi067.rdualw (mgr.24569) 9932 : cluster [DBG] pgmap v8553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:01.769757+0000 mgr.smithi067.rdualw (mgr.24569) 9933 : cluster [DBG] pgmap v8554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:01.769757+0000 mgr.smithi067.rdualw (mgr.24569) 9933 : cluster [DBG] pgmap v8554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:03.770280+0000 mgr.smithi067.rdualw (mgr.24569) 9934 : cluster [DBG] pgmap v8555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:03.770280+0000 mgr.smithi067.rdualw (mgr.24569) 9934 : cluster [DBG] pgmap v8555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:05.771204+0000 mgr.smithi067.rdualw (mgr.24569) 9935 : cluster [DBG] pgmap v8556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:14:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:05.771204+0000 mgr.smithi067.rdualw (mgr.24569) 9935 : cluster [DBG] pgmap v8556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:14:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:07.771700+0000 mgr.smithi067.rdualw (mgr.24569) 9936 : cluster [DBG] pgmap v8557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:07.771700+0000 mgr.smithi067.rdualw (mgr.24569) 9936 : cluster [DBG] pgmap v8557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:09.772345+0000 mgr.smithi067.rdualw (mgr.24569) 9937 : cluster [DBG] pgmap v8558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:09.772345+0000 mgr.smithi067.rdualw (mgr.24569) 9937 : cluster [DBG] pgmap v8558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:11.773175+0000 mgr.smithi067.rdualw (mgr.24569) 9938 : cluster [DBG] pgmap v8559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:11.773175+0000 mgr.smithi067.rdualw (mgr.24569) 9938 : cluster [DBG] pgmap v8559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:13.773772+0000 mgr.smithi067.rdualw (mgr.24569) 9939 : cluster [DBG] pgmap v8560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:13.773772+0000 mgr.smithi067.rdualw (mgr.24569) 9939 : cluster [DBG] pgmap v8560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:15.774663+0000 mgr.smithi067.rdualw (mgr.24569) 9940 : cluster [DBG] pgmap v8561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:14:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:15.774663+0000 mgr.smithi067.rdualw (mgr.24569) 9940 : cluster [DBG] pgmap v8561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:14:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:17.775124+0000 mgr.smithi067.rdualw (mgr.24569) 9941 : cluster [DBG] pgmap v8562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:17.775124+0000 mgr.smithi067.rdualw (mgr.24569) 9941 : cluster [DBG] pgmap v8562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:19.775694+0000 mgr.smithi067.rdualw (mgr.24569) 9942 : cluster [DBG] pgmap v8563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:19.775694+0000 mgr.smithi067.rdualw (mgr.24569) 9942 : cluster [DBG] pgmap v8563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:21.776599+0000 mgr.smithi067.rdualw (mgr.24569) 9943 : cluster [DBG] pgmap v8564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:21.776599+0000 mgr.smithi067.rdualw (mgr.24569) 9943 : cluster [DBG] pgmap v8564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:23.777131+0000 mgr.smithi067.rdualw (mgr.24569) 9944 : cluster [DBG] pgmap v8565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:23.777131+0000 mgr.smithi067.rdualw (mgr.24569) 9944 : cluster [DBG] pgmap v8565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:27.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:25.777951+0000 mgr.smithi067.rdualw (mgr.24569) 9945 : cluster [DBG] pgmap v8566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:14:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:25.777951+0000 mgr.smithi067.rdualw (mgr.24569) 9945 : cluster [DBG] pgmap v8566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:14:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:27.778461+0000 mgr.smithi067.rdualw (mgr.24569) 9946 : cluster [DBG] pgmap v8567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:27.778461+0000 mgr.smithi067.rdualw (mgr.24569) 9946 : cluster [DBG] pgmap v8567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:14:28.388396+0000 mon.smithi067 (mon.1) 1507 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:14:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:14:28.389836+0000 mon.smithi067 (mon.1) 1508 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:14:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:14:28.390792+0000 mon.smithi067 (mon.1) 1509 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:14:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:14:28.391690+0000 mgr.smithi067.rdualw (mgr.24569) 9947 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:14:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:14:28.807894+0000 mon.smithi061 (mon.0) 2107 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:14:29.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:14:28.814289+0000 mon.smithi061 (mon.0) 2108 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:14:29.306 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:14:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:14:28.388396+0000 mon.smithi067 (mon.1) 1507 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:14:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:14:28.389836+0000 mon.smithi067 (mon.1) 1508 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:14:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:14:28.390792+0000 mon.smithi067 (mon.1) 1509 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:14:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:14:28.391690+0000 mgr.smithi067.rdualw (mgr.24569) 9947 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:14:29.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:14:28.807894+0000 mon.smithi061 (mon.0) 2107 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:14:29.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:14:28.814289+0000 mon.smithi061 (mon.0) 2108 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:14:29.603 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:14:29.603 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 8m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:14:29.603 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 8m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:14:29.604 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 8m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:14:29.604 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 8m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:14:29.604 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 8m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:14:29.604 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 8m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:14:29.605 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 8m ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:14:29.605 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 8m ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:14:29.605 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 8m ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:14:29.605 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 8m ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:14:29.605 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 8m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:14:29.606 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 8m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:14:29.606 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 8m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:14:29.606 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 8m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:14:29.606 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 8m ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:14:29.607 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 8m ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:14:29.607 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 8m ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:14:29.607 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 8m ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:14:29.607 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 8m ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:14:29.608 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 8m ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:14:29.608 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 8m ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:14:29.608 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 8m ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:14:29.608 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 8m ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:14:29.945 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:14:29.946 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:14:29.946 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:14:29.946 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:14:29.947 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:14:29.947 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:14:29.947 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:14:29.947 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:14:29.948 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:14:29.948 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:14:29.948 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:14:29.948 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:14:29.948 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:14:29.949 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:14:29.949 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:14:29.949 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:14:29.949 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:14:29.950 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:14:29.950 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:14:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:14:29.292472+0000 mgr.smithi067.rdualw (mgr.24569) 9948 : audit [DBG] from='client.40774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:14:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:14:29.585232+0000 mgr.smithi067.rdualw (mgr.24569) 9949 : audit [DBG] from='client.40778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:14:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:29.779067+0000 mgr.smithi067.rdualw (mgr.24569) 9950 : cluster [DBG] pgmap v8568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:14:29.944682+0000 mon.smithi061 (mon.0) 2109 : audit [DBG] from='client.? 172.21.15.61:0/2773518224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:14:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:14:29.292472+0000 mgr.smithi067.rdualw (mgr.24569) 9948 : audit [DBG] from='client.40774 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:14:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:14:29.585232+0000 mgr.smithi067.rdualw (mgr.24569) 9949 : audit [DBG] from='client.40778 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:14:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:29.779067+0000 mgr.smithi067.rdualw (mgr.24569) 9950 : cluster [DBG] pgmap v8568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:14:29.944682+0000 mon.smithi061 (mon.0) 2109 : audit [DBG] from='client.? 172.21.15.61:0/2773518224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:14:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:31.780127+0000 mgr.smithi067.rdualw (mgr.24569) 9951 : cluster [DBG] pgmap v8569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:31.780127+0000 mgr.smithi067.rdualw (mgr.24569) 9951 : cluster [DBG] pgmap v8569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:33.780845+0000 mgr.smithi067.rdualw (mgr.24569) 9952 : cluster [DBG] pgmap v8570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:33.780845+0000 mgr.smithi067.rdualw (mgr.24569) 9952 : cluster [DBG] pgmap v8570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:35.781709+0000 mgr.smithi067.rdualw (mgr.24569) 9953 : cluster [DBG] pgmap v8571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:14:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:14:36.020218+0000 mon.smithi067 (mon.1) 1510 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:14:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:14:36.020454+0000 mon.smithi067 (mon.1) 1511 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:14:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:14:36.020921+0000 mon.smithi061 (mon.0) 2110 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:14:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:14:36.021155+0000 mon.smithi061 (mon.0) 2111 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:14:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:35.781709+0000 mgr.smithi067.rdualw (mgr.24569) 9953 : cluster [DBG] pgmap v8571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:14:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:14:36.020218+0000 mon.smithi067 (mon.1) 1510 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:14:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:14:36.020454+0000 mon.smithi067 (mon.1) 1511 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:14:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:14:36.020921+0000 mon.smithi061 (mon.0) 2110 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:14:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:14:36.021155+0000 mon.smithi061 (mon.0) 2111 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:14:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:37.782235+0000 mgr.smithi067.rdualw (mgr.24569) 9954 : cluster [DBG] pgmap v8572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:37.782235+0000 mgr.smithi067.rdualw (mgr.24569) 9954 : cluster [DBG] pgmap v8572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:39.782768+0000 mgr.smithi067.rdualw (mgr.24569) 9955 : cluster [DBG] pgmap v8573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:39.782768+0000 mgr.smithi067.rdualw (mgr.24569) 9955 : cluster [DBG] pgmap v8573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:41.783735+0000 mgr.smithi067.rdualw (mgr.24569) 9956 : cluster [DBG] pgmap v8574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:41.783735+0000 mgr.smithi067.rdualw (mgr.24569) 9956 : cluster [DBG] pgmap v8574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:43.784477+0000 mgr.smithi067.rdualw (mgr.24569) 9957 : cluster [DBG] pgmap v8575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:43.784477+0000 mgr.smithi067.rdualw (mgr.24569) 9957 : cluster [DBG] pgmap v8575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:45.785556+0000 mgr.smithi067.rdualw (mgr.24569) 9958 : cluster [DBG] pgmap v8576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:14:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:45.785556+0000 mgr.smithi067.rdualw (mgr.24569) 9958 : cluster [DBG] pgmap v8576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:14:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:47.786266+0000 mgr.smithi067.rdualw (mgr.24569) 9959 : cluster [DBG] pgmap v8577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:47.786266+0000 mgr.smithi067.rdualw (mgr.24569) 9959 : cluster [DBG] pgmap v8577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:49.786969+0000 mgr.smithi067.rdualw (mgr.24569) 9960 : cluster [DBG] pgmap v8578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:49.786969+0000 mgr.smithi067.rdualw (mgr.24569) 9960 : cluster [DBG] pgmap v8578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:51.787867+0000 mgr.smithi067.rdualw (mgr.24569) 9961 : cluster [DBG] pgmap v8579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:51.787867+0000 mgr.smithi067.rdualw (mgr.24569) 9961 : cluster [DBG] pgmap v8579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:53.788493+0000 mgr.smithi067.rdualw (mgr.24569) 9962 : cluster [DBG] pgmap v8580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:53.788493+0000 mgr.smithi067.rdualw (mgr.24569) 9962 : cluster [DBG] pgmap v8580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:55.789556+0000 mgr.smithi067.rdualw (mgr.24569) 9963 : cluster [DBG] pgmap v8581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:14:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:55.789556+0000 mgr.smithi067.rdualw (mgr.24569) 9963 : cluster [DBG] pgmap v8581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:14:58.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:14:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:57.790140+0000 mgr.smithi067.rdualw (mgr.24569) 9964 : cluster [DBG] pgmap v8582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:14:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:14:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:57.790140+0000 mgr.smithi067.rdualw (mgr.24569) 9964 : cluster [DBG] pgmap v8582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:00.257 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:15:00.548 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:15:00.549 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 8m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:15:00.549 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 8m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:15:00.549 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 8m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:15:00.550 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 8m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:15:00.550 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 8m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:15:00.550 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 8m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:15:00.550 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 8m ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:15:00.551 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 8m ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:15:00.551 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 8m ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:15:00.551 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 8m ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:15:00.551 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 8m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:15:00.551 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 8m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:15:00.552 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 8m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:15:00.552 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 8m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:15:00.552 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 8m ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:15:00.552 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 8m ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:15:00.552 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 8m ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:15:00.553 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 8m ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:15:00.553 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 8m ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:15:00.553 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 8m ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:15:00.553 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 8m ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:15:00.554 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 8m ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:15:00.554 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 8m ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:15:00.894 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:15:00.894 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:15:00.894 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:15:00.895 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:15:00.895 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:15:00.895 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:15:00.895 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:15:00.896 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:15:00.896 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:15:00.896 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:15:00.896 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:15:00.897 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:15:00.897 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:15:00.897 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:15:00.897 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:15:00.897 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:15:00.898 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:15:00.898 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:15:00.898 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:15:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:14:59.790837+0000 mgr.smithi067.rdualw (mgr.24569) 9965 : cluster [DBG] pgmap v8583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:14:59.790837+0000 mgr.smithi067.rdualw (mgr.24569) 9965 : cluster [DBG] pgmap v8583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:15:00.243761+0000 mgr.smithi067.rdualw (mgr.24569) 9966 : audit [DBG] from='client.40786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:15:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:15:00.531253+0000 mgr.smithi067.rdualw (mgr.24569) 9967 : audit [DBG] from='client.40790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:15:02.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:15:00.892995+0000 mon.smithi061 (mon.0) 2112 : audit [DBG] from='client.? 172.21.15.61:0/2013487604' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:15:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:15:00.243761+0000 mgr.smithi067.rdualw (mgr.24569) 9966 : audit [DBG] from='client.40786 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:15:02.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:15:00.531253+0000 mgr.smithi067.rdualw (mgr.24569) 9967 : audit [DBG] from='client.40790 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:15:02.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:15:00.892995+0000 mon.smithi061 (mon.0) 2112 : audit [DBG] from='client.? 172.21.15.61:0/2013487604' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:15:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:01.791666+0000 mgr.smithi067.rdualw (mgr.24569) 9968 : cluster [DBG] pgmap v8584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:01.791666+0000 mgr.smithi067.rdualw (mgr.24569) 9968 : cluster [DBG] pgmap v8584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:03.792188+0000 mgr.smithi067.rdualw (mgr.24569) 9969 : cluster [DBG] pgmap v8585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:03.792188+0000 mgr.smithi067.rdualw (mgr.24569) 9969 : cluster [DBG] pgmap v8585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:05.793089+0000 mgr.smithi067.rdualw (mgr.24569) 9970 : cluster [DBG] pgmap v8586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:15:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:05.793089+0000 mgr.smithi067.rdualw (mgr.24569) 9970 : cluster [DBG] pgmap v8586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:15:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:07.793601+0000 mgr.smithi067.rdualw (mgr.24569) 9971 : cluster [DBG] pgmap v8587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:07.793601+0000 mgr.smithi067.rdualw (mgr.24569) 9971 : cluster [DBG] pgmap v8587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:09.794321+0000 mgr.smithi067.rdualw (mgr.24569) 9972 : cluster [DBG] pgmap v8588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:09.794321+0000 mgr.smithi067.rdualw (mgr.24569) 9972 : cluster [DBG] pgmap v8588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:11.795229+0000 mgr.smithi067.rdualw (mgr.24569) 9973 : cluster [DBG] pgmap v8589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:11.795229+0000 mgr.smithi067.rdualw (mgr.24569) 9973 : cluster [DBG] pgmap v8589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:13.795707+0000 mgr.smithi067.rdualw (mgr.24569) 9974 : cluster [DBG] pgmap v8590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:13.795707+0000 mgr.smithi067.rdualw (mgr.24569) 9974 : cluster [DBG] pgmap v8590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:15.796573+0000 mgr.smithi067.rdualw (mgr.24569) 9975 : cluster [DBG] pgmap v8591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:15:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:15.796573+0000 mgr.smithi067.rdualw (mgr.24569) 9975 : cluster [DBG] pgmap v8591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:15:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:17.797078+0000 mgr.smithi067.rdualw (mgr.24569) 9976 : cluster [DBG] pgmap v8592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:17.797078+0000 mgr.smithi067.rdualw (mgr.24569) 9976 : cluster [DBG] pgmap v8592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:19.797636+0000 mgr.smithi067.rdualw (mgr.24569) 9977 : cluster [DBG] pgmap v8593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:19.797636+0000 mgr.smithi067.rdualw (mgr.24569) 9977 : cluster [DBG] pgmap v8593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:21.798434+0000 mgr.smithi067.rdualw (mgr.24569) 9978 : cluster [DBG] pgmap v8594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:21.798434+0000 mgr.smithi067.rdualw (mgr.24569) 9978 : cluster [DBG] pgmap v8594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:23.798928+0000 mgr.smithi067.rdualw (mgr.24569) 9979 : cluster [DBG] pgmap v8595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:23.798928+0000 mgr.smithi067.rdualw (mgr.24569) 9979 : cluster [DBG] pgmap v8595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:27.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:25.799793+0000 mgr.smithi067.rdualw (mgr.24569) 9980 : cluster [DBG] pgmap v8596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:15:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:25.799793+0000 mgr.smithi067.rdualw (mgr.24569) 9980 : cluster [DBG] pgmap v8596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:15:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:27.800339+0000 mgr.smithi067.rdualw (mgr.24569) 9981 : cluster [DBG] pgmap v8597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:15:28.817562+0000 mon.smithi067 (mon.1) 1512 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:15:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:15:28.819012+0000 mon.smithi067 (mon.1) 1513 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:15:29.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:15:28.819928+0000 mon.smithi067 (mon.1) 1514 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:15:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:27.800339+0000 mgr.smithi067.rdualw (mgr.24569) 9981 : cluster [DBG] pgmap v8597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:15:28.817562+0000 mon.smithi067 (mon.1) 1512 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:15:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:15:28.819012+0000 mon.smithi067 (mon.1) 1513 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:15:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:15:28.819928+0000 mon.smithi067 (mon.1) 1514 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:15:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:15:28.820769+0000 mgr.smithi067.rdualw (mgr.24569) 9982 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:15:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:15:29.236321+0000 mon.smithi061 (mon.0) 2113 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:15:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:15:29.241535+0000 mon.smithi061 (mon.0) 2114 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:15:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:15:28.820769+0000 mgr.smithi067.rdualw (mgr.24569) 9982 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:15:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:15:29.236321+0000 mon.smithi061 (mon.0) 2113 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:15:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:15:29.241535+0000 mon.smithi061 (mon.0) 2114 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:15:31.203 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:15:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:29.800979+0000 mgr.smithi067.rdualw (mgr.24569) 9983 : cluster [DBG] pgmap v8598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:29.800979+0000 mgr.smithi067.rdualw (mgr.24569) 9983 : cluster [DBG] pgmap v8598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:31.542 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:15:31.543 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 9m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:15:31.543 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 9m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:15:31.543 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 9m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:15:31.543 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 9m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:15:31.544 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 9m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:15:31.544 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 9m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:15:31.544 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 9m ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:15:31.544 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 9m ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:15:31.544 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 9m ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:15:31.545 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 9m ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:15:31.545 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 9m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:15:31.545 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 9m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:15:31.545 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 9m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:15:31.545 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 9m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:15:31.546 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 9m ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:15:31.546 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 9m ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:15:31.546 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 9m ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:15:31.546 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 9m ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:15:31.547 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 9m ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:15:31.547 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 9m ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:15:31.547 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 9m ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:15:31.547 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 9m ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:15:31.547 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 9m ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:15:31.897 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:15:31.897 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:15:31.897 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:15:31.898 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:15:31.898 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:15:31.898 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:15:31.898 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:15:31.899 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:15:31.899 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:15:31.899 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:15:31.899 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:15:31.900 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:15:31.900 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:15:31.900 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:15:31.900 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:15:31.900 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:15:31.901 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:15:31.901 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:15:31.901 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:15:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:15:31.895893+0000 mon.smithi061 (mon.0) 2115 : audit [DBG] from='client.? 172.21.15.61:0/2912138888' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:15:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:15:31.895893+0000 mon.smithi061 (mon.0) 2115 : audit [DBG] from='client.? 172.21.15.61:0/2912138888' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:15:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:15:31.189675+0000 mgr.smithi067.rdualw (mgr.24569) 9984 : audit [DBG] from='client.40798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:15:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:15:31.524530+0000 mgr.smithi067.rdualw (mgr.24569) 9985 : audit [DBG] from='client.40802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:15:33.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:31.801854+0000 mgr.smithi067.rdualw (mgr.24569) 9986 : cluster [DBG] pgmap v8599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:15:31.189675+0000 mgr.smithi067.rdualw (mgr.24569) 9984 : audit [DBG] from='client.40798 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:15:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:15:31.524530+0000 mgr.smithi067.rdualw (mgr.24569) 9985 : audit [DBG] from='client.40802 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:15:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:31.801854+0000 mgr.smithi067.rdualw (mgr.24569) 9986 : cluster [DBG] pgmap v8599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:33.802472+0000 mgr.smithi067.rdualw (mgr.24569) 9987 : cluster [DBG] pgmap v8600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:33.802472+0000 mgr.smithi067.rdualw (mgr.24569) 9987 : cluster [DBG] pgmap v8600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:35.803470+0000 mgr.smithi067.rdualw (mgr.24569) 9988 : cluster [DBG] pgmap v8601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:15:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:15:36.025370+0000 mon.smithi067 (mon.1) 1515 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:15:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:15:36.025769+0000 mon.smithi067 (mon.1) 1516 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:15:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:15:36.026040+0000 mon.smithi061 (mon.0) 2116 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:15:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:15:36.026522+0000 mon.smithi061 (mon.0) 2117 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:15:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:35.803470+0000 mgr.smithi067.rdualw (mgr.24569) 9988 : cluster [DBG] pgmap v8601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:15:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:15:36.025370+0000 mon.smithi067 (mon.1) 1515 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:15:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:15:36.025769+0000 mon.smithi067 (mon.1) 1516 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:15:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:15:36.026040+0000 mon.smithi061 (mon.0) 2116 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:15:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:15:36.026522+0000 mon.smithi061 (mon.0) 2117 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:15:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:37.804082+0000 mgr.smithi067.rdualw (mgr.24569) 9989 : cluster [DBG] pgmap v8602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:37.804082+0000 mgr.smithi067.rdualw (mgr.24569) 9989 : cluster [DBG] pgmap v8602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:39.804781+0000 mgr.smithi067.rdualw (mgr.24569) 9990 : cluster [DBG] pgmap v8603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:39.804781+0000 mgr.smithi067.rdualw (mgr.24569) 9990 : cluster [DBG] pgmap v8603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:41.805715+0000 mgr.smithi067.rdualw (mgr.24569) 9991 : cluster [DBG] pgmap v8604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:41.805715+0000 mgr.smithi067.rdualw (mgr.24569) 9991 : cluster [DBG] pgmap v8604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:43.806402+0000 mgr.smithi067.rdualw (mgr.24569) 9992 : cluster [DBG] pgmap v8605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:43.806402+0000 mgr.smithi067.rdualw (mgr.24569) 9992 : cluster [DBG] pgmap v8605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:45.807334+0000 mgr.smithi067.rdualw (mgr.24569) 9993 : cluster [DBG] pgmap v8606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:15:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:45.807334+0000 mgr.smithi067.rdualw (mgr.24569) 9993 : cluster [DBG] pgmap v8606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:15:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:47.807861+0000 mgr.smithi067.rdualw (mgr.24569) 9994 : cluster [DBG] pgmap v8607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:47.807861+0000 mgr.smithi067.rdualw (mgr.24569) 9994 : cluster [DBG] pgmap v8607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:49.808375+0000 mgr.smithi067.rdualw (mgr.24569) 9995 : cluster [DBG] pgmap v8608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:49.808375+0000 mgr.smithi067.rdualw (mgr.24569) 9995 : cluster [DBG] pgmap v8608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:51.809171+0000 mgr.smithi067.rdualw (mgr.24569) 9996 : cluster [DBG] pgmap v8609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:51.809171+0000 mgr.smithi067.rdualw (mgr.24569) 9996 : cluster [DBG] pgmap v8609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:53.809701+0000 mgr.smithi067.rdualw (mgr.24569) 9997 : cluster [DBG] pgmap v8610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:53.809701+0000 mgr.smithi067.rdualw (mgr.24569) 9997 : cluster [DBG] pgmap v8610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:55.810485+0000 mgr.smithi067.rdualw (mgr.24569) 9998 : cluster [DBG] pgmap v8611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:15:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:55.810485+0000 mgr.smithi067.rdualw (mgr.24569) 9998 : cluster [DBG] pgmap v8611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:15:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:15:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:57.811002+0000 mgr.smithi067.rdualw (mgr.24569) 9999 : cluster [DBG] pgmap v8612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:15:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:15:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:57.811002+0000 mgr.smithi067.rdualw (mgr.24569) 9999 : cluster [DBG] pgmap v8612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:01.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:15:59.811556+0000 mgr.smithi067.rdualw (mgr.24569) 10000 : cluster [DBG] pgmap v8613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:15:59.811556+0000 mgr.smithi067.rdualw (mgr.24569) 10000 : cluster [DBG] pgmap v8613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:02.201 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:16:02.496 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:16:02.497 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 9m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:16:02.497 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 9m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:16:02.497 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 9m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:16:02.497 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 9m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:16:02.498 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 9m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:16:02.498 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 9m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:16:02.498 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 9m ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:16:02.498 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 9m ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:16:02.499 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 9m ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:16:02.499 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 9m ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:16:02.499 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 9m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:16:02.499 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 9m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:16:02.499 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 9m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:16:02.500 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 9m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:16:02.500 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 9m ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:16:02.500 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 9m ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:16:02.501 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 9m ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:16:02.501 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 9m ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:16:02.501 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 9m ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:16:02.501 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 9m ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:16:02.502 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 9m ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:16:02.502 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 9m ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:16:02.502 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 9m ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:16:02.888 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:16:02.888 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:16:02.888 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:16:02.888 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:16:02.889 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:16:02.889 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:16:02.889 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:16:02.889 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:16:02.889 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:16:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:16:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:16:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:16:02.890 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:16:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:16:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:16:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:16:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:16:02.891 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:16:02.892 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:16:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:01.812344+0000 mgr.smithi067.rdualw (mgr.24569) 10001 : cluster [DBG] pgmap v8614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:02.886671+0000 mon.smithi061 (mon.0) 2118 : audit [DBG] from='client.? 172.21.15.61:0/685479901' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:16:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:01.812344+0000 mgr.smithi067.rdualw (mgr.24569) 10001 : cluster [DBG] pgmap v8614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:02.886671+0000 mon.smithi061 (mon.0) 2118 : audit [DBG] from='client.? 172.21.15.61:0/685479901' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:16:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:02.187902+0000 mgr.smithi067.rdualw (mgr.24569) 10002 : audit [DBG] from='client.40810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:16:04.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:02.478646+0000 mgr.smithi067.rdualw (mgr.24569) 10003 : audit [DBG] from='client.40814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:16:04.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:03.813021+0000 mgr.smithi067.rdualw (mgr.24569) 10004 : cluster [DBG] pgmap v8615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:04.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:02.187902+0000 mgr.smithi067.rdualw (mgr.24569) 10002 : audit [DBG] from='client.40810 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:16:04.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:02.478646+0000 mgr.smithi067.rdualw (mgr.24569) 10003 : audit [DBG] from='client.40814 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:16:04.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:03.813021+0000 mgr.smithi067.rdualw (mgr.24569) 10004 : cluster [DBG] pgmap v8615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:05.814105+0000 mgr.smithi067.rdualw (mgr.24569) 10005 : cluster [DBG] pgmap v8616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:16:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:05.814105+0000 mgr.smithi067.rdualw (mgr.24569) 10005 : cluster [DBG] pgmap v8616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:16:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:07.814705+0000 mgr.smithi067.rdualw (mgr.24569) 10006 : cluster [DBG] pgmap v8617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:07.814705+0000 mgr.smithi067.rdualw (mgr.24569) 10006 : cluster [DBG] pgmap v8617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:09.815372+0000 mgr.smithi067.rdualw (mgr.24569) 10007 : cluster [DBG] pgmap v8618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:09.815372+0000 mgr.smithi067.rdualw (mgr.24569) 10007 : cluster [DBG] pgmap v8618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:11.816436+0000 mgr.smithi067.rdualw (mgr.24569) 10008 : cluster [DBG] pgmap v8619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:11.816436+0000 mgr.smithi067.rdualw (mgr.24569) 10008 : cluster [DBG] pgmap v8619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:13.816988+0000 mgr.smithi067.rdualw (mgr.24569) 10009 : cluster [DBG] pgmap v8620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:13.816988+0000 mgr.smithi067.rdualw (mgr.24569) 10009 : cluster [DBG] pgmap v8620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:15.818036+0000 mgr.smithi067.rdualw (mgr.24569) 10010 : cluster [DBG] pgmap v8621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:16:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:15.818036+0000 mgr.smithi067.rdualw (mgr.24569) 10010 : cluster [DBG] pgmap v8621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:16:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:17.818727+0000 mgr.smithi067.rdualw (mgr.24569) 10011 : cluster [DBG] pgmap v8622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:17.818727+0000 mgr.smithi067.rdualw (mgr.24569) 10011 : cluster [DBG] pgmap v8622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:19.819259+0000 mgr.smithi067.rdualw (mgr.24569) 10012 : cluster [DBG] pgmap v8623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:19.819259+0000 mgr.smithi067.rdualw (mgr.24569) 10012 : cluster [DBG] pgmap v8623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:21.820248+0000 mgr.smithi067.rdualw (mgr.24569) 10013 : cluster [DBG] pgmap v8624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:21.820248+0000 mgr.smithi067.rdualw (mgr.24569) 10013 : cluster [DBG] pgmap v8624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:23.820779+0000 mgr.smithi067.rdualw (mgr.24569) 10014 : cluster [DBG] pgmap v8625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:23.820779+0000 mgr.smithi067.rdualw (mgr.24569) 10014 : cluster [DBG] pgmap v8625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:27.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:25.821652+0000 mgr.smithi067.rdualw (mgr.24569) 10015 : cluster [DBG] pgmap v8626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:16:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:25.821652+0000 mgr.smithi067.rdualw (mgr.24569) 10015 : cluster [DBG] pgmap v8626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:16:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:27.822198+0000 mgr.smithi067.rdualw (mgr.24569) 10016 : cluster [DBG] pgmap v8627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:27.822198+0000 mgr.smithi067.rdualw (mgr.24569) 10016 : cluster [DBG] pgmap v8627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:29.245137+0000 mon.smithi067 (mon.1) 1517 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:16:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:29.246694+0000 mon.smithi067 (mon.1) 1518 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:16:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:29.247759+0000 mon.smithi067 (mon.1) 1519 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:16:30.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:29.245137+0000 mon.smithi067 (mon.1) 1517 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:16:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:29.246694+0000 mon.smithi067 (mon.1) 1518 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:16:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:29.247759+0000 mon.smithi067 (mon.1) 1519 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:16:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:16:29.248832+0000 mgr.smithi067.rdualw (mgr.24569) 10017 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:16:31.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:29.822764+0000 mgr.smithi067.rdualw (mgr.24569) 10018 : cluster [DBG] pgmap v8628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:16:29.248832+0000 mgr.smithi067.rdualw (mgr.24569) 10017 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:16:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:29.822764+0000 mgr.smithi067.rdualw (mgr.24569) 10018 : cluster [DBG] pgmap v8628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:33.214 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:16:33.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:31.823472+0000 mgr.smithi067.rdualw (mgr.24569) 10019 : cluster [DBG] pgmap v8629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:31.823472+0000 mgr.smithi067.rdualw (mgr.24569) 10019 : cluster [DBG] pgmap v8629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:33.525 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:16:33.526 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 10m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:16:33.526 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 10m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:16:33.526 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 10m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:16:33.526 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 10m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:16:33.527 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 10m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:16:33.527 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 10m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:16:33.527 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 10m ago 4h 483M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:16:33.527 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 10m ago 4h 630M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:16:33.528 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 10m ago 4h 1818M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:16:33.528 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 10m ago 4h 940M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:16:33.528 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 10m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:16:33.528 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 10m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:16:33.528 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 10m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:16:33.529 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 10m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:16:33.529 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 10m ago 4h 1175M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:16:33.529 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 10m ago 4h 2068M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:16:33.529 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 10m ago 4h 1299M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:16:33.529 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 10m ago 4h 2214M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:16:33.530 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 10m ago 4h 2041M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:16:33.530 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 10m ago 4h 2209M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:16:33.530 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 10m ago 4h 1802M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:16:33.530 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 10m ago 4h 2758M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:16:33.531 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 10m ago 4h 155M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:16:33.919 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:16:33.920 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:16:33.920 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:16:33.920 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:16:33.920 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:16:33.920 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:16:33.921 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:16:33.921 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:16:33.921 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:16:33.921 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:16:33.922 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:16:33.922 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:16:33.922 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:16:33.922 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:16:33.922 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:16:33.923 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:16:33.923 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:16:33.923 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:16:33.923 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:16:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:33.200031+0000 mgr.smithi067.rdualw (mgr.24569) 10020 : audit [DBG] from='client.40822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:16:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:33.509306+0000 mgr.smithi067.rdualw (mgr.24569) 10021 : audit [DBG] from='client.40826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:16:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:33.823918+0000 mgr.smithi067.rdualw (mgr.24569) 10022 : cluster [DBG] pgmap v8630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:33.837117+0000 mon.smithi061 (mon.0) 2119 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:16:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:33.918076+0000 mon.smithi061 (mon.0) 2120 : audit [DBG] from='client.? 172.21.15.61:0/1446620446' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:16:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:34.237472+0000 mon.smithi067 (mon.1) 1520 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:16:35.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:34.238234+0000 mon.smithi061 (mon.0) 2121 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:16:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:33.200031+0000 mgr.smithi067.rdualw (mgr.24569) 10020 : audit [DBG] from='client.40822 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:16:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:33.509306+0000 mgr.smithi067.rdualw (mgr.24569) 10021 : audit [DBG] from='client.40826 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:16:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:33.823918+0000 mgr.smithi067.rdualw (mgr.24569) 10022 : cluster [DBG] pgmap v8630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:33.837117+0000 mon.smithi061 (mon.0) 2119 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:16:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:33.918076+0000 mon.smithi061 (mon.0) 2120 : audit [DBG] from='client.? 172.21.15.61:0/1446620446' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:16:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:34.237472+0000 mon.smithi067 (mon.1) 1520 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:16:35.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:34.238234+0000 mon.smithi061 (mon.0) 2121 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:16:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:35.824784+0000 mgr.smithi067.rdualw (mgr.24569) 10023 : cluster [DBG] pgmap v8631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:16:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:36.031232+0000 mon.smithi067 (mon.1) 1521 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:16:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:36.031595+0000 mon.smithi067 (mon.1) 1522 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:16:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:36.032106+0000 mon.smithi061 (mon.0) 2122 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:16:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:36.032511+0000 mon.smithi061 (mon.0) 2123 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:16:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:36.386609+0000 mon.smithi061 (mon.0) 2124 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:16:37.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:36.806403+0000 mon.smithi067 (mon.1) 1523 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:16:37.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:36.807232+0000 mon.smithi061 (mon.0) 2125 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:16:37.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:36.813913+0000 mon.smithi061 (mon.0) 2126 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:16:37.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:16:36.821099+0000 mon.smithi061 (mon.0) 2127 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:16:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:35.824784+0000 mgr.smithi067.rdualw (mgr.24569) 10023 : cluster [DBG] pgmap v8631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:16:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:36.031232+0000 mon.smithi067 (mon.1) 1521 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:16:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:36.031595+0000 mon.smithi067 (mon.1) 1522 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:16:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:36.032106+0000 mon.smithi061 (mon.0) 2122 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:16:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:36.032511+0000 mon.smithi061 (mon.0) 2123 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:16:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:36.386609+0000 mon.smithi061 (mon.0) 2124 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:16:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:36.806403+0000 mon.smithi067 (mon.1) 1523 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:16:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:36.807232+0000 mon.smithi061 (mon.0) 2125 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:16:37.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:36.813913+0000 mon.smithi061 (mon.0) 2126 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:16:37.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:16:36.821099+0000 mon.smithi061 (mon.0) 2127 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:16:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:37.825289+0000 mgr.smithi067.rdualw (mgr.24569) 10024 : cluster [DBG] pgmap v8632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:37.825289+0000 mgr.smithi067.rdualw (mgr.24569) 10024 : cluster [DBG] pgmap v8632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:39.826067+0000 mgr.smithi067.rdualw (mgr.24569) 10025 : cluster [DBG] pgmap v8633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:39.826067+0000 mgr.smithi067.rdualw (mgr.24569) 10025 : cluster [DBG] pgmap v8633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:41.827047+0000 mgr.smithi067.rdualw (mgr.24569) 10026 : cluster [DBG] pgmap v8634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:41.827047+0000 mgr.smithi067.rdualw (mgr.24569) 10026 : cluster [DBG] pgmap v8634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:43.827513+0000 mgr.smithi067.rdualw (mgr.24569) 10027 : cluster [DBG] pgmap v8635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:43.827513+0000 mgr.smithi067.rdualw (mgr.24569) 10027 : cluster [DBG] pgmap v8635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:45.828628+0000 mgr.smithi067.rdualw (mgr.24569) 10028 : cluster [DBG] pgmap v8636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:16:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:45.828628+0000 mgr.smithi067.rdualw (mgr.24569) 10028 : cluster [DBG] pgmap v8636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:16:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:47.829327+0000 mgr.smithi067.rdualw (mgr.24569) 10029 : cluster [DBG] pgmap v8637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:47.829327+0000 mgr.smithi067.rdualw (mgr.24569) 10029 : cluster [DBG] pgmap v8637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:49.829905+0000 mgr.smithi067.rdualw (mgr.24569) 10030 : cluster [DBG] pgmap v8638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:51.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:49.829905+0000 mgr.smithi067.rdualw (mgr.24569) 10030 : cluster [DBG] pgmap v8638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:51.831052+0000 mgr.smithi067.rdualw (mgr.24569) 10031 : cluster [DBG] pgmap v8639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:51.831052+0000 mgr.smithi067.rdualw (mgr.24569) 10031 : cluster [DBG] pgmap v8639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:53.831809+0000 mgr.smithi067.rdualw (mgr.24569) 10032 : cluster [DBG] pgmap v8640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:53.831809+0000 mgr.smithi067.rdualw (mgr.24569) 10032 : cluster [DBG] pgmap v8640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:55.832665+0000 mgr.smithi067.rdualw (mgr.24569) 10033 : cluster [DBG] pgmap v8641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:16:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:55.832665+0000 mgr.smithi067.rdualw (mgr.24569) 10033 : cluster [DBG] pgmap v8641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:16:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:16:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:57.833349+0000 mgr.smithi067.rdualw (mgr.24569) 10034 : cluster [DBG] pgmap v8642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:16:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:16:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:57.833349+0000 mgr.smithi067.rdualw (mgr.24569) 10034 : cluster [DBG] pgmap v8642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:16:59.834151+0000 mgr.smithi067.rdualw (mgr.24569) 10035 : cluster [DBG] pgmap v8643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:01.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:16:59.834151+0000 mgr.smithi067.rdualw (mgr.24569) 10035 : cluster [DBG] pgmap v8643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:01.835005+0000 mgr.smithi067.rdualw (mgr.24569) 10036 : cluster [DBG] pgmap v8644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:01.835005+0000 mgr.smithi067.rdualw (mgr.24569) 10036 : cluster [DBG] pgmap v8644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:04.250 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:17:04.543 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:17:04.544 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 28s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:17:04.544 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 28s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:17:04.545 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 30s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:17:04.545 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 28s ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:17:04.545 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 28s ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:17:04.545 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 30s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:17:04.546 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 28s ago 4h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:17:04.546 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 30s ago 4h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:17:04.546 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 28s ago 4h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:17:04.546 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 30s ago 4h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:17:04.547 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 28s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:17:04.547 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 30s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:17:04.547 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 28s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:17:04.547 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 30s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:17:04.548 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 28s ago 4h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:17:04.548 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 28s ago 4h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:17:04.548 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 28s ago 4h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:17:04.548 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 28s ago 4h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:17:04.549 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 30s ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:17:04.549 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 30s ago 4h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:17:04.549 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 30s ago 4h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:17:04.550 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 30s ago 4h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:17:04.550 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 28s ago 4h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:17:04.887 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:17:04.887 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:17:04.888 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:17:04.888 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:17:04.888 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:17:04.888 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:17:04.889 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:17:04.889 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:17:04.889 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:17:04.889 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:17:04.890 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:17:04.890 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:17:04.890 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:17:04.890 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:17:04.890 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:17:04.891 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:17:04.891 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:17:04.891 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:17:04.891 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:17:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:03.835504+0000 mgr.smithi067.rdualw (mgr.24569) 10037 : cluster [DBG] pgmap v8645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:05.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:17:04.886178+0000 mon.smithi061 (mon.0) 2128 : audit [DBG] from='client.? 172.21.15.61:0/1420272027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:17:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:03.835504+0000 mgr.smithi067.rdualw (mgr.24569) 10037 : cluster [DBG] pgmap v8645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:17:04.886178+0000 mon.smithi061 (mon.0) 2128 : audit [DBG] from='client.? 172.21.15.61:0/1420272027' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:17:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:17:04.235440+0000 mgr.smithi067.rdualw (mgr.24569) 10038 : audit [DBG] from='client.40834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:17:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:17:04.525985+0000 mgr.smithi067.rdualw (mgr.24569) 10039 : audit [DBG] from='client.40838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:17:06.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:17:04.235440+0000 mgr.smithi067.rdualw (mgr.24569) 10038 : audit [DBG] from='client.40834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:17:06.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:17:04.525985+0000 mgr.smithi067.rdualw (mgr.24569) 10039 : audit [DBG] from='client.40838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:17:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:05.836469+0000 mgr.smithi067.rdualw (mgr.24569) 10040 : cluster [DBG] pgmap v8646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:17:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:05.836469+0000 mgr.smithi067.rdualw (mgr.24569) 10040 : cluster [DBG] pgmap v8646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:17:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:07.836991+0000 mgr.smithi067.rdualw (mgr.24569) 10041 : cluster [DBG] pgmap v8647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:07.836991+0000 mgr.smithi067.rdualw (mgr.24569) 10041 : cluster [DBG] pgmap v8647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:09.837676+0000 mgr.smithi067.rdualw (mgr.24569) 10042 : cluster [DBG] pgmap v8648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:09.837676+0000 mgr.smithi067.rdualw (mgr.24569) 10042 : cluster [DBG] pgmap v8648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:11.838707+0000 mgr.smithi067.rdualw (mgr.24569) 10043 : cluster [DBG] pgmap v8649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:11.838707+0000 mgr.smithi067.rdualw (mgr.24569) 10043 : cluster [DBG] pgmap v8649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:13.839396+0000 mgr.smithi067.rdualw (mgr.24569) 10044 : cluster [DBG] pgmap v8650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:13.839396+0000 mgr.smithi067.rdualw (mgr.24569) 10044 : cluster [DBG] pgmap v8650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:15.840375+0000 mgr.smithi067.rdualw (mgr.24569) 10045 : cluster [DBG] pgmap v8651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:17:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:15.840375+0000 mgr.smithi067.rdualw (mgr.24569) 10045 : cluster [DBG] pgmap v8651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:17:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:17.840929+0000 mgr.smithi067.rdualw (mgr.24569) 10046 : cluster [DBG] pgmap v8652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:17.840929+0000 mgr.smithi067.rdualw (mgr.24569) 10046 : cluster [DBG] pgmap v8652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:19.841594+0000 mgr.smithi067.rdualw (mgr.24569) 10047 : cluster [DBG] pgmap v8653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:19.841594+0000 mgr.smithi067.rdualw (mgr.24569) 10047 : cluster [DBG] pgmap v8653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:21.842696+0000 mgr.smithi067.rdualw (mgr.24569) 10048 : cluster [DBG] pgmap v8654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:21.842696+0000 mgr.smithi067.rdualw (mgr.24569) 10048 : cluster [DBG] pgmap v8654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:23.843197+0000 mgr.smithi067.rdualw (mgr.24569) 10049 : cluster [DBG] pgmap v8655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:23.843197+0000 mgr.smithi067.rdualw (mgr.24569) 10049 : cluster [DBG] pgmap v8655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:27.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:25.843980+0000 mgr.smithi067.rdualw (mgr.24569) 10050 : cluster [DBG] pgmap v8656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:17:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:25.843980+0000 mgr.smithi067.rdualw (mgr.24569) 10050 : cluster [DBG] pgmap v8656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:17:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:27.844438+0000 mgr.smithi067.rdualw (mgr.24569) 10051 : cluster [DBG] pgmap v8657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:27.844438+0000 mgr.smithi067.rdualw (mgr.24569) 10051 : cluster [DBG] pgmap v8657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:29.845005+0000 mgr.smithi067.rdualw (mgr.24569) 10052 : cluster [DBG] pgmap v8658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:29.845005+0000 mgr.smithi067.rdualw (mgr.24569) 10052 : cluster [DBG] pgmap v8658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:31.846024+0000 mgr.smithi067.rdualw (mgr.24569) 10053 : cluster [DBG] pgmap v8659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:31.846024+0000 mgr.smithi067.rdualw (mgr.24569) 10053 : cluster [DBG] pgmap v8659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:35.197 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:17:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:33.846731+0000 mgr.smithi067.rdualw (mgr.24569) 10054 : cluster [DBG] pgmap v8660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:33.846731+0000 mgr.smithi067.rdualw (mgr.24569) 10054 : cluster [DBG] pgmap v8660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:35.490 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:17:35.491 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 59s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:17:35.491 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 59s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:17:35.491 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 61s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:17:35.491 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 59s ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:17:35.492 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 59s ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:17:35.492 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 61s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:17:35.492 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 59s ago 4h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:17:35.492 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 61s ago 4h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:17:35.493 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 59s ago 4h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:17:35.493 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 61s ago 4h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:17:35.493 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 59s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:17:35.493 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 61s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:17:35.494 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 59s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:17:35.494 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 61s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:17:35.494 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 59s ago 4h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:17:35.494 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 59s ago 4h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:17:35.495 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 59s ago 4h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:17:35.495 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 59s ago 4h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:17:35.495 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 61s ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:17:35.495 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 61s ago 4h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:17:35.496 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 61s ago 4h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:17:35.496 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 61s ago 4h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:17:35.496 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 59s ago 4h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:17:35.831 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:17:35.831 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:17:35.832 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:17:35.832 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:17:35.832 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:17:35.832 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:17:35.833 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:17:35.833 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:17:35.833 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:17:35.833 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:17:35.834 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:17:35.834 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:17:35.834 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:17:35.834 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:17:35.834 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:17:35.835 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:17:35.835 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:17:35.835 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:17:35.835 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:17:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:17:35.830147+0000 mon.smithi061 (mon.0) 2129 : audit [DBG] from='client.? 172.21.15.61:0/2109571805' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:17:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:17:35.830147+0000 mon.smithi061 (mon.0) 2129 : audit [DBG] from='client.? 172.21.15.61:0/2109571805' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:17:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:17:35.183881+0000 mgr.smithi067.rdualw (mgr.24569) 10055 : audit [DBG] from='client.40846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:17:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:17:35.472415+0000 mgr.smithi067.rdualw (mgr.24569) 10056 : audit [DBG] from='client.40850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:17:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:35.847568+0000 mgr.smithi067.rdualw (mgr.24569) 10057 : cluster [DBG] pgmap v8661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:17:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:17:36.037098+0000 mon.smithi067 (mon.1) 1524 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:17:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:17:36.037366+0000 mon.smithi067 (mon.1) 1525 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:17:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:17:36.037756+0000 mon.smithi061 (mon.0) 2130 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:17:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:17:36.038222+0000 mon.smithi061 (mon.0) 2131 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:17:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:17:36.825114+0000 mon.smithi067 (mon.1) 1526 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:17:37.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:17:36.826525+0000 mon.smithi067 (mon.1) 1527 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:17:37.304 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:17:36.827471+0000 mon.smithi067 (mon.1) 1528 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:17:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:17:35.183881+0000 mgr.smithi067.rdualw (mgr.24569) 10055 : audit [DBG] from='client.40846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:17:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:17:35.472415+0000 mgr.smithi067.rdualw (mgr.24569) 10056 : audit [DBG] from='client.40850 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:17:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:35.847568+0000 mgr.smithi067.rdualw (mgr.24569) 10057 : cluster [DBG] pgmap v8661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:17:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:17:36.037098+0000 mon.smithi067 (mon.1) 1524 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:17:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:17:36.037366+0000 mon.smithi067 (mon.1) 1525 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:17:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:17:36.037756+0000 mon.smithi061 (mon.0) 2130 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:17:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:17:36.038222+0000 mon.smithi061 (mon.0) 2131 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:17:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:17:36.825114+0000 mon.smithi067 (mon.1) 1526 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:17:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:17:36.826525+0000 mon.smithi067 (mon.1) 1527 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:17:37.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:17:36.827471+0000 mon.smithi067 (mon.1) 1528 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:17:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:17:36.828321+0000 mgr.smithi067.rdualw (mgr.24569) 10058 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:17:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:17:37.246003+0000 mon.smithi061 (mon.0) 2132 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:17:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:17:37.253700+0000 mon.smithi061 (mon.0) 2133 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:17:38.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:17:36.828321+0000 mgr.smithi067.rdualw (mgr.24569) 10058 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:17:38.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:17:37.246003+0000 mon.smithi061 (mon.0) 2132 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:17:38.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:17:37.253700+0000 mon.smithi061 (mon.0) 2133 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:17:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:37.847989+0000 mgr.smithi067.rdualw (mgr.24569) 10059 : cluster [DBG] pgmap v8662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:37.847989+0000 mgr.smithi067.rdualw (mgr.24569) 10059 : cluster [DBG] pgmap v8662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:39.848691+0000 mgr.smithi067.rdualw (mgr.24569) 10060 : cluster [DBG] pgmap v8663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:39.848691+0000 mgr.smithi067.rdualw (mgr.24569) 10060 : cluster [DBG] pgmap v8663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:41.849774+0000 mgr.smithi067.rdualw (mgr.24569) 10061 : cluster [DBG] pgmap v8664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:41.849774+0000 mgr.smithi067.rdualw (mgr.24569) 10061 : cluster [DBG] pgmap v8664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:43.850342+0000 mgr.smithi067.rdualw (mgr.24569) 10062 : cluster [DBG] pgmap v8665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:43.850342+0000 mgr.smithi067.rdualw (mgr.24569) 10062 : cluster [DBG] pgmap v8665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:45.851394+0000 mgr.smithi067.rdualw (mgr.24569) 10063 : cluster [DBG] pgmap v8666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:17:47.318 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:45.851394+0000 mgr.smithi067.rdualw (mgr.24569) 10063 : cluster [DBG] pgmap v8666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:17:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:47.852029+0000 mgr.smithi067.rdualw (mgr.24569) 10064 : cluster [DBG] pgmap v8667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:47.852029+0000 mgr.smithi067.rdualw (mgr.24569) 10064 : cluster [DBG] pgmap v8667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:49.852799+0000 mgr.smithi067.rdualw (mgr.24569) 10065 : cluster [DBG] pgmap v8668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:49.852799+0000 mgr.smithi067.rdualw (mgr.24569) 10065 : cluster [DBG] pgmap v8668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:51.853664+0000 mgr.smithi067.rdualw (mgr.24569) 10066 : cluster [DBG] pgmap v8669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:51.853664+0000 mgr.smithi067.rdualw (mgr.24569) 10066 : cluster [DBG] pgmap v8669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:53.854279+0000 mgr.smithi067.rdualw (mgr.24569) 10067 : cluster [DBG] pgmap v8670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:53.854279+0000 mgr.smithi067.rdualw (mgr.24569) 10067 : cluster [DBG] pgmap v8670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:55.855019+0000 mgr.smithi067.rdualw (mgr.24569) 10068 : cluster [DBG] pgmap v8671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:17:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:55.855019+0000 mgr.smithi067.rdualw (mgr.24569) 10068 : cluster [DBG] pgmap v8671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:17:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:17:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:57.855559+0000 mgr.smithi067.rdualw (mgr.24569) 10069 : cluster [DBG] pgmap v8672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:17:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:17:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:57.855559+0000 mgr.smithi067.rdualw (mgr.24569) 10069 : cluster [DBG] pgmap v8672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:17:59.856179+0000 mgr.smithi067.rdualw (mgr.24569) 10070 : cluster [DBG] pgmap v8673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:17:59.856179+0000 mgr.smithi067.rdualw (mgr.24569) 10070 : cluster [DBG] pgmap v8673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:01.857307+0000 mgr.smithi067.rdualw (mgr.24569) 10071 : cluster [DBG] pgmap v8674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:01.857307+0000 mgr.smithi067.rdualw (mgr.24569) 10071 : cluster [DBG] pgmap v8674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:03.857996+0000 mgr.smithi067.rdualw (mgr.24569) 10072 : cluster [DBG] pgmap v8675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:03.857996+0000 mgr.smithi067.rdualw (mgr.24569) 10072 : cluster [DBG] pgmap v8675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:06.141 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:18:06.429 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:18:06.429 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 90s ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:18:06.429 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 90s ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:18:06.430 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 92s ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:18:06.430 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 90s ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:18:06.430 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 90s ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:18:06.430 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 92s ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:18:06.431 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 90s ago 4h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:18:06.431 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 92s ago 4h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:18:06.431 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 90s ago 4h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:18:06.431 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 92s ago 4h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:18:06.432 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 90s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:18:06.432 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 92s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:18:06.432 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 90s ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:18:06.432 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 92s ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:18:06.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 90s ago 4h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:18:06.433 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 90s ago 4h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:18:06.433 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 90s ago 4h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:18:06.433 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 90s ago 4h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:18:06.433 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 92s ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:18:06.434 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 92s ago 4h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:18:06.434 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 92s ago 4h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:18:06.434 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 92s ago 4h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:18:06.434 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 90s ago 4h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:18:06.769 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:18:06.769 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:18:06.770 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:18:06.770 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:18:06.770 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:18:06.771 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:18:06.771 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:18:06.771 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:18:06.771 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:18:06.771 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:18:06.772 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:18:06.772 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:18:06.772 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:18:06.772 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:18:06.773 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:18:06.773 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:18:06.773 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:18:06.773 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:18:06.773 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:18:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:05.858857+0000 mgr.smithi067.rdualw (mgr.24569) 10073 : cluster [DBG] pgmap v8676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:18:07.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:18:06.768079+0000 mon.smithi061 (mon.0) 2134 : audit [DBG] from='client.? 172.21.15.61:0/522876214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:18:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:05.858857+0000 mgr.smithi067.rdualw (mgr.24569) 10073 : cluster [DBG] pgmap v8676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:18:07.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:18:06.768079+0000 mon.smithi061 (mon.0) 2134 : audit [DBG] from='client.? 172.21.15.61:0/522876214' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:18:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:18:06.127411+0000 mgr.smithi067.rdualw (mgr.24569) 10074 : audit [DBG] from='client.40858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:18:08.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:18:06.411513+0000 mgr.smithi067.rdualw (mgr.24569) 10075 : audit [DBG] from='client.40862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:18:08.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:18:06.127411+0000 mgr.smithi067.rdualw (mgr.24569) 10074 : audit [DBG] from='client.40858 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:18:08.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:18:06.411513+0000 mgr.smithi067.rdualw (mgr.24569) 10075 : audit [DBG] from='client.40862 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:18:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:07.859352+0000 mgr.smithi067.rdualw (mgr.24569) 10076 : cluster [DBG] pgmap v8677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:07.859352+0000 mgr.smithi067.rdualw (mgr.24569) 10076 : cluster [DBG] pgmap v8677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:09.860174+0000 mgr.smithi067.rdualw (mgr.24569) 10077 : cluster [DBG] pgmap v8678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:09.860174+0000 mgr.smithi067.rdualw (mgr.24569) 10077 : cluster [DBG] pgmap v8678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:11.861277+0000 mgr.smithi067.rdualw (mgr.24569) 10078 : cluster [DBG] pgmap v8679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:11.861277+0000 mgr.smithi067.rdualw (mgr.24569) 10078 : cluster [DBG] pgmap v8679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:13.861912+0000 mgr.smithi067.rdualw (mgr.24569) 10079 : cluster [DBG] pgmap v8680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:13.861912+0000 mgr.smithi067.rdualw (mgr.24569) 10079 : cluster [DBG] pgmap v8680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:15.862879+0000 mgr.smithi067.rdualw (mgr.24569) 10080 : cluster [DBG] pgmap v8681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:18:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:15.862879+0000 mgr.smithi067.rdualw (mgr.24569) 10080 : cluster [DBG] pgmap v8681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:18:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:17.863613+0000 mgr.smithi067.rdualw (mgr.24569) 10081 : cluster [DBG] pgmap v8682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:17.863613+0000 mgr.smithi067.rdualw (mgr.24569) 10081 : cluster [DBG] pgmap v8682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:19.864310+0000 mgr.smithi067.rdualw (mgr.24569) 10082 : cluster [DBG] pgmap v8683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:21.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:19.864310+0000 mgr.smithi067.rdualw (mgr.24569) 10082 : cluster [DBG] pgmap v8683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:21.865320+0000 mgr.smithi067.rdualw (mgr.24569) 10083 : cluster [DBG] pgmap v8684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:21.865320+0000 mgr.smithi067.rdualw (mgr.24569) 10083 : cluster [DBG] pgmap v8684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:23.865933+0000 mgr.smithi067.rdualw (mgr.24569) 10084 : cluster [DBG] pgmap v8685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:23.865933+0000 mgr.smithi067.rdualw (mgr.24569) 10084 : cluster [DBG] pgmap v8685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:27.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:25.866835+0000 mgr.smithi067.rdualw (mgr.24569) 10085 : cluster [DBG] pgmap v8686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:18:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:25.866835+0000 mgr.smithi067.rdualw (mgr.24569) 10085 : cluster [DBG] pgmap v8686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:18:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:27.867486+0000 mgr.smithi067.rdualw (mgr.24569) 10086 : cluster [DBG] pgmap v8687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:27.867486+0000 mgr.smithi067.rdualw (mgr.24569) 10086 : cluster [DBG] pgmap v8687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:29.868221+0000 mgr.smithi067.rdualw (mgr.24569) 10087 : cluster [DBG] pgmap v8688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:29.868221+0000 mgr.smithi067.rdualw (mgr.24569) 10087 : cluster [DBG] pgmap v8688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:31.869225+0000 mgr.smithi067.rdualw (mgr.24569) 10088 : cluster [DBG] pgmap v8689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:31.869225+0000 mgr.smithi067.rdualw (mgr.24569) 10088 : cluster [DBG] pgmap v8689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:33.869787+0000 mgr.smithi067.rdualw (mgr.24569) 10089 : cluster [DBG] pgmap v8690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:35.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:33.869787+0000 mgr.smithi067.rdualw (mgr.24569) 10089 : cluster [DBG] pgmap v8690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:37.075 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:18:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:35.870637+0000 mgr.smithi067.rdualw (mgr.24569) 10090 : cluster [DBG] pgmap v8691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:18:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:18:36.043151+0000 mon.smithi067 (mon.1) 1529 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:18:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:18:36.043408+0000 mon.smithi067 (mon.1) 1530 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:18:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:18:36.043825+0000 mon.smithi061 (mon.0) 2135 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:18:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:18:36.044149+0000 mon.smithi061 (mon.0) 2136 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:18:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:35.870637+0000 mgr.smithi067.rdualw (mgr.24569) 10090 : cluster [DBG] pgmap v8691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:18:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:18:36.043151+0000 mon.smithi067 (mon.1) 1529 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:18:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:18:36.043408+0000 mon.smithi067 (mon.1) 1530 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:18:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:18:36.043825+0000 mon.smithi061 (mon.0) 2135 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:18:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:18:36.044149+0000 mon.smithi061 (mon.0) 2136 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:18:37.368 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:18:37.369 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 2m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:18:37.369 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 2m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:18:37.369 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 2m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:18:37.369 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 2m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:18:37.370 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 2m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:18:37.370 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 2m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:18:37.370 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 2m ago 4h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:18:37.370 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 2m ago 4h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:18:37.371 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 2m ago 4h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:18:37.371 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 2m ago 4h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:18:37.371 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 2m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:18:37.371 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 2m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:18:37.371 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 2m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:18:37.372 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 2m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:18:37.372 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 2m ago 4h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:18:37.372 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 2m ago 4h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:18:37.372 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 2m ago 4h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:18:37.373 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 2m ago 4h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:18:37.373 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 2m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:18:37.373 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 2m ago 4h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:18:37.373 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 2m ago 4h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:18:37.373 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 2m ago 4h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:18:37.374 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 2m ago 4h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:18:37.726 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:18:37.726 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:18:37.726 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:18:37.727 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:18:37.727 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:18:37.727 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:18:37.727 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:18:37.728 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:18:37.728 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:18:37.728 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:18:37.728 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:18:37.728 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:18:37.729 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:18:37.729 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:18:37.729 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:18:37.729 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:18:37.730 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:18:37.730 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:18:37.730 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:18:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:18:37.256706+0000 mon.smithi067 (mon.1) 1531 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:18:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:18:37.258242+0000 mon.smithi067 (mon.1) 1532 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:18:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:18:37.259267+0000 mon.smithi067 (mon.1) 1533 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:18:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:18:37.623993+0000 mon.smithi061 (mon.0) 2137 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:18:38.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:18:37.628194+0000 mon.smithi061 (mon.0) 2138 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:18:38.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:18:37.724609+0000 mon.smithi061 (mon.0) 2139 : audit [DBG] from='client.? 172.21.15.61:0/2568182804' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:18:38.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:18:37.256706+0000 mon.smithi067 (mon.1) 1531 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:18:38.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:18:37.258242+0000 mon.smithi067 (mon.1) 1532 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:18:38.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:18:37.259267+0000 mon.smithi067 (mon.1) 1533 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:18:38.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:18:37.623993+0000 mon.smithi061 (mon.0) 2137 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:18:38.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:18:37.628194+0000 mon.smithi061 (mon.0) 2138 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:18:38.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:18:37.724609+0000 mon.smithi061 (mon.0) 2139 : audit [DBG] from='client.? 172.21.15.61:0/2568182804' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:18:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:18:37.061616+0000 mgr.smithi067.rdualw (mgr.24569) 10091 : audit [DBG] from='client.40870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:18:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:18:37.260132+0000 mgr.smithi067.rdualw (mgr.24569) 10092 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:18:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:18:37.351656+0000 mgr.smithi067.rdualw (mgr.24569) 10093 : audit [DBG] from='client.40874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:18:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:37.871107+0000 mgr.smithi067.rdualw (mgr.24569) 10094 : cluster [DBG] pgmap v8692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:18:38.037844+0000 mon.smithi061 (mon.0) 2140 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:18:39.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:18:38.045693+0000 mon.smithi061 (mon.0) 2141 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:18:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:18:37.061616+0000 mgr.smithi067.rdualw (mgr.24569) 10091 : audit [DBG] from='client.40870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:18:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:18:37.260132+0000 mgr.smithi067.rdualw (mgr.24569) 10092 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:18:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:18:37.351656+0000 mgr.smithi067.rdualw (mgr.24569) 10093 : audit [DBG] from='client.40874 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:18:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:37.871107+0000 mgr.smithi067.rdualw (mgr.24569) 10094 : cluster [DBG] pgmap v8692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:18:38.037844+0000 mon.smithi061 (mon.0) 2140 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:18:39.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:18:38.045693+0000 mon.smithi061 (mon.0) 2141 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:18:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:39.871870+0000 mgr.smithi067.rdualw (mgr.24569) 10095 : cluster [DBG] pgmap v8693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:39.871870+0000 mgr.smithi067.rdualw (mgr.24569) 10095 : cluster [DBG] pgmap v8693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:41.872819+0000 mgr.smithi067.rdualw (mgr.24569) 10096 : cluster [DBG] pgmap v8694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:41.872819+0000 mgr.smithi067.rdualw (mgr.24569) 10096 : cluster [DBG] pgmap v8694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:43.873431+0000 mgr.smithi067.rdualw (mgr.24569) 10097 : cluster [DBG] pgmap v8695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:43.873431+0000 mgr.smithi067.rdualw (mgr.24569) 10097 : cluster [DBG] pgmap v8695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:45.874370+0000 mgr.smithi067.rdualw (mgr.24569) 10098 : cluster [DBG] pgmap v8696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:18:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:45.874370+0000 mgr.smithi067.rdualw (mgr.24569) 10098 : cluster [DBG] pgmap v8696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:18:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:47.875016+0000 mgr.smithi067.rdualw (mgr.24569) 10099 : cluster [DBG] pgmap v8697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:47.875016+0000 mgr.smithi067.rdualw (mgr.24569) 10099 : cluster [DBG] pgmap v8697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:49.875821+0000 mgr.smithi067.rdualw (mgr.24569) 10100 : cluster [DBG] pgmap v8698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:49.875821+0000 mgr.smithi067.rdualw (mgr.24569) 10100 : cluster [DBG] pgmap v8698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:51.876703+0000 mgr.smithi067.rdualw (mgr.24569) 10101 : cluster [DBG] pgmap v8699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:51.876703+0000 mgr.smithi067.rdualw (mgr.24569) 10101 : cluster [DBG] pgmap v8699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:53.877507+0000 mgr.smithi067.rdualw (mgr.24569) 10102 : cluster [DBG] pgmap v8700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:53.877507+0000 mgr.smithi067.rdualw (mgr.24569) 10102 : cluster [DBG] pgmap v8700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:55.878411+0000 mgr.smithi067.rdualw (mgr.24569) 10103 : cluster [DBG] pgmap v8701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:18:57.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:55.878411+0000 mgr.smithi067.rdualw (mgr.24569) 10103 : cluster [DBG] pgmap v8701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:18:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:18:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:57.879070+0000 mgr.smithi067.rdualw (mgr.24569) 10104 : cluster [DBG] pgmap v8702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:18:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:18:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:57.879070+0000 mgr.smithi067.rdualw (mgr.24569) 10104 : cluster [DBG] pgmap v8702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:18:59.879705+0000 mgr.smithi067.rdualw (mgr.24569) 10105 : cluster [DBG] pgmap v8703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:18:59.879705+0000 mgr.smithi067.rdualw (mgr.24569) 10105 : cluster [DBG] pgmap v8703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:01.880716+0000 mgr.smithi067.rdualw (mgr.24569) 10106 : cluster [DBG] pgmap v8704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:01.880716+0000 mgr.smithi067.rdualw (mgr.24569) 10106 : cluster [DBG] pgmap v8704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:03.881282+0000 mgr.smithi067.rdualw (mgr.24569) 10107 : cluster [DBG] pgmap v8705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:03.881282+0000 mgr.smithi067.rdualw (mgr.24569) 10107 : cluster [DBG] pgmap v8705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:05.882142+0000 mgr.smithi067.rdualw (mgr.24569) 10108 : cluster [DBG] pgmap v8706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:19:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:05.882142+0000 mgr.smithi067.rdualw (mgr.24569) 10108 : cluster [DBG] pgmap v8706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:19:08.034 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:19:08.336 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:19:08.336 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 2m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:19:08.336 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 2m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:19:08.336 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 2m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:19:08.337 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 2m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:19:08.337 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 2m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:19:08.337 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 2m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:19:08.337 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 2m ago 4h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:19:08.338 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 2m ago 4h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:19:08.338 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 2m ago 4h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:19:08.338 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 2m ago 4h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:19:08.338 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 2m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:19:08.338 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 2m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:19:08.339 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 2m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:19:08.339 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 2m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:19:08.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 2m ago 4h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:19:08.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 2m ago 4h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:19:08.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 2m ago 4h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:19:08.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 2m ago 4h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:19:08.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 2m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:19:08.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 2m ago 4h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:19:08.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 2m ago 4h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:19:08.341 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 2m ago 4h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:19:08.341 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 2m ago 4h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:19:08.676 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:19:08.677 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:19:08.677 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:19:08.677 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:19:08.677 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:19:08.678 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:19:08.678 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:19:08.678 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:19:08.678 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:19:08.679 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:19:08.679 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:19:08.679 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:19:08.679 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:19:08.680 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:19:08.680 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:19:08.680 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:19:08.680 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:19:08.681 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:19:08.681 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:19:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:07.882806+0000 mgr.smithi067.rdualw (mgr.24569) 10109 : cluster [DBG] pgmap v8707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:09.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:19:08.675415+0000 mon.smithi061 (mon.0) 2142 : audit [DBG] from='client.? 172.21.15.61:0/3946885133' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:19:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:07.882806+0000 mgr.smithi067.rdualw (mgr.24569) 10109 : cluster [DBG] pgmap v8707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:19:08.675415+0000 mon.smithi061 (mon.0) 2142 : audit [DBG] from='client.? 172.21.15.61:0/3946885133' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:19:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:19:08.020420+0000 mgr.smithi067.rdualw (mgr.24569) 10110 : audit [DBG] from='client.40882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:19:10.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:19:08.318237+0000 mgr.smithi067.rdualw (mgr.24569) 10111 : audit [DBG] from='client.40886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:19:10.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:19:08.020420+0000 mgr.smithi067.rdualw (mgr.24569) 10110 : audit [DBG] from='client.40882 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:19:10.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:19:08.318237+0000 mgr.smithi067.rdualw (mgr.24569) 10111 : audit [DBG] from='client.40886 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:19:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:09.883573+0000 mgr.smithi067.rdualw (mgr.24569) 10112 : cluster [DBG] pgmap v8708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:09.883573+0000 mgr.smithi067.rdualw (mgr.24569) 10112 : cluster [DBG] pgmap v8708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:11.884684+0000 mgr.smithi067.rdualw (mgr.24569) 10113 : cluster [DBG] pgmap v8709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:11.884684+0000 mgr.smithi067.rdualw (mgr.24569) 10113 : cluster [DBG] pgmap v8709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:13.885264+0000 mgr.smithi067.rdualw (mgr.24569) 10114 : cluster [DBG] pgmap v8710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:13.885264+0000 mgr.smithi067.rdualw (mgr.24569) 10114 : cluster [DBG] pgmap v8710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:15.886052+0000 mgr.smithi067.rdualw (mgr.24569) 10115 : cluster [DBG] pgmap v8711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:19:17.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:15.886052+0000 mgr.smithi067.rdualw (mgr.24569) 10115 : cluster [DBG] pgmap v8711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:19:19.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:17.886529+0000 mgr.smithi067.rdualw (mgr.24569) 10116 : cluster [DBG] pgmap v8712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:17.886529+0000 mgr.smithi067.rdualw (mgr.24569) 10116 : cluster [DBG] pgmap v8712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:19.887347+0000 mgr.smithi067.rdualw (mgr.24569) 10117 : cluster [DBG] pgmap v8713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:20.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:19.887347+0000 mgr.smithi067.rdualw (mgr.24569) 10117 : cluster [DBG] pgmap v8713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:21.888277+0000 mgr.smithi067.rdualw (mgr.24569) 10118 : cluster [DBG] pgmap v8714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:21.888277+0000 mgr.smithi067.rdualw (mgr.24569) 10118 : cluster [DBG] pgmap v8714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:23.888912+0000 mgr.smithi067.rdualw (mgr.24569) 10119 : cluster [DBG] pgmap v8715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:23.888912+0000 mgr.smithi067.rdualw (mgr.24569) 10119 : cluster [DBG] pgmap v8715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:27.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:25.889692+0000 mgr.smithi067.rdualw (mgr.24569) 10120 : cluster [DBG] pgmap v8716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:19:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:25.889692+0000 mgr.smithi067.rdualw (mgr.24569) 10120 : cluster [DBG] pgmap v8716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:19:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:27.890211+0000 mgr.smithi067.rdualw (mgr.24569) 10121 : cluster [DBG] pgmap v8717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:27.890211+0000 mgr.smithi067.rdualw (mgr.24569) 10121 : cluster [DBG] pgmap v8717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:31.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:29.890979+0000 mgr.smithi067.rdualw (mgr.24569) 10122 : cluster [DBG] pgmap v8718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:29.890979+0000 mgr.smithi067.rdualw (mgr.24569) 10122 : cluster [DBG] pgmap v8718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:31.891919+0000 mgr.smithi067.rdualw (mgr.24569) 10123 : cluster [DBG] pgmap v8719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:31.891919+0000 mgr.smithi067.rdualw (mgr.24569) 10123 : cluster [DBG] pgmap v8719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:35.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:33.892745+0000 mgr.smithi067.rdualw (mgr.24569) 10124 : cluster [DBG] pgmap v8720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:33.892745+0000 mgr.smithi067.rdualw (mgr.24569) 10124 : cluster [DBG] pgmap v8720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:35.893604+0000 mgr.smithi067.rdualw (mgr.24569) 10125 : cluster [DBG] pgmap v8721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:19:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:19:36.049098+0000 mon.smithi067 (mon.1) 1534 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:19:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:19:36.049332+0000 mon.smithi067 (mon.1) 1535 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:19:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:19:36.049808+0000 mon.smithi061 (mon.0) 2143 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:19:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:19:36.050110+0000 mon.smithi061 (mon.0) 2144 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:19:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:35.893604+0000 mgr.smithi067.rdualw (mgr.24569) 10125 : cluster [DBG] pgmap v8721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:19:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:19:36.049098+0000 mon.smithi067 (mon.1) 1534 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:19:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:19:36.049332+0000 mon.smithi067 (mon.1) 1535 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:19:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:19:36.049808+0000 mon.smithi061 (mon.0) 2143 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:19:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:19:36.050110+0000 mon.smithi061 (mon.0) 2144 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:19:38.985 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:19:39.286 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:19:39.287 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 3m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:19:39.287 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 3m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:19:39.287 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 3m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:19:39.288 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 3m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:19:39.288 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 3m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:19:39.288 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 3m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:19:39.288 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 3m ago 4h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:19:39.289 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 3m ago 4h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:19:39.289 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 3m ago 4h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:19:39.289 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 3m ago 4h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:19:39.289 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 3m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:19:39.289 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 3m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:19:39.290 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 3m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:19:39.290 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 3m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:19:39.290 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 3m ago 4h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:19:39.290 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 3m ago 4h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:19:39.291 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 3m ago 4h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:19:39.291 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 3m ago 4h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:19:39.291 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 3m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:19:39.291 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 3m ago 4h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:19:39.292 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 3m ago 4h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:19:39.292 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 3m ago 4h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:19:39.292 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 3m ago 4h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:19:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:37.894134+0000 mgr.smithi067.rdualw (mgr.24569) 10126 : cluster [DBG] pgmap v8722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:19:38.048644+0000 mon.smithi067 (mon.1) 1536 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:19:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:19:38.050056+0000 mon.smithi067 (mon.1) 1537 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:19:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:19:38.051004+0000 mon.smithi067 (mon.1) 1538 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:19:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:19:38.468483+0000 mon.smithi061 (mon.0) 2145 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:19:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:19:38.474522+0000 mon.smithi061 (mon.0) 2146 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:19:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:37.894134+0000 mgr.smithi067.rdualw (mgr.24569) 10126 : cluster [DBG] pgmap v8722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:19:38.048644+0000 mon.smithi067 (mon.1) 1536 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:19:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:19:38.050056+0000 mon.smithi067 (mon.1) 1537 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:19:39.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:19:38.051004+0000 mon.smithi067 (mon.1) 1538 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:19:39.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:19:38.468483+0000 mon.smithi061 (mon.0) 2145 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:19:39.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:19:38.474522+0000 mon.smithi061 (mon.0) 2146 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:19:39.627 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:19:39.627 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:19:39.628 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:19:39.628 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:19:39.628 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:19:39.628 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:19:39.628 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:19:39.629 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:19:39.629 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:19:39.629 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:19:39.629 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:19:39.630 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:19:39.630 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:19:39.630 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:19:39.630 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:19:39.630 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:19:39.631 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:19:39.631 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:19:39.631 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:19:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:19:38.051862+0000 mgr.smithi067.rdualw (mgr.24569) 10127 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:19:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:19:38.971279+0000 mgr.smithi067.rdualw (mgr.24569) 10128 : audit [DBG] from='client.40894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:19:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:19:39.626047+0000 mon.smithi061 (mon.0) 2147 : audit [DBG] from='client.? 172.21.15.61:0/2548040232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:19:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:19:38.051862+0000 mgr.smithi067.rdualw (mgr.24569) 10127 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:19:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:19:38.971279+0000 mgr.smithi067.rdualw (mgr.24569) 10128 : audit [DBG] from='client.40894 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:19:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:19:39.626047+0000 mon.smithi061 (mon.0) 2147 : audit [DBG] from='client.? 172.21.15.61:0/2548040232' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:19:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:19:39.268474+0000 mgr.smithi067.rdualw (mgr.24569) 10129 : audit [DBG] from='client.40898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:19:41.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:39.894829+0000 mgr.smithi067.rdualw (mgr.24569) 10130 : cluster [DBG] pgmap v8723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:19:39.268474+0000 mgr.smithi067.rdualw (mgr.24569) 10129 : audit [DBG] from='client.40898 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:19:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:39.894829+0000 mgr.smithi067.rdualw (mgr.24569) 10130 : cluster [DBG] pgmap v8723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:41.895773+0000 mgr.smithi067.rdualw (mgr.24569) 10131 : cluster [DBG] pgmap v8724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:41.895773+0000 mgr.smithi067.rdualw (mgr.24569) 10131 : cluster [DBG] pgmap v8724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:43.896372+0000 mgr.smithi067.rdualw (mgr.24569) 10132 : cluster [DBG] pgmap v8725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:43.896372+0000 mgr.smithi067.rdualw (mgr.24569) 10132 : cluster [DBG] pgmap v8725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:45.897291+0000 mgr.smithi067.rdualw (mgr.24569) 10133 : cluster [DBG] pgmap v8726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:19:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:45.897291+0000 mgr.smithi067.rdualw (mgr.24569) 10133 : cluster [DBG] pgmap v8726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:19:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:47.897862+0000 mgr.smithi067.rdualw (mgr.24569) 10134 : cluster [DBG] pgmap v8727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:47.897862+0000 mgr.smithi067.rdualw (mgr.24569) 10134 : cluster [DBG] pgmap v8727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:50.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:49.898371+0000 mgr.smithi067.rdualw (mgr.24569) 10135 : cluster [DBG] pgmap v8728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:49.898371+0000 mgr.smithi067.rdualw (mgr.24569) 10135 : cluster [DBG] pgmap v8728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:51.899388+0000 mgr.smithi067.rdualw (mgr.24569) 10136 : cluster [DBG] pgmap v8729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:51.899388+0000 mgr.smithi067.rdualw (mgr.24569) 10136 : cluster [DBG] pgmap v8729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:53.900063+0000 mgr.smithi067.rdualw (mgr.24569) 10137 : cluster [DBG] pgmap v8730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:53.900063+0000 mgr.smithi067.rdualw (mgr.24569) 10137 : cluster [DBG] pgmap v8730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:55.900974+0000 mgr.smithi067.rdualw (mgr.24569) 10138 : cluster [DBG] pgmap v8731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:19:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:55.900974+0000 mgr.smithi067.rdualw (mgr.24569) 10138 : cluster [DBG] pgmap v8731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:19:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:19:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:57.901515+0000 mgr.smithi067.rdualw (mgr.24569) 10139 : cluster [DBG] pgmap v8732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:19:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:19:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:57.901515+0000 mgr.smithi067.rdualw (mgr.24569) 10139 : cluster [DBG] pgmap v8732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:19:59.902236+0000 mgr.smithi067.rdualw (mgr.24569) 10140 : cluster [DBG] pgmap v8733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:01.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:00.000103+0000 mon.smithi061 (mon.0) 2148 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T20:20:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:19:59.902236+0000 mgr.smithi067.rdualw (mgr.24569) 10140 : cluster [DBG] pgmap v8733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:01.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:00.000103+0000 mon.smithi061 (mon.0) 2148 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T20:20:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:01.903106+0000 mgr.smithi067.rdualw (mgr.24569) 10141 : cluster [DBG] pgmap v8734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:01.903106+0000 mgr.smithi067.rdualw (mgr.24569) 10141 : cluster [DBG] pgmap v8734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:03.903700+0000 mgr.smithi067.rdualw (mgr.24569) 10142 : cluster [DBG] pgmap v8735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:03.903700+0000 mgr.smithi067.rdualw (mgr.24569) 10142 : cluster [DBG] pgmap v8735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:05.904596+0000 mgr.smithi067.rdualw (mgr.24569) 10143 : cluster [DBG] pgmap v8736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:20:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:05.904596+0000 mgr.smithi067.rdualw (mgr.24569) 10143 : cluster [DBG] pgmap v8736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:20:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:07.905063+0000 mgr.smithi067.rdualw (mgr.24569) 10144 : cluster [DBG] pgmap v8737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:07.905063+0000 mgr.smithi067.rdualw (mgr.24569) 10144 : cluster [DBG] pgmap v8737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:09.933 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:20:10.226 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:20:10.227 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 3m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:20:10.227 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 3m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:20:10.227 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 3m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:20:10.227 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 3m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:20:10.227 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 3m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:20:10.228 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 3m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:20:10.228 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 3m ago 4h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:20:10.228 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 3m ago 4h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:20:10.228 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 3m ago 5h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:20:10.229 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 3m ago 4h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:20:10.229 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 3m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:20:10.229 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 3m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:20:10.229 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 3m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:20:10.230 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 3m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:20:10.230 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 3m ago 4h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:20:10.230 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 3m ago 4h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:20:10.230 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 3m ago 4h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:20:10.231 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 3m ago 4h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:20:10.231 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 3m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:20:10.231 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 3m ago 4h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:20:10.231 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 3m ago 4h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:20:10.231 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 3m ago 4h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:20:10.232 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 3m ago 4h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:20:10.604 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:20:10.605 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:20:10.605 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:20:10.605 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:20:10.605 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:20:10.606 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:20:10.606 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:20:10.606 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:20:10.606 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:20:10.606 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:20:10.607 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:20:10.607 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:20:10.607 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:20:10.607 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:20:10.608 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:20:10.608 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:20:10.608 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:20:10.608 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:20:10.608 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:20:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:09.905764+0000 mgr.smithi067.rdualw (mgr.24569) 10145 : cluster [DBG] pgmap v8738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:20:09.920110+0000 mgr.smithi067.rdualw (mgr.24569) 10146 : audit [DBG] from='client.40906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:20:11.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:20:10.603116+0000 mon.smithi061 (mon.0) 2149 : audit [DBG] from='client.? 172.21.15.61:0/688249814' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:20:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:09.905764+0000 mgr.smithi067.rdualw (mgr.24569) 10145 : cluster [DBG] pgmap v8738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:20:09.920110+0000 mgr.smithi067.rdualw (mgr.24569) 10146 : audit [DBG] from='client.40906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:20:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:20:10.603116+0000 mon.smithi061 (mon.0) 2149 : audit [DBG] from='client.? 172.21.15.61:0/688249814' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:20:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:20:10.208673+0000 mgr.smithi067.rdualw (mgr.24569) 10147 : audit [DBG] from='client.40910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:20:12.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:20:10.208673+0000 mgr.smithi067.rdualw (mgr.24569) 10147 : audit [DBG] from='client.40910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:20:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:11.906676+0000 mgr.smithi067.rdualw (mgr.24569) 10148 : cluster [DBG] pgmap v8739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:11.906676+0000 mgr.smithi067.rdualw (mgr.24569) 10148 : cluster [DBG] pgmap v8739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:13.907220+0000 mgr.smithi067.rdualw (mgr.24569) 10149 : cluster [DBG] pgmap v8740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:13.907220+0000 mgr.smithi067.rdualw (mgr.24569) 10149 : cluster [DBG] pgmap v8740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:15.908083+0000 mgr.smithi067.rdualw (mgr.24569) 10150 : cluster [DBG] pgmap v8741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:20:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:15.908083+0000 mgr.smithi067.rdualw (mgr.24569) 10150 : cluster [DBG] pgmap v8741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:20:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:17.908623+0000 mgr.smithi067.rdualw (mgr.24569) 10151 : cluster [DBG] pgmap v8742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:17.908623+0000 mgr.smithi067.rdualw (mgr.24569) 10151 : cluster [DBG] pgmap v8742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:19.909146+0000 mgr.smithi067.rdualw (mgr.24569) 10152 : cluster [DBG] pgmap v8743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:21.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:19.909146+0000 mgr.smithi067.rdualw (mgr.24569) 10152 : cluster [DBG] pgmap v8743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:21.910202+0000 mgr.smithi067.rdualw (mgr.24569) 10153 : cluster [DBG] pgmap v8744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:21.910202+0000 mgr.smithi067.rdualw (mgr.24569) 10153 : cluster [DBG] pgmap v8744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:23.910848+0000 mgr.smithi067.rdualw (mgr.24569) 10154 : cluster [DBG] pgmap v8745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:23.910848+0000 mgr.smithi067.rdualw (mgr.24569) 10154 : cluster [DBG] pgmap v8745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:27.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:25.911835+0000 mgr.smithi067.rdualw (mgr.24569) 10155 : cluster [DBG] pgmap v8746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:20:27.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:25.911835+0000 mgr.smithi067.rdualw (mgr.24569) 10155 : cluster [DBG] pgmap v8746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:20:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:27.912562+0000 mgr.smithi067.rdualw (mgr.24569) 10156 : cluster [DBG] pgmap v8747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:27.912562+0000 mgr.smithi067.rdualw (mgr.24569) 10156 : cluster [DBG] pgmap v8747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:29.913159+0000 mgr.smithi067.rdualw (mgr.24569) 10157 : cluster [DBG] pgmap v8748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:29.913159+0000 mgr.smithi067.rdualw (mgr.24569) 10157 : cluster [DBG] pgmap v8748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:31.914054+0000 mgr.smithi067.rdualw (mgr.24569) 10158 : cluster [DBG] pgmap v8749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:33.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:31.914054+0000 mgr.smithi067.rdualw (mgr.24569) 10158 : cluster [DBG] pgmap v8749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:33.914678+0000 mgr.smithi067.rdualw (mgr.24569) 10159 : cluster [DBG] pgmap v8750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:33.914678+0000 mgr.smithi067.rdualw (mgr.24569) 10159 : cluster [DBG] pgmap v8750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:35.915509+0000 mgr.smithi067.rdualw (mgr.24569) 10160 : cluster [DBG] pgmap v8751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:20:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:20:36.054761+0000 mon.smithi067 (mon.1) 1539 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:20:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:20:36.055093+0000 mon.smithi067 (mon.1) 1540 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:20:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:20:36.055415+0000 mon.smithi061 (mon.0) 2150 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:20:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:20:36.055668+0000 mon.smithi061 (mon.0) 2151 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:20:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:35.915509+0000 mgr.smithi067.rdualw (mgr.24569) 10160 : cluster [DBG] pgmap v8751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:20:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:20:36.054761+0000 mon.smithi067 (mon.1) 1539 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:20:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:20:36.055093+0000 mon.smithi067 (mon.1) 1540 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:20:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:20:36.055415+0000 mon.smithi061 (mon.0) 2150 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:20:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:20:36.055668+0000 mon.smithi061 (mon.0) 2151 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:20:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:37.916114+0000 mgr.smithi067.rdualw (mgr.24569) 10161 : cluster [DBG] pgmap v8752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:20:38.479463+0000 mon.smithi067 (mon.1) 1541 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:20:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:20:38.480880+0000 mon.smithi067 (mon.1) 1542 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:20:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:20:38.481787+0000 mon.smithi067 (mon.1) 1543 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:20:39.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:20:38.899438+0000 mon.smithi061 (mon.0) 2152 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:20:39.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:20:38.904835+0000 mon.smithi061 (mon.0) 2153 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:20:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:37.916114+0000 mgr.smithi067.rdualw (mgr.24569) 10161 : cluster [DBG] pgmap v8752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:20:38.479463+0000 mon.smithi067 (mon.1) 1541 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:20:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:20:38.480880+0000 mon.smithi067 (mon.1) 1542 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:20:39.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:20:38.481787+0000 mon.smithi067 (mon.1) 1543 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:20:39.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:20:38.899438+0000 mon.smithi061 (mon.0) 2152 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:20:39.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:20:38.904835+0000 mon.smithi061 (mon.0) 2153 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:20:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:20:38.482626+0000 mgr.smithi067.rdualw (mgr.24569) 10162 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:20:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:20:38.482626+0000 mgr.smithi067.rdualw (mgr.24569) 10162 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:20:40.911 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:20:41.218 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:20:41.218 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 4m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:20:41.218 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 4m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:20:41.219 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 4m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:20:41.219 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 4m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:20:41.219 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 4m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:20:41.219 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 4m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:20:41.220 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 4m ago 5h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:20:41.220 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 4m ago 4h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:20:41.220 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 4m ago 5h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:20:41.220 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 4m ago 4h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:20:41.220 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 4m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:20:41.221 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 4m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:20:41.221 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 4m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:20:41.221 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 4m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:20:41.221 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 4m ago 4h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:20:41.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 4m ago 4h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:20:41.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 4m ago 4h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:20:41.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 4m ago 4h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:20:41.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 4m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:20:41.223 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 4m ago 4h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:20:41.223 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 4m ago 4h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:20:41.223 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 4m ago 4h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:20:41.223 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 4m ago 4h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:20:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:39.917000+0000 mgr.smithi067.rdualw (mgr.24569) 10163 : cluster [DBG] pgmap v8753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:41.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:20:40.897329+0000 mgr.smithi067.rdualw (mgr.24569) 10164 : audit [DBG] from='client.40918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:20:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:39.917000+0000 mgr.smithi067.rdualw (mgr.24569) 10163 : cluster [DBG] pgmap v8753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:20:40.897329+0000 mgr.smithi067.rdualw (mgr.24569) 10164 : audit [DBG] from='client.40918 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:20:41.559 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:20:41.560 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:20:41.560 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:20:41.560 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:20:41.561 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:20:41.561 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:20:41.562 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:20:41.562 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:20:41.563 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:20:41.563 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:20:41.563 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:20:41.563 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:20:41.563 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:20:41.564 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:20:41.564 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:20:41.564 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:20:41.564 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:20:41.565 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:20:41.565 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:20:42.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:20:41.200377+0000 mgr.smithi067.rdualw (mgr.24569) 10165 : audit [DBG] from='client.40922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:20:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:20:41.558412+0000 mon.smithi061 (mon.0) 2154 : audit [DBG] from='client.? 172.21.15.61:0/3834866630' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:20:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:41.917810+0000 mgr.smithi067.rdualw (mgr.24569) 10166 : cluster [DBG] pgmap v8754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:20:41.200377+0000 mgr.smithi067.rdualw (mgr.24569) 10165 : audit [DBG] from='client.40922 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:20:42.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:20:41.558412+0000 mon.smithi061 (mon.0) 2154 : audit [DBG] from='client.? 172.21.15.61:0/3834866630' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:20:42.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:41.917810+0000 mgr.smithi067.rdualw (mgr.24569) 10166 : cluster [DBG] pgmap v8754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:43.918487+0000 mgr.smithi067.rdualw (mgr.24569) 10167 : cluster [DBG] pgmap v8755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:43.918487+0000 mgr.smithi067.rdualw (mgr.24569) 10167 : cluster [DBG] pgmap v8755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:45.919360+0000 mgr.smithi067.rdualw (mgr.24569) 10168 : cluster [DBG] pgmap v8756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:20:47.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:45.919360+0000 mgr.smithi067.rdualw (mgr.24569) 10168 : cluster [DBG] pgmap v8756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:20:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:47.919898+0000 mgr.smithi067.rdualw (mgr.24569) 10169 : cluster [DBG] pgmap v8757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:47.919898+0000 mgr.smithi067.rdualw (mgr.24569) 10169 : cluster [DBG] pgmap v8757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:49.920481+0000 mgr.smithi067.rdualw (mgr.24569) 10170 : cluster [DBG] pgmap v8758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:51.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:49.920481+0000 mgr.smithi067.rdualw (mgr.24569) 10170 : cluster [DBG] pgmap v8758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:51.921450+0000 mgr.smithi067.rdualw (mgr.24569) 10171 : cluster [DBG] pgmap v8759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:51.921450+0000 mgr.smithi067.rdualw (mgr.24569) 10171 : cluster [DBG] pgmap v8759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:53.922288+0000 mgr.smithi067.rdualw (mgr.24569) 10172 : cluster [DBG] pgmap v8760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:55.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:53.922288+0000 mgr.smithi067.rdualw (mgr.24569) 10172 : cluster [DBG] pgmap v8760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:55.923304+0000 mgr.smithi067.rdualw (mgr.24569) 10173 : cluster [DBG] pgmap v8761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:20:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:55.923304+0000 mgr.smithi067.rdualw (mgr.24569) 10173 : cluster [DBG] pgmap v8761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:20:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:20:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:57.923883+0000 mgr.smithi067.rdualw (mgr.24569) 10174 : cluster [DBG] pgmap v8762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:20:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:20:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:57.923883+0000 mgr.smithi067.rdualw (mgr.24569) 10174 : cluster [DBG] pgmap v8762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:01.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:20:59.924580+0000 mgr.smithi067.rdualw (mgr.24569) 10175 : cluster [DBG] pgmap v8763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:20:59.924580+0000 mgr.smithi067.rdualw (mgr.24569) 10175 : cluster [DBG] pgmap v8763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:01.925467+0000 mgr.smithi067.rdualw (mgr.24569) 10176 : cluster [DBG] pgmap v8764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:01.925467+0000 mgr.smithi067.rdualw (mgr.24569) 10176 : cluster [DBG] pgmap v8764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:03.926218+0000 mgr.smithi067.rdualw (mgr.24569) 10177 : cluster [DBG] pgmap v8765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:04.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:03.926218+0000 mgr.smithi067.rdualw (mgr.24569) 10177 : cluster [DBG] pgmap v8765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:05.927098+0000 mgr.smithi067.rdualw (mgr.24569) 10178 : cluster [DBG] pgmap v8766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:21:07.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:05.927098+0000 mgr.smithi067.rdualw (mgr.24569) 10178 : cluster [DBG] pgmap v8766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:21:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:07.927651+0000 mgr.smithi067.rdualw (mgr.24569) 10179 : cluster [DBG] pgmap v8767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:07.927651+0000 mgr.smithi067.rdualw (mgr.24569) 10179 : cluster [DBG] pgmap v8767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:09.928283+0000 mgr.smithi067.rdualw (mgr.24569) 10180 : cluster [DBG] pgmap v8768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:09.928283+0000 mgr.smithi067.rdualw (mgr.24569) 10180 : cluster [DBG] pgmap v8768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:11.875 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:21:12.167 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:21:12.168 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 4m ago 4h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:21:12.168 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 4m ago 4h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:21:12.168 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 4m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:21:12.168 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 4m ago 4h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:21:12.169 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 4m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:21:12.169 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 4m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:21:12.169 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 4m ago 5h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:21:12.169 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 4m ago 4h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:21:12.169 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 4m ago 5h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:21:12.170 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 4m ago 4h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:21:12.170 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 4m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:21:12.170 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 4m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:21:12.170 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (4h) 4m ago 4h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:21:12.171 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 4m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:21:12.171 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 4m ago 4h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:21:12.171 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 4m ago 4h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:21:12.171 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 4m ago 4h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:21:12.172 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 4m ago 4h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:21:12.172 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 4m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:21:12.172 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 4m ago 4h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:21:12.172 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 4m ago 4h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:21:12.172 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 4m ago 4h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:21:12.173 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 4m ago 4h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:21:12.509 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:21:12.509 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:21:12.510 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:21:12.510 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:21:12.510 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:21:12.510 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:21:12.511 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:21:12.511 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:21:12.511 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:21:12.511 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:21:12.511 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:21:12.512 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:21:12.512 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:21:12.512 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:21:12.512 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:21:12.513 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:21:12.513 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:21:12.513 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:21:12.513 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:21:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:21:11.861459+0000 mgr.smithi067.rdualw (mgr.24569) 10181 : audit [DBG] from='client.40930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:21:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:11.929160+0000 mgr.smithi067.rdualw (mgr.24569) 10182 : cluster [DBG] pgmap v8769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:21:12.507974+0000 mon.smithi061 (mon.0) 2155 : audit [DBG] from='client.? 172.21.15.61:0/2997251901' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:21:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:21:11.861459+0000 mgr.smithi067.rdualw (mgr.24569) 10181 : audit [DBG] from='client.40930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:21:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:11.929160+0000 mgr.smithi067.rdualw (mgr.24569) 10182 : cluster [DBG] pgmap v8769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:21:12.507974+0000 mon.smithi061 (mon.0) 2155 : audit [DBG] from='client.? 172.21.15.61:0/2997251901' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:21:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:21:12.149651+0000 mgr.smithi067.rdualw (mgr.24569) 10183 : audit [DBG] from='client.40934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:21:14.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:21:12.149651+0000 mgr.smithi067.rdualw (mgr.24569) 10183 : audit [DBG] from='client.40934 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:21:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:13.929786+0000 mgr.smithi067.rdualw (mgr.24569) 10184 : cluster [DBG] pgmap v8770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:13.929786+0000 mgr.smithi067.rdualw (mgr.24569) 10184 : cluster [DBG] pgmap v8770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:15.930659+0000 mgr.smithi067.rdualw (mgr.24569) 10185 : cluster [DBG] pgmap v8771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:21:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:15.930659+0000 mgr.smithi067.rdualw (mgr.24569) 10185 : cluster [DBG] pgmap v8771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:21:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:17.931287+0000 mgr.smithi067.rdualw (mgr.24569) 10186 : cluster [DBG] pgmap v8772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:17.931287+0000 mgr.smithi067.rdualw (mgr.24569) 10186 : cluster [DBG] pgmap v8772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:19.931912+0000 mgr.smithi067.rdualw (mgr.24569) 10187 : cluster [DBG] pgmap v8773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:19.931912+0000 mgr.smithi067.rdualw (mgr.24569) 10187 : cluster [DBG] pgmap v8773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:21.932746+0000 mgr.smithi067.rdualw (mgr.24569) 10188 : cluster [DBG] pgmap v8774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:21.932746+0000 mgr.smithi067.rdualw (mgr.24569) 10188 : cluster [DBG] pgmap v8774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:23.933529+0000 mgr.smithi067.rdualw (mgr.24569) 10189 : cluster [DBG] pgmap v8775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:25.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:23.933529+0000 mgr.smithi067.rdualw (mgr.24569) 10189 : cluster [DBG] pgmap v8775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:27.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:25.934402+0000 mgr.smithi067.rdualw (mgr.24569) 10190 : cluster [DBG] pgmap v8776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:21:27.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:25.934402+0000 mgr.smithi067.rdualw (mgr.24569) 10190 : cluster [DBG] pgmap v8776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:21:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:27.934901+0000 mgr.smithi067.rdualw (mgr.24569) 10191 : cluster [DBG] pgmap v8777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:27.934901+0000 mgr.smithi067.rdualw (mgr.24569) 10191 : cluster [DBG] pgmap v8777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:29.935627+0000 mgr.smithi067.rdualw (mgr.24569) 10192 : cluster [DBG] pgmap v8778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:31.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:29.935627+0000 mgr.smithi067.rdualw (mgr.24569) 10192 : cluster [DBG] pgmap v8778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:31.936465+0000 mgr.smithi067.rdualw (mgr.24569) 10193 : cluster [DBG] pgmap v8779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:31.936465+0000 mgr.smithi067.rdualw (mgr.24569) 10193 : cluster [DBG] pgmap v8779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:33.937142+0000 mgr.smithi067.rdualw (mgr.24569) 10194 : cluster [DBG] pgmap v8780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:33.937142+0000 mgr.smithi067.rdualw (mgr.24569) 10194 : cluster [DBG] pgmap v8780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:35.937972+0000 mgr.smithi067.rdualw (mgr.24569) 10195 : cluster [DBG] pgmap v8781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:21:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:21:36.060616+0000 mon.smithi067 (mon.1) 1544 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:21:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:21:36.060856+0000 mon.smithi067 (mon.1) 1545 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:21:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:21:36.061641+0000 mon.smithi061 (mon.0) 2156 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:21:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:21:36.062303+0000 mon.smithi061 (mon.0) 2157 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:21:37.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:35.937972+0000 mgr.smithi067.rdualw (mgr.24569) 10195 : cluster [DBG] pgmap v8781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:21:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:21:36.060616+0000 mon.smithi067 (mon.1) 1544 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:21:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:21:36.060856+0000 mon.smithi067 (mon.1) 1545 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:21:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:21:36.061641+0000 mon.smithi061 (mon.0) 2156 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:21:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:21:36.062303+0000 mon.smithi061 (mon.0) 2157 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:21:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:37.938434+0000 mgr.smithi067.rdualw (mgr.24569) 10196 : cluster [DBG] pgmap v8782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:21:38.907820+0000 mon.smithi067 (mon.1) 1546 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:21:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:21:38.909328+0000 mon.smithi067 (mon.1) 1547 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:21:39.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:21:38.910240+0000 mon.smithi067 (mon.1) 1548 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:21:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:37.938434+0000 mgr.smithi067.rdualw (mgr.24569) 10196 : cluster [DBG] pgmap v8782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:21:38.907820+0000 mon.smithi067 (mon.1) 1546 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:21:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:21:38.909328+0000 mon.smithi067 (mon.1) 1547 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:21:39.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:21:38.910240+0000 mon.smithi067 (mon.1) 1548 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:21:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:21:38.911075+0000 mgr.smithi067.rdualw (mgr.24569) 10197 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:21:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:21:39.327785+0000 mon.smithi061 (mon.0) 2158 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:21:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:21:39.333049+0000 mon.smithi061 (mon.0) 2159 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:21:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:21:38.911075+0000 mgr.smithi067.rdualw (mgr.24569) 10197 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:21:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:21:39.327785+0000 mon.smithi061 (mon.0) 2158 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:21:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:21:39.333049+0000 mon.smithi061 (mon.0) 2159 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:21:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:39.938970+0000 mgr.smithi067.rdualw (mgr.24569) 10198 : cluster [DBG] pgmap v8783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:39.938970+0000 mgr.smithi067.rdualw (mgr.24569) 10198 : cluster [DBG] pgmap v8783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:42.820 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:21:43.112 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:21:43.112 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 5m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:21:43.112 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 5m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:21:43.113 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 5m ago 4h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:21:43.113 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 5m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:21:43.113 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 5m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:21:43.113 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 5m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:21:43.114 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 5m ago 5h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:21:43.114 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 5m ago 4h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:21:43.114 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 5m ago 5h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:21:43.114 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 5m ago 4h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:21:43.115 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 5m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:21:43.115 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 5m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:21:43.115 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 5m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:21:43.115 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (4h) 5m ago 4h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:21:43.115 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 5m ago 4h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:21:43.116 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 5m ago 4h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:21:43.116 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 5m ago 4h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:21:43.116 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 5m ago 4h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:21:43.116 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 5m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:21:43.117 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 5m ago 4h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:21:43.117 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 5m ago 4h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:21:43.117 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 5m ago 4h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:21:43.117 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 5m ago 4h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:21:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:41.939901+0000 mgr.smithi067.rdualw (mgr.24569) 10199 : cluster [DBG] pgmap v8784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:41.939901+0000 mgr.smithi067.rdualw (mgr.24569) 10199 : cluster [DBG] pgmap v8784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:43.452 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:21:43.453 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:21:43.453 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:21:43.453 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:21:43.454 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:21:43.454 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:21:43.454 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:21:43.454 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:21:43.455 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:21:43.455 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:21:43.455 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:21:43.455 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:21:43.455 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:21:43.456 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:21:43.456 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:21:43.457 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:21:43.457 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:21:43.457 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:21:43.457 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:21:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:21:42.806973+0000 mgr.smithi067.rdualw (mgr.24569) 10200 : audit [DBG] from='client.40942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:21:44.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:21:43.451514+0000 mon.smithi061 (mon.0) 2160 : audit [DBG] from='client.? 172.21.15.61:0/323703287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:21:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:21:42.806973+0000 mgr.smithi067.rdualw (mgr.24569) 10200 : audit [DBG] from='client.40942 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:21:44.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:21:43.451514+0000 mon.smithi061 (mon.0) 2160 : audit [DBG] from='client.? 172.21.15.61:0/323703287' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:21:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:21:43.094062+0000 mgr.smithi067.rdualw (mgr.24569) 10201 : audit [DBG] from='client.40946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:21:45.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:43.940586+0000 mgr.smithi067.rdualw (mgr.24569) 10202 : cluster [DBG] pgmap v8785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:21:43.094062+0000 mgr.smithi067.rdualw (mgr.24569) 10201 : audit [DBG] from='client.40946 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:21:45.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:43.940586+0000 mgr.smithi067.rdualw (mgr.24569) 10202 : cluster [DBG] pgmap v8785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:45.941350+0000 mgr.smithi067.rdualw (mgr.24569) 10203 : cluster [DBG] pgmap v8786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:21:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:45.941350+0000 mgr.smithi067.rdualw (mgr.24569) 10203 : cluster [DBG] pgmap v8786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:21:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:47.941844+0000 mgr.smithi067.rdualw (mgr.24569) 10204 : cluster [DBG] pgmap v8787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:49.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:47.941844+0000 mgr.smithi067.rdualw (mgr.24569) 10204 : cluster [DBG] pgmap v8787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:49.942589+0000 mgr.smithi067.rdualw (mgr.24569) 10205 : cluster [DBG] pgmap v8788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:49.942589+0000 mgr.smithi067.rdualw (mgr.24569) 10205 : cluster [DBG] pgmap v8788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:51.943369+0000 mgr.smithi067.rdualw (mgr.24569) 10206 : cluster [DBG] pgmap v8789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:51.943369+0000 mgr.smithi067.rdualw (mgr.24569) 10206 : cluster [DBG] pgmap v8789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:53.944078+0000 mgr.smithi067.rdualw (mgr.24569) 10207 : cluster [DBG] pgmap v8790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:53.944078+0000 mgr.smithi067.rdualw (mgr.24569) 10207 : cluster [DBG] pgmap v8790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:55.945087+0000 mgr.smithi067.rdualw (mgr.24569) 10208 : cluster [DBG] pgmap v8791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:21:57.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:55.945087+0000 mgr.smithi067.rdualw (mgr.24569) 10208 : cluster [DBG] pgmap v8791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:21:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:21:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:57.945610+0000 mgr.smithi067.rdualw (mgr.24569) 10209 : cluster [DBG] pgmap v8792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:21:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:21:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:57.945610+0000 mgr.smithi067.rdualw (mgr.24569) 10209 : cluster [DBG] pgmap v8792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:21:59.946114+0000 mgr.smithi067.rdualw (mgr.24569) 10210 : cluster [DBG] pgmap v8793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:01.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:21:59.946114+0000 mgr.smithi067.rdualw (mgr.24569) 10210 : cluster [DBG] pgmap v8793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:01.947230+0000 mgr.smithi067.rdualw (mgr.24569) 10211 : cluster [DBG] pgmap v8794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:01.947230+0000 mgr.smithi067.rdualw (mgr.24569) 10211 : cluster [DBG] pgmap v8794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:03.947875+0000 mgr.smithi067.rdualw (mgr.24569) 10212 : cluster [DBG] pgmap v8795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:03.947875+0000 mgr.smithi067.rdualw (mgr.24569) 10212 : cluster [DBG] pgmap v8795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:05.948871+0000 mgr.smithi067.rdualw (mgr.24569) 10213 : cluster [DBG] pgmap v8796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:22:07.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:05.948871+0000 mgr.smithi067.rdualw (mgr.24569) 10213 : cluster [DBG] pgmap v8796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:22:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:07.949387+0000 mgr.smithi067.rdualw (mgr.24569) 10214 : cluster [DBG] pgmap v8797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:09.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:07.949387+0000 mgr.smithi067.rdualw (mgr.24569) 10214 : cluster [DBG] pgmap v8797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:09.949999+0000 mgr.smithi067.rdualw (mgr.24569) 10215 : cluster [DBG] pgmap v8798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:11.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:09.949999+0000 mgr.smithi067.rdualw (mgr.24569) 10215 : cluster [DBG] pgmap v8798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:11.951062+0000 mgr.smithi067.rdualw (mgr.24569) 10216 : cluster [DBG] pgmap v8799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:11.951062+0000 mgr.smithi067.rdualw (mgr.24569) 10216 : cluster [DBG] pgmap v8799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:13.764 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:22:14.055 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:22:14.055 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (4h) 5m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:22:14.056 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 5m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:22:14.056 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 5m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:22:14.056 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (4h) 5m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:22:14.056 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 5m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:22:14.056 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 5m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:22:14.057 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 5m ago 5h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:22:14.057 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 5m ago 5h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:22:14.057 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 5m ago 5h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:22:14.057 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 5m ago 5h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:22:14.058 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 5m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:22:14.058 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 5m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:22:14.058 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 5m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:22:14.058 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 5m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:22:14.059 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 5m ago 4h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:22:14.059 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 5m ago 4h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:22:14.059 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 5m ago 4h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:22:14.059 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 5m ago 4h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:22:14.059 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 5m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:22:14.060 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 5m ago 4h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:22:14.060 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 5m ago 4h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:22:14.060 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 5m ago 4h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:22:14.060 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (4h) 5m ago 5h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:22:14.396 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:22:14.397 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:22:14.397 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:22:14.397 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:22:14.397 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:22:14.398 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:22:14.398 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:22:14.398 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:22:14.398 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:22:14.398 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:22:14.399 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:22:14.399 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:22:14.399 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:22:14.399 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:22:14.400 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:22:14.400 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:22:14.400 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:22:14.400 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:22:14.401 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:22:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:22:13.750479+0000 mgr.smithi067.rdualw (mgr.24569) 10217 : audit [DBG] from='client.40954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:22:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:13.951620+0000 mgr.smithi067.rdualw (mgr.24569) 10218 : cluster [DBG] pgmap v8800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:15.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:22:14.395316+0000 mon.smithi061 (mon.0) 2161 : audit [DBG] from='client.? 172.21.15.61:0/3297978561' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:22:15.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:22:13.750479+0000 mgr.smithi067.rdualw (mgr.24569) 10217 : audit [DBG] from='client.40954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:22:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:13.951620+0000 mgr.smithi067.rdualw (mgr.24569) 10218 : cluster [DBG] pgmap v8800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:22:14.395316+0000 mon.smithi061 (mon.0) 2161 : audit [DBG] from='client.? 172.21.15.61:0/3297978561' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:22:16.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:22:14.037302+0000 mgr.smithi067.rdualw (mgr.24569) 10219 : audit [DBG] from='client.40958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:22:16.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:22:14.037302+0000 mgr.smithi067.rdualw (mgr.24569) 10219 : audit [DBG] from='client.40958 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:22:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:15.952384+0000 mgr.smithi067.rdualw (mgr.24569) 10220 : cluster [DBG] pgmap v8801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:22:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:15.952384+0000 mgr.smithi067.rdualw (mgr.24569) 10220 : cluster [DBG] pgmap v8801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:22:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:17.952938+0000 mgr.smithi067.rdualw (mgr.24569) 10221 : cluster [DBG] pgmap v8802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:19.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:17.952938+0000 mgr.smithi067.rdualw (mgr.24569) 10221 : cluster [DBG] pgmap v8802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:19.953610+0000 mgr.smithi067.rdualw (mgr.24569) 10222 : cluster [DBG] pgmap v8803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:21.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:19.953610+0000 mgr.smithi067.rdualw (mgr.24569) 10222 : cluster [DBG] pgmap v8803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:21.954549+0000 mgr.smithi067.rdualw (mgr.24569) 10223 : cluster [DBG] pgmap v8804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:21.954549+0000 mgr.smithi067.rdualw (mgr.24569) 10223 : cluster [DBG] pgmap v8804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:23.955365+0000 mgr.smithi067.rdualw (mgr.24569) 10224 : cluster [DBG] pgmap v8805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:23.955365+0000 mgr.smithi067.rdualw (mgr.24569) 10224 : cluster [DBG] pgmap v8805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:27.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:25.956340+0000 mgr.smithi067.rdualw (mgr.24569) 10225 : cluster [DBG] pgmap v8806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:22:27.406 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:25.956340+0000 mgr.smithi067.rdualw (mgr.24569) 10225 : cluster [DBG] pgmap v8806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:22:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:27.956926+0000 mgr.smithi067.rdualw (mgr.24569) 10226 : cluster [DBG] pgmap v8807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:29.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:27.956926+0000 mgr.smithi067.rdualw (mgr.24569) 10226 : cluster [DBG] pgmap v8807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:31.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:29.957691+0000 mgr.smithi067.rdualw (mgr.24569) 10227 : cluster [DBG] pgmap v8808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:31.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:29.957691+0000 mgr.smithi067.rdualw (mgr.24569) 10227 : cluster [DBG] pgmap v8808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:31.958713+0000 mgr.smithi067.rdualw (mgr.24569) 10228 : cluster [DBG] pgmap v8809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:31.958713+0000 mgr.smithi067.rdualw (mgr.24569) 10228 : cluster [DBG] pgmap v8809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:35.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:33.959497+0000 mgr.smithi067.rdualw (mgr.24569) 10229 : cluster [DBG] pgmap v8810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:35.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:33.959497+0000 mgr.smithi067.rdualw (mgr.24569) 10229 : cluster [DBG] pgmap v8810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:35.960528+0000 mgr.smithi067.rdualw (mgr.24569) 10230 : cluster [DBG] pgmap v8811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:22:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:22:36.065023+0000 mon.smithi067 (mon.1) 1549 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:22:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:22:36.065641+0000 mon.smithi061 (mon.0) 2162 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:22:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:22:36.066054+0000 mon.smithi067 (mon.1) 1550 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:22:37.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:22:36.066684+0000 mon.smithi061 (mon.0) 2163 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:22:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:35.960528+0000 mgr.smithi067.rdualw (mgr.24569) 10230 : cluster [DBG] pgmap v8811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:22:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:22:36.065023+0000 mon.smithi067 (mon.1) 1549 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:22:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:22:36.065641+0000 mon.smithi061 (mon.0) 2162 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:22:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:22:36.066054+0000 mon.smithi067 (mon.1) 1550 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:22:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:22:36.066684+0000 mon.smithi061 (mon.0) 2163 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:22:39.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:37.961141+0000 mgr.smithi067.rdualw (mgr.24569) 10231 : cluster [DBG] pgmap v8812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:39.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:37.961141+0000 mgr.smithi067.rdualw (mgr.24569) 10231 : cluster [DBG] pgmap v8812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:22:39.336233+0000 mon.smithi067 (mon.1) 1551 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:22:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:22:39.337655+0000 mon.smithi067 (mon.1) 1552 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:22:40.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:22:39.338614+0000 mon.smithi067 (mon.1) 1553 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:22:40.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:22:39.758592+0000 mon.smithi061 (mon.0) 2164 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:22:40.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:22:39.764005+0000 mon.smithi061 (mon.0) 2165 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:22:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:22:39.336233+0000 mon.smithi067 (mon.1) 1551 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:22:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:22:39.337655+0000 mon.smithi067 (mon.1) 1552 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:22:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:22:39.338614+0000 mon.smithi067 (mon.1) 1553 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:22:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:22:39.758592+0000 mon.smithi061 (mon.0) 2164 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:22:40.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:22:39.764005+0000 mon.smithi061 (mon.0) 2165 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:22:41.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:22:39.339474+0000 mgr.smithi067.rdualw (mgr.24569) 10232 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:22:41.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:39.961679+0000 mgr.smithi067.rdualw (mgr.24569) 10233 : cluster [DBG] pgmap v8813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:41.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:22:39.339474+0000 mgr.smithi067.rdualw (mgr.24569) 10232 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:22:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:39.961679+0000 mgr.smithi067.rdualw (mgr.24569) 10233 : cluster [DBG] pgmap v8813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:41.962695+0000 mgr.smithi067.rdualw (mgr.24569) 10234 : cluster [DBG] pgmap v8814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:41.962695+0000 mgr.smithi067.rdualw (mgr.24569) 10234 : cluster [DBG] pgmap v8814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:44.702 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:22:44.993 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:22:44.993 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 6m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:22:44.993 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 6m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:22:44.994 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 6m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:22:44.994 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 6m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:22:44.994 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 6m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:22:44.994 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 6m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:22:44.995 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 6m ago 5h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:22:44.995 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 6m ago 5h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:22:44.995 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 6m ago 5h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:22:44.995 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 6m ago 5h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:22:44.995 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 6m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:22:44.996 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 6m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:22:44.996 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 6m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:22:44.996 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 6m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:22:44.996 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 6m ago 5h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:22:44.997 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (4h) 6m ago 4h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:22:44.997 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (4h) 6m ago 4h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:22:44.997 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 6m ago 4h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:22:44.997 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 6m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:22:44.998 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 6m ago 4h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:22:44.998 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 6m ago 4h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:22:44.998 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 6m ago 4h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:22:44.998 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 6m ago 5h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:22:45.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:43.963248+0000 mgr.smithi067.rdualw (mgr.24569) 10235 : cluster [DBG] pgmap v8815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:45.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:43.963248+0000 mgr.smithi067.rdualw (mgr.24569) 10235 : cluster [DBG] pgmap v8815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:45.337 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:22:45.337 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:22:45.337 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:22:45.338 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:22:45.338 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:22:45.338 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:22:45.338 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:22:45.339 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:22:45.339 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:22:45.339 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:22:45.339 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:22:45.340 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:22:45.340 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:22:45.340 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:22:45.340 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:22:45.340 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:22:45.341 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:22:45.341 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:22:45.341 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:22:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:22:44.688788+0000 mgr.smithi067.rdualw (mgr.24569) 10236 : audit [DBG] from='client.40966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:22:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:22:44.975074+0000 mgr.smithi067.rdualw (mgr.24569) 10237 : audit [DBG] from='client.40970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:22:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:22:45.336136+0000 mon.smithi061 (mon.0) 2166 : audit [DBG] from='client.? 172.21.15.61:0/3120688299' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:22:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:22:44.688788+0000 mgr.smithi067.rdualw (mgr.24569) 10236 : audit [DBG] from='client.40966 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:22:46.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:22:44.975074+0000 mgr.smithi067.rdualw (mgr.24569) 10237 : audit [DBG] from='client.40970 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:22:46.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:22:45.336136+0000 mon.smithi061 (mon.0) 2166 : audit [DBG] from='client.? 172.21.15.61:0/3120688299' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:22:47.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:45.964241+0000 mgr.smithi067.rdualw (mgr.24569) 10238 : cluster [DBG] pgmap v8816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:22:47.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:45.964241+0000 mgr.smithi067.rdualw (mgr.24569) 10238 : cluster [DBG] pgmap v8816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:22:48.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:47.965009+0000 mgr.smithi067.rdualw (mgr.24569) 10239 : cluster [DBG] pgmap v8817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:47.965009+0000 mgr.smithi067.rdualw (mgr.24569) 10239 : cluster [DBG] pgmap v8817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:49.965623+0000 mgr.smithi067.rdualw (mgr.24569) 10240 : cluster [DBG] pgmap v8818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:49.965623+0000 mgr.smithi067.rdualw (mgr.24569) 10240 : cluster [DBG] pgmap v8818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:51.966439+0000 mgr.smithi067.rdualw (mgr.24569) 10241 : cluster [DBG] pgmap v8819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:51.966439+0000 mgr.smithi067.rdualw (mgr.24569) 10241 : cluster [DBG] pgmap v8819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:53.967121+0000 mgr.smithi067.rdualw (mgr.24569) 10242 : cluster [DBG] pgmap v8820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:53.967121+0000 mgr.smithi067.rdualw (mgr.24569) 10242 : cluster [DBG] pgmap v8820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:57.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:55.967983+0000 mgr.smithi067.rdualw (mgr.24569) 10243 : cluster [DBG] pgmap v8821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:22:57.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:55.967983+0000 mgr.smithi067.rdualw (mgr.24569) 10243 : cluster [DBG] pgmap v8821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:22:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:22:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:57.968597+0000 mgr.smithi067.rdualw (mgr.24569) 10244 : cluster [DBG] pgmap v8822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:22:59.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:22:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:57.968597+0000 mgr.smithi067.rdualw (mgr.24569) 10244 : cluster [DBG] pgmap v8822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:01.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:22:59.969117+0000 mgr.smithi067.rdualw (mgr.24569) 10245 : cluster [DBG] pgmap v8823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:01.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:22:59.969117+0000 mgr.smithi067.rdualw (mgr.24569) 10245 : cluster [DBG] pgmap v8823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:01.970087+0000 mgr.smithi067.rdualw (mgr.24569) 10246 : cluster [DBG] pgmap v8824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:01.970087+0000 mgr.smithi067.rdualw (mgr.24569) 10246 : cluster [DBG] pgmap v8824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:05.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:03.970801+0000 mgr.smithi067.rdualw (mgr.24569) 10247 : cluster [DBG] pgmap v8825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:05.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:03.970801+0000 mgr.smithi067.rdualw (mgr.24569) 10247 : cluster [DBG] pgmap v8825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:07.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:05.971660+0000 mgr.smithi067.rdualw (mgr.24569) 10248 : cluster [DBG] pgmap v8826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:23:07.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:05.971660+0000 mgr.smithi067.rdualw (mgr.24569) 10248 : cluster [DBG] pgmap v8826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:23:09.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:07.972296+0000 mgr.smithi067.rdualw (mgr.24569) 10249 : cluster [DBG] pgmap v8827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:09.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:07.972296+0000 mgr.smithi067.rdualw (mgr.24569) 10249 : cluster [DBG] pgmap v8827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:11.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:09.972881+0000 mgr.smithi067.rdualw (mgr.24569) 10250 : cluster [DBG] pgmap v8828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:11.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:09.972881+0000 mgr.smithi067.rdualw (mgr.24569) 10250 : cluster [DBG] pgmap v8828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:11.973687+0000 mgr.smithi067.rdualw (mgr.24569) 10251 : cluster [DBG] pgmap v8829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:11.973687+0000 mgr.smithi067.rdualw (mgr.24569) 10251 : cluster [DBG] pgmap v8829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:15.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:13.974374+0000 mgr.smithi067.rdualw (mgr.24569) 10252 : cluster [DBG] pgmap v8830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:15.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:13.974374+0000 mgr.smithi067.rdualw (mgr.24569) 10252 : cluster [DBG] pgmap v8830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:15.645 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:23:15.935 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:23:15.936 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 6m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:23:15.936 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 6m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:23:15.936 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 6m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:23:15.937 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 6m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:23:15.937 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 6m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:23:15.937 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 6m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:23:15.937 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 6m ago 5h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:23:15.937 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 6m ago 5h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:23:15.938 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 6m ago 5h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:23:15.938 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 6m ago 5h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:23:15.938 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 6m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:23:15.939 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 6m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:23:15.939 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 6m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:23:15.939 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 6m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:23:15.940 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 6m ago 5h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:23:15.940 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 6m ago 5h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:23:15.941 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 6m ago 5h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:23:15.941 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (4h) 6m ago 4h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:23:15.941 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (4h) 6m ago 4h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:23:15.941 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 6m ago 4h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:23:15.942 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 6m ago 4h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:23:15.942 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 6m ago 4h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:23:15.942 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 6m ago 5h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:23:16.278 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:23:16.278 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:23:16.279 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:23:16.279 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:23:16.279 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:23:16.279 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:23:16.280 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:23:16.280 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:23:16.280 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:23:16.280 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:23:16.281 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:23:16.281 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:23:16.281 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:23:16.281 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:23:16.281 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:23:16.282 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:23:16.282 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:23:16.282 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:23:16.282 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:23:17.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:23:15.629663+0000 mgr.smithi067.rdualw (mgr.24569) 10253 : audit [DBG] from='client.40978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:23:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:23:15.917427+0000 mgr.smithi067.rdualw (mgr.24569) 10254 : audit [DBG] from='client.40982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:23:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:15.975144+0000 mgr.smithi067.rdualw (mgr.24569) 10255 : cluster [DBG] pgmap v8831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:23:17.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:23:16.276892+0000 mon.smithi061 (mon.0) 2167 : audit [DBG] from='client.? 172.21.15.61:0/3179336409' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:23:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:23:15.629663+0000 mgr.smithi067.rdualw (mgr.24569) 10253 : audit [DBG] from='client.40978 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:23:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:23:15.917427+0000 mgr.smithi067.rdualw (mgr.24569) 10254 : audit [DBG] from='client.40982 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:23:17.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:15.975144+0000 mgr.smithi067.rdualw (mgr.24569) 10255 : cluster [DBG] pgmap v8831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:23:17.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:23:16.276892+0000 mon.smithi061 (mon.0) 2167 : audit [DBG] from='client.? 172.21.15.61:0/3179336409' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:23:19.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:17.975620+0000 mgr.smithi067.rdualw (mgr.24569) 10256 : cluster [DBG] pgmap v8832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:19.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:17.975620+0000 mgr.smithi067.rdualw (mgr.24569) 10256 : cluster [DBG] pgmap v8832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:21.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:19.976232+0000 mgr.smithi067.rdualw (mgr.24569) 10257 : cluster [DBG] pgmap v8833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:21.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:19.976232+0000 mgr.smithi067.rdualw (mgr.24569) 10257 : cluster [DBG] pgmap v8833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:21.977049+0000 mgr.smithi067.rdualw (mgr.24569) 10258 : cluster [DBG] pgmap v8834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:21.977049+0000 mgr.smithi067.rdualw (mgr.24569) 10258 : cluster [DBG] pgmap v8834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:23.977706+0000 mgr.smithi067.rdualw (mgr.24569) 10259 : cluster [DBG] pgmap v8835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:23.977706+0000 mgr.smithi067.rdualw (mgr.24569) 10259 : cluster [DBG] pgmap v8835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:25.978709+0000 mgr.smithi067.rdualw (mgr.24569) 10260 : cluster [DBG] pgmap v8836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:23:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:25.978709+0000 mgr.smithi067.rdualw (mgr.24569) 10260 : cluster [DBG] pgmap v8836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:23:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:27.979330+0000 mgr.smithi067.rdualw (mgr.24569) 10261 : cluster [DBG] pgmap v8837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:27.979330+0000 mgr.smithi067.rdualw (mgr.24569) 10261 : cluster [DBG] pgmap v8837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:29.979947+0000 mgr.smithi067.rdualw (mgr.24569) 10262 : cluster [DBG] pgmap v8838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:29.979947+0000 mgr.smithi067.rdualw (mgr.24569) 10262 : cluster [DBG] pgmap v8838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:31.980945+0000 mgr.smithi067.rdualw (mgr.24569) 10263 : cluster [DBG] pgmap v8839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:31.980945+0000 mgr.smithi067.rdualw (mgr.24569) 10263 : cluster [DBG] pgmap v8839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:33.981670+0000 mgr.smithi067.rdualw (mgr.24569) 10264 : cluster [DBG] pgmap v8840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:33.981670+0000 mgr.smithi067.rdualw (mgr.24569) 10264 : cluster [DBG] pgmap v8840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:35.982574+0000 mgr.smithi067.rdualw (mgr.24569) 10265 : cluster [DBG] pgmap v8841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:23:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:23:36.072238+0000 mon.smithi067 (mon.1) 1554 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:23:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:23:36.072614+0000 mon.smithi067 (mon.1) 1555 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:23:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:23:36.072890+0000 mon.smithi061 (mon.0) 2168 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:23:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:23:36.073130+0000 mon.smithi061 (mon.0) 2169 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:23:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:35.982574+0000 mgr.smithi067.rdualw (mgr.24569) 10265 : cluster [DBG] pgmap v8841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:23:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:23:36.072238+0000 mon.smithi067 (mon.1) 1554 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:23:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:23:36.072614+0000 mon.smithi067 (mon.1) 1555 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:23:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:23:36.072890+0000 mon.smithi061 (mon.0) 2168 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:23:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:23:36.073130+0000 mon.smithi061 (mon.0) 2169 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:23:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:37.982981+0000 mgr.smithi067.rdualw (mgr.24569) 10266 : cluster [DBG] pgmap v8842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:37.982981+0000 mgr.smithi067.rdualw (mgr.24569) 10266 : cluster [DBG] pgmap v8842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:23:39.767356+0000 mon.smithi067 (mon.1) 1556 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:23:40.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:23:39.768873+0000 mon.smithi067 (mon.1) 1557 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:23:40.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:23:39.769802+0000 mon.smithi067 (mon.1) 1558 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:23:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:23:39.767356+0000 mon.smithi067 (mon.1) 1556 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:23:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:23:39.768873+0000 mon.smithi067 (mon.1) 1557 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:23:40.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:23:39.769802+0000 mon.smithi067 (mon.1) 1558 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:23:41.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:23:39.770669+0000 mgr.smithi067.rdualw (mgr.24569) 10267 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:23:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:39.983487+0000 mgr.smithi067.rdualw (mgr.24569) 10268 : cluster [DBG] pgmap v8843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:23:40.185300+0000 mon.smithi061 (mon.0) 2170 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:23:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:23:40.193124+0000 mon.smithi061 (mon.0) 2171 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:23:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:23:39.770669+0000 mgr.smithi067.rdualw (mgr.24569) 10267 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:23:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:39.983487+0000 mgr.smithi067.rdualw (mgr.24569) 10268 : cluster [DBG] pgmap v8843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:41.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:23:40.185300+0000 mon.smithi061 (mon.0) 2170 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:23:41.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:23:40.193124+0000 mon.smithi061 (mon.0) 2171 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:23:43.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:41.984410+0000 mgr.smithi067.rdualw (mgr.24569) 10269 : cluster [DBG] pgmap v8844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:41.984410+0000 mgr.smithi067.rdualw (mgr.24569) 10269 : cluster [DBG] pgmap v8844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:43.985193+0000 mgr.smithi067.rdualw (mgr.24569) 10270 : cluster [DBG] pgmap v8845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:43.985193+0000 mgr.smithi067.rdualw (mgr.24569) 10270 : cluster [DBG] pgmap v8845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:45.986058+0000 mgr.smithi067.rdualw (mgr.24569) 10271 : cluster [DBG] pgmap v8846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:23:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:45.986058+0000 mgr.smithi067.rdualw (mgr.24569) 10271 : cluster [DBG] pgmap v8846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:23:46.651 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:23:46.941 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:23:46.941 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 7m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:23:46.941 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 7m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:23:46.942 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 7m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:23:46.942 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 7m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:23:46.942 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 7m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:23:46.942 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 7m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:23:46.943 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 7m ago 5h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:23:46.943 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 7m ago 5h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:23:46.943 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 7m ago 5h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:23:46.943 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 7m ago 5h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:23:46.943 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 7m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:23:46.944 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 7m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:23:46.944 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 7m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:23:46.944 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 7m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:23:46.944 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 7m ago 5h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:23:46.945 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 7m ago 5h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:23:46.945 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 7m ago 5h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:23:46.945 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 7m ago 5h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:23:46.945 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 7m ago 5h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:23:46.945 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (4h) 7m ago 4h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:23:46.946 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (4h) 7m ago 4h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:23:46.946 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 7m ago 4h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:23:46.946 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 7m ago 5h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:23:47.282 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:23:47.283 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:23:47.283 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:23:47.283 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:23:47.283 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:23:47.284 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:23:47.284 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:23:47.284 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:23:47.284 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:23:47.285 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:23:47.285 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:23:47.285 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:23:47.285 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:23:47.286 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:23:47.286 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:23:47.286 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:23:47.287 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:23:47.287 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:23:47.287 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:23:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:23:46.637608+0000 mgr.smithi067.rdualw (mgr.24569) 10272 : audit [DBG] from='client.40990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:23:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:23:46.922811+0000 mgr.smithi067.rdualw (mgr.24569) 10273 : audit [DBG] from='client.40994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:23:48.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:23:47.281119+0000 mon.smithi061 (mon.0) 2172 : audit [DBG] from='client.? 172.21.15.61:0/4003100406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:23:48.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:23:46.637608+0000 mgr.smithi067.rdualw (mgr.24569) 10272 : audit [DBG] from='client.40990 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:23:48.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:23:46.922811+0000 mgr.smithi067.rdualw (mgr.24569) 10273 : audit [DBG] from='client.40994 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:23:48.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:23:47.281119+0000 mon.smithi061 (mon.0) 2172 : audit [DBG] from='client.? 172.21.15.61:0/4003100406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:23:49.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:47.986576+0000 mgr.smithi067.rdualw (mgr.24569) 10274 : cluster [DBG] pgmap v8847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:49.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:47.986576+0000 mgr.smithi067.rdualw (mgr.24569) 10274 : cluster [DBG] pgmap v8847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:49.987262+0000 mgr.smithi067.rdualw (mgr.24569) 10275 : cluster [DBG] pgmap v8848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:50.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:49.987262+0000 mgr.smithi067.rdualw (mgr.24569) 10275 : cluster [DBG] pgmap v8848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:51.988224+0000 mgr.smithi067.rdualw (mgr.24569) 10276 : cluster [DBG] pgmap v8849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:51.988224+0000 mgr.smithi067.rdualw (mgr.24569) 10276 : cluster [DBG] pgmap v8849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:53.988882+0000 mgr.smithi067.rdualw (mgr.24569) 10277 : cluster [DBG] pgmap v8850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:53.988882+0000 mgr.smithi067.rdualw (mgr.24569) 10277 : cluster [DBG] pgmap v8850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:55.989774+0000 mgr.smithi067.rdualw (mgr.24569) 10278 : cluster [DBG] pgmap v8851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:23:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:55.989774+0000 mgr.smithi067.rdualw (mgr.24569) 10278 : cluster [DBG] pgmap v8851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:23:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:23:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:57.990467+0000 mgr.smithi067.rdualw (mgr.24569) 10279 : cluster [DBG] pgmap v8852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:23:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:23:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:57.990467+0000 mgr.smithi067.rdualw (mgr.24569) 10279 : cluster [DBG] pgmap v8852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:23:59.991285+0000 mgr.smithi067.rdualw (mgr.24569) 10280 : cluster [DBG] pgmap v8853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:23:59.991285+0000 mgr.smithi067.rdualw (mgr.24569) 10280 : cluster [DBG] pgmap v8853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:01.992138+0000 mgr.smithi067.rdualw (mgr.24569) 10281 : cluster [DBG] pgmap v8854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:03.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:01.992138+0000 mgr.smithi067.rdualw (mgr.24569) 10281 : cluster [DBG] pgmap v8854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:03.992751+0000 mgr.smithi067.rdualw (mgr.24569) 10282 : cluster [DBG] pgmap v8855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:03.992751+0000 mgr.smithi067.rdualw (mgr.24569) 10282 : cluster [DBG] pgmap v8855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:05.993595+0000 mgr.smithi067.rdualw (mgr.24569) 10283 : cluster [DBG] pgmap v8856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:24:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:05.993595+0000 mgr.smithi067.rdualw (mgr.24569) 10283 : cluster [DBG] pgmap v8856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:24:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:07.994135+0000 mgr.smithi067.rdualw (mgr.24569) 10284 : cluster [DBG] pgmap v8857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:07.994135+0000 mgr.smithi067.rdualw (mgr.24569) 10284 : cluster [DBG] pgmap v8857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:09.994833+0000 mgr.smithi067.rdualw (mgr.24569) 10285 : cluster [DBG] pgmap v8858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:09.994833+0000 mgr.smithi067.rdualw (mgr.24569) 10285 : cluster [DBG] pgmap v8858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:11.995810+0000 mgr.smithi067.rdualw (mgr.24569) 10286 : cluster [DBG] pgmap v8859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:11.995810+0000 mgr.smithi067.rdualw (mgr.24569) 10286 : cluster [DBG] pgmap v8859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:13.996372+0000 mgr.smithi067.rdualw (mgr.24569) 10287 : cluster [DBG] pgmap v8860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:13.996372+0000 mgr.smithi067.rdualw (mgr.24569) 10287 : cluster [DBG] pgmap v8860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:15.997186+0000 mgr.smithi067.rdualw (mgr.24569) 10288 : cluster [DBG] pgmap v8861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:24:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:15.997186+0000 mgr.smithi067.rdualw (mgr.24569) 10288 : cluster [DBG] pgmap v8861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:24:17.589 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:24:17.879 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:24:17.879 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 7m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:24:17.880 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 7m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:24:17.880 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 7m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:24:17.880 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 7m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:24:17.880 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 7m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:24:17.881 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 7m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:24:17.881 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 7m ago 5h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:24:17.881 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 7m ago 5h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:24:17.881 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 7m ago 5h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:24:17.882 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 7m ago 5h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:24:17.882 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 7m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:24:17.882 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 7m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:24:17.882 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 7m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:24:17.883 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 7m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:24:17.883 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 7m ago 5h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:24:17.883 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 7m ago 5h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:24:17.883 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 7m ago 5h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:24:17.883 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 7m ago 5h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:24:17.884 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 7m ago 5h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:24:17.884 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 7m ago 5h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:24:17.884 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 7m ago 5h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:24:17.884 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (4h) 7m ago 4h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:24:17.884 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 7m ago 5h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:24:18.222 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:24:18.222 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:24:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:24:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:24:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:24:18.223 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:24:18.224 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:24:18.224 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:24:18.224 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:24:18.224 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:24:18.224 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:24:18.225 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:24:18.225 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:24:18.225 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:24:18.225 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:24:18.226 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:24:18.226 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:24:18.226 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:24:18.226 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:24:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:24:17.576221+0000 mgr.smithi067.rdualw (mgr.24569) 10289 : audit [DBG] from='client.41002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:24:18.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:24:17.861750+0000 mgr.smithi067.rdualw (mgr.24569) 10290 : audit [DBG] from='client.41006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:24:18.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:17.997698+0000 mgr.smithi067.rdualw (mgr.24569) 10291 : cluster [DBG] pgmap v8862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:24:17.576221+0000 mgr.smithi067.rdualw (mgr.24569) 10289 : audit [DBG] from='client.41002 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:24:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:24:17.861750+0000 mgr.smithi067.rdualw (mgr.24569) 10290 : audit [DBG] from='client.41006 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:24:18.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:17.997698+0000 mgr.smithi067.rdualw (mgr.24569) 10291 : cluster [DBG] pgmap v8862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:19.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:24:18.220977+0000 mon.smithi061 (mon.0) 2173 : audit [DBG] from='client.? 172.21.15.61:0/3780923550' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:24:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:24:18.220977+0000 mon.smithi061 (mon.0) 2173 : audit [DBG] from='client.? 172.21.15.61:0/3780923550' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:24:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:19.998514+0000 mgr.smithi067.rdualw (mgr.24569) 10292 : cluster [DBG] pgmap v8863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:19.998514+0000 mgr.smithi067.rdualw (mgr.24569) 10292 : cluster [DBG] pgmap v8863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:21.999473+0000 mgr.smithi067.rdualw (mgr.24569) 10293 : cluster [DBG] pgmap v8864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:21.999473+0000 mgr.smithi067.rdualw (mgr.24569) 10293 : cluster [DBG] pgmap v8864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:24.000133+0000 mgr.smithi067.rdualw (mgr.24569) 10294 : cluster [DBG] pgmap v8865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:24.000133+0000 mgr.smithi067.rdualw (mgr.24569) 10294 : cluster [DBG] pgmap v8865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:26.000972+0000 mgr.smithi067.rdualw (mgr.24569) 10295 : cluster [DBG] pgmap v8866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:24:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:26.000972+0000 mgr.smithi067.rdualw (mgr.24569) 10295 : cluster [DBG] pgmap v8866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:24:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:28.001643+0000 mgr.smithi067.rdualw (mgr.24569) 10296 : cluster [DBG] pgmap v8867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:28.001643+0000 mgr.smithi067.rdualw (mgr.24569) 10296 : cluster [DBG] pgmap v8867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:30.002250+0000 mgr.smithi067.rdualw (mgr.24569) 10297 : cluster [DBG] pgmap v8868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:30.002250+0000 mgr.smithi067.rdualw (mgr.24569) 10297 : cluster [DBG] pgmap v8868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:32.003232+0000 mgr.smithi067.rdualw (mgr.24569) 10298 : cluster [DBG] pgmap v8869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:32.003232+0000 mgr.smithi067.rdualw (mgr.24569) 10298 : cluster [DBG] pgmap v8869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:34.003994+0000 mgr.smithi067.rdualw (mgr.24569) 10299 : cluster [DBG] pgmap v8870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:34.003994+0000 mgr.smithi067.rdualw (mgr.24569) 10299 : cluster [DBG] pgmap v8870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:36.004939+0000 mgr.smithi067.rdualw (mgr.24569) 10300 : cluster [DBG] pgmap v8871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:24:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:24:36.078381+0000 mon.smithi067 (mon.1) 1559 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:24:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:24:36.078757+0000 mon.smithi067 (mon.1) 1560 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:24:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:24:36.079004+0000 mon.smithi061 (mon.0) 2174 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:24:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:24:36.079350+0000 mon.smithi061 (mon.0) 2175 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:24:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:36.004939+0000 mgr.smithi067.rdualw (mgr.24569) 10300 : cluster [DBG] pgmap v8871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:24:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:24:36.078381+0000 mon.smithi067 (mon.1) 1559 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:24:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:24:36.078757+0000 mon.smithi067 (mon.1) 1560 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:24:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:24:36.079004+0000 mon.smithi061 (mon.0) 2174 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:24:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:24:36.079350+0000 mon.smithi061 (mon.0) 2175 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:24:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:38.005631+0000 mgr.smithi067.rdualw (mgr.24569) 10301 : cluster [DBG] pgmap v8872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:38.005631+0000 mgr.smithi067.rdualw (mgr.24569) 10301 : cluster [DBG] pgmap v8872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:40.006273+0000 mgr.smithi067.rdualw (mgr.24569) 10302 : cluster [DBG] pgmap v8873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:40.006273+0000 mgr.smithi067.rdualw (mgr.24569) 10302 : cluster [DBG] pgmap v8873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:41.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:24:40.196488+0000 mon.smithi067 (mon.1) 1561 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:24:41.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:24:40.197939+0000 mon.smithi067 (mon.1) 1562 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:24:41.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:24:40.198852+0000 mon.smithi067 (mon.1) 1563 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:24:41.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:24:40.199712+0000 mgr.smithi067.rdualw (mgr.24569) 10303 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:24:41.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:24:40.607682+0000 mon.smithi061 (mon.0) 2176 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:24:41.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:24:40.612870+0000 mon.smithi061 (mon.0) 2177 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:24:41.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:24:40.196488+0000 mon.smithi067 (mon.1) 1561 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:24:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:24:40.197939+0000 mon.smithi067 (mon.1) 1562 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:24:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:24:40.198852+0000 mon.smithi067 (mon.1) 1563 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:24:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:24:40.199712+0000 mgr.smithi067.rdualw (mgr.24569) 10303 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:24:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:24:40.607682+0000 mon.smithi061 (mon.0) 2176 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:24:41.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:24:40.612870+0000 mon.smithi061 (mon.0) 2177 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:24:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:42.007168+0000 mgr.smithi067.rdualw (mgr.24569) 10304 : cluster [DBG] pgmap v8874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:43.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:42.007168+0000 mgr.smithi067.rdualw (mgr.24569) 10304 : cluster [DBG] pgmap v8874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:44.007826+0000 mgr.smithi067.rdualw (mgr.24569) 10305 : cluster [DBG] pgmap v8875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:44.007826+0000 mgr.smithi067.rdualw (mgr.24569) 10305 : cluster [DBG] pgmap v8875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:46.008731+0000 mgr.smithi067.rdualw (mgr.24569) 10306 : cluster [DBG] pgmap v8876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:24:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:46.008731+0000 mgr.smithi067.rdualw (mgr.24569) 10306 : cluster [DBG] pgmap v8876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:24:48.531 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:24:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:48.009439+0000 mgr.smithi067.rdualw (mgr.24569) 10307 : cluster [DBG] pgmap v8877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:48.009439+0000 mgr.smithi067.rdualw (mgr.24569) 10307 : cluster [DBG] pgmap v8877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:48.819 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:24:48.820 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 8m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:24:48.820 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 8m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:24:48.820 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 8m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:24:48.821 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 8m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:24:48.821 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 8m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:24:48.821 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 8m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:24:48.821 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 8m ago 5h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:24:48.821 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 8m ago 5h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:24:48.822 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 8m ago 5h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:24:48.822 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 8m ago 5h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:24:48.822 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 8m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:24:48.822 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 8m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:24:48.823 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 8m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:24:48.823 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 8m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:24:48.823 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 8m ago 5h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:24:48.823 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 8m ago 5h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:24:48.824 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 8m ago 5h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:24:48.824 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 8m ago 5h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:24:48.824 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 8m ago 5h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:24:48.824 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 8m ago 5h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:24:48.825 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 8m ago 5h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:24:48.825 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 8m ago 5h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:24:48.825 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 8m ago 5h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:24:49.161 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:24:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:24:49.161 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:24:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:24:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:24:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:24:49.162 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:24:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:24:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:24:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:24:49.163 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:24:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:24:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:24:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:24:49.164 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:24:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:24:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:24:49.165 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:24:49.165 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:24:49.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:24:48.517104+0000 mgr.smithi067.rdualw (mgr.24569) 10308 : audit [DBG] from='client.41014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:24:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:24:48.802290+0000 mgr.smithi067.rdualw (mgr.24569) 10309 : audit [DBG] from='client.41018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:24:49.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:24:48.517104+0000 mgr.smithi067.rdualw (mgr.24569) 10308 : audit [DBG] from='client.41014 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:24:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:24:48.802290+0000 mgr.smithi067.rdualw (mgr.24569) 10309 : audit [DBG] from='client.41018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:24:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:24:49.159632+0000 mon.smithi061 (mon.0) 2178 : audit [DBG] from='client.? 172.21.15.61:0/3998244875' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:24:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:50.010005+0000 mgr.smithi067.rdualw (mgr.24569) 10310 : cluster [DBG] pgmap v8878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:24:49.159632+0000 mon.smithi061 (mon.0) 2178 : audit [DBG] from='client.? 172.21.15.61:0/3998244875' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:24:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:50.010005+0000 mgr.smithi067.rdualw (mgr.24569) 10310 : cluster [DBG] pgmap v8878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:52.010977+0000 mgr.smithi067.rdualw (mgr.24569) 10311 : cluster [DBG] pgmap v8879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:52.010977+0000 mgr.smithi067.rdualw (mgr.24569) 10311 : cluster [DBG] pgmap v8879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:54.011610+0000 mgr.smithi067.rdualw (mgr.24569) 10312 : cluster [DBG] pgmap v8880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:54.011610+0000 mgr.smithi067.rdualw (mgr.24569) 10312 : cluster [DBG] pgmap v8880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:56.012546+0000 mgr.smithi067.rdualw (mgr.24569) 10313 : cluster [DBG] pgmap v8881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:24:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:56.012546+0000 mgr.smithi067.rdualw (mgr.24569) 10313 : cluster [DBG] pgmap v8881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:24:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:24:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:24:58.013043+0000 mgr.smithi067.rdualw (mgr.24569) 10314 : cluster [DBG] pgmap v8882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:24:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:24:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:24:58.013043+0000 mgr.smithi067.rdualw (mgr.24569) 10314 : cluster [DBG] pgmap v8882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:00.013640+0000 mgr.smithi067.rdualw (mgr.24569) 10315 : cluster [DBG] pgmap v8883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:00.013640+0000 mgr.smithi067.rdualw (mgr.24569) 10315 : cluster [DBG] pgmap v8883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:02.014572+0000 mgr.smithi067.rdualw (mgr.24569) 10316 : cluster [DBG] pgmap v8884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:02.014572+0000 mgr.smithi067.rdualw (mgr.24569) 10316 : cluster [DBG] pgmap v8884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:04.015141+0000 mgr.smithi067.rdualw (mgr.24569) 10317 : cluster [DBG] pgmap v8885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:04.015141+0000 mgr.smithi067.rdualw (mgr.24569) 10317 : cluster [DBG] pgmap v8885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:06.016267+0000 mgr.smithi067.rdualw (mgr.24569) 10318 : cluster [DBG] pgmap v8886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:25:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:06.016267+0000 mgr.smithi067.rdualw (mgr.24569) 10318 : cluster [DBG] pgmap v8886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:25:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:08.016925+0000 mgr.smithi067.rdualw (mgr.24569) 10319 : cluster [DBG] pgmap v8887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:08.016925+0000 mgr.smithi067.rdualw (mgr.24569) 10319 : cluster [DBG] pgmap v8887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:10.017648+0000 mgr.smithi067.rdualw (mgr.24569) 10320 : cluster [DBG] pgmap v8888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:10.017648+0000 mgr.smithi067.rdualw (mgr.24569) 10320 : cluster [DBG] pgmap v8888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:12.018527+0000 mgr.smithi067.rdualw (mgr.24569) 10321 : cluster [DBG] pgmap v8889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:12.018527+0000 mgr.smithi067.rdualw (mgr.24569) 10321 : cluster [DBG] pgmap v8889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:14.019121+0000 mgr.smithi067.rdualw (mgr.24569) 10322 : cluster [DBG] pgmap v8890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:14.019121+0000 mgr.smithi067.rdualw (mgr.24569) 10322 : cluster [DBG] pgmap v8890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:16.019978+0000 mgr.smithi067.rdualw (mgr.24569) 10323 : cluster [DBG] pgmap v8891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:25:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:16.019978+0000 mgr.smithi067.rdualw (mgr.24569) 10323 : cluster [DBG] pgmap v8891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:25:18.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:18.020506+0000 mgr.smithi067.rdualw (mgr.24569) 10324 : cluster [DBG] pgmap v8892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:18.020506+0000 mgr.smithi067.rdualw (mgr.24569) 10324 : cluster [DBG] pgmap v8892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:19.467 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:25:19.758 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:25:19.758 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 8m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:25:19.758 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 8m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:25:19.759 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 8m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:25:19.759 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 8m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:25:19.759 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 8m ago 4h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:25:19.759 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 8m ago 4h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:25:19.760 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 8m ago 5h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:25:19.760 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 8m ago 5h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:25:19.760 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 8m ago 5h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:25:19.760 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 8m ago 5h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:25:19.760 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 8m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:25:19.761 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 8m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:25:19.761 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 8m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:25:19.761 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 8m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:25:19.761 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 8m ago 5h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:25:19.761 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 8m ago 5h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:25:19.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 8m ago 5h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:25:19.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 8m ago 5h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:25:19.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 8m ago 5h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:25:19.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 8m ago 5h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:25:19.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 8m ago 5h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:25:19.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 8m ago 5h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:25:19.763 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 8m ago 5h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:25:20.097 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:25:20.097 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:25:20.098 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:25:20.098 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:25:20.098 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:25:20.098 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:25:20.099 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:25:20.099 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:25:20.099 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:25:20.099 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:25:20.099 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:25:20.100 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:25:20.100 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:25:20.100 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:25:20.100 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:25:20.101 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:25:20.101 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:25:20.101 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:25:20.101 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:25:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:25:19.454209+0000 mgr.smithi067.rdualw (mgr.24569) 10325 : audit [DBG] from='client.41026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:25:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:25:19.740020+0000 mgr.smithi067.rdualw (mgr.24569) 10326 : audit [DBG] from='client.41030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:25:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:20.021264+0000 mgr.smithi067.rdualw (mgr.24569) 10327 : cluster [DBG] pgmap v8893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:25:19.454209+0000 mgr.smithi067.rdualw (mgr.24569) 10325 : audit [DBG] from='client.41026 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:25:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:25:19.740020+0000 mgr.smithi067.rdualw (mgr.24569) 10326 : audit [DBG] from='client.41030 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:25:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:20.021264+0000 mgr.smithi067.rdualw (mgr.24569) 10327 : cluster [DBG] pgmap v8893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:21.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:25:20.096015+0000 mon.smithi061 (mon.0) 2179 : audit [DBG] from='client.? 172.21.15.61:0/647133561' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:25:21.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:25:20.096015+0000 mon.smithi061 (mon.0) 2179 : audit [DBG] from='client.? 172.21.15.61:0/647133561' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:25:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:22.022164+0000 mgr.smithi067.rdualw (mgr.24569) 10328 : cluster [DBG] pgmap v8894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:23.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:22.022164+0000 mgr.smithi067.rdualw (mgr.24569) 10328 : cluster [DBG] pgmap v8894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:24.022989+0000 mgr.smithi067.rdualw (mgr.24569) 10329 : cluster [DBG] pgmap v8895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:24.022989+0000 mgr.smithi067.rdualw (mgr.24569) 10329 : cluster [DBG] pgmap v8895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:26.023826+0000 mgr.smithi067.rdualw (mgr.24569) 10330 : cluster [DBG] pgmap v8896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:25:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:26.023826+0000 mgr.smithi067.rdualw (mgr.24569) 10330 : cluster [DBG] pgmap v8896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:25:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:28.024441+0000 mgr.smithi067.rdualw (mgr.24569) 10331 : cluster [DBG] pgmap v8897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:28.024441+0000 mgr.smithi067.rdualw (mgr.24569) 10331 : cluster [DBG] pgmap v8897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:30.025149+0000 mgr.smithi067.rdualw (mgr.24569) 10332 : cluster [DBG] pgmap v8898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:30.025149+0000 mgr.smithi067.rdualw (mgr.24569) 10332 : cluster [DBG] pgmap v8898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:32.026014+0000 mgr.smithi067.rdualw (mgr.24569) 10333 : cluster [DBG] pgmap v8899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:32.026014+0000 mgr.smithi067.rdualw (mgr.24569) 10333 : cluster [DBG] pgmap v8899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:34.026754+0000 mgr.smithi067.rdualw (mgr.24569) 10334 : cluster [DBG] pgmap v8900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:34.026754+0000 mgr.smithi067.rdualw (mgr.24569) 10334 : cluster [DBG] pgmap v8900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:36.027478+0000 mgr.smithi067.rdualw (mgr.24569) 10335 : cluster [DBG] pgmap v8901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:25:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:25:36.085457+0000 mon.smithi067 (mon.1) 1564 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:25:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:25:36.085706+0000 mon.smithi067 (mon.1) 1565 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:25:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:25:36.086077+0000 mon.smithi061 (mon.0) 2180 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:25:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:25:36.086377+0000 mon.smithi061 (mon.0) 2181 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:25:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:36.027478+0000 mgr.smithi067.rdualw (mgr.24569) 10335 : cluster [DBG] pgmap v8901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:25:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:25:36.085457+0000 mon.smithi067 (mon.1) 1564 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:25:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:25:36.085706+0000 mon.smithi067 (mon.1) 1565 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:25:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:25:36.086077+0000 mon.smithi061 (mon.0) 2180 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:25:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:25:36.086377+0000 mon.smithi061 (mon.0) 2181 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:25:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:38.027972+0000 mgr.smithi067.rdualw (mgr.24569) 10336 : cluster [DBG] pgmap v8902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:38.027972+0000 mgr.smithi067.rdualw (mgr.24569) 10336 : cluster [DBG] pgmap v8902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:40.028576+0000 mgr.smithi067.rdualw (mgr.24569) 10337 : cluster [DBG] pgmap v8903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:40.028576+0000 mgr.smithi067.rdualw (mgr.24569) 10337 : cluster [DBG] pgmap v8903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:41.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:25:40.616075+0000 mon.smithi067 (mon.1) 1566 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:25:41.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:25:40.617485+0000 mon.smithi067 (mon.1) 1567 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:25:41.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:25:40.618411+0000 mon.smithi067 (mon.1) 1568 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:25:41.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:25:40.619270+0000 mgr.smithi067.rdualw (mgr.24569) 10338 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:25:41.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:25:41.032478+0000 mon.smithi061 (mon.0) 2182 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:25:41.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:25:41.038182+0000 mon.smithi061 (mon.0) 2183 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:25:41.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:25:40.616075+0000 mon.smithi067 (mon.1) 1566 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:25:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:25:40.617485+0000 mon.smithi067 (mon.1) 1567 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:25:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:25:40.618411+0000 mon.smithi067 (mon.1) 1568 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:25:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:25:40.619270+0000 mgr.smithi067.rdualw (mgr.24569) 10338 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:25:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:25:41.032478+0000 mon.smithi061 (mon.0) 2182 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:25:41.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:25:41.038182+0000 mon.smithi061 (mon.0) 2183 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:25:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:42.029496+0000 mgr.smithi067.rdualw (mgr.24569) 10339 : cluster [DBG] pgmap v8904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:42.029496+0000 mgr.smithi067.rdualw (mgr.24569) 10339 : cluster [DBG] pgmap v8904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:44.030081+0000 mgr.smithi067.rdualw (mgr.24569) 10340 : cluster [DBG] pgmap v8905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:44.030081+0000 mgr.smithi067.rdualw (mgr.24569) 10340 : cluster [DBG] pgmap v8905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:46.031018+0000 mgr.smithi067.rdualw (mgr.24569) 10341 : cluster [DBG] pgmap v8906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:25:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:46.031018+0000 mgr.smithi067.rdualw (mgr.24569) 10341 : cluster [DBG] pgmap v8906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:25:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:48.031595+0000 mgr.smithi067.rdualw (mgr.24569) 10342 : cluster [DBG] pgmap v8907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:48.031595+0000 mgr.smithi067.rdualw (mgr.24569) 10342 : cluster [DBG] pgmap v8907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:50.402 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:25:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:50.032281+0000 mgr.smithi067.rdualw (mgr.24569) 10343 : cluster [DBG] pgmap v8908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:50.032281+0000 mgr.smithi067.rdualw (mgr.24569) 10343 : cluster [DBG] pgmap v8908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:50.703 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:25:50.703 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 9m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:25:50.703 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 9m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:25:50.703 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 9m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:25:50.704 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 9m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:25:50.704 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 9m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:25:50.705 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 9m ago 5h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:25:50.705 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 9m ago 5h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:25:50.705 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 9m ago 5h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:25:50.705 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 9m ago 5h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:25:50.705 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 9m ago 5h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:25:50.706 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 9m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:25:50.706 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 9m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:25:50.706 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 9m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:25:50.706 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 9m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:25:50.707 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 9m ago 5h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:25:50.707 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 9m ago 5h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:25:50.707 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 9m ago 5h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:25:50.707 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 9m ago 5h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:25:50.707 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 9m ago 5h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:25:50.708 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 9m ago 5h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:25:50.708 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 9m ago 5h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:25:50.708 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 9m ago 5h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:25:50.709 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 9m ago 5h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:25:51.042 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:25:51.043 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:25:51.043 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:25:51.043 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:25:51.044 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:25:51.044 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:25:51.044 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:25:51.044 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:25:51.044 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:25:51.045 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:25:51.045 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:25:51.045 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:25:51.045 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:25:51.046 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:25:51.046 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:25:51.046 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:25:51.046 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:25:51.047 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:25:51.047 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:25:51.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:25:50.389341+0000 mgr.smithi067.rdualw (mgr.24569) 10344 : audit [DBG] from='client.41038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:25:51.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:25:50.685354+0000 mgr.smithi067.rdualw (mgr.24569) 10345 : audit [DBG] from='client.41042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:25:51.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:25:51.041183+0000 mon.smithi061 (mon.0) 2184 : audit [DBG] from='client.? 172.21.15.61:0/348876710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:25:51.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:25:50.389341+0000 mgr.smithi067.rdualw (mgr.24569) 10344 : audit [DBG] from='client.41038 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:25:51.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:25:50.685354+0000 mgr.smithi067.rdualw (mgr.24569) 10345 : audit [DBG] from='client.41042 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:25:51.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:25:51.041183+0000 mon.smithi061 (mon.0) 2184 : audit [DBG] from='client.? 172.21.15.61:0/348876710' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:25:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:52.033168+0000 mgr.smithi067.rdualw (mgr.24569) 10346 : cluster [DBG] pgmap v8909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:53.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:52.033168+0000 mgr.smithi067.rdualw (mgr.24569) 10346 : cluster [DBG] pgmap v8909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:54.033920+0000 mgr.smithi067.rdualw (mgr.24569) 10347 : cluster [DBG] pgmap v8910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:54.033920+0000 mgr.smithi067.rdualw (mgr.24569) 10347 : cluster [DBG] pgmap v8910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:56.035026+0000 mgr.smithi067.rdualw (mgr.24569) 10348 : cluster [DBG] pgmap v8911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:25:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:56.035026+0000 mgr.smithi067.rdualw (mgr.24569) 10348 : cluster [DBG] pgmap v8911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:25:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:25:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:25:58.035653+0000 mgr.smithi067.rdualw (mgr.24569) 10349 : cluster [DBG] pgmap v8912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:25:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:25:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:25:58.035653+0000 mgr.smithi067.rdualw (mgr.24569) 10349 : cluster [DBG] pgmap v8912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:00.036161+0000 mgr.smithi067.rdualw (mgr.24569) 10350 : cluster [DBG] pgmap v8913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:00.036161+0000 mgr.smithi067.rdualw (mgr.24569) 10350 : cluster [DBG] pgmap v8913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:02.037039+0000 mgr.smithi067.rdualw (mgr.24569) 10351 : cluster [DBG] pgmap v8914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:02.037039+0000 mgr.smithi067.rdualw (mgr.24569) 10351 : cluster [DBG] pgmap v8914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:04.037781+0000 mgr.smithi067.rdualw (mgr.24569) 10352 : cluster [DBG] pgmap v8915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:04.037781+0000 mgr.smithi067.rdualw (mgr.24569) 10352 : cluster [DBG] pgmap v8915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:06.038742+0000 mgr.smithi067.rdualw (mgr.24569) 10353 : cluster [DBG] pgmap v8916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:26:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:06.038742+0000 mgr.smithi067.rdualw (mgr.24569) 10353 : cluster [DBG] pgmap v8916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:26:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:08.039349+0000 mgr.smithi067.rdualw (mgr.24569) 10354 : cluster [DBG] pgmap v8917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:08.039349+0000 mgr.smithi067.rdualw (mgr.24569) 10354 : cluster [DBG] pgmap v8917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:10.040047+0000 mgr.smithi067.rdualw (mgr.24569) 10355 : cluster [DBG] pgmap v8918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:10.040047+0000 mgr.smithi067.rdualw (mgr.24569) 10355 : cluster [DBG] pgmap v8918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:13.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:12.041092+0000 mgr.smithi067.rdualw (mgr.24569) 10356 : cluster [DBG] pgmap v8919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:13.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:12.041092+0000 mgr.smithi067.rdualw (mgr.24569) 10356 : cluster [DBG] pgmap v8919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:14.041666+0000 mgr.smithi067.rdualw (mgr.24569) 10357 : cluster [DBG] pgmap v8920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:14.041666+0000 mgr.smithi067.rdualw (mgr.24569) 10357 : cluster [DBG] pgmap v8920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:16.042483+0000 mgr.smithi067.rdualw (mgr.24569) 10358 : cluster [DBG] pgmap v8921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:26:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:16.042483+0000 mgr.smithi067.rdualw (mgr.24569) 10358 : cluster [DBG] pgmap v8921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:26:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:18.043184+0000 mgr.smithi067.rdualw (mgr.24569) 10359 : cluster [DBG] pgmap v8922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:18.043184+0000 mgr.smithi067.rdualw (mgr.24569) 10359 : cluster [DBG] pgmap v8922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:20.043788+0000 mgr.smithi067.rdualw (mgr.24569) 10360 : cluster [DBG] pgmap v8923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:20.043788+0000 mgr.smithi067.rdualw (mgr.24569) 10360 : cluster [DBG] pgmap v8923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:21.350 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:26:21.642 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:26:21.642 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 9m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:26:21.643 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 9m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:26:21.643 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 9m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:26:21.643 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 9m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:26:21.643 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 9m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:26:21.644 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 9m ago 5h 24.9M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:26:21.644 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 9m ago 5h 485M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:26:21.644 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 9m ago 5h 636M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:26:21.644 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 9m ago 5h 1856M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:26:21.645 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 9m ago 5h 968M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:26:21.645 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 9m ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:26:21.645 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 9m ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:26:21.645 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 9m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:26:21.645 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 9m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:26:21.646 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 9m ago 5h 1204M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:26:21.646 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 9m ago 5h 2102M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:26:21.646 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 9m ago 5h 1320M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:26:21.647 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 9m ago 5h 2249M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:26:21.647 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 9m ago 5h 2074M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:26:21.647 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 9m ago 5h 2238M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:26:21.647 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 9m ago 5h 1828M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:26:21.648 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 9m ago 5h 2791M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:26:21.648 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 9m ago 5h 158M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:26:21.986 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:26:21.987 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:26:21.987 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:26:21.987 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:26:21.987 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:26:21.988 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:26:21.988 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:26:21.988 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:26:21.988 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:26:21.989 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:26:21.989 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:26:21.989 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:26:21.989 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:26:21.990 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:26:21.990 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:26:21.990 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:26:21.990 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:26:21.991 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:26:21.991 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:26:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:21.985323+0000 mon.smithi061 (mon.0) 2185 : audit [DBG] from='client.? 172.21.15.61:0/527567724' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:26:22.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:21.985323+0000 mon.smithi061 (mon.0) 2185 : audit [DBG] from='client.? 172.21.15.61:0/527567724' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:26:23.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:21.336208+0000 mgr.smithi067.rdualw (mgr.24569) 10361 : audit [DBG] from='client.41050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:26:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:21.623701+0000 mgr.smithi067.rdualw (mgr.24569) 10362 : audit [DBG] from='client.41054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:26:23.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:22.044694+0000 mgr.smithi067.rdualw (mgr.24569) 10363 : cluster [DBG] pgmap v8924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:23.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:21.336208+0000 mgr.smithi067.rdualw (mgr.24569) 10361 : audit [DBG] from='client.41050 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:26:23.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:21.623701+0000 mgr.smithi067.rdualw (mgr.24569) 10362 : audit [DBG] from='client.41054 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:26:23.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:22.044694+0000 mgr.smithi067.rdualw (mgr.24569) 10363 : cluster [DBG] pgmap v8924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:24.045391+0000 mgr.smithi067.rdualw (mgr.24569) 10364 : cluster [DBG] pgmap v8925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:24.045391+0000 mgr.smithi067.rdualw (mgr.24569) 10364 : cluster [DBG] pgmap v8925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:26.046239+0000 mgr.smithi067.rdualw (mgr.24569) 10365 : cluster [DBG] pgmap v8926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:26:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:26.046239+0000 mgr.smithi067.rdualw (mgr.24569) 10365 : cluster [DBG] pgmap v8926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:26:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:28.046904+0000 mgr.smithi067.rdualw (mgr.24569) 10366 : cluster [DBG] pgmap v8927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:28.046904+0000 mgr.smithi067.rdualw (mgr.24569) 10366 : cluster [DBG] pgmap v8927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:30.047621+0000 mgr.smithi067.rdualw (mgr.24569) 10367 : cluster [DBG] pgmap v8928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:30.047621+0000 mgr.smithi067.rdualw (mgr.24569) 10367 : cluster [DBG] pgmap v8928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:33.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:32.048410+0000 mgr.smithi067.rdualw (mgr.24569) 10368 : cluster [DBG] pgmap v8929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:33.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:32.048410+0000 mgr.smithi067.rdualw (mgr.24569) 10368 : cluster [DBG] pgmap v8929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:34.049108+0000 mgr.smithi067.rdualw (mgr.24569) 10369 : cluster [DBG] pgmap v8930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:34.049108+0000 mgr.smithi067.rdualw (mgr.24569) 10369 : cluster [DBG] pgmap v8930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:36.049963+0000 mgr.smithi067.rdualw (mgr.24569) 10370 : cluster [DBG] pgmap v8931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:26:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:36.091633+0000 mon.smithi067 (mon.1) 1569 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:26:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:36.091908+0000 mon.smithi067 (mon.1) 1570 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:26:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:36.092272+0000 mon.smithi061 (mon.0) 2186 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:26:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:36.092571+0000 mon.smithi061 (mon.0) 2187 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:26:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:36.049963+0000 mgr.smithi067.rdualw (mgr.24569) 10370 : cluster [DBG] pgmap v8931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:26:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:36.091633+0000 mon.smithi067 (mon.1) 1569 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:26:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:36.091908+0000 mon.smithi067 (mon.1) 1570 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:26:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:36.092272+0000 mon.smithi061 (mon.0) 2186 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:26:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:36.092571+0000 mon.smithi061 (mon.0) 2187 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:26:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:38.050450+0000 mgr.smithi067.rdualw (mgr.24569) 10371 : cluster [DBG] pgmap v8932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:38.050450+0000 mgr.smithi067.rdualw (mgr.24569) 10371 : cluster [DBG] pgmap v8932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:40.051141+0000 mgr.smithi067.rdualw (mgr.24569) 10372 : cluster [DBG] pgmap v8933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:40.051141+0000 mgr.smithi067.rdualw (mgr.24569) 10372 : cluster [DBG] pgmap v8933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:41.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:41.041392+0000 mon.smithi067 (mon.1) 1571 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:26:41.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:41.042901+0000 mon.smithi067 (mon.1) 1572 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:26:41.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:41.043821+0000 mon.smithi067 (mon.1) 1573 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:26:41.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:26:41.044656+0000 mgr.smithi067.rdualw (mgr.24569) 10373 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:26:41.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:41.041392+0000 mon.smithi067 (mon.1) 1571 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:26:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:41.042901+0000 mon.smithi067 (mon.1) 1572 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:26:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:41.043821+0000 mon.smithi067 (mon.1) 1573 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:26:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:26:41.044656+0000 mgr.smithi067.rdualw (mgr.24569) 10373 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:26:43.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:42.051921+0000 mgr.smithi067.rdualw (mgr.24569) 10374 : cluster [DBG] pgmap v8934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:43.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:42.051921+0000 mgr.smithi067.rdualw (mgr.24569) 10374 : cluster [DBG] pgmap v8934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:44.052405+0000 mgr.smithi067.rdualw (mgr.24569) 10375 : cluster [DBG] pgmap v8935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:44.052405+0000 mgr.smithi067.rdualw (mgr.24569) 10375 : cluster [DBG] pgmap v8935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:46.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:45.536116+0000 mon.smithi061 (mon.0) 2188 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:26:46.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:45.936332+0000 mon.smithi067 (mon.1) 1574 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:26:46.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:45.936954+0000 mon.smithi061 (mon.0) 2189 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:26:46.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:46.053127+0000 mgr.smithi067.rdualw (mgr.24569) 10376 : cluster [DBG] pgmap v8936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:26:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:45.536116+0000 mon.smithi061 (mon.0) 2188 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:26:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:45.936332+0000 mon.smithi067 (mon.1) 1574 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:26:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:45.936954+0000 mon.smithi061 (mon.0) 2189 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:26:46.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:46.053127+0000 mgr.smithi067.rdualw (mgr.24569) 10376 : cluster [DBG] pgmap v8936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:26:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:48.053631+0000 mgr.smithi067.rdualw (mgr.24569) 10377 : cluster [DBG] pgmap v8937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:48.053631+0000 mgr.smithi067.rdualw (mgr.24569) 10377 : cluster [DBG] pgmap v8937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:48.461173+0000 mon.smithi061 (mon.0) 2190 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:26:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:48.865923+0000 mon.smithi067 (mon.1) 1575 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:26:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:48.866715+0000 mon.smithi061 (mon.0) 2191 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:26:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:48.873886+0000 mon.smithi061 (mon.0) 2192 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:26:49.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:48.883201+0000 mon.smithi061 (mon.0) 2193 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:26:49.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:48.461173+0000 mon.smithi061 (mon.0) 2190 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:26:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:48.865923+0000 mon.smithi067 (mon.1) 1575 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:26:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:48.866715+0000 mon.smithi061 (mon.0) 2191 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:26:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:48.873886+0000 mon.smithi061 (mon.0) 2192 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:26:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:48.883201+0000 mon.smithi061 (mon.0) 2193 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:26:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:50.054253+0000 mgr.smithi067.rdualw (mgr.24569) 10378 : cluster [DBG] pgmap v8938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:50.054253+0000 mgr.smithi067.rdualw (mgr.24569) 10378 : cluster [DBG] pgmap v8938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:52.322 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:26:52.612 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:26:52.612 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 4s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:26:52.612 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 4s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:26:52.613 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 7s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:26:52.613 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 4s ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:26:52.613 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 4s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:26:52.613 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 7s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:26:52.614 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 4s ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:26:52.614 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 7s ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:26:52.614 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 4s ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:26:52.614 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 7s ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:26:52.615 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 4s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:26:52.615 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 7s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:26:52.615 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 4s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:26:52.615 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 7s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:26:52.615 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 4s ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:26:52.616 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 4s ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:26:52.616 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 4s ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:26:52.616 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 4s ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:26:52.616 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 7s ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:26:52.617 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 7s ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:26:52.617 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 7s ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:26:52.617 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 7s ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:26:52.618 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 4s ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:26:52.953 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:26:52.954 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:26:52.954 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:26:52.954 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:26:52.954 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:26:52.955 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:26:52.955 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:26:52.955 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:26:52.955 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:26:52.956 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:26:52.956 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:26:52.956 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:26:52.956 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:26:52.956 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:26:52.957 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:26:52.957 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:26:52.957 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:26:52.957 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:26:52.957 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:26:53.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:52.055170+0000 mgr.smithi067.rdualw (mgr.24569) 10379 : cluster [DBG] pgmap v8939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:53.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:52.951296+0000 mon.smithi061 (mon.0) 2194 : audit [DBG] from='client.? 172.21.15.61:0/3546450678' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:26:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:52.055170+0000 mgr.smithi067.rdualw (mgr.24569) 10379 : cluster [DBG] pgmap v8939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:53.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:52.951296+0000 mon.smithi061 (mon.0) 2194 : audit [DBG] from='client.? 172.21.15.61:0/3546450678' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:26:54.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:52.308417+0000 mgr.smithi067.rdualw (mgr.24569) 10380 : audit [DBG] from='client.41062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:26:54.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:26:52.594363+0000 mgr.smithi067.rdualw (mgr.24569) 10381 : audit [DBG] from='client.41066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:26:54.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:52.308417+0000 mgr.smithi067.rdualw (mgr.24569) 10380 : audit [DBG] from='client.41062 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:26:54.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:26:52.594363+0000 mgr.smithi067.rdualw (mgr.24569) 10381 : audit [DBG] from='client.41066 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:26:55.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:54.055905+0000 mgr.smithi067.rdualw (mgr.24569) 10382 : cluster [DBG] pgmap v8940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:55.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:54.055905+0000 mgr.smithi067.rdualw (mgr.24569) 10382 : cluster [DBG] pgmap v8940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:56.056734+0000 mgr.smithi067.rdualw (mgr.24569) 10383 : cluster [DBG] pgmap v8941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:26:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:56.056734+0000 mgr.smithi067.rdualw (mgr.24569) 10383 : cluster [DBG] pgmap v8941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:26:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:26:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:26:58.057275+0000 mgr.smithi067.rdualw (mgr.24569) 10384 : cluster [DBG] pgmap v8942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:26:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:26:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:26:58.057275+0000 mgr.smithi067.rdualw (mgr.24569) 10384 : cluster [DBG] pgmap v8942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:00.057909+0000 mgr.smithi067.rdualw (mgr.24569) 10385 : cluster [DBG] pgmap v8943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:00.057909+0000 mgr.smithi067.rdualw (mgr.24569) 10385 : cluster [DBG] pgmap v8943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:03.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:02.058804+0000 mgr.smithi067.rdualw (mgr.24569) 10386 : cluster [DBG] pgmap v8944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:03.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:02.058804+0000 mgr.smithi067.rdualw (mgr.24569) 10386 : cluster [DBG] pgmap v8944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:04.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:04.059397+0000 mgr.smithi067.rdualw (mgr.24569) 10387 : cluster [DBG] pgmap v8945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:04.059397+0000 mgr.smithi067.rdualw (mgr.24569) 10387 : cluster [DBG] pgmap v8945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:06.060316+0000 mgr.smithi067.rdualw (mgr.24569) 10388 : cluster [DBG] pgmap v8946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:27:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:06.060316+0000 mgr.smithi067.rdualw (mgr.24569) 10388 : cluster [DBG] pgmap v8946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:27:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:08.060934+0000 mgr.smithi067.rdualw (mgr.24569) 10389 : cluster [DBG] pgmap v8947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:08.060934+0000 mgr.smithi067.rdualw (mgr.24569) 10389 : cluster [DBG] pgmap v8947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:10.061736+0000 mgr.smithi067.rdualw (mgr.24569) 10390 : cluster [DBG] pgmap v8948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:10.061736+0000 mgr.smithi067.rdualw (mgr.24569) 10390 : cluster [DBG] pgmap v8948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:13.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:12.062638+0000 mgr.smithi067.rdualw (mgr.24569) 10391 : cluster [DBG] pgmap v8949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:13.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:12.062638+0000 mgr.smithi067.rdualw (mgr.24569) 10391 : cluster [DBG] pgmap v8949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:14.063185+0000 mgr.smithi067.rdualw (mgr.24569) 10392 : cluster [DBG] pgmap v8950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:14.063185+0000 mgr.smithi067.rdualw (mgr.24569) 10392 : cluster [DBG] pgmap v8950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:16.063934+0000 mgr.smithi067.rdualw (mgr.24569) 10393 : cluster [DBG] pgmap v8951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:27:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:16.063934+0000 mgr.smithi067.rdualw (mgr.24569) 10393 : cluster [DBG] pgmap v8951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:27:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:18.064387+0000 mgr.smithi067.rdualw (mgr.24569) 10394 : cluster [DBG] pgmap v8952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:18.064387+0000 mgr.smithi067.rdualw (mgr.24569) 10394 : cluster [DBG] pgmap v8952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:20.065014+0000 mgr.smithi067.rdualw (mgr.24569) 10395 : cluster [DBG] pgmap v8953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:20.065014+0000 mgr.smithi067.rdualw (mgr.24569) 10395 : cluster [DBG] pgmap v8953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:23.258 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:27:23.551 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:27:23.552 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 35s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:27:23.552 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 35s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:27:23.552 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 38s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:27:23.553 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 35s ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:27:23.553 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 35s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:27:23.553 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 38s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:27:23.553 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 35s ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:27:23.554 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 38s ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:27:23.554 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 35s ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:27:23.554 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 38s ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:27:23.554 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 35s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:27:23.555 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 38s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:27:23.555 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 35s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:27:23.555 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 38s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:27:23.556 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 35s ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:27:23.557 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 35s ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:27:23.557 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 35s ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:27:23.557 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 35s ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:27:23.557 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 38s ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:27:23.558 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 38s ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:27:23.558 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 38s ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:27:23.558 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 38s ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:27:23.558 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 35s ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:27:23.891 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:27:23.892 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:27:23.892 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:27:23.892 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:27:23.892 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:27:23.893 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:27:23.893 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:27:23.893 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:27:23.893 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:27:23.893 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:27:23.894 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:27:23.894 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:27:23.894 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:27:23.894 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:27:23.895 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:27:23.895 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:27:23.895 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:27:23.895 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:27:23.895 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:27:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:22.065917+0000 mgr.smithi067.rdualw (mgr.24569) 10396 : cluster [DBG] pgmap v8954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:24.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:27:23.890158+0000 mon.smithi061 (mon.0) 2195 : audit [DBG] from='client.? 172.21.15.61:0/2916626163' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:27:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:22.065917+0000 mgr.smithi067.rdualw (mgr.24569) 10396 : cluster [DBG] pgmap v8954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:27:23.890158+0000 mon.smithi061 (mon.0) 2195 : audit [DBG] from='client.? 172.21.15.61:0/2916626163' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:27:25.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:27:23.244862+0000 mgr.smithi067.rdualw (mgr.24569) 10397 : audit [DBG] from='client.41074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:27:25.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:27:23.533150+0000 mgr.smithi067.rdualw (mgr.24569) 10398 : audit [DBG] from='client.41078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:27:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:27:23.244862+0000 mgr.smithi067.rdualw (mgr.24569) 10397 : audit [DBG] from='client.41074 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:27:25.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:27:23.533150+0000 mgr.smithi067.rdualw (mgr.24569) 10398 : audit [DBG] from='client.41078 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:27:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:24.066454+0000 mgr.smithi067.rdualw (mgr.24569) 10399 : cluster [DBG] pgmap v8955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:24.066454+0000 mgr.smithi067.rdualw (mgr.24569) 10399 : cluster [DBG] pgmap v8955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:26.067257+0000 mgr.smithi067.rdualw (mgr.24569) 10400 : cluster [DBG] pgmap v8956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:27:28.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:26.067257+0000 mgr.smithi067.rdualw (mgr.24569) 10400 : cluster [DBG] pgmap v8956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:27:30.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:28.067826+0000 mgr.smithi067.rdualw (mgr.24569) 10401 : cluster [DBG] pgmap v8957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:28.067826+0000 mgr.smithi067.rdualw (mgr.24569) 10401 : cluster [DBG] pgmap v8957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:30.068657+0000 mgr.smithi067.rdualw (mgr.24569) 10402 : cluster [DBG] pgmap v8958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:32.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:30.068657+0000 mgr.smithi067.rdualw (mgr.24569) 10402 : cluster [DBG] pgmap v8958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:34.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:32.069696+0000 mgr.smithi067.rdualw (mgr.24569) 10403 : cluster [DBG] pgmap v8959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:32.069696+0000 mgr.smithi067.rdualw (mgr.24569) 10403 : cluster [DBG] pgmap v8959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:34.070250+0000 mgr.smithi067.rdualw (mgr.24569) 10404 : cluster [DBG] pgmap v8960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:36.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:34.070250+0000 mgr.smithi067.rdualw (mgr.24569) 10404 : cluster [DBG] pgmap v8960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:27:36.096862+0000 mon.smithi067 (mon.1) 1576 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:27:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:27:36.097197+0000 mon.smithi067 (mon.1) 1577 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:27:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:27:36.097429+0000 mon.smithi061 (mon.0) 2196 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:27:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:27:36.097794+0000 mon.smithi061 (mon.0) 2197 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:27:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:27:36.096862+0000 mon.smithi067 (mon.1) 1576 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:27:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:27:36.097197+0000 mon.smithi067 (mon.1) 1577 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:27:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:27:36.097429+0000 mon.smithi061 (mon.0) 2196 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:27:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:27:36.097794+0000 mon.smithi061 (mon.0) 2197 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:27:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:36.071277+0000 mgr.smithi067.rdualw (mgr.24569) 10405 : cluster [DBG] pgmap v8961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:27:38.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:36.071277+0000 mgr.smithi067.rdualw (mgr.24569) 10405 : cluster [DBG] pgmap v8961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:27:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:38.071936+0000 mgr.smithi067.rdualw (mgr.24569) 10406 : cluster [DBG] pgmap v8962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:38.071936+0000 mgr.smithi067.rdualw (mgr.24569) 10406 : cluster [DBG] pgmap v8962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:42.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:40.072648+0000 mgr.smithi067.rdualw (mgr.24569) 10407 : cluster [DBG] pgmap v8963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:40.072648+0000 mgr.smithi067.rdualw (mgr.24569) 10407 : cluster [DBG] pgmap v8963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:44.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:42.073707+0000 mgr.smithi067.rdualw (mgr.24569) 10408 : cluster [DBG] pgmap v8964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:42.073707+0000 mgr.smithi067.rdualw (mgr.24569) 10408 : cluster [DBG] pgmap v8964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:46.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:44.074281+0000 mgr.smithi067.rdualw (mgr.24569) 10409 : cluster [DBG] pgmap v8965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:44.074281+0000 mgr.smithi067.rdualw (mgr.24569) 10409 : cluster [DBG] pgmap v8965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:48.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:46.075134+0000 mgr.smithi067.rdualw (mgr.24569) 10410 : cluster [DBG] pgmap v8966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:27:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:46.075134+0000 mgr.smithi067.rdualw (mgr.24569) 10410 : cluster [DBG] pgmap v8966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:27:49.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:27:48.887633+0000 mon.smithi067 (mon.1) 1578 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:27:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:27:48.889166+0000 mon.smithi067 (mon.1) 1579 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:27:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:27:48.890092+0000 mon.smithi067 (mon.1) 1580 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:27:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:27:48.887633+0000 mon.smithi067 (mon.1) 1578 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:27:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:27:48.889166+0000 mon.smithi067 (mon.1) 1579 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:27:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:27:48.890092+0000 mon.smithi067 (mon.1) 1580 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:27:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:48.075805+0000 mgr.smithi067.rdualw (mgr.24569) 10411 : cluster [DBG] pgmap v8967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:27:48.890945+0000 mgr.smithi067.rdualw (mgr.24569) 10412 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:27:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:27:49.311914+0000 mon.smithi061 (mon.0) 2198 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:27:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:27:49.321845+0000 mon.smithi061 (mon.0) 2199 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:27:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:48.075805+0000 mgr.smithi067.rdualw (mgr.24569) 10411 : cluster [DBG] pgmap v8967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:27:48.890945+0000 mgr.smithi067.rdualw (mgr.24569) 10412 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:27:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:27:49.311914+0000 mon.smithi061 (mon.0) 2198 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:27:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:27:49.321845+0000 mon.smithi061 (mon.0) 2199 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:27:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:50.076401+0000 mgr.smithi067.rdualw (mgr.24569) 10413 : cluster [DBG] pgmap v8968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:50.076401+0000 mgr.smithi067.rdualw (mgr.24569) 10413 : cluster [DBG] pgmap v8968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:53.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:52.077287+0000 mgr.smithi067.rdualw (mgr.24569) 10414 : cluster [DBG] pgmap v8969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:53.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:52.077287+0000 mgr.smithi067.rdualw (mgr.24569) 10414 : cluster [DBG] pgmap v8969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:54.200 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:27:54.497 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:27:54.497 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 66s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:27:54.497 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 66s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:27:54.498 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 68s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:27:54.498 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 66s ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:27:54.498 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 66s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:27:54.499 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 68s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:27:54.499 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (4h) 66s ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:27:54.499 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 68s ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:27:54.500 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 66s ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:27:54.500 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 68s ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:27:54.500 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (4h) 66s ago 4h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:27:54.500 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (4h) 68s ago 4h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:27:54.500 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 66s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:27:54.501 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 68s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:27:54.501 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 66s ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:27:54.501 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 66s ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:27:54.501 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 66s ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:27:54.502 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 66s ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:27:54.502 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 68s ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:27:54.502 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 68s ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:27:54.502 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 68s ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:27:54.502 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 68s ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:27:54.503 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 66s ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:27:54.836 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:27:54.837 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:27:54.837 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:27:54.837 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:27:54.837 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:27:54.838 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:27:54.838 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:27:54.838 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:27:54.838 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:27:54.839 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:27:54.839 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:27:54.839 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:27:54.839 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:27:54.840 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:27:54.840 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:27:54.840 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:27:54.840 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:27:54.841 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:27:54.841 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:27:55.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:54.078052+0000 mgr.smithi067.rdualw (mgr.24569) 10415 : cluster [DBG] pgmap v8970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:27:54.186918+0000 mgr.smithi067.rdualw (mgr.24569) 10416 : audit [DBG] from='client.41086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:27:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:27:54.479186+0000 mgr.smithi067.rdualw (mgr.24569) 10417 : audit [DBG] from='client.41090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:27:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:27:54.835156+0000 mon.smithi061 (mon.0) 2200 : audit [DBG] from='client.? 172.21.15.61:0/1821489164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:27:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:54.078052+0000 mgr.smithi067.rdualw (mgr.24569) 10415 : cluster [DBG] pgmap v8970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:27:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:27:54.186918+0000 mgr.smithi067.rdualw (mgr.24569) 10416 : audit [DBG] from='client.41086 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:27:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:27:54.479186+0000 mgr.smithi067.rdualw (mgr.24569) 10417 : audit [DBG] from='client.41090 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:27:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:27:54.835156+0000 mon.smithi061 (mon.0) 2200 : audit [DBG] from='client.? 172.21.15.61:0/1821489164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:27:58.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:27:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:56.078881+0000 mgr.smithi067.rdualw (mgr.24569) 10418 : cluster [DBG] pgmap v8971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:27:58.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:27:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:56.078881+0000 mgr.smithi067.rdualw (mgr.24569) 10418 : cluster [DBG] pgmap v8971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:28:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:27:58.079523+0000 mgr.smithi067.rdualw (mgr.24569) 10419 : cluster [DBG] pgmap v8972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:27:58.079523+0000 mgr.smithi067.rdualw (mgr.24569) 10419 : cluster [DBG] pgmap v8972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:00.080289+0000 mgr.smithi067.rdualw (mgr.24569) 10420 : cluster [DBG] pgmap v8973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:02.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:00.080289+0000 mgr.smithi067.rdualw (mgr.24569) 10420 : cluster [DBG] pgmap v8973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:02.081174+0000 mgr.smithi067.rdualw (mgr.24569) 10421 : cluster [DBG] pgmap v8974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:04.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:02.081174+0000 mgr.smithi067.rdualw (mgr.24569) 10421 : cluster [DBG] pgmap v8974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:06.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:04.081802+0000 mgr.smithi067.rdualw (mgr.24569) 10422 : cluster [DBG] pgmap v8975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:06.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:04.081802+0000 mgr.smithi067.rdualw (mgr.24569) 10422 : cluster [DBG] pgmap v8975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:08.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:06.082621+0000 mgr.smithi067.rdualw (mgr.24569) 10423 : cluster [DBG] pgmap v8976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:28:08.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:06.082621+0000 mgr.smithi067.rdualw (mgr.24569) 10423 : cluster [DBG] pgmap v8976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:28:10.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:08.083309+0000 mgr.smithi067.rdualw (mgr.24569) 10424 : cluster [DBG] pgmap v8977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:10.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:08.083309+0000 mgr.smithi067.rdualw (mgr.24569) 10424 : cluster [DBG] pgmap v8977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:12.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:10.083915+0000 mgr.smithi067.rdualw (mgr.24569) 10425 : cluster [DBG] pgmap v8978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:12.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:10.083915+0000 mgr.smithi067.rdualw (mgr.24569) 10425 : cluster [DBG] pgmap v8978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:14.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:12.084783+0000 mgr.smithi067.rdualw (mgr.24569) 10426 : cluster [DBG] pgmap v8979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:14.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:12.084783+0000 mgr.smithi067.rdualw (mgr.24569) 10426 : cluster [DBG] pgmap v8979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:16.305 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:14.085347+0000 mgr.smithi067.rdualw (mgr.24569) 10427 : cluster [DBG] pgmap v8980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:16.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:14.085347+0000 mgr.smithi067.rdualw (mgr.24569) 10427 : cluster [DBG] pgmap v8980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:16.086411+0000 mgr.smithi067.rdualw (mgr.24569) 10428 : cluster [DBG] pgmap v8981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:28:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:16.086411+0000 mgr.smithi067.rdualw (mgr.24569) 10428 : cluster [DBG] pgmap v8981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:28:20.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:18.086917+0000 mgr.smithi067.rdualw (mgr.24569) 10429 : cluster [DBG] pgmap v8982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:18.086917+0000 mgr.smithi067.rdualw (mgr.24569) 10429 : cluster [DBG] pgmap v8982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:22.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:20.087628+0000 mgr.smithi067.rdualw (mgr.24569) 10430 : cluster [DBG] pgmap v8983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:20.087628+0000 mgr.smithi067.rdualw (mgr.24569) 10430 : cluster [DBG] pgmap v8983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:24.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:22.088426+0000 mgr.smithi067.rdualw (mgr.24569) 10431 : cluster [DBG] pgmap v8984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:22.088426+0000 mgr.smithi067.rdualw (mgr.24569) 10431 : cluster [DBG] pgmap v8984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:25.148 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:28:25.441 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:28:25.441 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 96s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:28:25.442 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 96s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:28:25.442 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 99s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:28:25.442 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 96s ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:28:25.442 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 96s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:28:25.443 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 99s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:28:25.443 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 96s ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:28:25.443 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (4h) 99s ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:28:25.443 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (4h) 96s ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:28:25.444 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 99s ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:28:25.444 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 96s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:28:25.444 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 99s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:28:25.444 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 96s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:28:25.444 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 99s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:28:25.445 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 96s ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:28:25.445 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 96s ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:28:25.445 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 96s ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:28:25.445 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 96s ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:28:25.446 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 99s ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:28:25.446 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 99s ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:28:25.446 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 99s ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:28:25.446 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 99s ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:28:25.446 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 96s ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:28:25.782 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:28:26.076 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:28:26.076 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:28:26.076 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:28:26.077 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:28:26.077 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:28:26.077 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:28:26.077 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:28:26.077 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:28:26.078 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:28:26.078 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:28:26.078 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:28:26.078 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:28:26.079 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:28:26.079 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:28:26.079 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:28:26.079 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:28:26.079 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:28:26.080 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:28:26.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:24.088989+0000 mgr.smithi067.rdualw (mgr.24569) 10432 : cluster [DBG] pgmap v8985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:28:25.780690+0000 mon.smithi061 (mon.0) 2201 : audit [DBG] from='client.? 172.21.15.61:0/1971922148' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:28:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:24.088989+0000 mgr.smithi067.rdualw (mgr.24569) 10432 : cluster [DBG] pgmap v8985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:28:25.780690+0000 mon.smithi061 (mon.0) 2201 : audit [DBG] from='client.? 172.21.15.61:0/1971922148' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:28:27.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:28:25.134216+0000 mgr.smithi067.rdualw (mgr.24569) 10433 : audit [DBG] from='client.41098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:28:27.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:28:25.423405+0000 mgr.smithi067.rdualw (mgr.24569) 10434 : audit [DBG] from='client.41102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:28:27.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:28:25.134216+0000 mgr.smithi067.rdualw (mgr.24569) 10433 : audit [DBG] from='client.41098 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:28:27.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:28:25.423405+0000 mgr.smithi067.rdualw (mgr.24569) 10434 : audit [DBG] from='client.41102 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:28:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:26.089862+0000 mgr.smithi067.rdualw (mgr.24569) 10435 : cluster [DBG] pgmap v8986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:28:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:26.089862+0000 mgr.smithi067.rdualw (mgr.24569) 10435 : cluster [DBG] pgmap v8986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:28:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:28.090350+0000 mgr.smithi067.rdualw (mgr.24569) 10436 : cluster [DBG] pgmap v8987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:28.090350+0000 mgr.smithi067.rdualw (mgr.24569) 10436 : cluster [DBG] pgmap v8987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:30.090950+0000 mgr.smithi067.rdualw (mgr.24569) 10437 : cluster [DBG] pgmap v8988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:30.090950+0000 mgr.smithi067.rdualw (mgr.24569) 10437 : cluster [DBG] pgmap v8988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:32.092005+0000 mgr.smithi067.rdualw (mgr.24569) 10438 : cluster [DBG] pgmap v8989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:32.092005+0000 mgr.smithi067.rdualw (mgr.24569) 10438 : cluster [DBG] pgmap v8989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:35.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:34.092615+0000 mgr.smithi067.rdualw (mgr.24569) 10439 : cluster [DBG] pgmap v8990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:34.092615+0000 mgr.smithi067.rdualw (mgr.24569) 10439 : cluster [DBG] pgmap v8990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:28:36.102710+0000 mon.smithi067 (mon.1) 1581 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:28:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:28:36.102959+0000 mon.smithi067 (mon.1) 1582 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:28:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:28:36.103398+0000 mon.smithi061 (mon.0) 2202 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:28:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:28:36.103637+0000 mon.smithi061 (mon.0) 2203 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:28:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:28:36.102710+0000 mon.smithi067 (mon.1) 1581 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:28:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:28:36.102959+0000 mon.smithi067 (mon.1) 1582 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:28:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:28:36.103398+0000 mon.smithi061 (mon.0) 2202 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:28:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:28:36.103637+0000 mon.smithi061 (mon.0) 2203 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:28:38.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:36.093613+0000 mgr.smithi067.rdualw (mgr.24569) 10440 : cluster [DBG] pgmap v8991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:28:38.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:36.093613+0000 mgr.smithi067.rdualw (mgr.24569) 10440 : cluster [DBG] pgmap v8991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:28:40.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:38.094268+0000 mgr.smithi067.rdualw (mgr.24569) 10441 : cluster [DBG] pgmap v8992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:40.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:38.094268+0000 mgr.smithi067.rdualw (mgr.24569) 10441 : cluster [DBG] pgmap v8992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:42.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:40.095007+0000 mgr.smithi067.rdualw (mgr.24569) 10442 : cluster [DBG] pgmap v8993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:42.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:40.095007+0000 mgr.smithi067.rdualw (mgr.24569) 10442 : cluster [DBG] pgmap v8993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:42.095934+0000 mgr.smithi067.rdualw (mgr.24569) 10443 : cluster [DBG] pgmap v8994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:44.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:42.095934+0000 mgr.smithi067.rdualw (mgr.24569) 10443 : cluster [DBG] pgmap v8994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:44.096599+0000 mgr.smithi067.rdualw (mgr.24569) 10444 : cluster [DBG] pgmap v8995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:44.096599+0000 mgr.smithi067.rdualw (mgr.24569) 10444 : cluster [DBG] pgmap v8995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:48.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:46.097508+0000 mgr.smithi067.rdualw (mgr.24569) 10445 : cluster [DBG] pgmap v8996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:28:48.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:46.097508+0000 mgr.smithi067.rdualw (mgr.24569) 10445 : cluster [DBG] pgmap v8996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:28:50.047 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:48.098177+0000 mgr.smithi067.rdualw (mgr.24569) 10446 : cluster [DBG] pgmap v8997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:50.048 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:28:49.324923+0000 mon.smithi067 (mon.1) 1583 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:28:50.048 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:28:49.326371+0000 mon.smithi067 (mon.1) 1584 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:28:50.048 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:28:49.327400+0000 mon.smithi067 (mon.1) 1585 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:28:50.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:28:49.682106+0000 mon.smithi061 (mon.0) 2204 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:28:50.049 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:28:49.693973+0000 mon.smithi061 (mon.0) 2205 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:28:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:48.098177+0000 mgr.smithi067.rdualw (mgr.24569) 10446 : cluster [DBG] pgmap v8997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:28:49.324923+0000 mon.smithi067 (mon.1) 1583 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:28:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:28:49.326371+0000 mon.smithi067 (mon.1) 1584 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:28:50.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:28:49.327400+0000 mon.smithi067 (mon.1) 1585 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:28:50.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:28:49.682106+0000 mon.smithi061 (mon.0) 2204 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:28:50.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:28:49.693973+0000 mon.smithi061 (mon.0) 2205 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:28:51.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:28:49.328337+0000 mgr.smithi067.rdualw (mgr.24569) 10447 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:28:51.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:28:50.102793+0000 mon.smithi061 (mon.0) 2206 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:28:51.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:28:50.111222+0000 mon.smithi061 (mon.0) 2207 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:28:51.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:28:49.328337+0000 mgr.smithi067.rdualw (mgr.24569) 10447 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:28:51.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:28:50.102793+0000 mon.smithi061 (mon.0) 2206 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:28:51.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:28:50.111222+0000 mon.smithi061 (mon.0) 2207 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:28:52.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:50.098659+0000 mgr.smithi067.rdualw (mgr.24569) 10448 : cluster [DBG] pgmap v8998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:52.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:50.098659+0000 mgr.smithi067.rdualw (mgr.24569) 10448 : cluster [DBG] pgmap v8998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:54.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:52.099590+0000 mgr.smithi067.rdualw (mgr.24569) 10449 : cluster [DBG] pgmap v8999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:52.099590+0000 mgr.smithi067.rdualw (mgr.24569) 10449 : cluster [DBG] pgmap v8999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:56.089 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:28:56.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:54.100214+0000 mgr.smithi067.rdualw (mgr.24569) 10450 : cluster [DBG] pgmap v9000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:56.377 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:28:56.380 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 2m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:28:56.380 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 2m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:28:56.381 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 2m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:28:56.381 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 2m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:28:56.381 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (4h) 2m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:28:56.381 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 2m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:28:56.382 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 2m ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:28:56.382 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 2m ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:28:56.382 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 2m ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:28:56.382 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (4h) 2m ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:28:56.383 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 2m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:28:56.383 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 2m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:28:56.383 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 2m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:28:56.383 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 2m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:28:56.383 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 2m ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:28:56.384 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 2m ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:28:56.384 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 2m ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:28:56.384 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 2m ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:28:56.384 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 2m ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:28:56.385 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 2m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:28:56.385 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 2m ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:28:56.385 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 2m ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:28:56.385 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 2m ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:28:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:54.100214+0000 mgr.smithi067.rdualw (mgr.24569) 10450 : cluster [DBG] pgmap v9000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:28:56.719 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:28:56.720 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:28:56.720 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:28:56.720 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:28:56.720 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:28:56.721 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:28:56.721 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:28:56.721 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:28:56.721 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:28:56.721 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:28:56.722 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:28:56.722 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:28:56.722 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:28:56.722 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:28:56.723 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:28:56.723 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:28:56.723 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:28:56.723 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:28:56.724 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:28:57.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:28:56.074905+0000 mgr.smithi067.rdualw (mgr.24569) 10451 : audit [DBG] from='client.41110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:28:57.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:28:56.718099+0000 mon.smithi061 (mon.0) 2208 : audit [DBG] from='client.? 172.21.15.61:0/2038099337' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:28:57.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:28:56.074905+0000 mgr.smithi067.rdualw (mgr.24569) 10451 : audit [DBG] from='client.41110 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:28:57.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:28:56.718099+0000 mon.smithi061 (mon.0) 2208 : audit [DBG] from='client.? 172.21.15.61:0/2038099337' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:28:58.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:56.101116+0000 mgr.smithi067.rdualw (mgr.24569) 10452 : cluster [DBG] pgmap v9001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:28:58.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:28:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:28:56.359152+0000 mgr.smithi067.rdualw (mgr.24569) 10453 : audit [DBG] from='client.41114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:28:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:56.101116+0000 mgr.smithi067.rdualw (mgr.24569) 10452 : cluster [DBG] pgmap v9001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:28:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:28:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:28:56.359152+0000 mgr.smithi067.rdualw (mgr.24569) 10453 : audit [DBG] from='client.41114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:29:00.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:28:58.101783+0000 mgr.smithi067.rdualw (mgr.24569) 10454 : cluster [DBG] pgmap v9002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:28:58.101783+0000 mgr.smithi067.rdualw (mgr.24569) 10454 : cluster [DBG] pgmap v9002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:00.102460+0000 mgr.smithi067.rdualw (mgr.24569) 10455 : cluster [DBG] pgmap v9003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:00.102460+0000 mgr.smithi067.rdualw (mgr.24569) 10455 : cluster [DBG] pgmap v9003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:02.103370+0000 mgr.smithi067.rdualw (mgr.24569) 10456 : cluster [DBG] pgmap v9004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:02.103370+0000 mgr.smithi067.rdualw (mgr.24569) 10456 : cluster [DBG] pgmap v9004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:04.104008+0000 mgr.smithi067.rdualw (mgr.24569) 10457 : cluster [DBG] pgmap v9005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:04.104008+0000 mgr.smithi067.rdualw (mgr.24569) 10457 : cluster [DBG] pgmap v9005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:06.104791+0000 mgr.smithi067.rdualw (mgr.24569) 10458 : cluster [DBG] pgmap v9006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:29:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:06.104791+0000 mgr.smithi067.rdualw (mgr.24569) 10458 : cluster [DBG] pgmap v9006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:29:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:08.105275+0000 mgr.smithi067.rdualw (mgr.24569) 10459 : cluster [DBG] pgmap v9007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:08.105275+0000 mgr.smithi067.rdualw (mgr.24569) 10459 : cluster [DBG] pgmap v9007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:10.106051+0000 mgr.smithi067.rdualw (mgr.24569) 10460 : cluster [DBG] pgmap v9008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:10.106051+0000 mgr.smithi067.rdualw (mgr.24569) 10460 : cluster [DBG] pgmap v9008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:12.106932+0000 mgr.smithi067.rdualw (mgr.24569) 10461 : cluster [DBG] pgmap v9009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:12.106932+0000 mgr.smithi067.rdualw (mgr.24569) 10461 : cluster [DBG] pgmap v9009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:14.107624+0000 mgr.smithi067.rdualw (mgr.24569) 10462 : cluster [DBG] pgmap v9010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:14.107624+0000 mgr.smithi067.rdualw (mgr.24569) 10462 : cluster [DBG] pgmap v9010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:18.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:16.108425+0000 mgr.smithi067.rdualw (mgr.24569) 10463 : cluster [DBG] pgmap v9011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:29:18.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:16.108425+0000 mgr.smithi067.rdualw (mgr.24569) 10463 : cluster [DBG] pgmap v9011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:29:20.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:18.108968+0000 mgr.smithi067.rdualw (mgr.24569) 10464 : cluster [DBG] pgmap v9012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:20.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:18.108968+0000 mgr.smithi067.rdualw (mgr.24569) 10464 : cluster [DBG] pgmap v9012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:22.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:20.109731+0000 mgr.smithi067.rdualw (mgr.24569) 10465 : cluster [DBG] pgmap v9013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:22.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:20.109731+0000 mgr.smithi067.rdualw (mgr.24569) 10465 : cluster [DBG] pgmap v9013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:24.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:22.110750+0000 mgr.smithi067.rdualw (mgr.24569) 10466 : cluster [DBG] pgmap v9014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:24.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:22.110750+0000 mgr.smithi067.rdualw (mgr.24569) 10466 : cluster [DBG] pgmap v9014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:26.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:24.111340+0000 mgr.smithi067.rdualw (mgr.24569) 10467 : cluster [DBG] pgmap v9015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:26.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:24.111340+0000 mgr.smithi067.rdualw (mgr.24569) 10467 : cluster [DBG] pgmap v9015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:27.026 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:29:27.316 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:29:27.316 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 2m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:29:27.316 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (4h) 2m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:29:27.317 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (4h) 2m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:29:27.317 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 2m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:29:27.317 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 2m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:29:27.317 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (4h) 2m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:29:27.318 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 2m ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:29:27.318 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 2m ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:29:27.318 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 2m ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:29:27.318 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 2m ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:29:27.319 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 2m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:29:27.319 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 2m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:29:27.319 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 2m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:29:27.319 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 2m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:29:27.320 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 2m ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:29:27.320 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 2m ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:29:27.320 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 2m ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:29:27.320 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 2m ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:29:27.321 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 2m ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:29:27.321 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 2m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:29:27.321 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 2m ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:29:27.321 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 2m ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:29:27.321 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 2m ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:29:27.660 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:29:27.660 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:29:27.661 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:29:27.661 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:29:27.661 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:29:27.661 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:29:27.662 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:29:27.662 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:29:27.662 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:29:27.662 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:29:27.663 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:29:27.663 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:29:27.663 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:29:27.663 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:29:27.664 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:29:27.664 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:29:27.664 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:29:27.664 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:29:27.664 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:29:28.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:26.112297+0000 mgr.smithi067.rdualw (mgr.24569) 10468 : cluster [DBG] pgmap v9016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:29:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:29:27.013178+0000 mgr.smithi067.rdualw (mgr.24569) 10469 : audit [DBG] from='client.41122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:29:28.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:29:27.658946+0000 mon.smithi061 (mon.0) 2209 : audit [DBG] from='client.? 172.21.15.61:0/2408140406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:29:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:26.112297+0000 mgr.smithi067.rdualw (mgr.24569) 10468 : cluster [DBG] pgmap v9016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:29:28.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:29:27.013178+0000 mgr.smithi067.rdualw (mgr.24569) 10469 : audit [DBG] from='client.41122 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:29:28.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:29:27.658946+0000 mon.smithi061 (mon.0) 2209 : audit [DBG] from='client.? 172.21.15.61:0/2408140406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:29:29.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:29:27.298341+0000 mgr.smithi067.rdualw (mgr.24569) 10470 : audit [DBG] from='client.41126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:29:29.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:29:27.298341+0000 mgr.smithi067.rdualw (mgr.24569) 10470 : audit [DBG] from='client.41126 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:29:30.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:28.112939+0000 mgr.smithi067.rdualw (mgr.24569) 10471 : cluster [DBG] pgmap v9017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:28.112939+0000 mgr.smithi067.rdualw (mgr.24569) 10471 : cluster [DBG] pgmap v9017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:32.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:30.113681+0000 mgr.smithi067.rdualw (mgr.24569) 10472 : cluster [DBG] pgmap v9018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:30.113681+0000 mgr.smithi067.rdualw (mgr.24569) 10472 : cluster [DBG] pgmap v9018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:34.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:32.114591+0000 mgr.smithi067.rdualw (mgr.24569) 10473 : cluster [DBG] pgmap v9019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:32.114591+0000 mgr.smithi067.rdualw (mgr.24569) 10473 : cluster [DBG] pgmap v9019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:36.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:34.115270+0000 mgr.smithi067.rdualw (mgr.24569) 10474 : cluster [DBG] pgmap v9020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:34.115270+0000 mgr.smithi067.rdualw (mgr.24569) 10474 : cluster [DBG] pgmap v9020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:29:36.107940+0000 mon.smithi067 (mon.1) 1586 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:29:37.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:29:36.108236+0000 mon.smithi067 (mon.1) 1587 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:29:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:29:36.108579+0000 mon.smithi061 (mon.0) 2210 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:29:37.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:29:36.109050+0000 mon.smithi061 (mon.0) 2211 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:29:37.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:29:36.107940+0000 mon.smithi067 (mon.1) 1586 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:29:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:29:36.108236+0000 mon.smithi067 (mon.1) 1587 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:29:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:29:36.108579+0000 mon.smithi061 (mon.0) 2210 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:29:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:29:36.109050+0000 mon.smithi061 (mon.0) 2211 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:29:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:36.116145+0000 mgr.smithi067.rdualw (mgr.24569) 10475 : cluster [DBG] pgmap v9021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:29:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:36.116145+0000 mgr.smithi067.rdualw (mgr.24569) 10475 : cluster [DBG] pgmap v9021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:29:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:38.116741+0000 mgr.smithi067.rdualw (mgr.24569) 10476 : cluster [DBG] pgmap v9022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:38.116741+0000 mgr.smithi067.rdualw (mgr.24569) 10476 : cluster [DBG] pgmap v9022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:40.117346+0000 mgr.smithi067.rdualw (mgr.24569) 10477 : cluster [DBG] pgmap v9023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:40.117346+0000 mgr.smithi067.rdualw (mgr.24569) 10477 : cluster [DBG] pgmap v9023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:42.118180+0000 mgr.smithi067.rdualw (mgr.24569) 10478 : cluster [DBG] pgmap v9024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:42.118180+0000 mgr.smithi067.rdualw (mgr.24569) 10478 : cluster [DBG] pgmap v9024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:44.118962+0000 mgr.smithi067.rdualw (mgr.24569) 10479 : cluster [DBG] pgmap v9025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:44.118962+0000 mgr.smithi067.rdualw (mgr.24569) 10479 : cluster [DBG] pgmap v9025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:46.119840+0000 mgr.smithi067.rdualw (mgr.24569) 10480 : cluster [DBG] pgmap v9026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:29:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:46.119840+0000 mgr.smithi067.rdualw (mgr.24569) 10480 : cluster [DBG] pgmap v9026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:29:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:48.120362+0000 mgr.smithi067.rdualw (mgr.24569) 10481 : cluster [DBG] pgmap v9027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:48.120362+0000 mgr.smithi067.rdualw (mgr.24569) 10481 : cluster [DBG] pgmap v9027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:51.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:29:50.114334+0000 mon.smithi067 (mon.1) 1588 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:29:51.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:29:50.115768+0000 mon.smithi067 (mon.1) 1589 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:29:51.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:29:50.116712+0000 mon.smithi067 (mon.1) 1590 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:29:51.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:29:50.114334+0000 mon.smithi067 (mon.1) 1588 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:29:51.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:29:50.115768+0000 mon.smithi067 (mon.1) 1589 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:29:51.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:29:50.116712+0000 mon.smithi067 (mon.1) 1590 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:29:52.498 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:29:50.117585+0000 mgr.smithi067.rdualw (mgr.24569) 10482 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:29:52.498 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:50.120978+0000 mgr.smithi067.rdualw (mgr.24569) 10483 : cluster [DBG] pgmap v9028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:29:50.117585+0000 mgr.smithi067.rdualw (mgr.24569) 10482 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:29:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:50.120978+0000 mgr.smithi067.rdualw (mgr.24569) 10483 : cluster [DBG] pgmap v9028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:52.121916+0000 mgr.smithi067.rdualw (mgr.24569) 10484 : cluster [DBG] pgmap v9029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:29:53.437065+0000 mon.smithi061 (mon.0) 2212 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:29:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:29:53.843801+0000 mon.smithi061 (mon.0) 2213 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:29:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:29:53.851569+0000 mon.smithi061 (mon.0) 2214 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:29:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:52.121916+0000 mgr.smithi067.rdualw (mgr.24569) 10484 : cluster [DBG] pgmap v9029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:29:53.437065+0000 mon.smithi061 (mon.0) 2212 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:29:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:29:53.843801+0000 mon.smithi061 (mon.0) 2213 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:29:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:29:53.851569+0000 mon.smithi061 (mon.0) 2214 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:29:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:54.122687+0000 mgr.smithi067.rdualw (mgr.24569) 10485 : cluster [DBG] pgmap v9030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:54.122687+0000 mgr.smithi067.rdualw (mgr.24569) 10485 : cluster [DBG] pgmap v9030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:29:57.969 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:29:58.336 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:56.123558+0000 mgr.smithi067.rdualw (mgr.24569) 10486 : cluster [DBG] pgmap v9031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:29:58.337 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:29:58.337 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 3m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:29:58.337 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 3m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:29:58.338 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 3m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:29:58.338 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 3m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:29:58.339 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 3m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:29:58.339 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 3m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:29:58.340 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 3m ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:29:58.340 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 3m ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:29:58.340 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 3m ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:29:58.341 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 3m ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:29:58.341 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 3m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:29:58.341 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 3m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:29:58.342 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 3m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:29:58.342 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 3m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:29:58.343 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 3m ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:29:58.343 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 3m ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:29:58.343 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 3m ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:29:58.344 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 3m ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:29:58.344 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 3m ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:29:58.344 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 3m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:29:58.345 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 3m ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:29:58.345 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 3m ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:29:58.346 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 3m ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:29:58.346 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:56.123558+0000 mgr.smithi067.rdualw (mgr.24569) 10486 : cluster [DBG] pgmap v9031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:29:58.602 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:29:58.602 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:29:58.603 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:29:58.603 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:29:58.603 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:29:58.603 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:29:58.604 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:29:58.604 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:29:58.604 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:29:58.604 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:29:58.605 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:29:58.605 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:29:58.605 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:29:58.605 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:29:58.605 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:29:58.606 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:29:58.606 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:29:58.606 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:29:58.606 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:29:59.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:29:57.955332+0000 mgr.smithi067.rdualw (mgr.24569) 10487 : audit [DBG] from='client.41134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:29:59.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:29:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:29:58.600993+0000 mon.smithi061 (mon.0) 2215 : audit [DBG] from='client.? 172.21.15.61:0/2827108701' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:29:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:29:57.955332+0000 mgr.smithi067.rdualw (mgr.24569) 10487 : audit [DBG] from='client.41134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:29:59.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:29:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:29:58.600993+0000 mon.smithi061 (mon.0) 2215 : audit [DBG] from='client.? 172.21.15.61:0/2827108701' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:30:00.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:29:58.124154+0000 mgr.smithi067.rdualw (mgr.24569) 10488 : cluster [DBG] pgmap v9032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:00.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:29:58.243706+0000 mgr.smithi067.rdualw (mgr.24569) 10489 : audit [DBG] from='client.41138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:30:00.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:00.000165+0000 mon.smithi061 (mon.0) 2216 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T20:30:00.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:29:58.124154+0000 mgr.smithi067.rdualw (mgr.24569) 10488 : cluster [DBG] pgmap v9032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:00.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:29:58.243706+0000 mgr.smithi067.rdualw (mgr.24569) 10489 : audit [DBG] from='client.41138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:30:00.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:00.000165+0000 mon.smithi061 (mon.0) 2216 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T20:30:02.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:00.124746+0000 mgr.smithi067.rdualw (mgr.24569) 10490 : cluster [DBG] pgmap v9033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:02.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:00.124746+0000 mgr.smithi067.rdualw (mgr.24569) 10490 : cluster [DBG] pgmap v9033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:02.125750+0000 mgr.smithi067.rdualw (mgr.24569) 10491 : cluster [DBG] pgmap v9034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:02.125750+0000 mgr.smithi067.rdualw (mgr.24569) 10491 : cluster [DBG] pgmap v9034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:06.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:04.126373+0000 mgr.smithi067.rdualw (mgr.24569) 10492 : cluster [DBG] pgmap v9035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:04.126373+0000 mgr.smithi067.rdualw (mgr.24569) 10492 : cluster [DBG] pgmap v9035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:08.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:06.127238+0000 mgr.smithi067.rdualw (mgr.24569) 10493 : cluster [DBG] pgmap v9036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:30:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:06.127238+0000 mgr.smithi067.rdualw (mgr.24569) 10493 : cluster [DBG] pgmap v9036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:30:10.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:08.127951+0000 mgr.smithi067.rdualw (mgr.24569) 10494 : cluster [DBG] pgmap v9037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:08.127951+0000 mgr.smithi067.rdualw (mgr.24569) 10494 : cluster [DBG] pgmap v9037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:12.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:10.128580+0000 mgr.smithi067.rdualw (mgr.24569) 10495 : cluster [DBG] pgmap v9038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:10.128580+0000 mgr.smithi067.rdualw (mgr.24569) 10495 : cluster [DBG] pgmap v9038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:12.129608+0000 mgr.smithi067.rdualw (mgr.24569) 10496 : cluster [DBG] pgmap v9039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:12.129608+0000 mgr.smithi067.rdualw (mgr.24569) 10496 : cluster [DBG] pgmap v9039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:14.130384+0000 mgr.smithi067.rdualw (mgr.24569) 10497 : cluster [DBG] pgmap v9040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:14.130384+0000 mgr.smithi067.rdualw (mgr.24569) 10497 : cluster [DBG] pgmap v9040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:16.131239+0000 mgr.smithi067.rdualw (mgr.24569) 10498 : cluster [DBG] pgmap v9041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:30:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:16.131239+0000 mgr.smithi067.rdualw (mgr.24569) 10498 : cluster [DBG] pgmap v9041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:30:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:18.131930+0000 mgr.smithi067.rdualw (mgr.24569) 10499 : cluster [DBG] pgmap v9042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:18.131930+0000 mgr.smithi067.rdualw (mgr.24569) 10499 : cluster [DBG] pgmap v9042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:20.132493+0000 mgr.smithi067.rdualw (mgr.24569) 10500 : cluster [DBG] pgmap v9043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:20.132493+0000 mgr.smithi067.rdualw (mgr.24569) 10500 : cluster [DBG] pgmap v9043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:22.133438+0000 mgr.smithi067.rdualw (mgr.24569) 10501 : cluster [DBG] pgmap v9044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:22.133438+0000 mgr.smithi067.rdualw (mgr.24569) 10501 : cluster [DBG] pgmap v9044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:24.134067+0000 mgr.smithi067.rdualw (mgr.24569) 10502 : cluster [DBG] pgmap v9045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:24.134067+0000 mgr.smithi067.rdualw (mgr.24569) 10502 : cluster [DBG] pgmap v9045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:26.135020+0000 mgr.smithi067.rdualw (mgr.24569) 10503 : cluster [DBG] pgmap v9046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:30:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:26.135020+0000 mgr.smithi067.rdualw (mgr.24569) 10503 : cluster [DBG] pgmap v9046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:30:28.999 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:30:29.293 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:30:29.293 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 3m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:30:29.294 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 3m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:30:29.294 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 3m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:30:29.294 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 3m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:30:29.294 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 3m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:30:29.295 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 3m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:30:29.295 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 3m ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:30:29.295 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 3m ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:30:29.295 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 3m ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:30:29.295 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 3m ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:30:29.296 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 3m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:30:29.296 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 3m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:30:29.296 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 3m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:30:29.296 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 3m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:30:29.297 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 3m ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:30:29.297 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 3m ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:30:29.297 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 3m ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:30:29.297 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 3m ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:30:29.298 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 3m ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:30:29.298 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 3m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:30:29.298 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 3m ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:30:29.298 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 3m ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:30:29.298 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 3m ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:30:29.632 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:30:29.632 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:30:29.633 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:30:29.633 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:30:29.633 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:30:29.634 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:30:29.634 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:30:29.635 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:30:29.635 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:30:29.635 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:30:29.636 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:30:29.636 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:30:29.636 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:30:29.637 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:30:29.637 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:30:29.637 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:30:29.638 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:30:29.638 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:30:29.638 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:30:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:28.135776+0000 mgr.smithi067.rdualw (mgr.24569) 10504 : cluster [DBG] pgmap v9047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:30:28.982969+0000 mgr.smithi067.rdualw (mgr.24569) 10505 : audit [DBG] from='client.41146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:30:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:30:29.630620+0000 mon.smithi061 (mon.0) 2217 : audit [DBG] from='client.? 172.21.15.61:0/3373488340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:30:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:28.135776+0000 mgr.smithi067.rdualw (mgr.24569) 10504 : cluster [DBG] pgmap v9047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:30:28.982969+0000 mgr.smithi067.rdualw (mgr.24569) 10505 : audit [DBG] from='client.41146 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:30:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:30:29.630620+0000 mon.smithi061 (mon.0) 2217 : audit [DBG] from='client.? 172.21.15.61:0/3373488340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:30:31.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:30:29.275078+0000 mgr.smithi067.rdualw (mgr.24569) 10506 : audit [DBG] from='client.41150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:30:31.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:30:29.275078+0000 mgr.smithi067.rdualw (mgr.24569) 10506 : audit [DBG] from='client.41150 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:30:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:30.136392+0000 mgr.smithi067.rdualw (mgr.24569) 10507 : cluster [DBG] pgmap v9048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:30.136392+0000 mgr.smithi067.rdualw (mgr.24569) 10507 : cluster [DBG] pgmap v9048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:32.137446+0000 mgr.smithi067.rdualw (mgr.24569) 10508 : cluster [DBG] pgmap v9049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:32.137446+0000 mgr.smithi067.rdualw (mgr.24569) 10508 : cluster [DBG] pgmap v9049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:34.138208+0000 mgr.smithi067.rdualw (mgr.24569) 10509 : cluster [DBG] pgmap v9050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:34.138208+0000 mgr.smithi067.rdualw (mgr.24569) 10509 : cluster [DBG] pgmap v9050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:30:36.113078+0000 mon.smithi067 (mon.1) 1591 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:30:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:30:36.113404+0000 mon.smithi067 (mon.1) 1592 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:30:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:30:36.113714+0000 mon.smithi061 (mon.0) 2218 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:30:37.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:30:36.113975+0000 mon.smithi061 (mon.0) 2219 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:30:37.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:30:36.113078+0000 mon.smithi067 (mon.1) 1591 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:30:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:30:36.113404+0000 mon.smithi067 (mon.1) 1592 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:30:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:30:36.113714+0000 mon.smithi061 (mon.0) 2218 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:30:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:30:36.113975+0000 mon.smithi061 (mon.0) 2219 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:30:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:36.139180+0000 mgr.smithi067.rdualw (mgr.24569) 10510 : cluster [DBG] pgmap v9051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:30:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:36.139180+0000 mgr.smithi067.rdualw (mgr.24569) 10510 : cluster [DBG] pgmap v9051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:30:39.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:38.139670+0000 mgr.smithi067.rdualw (mgr.24569) 10511 : cluster [DBG] pgmap v9052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:39.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:38.139670+0000 mgr.smithi067.rdualw (mgr.24569) 10511 : cluster [DBG] pgmap v9052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:41.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:40.140306+0000 mgr.smithi067.rdualw (mgr.24569) 10512 : cluster [DBG] pgmap v9053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:41.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:40.140306+0000 mgr.smithi067.rdualw (mgr.24569) 10512 : cluster [DBG] pgmap v9053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:44.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:42.141247+0000 mgr.smithi067.rdualw (mgr.24569) 10513 : cluster [DBG] pgmap v9054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:44.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:42.141247+0000 mgr.smithi067.rdualw (mgr.24569) 10513 : cluster [DBG] pgmap v9054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:46.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:44.142062+0000 mgr.smithi067.rdualw (mgr.24569) 10514 : cluster [DBG] pgmap v9055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:44.142062+0000 mgr.smithi067.rdualw (mgr.24569) 10514 : cluster [DBG] pgmap v9055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:48.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:46.142894+0000 mgr.smithi067.rdualw (mgr.24569) 10515 : cluster [DBG] pgmap v9056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:30:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:46.142894+0000 mgr.smithi067.rdualw (mgr.24569) 10515 : cluster [DBG] pgmap v9056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:30:50.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:48.143680+0000 mgr.smithi067.rdualw (mgr.24569) 10516 : cluster [DBG] pgmap v9057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:48.143680+0000 mgr.smithi067.rdualw (mgr.24569) 10516 : cluster [DBG] pgmap v9057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:52.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:50.144562+0000 mgr.smithi067.rdualw (mgr.24569) 10517 : cluster [DBG] pgmap v9058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:50.144562+0000 mgr.smithi067.rdualw (mgr.24569) 10517 : cluster [DBG] pgmap v9058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:54.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:52.145473+0000 mgr.smithi067.rdualw (mgr.24569) 10518 : cluster [DBG] pgmap v9059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:54.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:30:53.856186+0000 mon.smithi067 (mon.1) 1593 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:30:54.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:30:53.857682+0000 mon.smithi067 (mon.1) 1594 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:30:54.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:30:53.858623+0000 mon.smithi067 (mon.1) 1595 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:30:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:52.145473+0000 mgr.smithi067.rdualw (mgr.24569) 10518 : cluster [DBG] pgmap v9059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:30:53.856186+0000 mon.smithi067 (mon.1) 1593 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:30:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:30:53.857682+0000 mon.smithi067 (mon.1) 1594 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:30:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:30:53.858623+0000 mon.smithi067 (mon.1) 1595 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:30:55.243 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:30:53.859478+0000 mgr.smithi067.rdualw (mgr.24569) 10519 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:30:55.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:30:53.859478+0000 mgr.smithi067.rdualw (mgr.24569) 10519 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:30:56.376 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:54.146095+0000 mgr.smithi067.rdualw (mgr.24569) 10520 : cluster [DBG] pgmap v9060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:54.146095+0000 mgr.smithi067.rdualw (mgr.24569) 10520 : cluster [DBG] pgmap v9060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:30:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:56.146967+0000 mgr.smithi067.rdualw (mgr.24569) 10521 : cluster [DBG] pgmap v9061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:30:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:30:56.768810+0000 mon.smithi061 (mon.0) 2220 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:30:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:30:57.172339+0000 mon.smithi061 (mon.0) 2221 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:30:58.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:30:57.178159+0000 mon.smithi061 (mon.0) 2222 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:30:58.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:56.146967+0000 mgr.smithi067.rdualw (mgr.24569) 10521 : cluster [DBG] pgmap v9061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:30:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:30:56.768810+0000 mon.smithi061 (mon.0) 2220 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:30:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:30:57.172339+0000 mon.smithi061 (mon.0) 2221 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:30:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:30:57.178159+0000 mon.smithi061 (mon.0) 2222 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:31:00.028 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:31:00.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:30:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:30:58.147512+0000 mgr.smithi067.rdualw (mgr.24569) 10522 : cluster [DBG] pgmap v9062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:30:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:30:58.147512+0000 mgr.smithi067.rdualw (mgr.24569) 10522 : cluster [DBG] pgmap v9062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:00.321 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:31:00.322 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 4m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:31:00.322 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 4m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:31:00.322 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 4m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:31:00.323 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 4m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:31:00.323 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 4m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:31:00.323 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 4m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:31:00.323 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 4m ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:31:00.324 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 4m ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:31:00.324 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 4m ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:31:00.324 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 4m ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:31:00.325 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 4m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:31:00.325 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 4m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:31:00.325 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 4m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:31:00.325 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 4m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:31:00.325 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 4m ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:31:00.326 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 4m ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:31:00.326 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 4m ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:31:00.326 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 4m ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:31:00.327 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 4m ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:31:00.327 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 4m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:31:00.327 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 4m ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:31:00.327 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 4m ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:31:00.328 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 4m ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:31:00.663 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:31:00.663 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:31:00.663 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:31:00.664 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:31:00.664 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:31:00.664 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:31:00.665 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:31:00.665 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:31:00.665 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:31:00.665 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:31:00.665 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:31:00.666 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:31:00.666 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:31:00.666 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:31:00.666 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:31:00.667 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:31:00.667 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:31:00.667 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:31:00.667 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:31:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:31:00.011555+0000 mgr.smithi067.rdualw (mgr.24569) 10523 : audit [DBG] from='client.41158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:31:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:31:00.661662+0000 mon.smithi061 (mon.0) 2223 : audit [DBG] from='client.? 172.21.15.61:0/146521764' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:31:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:31:00.011555+0000 mgr.smithi067.rdualw (mgr.24569) 10523 : audit [DBG] from='client.41158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:31:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:31:00.661662+0000 mon.smithi061 (mon.0) 2223 : audit [DBG] from='client.? 172.21.15.61:0/146521764' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:31:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:00.148298+0000 mgr.smithi067.rdualw (mgr.24569) 10524 : cluster [DBG] pgmap v9063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:31:00.303437+0000 mgr.smithi067.rdualw (mgr.24569) 10525 : audit [DBG] from='client.41162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:31:02.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:00.148298+0000 mgr.smithi067.rdualw (mgr.24569) 10524 : cluster [DBG] pgmap v9063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:31:00.303437+0000 mgr.smithi067.rdualw (mgr.24569) 10525 : audit [DBG] from='client.41162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:31:04.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:02.149350+0000 mgr.smithi067.rdualw (mgr.24569) 10526 : cluster [DBG] pgmap v9064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:04.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:02.149350+0000 mgr.smithi067.rdualw (mgr.24569) 10526 : cluster [DBG] pgmap v9064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:06.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:04.150085+0000 mgr.smithi067.rdualw (mgr.24569) 10527 : cluster [DBG] pgmap v9065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:04.150085+0000 mgr.smithi067.rdualw (mgr.24569) 10527 : cluster [DBG] pgmap v9065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:08.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:06.150982+0000 mgr.smithi067.rdualw (mgr.24569) 10528 : cluster [DBG] pgmap v9066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:31:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:06.150982+0000 mgr.smithi067.rdualw (mgr.24569) 10528 : cluster [DBG] pgmap v9066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:31:10.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:08.151640+0000 mgr.smithi067.rdualw (mgr.24569) 10529 : cluster [DBG] pgmap v9067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:08.151640+0000 mgr.smithi067.rdualw (mgr.24569) 10529 : cluster [DBG] pgmap v9067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:12.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:10.152223+0000 mgr.smithi067.rdualw (mgr.24569) 10530 : cluster [DBG] pgmap v9068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:10.152223+0000 mgr.smithi067.rdualw (mgr.24569) 10530 : cluster [DBG] pgmap v9068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:14.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:12.153191+0000 mgr.smithi067.rdualw (mgr.24569) 10531 : cluster [DBG] pgmap v9069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:12.153191+0000 mgr.smithi067.rdualw (mgr.24569) 10531 : cluster [DBG] pgmap v9069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:16.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:14.153971+0000 mgr.smithi067.rdualw (mgr.24569) 10532 : cluster [DBG] pgmap v9070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:14.153971+0000 mgr.smithi067.rdualw (mgr.24569) 10532 : cluster [DBG] pgmap v9070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:16.155035+0000 mgr.smithi067.rdualw (mgr.24569) 10533 : cluster [DBG] pgmap v9071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:31:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:16.155035+0000 mgr.smithi067.rdualw (mgr.24569) 10533 : cluster [DBG] pgmap v9071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:31:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:18.155563+0000 mgr.smithi067.rdualw (mgr.24569) 10534 : cluster [DBG] pgmap v9072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:18.155563+0000 mgr.smithi067.rdualw (mgr.24569) 10534 : cluster [DBG] pgmap v9072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:20.156290+0000 mgr.smithi067.rdualw (mgr.24569) 10535 : cluster [DBG] pgmap v9073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:20.156290+0000 mgr.smithi067.rdualw (mgr.24569) 10535 : cluster [DBG] pgmap v9073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:22.157294+0000 mgr.smithi067.rdualw (mgr.24569) 10536 : cluster [DBG] pgmap v9074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:22.157294+0000 mgr.smithi067.rdualw (mgr.24569) 10536 : cluster [DBG] pgmap v9074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:24.157870+0000 mgr.smithi067.rdualw (mgr.24569) 10537 : cluster [DBG] pgmap v9075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:24.157870+0000 mgr.smithi067.rdualw (mgr.24569) 10537 : cluster [DBG] pgmap v9075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:26.158812+0000 mgr.smithi067.rdualw (mgr.24569) 10538 : cluster [DBG] pgmap v9076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:31:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:26.158812+0000 mgr.smithi067.rdualw (mgr.24569) 10538 : cluster [DBG] pgmap v9076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:31:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:28.159482+0000 mgr.smithi067.rdualw (mgr.24569) 10539 : cluster [DBG] pgmap v9077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:30.577 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:28.159482+0000 mgr.smithi067.rdualw (mgr.24569) 10539 : cluster [DBG] pgmap v9077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:30.969 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:31:31.263 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:31:31.263 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 4m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:31:31.263 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 4m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:31:31.264 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 4m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:31:31.264 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 4m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:31:31.264 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 4m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:31:31.264 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 4m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:31:31.264 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 4m ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:31:31.265 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 4m ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:31:31.265 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 4m ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:31:31.265 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 4m ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:31:31.265 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 4m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:31:31.265 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 4m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:31:31.266 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 4m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:31:31.266 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 4m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:31:31.266 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 4m ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:31:31.267 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 4m ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:31:31.267 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 4m ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:31:31.267 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 4m ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:31:31.267 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 4m ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:31:31.267 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 4m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:31:31.268 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 4m ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:31:31.268 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 4m ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:31:31.268 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 4m ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:31:31.603 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:31:31.604 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:31:31.604 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:31:31.604 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:31:31.604 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:31:31.605 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:31:31.605 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:31:31.605 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:31:31.605 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:31:31.606 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:31:31.606 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:31:31.606 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:31:31.606 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:31:31.607 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:31:31.607 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:31:31.607 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:31:31.607 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:31:31.608 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:31:31.608 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:31:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:30.160091+0000 mgr.smithi067.rdualw (mgr.24569) 10540 : cluster [DBG] pgmap v9078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:32.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:31:30.955553+0000 mgr.smithi067.rdualw (mgr.24569) 10541 : audit [DBG] from='client.41170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:31:32.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:31:31.602226+0000 mon.smithi061 (mon.0) 2224 : audit [DBG] from='client.? 172.21.15.61:0/371963709' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:31:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:30.160091+0000 mgr.smithi067.rdualw (mgr.24569) 10540 : cluster [DBG] pgmap v9078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:31:30.955553+0000 mgr.smithi067.rdualw (mgr.24569) 10541 : audit [DBG] from='client.41170 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:31:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:31:31.602226+0000 mon.smithi061 (mon.0) 2224 : audit [DBG] from='client.? 172.21.15.61:0/371963709' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:31:33.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:31:31.245146+0000 mgr.smithi067.rdualw (mgr.24569) 10542 : audit [DBG] from='client.41174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:31:33.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:31:31.245146+0000 mgr.smithi067.rdualw (mgr.24569) 10542 : audit [DBG] from='client.41174 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:31:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:32.161082+0000 mgr.smithi067.rdualw (mgr.24569) 10543 : cluster [DBG] pgmap v9079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:32.161082+0000 mgr.smithi067.rdualw (mgr.24569) 10543 : cluster [DBG] pgmap v9079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:34.161717+0000 mgr.smithi067.rdualw (mgr.24569) 10544 : cluster [DBG] pgmap v9080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:34.161717+0000 mgr.smithi067.rdualw (mgr.24569) 10544 : cluster [DBG] pgmap v9080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:37.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:31:36.118497+0000 mon.smithi067 (mon.1) 1596 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:31:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:31:36.118818+0000 mon.smithi067 (mon.1) 1597 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:31:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:31:36.119123+0000 mon.smithi061 (mon.0) 2225 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:31:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:31:36.119435+0000 mon.smithi061 (mon.0) 2226 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:31:37.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:31:36.118497+0000 mon.smithi067 (mon.1) 1596 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:31:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:31:36.118818+0000 mon.smithi067 (mon.1) 1597 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:31:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:31:36.119123+0000 mon.smithi061 (mon.0) 2225 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:31:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:31:36.119435+0000 mon.smithi061 (mon.0) 2226 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:31:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:36.162720+0000 mgr.smithi067.rdualw (mgr.24569) 10545 : cluster [DBG] pgmap v9081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:31:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:36.162720+0000 mgr.smithi067.rdualw (mgr.24569) 10545 : cluster [DBG] pgmap v9081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:31:39.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:38.163341+0000 mgr.smithi067.rdualw (mgr.24569) 10546 : cluster [DBG] pgmap v9082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:39.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:38.163341+0000 mgr.smithi067.rdualw (mgr.24569) 10546 : cluster [DBG] pgmap v9082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:41.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:40.164030+0000 mgr.smithi067.rdualw (mgr.24569) 10547 : cluster [DBG] pgmap v9083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:40.164030+0000 mgr.smithi067.rdualw (mgr.24569) 10547 : cluster [DBG] pgmap v9083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:44.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:42.164957+0000 mgr.smithi067.rdualw (mgr.24569) 10548 : cluster [DBG] pgmap v9084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:44.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:42.164957+0000 mgr.smithi067.rdualw (mgr.24569) 10548 : cluster [DBG] pgmap v9084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:44.165594+0000 mgr.smithi067.rdualw (mgr.24569) 10549 : cluster [DBG] pgmap v9085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:44.165594+0000 mgr.smithi067.rdualw (mgr.24569) 10549 : cluster [DBG] pgmap v9085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:46.166456+0000 mgr.smithi067.rdualw (mgr.24569) 10550 : cluster [DBG] pgmap v9086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:31:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:46.166456+0000 mgr.smithi067.rdualw (mgr.24569) 10550 : cluster [DBG] pgmap v9086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:31:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:48.167079+0000 mgr.smithi067.rdualw (mgr.24569) 10551 : cluster [DBG] pgmap v9087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:48.167079+0000 mgr.smithi067.rdualw (mgr.24569) 10551 : cluster [DBG] pgmap v9087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:50.167730+0000 mgr.smithi067.rdualw (mgr.24569) 10552 : cluster [DBG] pgmap v9088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:50.167730+0000 mgr.smithi067.rdualw (mgr.24569) 10552 : cluster [DBG] pgmap v9088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:52.168702+0000 mgr.smithi067.rdualw (mgr.24569) 10553 : cluster [DBG] pgmap v9089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:52.168702+0000 mgr.smithi067.rdualw (mgr.24569) 10553 : cluster [DBG] pgmap v9089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:54.169307+0000 mgr.smithi067.rdualw (mgr.24569) 10554 : cluster [DBG] pgmap v9090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:54.169307+0000 mgr.smithi067.rdualw (mgr.24569) 10554 : cluster [DBG] pgmap v9090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:31:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:56.170088+0000 mgr.smithi067.rdualw (mgr.24569) 10555 : cluster [DBG] pgmap v9091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:31:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:31:57.181782+0000 mon.smithi067 (mon.1) 1598 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:31:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:31:57.183209+0000 mon.smithi067 (mon.1) 1599 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:31:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:31:57.184167+0000 mon.smithi067 (mon.1) 1600 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:31:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:31:57.605864+0000 mon.smithi061 (mon.0) 2227 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:31:58.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:31:57.611062+0000 mon.smithi061 (mon.0) 2228 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:31:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:56.170088+0000 mgr.smithi067.rdualw (mgr.24569) 10555 : cluster [DBG] pgmap v9091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:31:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:31:57.181782+0000 mon.smithi067 (mon.1) 1598 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:31:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:31:57.183209+0000 mon.smithi067 (mon.1) 1599 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:31:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:31:57.184167+0000 mon.smithi067 (mon.1) 1600 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:31:58.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:31:57.605864+0000 mon.smithi061 (mon.0) 2227 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:31:58.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:31:57.611062+0000 mon.smithi061 (mon.0) 2228 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:31:59.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:31:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:31:57.185076+0000 mgr.smithi067.rdualw (mgr.24569) 10556 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:31:59.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:31:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:31:57.185076+0000 mgr.smithi067.rdualw (mgr.24569) 10556 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:32:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:31:58.170583+0000 mgr.smithi067.rdualw (mgr.24569) 10557 : cluster [DBG] pgmap v9092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:31:58.170583+0000 mgr.smithi067.rdualw (mgr.24569) 10557 : cluster [DBG] pgmap v9092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:01.914 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:32:02.208 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:32:02.208 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 5m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:32:02.208 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 5m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:32:02.209 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 5m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:32:02.209 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 5m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:32:02.209 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 5m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:32:02.209 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 5m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:32:02.210 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 5m ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:32:02.210 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 5m ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:32:02.210 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 5m ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:32:02.210 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 5m ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:32:02.210 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 5m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:32:02.211 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 5m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:32:02.211 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 5m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:32:02.211 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 5m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:32:02.211 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 5m ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:32:02.212 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 5m ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:32:02.212 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 5m ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:32:02.212 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 5m ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:32:02.212 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 5m ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:32:02.213 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 5m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:32:02.213 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 5m ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:32:02.213 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 5m ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:32:02.213 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 5m ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:32:02.548 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:32:02.549 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:32:02.549 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:32:02.549 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:32:02.550 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:32:02.550 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:32:02.550 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:32:02.550 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:32:02.550 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:32:02.551 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:32:02.551 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:32:02.551 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:32:02.551 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:32:02.552 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:32:02.552 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:32:02.552 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:32:02.552 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:32:02.552 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:32:02.553 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:32:02.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:00.171146+0000 mgr.smithi067.rdualw (mgr.24569) 10558 : cluster [DBG] pgmap v9093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:00.171146+0000 mgr.smithi067.rdualw (mgr.24569) 10558 : cluster [DBG] pgmap v9093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:03.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:32:01.900803+0000 mgr.smithi067.rdualw (mgr.24569) 10559 : audit [DBG] from='client.41182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:32:03.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:32:02.547419+0000 mon.smithi061 (mon.0) 2229 : audit [DBG] from='client.? 172.21.15.61:0/3374906688' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:32:03.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:32:01.900803+0000 mgr.smithi067.rdualw (mgr.24569) 10559 : audit [DBG] from='client.41182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:32:03.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:32:02.547419+0000 mon.smithi061 (mon.0) 2229 : audit [DBG] from='client.? 172.21.15.61:0/3374906688' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:32:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:02.172015+0000 mgr.smithi067.rdualw (mgr.24569) 10560 : cluster [DBG] pgmap v9094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:04.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:32:02.190086+0000 mgr.smithi067.rdualw (mgr.24569) 10561 : audit [DBG] from='client.41186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:32:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:02.172015+0000 mgr.smithi067.rdualw (mgr.24569) 10560 : cluster [DBG] pgmap v9094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:32:02.190086+0000 mgr.smithi067.rdualw (mgr.24569) 10561 : audit [DBG] from='client.41186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:32:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:04.172800+0000 mgr.smithi067.rdualw (mgr.24569) 10562 : cluster [DBG] pgmap v9095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:04.172800+0000 mgr.smithi067.rdualw (mgr.24569) 10562 : cluster [DBG] pgmap v9095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:06.173882+0000 mgr.smithi067.rdualw (mgr.24569) 10563 : cluster [DBG] pgmap v9096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:32:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:06.173882+0000 mgr.smithi067.rdualw (mgr.24569) 10563 : cluster [DBG] pgmap v9096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:32:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:08.174409+0000 mgr.smithi067.rdualw (mgr.24569) 10564 : cluster [DBG] pgmap v9097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:08.174409+0000 mgr.smithi067.rdualw (mgr.24569) 10564 : cluster [DBG] pgmap v9097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:10.175224+0000 mgr.smithi067.rdualw (mgr.24569) 10565 : cluster [DBG] pgmap v9098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:10.175224+0000 mgr.smithi067.rdualw (mgr.24569) 10565 : cluster [DBG] pgmap v9098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:12.176212+0000 mgr.smithi067.rdualw (mgr.24569) 10566 : cluster [DBG] pgmap v9099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:12.176212+0000 mgr.smithi067.rdualw (mgr.24569) 10566 : cluster [DBG] pgmap v9099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:14.176883+0000 mgr.smithi067.rdualw (mgr.24569) 10567 : cluster [DBG] pgmap v9100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:14.176883+0000 mgr.smithi067.rdualw (mgr.24569) 10567 : cluster [DBG] pgmap v9100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:16.177737+0000 mgr.smithi067.rdualw (mgr.24569) 10568 : cluster [DBG] pgmap v9101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:32:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:16.177737+0000 mgr.smithi067.rdualw (mgr.24569) 10568 : cluster [DBG] pgmap v9101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:32:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:18.178271+0000 mgr.smithi067.rdualw (mgr.24569) 10569 : cluster [DBG] pgmap v9102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:18.178271+0000 mgr.smithi067.rdualw (mgr.24569) 10569 : cluster [DBG] pgmap v9102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:21.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:20.179065+0000 mgr.smithi067.rdualw (mgr.24569) 10570 : cluster [DBG] pgmap v9103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:21.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:20.179065+0000 mgr.smithi067.rdualw (mgr.24569) 10570 : cluster [DBG] pgmap v9103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:22.180064+0000 mgr.smithi067.rdualw (mgr.24569) 10571 : cluster [DBG] pgmap v9104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:22.180064+0000 mgr.smithi067.rdualw (mgr.24569) 10571 : cluster [DBG] pgmap v9104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:24.180663+0000 mgr.smithi067.rdualw (mgr.24569) 10572 : cluster [DBG] pgmap v9105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:24.180663+0000 mgr.smithi067.rdualw (mgr.24569) 10572 : cluster [DBG] pgmap v9105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:26.181606+0000 mgr.smithi067.rdualw (mgr.24569) 10573 : cluster [DBG] pgmap v9106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:32:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:26.181606+0000 mgr.smithi067.rdualw (mgr.24569) 10573 : cluster [DBG] pgmap v9106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:32:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:28.182306+0000 mgr.smithi067.rdualw (mgr.24569) 10574 : cluster [DBG] pgmap v9107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:28.182306+0000 mgr.smithi067.rdualw (mgr.24569) 10574 : cluster [DBG] pgmap v9107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:30.182910+0000 mgr.smithi067.rdualw (mgr.24569) 10575 : cluster [DBG] pgmap v9108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:30.182910+0000 mgr.smithi067.rdualw (mgr.24569) 10575 : cluster [DBG] pgmap v9108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:32.858 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:32:33.152 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:32:33.153 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 5m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:32:33.153 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 5m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:32:33.153 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 5m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:32:33.154 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 5m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:32:33.154 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 5m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:32:33.154 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 5m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:32:33.154 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 5m ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:32:33.154 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 5m ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:32:33.155 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 5m ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:32:33.155 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 5m ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:32:33.155 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 5m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:32:33.155 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 5m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:32:33.155 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 5m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:32:33.156 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 5m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:32:33.156 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 5m ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:32:33.156 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 5m ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:32:33.156 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 5m ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:32:33.156 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 5m ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:32:33.157 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 5m ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:32:33.157 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 5m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:32:33.157 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 5m ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:32:33.157 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 5m ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:32:33.157 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 5m ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:32:33.492 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:32:33.492 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:32:33.492 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:32:33.492 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:32:33.493 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:32:33.493 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:32:33.493 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:32:33.493 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:32:33.494 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:32:33.494 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:32:33.494 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:32:33.494 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:32:33.495 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:32:33.495 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:32:33.495 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:32:33.495 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:32:33.495 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:32:33.496 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:32:33.496 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:32:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:32.183794+0000 mgr.smithi067.rdualw (mgr.24569) 10576 : cluster [DBG] pgmap v9109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:32:32.844637+0000 mgr.smithi067.rdualw (mgr.24569) 10577 : audit [DBG] from='client.41194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:32:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:32:33.490626+0000 mon.smithi061 (mon.0) 2230 : audit [DBG] from='client.? 172.21.15.61:0/2083968283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:32:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:32.183794+0000 mgr.smithi067.rdualw (mgr.24569) 10576 : cluster [DBG] pgmap v9109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:32:32.844637+0000 mgr.smithi067.rdualw (mgr.24569) 10577 : audit [DBG] from='client.41194 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:32:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:32:33.490626+0000 mon.smithi061 (mon.0) 2230 : audit [DBG] from='client.? 172.21.15.61:0/2083968283' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:32:35.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:32:33.134815+0000 mgr.smithi067.rdualw (mgr.24569) 10578 : audit [DBG] from='client.41198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:32:35.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:32:33.134815+0000 mgr.smithi067.rdualw (mgr.24569) 10578 : audit [DBG] from='client.41198 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:32:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:34.184385+0000 mgr.smithi067.rdualw (mgr.24569) 10579 : cluster [DBG] pgmap v9110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:34.184385+0000 mgr.smithi067.rdualw (mgr.24569) 10579 : cluster [DBG] pgmap v9110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:32:36.124313+0000 mon.smithi067 (mon.1) 1601 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:32:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:32:36.124574+0000 mon.smithi067 (mon.1) 1602 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:32:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:32:36.125265+0000 mon.smithi061 (mon.0) 2231 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:32:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:32:36.125558+0000 mon.smithi061 (mon.0) 2232 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:32:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:32:36.124313+0000 mon.smithi067 (mon.1) 1601 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:32:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:32:36.124574+0000 mon.smithi067 (mon.1) 1602 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:32:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:32:36.125265+0000 mon.smithi061 (mon.0) 2231 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:32:37.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:32:36.125558+0000 mon.smithi061 (mon.0) 2232 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:32:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:36.185200+0000 mgr.smithi067.rdualw (mgr.24569) 10580 : cluster [DBG] pgmap v9111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:32:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:36.185200+0000 mgr.smithi067.rdualw (mgr.24569) 10580 : cluster [DBG] pgmap v9111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:32:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:38.185745+0000 mgr.smithi067.rdualw (mgr.24569) 10581 : cluster [DBG] pgmap v9112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:38.185745+0000 mgr.smithi067.rdualw (mgr.24569) 10581 : cluster [DBG] pgmap v9112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:40.186357+0000 mgr.smithi067.rdualw (mgr.24569) 10582 : cluster [DBG] pgmap v9113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:40.186357+0000 mgr.smithi067.rdualw (mgr.24569) 10582 : cluster [DBG] pgmap v9113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:42.187394+0000 mgr.smithi067.rdualw (mgr.24569) 10583 : cluster [DBG] pgmap v9114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:42.187394+0000 mgr.smithi067.rdualw (mgr.24569) 10583 : cluster [DBG] pgmap v9114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:44.188064+0000 mgr.smithi067.rdualw (mgr.24569) 10584 : cluster [DBG] pgmap v9115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:44.188064+0000 mgr.smithi067.rdualw (mgr.24569) 10584 : cluster [DBG] pgmap v9115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:46.189096+0000 mgr.smithi067.rdualw (mgr.24569) 10585 : cluster [DBG] pgmap v9116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:32:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:46.189096+0000 mgr.smithi067.rdualw (mgr.24569) 10585 : cluster [DBG] pgmap v9116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:32:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:48.189744+0000 mgr.smithi067.rdualw (mgr.24569) 10586 : cluster [DBG] pgmap v9117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:48.189744+0000 mgr.smithi067.rdualw (mgr.24569) 10586 : cluster [DBG] pgmap v9117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:50.190317+0000 mgr.smithi067.rdualw (mgr.24569) 10587 : cluster [DBG] pgmap v9118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:50.190317+0000 mgr.smithi067.rdualw (mgr.24569) 10587 : cluster [DBG] pgmap v9118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:52.191190+0000 mgr.smithi067.rdualw (mgr.24569) 10588 : cluster [DBG] pgmap v9119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:52.191190+0000 mgr.smithi067.rdualw (mgr.24569) 10588 : cluster [DBG] pgmap v9119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:54.191790+0000 mgr.smithi067.rdualw (mgr.24569) 10589 : cluster [DBG] pgmap v9120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:54.191790+0000 mgr.smithi067.rdualw (mgr.24569) 10589 : cluster [DBG] pgmap v9120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:32:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:56.192665+0000 mgr.smithi067.rdualw (mgr.24569) 10590 : cluster [DBG] pgmap v9121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:32:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:32:57.614657+0000 mon.smithi067 (mon.1) 1603 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:32:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:32:57.616025+0000 mon.smithi067 (mon.1) 1604 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:32:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:32:57.616961+0000 mon.smithi067 (mon.1) 1605 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:32:58.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:32:58.033962+0000 mon.smithi061 (mon.0) 2233 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:32:58.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:32:58.039752+0000 mon.smithi061 (mon.0) 2234 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:32:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:56.192665+0000 mgr.smithi067.rdualw (mgr.24569) 10590 : cluster [DBG] pgmap v9121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:32:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:32:57.614657+0000 mon.smithi067 (mon.1) 1603 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:32:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:32:57.616025+0000 mon.smithi067 (mon.1) 1604 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:32:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:32:57.616961+0000 mon.smithi067 (mon.1) 1605 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:32:58.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:32:58.033962+0000 mon.smithi061 (mon.0) 2233 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:32:58.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:32:58.039752+0000 mon.smithi061 (mon.0) 2234 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:32:59.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:32:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:32:57.617808+0000 mgr.smithi067.rdualw (mgr.24569) 10591 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:32:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:32:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:32:57.617808+0000 mgr.smithi067.rdualw (mgr.24569) 10591 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:33:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:32:58.193290+0000 mgr.smithi067.rdualw (mgr.24569) 10592 : cluster [DBG] pgmap v9122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:32:58.193290+0000 mgr.smithi067.rdualw (mgr.24569) 10592 : cluster [DBG] pgmap v9122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:01.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:00.193929+0000 mgr.smithi067.rdualw (mgr.24569) 10593 : cluster [DBG] pgmap v9123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:01.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:00.193929+0000 mgr.smithi067.rdualw (mgr.24569) 10593 : cluster [DBG] pgmap v9123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:03.801 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:33:04.092 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:33:04.092 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 6m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:33:04.092 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 6m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:33:04.093 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 6m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:33:04.093 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 6m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:33:04.093 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 6m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:33:04.093 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 6m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:33:04.094 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 6m ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:33:04.094 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 6m ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:33:04.094 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 6m ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:33:04.094 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 6m ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:33:04.094 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 6m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:33:04.095 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 6m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:33:04.095 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 6m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:33:04.095 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 6m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:33:04.095 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 6m ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:33:04.096 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 6m ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:33:04.096 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 6m ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:33:04.096 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 6m ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:33:04.096 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 6m ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:33:04.097 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 6m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:33:04.097 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 6m ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:33:04.097 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 6m ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:33:04.097 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 6m ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:33:04.430 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:33:04.431 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:33:04.431 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:33:04.431 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:33:04.432 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:33:04.432 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:33:04.432 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:33:04.432 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:33:04.433 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:33:04.433 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:33:04.433 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:33:04.433 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:33:04.433 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:33:04.434 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:33:04.434 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:33:04.434 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:33:04.434 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:33:04.435 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:33:04.435 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:33:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:02.194887+0000 mgr.smithi067.rdualw (mgr.24569) 10594 : cluster [DBG] pgmap v9124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:02.194887+0000 mgr.smithi067.rdualw (mgr.24569) 10594 : cluster [DBG] pgmap v9124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:33:03.787511+0000 mgr.smithi067.rdualw (mgr.24569) 10595 : audit [DBG] from='client.41206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:33:05.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:33:04.074153+0000 mgr.smithi067.rdualw (mgr.24569) 10596 : audit [DBG] from='client.41210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:33:05.317 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:33:04.429289+0000 mon.smithi061 (mon.0) 2235 : audit [DBG] from='client.? 172.21.15.61:0/3939710859' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:33:05.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:33:03.787511+0000 mgr.smithi067.rdualw (mgr.24569) 10595 : audit [DBG] from='client.41206 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:33:05.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:33:04.074153+0000 mgr.smithi067.rdualw (mgr.24569) 10596 : audit [DBG] from='client.41210 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:33:05.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:33:04.429289+0000 mon.smithi061 (mon.0) 2235 : audit [DBG] from='client.? 172.21.15.61:0/3939710859' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:33:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:04.195442+0000 mgr.smithi067.rdualw (mgr.24569) 10597 : cluster [DBG] pgmap v9125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:04.195442+0000 mgr.smithi067.rdualw (mgr.24569) 10597 : cluster [DBG] pgmap v9125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:06.196291+0000 mgr.smithi067.rdualw (mgr.24569) 10598 : cluster [DBG] pgmap v9126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:33:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:06.196291+0000 mgr.smithi067.rdualw (mgr.24569) 10598 : cluster [DBG] pgmap v9126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:33:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:08.196758+0000 mgr.smithi067.rdualw (mgr.24569) 10599 : cluster [DBG] pgmap v9127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:08.196758+0000 mgr.smithi067.rdualw (mgr.24569) 10599 : cluster [DBG] pgmap v9127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:10.197340+0000 mgr.smithi067.rdualw (mgr.24569) 10600 : cluster [DBG] pgmap v9128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:10.197340+0000 mgr.smithi067.rdualw (mgr.24569) 10600 : cluster [DBG] pgmap v9128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:12.198262+0000 mgr.smithi067.rdualw (mgr.24569) 10601 : cluster [DBG] pgmap v9129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:12.198262+0000 mgr.smithi067.rdualw (mgr.24569) 10601 : cluster [DBG] pgmap v9129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:14.198793+0000 mgr.smithi067.rdualw (mgr.24569) 10602 : cluster [DBG] pgmap v9130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:14.198793+0000 mgr.smithi067.rdualw (mgr.24569) 10602 : cluster [DBG] pgmap v9130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:18.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:16.199704+0000 mgr.smithi067.rdualw (mgr.24569) 10603 : cluster [DBG] pgmap v9131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:33:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:16.199704+0000 mgr.smithi067.rdualw (mgr.24569) 10603 : cluster [DBG] pgmap v9131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:33:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:18.200275+0000 mgr.smithi067.rdualw (mgr.24569) 10604 : cluster [DBG] pgmap v9132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:18.200275+0000 mgr.smithi067.rdualw (mgr.24569) 10604 : cluster [DBG] pgmap v9132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:20.200893+0000 mgr.smithi067.rdualw (mgr.24569) 10605 : cluster [DBG] pgmap v9133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:20.200893+0000 mgr.smithi067.rdualw (mgr.24569) 10605 : cluster [DBG] pgmap v9133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:22.201833+0000 mgr.smithi067.rdualw (mgr.24569) 10606 : cluster [DBG] pgmap v9134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:22.201833+0000 mgr.smithi067.rdualw (mgr.24569) 10606 : cluster [DBG] pgmap v9134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:24.202568+0000 mgr.smithi067.rdualw (mgr.24569) 10607 : cluster [DBG] pgmap v9135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:24.202568+0000 mgr.smithi067.rdualw (mgr.24569) 10607 : cluster [DBG] pgmap v9135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:26.203368+0000 mgr.smithi067.rdualw (mgr.24569) 10608 : cluster [DBG] pgmap v9136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:33:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:26.203368+0000 mgr.smithi067.rdualw (mgr.24569) 10608 : cluster [DBG] pgmap v9136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:33:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:28.204060+0000 mgr.smithi067.rdualw (mgr.24569) 10609 : cluster [DBG] pgmap v9137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:28.204060+0000 mgr.smithi067.rdualw (mgr.24569) 10609 : cluster [DBG] pgmap v9137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:30.204658+0000 mgr.smithi067.rdualw (mgr.24569) 10610 : cluster [DBG] pgmap v9138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:30.204658+0000 mgr.smithi067.rdualw (mgr.24569) 10610 : cluster [DBG] pgmap v9138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:32.205503+0000 mgr.smithi067.rdualw (mgr.24569) 10611 : cluster [DBG] pgmap v9139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:32.205503+0000 mgr.smithi067.rdualw (mgr.24569) 10611 : cluster [DBG] pgmap v9139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:34.769 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:33:35.064 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:33:35.065 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 6m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:33:35.065 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 6m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:33:35.065 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 6m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:33:35.065 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 6m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:33:35.066 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 6m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:33:35.066 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 6m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:33:35.066 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 6m ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:33:35.066 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 6m ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:33:35.067 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 6m ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:33:35.067 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 6m ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:33:35.067 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 6m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:33:35.067 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 6m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:33:35.067 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 6m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:33:35.068 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 6m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:33:35.068 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 6m ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:33:35.068 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 6m ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:33:35.069 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 6m ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:33:35.069 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 6m ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:33:35.069 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 6m ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:33:35.069 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 6m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:33:35.070 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 6m ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:33:35.070 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 6m ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:33:35.070 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 6m ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:33:35.404 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:33:35.404 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:33:35.404 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:33:35.405 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:33:35.405 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:33:35.405 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:33:35.405 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:33:35.406 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:33:35.406 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:33:35.406 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:33:35.406 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:33:35.407 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:33:35.407 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:33:35.407 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:33:35.407 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:33:35.408 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:33:35.408 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:33:35.408 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:33:35.408 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:33:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:34.206100+0000 mgr.smithi067.rdualw (mgr.24569) 10612 : cluster [DBG] pgmap v9140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:33:34.753803+0000 mgr.smithi067.rdualw (mgr.24569) 10613 : audit [DBG] from='client.41218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:33:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:33:35.046825+0000 mgr.smithi067.rdualw (mgr.24569) 10614 : audit [DBG] from='client.41222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:33:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:33:35.402789+0000 mon.smithi061 (mon.0) 2236 : audit [DBG] from='client.? 172.21.15.61:0/1331259153' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:33:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:34.206100+0000 mgr.smithi067.rdualw (mgr.24569) 10612 : cluster [DBG] pgmap v9140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:33:34.753803+0000 mgr.smithi067.rdualw (mgr.24569) 10613 : audit [DBG] from='client.41218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:33:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:33:35.046825+0000 mgr.smithi067.rdualw (mgr.24569) 10614 : audit [DBG] from='client.41222 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:33:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:33:35.402789+0000 mon.smithi061 (mon.0) 2236 : audit [DBG] from='client.? 172.21.15.61:0/1331259153' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:33:37.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:33:36.130653+0000 mon.smithi067 (mon.1) 1606 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:33:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:33:36.130884+0000 mon.smithi067 (mon.1) 1607 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:33:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:33:36.131213+0000 mon.smithi061 (mon.0) 2237 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:33:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:33:36.131683+0000 mon.smithi061 (mon.0) 2238 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:33:37.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:33:36.130653+0000 mon.smithi067 (mon.1) 1606 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:33:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:33:36.130884+0000 mon.smithi067 (mon.1) 1607 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:33:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:33:36.131213+0000 mon.smithi061 (mon.0) 2237 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:33:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:33:36.131683+0000 mon.smithi061 (mon.0) 2238 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:33:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:36.207071+0000 mgr.smithi067.rdualw (mgr.24569) 10615 : cluster [DBG] pgmap v9141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:33:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:36.207071+0000 mgr.smithi067.rdualw (mgr.24569) 10615 : cluster [DBG] pgmap v9141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:33:39.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:38.207613+0000 mgr.smithi067.rdualw (mgr.24569) 10616 : cluster [DBG] pgmap v9142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:39.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:38.207613+0000 mgr.smithi067.rdualw (mgr.24569) 10616 : cluster [DBG] pgmap v9142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:41.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:40.208154+0000 mgr.smithi067.rdualw (mgr.24569) 10617 : cluster [DBG] pgmap v9143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:41.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:40.208154+0000 mgr.smithi067.rdualw (mgr.24569) 10617 : cluster [DBG] pgmap v9143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:42.209048+0000 mgr.smithi067.rdualw (mgr.24569) 10618 : cluster [DBG] pgmap v9144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:42.209048+0000 mgr.smithi067.rdualw (mgr.24569) 10618 : cluster [DBG] pgmap v9144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:44.209797+0000 mgr.smithi067.rdualw (mgr.24569) 10619 : cluster [DBG] pgmap v9145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:44.209797+0000 mgr.smithi067.rdualw (mgr.24569) 10619 : cluster [DBG] pgmap v9145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:46.210630+0000 mgr.smithi067.rdualw (mgr.24569) 10620 : cluster [DBG] pgmap v9146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:33:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:46.210630+0000 mgr.smithi067.rdualw (mgr.24569) 10620 : cluster [DBG] pgmap v9146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:33:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:48.211079+0000 mgr.smithi067.rdualw (mgr.24569) 10621 : cluster [DBG] pgmap v9147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:48.211079+0000 mgr.smithi067.rdualw (mgr.24569) 10621 : cluster [DBG] pgmap v9147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:50.211790+0000 mgr.smithi067.rdualw (mgr.24569) 10622 : cluster [DBG] pgmap v9148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:50.211790+0000 mgr.smithi067.rdualw (mgr.24569) 10622 : cluster [DBG] pgmap v9148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:52.212624+0000 mgr.smithi067.rdualw (mgr.24569) 10623 : cluster [DBG] pgmap v9149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:52.212624+0000 mgr.smithi067.rdualw (mgr.24569) 10623 : cluster [DBG] pgmap v9149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:54.213271+0000 mgr.smithi067.rdualw (mgr.24569) 10624 : cluster [DBG] pgmap v9150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:54.213271+0000 mgr.smithi067.rdualw (mgr.24569) 10624 : cluster [DBG] pgmap v9150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:33:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:56.214192+0000 mgr.smithi067.rdualw (mgr.24569) 10625 : cluster [DBG] pgmap v9151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:33:58.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:33:58.042667+0000 mon.smithi067 (mon.1) 1608 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:33:58.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:33:58.044127+0000 mon.smithi067 (mon.1) 1609 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:33:58.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:33:58.045012+0000 mon.smithi067 (mon.1) 1610 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:33:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:56.214192+0000 mgr.smithi067.rdualw (mgr.24569) 10625 : cluster [DBG] pgmap v9151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:33:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:33:58.042667+0000 mon.smithi067 (mon.1) 1608 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:33:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:33:58.044127+0000 mon.smithi067 (mon.1) 1609 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:33:58.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:33:58.045012+0000 mon.smithi067 (mon.1) 1610 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:33:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:33:58.045851+0000 mgr.smithi067.rdualw (mgr.24569) 10626 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:33:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:33:58.462724+0000 mon.smithi061 (mon.0) 2239 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:33:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:33:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:33:58.468222+0000 mon.smithi061 (mon.0) 2240 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:33:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:33:58.045851+0000 mgr.smithi067.rdualw (mgr.24569) 10626 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:33:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:33:58.462724+0000 mon.smithi061 (mon.0) 2239 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:33:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:33:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:33:58.468222+0000 mon.smithi061 (mon.0) 2240 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:34:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:33:58.214632+0000 mgr.smithi067.rdualw (mgr.24569) 10627 : cluster [DBG] pgmap v9152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:33:58.214632+0000 mgr.smithi067.rdualw (mgr.24569) 10627 : cluster [DBG] pgmap v9152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:00.215447+0000 mgr.smithi067.rdualw (mgr.24569) 10628 : cluster [DBG] pgmap v9153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:00.215447+0000 mgr.smithi067.rdualw (mgr.24569) 10628 : cluster [DBG] pgmap v9153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:04.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:02.216250+0000 mgr.smithi067.rdualw (mgr.24569) 10629 : cluster [DBG] pgmap v9154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:02.216250+0000 mgr.smithi067.rdualw (mgr.24569) 10629 : cluster [DBG] pgmap v9154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:05.713 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:34:06.001 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:34:06.002 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 7m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:34:06.002 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 7m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:34:06.002 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 7m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:34:06.002 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 7m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:34:06.003 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 7m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:34:06.003 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 7m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:34:06.003 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 7m ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:34:06.004 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 7m ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:34:06.004 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 7m ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:34:06.004 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 7m ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:34:06.005 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 7m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:34:06.005 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 7m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:34:06.005 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 7m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:34:06.005 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 7m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:34:06.006 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 7m ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:34:06.006 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 7m ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:34:06.006 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 7m ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:34:06.006 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 7m ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:34:06.007 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 7m ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:34:06.007 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 7m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:34:06.007 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 7m ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:34:06.007 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 7m ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:34:06.008 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 7m ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:34:06.343 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:34:06.343 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:34:06.343 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:34:06.344 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:34:06.344 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:34:06.344 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:34:06.344 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:34:06.345 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:34:06.345 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:34:06.345 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:34:06.345 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:34:06.345 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:34:06.346 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:34:06.346 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:34:06.346 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:34:06.346 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:34:06.347 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:34:06.347 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:34:06.347 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:34:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:04.216827+0000 mgr.smithi067.rdualw (mgr.24569) 10630 : cluster [DBG] pgmap v9155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:04.216827+0000 mgr.smithi067.rdualw (mgr.24569) 10630 : cluster [DBG] pgmap v9155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:07.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:34:05.699170+0000 mgr.smithi067.rdualw (mgr.24569) 10631 : audit [DBG] from='client.41230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:34:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:34:05.983407+0000 mgr.smithi067.rdualw (mgr.24569) 10632 : audit [DBG] from='client.41234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:34:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:34:06.341518+0000 mon.smithi061 (mon.0) 2241 : audit [DBG] from='client.? 172.21.15.61:0/2086386203' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:34:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:34:05.699170+0000 mgr.smithi067.rdualw (mgr.24569) 10631 : audit [DBG] from='client.41230 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:34:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:34:05.983407+0000 mgr.smithi067.rdualw (mgr.24569) 10632 : audit [DBG] from='client.41234 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:34:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:34:06.341518+0000 mon.smithi061 (mon.0) 2241 : audit [DBG] from='client.? 172.21.15.61:0/2086386203' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:34:08.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:06.217671+0000 mgr.smithi067.rdualw (mgr.24569) 10633 : cluster [DBG] pgmap v9156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:34:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:06.217671+0000 mgr.smithi067.rdualw (mgr.24569) 10633 : cluster [DBG] pgmap v9156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:34:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:08.218164+0000 mgr.smithi067.rdualw (mgr.24569) 10634 : cluster [DBG] pgmap v9157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:08.218164+0000 mgr.smithi067.rdualw (mgr.24569) 10634 : cluster [DBG] pgmap v9157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:10.218842+0000 mgr.smithi067.rdualw (mgr.24569) 10635 : cluster [DBG] pgmap v9158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:10.218842+0000 mgr.smithi067.rdualw (mgr.24569) 10635 : cluster [DBG] pgmap v9158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:14.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:12.219797+0000 mgr.smithi067.rdualw (mgr.24569) 10636 : cluster [DBG] pgmap v9159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:12.219797+0000 mgr.smithi067.rdualw (mgr.24569) 10636 : cluster [DBG] pgmap v9159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:14.220418+0000 mgr.smithi067.rdualw (mgr.24569) 10637 : cluster [DBG] pgmap v9160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:14.220418+0000 mgr.smithi067.rdualw (mgr.24569) 10637 : cluster [DBG] pgmap v9160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:16.221451+0000 mgr.smithi067.rdualw (mgr.24569) 10638 : cluster [DBG] pgmap v9161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:34:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:16.221451+0000 mgr.smithi067.rdualw (mgr.24569) 10638 : cluster [DBG] pgmap v9161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:34:19.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:18.221967+0000 mgr.smithi067.rdualw (mgr.24569) 10639 : cluster [DBG] pgmap v9162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:18.221967+0000 mgr.smithi067.rdualw (mgr.24569) 10639 : cluster [DBG] pgmap v9162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:21.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:20.222734+0000 mgr.smithi067.rdualw (mgr.24569) 10640 : cluster [DBG] pgmap v9163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:21.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:20.222734+0000 mgr.smithi067.rdualw (mgr.24569) 10640 : cluster [DBG] pgmap v9163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:22.223748+0000 mgr.smithi067.rdualw (mgr.24569) 10641 : cluster [DBG] pgmap v9164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:22.223748+0000 mgr.smithi067.rdualw (mgr.24569) 10641 : cluster [DBG] pgmap v9164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:24.224341+0000 mgr.smithi067.rdualw (mgr.24569) 10642 : cluster [DBG] pgmap v9165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:24.224341+0000 mgr.smithi067.rdualw (mgr.24569) 10642 : cluster [DBG] pgmap v9165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:26.225196+0000 mgr.smithi067.rdualw (mgr.24569) 10643 : cluster [DBG] pgmap v9166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:34:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:26.225196+0000 mgr.smithi067.rdualw (mgr.24569) 10643 : cluster [DBG] pgmap v9166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:34:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:28.225892+0000 mgr.smithi067.rdualw (mgr.24569) 10644 : cluster [DBG] pgmap v9167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:28.225892+0000 mgr.smithi067.rdualw (mgr.24569) 10644 : cluster [DBG] pgmap v9167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:32.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:30.226582+0000 mgr.smithi067.rdualw (mgr.24569) 10645 : cluster [DBG] pgmap v9168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:30.226582+0000 mgr.smithi067.rdualw (mgr.24569) 10645 : cluster [DBG] pgmap v9168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:32.227615+0000 mgr.smithi067.rdualw (mgr.24569) 10646 : cluster [DBG] pgmap v9169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:32.227615+0000 mgr.smithi067.rdualw (mgr.24569) 10646 : cluster [DBG] pgmap v9169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:34.228182+0000 mgr.smithi067.rdualw (mgr.24569) 10647 : cluster [DBG] pgmap v9170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:34.228182+0000 mgr.smithi067.rdualw (mgr.24569) 10647 : cluster [DBG] pgmap v9170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:36.658 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:34:36.969 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:34:36.970 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 7m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:34:36.970 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 7m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:34:36.971 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 7m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:34:36.971 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 7m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:34:36.972 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 7m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:34:36.972 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 7m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:34:36.972 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 7m ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:34:36.973 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 7m ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:34:36.973 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 7m ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:34:36.973 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 7m ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:34:36.974 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 7m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:34:36.974 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 7m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:34:36.975 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 7m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:34:36.975 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 7m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:34:36.975 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 7m ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:34:36.976 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 7m ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:34:36.976 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 7m ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:34:36.977 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 7m ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:34:36.977 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 7m ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:34:36.977 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 7m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:34:36.978 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 7m ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:34:36.978 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 7m ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:34:36.979 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 7m ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:34:37.312 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:34:37.313 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:34:37.313 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:34:37.313 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:34:37.313 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:34:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:34:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:34:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:34:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:34:37.314 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:34:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:34:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:34:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:34:37.315 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:34:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:34:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:34:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:34:37.316 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:34:37.316 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:34:37.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:34:36.136032+0000 mon.smithi067 (mon.1) 1611 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:34:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:34:36.136304+0000 mon.smithi067 (mon.1) 1612 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:34:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:34:36.136688+0000 mon.smithi061 (mon.0) 2242 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:34:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:34:36.136995+0000 mon.smithi061 (mon.0) 2243 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:34:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:34:36.136032+0000 mon.smithi067 (mon.1) 1611 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:34:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:34:36.136304+0000 mon.smithi067 (mon.1) 1612 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:34:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:34:36.136688+0000 mon.smithi061 (mon.0) 2242 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:34:37.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:34:36.136995+0000 mon.smithi061 (mon.0) 2243 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:34:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:36.229201+0000 mgr.smithi067.rdualw (mgr.24569) 10648 : cluster [DBG] pgmap v9171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:34:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:34:36.644262+0000 mgr.smithi067.rdualw (mgr.24569) 10649 : audit [DBG] from='client.41242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:34:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:34:36.951876+0000 mgr.smithi067.rdualw (mgr.24569) 10650 : audit [DBG] from='client.41246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:34:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:34:37.311106+0000 mon.smithi061 (mon.0) 2244 : audit [DBG] from='client.? 172.21.15.61:0/3069964413' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:34:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:36.229201+0000 mgr.smithi067.rdualw (mgr.24569) 10648 : cluster [DBG] pgmap v9171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:34:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:34:36.644262+0000 mgr.smithi067.rdualw (mgr.24569) 10649 : audit [DBG] from='client.41242 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:34:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:34:36.951876+0000 mgr.smithi067.rdualw (mgr.24569) 10650 : audit [DBG] from='client.41246 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:34:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:34:37.311106+0000 mon.smithi061 (mon.0) 2244 : audit [DBG] from='client.? 172.21.15.61:0/3069964413' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:34:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:38.229757+0000 mgr.smithi067.rdualw (mgr.24569) 10651 : cluster [DBG] pgmap v9172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:38.229757+0000 mgr.smithi067.rdualw (mgr.24569) 10651 : cluster [DBG] pgmap v9172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:40.230610+0000 mgr.smithi067.rdualw (mgr.24569) 10652 : cluster [DBG] pgmap v9173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:40.230610+0000 mgr.smithi067.rdualw (mgr.24569) 10652 : cluster [DBG] pgmap v9173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:42.231506+0000 mgr.smithi067.rdualw (mgr.24569) 10653 : cluster [DBG] pgmap v9174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:42.231506+0000 mgr.smithi067.rdualw (mgr.24569) 10653 : cluster [DBG] pgmap v9174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:44.232319+0000 mgr.smithi067.rdualw (mgr.24569) 10654 : cluster [DBG] pgmap v9175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:44.232319+0000 mgr.smithi067.rdualw (mgr.24569) 10654 : cluster [DBG] pgmap v9175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:46.233232+0000 mgr.smithi067.rdualw (mgr.24569) 10655 : cluster [DBG] pgmap v9176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:34:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:46.233232+0000 mgr.smithi067.rdualw (mgr.24569) 10655 : cluster [DBG] pgmap v9176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:34:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:48.233843+0000 mgr.smithi067.rdualw (mgr.24569) 10656 : cluster [DBG] pgmap v9177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:48.233843+0000 mgr.smithi067.rdualw (mgr.24569) 10656 : cluster [DBG] pgmap v9177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:50.234471+0000 mgr.smithi067.rdualw (mgr.24569) 10657 : cluster [DBG] pgmap v9178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:50.234471+0000 mgr.smithi067.rdualw (mgr.24569) 10657 : cluster [DBG] pgmap v9178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:52.235469+0000 mgr.smithi067.rdualw (mgr.24569) 10658 : cluster [DBG] pgmap v9179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:52.235469+0000 mgr.smithi067.rdualw (mgr.24569) 10658 : cluster [DBG] pgmap v9179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:54.236071+0000 mgr.smithi067.rdualw (mgr.24569) 10659 : cluster [DBG] pgmap v9180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:54.236071+0000 mgr.smithi067.rdualw (mgr.24569) 10659 : cluster [DBG] pgmap v9180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:34:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:56.236940+0000 mgr.smithi067.rdualw (mgr.24569) 10660 : cluster [DBG] pgmap v9181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:34:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:56.236940+0000 mgr.smithi067.rdualw (mgr.24569) 10660 : cluster [DBG] pgmap v9181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:34:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:34:58.471257+0000 mon.smithi067 (mon.1) 1613 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:34:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:34:58.472805+0000 mon.smithi067 (mon.1) 1614 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:34:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:34:58.473793+0000 mon.smithi067 (mon.1) 1615 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:34:59.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:34:58.888780+0000 mon.smithi061 (mon.0) 2245 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:34:59.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:34:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:34:58.894238+0000 mon.smithi061 (mon.0) 2246 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:34:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:34:58.471257+0000 mon.smithi067 (mon.1) 1613 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:34:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:34:58.472805+0000 mon.smithi067 (mon.1) 1614 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:34:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:34:58.473793+0000 mon.smithi067 (mon.1) 1615 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:34:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:34:58.888780+0000 mon.smithi061 (mon.0) 2245 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:34:59.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:34:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:34:58.894238+0000 mon.smithi061 (mon.0) 2246 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:35:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:34:58.237473+0000 mgr.smithi067.rdualw (mgr.24569) 10661 : cluster [DBG] pgmap v9182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:34:58.474721+0000 mgr.smithi067.rdualw (mgr.24569) 10662 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:35:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:34:58.237473+0000 mgr.smithi067.rdualw (mgr.24569) 10661 : cluster [DBG] pgmap v9182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:34:58.474721+0000 mgr.smithi067.rdualw (mgr.24569) 10662 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:35:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:00.238240+0000 mgr.smithi067.rdualw (mgr.24569) 10663 : cluster [DBG] pgmap v9183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:00.238240+0000 mgr.smithi067.rdualw (mgr.24569) 10663 : cluster [DBG] pgmap v9183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:03.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:02.239180+0000 mgr.smithi067.rdualw (mgr.24569) 10664 : cluster [DBG] pgmap v9184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:03.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:02.239180+0000 mgr.smithi067.rdualw (mgr.24569) 10664 : cluster [DBG] pgmap v9184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:05.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:04.239792+0000 mgr.smithi067.rdualw (mgr.24569) 10665 : cluster [DBG] pgmap v9185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:05.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:04.239792+0000 mgr.smithi067.rdualw (mgr.24569) 10665 : cluster [DBG] pgmap v9185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:07.643 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:35:08.161 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:35:08.162 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 8m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:35:08.163 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 8m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:35:08.163 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 8m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:35:08.163 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 8m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:35:08.163 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 8m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:35:08.164 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 8m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:35:08.164 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 8m ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:35:08.164 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 8m ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:35:08.164 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 8m ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:35:08.164 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 8m ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:35:08.165 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 8m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:35:08.165 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 8m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:35:08.165 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 8m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:35:08.165 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 8m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:35:08.166 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 8m ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:35:08.166 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 8m ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:35:08.166 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 8m ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:35:08.166 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 8m ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:35:08.166 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 8m ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:35:08.167 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 8m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:35:08.167 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 8m ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:35:08.167 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 8m ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:35:08.167 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 8m ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:35:08.339 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:35:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:35:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:35:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:35:08.340 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:35:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:35:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:35:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:35:08.341 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:35:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:35:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:35:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:35:08.342 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:35:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:35:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:35:08.343 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:35:08.344 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:35:08.344 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:35:08.344 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:35:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:06.240657+0000 mgr.smithi067.rdualw (mgr.24569) 10666 : cluster [DBG] pgmap v9186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:35:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:06.240657+0000 mgr.smithi067.rdualw (mgr.24569) 10666 : cluster [DBG] pgmap v9186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:35:09.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:35:07.629259+0000 mgr.smithi067.rdualw (mgr.24569) 10667 : audit [DBG] from='client.41254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:35:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:35:07.973430+0000 mgr.smithi067.rdualw (mgr.24569) 10668 : audit [DBG] from='client.41258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:35:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:35:08.338207+0000 mon.smithi061 (mon.0) 2247 : audit [DBG] from='client.? 172.21.15.61:0/327548992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:35:09.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:35:07.629259+0000 mgr.smithi067.rdualw (mgr.24569) 10667 : audit [DBG] from='client.41254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:35:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:35:07.973430+0000 mgr.smithi067.rdualw (mgr.24569) 10668 : audit [DBG] from='client.41258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:35:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:35:08.338207+0000 mon.smithi061 (mon.0) 2247 : audit [DBG] from='client.? 172.21.15.61:0/327548992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:35:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:08.241212+0000 mgr.smithi067.rdualw (mgr.24569) 10669 : cluster [DBG] pgmap v9187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:08.241212+0000 mgr.smithi067.rdualw (mgr.24569) 10669 : cluster [DBG] pgmap v9187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:10.242070+0000 mgr.smithi067.rdualw (mgr.24569) 10670 : cluster [DBG] pgmap v9188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:10.242070+0000 mgr.smithi067.rdualw (mgr.24569) 10670 : cluster [DBG] pgmap v9188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:12.243084+0000 mgr.smithi067.rdualw (mgr.24569) 10671 : cluster [DBG] pgmap v9189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:12.243084+0000 mgr.smithi067.rdualw (mgr.24569) 10671 : cluster [DBG] pgmap v9189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:14.243847+0000 mgr.smithi067.rdualw (mgr.24569) 10672 : cluster [DBG] pgmap v9190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:14.243847+0000 mgr.smithi067.rdualw (mgr.24569) 10672 : cluster [DBG] pgmap v9190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:16.244629+0000 mgr.smithi067.rdualw (mgr.24569) 10673 : cluster [DBG] pgmap v9191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:35:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:16.244629+0000 mgr.smithi067.rdualw (mgr.24569) 10673 : cluster [DBG] pgmap v9191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:35:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:18.245313+0000 mgr.smithi067.rdualw (mgr.24569) 10674 : cluster [DBG] pgmap v9192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:18.245313+0000 mgr.smithi067.rdualw (mgr.24569) 10674 : cluster [DBG] pgmap v9192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:20.246041+0000 mgr.smithi067.rdualw (mgr.24569) 10675 : cluster [DBG] pgmap v9193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:20.246041+0000 mgr.smithi067.rdualw (mgr.24569) 10675 : cluster [DBG] pgmap v9193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:22.246859+0000 mgr.smithi067.rdualw (mgr.24569) 10676 : cluster [DBG] pgmap v9194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:22.246859+0000 mgr.smithi067.rdualw (mgr.24569) 10676 : cluster [DBG] pgmap v9194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:24.247668+0000 mgr.smithi067.rdualw (mgr.24569) 10677 : cluster [DBG] pgmap v9195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:24.247668+0000 mgr.smithi067.rdualw (mgr.24569) 10677 : cluster [DBG] pgmap v9195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:26.248565+0000 mgr.smithi067.rdualw (mgr.24569) 10678 : cluster [DBG] pgmap v9196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:35:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:26.248565+0000 mgr.smithi067.rdualw (mgr.24569) 10678 : cluster [DBG] pgmap v9196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:35:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:28.249216+0000 mgr.smithi067.rdualw (mgr.24569) 10679 : cluster [DBG] pgmap v9197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:28.249216+0000 mgr.smithi067.rdualw (mgr.24569) 10679 : cluster [DBG] pgmap v9197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:30.249942+0000 mgr.smithi067.rdualw (mgr.24569) 10680 : cluster [DBG] pgmap v9198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:30.249942+0000 mgr.smithi067.rdualw (mgr.24569) 10680 : cluster [DBG] pgmap v9198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:32.250805+0000 mgr.smithi067.rdualw (mgr.24569) 10681 : cluster [DBG] pgmap v9199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:32.250805+0000 mgr.smithi067.rdualw (mgr.24569) 10681 : cluster [DBG] pgmap v9199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:34.251499+0000 mgr.smithi067.rdualw (mgr.24569) 10682 : cluster [DBG] pgmap v9200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:34.251499+0000 mgr.smithi067.rdualw (mgr.24569) 10682 : cluster [DBG] pgmap v9200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:37.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:35:36.142095+0000 mon.smithi067 (mon.1) 1616 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:35:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:35:36.142342+0000 mon.smithi067 (mon.1) 1617 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:35:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:35:36.142652+0000 mon.smithi061 (mon.0) 2248 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:35:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:35:36.143008+0000 mon.smithi061 (mon.0) 2249 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:35:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:35:36.142095+0000 mon.smithi067 (mon.1) 1616 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:35:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:35:36.142342+0000 mon.smithi067 (mon.1) 1617 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:35:37.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:35:36.142652+0000 mon.smithi061 (mon.0) 2248 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:35:37.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:35:36.143008+0000 mon.smithi061 (mon.0) 2249 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:35:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:36.252347+0000 mgr.smithi067.rdualw (mgr.24569) 10683 : cluster [DBG] pgmap v9201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:35:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:36.252347+0000 mgr.smithi067.rdualw (mgr.24569) 10683 : cluster [DBG] pgmap v9201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:35:38.677 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:35:39.036 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:35:39.036 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 8m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:35:39.037 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 8m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:35:39.037 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 8m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:35:39.037 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 8m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:35:39.038 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 8m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:35:39.038 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 8m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:35:39.039 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 8m ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:35:39.039 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 8m ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:35:39.039 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 8m ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:35:39.040 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 8m ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:35:39.040 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 8m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:35:39.041 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 8m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:35:39.041 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 8m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:35:39.042 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 8m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:35:39.042 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 8m ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:35:39.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 8m ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:35:39.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 8m ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:35:39.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 8m ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:35:39.043 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 8m ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:35:39.044 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 8m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:35:39.044 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 8m ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:35:39.044 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 8m ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:35:39.044 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 8m ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:35:39.398 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:35:39.398 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:35:39.398 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:35:39.398 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:35:39.399 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:35:39.399 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:35:39.399 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:35:39.399 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:35:39.400 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:35:39.400 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:35:39.400 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:35:39.400 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:35:39.400 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:35:39.401 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:35:39.401 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:35:39.401 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:35:39.401 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:35:39.402 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:35:39.402 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:35:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:38.253089+0000 mgr.smithi067.rdualw (mgr.24569) 10684 : cluster [DBG] pgmap v9202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:35:38.661360+0000 mgr.smithi067.rdualw (mgr.24569) 10685 : audit [DBG] from='client.41266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:35:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:35:39.017687+0000 mgr.smithi067.rdualw (mgr.24569) 10686 : audit [DBG] from='client.41270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:35:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:35:39.396479+0000 mon.smithi061 (mon.0) 2250 : audit [DBG] from='client.? 172.21.15.61:0/174195932' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:35:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:38.253089+0000 mgr.smithi067.rdualw (mgr.24569) 10684 : cluster [DBG] pgmap v9202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:35:38.661360+0000 mgr.smithi067.rdualw (mgr.24569) 10685 : audit [DBG] from='client.41266 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:35:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:35:39.017687+0000 mgr.smithi067.rdualw (mgr.24569) 10686 : audit [DBG] from='client.41270 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:35:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:35:39.396479+0000 mon.smithi061 (mon.0) 2250 : audit [DBG] from='client.? 172.21.15.61:0/174195932' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:35:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:40.253695+0000 mgr.smithi067.rdualw (mgr.24569) 10687 : cluster [DBG] pgmap v9203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:40.253695+0000 mgr.smithi067.rdualw (mgr.24569) 10687 : cluster [DBG] pgmap v9203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:42.254641+0000 mgr.smithi067.rdualw (mgr.24569) 10688 : cluster [DBG] pgmap v9204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:42.254641+0000 mgr.smithi067.rdualw (mgr.24569) 10688 : cluster [DBG] pgmap v9204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:44.255258+0000 mgr.smithi067.rdualw (mgr.24569) 10689 : cluster [DBG] pgmap v9205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:44.255258+0000 mgr.smithi067.rdualw (mgr.24569) 10689 : cluster [DBG] pgmap v9205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:46.256196+0000 mgr.smithi067.rdualw (mgr.24569) 10690 : cluster [DBG] pgmap v9206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:35:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:46.256196+0000 mgr.smithi067.rdualw (mgr.24569) 10690 : cluster [DBG] pgmap v9206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:35:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:48.256807+0000 mgr.smithi067.rdualw (mgr.24569) 10691 : cluster [DBG] pgmap v9207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:48.256807+0000 mgr.smithi067.rdualw (mgr.24569) 10691 : cluster [DBG] pgmap v9207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:50.257581+0000 mgr.smithi067.rdualw (mgr.24569) 10692 : cluster [DBG] pgmap v9208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:50.257581+0000 mgr.smithi067.rdualw (mgr.24569) 10692 : cluster [DBG] pgmap v9208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:53.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:52.258332+0000 mgr.smithi067.rdualw (mgr.24569) 10693 : cluster [DBG] pgmap v9209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:53.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:52.258332+0000 mgr.smithi067.rdualw (mgr.24569) 10693 : cluster [DBG] pgmap v9209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:54.259120+0000 mgr.smithi067.rdualw (mgr.24569) 10694 : cluster [DBG] pgmap v9210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:55.716 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:54.259120+0000 mgr.smithi067.rdualw (mgr.24569) 10694 : cluster [DBG] pgmap v9210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:35:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:56.259991+0000 mgr.smithi067.rdualw (mgr.24569) 10695 : cluster [DBG] pgmap v9211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:35:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:56.259991+0000 mgr.smithi067.rdualw (mgr.24569) 10695 : cluster [DBG] pgmap v9211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:35:59.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:35:58.899669+0000 mon.smithi067 (mon.1) 1618 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:35:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:35:58.901053+0000 mon.smithi067 (mon.1) 1619 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:35:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:35:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:35:58.902004+0000 mon.smithi067 (mon.1) 1620 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:35:59.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:35:58.899669+0000 mon.smithi067 (mon.1) 1618 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:35:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:35:58.901053+0000 mon.smithi067 (mon.1) 1619 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:35:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:35:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:35:58.902004+0000 mon.smithi067 (mon.1) 1620 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:36:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:35:58.260528+0000 mgr.smithi067.rdualw (mgr.24569) 10696 : cluster [DBG] pgmap v9212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:35:58.902852+0000 mgr.smithi067.rdualw (mgr.24569) 10697 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:36:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:35:59.316898+0000 mon.smithi061 (mon.0) 2251 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:36:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:35:59.322519+0000 mon.smithi061 (mon.0) 2252 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:36:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:35:58.260528+0000 mgr.smithi067.rdualw (mgr.24569) 10696 : cluster [DBG] pgmap v9212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:35:58.902852+0000 mgr.smithi067.rdualw (mgr.24569) 10697 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:36:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:35:59.316898+0000 mon.smithi061 (mon.0) 2251 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:36:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:35:59.322519+0000 mon.smithi061 (mon.0) 2252 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:36:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:00.261180+0000 mgr.smithi067.rdualw (mgr.24569) 10698 : cluster [DBG] pgmap v9213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:00.261180+0000 mgr.smithi067.rdualw (mgr.24569) 10698 : cluster [DBG] pgmap v9213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:02.262058+0000 mgr.smithi067.rdualw (mgr.24569) 10699 : cluster [DBG] pgmap v9214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:02.262058+0000 mgr.smithi067.rdualw (mgr.24569) 10699 : cluster [DBG] pgmap v9214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:04.262722+0000 mgr.smithi067.rdualw (mgr.24569) 10700 : cluster [DBG] pgmap v9215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:04.262722+0000 mgr.smithi067.rdualw (mgr.24569) 10700 : cluster [DBG] pgmap v9215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:06.263596+0000 mgr.smithi067.rdualw (mgr.24569) 10701 : cluster [DBG] pgmap v9216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:36:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:06.263596+0000 mgr.smithi067.rdualw (mgr.24569) 10701 : cluster [DBG] pgmap v9216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:36:09.706 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:36:09.999 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:36:09.999 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 9m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:36:09.999 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 9m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:36:10.000 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 9m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:36:10.000 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 9m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:36:10.000 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 9m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:36:10.000 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 9m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:36:10.001 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 9m ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:36:10.001 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 9m ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:36:10.001 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 9m ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:36:10.001 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 9m ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:36:10.002 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 9m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:36:10.002 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 9m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:36:10.002 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 9m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:36:10.002 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 9m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:36:10.003 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 9m ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:36:10.003 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 9m ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:36:10.003 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 9m ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:36:10.003 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 9m ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:36:10.004 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 9m ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:36:10.004 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 9m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:36:10.004 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 9m ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:36:10.004 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 9m ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:36:10.005 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 9m ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:36:10.340 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:36:10.341 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:36:10.341 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:36:10.341 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:36:10.341 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:36:10.342 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:36:10.342 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:36:10.342 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:36:10.342 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:36:10.343 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:36:10.343 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:36:10.343 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:36:10.343 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:36:10.344 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:36:10.344 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:36:10.344 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:36:10.344 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:36:10.344 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:36:10.345 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:36:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:08.264090+0000 mgr.smithi067.rdualw (mgr.24569) 10702 : cluster [DBG] pgmap v9217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:08.264090+0000 mgr.smithi067.rdualw (mgr.24569) 10702 : cluster [DBG] pgmap v9217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:11.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:36:09.692696+0000 mgr.smithi067.rdualw (mgr.24569) 10703 : audit [DBG] from='client.41278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:36:11.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:36:09.981129+0000 mgr.smithi067.rdualw (mgr.24569) 10704 : audit [DBG] from='client.41282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:36:11.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:36:10.339582+0000 mon.smithi061 (mon.0) 2253 : audit [DBG] from='client.? 172.21.15.61:0/3684932006' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:36:11.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:36:09.692696+0000 mgr.smithi067.rdualw (mgr.24569) 10703 : audit [DBG] from='client.41278 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:36:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:36:09.981129+0000 mgr.smithi067.rdualw (mgr.24569) 10704 : audit [DBG] from='client.41282 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:36:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:36:10.339582+0000 mon.smithi061 (mon.0) 2253 : audit [DBG] from='client.? 172.21.15.61:0/3684932006' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:36:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:10.264772+0000 mgr.smithi067.rdualw (mgr.24569) 10705 : cluster [DBG] pgmap v9218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:10.264772+0000 mgr.smithi067.rdualw (mgr.24569) 10705 : cluster [DBG] pgmap v9218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:12.265726+0000 mgr.smithi067.rdualw (mgr.24569) 10706 : cluster [DBG] pgmap v9219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:12.265726+0000 mgr.smithi067.rdualw (mgr.24569) 10706 : cluster [DBG] pgmap v9219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:14.266485+0000 mgr.smithi067.rdualw (mgr.24569) 10707 : cluster [DBG] pgmap v9220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:14.266485+0000 mgr.smithi067.rdualw (mgr.24569) 10707 : cluster [DBG] pgmap v9220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:16.267440+0000 mgr.smithi067.rdualw (mgr.24569) 10708 : cluster [DBG] pgmap v9221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:36:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:16.267440+0000 mgr.smithi067.rdualw (mgr.24569) 10708 : cluster [DBG] pgmap v9221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:36:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:18.268080+0000 mgr.smithi067.rdualw (mgr.24569) 10709 : cluster [DBG] pgmap v9222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:18.268080+0000 mgr.smithi067.rdualw (mgr.24569) 10709 : cluster [DBG] pgmap v9222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:20.268649+0000 mgr.smithi067.rdualw (mgr.24569) 10710 : cluster [DBG] pgmap v9223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:20.268649+0000 mgr.smithi067.rdualw (mgr.24569) 10710 : cluster [DBG] pgmap v9223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:22.269523+0000 mgr.smithi067.rdualw (mgr.24569) 10711 : cluster [DBG] pgmap v9224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:22.269523+0000 mgr.smithi067.rdualw (mgr.24569) 10711 : cluster [DBG] pgmap v9224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:24.270055+0000 mgr.smithi067.rdualw (mgr.24569) 10712 : cluster [DBG] pgmap v9225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:24.270055+0000 mgr.smithi067.rdualw (mgr.24569) 10712 : cluster [DBG] pgmap v9225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:26.270931+0000 mgr.smithi067.rdualw (mgr.24569) 10713 : cluster [DBG] pgmap v9226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:36:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:26.270931+0000 mgr.smithi067.rdualw (mgr.24569) 10713 : cluster [DBG] pgmap v9226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:36:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:28.271663+0000 mgr.smithi067.rdualw (mgr.24569) 10714 : cluster [DBG] pgmap v9227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:28.271663+0000 mgr.smithi067.rdualw (mgr.24569) 10714 : cluster [DBG] pgmap v9227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:30.272346+0000 mgr.smithi067.rdualw (mgr.24569) 10715 : cluster [DBG] pgmap v9228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:30.272346+0000 mgr.smithi067.rdualw (mgr.24569) 10715 : cluster [DBG] pgmap v9228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:32.273160+0000 mgr.smithi067.rdualw (mgr.24569) 10716 : cluster [DBG] pgmap v9229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:32.273160+0000 mgr.smithi067.rdualw (mgr.24569) 10716 : cluster [DBG] pgmap v9229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:34.273758+0000 mgr.smithi067.rdualw (mgr.24569) 10717 : cluster [DBG] pgmap v9230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:36:36.147417+0000 mon.smithi067 (mon.1) 1621 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:36:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:36:36.147692+0000 mon.smithi067 (mon.1) 1622 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:36:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:36:36.148169+0000 mon.smithi061 (mon.0) 2254 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:36:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:36:36.148512+0000 mon.smithi061 (mon.0) 2255 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:36:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:34.273758+0000 mgr.smithi067.rdualw (mgr.24569) 10717 : cluster [DBG] pgmap v9230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:36:36.147417+0000 mon.smithi067 (mon.1) 1621 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:36:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:36:36.147692+0000 mon.smithi067 (mon.1) 1622 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:36:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:36:36.148169+0000 mon.smithi061 (mon.0) 2254 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:36:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:36:36.148512+0000 mon.smithi061 (mon.0) 2255 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:36:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:36.274639+0000 mgr.smithi067.rdualw (mgr.24569) 10718 : cluster [DBG] pgmap v9231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:36:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:36.274639+0000 mgr.smithi067.rdualw (mgr.24569) 10718 : cluster [DBG] pgmap v9231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:36:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:38.275353+0000 mgr.smithi067.rdualw (mgr.24569) 10719 : cluster [DBG] pgmap v9232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:38.275353+0000 mgr.smithi067.rdualw (mgr.24569) 10719 : cluster [DBG] pgmap v9232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:40.648 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:36:40.941 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:36:40.942 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 9m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:36:40.942 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 9m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:36:40.942 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 9m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:36:40.943 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 9m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:36:40.943 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 9m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:36:40.943 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 9m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:36:40.943 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 9m ago 5h 487M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:36:40.943 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 9m ago 5h 642M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:36:40.944 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 9m ago 5h 1895M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:36:40.944 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 9m ago 5h 1039M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:36:40.944 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 9m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:36:40.944 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 9m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:36:40.945 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 9m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:36:40.945 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 9m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:36:40.945 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 9m ago 5h 1231M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:36:40.945 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 9m ago 5h 2135M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:36:40.946 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 9m ago 5h 1342M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:36:40.946 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 9m ago 5h 2284M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:36:40.946 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 9m ago 5h 2105M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:36:40.946 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 9m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:36:40.946 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 9m ago 5h 1854M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:36:40.947 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 9m ago 5h 2823M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:36:40.947 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 9m ago 5h 160M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:36:41.283 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:36:41.283 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:36:41.283 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:36:41.284 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:36:41.284 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:36:41.284 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:36:41.284 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:36:41.285 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:36:41.285 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:36:41.285 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:36:41.285 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:36:41.286 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:36:41.286 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:36:41.286 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:36:41.286 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:36:41.286 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:36:41.287 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:36:41.287 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:36:41.287 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:36:41.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:40.275923+0000 mgr.smithi067.rdualw (mgr.24569) 10720 : cluster [DBG] pgmap v9233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:41.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:36:40.634820+0000 mgr.smithi067.rdualw (mgr.24569) 10721 : audit [DBG] from='client.41290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:36:41.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:36:40.923732+0000 mgr.smithi067.rdualw (mgr.24569) 10722 : audit [DBG] from='client.41294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:36:41.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:40.275923+0000 mgr.smithi067.rdualw (mgr.24569) 10720 : cluster [DBG] pgmap v9233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:36:40.634820+0000 mgr.smithi067.rdualw (mgr.24569) 10721 : audit [DBG] from='client.41290 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:36:41.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:36:40.923732+0000 mgr.smithi067.rdualw (mgr.24569) 10722 : audit [DBG] from='client.41294 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:36:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:36:41.281825+0000 mon.smithi061 (mon.0) 2256 : audit [DBG] from='client.? 172.21.15.61:0/1349945300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:36:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:36:41.281825+0000 mon.smithi061 (mon.0) 2256 : audit [DBG] from='client.? 172.21.15.61:0/1349945300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:36:43.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:42.276802+0000 mgr.smithi067.rdualw (mgr.24569) 10723 : cluster [DBG] pgmap v9234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:43.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:42.276802+0000 mgr.smithi067.rdualw (mgr.24569) 10723 : cluster [DBG] pgmap v9234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:45.724 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:44.277545+0000 mgr.smithi067.rdualw (mgr.24569) 10724 : cluster [DBG] pgmap v9235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:45.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:44.277545+0000 mgr.smithi067.rdualw (mgr.24569) 10724 : cluster [DBG] pgmap v9235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:46.278604+0000 mgr.smithi067.rdualw (mgr.24569) 10725 : cluster [DBG] pgmap v9236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:36:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:46.278604+0000 mgr.smithi067.rdualw (mgr.24569) 10725 : cluster [DBG] pgmap v9236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:36:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:48.279114+0000 mgr.smithi067.rdualw (mgr.24569) 10726 : cluster [DBG] pgmap v9237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:48.279114+0000 mgr.smithi067.rdualw (mgr.24569) 10726 : cluster [DBG] pgmap v9237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:50.279831+0000 mgr.smithi067.rdualw (mgr.24569) 10727 : cluster [DBG] pgmap v9238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:50.279831+0000 mgr.smithi067.rdualw (mgr.24569) 10727 : cluster [DBG] pgmap v9238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:52.280701+0000 mgr.smithi067.rdualw (mgr.24569) 10728 : cluster [DBG] pgmap v9239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:52.280701+0000 mgr.smithi067.rdualw (mgr.24569) 10728 : cluster [DBG] pgmap v9239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:54.281428+0000 mgr.smithi067.rdualw (mgr.24569) 10729 : cluster [DBG] pgmap v9240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:54.281428+0000 mgr.smithi067.rdualw (mgr.24569) 10729 : cluster [DBG] pgmap v9240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:36:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:36:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:56.282531+0000 mgr.smithi067.rdualw (mgr.24569) 10730 : cluster [DBG] pgmap v9241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:36:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:36:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:56.282531+0000 mgr.smithi067.rdualw (mgr.24569) 10730 : cluster [DBG] pgmap v9241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:37:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:36:58.283102+0000 mgr.smithi067.rdualw (mgr.24569) 10731 : cluster [DBG] pgmap v9242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:36:59.325514+0000 mon.smithi067 (mon.1) 1623 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:37:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:36:59.326970+0000 mon.smithi067 (mon.1) 1624 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:37:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:36:59.327911+0000 mon.smithi067 (mon.1) 1625 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:37:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:36:58.283102+0000 mgr.smithi067.rdualw (mgr.24569) 10731 : cluster [DBG] pgmap v9242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:36:59.325514+0000 mon.smithi067 (mon.1) 1623 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:37:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:36:59.326970+0000 mon.smithi067 (mon.1) 1624 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:37:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:36:59.327911+0000 mon.smithi067 (mon.1) 1625 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:37:01.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:36:59.328775+0000 mgr.smithi067.rdualw (mgr.24569) 10732 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:37:01.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:36:59.328775+0000 mgr.smithi067.rdualw (mgr.24569) 10732 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:37:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:00.283624+0000 mgr.smithi067.rdualw (mgr.24569) 10733 : cluster [DBG] pgmap v9243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:00.283624+0000 mgr.smithi067.rdualw (mgr.24569) 10733 : cluster [DBG] pgmap v9243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:02.284329+0000 mgr.smithi067.rdualw (mgr.24569) 10734 : cluster [DBG] pgmap v9244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:04.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:03.715258+0000 mon.smithi061 (mon.0) 2257 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:37:04.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:04.114125+0000 mon.smithi067 (mon.1) 1626 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:37:04.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:04.114771+0000 mon.smithi061 (mon.0) 2258 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:37:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:02.284329+0000 mgr.smithi067.rdualw (mgr.24569) 10734 : cluster [DBG] pgmap v9244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:03.715258+0000 mon.smithi061 (mon.0) 2257 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:37:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:04.114125+0000 mon.smithi067 (mon.1) 1626 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:37:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:04.114771+0000 mon.smithi061 (mon.0) 2258 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:37:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:04.284909+0000 mgr.smithi067.rdualw (mgr.24569) 10735 : cluster [DBG] pgmap v9245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:04.284909+0000 mgr.smithi067.rdualw (mgr.24569) 10735 : cluster [DBG] pgmap v9245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:07.728 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:06.285827+0000 mgr.smithi067.rdualw (mgr.24569) 10736 : cluster [DBG] pgmap v9246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:37:07.728 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:06.339987+0000 mon.smithi061 (mon.0) 2259 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:37:07.729 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:06.755954+0000 mon.smithi067 (mon.1) 1627 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:37:07.729 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:06.756648+0000 mon.smithi061 (mon.0) 2260 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:37:07.729 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:06.761290+0000 mon.smithi061 (mon.0) 2261 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:37:07.729 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:06.771185+0000 mon.smithi061 (mon.0) 2262 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:37:07.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:06.285827+0000 mgr.smithi067.rdualw (mgr.24569) 10736 : cluster [DBG] pgmap v9246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:37:07.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:06.339987+0000 mon.smithi061 (mon.0) 2259 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:37:07.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:06.755954+0000 mon.smithi067 (mon.1) 1627 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:37:07.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:06.756648+0000 mon.smithi061 (mon.0) 2260 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:37:07.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:06.761290+0000 mon.smithi061 (mon.0) 2261 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:37:07.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:06.771185+0000 mon.smithi061 (mon.0) 2262 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:37:09.728 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:08.286381+0000 mgr.smithi067.rdualw (mgr.24569) 10737 : cluster [DBG] pgmap v9247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:08.286381+0000 mgr.smithi067.rdualw (mgr.24569) 10737 : cluster [DBG] pgmap v9247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:11.591 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:37:11.728 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:10.287047+0000 mgr.smithi067.rdualw (mgr.24569) 10738 : cluster [DBG] pgmap v9248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:11.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:10.287047+0000 mgr.smithi067.rdualw (mgr.24569) 10738 : cluster [DBG] pgmap v9248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:11.886 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:37:11.886 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 5s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:37:11.887 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 5s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:37:11.887 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 8s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:37:11.887 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 5s ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:37:11.887 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 5s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:37:11.888 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 8s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:37:11.888 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 5s ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:37:11.888 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 8s ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:37:11.888 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 5s ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:37:11.889 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 8s ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:37:11.889 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 5s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:37:11.889 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 8s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:37:11.889 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 5s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:37:11.890 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 8s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:37:11.890 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 5s ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:37:11.890 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 5s ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:37:11.890 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 5s ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:37:11.890 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 5s ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:37:11.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 8s ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:37:11.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 8s ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:37:11.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 8s ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:37:11.891 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 8s ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:37:11.892 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 5s ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:37:12.230 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:37:12.231 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:37:12.231 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:37:12.231 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:37:12.231 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:37:12.232 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:37:12.232 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:37:12.232 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:37:12.232 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:37:12.232 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:37:12.233 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:37:12.233 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:37:12.233 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:37:12.233 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:37:12.233 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:37:12.234 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:37:12.234 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:37:12.234 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:37:12.234 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:37:13.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:11.577651+0000 mgr.smithi067.rdualw (mgr.24569) 10739 : audit [DBG] from='client.41302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:37:13.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:11.868517+0000 mgr.smithi067.rdualw (mgr.24569) 10740 : audit [DBG] from='client.41306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:37:13.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:12.229119+0000 mon.smithi061 (mon.0) 2263 : audit [DBG] from='client.? 172.21.15.61:0/602075329' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:37:13.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:11.577651+0000 mgr.smithi067.rdualw (mgr.24569) 10739 : audit [DBG] from='client.41302 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:37:13.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:11.868517+0000 mgr.smithi067.rdualw (mgr.24569) 10740 : audit [DBG] from='client.41306 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:37:13.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:12.229119+0000 mon.smithi061 (mon.0) 2263 : audit [DBG] from='client.? 172.21.15.61:0/602075329' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:37:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:12.287839+0000 mgr.smithi067.rdualw (mgr.24569) 10741 : cluster [DBG] pgmap v9249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:12.287839+0000 mgr.smithi067.rdualw (mgr.24569) 10741 : cluster [DBG] pgmap v9249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:14.288512+0000 mgr.smithi067.rdualw (mgr.24569) 10742 : cluster [DBG] pgmap v9250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:14.288512+0000 mgr.smithi067.rdualw (mgr.24569) 10742 : cluster [DBG] pgmap v9250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:16.289334+0000 mgr.smithi067.rdualw (mgr.24569) 10743 : cluster [DBG] pgmap v9251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:37:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:16.289334+0000 mgr.smithi067.rdualw (mgr.24569) 10743 : cluster [DBG] pgmap v9251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:37:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:18.289865+0000 mgr.smithi067.rdualw (mgr.24569) 10744 : cluster [DBG] pgmap v9252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:18.289865+0000 mgr.smithi067.rdualw (mgr.24569) 10744 : cluster [DBG] pgmap v9252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:20.290596+0000 mgr.smithi067.rdualw (mgr.24569) 10745 : cluster [DBG] pgmap v9253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:22.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:20.290596+0000 mgr.smithi067.rdualw (mgr.24569) 10745 : cluster [DBG] pgmap v9253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:22.291329+0000 mgr.smithi067.rdualw (mgr.24569) 10746 : cluster [DBG] pgmap v9254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:22.291329+0000 mgr.smithi067.rdualw (mgr.24569) 10746 : cluster [DBG] pgmap v9254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:24.292072+0000 mgr.smithi067.rdualw (mgr.24569) 10747 : cluster [DBG] pgmap v9255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:24.292072+0000 mgr.smithi067.rdualw (mgr.24569) 10747 : cluster [DBG] pgmap v9255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:26.293085+0000 mgr.smithi067.rdualw (mgr.24569) 10748 : cluster [DBG] pgmap v9256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:37:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:26.293085+0000 mgr.smithi067.rdualw (mgr.24569) 10748 : cluster [DBG] pgmap v9256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:37:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:28.293727+0000 mgr.smithi067.rdualw (mgr.24569) 10749 : cluster [DBG] pgmap v9257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:28.293727+0000 mgr.smithi067.rdualw (mgr.24569) 10749 : cluster [DBG] pgmap v9257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:30.294604+0000 mgr.smithi067.rdualw (mgr.24569) 10750 : cluster [DBG] pgmap v9258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:30.294604+0000 mgr.smithi067.rdualw (mgr.24569) 10750 : cluster [DBG] pgmap v9258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:32.295472+0000 mgr.smithi067.rdualw (mgr.24569) 10751 : cluster [DBG] pgmap v9259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:32.295472+0000 mgr.smithi067.rdualw (mgr.24569) 10751 : cluster [DBG] pgmap v9259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:34.296220+0000 mgr.smithi067.rdualw (mgr.24569) 10752 : cluster [DBG] pgmap v9260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:34.296220+0000 mgr.smithi067.rdualw (mgr.24569) 10752 : cluster [DBG] pgmap v9260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:37.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:36.153955+0000 mon.smithi067 (mon.1) 1628 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:37:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:36.154209+0000 mon.smithi067 (mon.1) 1629 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:37:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:36.154551+0000 mon.smithi061 (mon.0) 2264 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:37:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:36.154838+0000 mon.smithi061 (mon.0) 2265 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:37:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:36.153955+0000 mon.smithi067 (mon.1) 1628 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:37:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:36.154209+0000 mon.smithi067 (mon.1) 1629 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:37:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:36.154551+0000 mon.smithi061 (mon.0) 2264 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:37:37.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:36.154838+0000 mon.smithi061 (mon.0) 2265 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:37:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:36.297526+0000 mgr.smithi067.rdualw (mgr.24569) 10753 : cluster [DBG] pgmap v9261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:37:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:36.297526+0000 mgr.smithi067.rdualw (mgr.24569) 10753 : cluster [DBG] pgmap v9261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:37:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:38.298206+0000 mgr.smithi067.rdualw (mgr.24569) 10754 : cluster [DBG] pgmap v9262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:38.298206+0000 mgr.smithi067.rdualw (mgr.24569) 10754 : cluster [DBG] pgmap v9262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:42.538 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:37:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:40.299166+0000 mgr.smithi067.rdualw (mgr.24569) 10755 : cluster [DBG] pgmap v9263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:40.299166+0000 mgr.smithi067.rdualw (mgr.24569) 10755 : cluster [DBG] pgmap v9263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:42.840 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:37:42.841 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 36s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:37:42.841 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 36s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:37:42.841 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 39s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:37:42.841 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 36s ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:37:42.842 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 36s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:37:42.842 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 39s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:37:42.842 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 36s ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:37:42.842 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 39s ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:37:42.843 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 36s ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:37:42.843 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 39s ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:37:42.843 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 36s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:37:42.843 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 39s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:37:42.843 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 36s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:37:42.844 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 39s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:37:42.844 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 36s ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:37:42.844 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 36s ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:37:42.844 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 36s ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:37:42.845 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 36s ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:37:42.845 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 39s ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:37:42.845 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 39s ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:37:42.845 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 39s ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:37:42.845 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 39s ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:37:42.846 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 36s ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:37:43.185 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:37:43.185 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:37:43.186 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:37:43.186 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:37:43.186 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:37:43.186 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:37:43.187 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:37:43.187 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:37:43.187 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:37:43.187 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:37:43.188 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:37:43.188 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:37:43.188 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:37:43.189 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:37:43.189 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:37:43.189 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:37:43.189 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:37:43.190 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:37:43.190 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:37:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:42.299950+0000 mgr.smithi067.rdualw (mgr.24569) 10756 : cluster [DBG] pgmap v9264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:42.524610+0000 mgr.smithi067.rdualw (mgr.24569) 10757 : audit [DBG] from='client.41314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:37:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:42.822699+0000 mgr.smithi067.rdualw (mgr.24569) 10758 : audit [DBG] from='client.41318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:37:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:37:43.183930+0000 mon.smithi061 (mon.0) 2266 : audit [DBG] from='client.? 172.21.15.61:0/1880753627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:37:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:42.299950+0000 mgr.smithi067.rdualw (mgr.24569) 10756 : cluster [DBG] pgmap v9264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:42.524610+0000 mgr.smithi067.rdualw (mgr.24569) 10757 : audit [DBG] from='client.41314 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:37:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:42.822699+0000 mgr.smithi067.rdualw (mgr.24569) 10758 : audit [DBG] from='client.41318 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:37:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:37:43.183930+0000 mon.smithi061 (mon.0) 2266 : audit [DBG] from='client.? 172.21.15.61:0/1880753627' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:37:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:44.300470+0000 mgr.smithi067.rdualw (mgr.24569) 10759 : cluster [DBG] pgmap v9265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:44.300470+0000 mgr.smithi067.rdualw (mgr.24569) 10759 : cluster [DBG] pgmap v9265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:46.301573+0000 mgr.smithi067.rdualw (mgr.24569) 10760 : cluster [DBG] pgmap v9266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:37:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:46.301573+0000 mgr.smithi067.rdualw (mgr.24569) 10760 : cluster [DBG] pgmap v9266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:37:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:48.302065+0000 mgr.smithi067.rdualw (mgr.24569) 10761 : cluster [DBG] pgmap v9267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:48.302065+0000 mgr.smithi067.rdualw (mgr.24569) 10761 : cluster [DBG] pgmap v9267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:50.302799+0000 mgr.smithi067.rdualw (mgr.24569) 10762 : cluster [DBG] pgmap v9268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:50.302799+0000 mgr.smithi067.rdualw (mgr.24569) 10762 : cluster [DBG] pgmap v9268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:52.303549+0000 mgr.smithi067.rdualw (mgr.24569) 10763 : cluster [DBG] pgmap v9269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:52.303549+0000 mgr.smithi067.rdualw (mgr.24569) 10763 : cluster [DBG] pgmap v9269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:54.304109+0000 mgr.smithi067.rdualw (mgr.24569) 10764 : cluster [DBG] pgmap v9270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:54.304109+0000 mgr.smithi067.rdualw (mgr.24569) 10764 : cluster [DBG] pgmap v9270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:37:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:37:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:56.305135+0000 mgr.smithi067.rdualw (mgr.24569) 10765 : cluster [DBG] pgmap v9271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:37:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:37:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:56.305135+0000 mgr.smithi067.rdualw (mgr.24569) 10765 : cluster [DBG] pgmap v9271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:38:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:37:58.305784+0000 mgr.smithi067.rdualw (mgr.24569) 10766 : cluster [DBG] pgmap v9272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:37:58.305784+0000 mgr.smithi067.rdualw (mgr.24569) 10766 : cluster [DBG] pgmap v9272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:00.306511+0000 mgr.smithi067.rdualw (mgr.24569) 10767 : cluster [DBG] pgmap v9273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:00.306511+0000 mgr.smithi067.rdualw (mgr.24569) 10767 : cluster [DBG] pgmap v9273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:02.307340+0000 mgr.smithi067.rdualw (mgr.24569) 10768 : cluster [DBG] pgmap v9274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:02.307340+0000 mgr.smithi067.rdualw (mgr.24569) 10768 : cluster [DBG] pgmap v9274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:04.307979+0000 mgr.smithi067.rdualw (mgr.24569) 10769 : cluster [DBG] pgmap v9275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:04.307979+0000 mgr.smithi067.rdualw (mgr.24569) 10769 : cluster [DBG] pgmap v9275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:38:06.777215+0000 mon.smithi067 (mon.1) 1630 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:38:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:38:06.778777+0000 mon.smithi067 (mon.1) 1631 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:38:07.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:38:06.779798+0000 mon.smithi067 (mon.1) 1632 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:38:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:38:06.777215+0000 mon.smithi067 (mon.1) 1630 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:38:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:38:06.778777+0000 mon.smithi067 (mon.1) 1631 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:38:07.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:38:06.779798+0000 mon.smithi067 (mon.1) 1632 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:38:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:06.308820+0000 mgr.smithi067.rdualw (mgr.24569) 10770 : cluster [DBG] pgmap v9276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:38:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:38:06.780706+0000 mgr.smithi067.rdualw (mgr.24569) 10771 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:38:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:38:07.192900+0000 mon.smithi061 (mon.0) 2267 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:38:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:38:07.200436+0000 mon.smithi061 (mon.0) 2268 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:38:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:06.308820+0000 mgr.smithi067.rdualw (mgr.24569) 10770 : cluster [DBG] pgmap v9276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:38:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:38:06.780706+0000 mgr.smithi067.rdualw (mgr.24569) 10771 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:38:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:38:07.192900+0000 mon.smithi061 (mon.0) 2267 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:38:08.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:38:07.200436+0000 mon.smithi061 (mon.0) 2268 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:38:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:08.309426+0000 mgr.smithi067.rdualw (mgr.24569) 10772 : cluster [DBG] pgmap v9277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:08.309426+0000 mgr.smithi067.rdualw (mgr.24569) 10772 : cluster [DBG] pgmap v9277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:10.310505+0000 mgr.smithi067.rdualw (mgr.24569) 10773 : cluster [DBG] pgmap v9278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:10.310505+0000 mgr.smithi067.rdualw (mgr.24569) 10773 : cluster [DBG] pgmap v9278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:13.494 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:38:13.786 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:38:13.787 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 67s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:38:13.787 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 67s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:38:13.787 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 70s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:38:13.787 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 67s ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:38:13.788 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 67s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:38:13.788 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 70s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:38:13.788 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 67s ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:38:13.788 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 70s ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:38:13.789 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 67s ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:38:13.789 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 70s ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:38:13.789 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 67s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:38:13.789 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 70s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:38:13.789 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 67s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:38:13.790 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 70s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:38:13.790 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 67s ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:38:13.790 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 67s ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:38:13.790 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 67s ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:38:13.791 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 67s ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:38:13.791 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 70s ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:38:13.791 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 70s ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:38:13.791 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 70s ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:38:13.791 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 70s ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:38:13.792 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 67s ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:38:14.127 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:38:14.128 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:38:14.128 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:38:14.128 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:38:14.128 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:38:14.129 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:38:14.129 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:38:14.129 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:38:14.129 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:38:14.130 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:38:14.130 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:38:14.130 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:38:14.130 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:38:14.131 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:38:14.131 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:38:14.131 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:38:14.131 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:38:14.131 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:38:14.132 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:38:14.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:12.311146+0000 mgr.smithi067.rdualw (mgr.24569) 10774 : cluster [DBG] pgmap v9279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:14.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:38:14.126338+0000 mon.smithi061 (mon.0) 2269 : audit [DBG] from='client.? 172.21.15.61:0/807067517' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:38:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:12.311146+0000 mgr.smithi067.rdualw (mgr.24569) 10774 : cluster [DBG] pgmap v9279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:14.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:38:14.126338+0000 mon.smithi061 (mon.0) 2269 : audit [DBG] from='client.? 172.21.15.61:0/807067517' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:38:15.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:38:13.480069+0000 mgr.smithi067.rdualw (mgr.24569) 10775 : audit [DBG] from='client.41326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:38:15.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:38:13.768876+0000 mgr.smithi067.rdualw (mgr.24569) 10776 : audit [DBG] from='client.41330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:38:15.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:38:13.480069+0000 mgr.smithi067.rdualw (mgr.24569) 10775 : audit [DBG] from='client.41326 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:38:15.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:38:13.768876+0000 mgr.smithi067.rdualw (mgr.24569) 10776 : audit [DBG] from='client.41330 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:38:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:14.311913+0000 mgr.smithi067.rdualw (mgr.24569) 10777 : cluster [DBG] pgmap v9280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:14.311913+0000 mgr.smithi067.rdualw (mgr.24569) 10777 : cluster [DBG] pgmap v9280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:16.312980+0000 mgr.smithi067.rdualw (mgr.24569) 10778 : cluster [DBG] pgmap v9281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:38:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:16.312980+0000 mgr.smithi067.rdualw (mgr.24569) 10778 : cluster [DBG] pgmap v9281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:38:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:18.313442+0000 mgr.smithi067.rdualw (mgr.24569) 10779 : cluster [DBG] pgmap v9282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:18.313442+0000 mgr.smithi067.rdualw (mgr.24569) 10779 : cluster [DBG] pgmap v9282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:20.314184+0000 mgr.smithi067.rdualw (mgr.24569) 10780 : cluster [DBG] pgmap v9283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:20.314184+0000 mgr.smithi067.rdualw (mgr.24569) 10780 : cluster [DBG] pgmap v9283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:24.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:22.314993+0000 mgr.smithi067.rdualw (mgr.24569) 10781 : cluster [DBG] pgmap v9284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:22.314993+0000 mgr.smithi067.rdualw (mgr.24569) 10781 : cluster [DBG] pgmap v9284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:24.315713+0000 mgr.smithi067.rdualw (mgr.24569) 10782 : cluster [DBG] pgmap v9285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:24.315713+0000 mgr.smithi067.rdualw (mgr.24569) 10782 : cluster [DBG] pgmap v9285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:26.316516+0000 mgr.smithi067.rdualw (mgr.24569) 10783 : cluster [DBG] pgmap v9286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:38:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:26.316516+0000 mgr.smithi067.rdualw (mgr.24569) 10783 : cluster [DBG] pgmap v9286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:38:30.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:28.317214+0000 mgr.smithi067.rdualw (mgr.24569) 10784 : cluster [DBG] pgmap v9287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:28.317214+0000 mgr.smithi067.rdualw (mgr.24569) 10784 : cluster [DBG] pgmap v9287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:32.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:30.317897+0000 mgr.smithi067.rdualw (mgr.24569) 10785 : cluster [DBG] pgmap v9288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:30.317897+0000 mgr.smithi067.rdualw (mgr.24569) 10785 : cluster [DBG] pgmap v9288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:32.318757+0000 mgr.smithi067.rdualw (mgr.24569) 10786 : cluster [DBG] pgmap v9289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:32.318757+0000 mgr.smithi067.rdualw (mgr.24569) 10786 : cluster [DBG] pgmap v9289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:34.319474+0000 mgr.smithi067.rdualw (mgr.24569) 10787 : cluster [DBG] pgmap v9290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:38:36.159201+0000 mon.smithi067 (mon.1) 1633 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:38:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:38:36.159482+0000 mon.smithi067 (mon.1) 1634 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:38:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:38:36.160023+0000 mon.smithi061 (mon.0) 2270 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:38:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:38:36.160262+0000 mon.smithi061 (mon.0) 2271 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:38:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:34.319474+0000 mgr.smithi067.rdualw (mgr.24569) 10787 : cluster [DBG] pgmap v9290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:38:36.159201+0000 mon.smithi067 (mon.1) 1633 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:38:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:38:36.159482+0000 mon.smithi067 (mon.1) 1634 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:38:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:38:36.160023+0000 mon.smithi061 (mon.0) 2270 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:38:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:38:36.160262+0000 mon.smithi061 (mon.0) 2271 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:38:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:36.320427+0000 mgr.smithi067.rdualw (mgr.24569) 10788 : cluster [DBG] pgmap v9291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:38:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:36.320427+0000 mgr.smithi067.rdualw (mgr.24569) 10788 : cluster [DBG] pgmap v9291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:38:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:38.321081+0000 mgr.smithi067.rdualw (mgr.24569) 10789 : cluster [DBG] pgmap v9292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:38.321081+0000 mgr.smithi067.rdualw (mgr.24569) 10789 : cluster [DBG] pgmap v9292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:40.322031+0000 mgr.smithi067.rdualw (mgr.24569) 10790 : cluster [DBG] pgmap v9293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:40.322031+0000 mgr.smithi067.rdualw (mgr.24569) 10790 : cluster [DBG] pgmap v9293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:44.436 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:38:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:42.322718+0000 mgr.smithi067.rdualw (mgr.24569) 10791 : cluster [DBG] pgmap v9294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:42.322718+0000 mgr.smithi067.rdualw (mgr.24569) 10791 : cluster [DBG] pgmap v9294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:44.730 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:38:44.730 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 98s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:38:44.730 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 98s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:38:44.731 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 101s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:38:44.731 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 98s ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:38:44.731 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 98s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:38:44.731 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 101s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:38:44.731 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 98s ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:38:44.732 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 101s ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:38:44.732 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 98s ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:38:44.732 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 101s ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:38:44.732 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 98s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:38:44.733 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 101s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:38:44.733 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 98s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:38:44.733 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 101s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:38:44.733 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (4h) 98s ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:38:44.733 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 98s ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:38:44.734 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 98s ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:38:44.734 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 98s ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:38:44.734 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 101s ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:38:44.734 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 101s ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:38:44.735 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 101s ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:38:44.735 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 101s ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:38:44.735 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 98s ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:38:45.073 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:38:45.074 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:38:45.074 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:38:45.074 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:38:45.074 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:38:45.075 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:38:45.075 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:38:45.075 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:38:45.075 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:38:45.076 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:38:45.076 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:38:45.076 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:38:45.076 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:38:45.077 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:38:45.077 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:38:45.077 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:38:45.077 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:38:45.077 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:38:45.078 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:38:45.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:44.323278+0000 mgr.smithi067.rdualw (mgr.24569) 10792 : cluster [DBG] pgmap v9295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:45.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:38:44.423074+0000 mgr.smithi067.rdualw (mgr.24569) 10793 : audit [DBG] from='client.41338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:38:45.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:38:44.711591+0000 mgr.smithi067.rdualw (mgr.24569) 10794 : audit [DBG] from='client.41342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:38:45.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:38:45.072072+0000 mon.smithi061 (mon.0) 2272 : audit [DBG] from='client.? 172.21.15.61:0/219836264' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:38:45.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:44.323278+0000 mgr.smithi067.rdualw (mgr.24569) 10792 : cluster [DBG] pgmap v9295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:45.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:38:44.423074+0000 mgr.smithi067.rdualw (mgr.24569) 10793 : audit [DBG] from='client.41338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:38:45.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:38:44.711591+0000 mgr.smithi067.rdualw (mgr.24569) 10794 : audit [DBG] from='client.41342 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:38:45.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:38:45.072072+0000 mon.smithi061 (mon.0) 2272 : audit [DBG] from='client.? 172.21.15.61:0/219836264' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:38:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:46.324261+0000 mgr.smithi067.rdualw (mgr.24569) 10795 : cluster [DBG] pgmap v9296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:38:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:46.324261+0000 mgr.smithi067.rdualw (mgr.24569) 10795 : cluster [DBG] pgmap v9296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:38:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:48.324883+0000 mgr.smithi067.rdualw (mgr.24569) 10796 : cluster [DBG] pgmap v9297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:48.324883+0000 mgr.smithi067.rdualw (mgr.24569) 10796 : cluster [DBG] pgmap v9297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:50.325949+0000 mgr.smithi067.rdualw (mgr.24569) 10797 : cluster [DBG] pgmap v9298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:50.325949+0000 mgr.smithi067.rdualw (mgr.24569) 10797 : cluster [DBG] pgmap v9298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:52.326728+0000 mgr.smithi067.rdualw (mgr.24569) 10798 : cluster [DBG] pgmap v9299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:52.326728+0000 mgr.smithi067.rdualw (mgr.24569) 10798 : cluster [DBG] pgmap v9299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:54.327419+0000 mgr.smithi067.rdualw (mgr.24569) 10799 : cluster [DBG] pgmap v9300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:54.327419+0000 mgr.smithi067.rdualw (mgr.24569) 10799 : cluster [DBG] pgmap v9300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:38:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:38:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:56.328444+0000 mgr.smithi067.rdualw (mgr.24569) 10800 : cluster [DBG] pgmap v9301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:38:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:38:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:56.328444+0000 mgr.smithi067.rdualw (mgr.24569) 10800 : cluster [DBG] pgmap v9301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:39:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:38:58.328944+0000 mgr.smithi067.rdualw (mgr.24569) 10801 : cluster [DBG] pgmap v9302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:38:58.328944+0000 mgr.smithi067.rdualw (mgr.24569) 10801 : cluster [DBG] pgmap v9302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:00.329750+0000 mgr.smithi067.rdualw (mgr.24569) 10802 : cluster [DBG] pgmap v9303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:00.329750+0000 mgr.smithi067.rdualw (mgr.24569) 10802 : cluster [DBG] pgmap v9303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:02.330407+0000 mgr.smithi067.rdualw (mgr.24569) 10803 : cluster [DBG] pgmap v9304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:02.330407+0000 mgr.smithi067.rdualw (mgr.24569) 10803 : cluster [DBG] pgmap v9304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:04.331038+0000 mgr.smithi067.rdualw (mgr.24569) 10804 : cluster [DBG] pgmap v9305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:04.331038+0000 mgr.smithi067.rdualw (mgr.24569) 10804 : cluster [DBG] pgmap v9305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:06.331879+0000 mgr.smithi067.rdualw (mgr.24569) 10805 : cluster [DBG] pgmap v9306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:39:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:39:07.205669+0000 mon.smithi067 (mon.1) 1635 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:39:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:39:07.207077+0000 mon.smithi067 (mon.1) 1636 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:39:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:39:07.208035+0000 mon.smithi067 (mon.1) 1637 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:39:08.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:39:07.464950+0000 mon.smithi061 (mon.0) 2273 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:39:08.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:39:07.574088+0000 mon.smithi061 (mon.0) 2274 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:39:08.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:39:07.977692+0000 mon.smithi061 (mon.0) 2275 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:39:08.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:39:07.985660+0000 mon.smithi061 (mon.0) 2276 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:39:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:06.331879+0000 mgr.smithi067.rdualw (mgr.24569) 10805 : cluster [DBG] pgmap v9306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:39:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:39:07.205669+0000 mon.smithi067 (mon.1) 1635 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:39:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:39:07.207077+0000 mon.smithi067 (mon.1) 1636 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:39:08.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:39:07.208035+0000 mon.smithi067 (mon.1) 1637 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:39:08.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:39:07.464950+0000 mon.smithi061 (mon.0) 2273 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:39:08.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:39:07.574088+0000 mon.smithi061 (mon.0) 2274 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:39:08.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:39:07.977692+0000 mon.smithi061 (mon.0) 2275 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:39:08.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:39:07.985660+0000 mon.smithi061 (mon.0) 2276 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:39:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:39:07.208869+0000 mgr.smithi067.rdualw (mgr.24569) 10806 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:39:09.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:39:07.208869+0000 mgr.smithi067.rdualw (mgr.24569) 10806 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:39:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:08.332345+0000 mgr.smithi067.rdualw (mgr.24569) 10807 : cluster [DBG] pgmap v9307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:08.332345+0000 mgr.smithi067.rdualw (mgr.24569) 10807 : cluster [DBG] pgmap v9307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:10.333142+0000 mgr.smithi067.rdualw (mgr.24569) 10808 : cluster [DBG] pgmap v9308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:10.333142+0000 mgr.smithi067.rdualw (mgr.24569) 10808 : cluster [DBG] pgmap v9308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:12.333824+0000 mgr.smithi067.rdualw (mgr.24569) 10809 : cluster [DBG] pgmap v9309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:14.569 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:12.333824+0000 mgr.smithi067.rdualw (mgr.24569) 10809 : cluster [DBG] pgmap v9309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:15.384 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:39:15.677 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:39:15.678 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 2m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:39:15.678 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 2m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:39:15.678 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 2m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:39:15.679 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 2m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:39:15.679 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 2m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:39:15.679 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 2m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:39:15.679 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 2m ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:39:15.680 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 2m ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:39:15.680 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 2m ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:39:15.680 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 2m ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:39:15.680 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 2m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:39:15.680 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 2m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:39:15.681 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 2m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:39:15.681 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 2m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:39:15.681 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 2m ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:39:15.681 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 2m ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:39:15.681 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 2m ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:39:15.682 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 2m ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:39:15.682 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 2m ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:39:15.682 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 2m ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:39:15.682 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 2m ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:39:15.683 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 2m ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:39:15.683 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 2m ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:39:16.018 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:39:16.018 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:39:16.018 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:39:16.019 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:39:16.019 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:39:16.020 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:39:16.020 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:39:16.020 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:39:16.020 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:39:16.020 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:39:16.021 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:39:16.021 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:39:16.021 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:39:16.021 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:39:16.022 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:39:16.022 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:39:16.022 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:39:16.023 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:39:16.023 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:39:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:14.334518+0000 mgr.smithi067.rdualw (mgr.24569) 10810 : cluster [DBG] pgmap v9310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:39:16.016744+0000 mon.smithi061 (mon.0) 2277 : audit [DBG] from='client.? 172.21.15.61:0/584987950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:39:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:14.334518+0000 mgr.smithi067.rdualw (mgr.24569) 10810 : cluster [DBG] pgmap v9310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:39:16.016744+0000 mon.smithi061 (mon.0) 2277 : audit [DBG] from='client.? 172.21.15.61:0/584987950' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:39:17.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:39:15.371079+0000 mgr.smithi067.rdualw (mgr.24569) 10811 : audit [DBG] from='client.41350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:39:17.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:39:15.659746+0000 mgr.smithi067.rdualw (mgr.24569) 10812 : audit [DBG] from='client.41354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:39:17.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:39:15.371079+0000 mgr.smithi067.rdualw (mgr.24569) 10811 : audit [DBG] from='client.41350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:39:17.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:39:15.659746+0000 mgr.smithi067.rdualw (mgr.24569) 10812 : audit [DBG] from='client.41354 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:39:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:16.335505+0000 mgr.smithi067.rdualw (mgr.24569) 10813 : cluster [DBG] pgmap v9311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:39:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:16.335505+0000 mgr.smithi067.rdualw (mgr.24569) 10813 : cluster [DBG] pgmap v9311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:39:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:18.335974+0000 mgr.smithi067.rdualw (mgr.24569) 10814 : cluster [DBG] pgmap v9312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:18.335974+0000 mgr.smithi067.rdualw (mgr.24569) 10814 : cluster [DBG] pgmap v9312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:22.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:20.336986+0000 mgr.smithi067.rdualw (mgr.24569) 10815 : cluster [DBG] pgmap v9313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:20.336986+0000 mgr.smithi067.rdualw (mgr.24569) 10815 : cluster [DBG] pgmap v9313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:22.337665+0000 mgr.smithi067.rdualw (mgr.24569) 10816 : cluster [DBG] pgmap v9314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:22.337665+0000 mgr.smithi067.rdualw (mgr.24569) 10816 : cluster [DBG] pgmap v9314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:24.338310+0000 mgr.smithi067.rdualw (mgr.24569) 10817 : cluster [DBG] pgmap v9315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:24.338310+0000 mgr.smithi067.rdualw (mgr.24569) 10817 : cluster [DBG] pgmap v9315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:26.339334+0000 mgr.smithi067.rdualw (mgr.24569) 10818 : cluster [DBG] pgmap v9316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:39:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:26.339334+0000 mgr.smithi067.rdualw (mgr.24569) 10818 : cluster [DBG] pgmap v9316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:39:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:28.340054+0000 mgr.smithi067.rdualw (mgr.24569) 10819 : cluster [DBG] pgmap v9317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:28.340054+0000 mgr.smithi067.rdualw (mgr.24569) 10819 : cluster [DBG] pgmap v9317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:30.340869+0000 mgr.smithi067.rdualw (mgr.24569) 10820 : cluster [DBG] pgmap v9318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:30.340869+0000 mgr.smithi067.rdualw (mgr.24569) 10820 : cluster [DBG] pgmap v9318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:33.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:32.341905+0000 mgr.smithi067.rdualw (mgr.24569) 10821 : cluster [DBG] pgmap v9319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:33.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:32.341905+0000 mgr.smithi067.rdualw (mgr.24569) 10821 : cluster [DBG] pgmap v9319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:35.753 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:34.342661+0000 mgr.smithi067.rdualw (mgr.24569) 10822 : cluster [DBG] pgmap v9320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:34.342661+0000 mgr.smithi067.rdualw (mgr.24569) 10822 : cluster [DBG] pgmap v9320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:36.752 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:39:36.165325+0000 mon.smithi067 (mon.1) 1638 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:39:36.753 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:39:36.165584+0000 mon.smithi067 (mon.1) 1639 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:39:36.753 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:39:36.165988+0000 mon.smithi061 (mon.0) 2278 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:39:36.753 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:39:36.166328+0000 mon.smithi061 (mon.0) 2279 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:39:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:39:36.165325+0000 mon.smithi067 (mon.1) 1638 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:39:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:39:36.165584+0000 mon.smithi067 (mon.1) 1639 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:39:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:39:36.165988+0000 mon.smithi061 (mon.0) 2278 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:39:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:39:36.166328+0000 mon.smithi061 (mon.0) 2279 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:39:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:36.343678+0000 mgr.smithi067.rdualw (mgr.24569) 10823 : cluster [DBG] pgmap v9321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:39:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:36.343678+0000 mgr.smithi067.rdualw (mgr.24569) 10823 : cluster [DBG] pgmap v9321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:39:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:38.344224+0000 mgr.smithi067.rdualw (mgr.24569) 10824 : cluster [DBG] pgmap v9322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:38.344224+0000 mgr.smithi067.rdualw (mgr.24569) 10824 : cluster [DBG] pgmap v9322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:40.345096+0000 mgr.smithi067.rdualw (mgr.24569) 10825 : cluster [DBG] pgmap v9323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:40.345096+0000 mgr.smithi067.rdualw (mgr.24569) 10825 : cluster [DBG] pgmap v9323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:42.345572+0000 mgr.smithi067.rdualw (mgr.24569) 10826 : cluster [DBG] pgmap v9324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:42.345572+0000 mgr.smithi067.rdualw (mgr.24569) 10826 : cluster [DBG] pgmap v9324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:46.326 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:39:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:44.346280+0000 mgr.smithi067.rdualw (mgr.24569) 10827 : cluster [DBG] pgmap v9325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:44.346280+0000 mgr.smithi067.rdualw (mgr.24569) 10827 : cluster [DBG] pgmap v9325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:46.619 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:39:46.619 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 2m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:39:46.619 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 2m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:39:46.620 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 2m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:39:46.620 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 2m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:39:46.620 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 2m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:39:46.620 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 2m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:39:46.621 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 2m ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:39:46.621 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 2m ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:39:46.621 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 2m ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:39:46.621 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 2m ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:39:46.621 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 2m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:39:46.622 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 2m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:39:46.622 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 2m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:39:46.622 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 2m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:39:46.622 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 2m ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:39:46.623 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 2m ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:39:46.623 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 2m ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:39:46.623 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 2m ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:39:46.623 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 2m ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:39:46.624 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 2m ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:39:46.624 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 2m ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:39:46.624 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 2m ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:39:46.624 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 2m ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:39:47.021 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:39:47.021 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:39:47.022 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:39:47.022 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:39:47.022 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:39:47.022 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:39:47.022 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:39:47.023 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:39:47.023 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:39:47.023 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:39:47.023 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:39:47.024 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:39:47.024 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:39:47.024 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:39:47.024 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:39:47.024 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:39:47.025 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:39:47.025 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:39:47.025 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:39:47.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:39:47.019896+0000 mon.smithi061 (mon.0) 2280 : audit [DBG] from='client.? 172.21.15.61:0/2600101420' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:39:47.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:39:47.019896+0000 mon.smithi061 (mon.0) 2280 : audit [DBG] from='client.? 172.21.15.61:0/2600101420' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:39:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:39:46.310679+0000 mgr.smithi067.rdualw (mgr.24569) 10828 : audit [DBG] from='client.41362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:39:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:46.347188+0000 mgr.smithi067.rdualw (mgr.24569) 10829 : cluster [DBG] pgmap v9326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:39:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:39:46.601487+0000 mgr.smithi067.rdualw (mgr.24569) 10830 : audit [DBG] from='client.41366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:39:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:39:46.310679+0000 mgr.smithi067.rdualw (mgr.24569) 10828 : audit [DBG] from='client.41362 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:39:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:46.347188+0000 mgr.smithi067.rdualw (mgr.24569) 10829 : cluster [DBG] pgmap v9326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:39:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:39:46.601487+0000 mgr.smithi067.rdualw (mgr.24569) 10830 : audit [DBG] from='client.41366 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:39:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:48.347861+0000 mgr.smithi067.rdualw (mgr.24569) 10831 : cluster [DBG] pgmap v9327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:48.347861+0000 mgr.smithi067.rdualw (mgr.24569) 10831 : cluster [DBG] pgmap v9327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:50.348803+0000 mgr.smithi067.rdualw (mgr.24569) 10832 : cluster [DBG] pgmap v9328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:50.348803+0000 mgr.smithi067.rdualw (mgr.24569) 10832 : cluster [DBG] pgmap v9328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:52.349333+0000 mgr.smithi067.rdualw (mgr.24569) 10833 : cluster [DBG] pgmap v9329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:52.349333+0000 mgr.smithi067.rdualw (mgr.24569) 10833 : cluster [DBG] pgmap v9329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:54.349928+0000 mgr.smithi067.rdualw (mgr.24569) 10834 : cluster [DBG] pgmap v9330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:54.349928+0000 mgr.smithi067.rdualw (mgr.24569) 10834 : cluster [DBG] pgmap v9330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:39:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:39:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:56.350876+0000 mgr.smithi067.rdualw (mgr.24569) 10835 : cluster [DBG] pgmap v9331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:39:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:39:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:56.350876+0000 mgr.smithi067.rdualw (mgr.24569) 10835 : cluster [DBG] pgmap v9331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:40:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:39:58.351592+0000 mgr.smithi067.rdualw (mgr.24569) 10836 : cluster [DBG] pgmap v9332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:00.000099+0000 mon.smithi061 (mon.0) 2281 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T20:40:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:39:58.351592+0000 mgr.smithi067.rdualw (mgr.24569) 10836 : cluster [DBG] pgmap v9332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:00.000099+0000 mon.smithi061 (mon.0) 2281 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T20:40:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:00.352547+0000 mgr.smithi067.rdualw (mgr.24569) 10837 : cluster [DBG] pgmap v9333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:00.352547+0000 mgr.smithi067.rdualw (mgr.24569) 10837 : cluster [DBG] pgmap v9333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:04.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:02.353188+0000 mgr.smithi067.rdualw (mgr.24569) 10838 : cluster [DBG] pgmap v9334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:02.353188+0000 mgr.smithi067.rdualw (mgr.24569) 10838 : cluster [DBG] pgmap v9334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:04.353859+0000 mgr.smithi067.rdualw (mgr.24569) 10839 : cluster [DBG] pgmap v9335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:04.353859+0000 mgr.smithi067.rdualw (mgr.24569) 10839 : cluster [DBG] pgmap v9335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:06.354773+0000 mgr.smithi067.rdualw (mgr.24569) 10840 : cluster [DBG] pgmap v9336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:40:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:40:07.988860+0000 mon.smithi067 (mon.1) 1640 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:40:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:40:07.990320+0000 mon.smithi067 (mon.1) 1641 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:40:08.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:40:07.991322+0000 mon.smithi067 (mon.1) 1642 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:40:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:06.354773+0000 mgr.smithi067.rdualw (mgr.24569) 10840 : cluster [DBG] pgmap v9336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:40:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:40:07.988860+0000 mon.smithi067 (mon.1) 1640 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:40:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:40:07.990320+0000 mon.smithi067 (mon.1) 1641 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:40:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:40:07.991322+0000 mon.smithi067 (mon.1) 1642 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:40:09.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:40:07.992231+0000 mgr.smithi067.rdualw (mgr.24569) 10841 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:40:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:40:08.414884+0000 mon.smithi061 (mon.0) 2282 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:40:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:40:08.420194+0000 mon.smithi061 (mon.0) 2283 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:40:09.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:40:07.992231+0000 mgr.smithi067.rdualw (mgr.24569) 10841 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:40:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:40:08.414884+0000 mon.smithi061 (mon.0) 2282 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:40:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:40:08.420194+0000 mon.smithi061 (mon.0) 2283 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:40:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:08.355208+0000 mgr.smithi067.rdualw (mgr.24569) 10842 : cluster [DBG] pgmap v9337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:08.355208+0000 mgr.smithi067.rdualw (mgr.24569) 10842 : cluster [DBG] pgmap v9337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:10.356202+0000 mgr.smithi067.rdualw (mgr.24569) 10843 : cluster [DBG] pgmap v9338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:10.356202+0000 mgr.smithi067.rdualw (mgr.24569) 10843 : cluster [DBG] pgmap v9338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:13.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:12.356870+0000 mgr.smithi067.rdualw (mgr.24569) 10844 : cluster [DBG] pgmap v9339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:13.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:12.356870+0000 mgr.smithi067.rdualw (mgr.24569) 10844 : cluster [DBG] pgmap v9339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:15.759 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:14.357502+0000 mgr.smithi067.rdualw (mgr.24569) 10845 : cluster [DBG] pgmap v9340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:14.357502+0000 mgr.smithi067.rdualw (mgr.24569) 10845 : cluster [DBG] pgmap v9340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:17.335 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:40:17.630 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:40:17.631 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 3m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:40:17.631 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 3m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:40:17.631 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 3m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:40:17.631 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 3m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:40:17.632 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 3m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:40:17.632 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 3m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:40:17.632 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 3m ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:40:17.632 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 3m ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:40:17.632 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 3m ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:40:17.633 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 3m ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:40:17.633 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 3m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:40:17.633 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 3m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:40:17.633 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 3m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:40:17.634 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 3m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:40:17.634 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 3m ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:40:17.634 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 3m ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:40:17.634 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 3m ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:40:17.635 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 3m ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:40:17.635 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 3m ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:40:17.635 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 3m ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:40:17.636 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 3m ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:40:17.636 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 3m ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:40:17.636 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 3m ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:40:17.969 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:40:17.969 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:40:17.970 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:40:17.970 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:40:17.970 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:40:17.970 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:40:17.970 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:40:17.971 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:40:17.971 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:40:17.971 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:40:17.971 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:40:17.972 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:40:17.972 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:40:17.972 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:40:17.972 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:40:17.973 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:40:17.973 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:40:17.973 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:40:17.973 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:40:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:16.358344+0000 mgr.smithi067.rdualw (mgr.24569) 10846 : cluster [DBG] pgmap v9341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:40:18.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:40:17.967896+0000 mon.smithi061 (mon.0) 2284 : audit [DBG] from='client.? 172.21.15.61:0/2192097629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:40:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:16.358344+0000 mgr.smithi067.rdualw (mgr.24569) 10846 : cluster [DBG] pgmap v9341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:40:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:40:17.967896+0000 mon.smithi061 (mon.0) 2284 : audit [DBG] from='client.? 172.21.15.61:0/2192097629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:40:19.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:40:17.321466+0000 mgr.smithi067.rdualw (mgr.24569) 10847 : audit [DBG] from='client.41374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:40:19.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:40:17.610171+0000 mgr.smithi067.rdualw (mgr.24569) 10848 : audit [DBG] from='client.41378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:40:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:40:17.321466+0000 mgr.smithi067.rdualw (mgr.24569) 10847 : audit [DBG] from='client.41374 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:40:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:40:17.610171+0000 mgr.smithi067.rdualw (mgr.24569) 10848 : audit [DBG] from='client.41378 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:40:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:18.359015+0000 mgr.smithi067.rdualw (mgr.24569) 10849 : cluster [DBG] pgmap v9342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:18.359015+0000 mgr.smithi067.rdualw (mgr.24569) 10849 : cluster [DBG] pgmap v9342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:20.359859+0000 mgr.smithi067.rdualw (mgr.24569) 10850 : cluster [DBG] pgmap v9343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:22.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:20.359859+0000 mgr.smithi067.rdualw (mgr.24569) 10850 : cluster [DBG] pgmap v9343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:24.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:22.360356+0000 mgr.smithi067.rdualw (mgr.24569) 10851 : cluster [DBG] pgmap v9344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:22.360356+0000 mgr.smithi067.rdualw (mgr.24569) 10851 : cluster [DBG] pgmap v9344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:24.360947+0000 mgr.smithi067.rdualw (mgr.24569) 10852 : cluster [DBG] pgmap v9345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:24.360947+0000 mgr.smithi067.rdualw (mgr.24569) 10852 : cluster [DBG] pgmap v9345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:26.361770+0000 mgr.smithi067.rdualw (mgr.24569) 10853 : cluster [DBG] pgmap v9346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:40:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:26.361770+0000 mgr.smithi067.rdualw (mgr.24569) 10853 : cluster [DBG] pgmap v9346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:40:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:28.362461+0000 mgr.smithi067.rdualw (mgr.24569) 10854 : cluster [DBG] pgmap v9347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:28.362461+0000 mgr.smithi067.rdualw (mgr.24569) 10854 : cluster [DBG] pgmap v9347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:30.363322+0000 mgr.smithi067.rdualw (mgr.24569) 10855 : cluster [DBG] pgmap v9348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:30.363322+0000 mgr.smithi067.rdualw (mgr.24569) 10855 : cluster [DBG] pgmap v9348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:32.364015+0000 mgr.smithi067.rdualw (mgr.24569) 10856 : cluster [DBG] pgmap v9349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:32.364015+0000 mgr.smithi067.rdualw (mgr.24569) 10856 : cluster [DBG] pgmap v9349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:34.364754+0000 mgr.smithi067.rdualw (mgr.24569) 10857 : cluster [DBG] pgmap v9350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:34.364754+0000 mgr.smithi067.rdualw (mgr.24569) 10857 : cluster [DBG] pgmap v9350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:37.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:40:36.172719+0000 mon.smithi067 (mon.1) 1643 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:40:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:40:36.172982+0000 mon.smithi067 (mon.1) 1644 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:40:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:40:36.173324+0000 mon.smithi061 (mon.0) 2285 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:40:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:40:36.173610+0000 mon.smithi061 (mon.0) 2286 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:40:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:40:36.172719+0000 mon.smithi067 (mon.1) 1643 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:40:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:40:36.172982+0000 mon.smithi067 (mon.1) 1644 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:40:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:40:36.173324+0000 mon.smithi061 (mon.0) 2285 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:40:37.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:40:36.173610+0000 mon.smithi061 (mon.0) 2286 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:40:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:36.365514+0000 mgr.smithi067.rdualw (mgr.24569) 10858 : cluster [DBG] pgmap v9351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:40:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:36.365514+0000 mgr.smithi067.rdualw (mgr.24569) 10858 : cluster [DBG] pgmap v9351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:40:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:38.366058+0000 mgr.smithi067.rdualw (mgr.24569) 10859 : cluster [DBG] pgmap v9352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:38.366058+0000 mgr.smithi067.rdualw (mgr.24569) 10859 : cluster [DBG] pgmap v9352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:40.367139+0000 mgr.smithi067.rdualw (mgr.24569) 10860 : cluster [DBG] pgmap v9353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:40.367139+0000 mgr.smithi067.rdualw (mgr.24569) 10860 : cluster [DBG] pgmap v9353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:42.367743+0000 mgr.smithi067.rdualw (mgr.24569) 10861 : cluster [DBG] pgmap v9354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:42.367743+0000 mgr.smithi067.rdualw (mgr.24569) 10861 : cluster [DBG] pgmap v9354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:44.368425+0000 mgr.smithi067.rdualw (mgr.24569) 10862 : cluster [DBG] pgmap v9355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:44.368425+0000 mgr.smithi067.rdualw (mgr.24569) 10862 : cluster [DBG] pgmap v9355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:48.368 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:40:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:46.369380+0000 mgr.smithi067.rdualw (mgr.24569) 10863 : cluster [DBG] pgmap v9356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:40:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:46.369380+0000 mgr.smithi067.rdualw (mgr.24569) 10863 : cluster [DBG] pgmap v9356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:40:48.674 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:40:48.675 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 3m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:40:48.675 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 3m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:40:48.675 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 3m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:40:48.675 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 3m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:40:48.676 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 3m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:40:48.676 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 3m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:40:48.676 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 3m ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:40:48.677 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 3m ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:40:48.677 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 3m ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:40:48.677 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 3m ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:40:48.677 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 3m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:40:48.678 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 3m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:40:48.678 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 3m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:40:48.678 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 3m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:40:48.678 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 3m ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:40:48.678 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 3m ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:40:48.679 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 3m ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:40:48.679 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 3m ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:40:48.679 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 3m ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:40:48.679 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 3m ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:40:48.679 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 3m ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:40:48.680 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 3m ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:40:48.680 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 3m ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:40:49.018 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:40:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:40:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:40:49.019 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:40:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:40:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:40:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:40:49.020 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:40:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:40:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:40:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:40:49.021 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:40:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:40:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:40:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:40:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:40:49.022 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:40:49.023 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:40:49.023 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:40:49.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:40:49.017432+0000 mon.smithi061 (mon.0) 2287 : audit [DBG] from='client.? 172.21.15.61:0/1520443258' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:40:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:40:49.017432+0000 mon.smithi061 (mon.0) 2287 : audit [DBG] from='client.? 172.21.15.61:0/1520443258' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:40:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:40:48.352667+0000 mgr.smithi067.rdualw (mgr.24569) 10864 : audit [DBG] from='client.41386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:40:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:48.369922+0000 mgr.smithi067.rdualw (mgr.24569) 10865 : cluster [DBG] pgmap v9357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:40:48.656962+0000 mgr.smithi067.rdualw (mgr.24569) 10866 : audit [DBG] from='client.41390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:40:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:40:48.352667+0000 mgr.smithi067.rdualw (mgr.24569) 10864 : audit [DBG] from='client.41386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:40:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:48.369922+0000 mgr.smithi067.rdualw (mgr.24569) 10865 : cluster [DBG] pgmap v9357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:50.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:40:48.656962+0000 mgr.smithi067.rdualw (mgr.24569) 10866 : audit [DBG] from='client.41390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:40:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:50.370765+0000 mgr.smithi067.rdualw (mgr.24569) 10867 : cluster [DBG] pgmap v9358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:50.370765+0000 mgr.smithi067.rdualw (mgr.24569) 10867 : cluster [DBG] pgmap v9358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:52.371270+0000 mgr.smithi067.rdualw (mgr.24569) 10868 : cluster [DBG] pgmap v9359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:52.371270+0000 mgr.smithi067.rdualw (mgr.24569) 10868 : cluster [DBG] pgmap v9359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:54.372030+0000 mgr.smithi067.rdualw (mgr.24569) 10869 : cluster [DBG] pgmap v9360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:54.372030+0000 mgr.smithi067.rdualw (mgr.24569) 10869 : cluster [DBG] pgmap v9360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:40:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:40:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:56.372939+0000 mgr.smithi067.rdualw (mgr.24569) 10870 : cluster [DBG] pgmap v9361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:40:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:40:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:56.372939+0000 mgr.smithi067.rdualw (mgr.24569) 10870 : cluster [DBG] pgmap v9361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:41:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:40:58.373610+0000 mgr.smithi067.rdualw (mgr.24569) 10871 : cluster [DBG] pgmap v9362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:40:58.373610+0000 mgr.smithi067.rdualw (mgr.24569) 10871 : cluster [DBG] pgmap v9362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:00.374708+0000 mgr.smithi067.rdualw (mgr.24569) 10872 : cluster [DBG] pgmap v9363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:00.374708+0000 mgr.smithi067.rdualw (mgr.24569) 10872 : cluster [DBG] pgmap v9363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:02.375291+0000 mgr.smithi067.rdualw (mgr.24569) 10873 : cluster [DBG] pgmap v9364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:02.375291+0000 mgr.smithi067.rdualw (mgr.24569) 10873 : cluster [DBG] pgmap v9364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:04.376086+0000 mgr.smithi067.rdualw (mgr.24569) 10874 : cluster [DBG] pgmap v9365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:04.376086+0000 mgr.smithi067.rdualw (mgr.24569) 10874 : cluster [DBG] pgmap v9365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:06.377051+0000 mgr.smithi067.rdualw (mgr.24569) 10875 : cluster [DBG] pgmap v9366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:41:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:06.377051+0000 mgr.smithi067.rdualw (mgr.24569) 10875 : cluster [DBG] pgmap v9366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:41:09.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:41:08.425816+0000 mon.smithi067 (mon.1) 1645 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:41:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:41:08.427304+0000 mon.smithi067 (mon.1) 1646 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:41:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:41:08.428235+0000 mon.smithi067 (mon.1) 1647 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:41:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:41:08.847153+0000 mon.smithi061 (mon.0) 2288 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:41:09.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:41:08.853391+0000 mon.smithi061 (mon.0) 2289 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:41:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:41:08.425816+0000 mon.smithi067 (mon.1) 1645 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:41:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:41:08.427304+0000 mon.smithi067 (mon.1) 1646 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:41:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:41:08.428235+0000 mon.smithi067 (mon.1) 1647 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:41:09.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:41:08.847153+0000 mon.smithi061 (mon.0) 2288 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:41:09.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:41:08.853391+0000 mon.smithi061 (mon.0) 2289 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:41:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:08.377692+0000 mgr.smithi067.rdualw (mgr.24569) 10876 : cluster [DBG] pgmap v9367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:41:08.429097+0000 mgr.smithi067.rdualw (mgr.24569) 10877 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:41:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:08.377692+0000 mgr.smithi067.rdualw (mgr.24569) 10876 : cluster [DBG] pgmap v9367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:41:08.429097+0000 mgr.smithi067.rdualw (mgr.24569) 10877 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:41:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:10.378840+0000 mgr.smithi067.rdualw (mgr.24569) 10878 : cluster [DBG] pgmap v9368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:10.378840+0000 mgr.smithi067.rdualw (mgr.24569) 10878 : cluster [DBG] pgmap v9368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:12.379435+0000 mgr.smithi067.rdualw (mgr.24569) 10879 : cluster [DBG] pgmap v9369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:12.379435+0000 mgr.smithi067.rdualw (mgr.24569) 10879 : cluster [DBG] pgmap v9369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:14.380108+0000 mgr.smithi067.rdualw (mgr.24569) 10880 : cluster [DBG] pgmap v9370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:14.380108+0000 mgr.smithi067.rdualw (mgr.24569) 10880 : cluster [DBG] pgmap v9370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:16.380959+0000 mgr.smithi067.rdualw (mgr.24569) 10881 : cluster [DBG] pgmap v9371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:41:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:16.380959+0000 mgr.smithi067.rdualw (mgr.24569) 10881 : cluster [DBG] pgmap v9371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:41:19.333 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:41:19.624 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:41:19.624 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 4m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:41:19.625 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 4m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:41:19.625 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 4m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:41:19.625 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 4m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:41:19.625 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 4m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:41:19.625 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 4m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:41:19.626 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 4m ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:41:19.626 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 4m ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:41:19.626 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 4m ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:41:19.626 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 4m ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:41:19.627 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 4m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:41:19.627 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 4m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:41:19.627 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 4m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:41:19.627 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 4m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:41:19.628 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 4m ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:41:19.628 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 4m ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:41:19.628 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 4m ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:41:19.628 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 4m ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:41:19.629 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 4m ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:41:19.629 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 4m ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:41:19.629 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 4m ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:41:19.629 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 4m ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:41:19.629 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 4m ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:41:19.963 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:41:19.964 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:41:19.964 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:41:19.964 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:41:19.964 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:41:19.965 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:41:19.965 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:41:19.965 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:41:19.965 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:41:19.966 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:41:19.966 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:41:19.966 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:41:19.966 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:41:19.967 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:41:19.967 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:41:19.967 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:41:19.967 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:41:19.968 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:41:19.968 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:41:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:18.381476+0000 mgr.smithi067.rdualw (mgr.24569) 10882 : cluster [DBG] pgmap v9372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:41:19.961523+0000 mon.smithi061 (mon.0) 2290 : audit [DBG] from='client.? 172.21.15.61:0/1768576369' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:41:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:18.381476+0000 mgr.smithi067.rdualw (mgr.24569) 10882 : cluster [DBG] pgmap v9372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:41:19.961523+0000 mon.smithi061 (mon.0) 2290 : audit [DBG] from='client.? 172.21.15.61:0/1768576369' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:41:21.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:41:19.318880+0000 mgr.smithi067.rdualw (mgr.24569) 10883 : audit [DBG] from='client.41398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:41:21.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:41:19.606568+0000 mgr.smithi067.rdualw (mgr.24569) 10884 : audit [DBG] from='client.41402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:41:21.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:41:19.318880+0000 mgr.smithi067.rdualw (mgr.24569) 10883 : audit [DBG] from='client.41398 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:41:21.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:41:19.606568+0000 mgr.smithi067.rdualw (mgr.24569) 10884 : audit [DBG] from='client.41402 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:41:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:20.382481+0000 mgr.smithi067.rdualw (mgr.24569) 10885 : cluster [DBG] pgmap v9373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:20.382481+0000 mgr.smithi067.rdualw (mgr.24569) 10885 : cluster [DBG] pgmap v9373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:22.383256+0000 mgr.smithi067.rdualw (mgr.24569) 10886 : cluster [DBG] pgmap v9374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:22.383256+0000 mgr.smithi067.rdualw (mgr.24569) 10886 : cluster [DBG] pgmap v9374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:24.384050+0000 mgr.smithi067.rdualw (mgr.24569) 10887 : cluster [DBG] pgmap v9375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:24.384050+0000 mgr.smithi067.rdualw (mgr.24569) 10887 : cluster [DBG] pgmap v9375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:26.384999+0000 mgr.smithi067.rdualw (mgr.24569) 10888 : cluster [DBG] pgmap v9376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:41:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:26.384999+0000 mgr.smithi067.rdualw (mgr.24569) 10888 : cluster [DBG] pgmap v9376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:41:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:28.385631+0000 mgr.smithi067.rdualw (mgr.24569) 10889 : cluster [DBG] pgmap v9377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:28.385631+0000 mgr.smithi067.rdualw (mgr.24569) 10889 : cluster [DBG] pgmap v9377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:30.386527+0000 mgr.smithi067.rdualw (mgr.24569) 10890 : cluster [DBG] pgmap v9378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:30.386527+0000 mgr.smithi067.rdualw (mgr.24569) 10890 : cluster [DBG] pgmap v9378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:32.387070+0000 mgr.smithi067.rdualw (mgr.24569) 10891 : cluster [DBG] pgmap v9379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:32.387070+0000 mgr.smithi067.rdualw (mgr.24569) 10891 : cluster [DBG] pgmap v9379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:34.387658+0000 mgr.smithi067.rdualw (mgr.24569) 10892 : cluster [DBG] pgmap v9380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:41:36.177521+0000 mon.smithi067 (mon.1) 1648 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:41:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:41:36.177794+0000 mon.smithi067 (mon.1) 1649 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:41:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:41:36.178394+0000 mon.smithi061 (mon.0) 2291 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:41:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:41:36.178754+0000 mon.smithi061 (mon.0) 2292 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:41:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:34.387658+0000 mgr.smithi067.rdualw (mgr.24569) 10892 : cluster [DBG] pgmap v9380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:41:36.177521+0000 mon.smithi067 (mon.1) 1648 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:41:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:41:36.177794+0000 mon.smithi067 (mon.1) 1649 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:41:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:41:36.178394+0000 mon.smithi061 (mon.0) 2291 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:41:36.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:41:36.178754+0000 mon.smithi061 (mon.0) 2292 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:41:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:36.388592+0000 mgr.smithi067.rdualw (mgr.24569) 10893 : cluster [DBG] pgmap v9381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:41:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:36.388592+0000 mgr.smithi067.rdualw (mgr.24569) 10893 : cluster [DBG] pgmap v9381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:41:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:38.389092+0000 mgr.smithi067.rdualw (mgr.24569) 10894 : cluster [DBG] pgmap v9382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:38.389092+0000 mgr.smithi067.rdualw (mgr.24569) 10894 : cluster [DBG] pgmap v9382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:40.389990+0000 mgr.smithi067.rdualw (mgr.24569) 10895 : cluster [DBG] pgmap v9383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:40.389990+0000 mgr.smithi067.rdualw (mgr.24569) 10895 : cluster [DBG] pgmap v9383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:42.390583+0000 mgr.smithi067.rdualw (mgr.24569) 10896 : cluster [DBG] pgmap v9384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:42.390583+0000 mgr.smithi067.rdualw (mgr.24569) 10896 : cluster [DBG] pgmap v9384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:44.391275+0000 mgr.smithi067.rdualw (mgr.24569) 10897 : cluster [DBG] pgmap v9385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:44.391275+0000 mgr.smithi067.rdualw (mgr.24569) 10897 : cluster [DBG] pgmap v9385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:46.392217+0000 mgr.smithi067.rdualw (mgr.24569) 10898 : cluster [DBG] pgmap v9386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:41:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:46.392217+0000 mgr.smithi067.rdualw (mgr.24569) 10898 : cluster [DBG] pgmap v9386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:41:50.269 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:41:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:48.392758+0000 mgr.smithi067.rdualw (mgr.24569) 10899 : cluster [DBG] pgmap v9387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:48.392758+0000 mgr.smithi067.rdualw (mgr.24569) 10899 : cluster [DBG] pgmap v9387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:50.583 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:41:50.584 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 4m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:41:50.584 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 4m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:41:50.585 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 4m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:41:50.585 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 4m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:41:50.585 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 4m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:41:50.586 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 4m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:41:50.587 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 4m ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:41:50.587 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 4m ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:41:50.587 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 4m ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:41:50.588 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 4m ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:41:50.588 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 4m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:41:50.588 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 4m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:41:50.588 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 4m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:41:50.589 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 4m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:41:50.589 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 4m ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:41:50.589 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 4m ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:41:50.589 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 4m ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:41:50.590 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 4m ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:41:50.590 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 4m ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:41:50.590 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 4m ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:41:50.591 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 4m ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:41:50.591 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 4m ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:41:50.592 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 4m ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:41:50.925 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:41:50.925 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:41:50.925 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:41:50.926 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:41:50.926 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:41:50.926 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:41:50.926 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:41:50.927 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:41:50.927 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:41:50.927 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:41:50.927 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:41:50.927 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:41:50.928 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:41:50.928 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:41:50.928 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:41:50.928 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:41:50.929 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:41:50.929 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:41:50.929 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:41:51.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:41:50.923581+0000 mon.smithi061 (mon.0) 2293 : audit [DBG] from='client.? 172.21.15.61:0/3852671398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:41:51.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:41:50.923581+0000 mon.smithi061 (mon.0) 2293 : audit [DBG] from='client.? 172.21.15.61:0/3852671398' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:41:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:41:50.255602+0000 mgr.smithi067.rdualw (mgr.24569) 10900 : audit [DBG] from='client.41410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:41:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:50.393587+0000 mgr.smithi067.rdualw (mgr.24569) 10901 : cluster [DBG] pgmap v9388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:41:50.565023+0000 mgr.smithi067.rdualw (mgr.24569) 10902 : audit [DBG] from='client.41414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:41:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:41:50.255602+0000 mgr.smithi067.rdualw (mgr.24569) 10900 : audit [DBG] from='client.41410 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:41:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:50.393587+0000 mgr.smithi067.rdualw (mgr.24569) 10901 : cluster [DBG] pgmap v9388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:41:50.565023+0000 mgr.smithi067.rdualw (mgr.24569) 10902 : audit [DBG] from='client.41414 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:41:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:52.394292+0000 mgr.smithi067.rdualw (mgr.24569) 10903 : cluster [DBG] pgmap v9389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:52.394292+0000 mgr.smithi067.rdualw (mgr.24569) 10903 : cluster [DBG] pgmap v9389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:54.394933+0000 mgr.smithi067.rdualw (mgr.24569) 10904 : cluster [DBG] pgmap v9390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:54.394933+0000 mgr.smithi067.rdualw (mgr.24569) 10904 : cluster [DBG] pgmap v9390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:41:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:41:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:56.395728+0000 mgr.smithi067.rdualw (mgr.24569) 10905 : cluster [DBG] pgmap v9391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:41:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:41:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:56.395728+0000 mgr.smithi067.rdualw (mgr.24569) 10905 : cluster [DBG] pgmap v9391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:42:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:41:58.396308+0000 mgr.smithi067.rdualw (mgr.24569) 10906 : cluster [DBG] pgmap v9392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:41:58.396308+0000 mgr.smithi067.rdualw (mgr.24569) 10906 : cluster [DBG] pgmap v9392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:02.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:00.397293+0000 mgr.smithi067.rdualw (mgr.24569) 10907 : cluster [DBG] pgmap v9393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:00.397293+0000 mgr.smithi067.rdualw (mgr.24569) 10907 : cluster [DBG] pgmap v9393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:04.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:02.398015+0000 mgr.smithi067.rdualw (mgr.24569) 10908 : cluster [DBG] pgmap v9394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:02.398015+0000 mgr.smithi067.rdualw (mgr.24569) 10908 : cluster [DBG] pgmap v9394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:04.398670+0000 mgr.smithi067.rdualw (mgr.24569) 10909 : cluster [DBG] pgmap v9395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:04.398670+0000 mgr.smithi067.rdualw (mgr.24569) 10909 : cluster [DBG] pgmap v9395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:06.399727+0000 mgr.smithi067.rdualw (mgr.24569) 10910 : cluster [DBG] pgmap v9396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:42:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:06.399727+0000 mgr.smithi067.rdualw (mgr.24569) 10910 : cluster [DBG] pgmap v9396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:42:09.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:42:08.856483+0000 mon.smithi067 (mon.1) 1650 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:42:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:42:08.857978+0000 mon.smithi067 (mon.1) 1651 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:42:09.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:42:08.858933+0000 mon.smithi067 (mon.1) 1652 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:42:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:42:08.856483+0000 mon.smithi067 (mon.1) 1650 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:42:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:42:08.857978+0000 mon.smithi067 (mon.1) 1651 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:42:09.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:42:08.858933+0000 mon.smithi067 (mon.1) 1652 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:42:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:08.400287+0000 mgr.smithi067.rdualw (mgr.24569) 10911 : cluster [DBG] pgmap v9397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:42:08.859842+0000 mgr.smithi067.rdualw (mgr.24569) 10912 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:42:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:42:09.276009+0000 mon.smithi061 (mon.0) 2294 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:42:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:42:09.281658+0000 mon.smithi061 (mon.0) 2295 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:42:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:08.400287+0000 mgr.smithi067.rdualw (mgr.24569) 10911 : cluster [DBG] pgmap v9397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:42:08.859842+0000 mgr.smithi067.rdualw (mgr.24569) 10912 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:42:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:42:09.276009+0000 mon.smithi061 (mon.0) 2294 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:42:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:42:09.281658+0000 mon.smithi061 (mon.0) 2295 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:42:12.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:10.401142+0000 mgr.smithi067.rdualw (mgr.24569) 10913 : cluster [DBG] pgmap v9398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:10.401142+0000 mgr.smithi067.rdualw (mgr.24569) 10913 : cluster [DBG] pgmap v9398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:12.401867+0000 mgr.smithi067.rdualw (mgr.24569) 10914 : cluster [DBG] pgmap v9399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:12.401867+0000 mgr.smithi067.rdualw (mgr.24569) 10914 : cluster [DBG] pgmap v9399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:14.402462+0000 mgr.smithi067.rdualw (mgr.24569) 10915 : cluster [DBG] pgmap v9400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:14.402462+0000 mgr.smithi067.rdualw (mgr.24569) 10915 : cluster [DBG] pgmap v9400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:18.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:16.403261+0000 mgr.smithi067.rdualw (mgr.24569) 10916 : cluster [DBG] pgmap v9401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:42:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:16.403261+0000 mgr.smithi067.rdualw (mgr.24569) 10916 : cluster [DBG] pgmap v9401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:42:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:18.403766+0000 mgr.smithi067.rdualw (mgr.24569) 10917 : cluster [DBG] pgmap v9402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:18.403766+0000 mgr.smithi067.rdualw (mgr.24569) 10917 : cluster [DBG] pgmap v9402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:21.241 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:42:21.532 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:42:21.532 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 5m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:42:21.532 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 5m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:42:21.533 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 5m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:42:21.533 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 5m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:42:21.533 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 5m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:42:21.533 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 5m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:42:21.534 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 5m ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:42:21.534 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 5m ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:42:21.534 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 5m ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:42:21.534 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 5m ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:42:21.535 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 5m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:42:21.535 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 5m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:42:21.535 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 5m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:42:21.535 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 5m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:42:21.535 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 5m ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:42:21.536 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 5m ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:42:21.536 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 5m ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:42:21.536 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 5m ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:42:21.537 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 5m ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:42:21.537 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 5m ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:42:21.537 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 5m ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:42:21.537 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 5m ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:42:21.537 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 5m ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:42:21.878 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:42:21.878 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:42:21.879 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:42:21.879 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:42:21.879 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:42:21.879 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:42:21.880 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:42:21.880 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:42:21.880 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:42:21.880 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:42:21.881 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:42:21.881 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:42:21.881 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:42:21.881 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:42:21.881 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:42:21.882 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:42:21.882 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:42:21.882 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:42:21.882 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:42:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:20.404564+0000 mgr.smithi067.rdualw (mgr.24569) 10918 : cluster [DBG] pgmap v9403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:22.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:42:21.227167+0000 mgr.smithi067.rdualw (mgr.24569) 10919 : audit [DBG] from='client.41422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:42:22.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:42:21.876940+0000 mon.smithi061 (mon.0) 2296 : audit [DBG] from='client.? 172.21.15.61:0/1781343626' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:42:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:20.404564+0000 mgr.smithi067.rdualw (mgr.24569) 10918 : cluster [DBG] pgmap v9403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:42:21.227167+0000 mgr.smithi067.rdualw (mgr.24569) 10919 : audit [DBG] from='client.41422 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:42:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:42:21.876940+0000 mon.smithi061 (mon.0) 2296 : audit [DBG] from='client.? 172.21.15.61:0/1781343626' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:42:23.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:42:21.514166+0000 mgr.smithi067.rdualw (mgr.24569) 10920 : audit [DBG] from='client.41426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:42:23.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:42:21.514166+0000 mgr.smithi067.rdualw (mgr.24569) 10920 : audit [DBG] from='client.41426 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:42:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:22.405196+0000 mgr.smithi067.rdualw (mgr.24569) 10921 : cluster [DBG] pgmap v9404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:22.405196+0000 mgr.smithi067.rdualw (mgr.24569) 10921 : cluster [DBG] pgmap v9404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:24.405864+0000 mgr.smithi067.rdualw (mgr.24569) 10922 : cluster [DBG] pgmap v9405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:24.405864+0000 mgr.smithi067.rdualw (mgr.24569) 10922 : cluster [DBG] pgmap v9405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:26.406812+0000 mgr.smithi067.rdualw (mgr.24569) 10923 : cluster [DBG] pgmap v9406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:42:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:26.406812+0000 mgr.smithi067.rdualw (mgr.24569) 10923 : cluster [DBG] pgmap v9406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:42:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:28.407348+0000 mgr.smithi067.rdualw (mgr.24569) 10924 : cluster [DBG] pgmap v9407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:28.407348+0000 mgr.smithi067.rdualw (mgr.24569) 10924 : cluster [DBG] pgmap v9407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:32.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:30.408267+0000 mgr.smithi067.rdualw (mgr.24569) 10925 : cluster [DBG] pgmap v9408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:30.408267+0000 mgr.smithi067.rdualw (mgr.24569) 10925 : cluster [DBG] pgmap v9408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:32.408994+0000 mgr.smithi067.rdualw (mgr.24569) 10926 : cluster [DBG] pgmap v9409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:32.408994+0000 mgr.smithi067.rdualw (mgr.24569) 10926 : cluster [DBG] pgmap v9409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:34.409624+0000 mgr.smithi067.rdualw (mgr.24569) 10927 : cluster [DBG] pgmap v9410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:42:36.183346+0000 mon.smithi067 (mon.1) 1653 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:42:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:42:36.183694+0000 mon.smithi067 (mon.1) 1654 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:42:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:42:36.183952+0000 mon.smithi061 (mon.0) 2297 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:42:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:42:36.184220+0000 mon.smithi061 (mon.0) 2298 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:42:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:34.409624+0000 mgr.smithi067.rdualw (mgr.24569) 10927 : cluster [DBG] pgmap v9410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:42:36.183346+0000 mon.smithi067 (mon.1) 1653 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:42:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:42:36.183694+0000 mon.smithi067 (mon.1) 1654 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:42:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:42:36.183952+0000 mon.smithi061 (mon.0) 2297 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:42:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:42:36.184220+0000 mon.smithi061 (mon.0) 2298 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:42:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:36.410488+0000 mgr.smithi067.rdualw (mgr.24569) 10928 : cluster [DBG] pgmap v9411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:42:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:36.410488+0000 mgr.smithi067.rdualw (mgr.24569) 10928 : cluster [DBG] pgmap v9411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:42:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:38.410983+0000 mgr.smithi067.rdualw (mgr.24569) 10929 : cluster [DBG] pgmap v9412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:38.410983+0000 mgr.smithi067.rdualw (mgr.24569) 10929 : cluster [DBG] pgmap v9412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:40.412040+0000 mgr.smithi067.rdualw (mgr.24569) 10930 : cluster [DBG] pgmap v9413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:40.412040+0000 mgr.smithi067.rdualw (mgr.24569) 10930 : cluster [DBG] pgmap v9413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:42.412748+0000 mgr.smithi067.rdualw (mgr.24569) 10931 : cluster [DBG] pgmap v9414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:42.412748+0000 mgr.smithi067.rdualw (mgr.24569) 10931 : cluster [DBG] pgmap v9414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:44.413328+0000 mgr.smithi067.rdualw (mgr.24569) 10932 : cluster [DBG] pgmap v9415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:44.413328+0000 mgr.smithi067.rdualw (mgr.24569) 10932 : cluster [DBG] pgmap v9415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:46.414363+0000 mgr.smithi067.rdualw (mgr.24569) 10933 : cluster [DBG] pgmap v9416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:42:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:46.414363+0000 mgr.smithi067.rdualw (mgr.24569) 10933 : cluster [DBG] pgmap v9416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:42:49.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:48.414945+0000 mgr.smithi067.rdualw (mgr.24569) 10934 : cluster [DBG] pgmap v9417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:49.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:48.414945+0000 mgr.smithi067.rdualw (mgr.24569) 10934 : cluster [DBG] pgmap v9417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:51.784 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:50.416004+0000 mgr.smithi067.rdualw (mgr.24569) 10935 : cluster [DBG] pgmap v9418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:50.416004+0000 mgr.smithi067.rdualw (mgr.24569) 10935 : cluster [DBG] pgmap v9418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:52.187 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:42:52.489 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:42:52.489 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 5m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:42:52.489 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 5m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:42:52.490 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 5m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:42:52.490 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 5m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:42:52.490 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 5m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:42:52.490 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 5m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:42:52.491 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 5m ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:42:52.491 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 5m ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:42:52.491 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 5m ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:42:52.491 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 5m ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:42:52.491 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 5m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:42:52.492 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 5m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:42:52.492 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 5m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:42:52.492 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 5m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:42:52.492 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 5m ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:42:52.493 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 5m ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:42:52.493 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 5m ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:42:52.493 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 5m ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:42:52.493 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 5m ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:42:52.493 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 5m ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:42:52.494 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 5m ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:42:52.494 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 5m ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:42:52.494 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 5m ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:42:52.829 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:42:52.830 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:42:52.830 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:42:52.830 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:42:52.830 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:42:52.831 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:42:52.831 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:42:52.831 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:42:52.831 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:42:52.832 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:42:52.832 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:42:52.832 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:42:52.832 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:42:52.832 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:42:52.833 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:42:52.833 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:42:52.833 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:42:52.833 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:42:52.834 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:42:53.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:42:52.173269+0000 mgr.smithi067.rdualw (mgr.24569) 10936 : audit [DBG] from='client.41434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:42:53.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:42:52.828257+0000 mon.smithi061 (mon.0) 2299 : audit [DBG] from='client.? 172.21.15.61:0/318368300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:42:53.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:42:52.173269+0000 mgr.smithi067.rdualw (mgr.24569) 10936 : audit [DBG] from='client.41434 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:42:53.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:42:52.828257+0000 mon.smithi061 (mon.0) 2299 : audit [DBG] from='client.? 172.21.15.61:0/318368300' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:42:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:52.416638+0000 mgr.smithi067.rdualw (mgr.24569) 10937 : cluster [DBG] pgmap v9419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:42:52.471303+0000 mgr.smithi067.rdualw (mgr.24569) 10938 : audit [DBG] from='client.41438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:42:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:52.416638+0000 mgr.smithi067.rdualw (mgr.24569) 10937 : cluster [DBG] pgmap v9419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:42:52.471303+0000 mgr.smithi067.rdualw (mgr.24569) 10938 : audit [DBG] from='client.41438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:42:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:54.417382+0000 mgr.smithi067.rdualw (mgr.24569) 10939 : cluster [DBG] pgmap v9420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:54.417382+0000 mgr.smithi067.rdualw (mgr.24569) 10939 : cluster [DBG] pgmap v9420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:42:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:42:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:56.418290+0000 mgr.smithi067.rdualw (mgr.24569) 10940 : cluster [DBG] pgmap v9421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:42:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:42:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:56.418290+0000 mgr.smithi067.rdualw (mgr.24569) 10940 : cluster [DBG] pgmap v9421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:43:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:42:58.418979+0000 mgr.smithi067.rdualw (mgr.24569) 10941 : cluster [DBG] pgmap v9422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:42:58.418979+0000 mgr.smithi067.rdualw (mgr.24569) 10941 : cluster [DBG] pgmap v9422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:00.419818+0000 mgr.smithi067.rdualw (mgr.24569) 10942 : cluster [DBG] pgmap v9423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:02.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:00.419818+0000 mgr.smithi067.rdualw (mgr.24569) 10942 : cluster [DBG] pgmap v9423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:02.420369+0000 mgr.smithi067.rdualw (mgr.24569) 10943 : cluster [DBG] pgmap v9424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:02.420369+0000 mgr.smithi067.rdualw (mgr.24569) 10943 : cluster [DBG] pgmap v9424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:04.421108+0000 mgr.smithi067.rdualw (mgr.24569) 10944 : cluster [DBG] pgmap v9425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:04.421108+0000 mgr.smithi067.rdualw (mgr.24569) 10944 : cluster [DBG] pgmap v9425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:06.421957+0000 mgr.smithi067.rdualw (mgr.24569) 10945 : cluster [DBG] pgmap v9426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:43:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:06.421957+0000 mgr.smithi067.rdualw (mgr.24569) 10945 : cluster [DBG] pgmap v9426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:43:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:08.422430+0000 mgr.smithi067.rdualw (mgr.24569) 10946 : cluster [DBG] pgmap v9427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:43:09.286695+0000 mon.smithi067 (mon.1) 1655 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:43:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:43:09.288143+0000 mon.smithi067 (mon.1) 1656 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:43:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:43:09.289077+0000 mon.smithi067 (mon.1) 1657 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:43:10.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:43:09.706442+0000 mon.smithi061 (mon.0) 2300 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:43:10.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:43:09.711970+0000 mon.smithi061 (mon.0) 2301 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:43:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:08.422430+0000 mgr.smithi067.rdualw (mgr.24569) 10946 : cluster [DBG] pgmap v9427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:43:09.286695+0000 mon.smithi067 (mon.1) 1655 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:43:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:43:09.288143+0000 mon.smithi067 (mon.1) 1656 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:43:10.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:43:09.289077+0000 mon.smithi067 (mon.1) 1657 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:43:10.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:43:09.706442+0000 mon.smithi061 (mon.0) 2300 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:43:10.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:43:09.711970+0000 mon.smithi061 (mon.0) 2301 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:43:11.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:43:09.289929+0000 mgr.smithi067.rdualw (mgr.24569) 10947 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:43:11.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:43:09.289929+0000 mgr.smithi067.rdualw (mgr.24569) 10947 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:43:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:10.423364+0000 mgr.smithi067.rdualw (mgr.24569) 10948 : cluster [DBG] pgmap v9428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:10.423364+0000 mgr.smithi067.rdualw (mgr.24569) 10948 : cluster [DBG] pgmap v9428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:12.423858+0000 mgr.smithi067.rdualw (mgr.24569) 10949 : cluster [DBG] pgmap v9429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:12.423858+0000 mgr.smithi067.rdualw (mgr.24569) 10949 : cluster [DBG] pgmap v9429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:14.424426+0000 mgr.smithi067.rdualw (mgr.24569) 10950 : cluster [DBG] pgmap v9430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:14.424426+0000 mgr.smithi067.rdualw (mgr.24569) 10950 : cluster [DBG] pgmap v9430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:16.425219+0000 mgr.smithi067.rdualw (mgr.24569) 10951 : cluster [DBG] pgmap v9431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:43:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:16.425219+0000 mgr.smithi067.rdualw (mgr.24569) 10951 : cluster [DBG] pgmap v9431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:43:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:18.425843+0000 mgr.smithi067.rdualw (mgr.24569) 10952 : cluster [DBG] pgmap v9432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:18.425843+0000 mgr.smithi067.rdualw (mgr.24569) 10952 : cluster [DBG] pgmap v9432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:20.426798+0000 mgr.smithi067.rdualw (mgr.24569) 10953 : cluster [DBG] pgmap v9433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:20.426798+0000 mgr.smithi067.rdualw (mgr.24569) 10953 : cluster [DBG] pgmap v9433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:23.136 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:43:23.427 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:43:23.427 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 6m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:43:23.427 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 6m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:43:23.428 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 6m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:43:23.428 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 6m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:43:23.428 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 6m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:43:23.428 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 6m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:43:23.429 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 6m ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:43:23.429 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 6m ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:43:23.429 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 6m ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:43:23.429 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 6m ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:43:23.430 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 6m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:43:23.430 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 6m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:43:23.430 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 6m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:43:23.430 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 6m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:43:23.431 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 6m ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:43:23.431 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 6m ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:43:23.431 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 6m ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:43:23.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 6m ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:43:23.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 6m ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:43:23.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 6m ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:43:23.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 6m ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:43:23.432 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 6m ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:43:23.433 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 6m ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:43:23.770 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:43:23.770 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:43:23.771 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:43:23.771 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:43:23.771 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:43:23.771 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:43:23.772 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:43:23.772 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:43:23.772 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:43:23.772 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:43:23.773 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:43:23.773 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:43:23.773 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:43:23.773 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:43:23.773 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:43:23.774 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:43:23.774 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:43:23.774 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:43:23.774 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:43:24.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:22.427356+0000 mgr.smithi067.rdualw (mgr.24569) 10954 : cluster [DBG] pgmap v9434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:24.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:43:23.122323+0000 mgr.smithi067.rdualw (mgr.24569) 10955 : audit [DBG] from='client.41446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:43:24.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:43:23.768901+0000 mon.smithi061 (mon.0) 2302 : audit [DBG] from='client.? 172.21.15.61:0/2603004740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:43:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:22.427356+0000 mgr.smithi067.rdualw (mgr.24569) 10954 : cluster [DBG] pgmap v9434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:43:23.122323+0000 mgr.smithi067.rdualw (mgr.24569) 10955 : audit [DBG] from='client.41446 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:43:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:43:23.768901+0000 mon.smithi061 (mon.0) 2302 : audit [DBG] from='client.? 172.21.15.61:0/2603004740' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:43:25.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:43:23.409177+0000 mgr.smithi067.rdualw (mgr.24569) 10956 : audit [DBG] from='client.41450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:43:25.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:43:23.409177+0000 mgr.smithi067.rdualw (mgr.24569) 10956 : audit [DBG] from='client.41450 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:43:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:24.427914+0000 mgr.smithi067.rdualw (mgr.24569) 10957 : cluster [DBG] pgmap v9435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:26.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:24.427914+0000 mgr.smithi067.rdualw (mgr.24569) 10957 : cluster [DBG] pgmap v9435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:26.428754+0000 mgr.smithi067.rdualw (mgr.24569) 10958 : cluster [DBG] pgmap v9436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:43:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:26.428754+0000 mgr.smithi067.rdualw (mgr.24569) 10958 : cluster [DBG] pgmap v9436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:43:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:28.429429+0000 mgr.smithi067.rdualw (mgr.24569) 10959 : cluster [DBG] pgmap v9437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:30.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:28.429429+0000 mgr.smithi067.rdualw (mgr.24569) 10959 : cluster [DBG] pgmap v9437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:30.430485+0000 mgr.smithi067.rdualw (mgr.24569) 10960 : cluster [DBG] pgmap v9438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:30.430485+0000 mgr.smithi067.rdualw (mgr.24569) 10960 : cluster [DBG] pgmap v9438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:32.431102+0000 mgr.smithi067.rdualw (mgr.24569) 10961 : cluster [DBG] pgmap v9439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:32.431102+0000 mgr.smithi067.rdualw (mgr.24569) 10961 : cluster [DBG] pgmap v9439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:34.431852+0000 mgr.smithi067.rdualw (mgr.24569) 10962 : cluster [DBG] pgmap v9440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:43:36.189314+0000 mon.smithi067 (mon.1) 1658 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:43:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:43:36.189577+0000 mon.smithi067 (mon.1) 1659 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:43:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:43:36.189955+0000 mon.smithi061 (mon.0) 2303 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:43:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:43:36.190322+0000 mon.smithi061 (mon.0) 2304 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:43:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:34.431852+0000 mgr.smithi067.rdualw (mgr.24569) 10962 : cluster [DBG] pgmap v9440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:43:36.189314+0000 mon.smithi067 (mon.1) 1658 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:43:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:43:36.189577+0000 mon.smithi067 (mon.1) 1659 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:43:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:43:36.189955+0000 mon.smithi061 (mon.0) 2303 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:43:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:43:36.190322+0000 mon.smithi061 (mon.0) 2304 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:43:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:36.432668+0000 mgr.smithi067.rdualw (mgr.24569) 10963 : cluster [DBG] pgmap v9441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:43:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:36.432668+0000 mgr.smithi067.rdualw (mgr.24569) 10963 : cluster [DBG] pgmap v9441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:43:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:38.433152+0000 mgr.smithi067.rdualw (mgr.24569) 10964 : cluster [DBG] pgmap v9442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:38.433152+0000 mgr.smithi067.rdualw (mgr.24569) 10964 : cluster [DBG] pgmap v9442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:40.434069+0000 mgr.smithi067.rdualw (mgr.24569) 10965 : cluster [DBG] pgmap v9443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:40.434069+0000 mgr.smithi067.rdualw (mgr.24569) 10965 : cluster [DBG] pgmap v9443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:42.434600+0000 mgr.smithi067.rdualw (mgr.24569) 10966 : cluster [DBG] pgmap v9444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:42.434600+0000 mgr.smithi067.rdualw (mgr.24569) 10966 : cluster [DBG] pgmap v9444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:44.435344+0000 mgr.smithi067.rdualw (mgr.24569) 10967 : cluster [DBG] pgmap v9445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:44.435344+0000 mgr.smithi067.rdualw (mgr.24569) 10967 : cluster [DBG] pgmap v9445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:46.436306+0000 mgr.smithi067.rdualw (mgr.24569) 10968 : cluster [DBG] pgmap v9446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:43:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:46.436306+0000 mgr.smithi067.rdualw (mgr.24569) 10968 : cluster [DBG] pgmap v9446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:43:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:48.436923+0000 mgr.smithi067.rdualw (mgr.24569) 10969 : cluster [DBG] pgmap v9447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:48.436923+0000 mgr.smithi067.rdualw (mgr.24569) 10969 : cluster [DBG] pgmap v9447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:50.437745+0000 mgr.smithi067.rdualw (mgr.24569) 10970 : cluster [DBG] pgmap v9448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:50.437745+0000 mgr.smithi067.rdualw (mgr.24569) 10970 : cluster [DBG] pgmap v9448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:54.110 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:43:54.412 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:43:54.413 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 6m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:43:54.413 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 6m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:43:54.413 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 6m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:43:54.413 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 6m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:43:54.414 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 6m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:43:54.414 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 6m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:43:54.414 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 6m ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:43:54.414 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 6m ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:43:54.415 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 6m ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:43:54.415 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 6m ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:43:54.415 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 6m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:43:54.415 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 6m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:43:54.416 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 6m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:43:54.416 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 6m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:43:54.416 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 6m ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:43:54.416 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 6m ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:43:54.416 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 6m ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:43:54.417 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 6m ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:43:54.417 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 6m ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:43:54.417 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 6m ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:43:54.417 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 6m ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:43:54.417 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 6m ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:43:54.418 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 6m ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:43:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:52.438459+0000 mgr.smithi067.rdualw (mgr.24569) 10971 : cluster [DBG] pgmap v9449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:52.438459+0000 mgr.smithi067.rdualw (mgr.24569) 10971 : cluster [DBG] pgmap v9449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:54.802 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:43:54.803 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:43:54.803 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:43:54.803 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:43:54.804 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:43:54.804 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:43:54.804 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:43:54.804 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:43:54.804 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:43:54.805 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:43:54.805 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:43:54.805 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:43:54.805 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:43:54.806 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:43:54.806 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:43:54.806 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:43:54.806 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:43:54.807 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:43:54.807 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:43:55.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:43:54.096755+0000 mgr.smithi067.rdualw (mgr.24569) 10972 : audit [DBG] from='client.41458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:43:55.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:43:54.801168+0000 mon.smithi061 (mon.0) 2305 : audit [DBG] from='client.? 172.21.15.61:0/751123183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:43:55.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:43:54.096755+0000 mgr.smithi067.rdualw (mgr.24569) 10972 : audit [DBG] from='client.41458 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:43:55.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:43:54.801168+0000 mon.smithi061 (mon.0) 2305 : audit [DBG] from='client.? 172.21.15.61:0/751123183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:43:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:43:54.394370+0000 mgr.smithi067.rdualw (mgr.24569) 10973 : audit [DBG] from='client.41462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:43:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:54.439043+0000 mgr.smithi067.rdualw (mgr.24569) 10974 : cluster [DBG] pgmap v9450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:43:54.394370+0000 mgr.smithi067.rdualw (mgr.24569) 10973 : audit [DBG] from='client.41462 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:43:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:54.439043+0000 mgr.smithi067.rdualw (mgr.24569) 10974 : cluster [DBG] pgmap v9450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:43:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:43:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:56.439883+0000 mgr.smithi067.rdualw (mgr.24569) 10975 : cluster [DBG] pgmap v9451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:43:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:43:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:56.439883+0000 mgr.smithi067.rdualw (mgr.24569) 10975 : cluster [DBG] pgmap v9451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:44:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:43:58.440373+0000 mgr.smithi067.rdualw (mgr.24569) 10976 : cluster [DBG] pgmap v9452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:43:58.440373+0000 mgr.smithi067.rdualw (mgr.24569) 10976 : cluster [DBG] pgmap v9452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:00.441303+0000 mgr.smithi067.rdualw (mgr.24569) 10977 : cluster [DBG] pgmap v9453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:00.441303+0000 mgr.smithi067.rdualw (mgr.24569) 10977 : cluster [DBG] pgmap v9453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:02.441847+0000 mgr.smithi067.rdualw (mgr.24569) 10978 : cluster [DBG] pgmap v9454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:02.441847+0000 mgr.smithi067.rdualw (mgr.24569) 10978 : cluster [DBG] pgmap v9454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:04.442498+0000 mgr.smithi067.rdualw (mgr.24569) 10979 : cluster [DBG] pgmap v9455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:04.442498+0000 mgr.smithi067.rdualw (mgr.24569) 10979 : cluster [DBG] pgmap v9455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:06.443580+0000 mgr.smithi067.rdualw (mgr.24569) 10980 : cluster [DBG] pgmap v9456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:44:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:06.443580+0000 mgr.smithi067.rdualw (mgr.24569) 10980 : cluster [DBG] pgmap v9456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:44:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:08.444118+0000 mgr.smithi067.rdualw (mgr.24569) 10981 : cluster [DBG] pgmap v9457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:44:09.717027+0000 mon.smithi067 (mon.1) 1660 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:44:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:44:09.718568+0000 mon.smithi067 (mon.1) 1661 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:44:10.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:44:09.719511+0000 mon.smithi067 (mon.1) 1662 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:44:10.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:44:10.135266+0000 mon.smithi061 (mon.0) 2306 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:44:10.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:44:10.142788+0000 mon.smithi061 (mon.0) 2307 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:44:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:08.444118+0000 mgr.smithi067.rdualw (mgr.24569) 10981 : cluster [DBG] pgmap v9457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:44:09.717027+0000 mon.smithi067 (mon.1) 1660 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:44:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:44:09.718568+0000 mon.smithi067 (mon.1) 1661 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:44:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:44:09.719511+0000 mon.smithi067 (mon.1) 1662 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:44:10.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:44:10.135266+0000 mon.smithi061 (mon.0) 2306 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:44:10.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:44:10.142788+0000 mon.smithi061 (mon.0) 2307 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:44:11.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:44:09.720403+0000 mgr.smithi067.rdualw (mgr.24569) 10982 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:44:11.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:44:09.720403+0000 mgr.smithi067.rdualw (mgr.24569) 10982 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:44:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:10.444929+0000 mgr.smithi067.rdualw (mgr.24569) 10983 : cluster [DBG] pgmap v9458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:10.444929+0000 mgr.smithi067.rdualw (mgr.24569) 10983 : cluster [DBG] pgmap v9458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:12.445457+0000 mgr.smithi067.rdualw (mgr.24569) 10984 : cluster [DBG] pgmap v9459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:12.445457+0000 mgr.smithi067.rdualw (mgr.24569) 10984 : cluster [DBG] pgmap v9459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:14.446119+0000 mgr.smithi067.rdualw (mgr.24569) 10985 : cluster [DBG] pgmap v9460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:14.446119+0000 mgr.smithi067.rdualw (mgr.24569) 10985 : cluster [DBG] pgmap v9460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:18.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:16.447114+0000 mgr.smithi067.rdualw (mgr.24569) 10986 : cluster [DBG] pgmap v9461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:44:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:16.447114+0000 mgr.smithi067.rdualw (mgr.24569) 10986 : cluster [DBG] pgmap v9461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:44:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:18.447651+0000 mgr.smithi067.rdualw (mgr.24569) 10987 : cluster [DBG] pgmap v9462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:18.447651+0000 mgr.smithi067.rdualw (mgr.24569) 10987 : cluster [DBG] pgmap v9462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:20.448457+0000 mgr.smithi067.rdualw (mgr.24569) 10988 : cluster [DBG] pgmap v9463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:20.448457+0000 mgr.smithi067.rdualw (mgr.24569) 10988 : cluster [DBG] pgmap v9463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:24.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:22.449106+0000 mgr.smithi067.rdualw (mgr.24569) 10989 : cluster [DBG] pgmap v9464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:24.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:22.449106+0000 mgr.smithi067.rdualw (mgr.24569) 10989 : cluster [DBG] pgmap v9464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:25.110 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:44:25.412 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:44:25.412 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 7m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:44:25.412 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 7m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:44:25.413 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 7m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:44:25.413 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 7m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:44:25.413 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 7m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:44:25.413 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 7m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:44:25.414 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 7m ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:44:25.414 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 7m ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:44:25.414 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 7m ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:44:25.414 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 7m ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:44:25.415 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 7m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:44:25.415 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 7m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:44:25.415 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 7m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:44:25.415 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 7m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:44:25.415 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 7m ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:44:25.416 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 7m ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:44:25.416 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 7m ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:44:25.416 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 7m ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:44:25.416 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 7m ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:44:25.417 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 7m ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:44:25.417 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 7m ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:44:25.417 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 7m ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:44:25.417 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 7m ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:44:25.849 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:44:25.850 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:44:25.850 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:44:25.851 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:44:25.851 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:44:25.851 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:44:25.852 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:44:25.852 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:44:25.852 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:44:25.852 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:44:25.852 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:44:25.853 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:44:25.853 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:44:25.853 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:44:25.853 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:44:25.854 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:44:25.854 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:44:25.854 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:44:25.854 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:44:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:24.449840+0000 mgr.smithi067.rdualw (mgr.24569) 10990 : cluster [DBG] pgmap v9465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:44:25.096813+0000 mgr.smithi067.rdualw (mgr.24569) 10991 : audit [DBG] from='client.41470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:44:26.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:44:25.848044+0000 mon.smithi061 (mon.0) 2308 : audit [DBG] from='client.? 172.21.15.61:0/1412823196' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:44:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:24.449840+0000 mgr.smithi067.rdualw (mgr.24569) 10990 : cluster [DBG] pgmap v9465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:44:25.096813+0000 mgr.smithi067.rdualw (mgr.24569) 10991 : audit [DBG] from='client.41470 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:44:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:44:25.848044+0000 mon.smithi061 (mon.0) 2308 : audit [DBG] from='client.? 172.21.15.61:0/1412823196' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:44:27.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:44:25.393997+0000 mgr.smithi067.rdualw (mgr.24569) 10992 : audit [DBG] from='client.41474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:44:27.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:44:25.393997+0000 mgr.smithi067.rdualw (mgr.24569) 10992 : audit [DBG] from='client.41474 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:44:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:26.450711+0000 mgr.smithi067.rdualw (mgr.24569) 10993 : cluster [DBG] pgmap v9466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:44:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:26.450711+0000 mgr.smithi067.rdualw (mgr.24569) 10993 : cluster [DBG] pgmap v9466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:44:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:28.451396+0000 mgr.smithi067.rdualw (mgr.24569) 10994 : cluster [DBG] pgmap v9467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:28.451396+0000 mgr.smithi067.rdualw (mgr.24569) 10994 : cluster [DBG] pgmap v9467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:30.452389+0000 mgr.smithi067.rdualw (mgr.24569) 10995 : cluster [DBG] pgmap v9468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:30.452389+0000 mgr.smithi067.rdualw (mgr.24569) 10995 : cluster [DBG] pgmap v9468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:33.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:32.452861+0000 mgr.smithi067.rdualw (mgr.24569) 10996 : cluster [DBG] pgmap v9469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:33.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:32.452861+0000 mgr.smithi067.rdualw (mgr.24569) 10996 : cluster [DBG] pgmap v9469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:34.453605+0000 mgr.smithi067.rdualw (mgr.24569) 10997 : cluster [DBG] pgmap v9470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:35.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:34.453605+0000 mgr.smithi067.rdualw (mgr.24569) 10997 : cluster [DBG] pgmap v9470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:44:36.195481+0000 mon.smithi067 (mon.1) 1663 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:44:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:44:36.195813+0000 mon.smithi067 (mon.1) 1664 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:44:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:44:36.196184+0000 mon.smithi061 (mon.0) 2309 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:44:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:44:36.196502+0000 mon.smithi061 (mon.0) 2310 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:44:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:44:36.195481+0000 mon.smithi067 (mon.1) 1663 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:44:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:44:36.195813+0000 mon.smithi067 (mon.1) 1664 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:44:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:44:36.196184+0000 mon.smithi061 (mon.0) 2309 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:44:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:44:36.196502+0000 mon.smithi061 (mon.0) 2310 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:44:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:36.454470+0000 mgr.smithi067.rdualw (mgr.24569) 10998 : cluster [DBG] pgmap v9471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:44:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:36.454470+0000 mgr.smithi067.rdualw (mgr.24569) 10998 : cluster [DBG] pgmap v9471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:44:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:38.455188+0000 mgr.smithi067.rdualw (mgr.24569) 10999 : cluster [DBG] pgmap v9472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:38.455188+0000 mgr.smithi067.rdualw (mgr.24569) 10999 : cluster [DBG] pgmap v9472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:40.456048+0000 mgr.smithi067.rdualw (mgr.24569) 11000 : cluster [DBG] pgmap v9473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:40.456048+0000 mgr.smithi067.rdualw (mgr.24569) 11000 : cluster [DBG] pgmap v9473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:42.456751+0000 mgr.smithi067.rdualw (mgr.24569) 11001 : cluster [DBG] pgmap v9474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:42.456751+0000 mgr.smithi067.rdualw (mgr.24569) 11001 : cluster [DBG] pgmap v9474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:44.457346+0000 mgr.smithi067.rdualw (mgr.24569) 11002 : cluster [DBG] pgmap v9475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:44.457346+0000 mgr.smithi067.rdualw (mgr.24569) 11002 : cluster [DBG] pgmap v9475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:46.458361+0000 mgr.smithi067.rdualw (mgr.24569) 11003 : cluster [DBG] pgmap v9476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:44:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:46.458361+0000 mgr.smithi067.rdualw (mgr.24569) 11003 : cluster [DBG] pgmap v9476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:44:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:48.459047+0000 mgr.smithi067.rdualw (mgr.24569) 11004 : cluster [DBG] pgmap v9477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:48.459047+0000 mgr.smithi067.rdualw (mgr.24569) 11004 : cluster [DBG] pgmap v9477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:50.459923+0000 mgr.smithi067.rdualw (mgr.24569) 11005 : cluster [DBG] pgmap v9478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:50.459923+0000 mgr.smithi067.rdualw (mgr.24569) 11005 : cluster [DBG] pgmap v9478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:52.460444+0000 mgr.smithi067.rdualw (mgr.24569) 11006 : cluster [DBG] pgmap v9479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:52.460444+0000 mgr.smithi067.rdualw (mgr.24569) 11006 : cluster [DBG] pgmap v9479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:56.164 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:44:56.455 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:44:56.456 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 7m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:44:56.456 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 7m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:44:56.456 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 7m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:44:56.456 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 7m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:44:56.457 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 7m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:44:56.457 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 7m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:44:56.457 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 7m ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:44:56.457 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 7m ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:44:56.457 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 7m ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:44:56.458 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 7m ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:44:56.458 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 7m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:44:56.458 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 7m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:44:56.458 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 7m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:44:56.459 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 7m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:44:56.459 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 7m ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:44:56.459 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 7m ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:44:56.459 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 7m ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:44:56.460 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 7m ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:44:56.460 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 7m ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:44:56.460 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 7m ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:44:56.460 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 7m ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:44:56.460 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 7m ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:44:56.461 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 7m ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:44:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:54.461033+0000 mgr.smithi067.rdualw (mgr.24569) 11007 : cluster [DBG] pgmap v9480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:54.461033+0000 mgr.smithi067.rdualw (mgr.24569) 11007 : cluster [DBG] pgmap v9480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:44:56.797 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:44:56.798 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:44:56.798 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:44:56.798 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:44:56.799 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:44:56.799 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:44:56.799 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:44:56.799 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:44:56.800 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:44:56.800 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:44:56.800 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:44:56.800 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:44:56.801 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:44:56.801 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:44:56.801 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:44:56.801 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:44:56.802 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:44:56.802 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:44:56.802 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:44:57.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:44:56.149739+0000 mgr.smithi067.rdualw (mgr.24569) 11008 : audit [DBG] from='client.41482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:44:57.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:44:56.796236+0000 mon.smithi061 (mon.0) 2311 : audit [DBG] from='client.? 172.21.15.61:0/3183915224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:44:57.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:44:56.149739+0000 mgr.smithi067.rdualw (mgr.24569) 11008 : audit [DBG] from='client.41482 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:44:57.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:44:56.796236+0000 mon.smithi061 (mon.0) 2311 : audit [DBG] from='client.? 172.21.15.61:0/3183915224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:44:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:44:56.437272+0000 mgr.smithi067.rdualw (mgr.24569) 11009 : audit [DBG] from='client.41486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:44:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:44:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:56.461802+0000 mgr.smithi067.rdualw (mgr.24569) 11010 : cluster [DBG] pgmap v9481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:44:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:44:56.437272+0000 mgr.smithi067.rdualw (mgr.24569) 11009 : audit [DBG] from='client.41486 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:44:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:44:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:56.461802+0000 mgr.smithi067.rdualw (mgr.24569) 11010 : cluster [DBG] pgmap v9481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:45:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:44:58.462570+0000 mgr.smithi067.rdualw (mgr.24569) 11011 : cluster [DBG] pgmap v9482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:44:58.462570+0000 mgr.smithi067.rdualw (mgr.24569) 11011 : cluster [DBG] pgmap v9482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:00.463560+0000 mgr.smithi067.rdualw (mgr.24569) 11012 : cluster [DBG] pgmap v9483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:00.463560+0000 mgr.smithi067.rdualw (mgr.24569) 11012 : cluster [DBG] pgmap v9483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:02.464071+0000 mgr.smithi067.rdualw (mgr.24569) 11013 : cluster [DBG] pgmap v9484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:02.464071+0000 mgr.smithi067.rdualw (mgr.24569) 11013 : cluster [DBG] pgmap v9484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:04.464664+0000 mgr.smithi067.rdualw (mgr.24569) 11014 : cluster [DBG] pgmap v9485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:04.464664+0000 mgr.smithi067.rdualw (mgr.24569) 11014 : cluster [DBG] pgmap v9485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:06.465597+0000 mgr.smithi067.rdualw (mgr.24569) 11015 : cluster [DBG] pgmap v9486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:45:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:06.465597+0000 mgr.smithi067.rdualw (mgr.24569) 11015 : cluster [DBG] pgmap v9486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:45:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:08.466221+0000 mgr.smithi067.rdualw (mgr.24569) 11016 : cluster [DBG] pgmap v9487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:45:10.146149+0000 mon.smithi067 (mon.1) 1665 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:45:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:45:10.147649+0000 mon.smithi067 (mon.1) 1666 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:45:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:45:10.148549+0000 mon.smithi067 (mon.1) 1667 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:45:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:08.466221+0000 mgr.smithi067.rdualw (mgr.24569) 11016 : cluster [DBG] pgmap v9487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:45:10.146149+0000 mon.smithi067 (mon.1) 1665 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:45:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:45:10.147649+0000 mon.smithi067 (mon.1) 1666 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:45:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:45:10.148549+0000 mon.smithi067 (mon.1) 1667 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:45:11.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:45:10.149405+0000 mgr.smithi067.rdualw (mgr.24569) 11017 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:45:11.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:45:10.566905+0000 mon.smithi061 (mon.0) 2312 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:45:11.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:45:10.572643+0000 mon.smithi061 (mon.0) 2313 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:45:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:45:10.149405+0000 mgr.smithi067.rdualw (mgr.24569) 11017 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:45:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:45:10.566905+0000 mon.smithi061 (mon.0) 2312 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:45:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:45:10.572643+0000 mon.smithi061 (mon.0) 2313 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:45:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:10.467218+0000 mgr.smithi067.rdualw (mgr.24569) 11018 : cluster [DBG] pgmap v9488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:10.467218+0000 mgr.smithi067.rdualw (mgr.24569) 11018 : cluster [DBG] pgmap v9488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:12.467917+0000 mgr.smithi067.rdualw (mgr.24569) 11019 : cluster [DBG] pgmap v9489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:12.467917+0000 mgr.smithi067.rdualw (mgr.24569) 11019 : cluster [DBG] pgmap v9489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:14.468506+0000 mgr.smithi067.rdualw (mgr.24569) 11020 : cluster [DBG] pgmap v9490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:14.468506+0000 mgr.smithi067.rdualw (mgr.24569) 11020 : cluster [DBG] pgmap v9490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:16.469556+0000 mgr.smithi067.rdualw (mgr.24569) 11021 : cluster [DBG] pgmap v9491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:45:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:16.469556+0000 mgr.smithi067.rdualw (mgr.24569) 11021 : cluster [DBG] pgmap v9491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:45:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:18.470072+0000 mgr.smithi067.rdualw (mgr.24569) 11022 : cluster [DBG] pgmap v9492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:18.470072+0000 mgr.smithi067.rdualw (mgr.24569) 11022 : cluster [DBG] pgmap v9492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:20.470919+0000 mgr.smithi067.rdualw (mgr.24569) 11023 : cluster [DBG] pgmap v9493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:20.470919+0000 mgr.smithi067.rdualw (mgr.24569) 11023 : cluster [DBG] pgmap v9493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:22.471601+0000 mgr.smithi067.rdualw (mgr.24569) 11024 : cluster [DBG] pgmap v9494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:22.471601+0000 mgr.smithi067.rdualw (mgr.24569) 11024 : cluster [DBG] pgmap v9494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:24.472294+0000 mgr.smithi067.rdualw (mgr.24569) 11025 : cluster [DBG] pgmap v9495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:24.472294+0000 mgr.smithi067.rdualw (mgr.24569) 11025 : cluster [DBG] pgmap v9495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:27.104 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:45:27.399 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:45:27.400 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 8m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:45:27.400 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 8m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:45:27.400 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 8m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:45:27.400 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 8m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:45:27.401 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 8m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:45:27.401 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 8m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:45:27.401 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 8m ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:45:27.401 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 8m ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:45:27.402 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 8m ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:45:27.402 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 8m ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:45:27.402 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 8m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:45:27.402 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 8m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:45:27.403 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 8m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:45:27.403 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 8m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:45:27.403 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 8m ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:45:27.404 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 8m ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:45:27.404 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 8m ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:45:27.404 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 8m ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:45:27.404 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 8m ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:45:27.405 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 8m ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:45:27.405 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 8m ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:45:27.405 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 8m ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:45:27.405 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 8m ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:45:27.746 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:45:27.746 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:45:27.746 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:45:27.747 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:45:27.747 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:45:27.747 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:45:27.747 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:45:27.747 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:45:27.748 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:45:27.748 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:45:27.748 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:45:27.748 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:45:27.749 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:45:27.749 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:45:27.749 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:45:27.749 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:45:27.749 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:45:27.750 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:45:27.750 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:45:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:26.473116+0000 mgr.smithi067.rdualw (mgr.24569) 11026 : cluster [DBG] pgmap v9496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:45:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:45:27.090966+0000 mgr.smithi067.rdualw (mgr.24569) 11027 : audit [DBG] from='client.41494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:45:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:45:27.744636+0000 mon.smithi061 (mon.0) 2314 : audit [DBG] from='client.? 172.21.15.61:0/3386019751' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:45:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:26.473116+0000 mgr.smithi067.rdualw (mgr.24569) 11026 : cluster [DBG] pgmap v9496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:45:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:45:27.090966+0000 mgr.smithi067.rdualw (mgr.24569) 11027 : audit [DBG] from='client.41494 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:45:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:45:27.744636+0000 mon.smithi061 (mon.0) 2314 : audit [DBG] from='client.? 172.21.15.61:0/3386019751' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:45:29.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:45:27.381322+0000 mgr.smithi067.rdualw (mgr.24569) 11028 : audit [DBG] from='client.41498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:45:30.669 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:28.473829+0000 mgr.smithi067.rdualw (mgr.24569) 11029 : cluster [DBG] pgmap v9497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:30.670 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:45:27.381322+0000 mgr.smithi067.rdualw (mgr.24569) 11028 : audit [DBG] from='client.41498 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:45:30.670 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:28.473829+0000 mgr.smithi067.rdualw (mgr.24569) 11029 : cluster [DBG] pgmap v9497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:31.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:30.474891+0000 mgr.smithi067.rdualw (mgr.24569) 11030 : cluster [DBG] pgmap v9498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:31.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:30.474891+0000 mgr.smithi067.rdualw (mgr.24569) 11030 : cluster [DBG] pgmap v9498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:32.475564+0000 mgr.smithi067.rdualw (mgr.24569) 11031 : cluster [DBG] pgmap v9499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:32.475564+0000 mgr.smithi067.rdualw (mgr.24569) 11031 : cluster [DBG] pgmap v9499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:34.476206+0000 mgr.smithi067.rdualw (mgr.24569) 11032 : cluster [DBG] pgmap v9500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:34.476206+0000 mgr.smithi067.rdualw (mgr.24569) 11032 : cluster [DBG] pgmap v9500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:37.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:45:36.200512+0000 mon.smithi067 (mon.1) 1668 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:45:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:45:36.200773+0000 mon.smithi067 (mon.1) 1669 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:45:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:45:36.201134+0000 mon.smithi061 (mon.0) 2315 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:45:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:45:36.201507+0000 mon.smithi061 (mon.0) 2316 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:45:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:45:36.200512+0000 mon.smithi067 (mon.1) 1668 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:45:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:45:36.200773+0000 mon.smithi067 (mon.1) 1669 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:45:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:45:36.201134+0000 mon.smithi061 (mon.0) 2315 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:45:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:45:36.201507+0000 mon.smithi061 (mon.0) 2316 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:45:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:36.477195+0000 mgr.smithi067.rdualw (mgr.24569) 11033 : cluster [DBG] pgmap v9501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:45:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:36.477195+0000 mgr.smithi067.rdualw (mgr.24569) 11033 : cluster [DBG] pgmap v9501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:45:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:38.477759+0000 mgr.smithi067.rdualw (mgr.24569) 11034 : cluster [DBG] pgmap v9502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:38.477759+0000 mgr.smithi067.rdualw (mgr.24569) 11034 : cluster [DBG] pgmap v9502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:40.478742+0000 mgr.smithi067.rdualw (mgr.24569) 11035 : cluster [DBG] pgmap v9503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:42.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:40.478742+0000 mgr.smithi067.rdualw (mgr.24569) 11035 : cluster [DBG] pgmap v9503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:42.479320+0000 mgr.smithi067.rdualw (mgr.24569) 11036 : cluster [DBG] pgmap v9504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:42.479320+0000 mgr.smithi067.rdualw (mgr.24569) 11036 : cluster [DBG] pgmap v9504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:44.480097+0000 mgr.smithi067.rdualw (mgr.24569) 11037 : cluster [DBG] pgmap v9505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:46.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:44.480097+0000 mgr.smithi067.rdualw (mgr.24569) 11037 : cluster [DBG] pgmap v9505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:46.481173+0000 mgr.smithi067.rdualw (mgr.24569) 11038 : cluster [DBG] pgmap v9506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:45:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:46.481173+0000 mgr.smithi067.rdualw (mgr.24569) 11038 : cluster [DBG] pgmap v9506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:45:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:48.481842+0000 mgr.smithi067.rdualw (mgr.24569) 11039 : cluster [DBG] pgmap v9507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:48.481842+0000 mgr.smithi067.rdualw (mgr.24569) 11039 : cluster [DBG] pgmap v9507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:50.482697+0000 mgr.smithi067.rdualw (mgr.24569) 11040 : cluster [DBG] pgmap v9508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:50.482697+0000 mgr.smithi067.rdualw (mgr.24569) 11040 : cluster [DBG] pgmap v9508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:52.483380+0000 mgr.smithi067.rdualw (mgr.24569) 11041 : cluster [DBG] pgmap v9509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:52.483380+0000 mgr.smithi067.rdualw (mgr.24569) 11041 : cluster [DBG] pgmap v9509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:54.484008+0000 mgr.smithi067.rdualw (mgr.24569) 11042 : cluster [DBG] pgmap v9510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:54.484008+0000 mgr.smithi067.rdualw (mgr.24569) 11042 : cluster [DBG] pgmap v9510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:45:58.052 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:45:58.347 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:45:58.347 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 8m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:45:58.348 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 8m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:45:58.348 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 8m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:45:58.348 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 8m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:45:58.348 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 8m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:45:58.349 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 8m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:45:58.349 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 8m ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:45:58.349 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 8m ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:45:58.349 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 8m ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:45:58.349 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 8m ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:45:58.350 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 8m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:45:58.350 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 8m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:45:58.350 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 8m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:45:58.350 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 8m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:45:58.351 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 8m ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:45:58.351 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 8m ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:45:58.351 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 8m ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:45:58.351 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 8m ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:45:58.352 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 8m ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:45:58.352 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 8m ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:45:58.352 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 8m ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:45:58.352 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 8m ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:45:58.352 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 8m ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:45:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:56.485066+0000 mgr.smithi067.rdualw (mgr.24569) 11043 : cluster [DBG] pgmap v9511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:45:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:56.485066+0000 mgr.smithi067.rdualw (mgr.24569) 11043 : cluster [DBG] pgmap v9511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:45:58.691 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:45:58.691 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:45:58.691 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:45:58.692 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:45:58.692 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:45:58.692 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:45:58.692 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:45:58.693 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:45:58.693 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:45:58.693 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:45:58.693 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:45:58.694 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:45:58.694 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:45:58.694 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:45:58.694 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:45:58.695 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:45:58.695 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:45:58.695 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:45:58.695 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:45:59.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:45:58.038722+0000 mgr.smithi067.rdualw (mgr.24569) 11044 : audit [DBG] from='client.41506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:45:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:45:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:45:58.689626+0000 mon.smithi061 (mon.0) 2317 : audit [DBG] from='client.? 172.21.15.61:0/249964505' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:45:59.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:45:58.038722+0000 mgr.smithi067.rdualw (mgr.24569) 11044 : audit [DBG] from='client.41506 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:45:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:45:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:45:58.689626+0000 mon.smithi061 (mon.0) 2317 : audit [DBG] from='client.? 172.21.15.61:0/249964505' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:46:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:45:58.329366+0000 mgr.smithi067.rdualw (mgr.24569) 11045 : audit [DBG] from='client.41510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:46:01.228 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:45:58.485799+0000 mgr.smithi067.rdualw (mgr.24569) 11046 : cluster [DBG] pgmap v9512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:01.229 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:45:58.329366+0000 mgr.smithi067.rdualw (mgr.24569) 11045 : audit [DBG] from='client.41510 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:46:01.229 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:45:58.485799+0000 mgr.smithi067.rdualw (mgr.24569) 11046 : cluster [DBG] pgmap v9512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:00.486605+0000 mgr.smithi067.rdualw (mgr.24569) 11047 : cluster [DBG] pgmap v9513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:00.486605+0000 mgr.smithi067.rdualw (mgr.24569) 11047 : cluster [DBG] pgmap v9513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:02.487162+0000 mgr.smithi067.rdualw (mgr.24569) 11048 : cluster [DBG] pgmap v9514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:04.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:02.487162+0000 mgr.smithi067.rdualw (mgr.24569) 11048 : cluster [DBG] pgmap v9514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:04.487792+0000 mgr.smithi067.rdualw (mgr.24569) 11049 : cluster [DBG] pgmap v9515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:04.487792+0000 mgr.smithi067.rdualw (mgr.24569) 11049 : cluster [DBG] pgmap v9515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:06.488855+0000 mgr.smithi067.rdualw (mgr.24569) 11050 : cluster [DBG] pgmap v9516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:46:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:06.488855+0000 mgr.smithi067.rdualw (mgr.24569) 11050 : cluster [DBG] pgmap v9516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:46:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:08.489381+0000 mgr.smithi067.rdualw (mgr.24569) 11051 : cluster [DBG] pgmap v9517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:08.489381+0000 mgr.smithi067.rdualw (mgr.24569) 11051 : cluster [DBG] pgmap v9517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:11.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:46:10.575903+0000 mon.smithi067 (mon.1) 1670 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:46:11.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:46:10.577354+0000 mon.smithi067 (mon.1) 1671 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:46:11.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:46:10.578336+0000 mon.smithi067 (mon.1) 1672 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:46:11.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:46:10.993331+0000 mon.smithi061 (mon.0) 2318 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:46:11.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:46:11.001669+0000 mon.smithi061 (mon.0) 2319 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:46:11.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:46:10.575903+0000 mon.smithi067 (mon.1) 1670 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:46:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:46:10.577354+0000 mon.smithi067 (mon.1) 1671 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:46:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:46:10.578336+0000 mon.smithi067 (mon.1) 1672 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:46:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:46:10.993331+0000 mon.smithi061 (mon.0) 2318 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:46:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:46:11.001669+0000 mon.smithi061 (mon.0) 2319 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:46:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:10.490236+0000 mgr.smithi067.rdualw (mgr.24569) 11052 : cluster [DBG] pgmap v9518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:12.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:46:10.579199+0000 mgr.smithi067.rdualw (mgr.24569) 11053 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:46:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:10.490236+0000 mgr.smithi067.rdualw (mgr.24569) 11052 : cluster [DBG] pgmap v9518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:46:10.579199+0000 mgr.smithi067.rdualw (mgr.24569) 11053 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:46:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:12.490880+0000 mgr.smithi067.rdualw (mgr.24569) 11054 : cluster [DBG] pgmap v9519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:12.490880+0000 mgr.smithi067.rdualw (mgr.24569) 11054 : cluster [DBG] pgmap v9519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:14.491462+0000 mgr.smithi067.rdualw (mgr.24569) 11055 : cluster [DBG] pgmap v9520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:16.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:14.491462+0000 mgr.smithi067.rdualw (mgr.24569) 11055 : cluster [DBG] pgmap v9520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:16.492307+0000 mgr.smithi067.rdualw (mgr.24569) 11056 : cluster [DBG] pgmap v9521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:46:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:16.492307+0000 mgr.smithi067.rdualw (mgr.24569) 11056 : cluster [DBG] pgmap v9521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:46:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:18.492890+0000 mgr.smithi067.rdualw (mgr.24569) 11057 : cluster [DBG] pgmap v9522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:18.492890+0000 mgr.smithi067.rdualw (mgr.24569) 11057 : cluster [DBG] pgmap v9522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:20.493946+0000 mgr.smithi067.rdualw (mgr.24569) 11058 : cluster [DBG] pgmap v9523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:20.493946+0000 mgr.smithi067.rdualw (mgr.24569) 11058 : cluster [DBG] pgmap v9523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:22.494451+0000 mgr.smithi067.rdualw (mgr.24569) 11059 : cluster [DBG] pgmap v9524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:22.494451+0000 mgr.smithi067.rdualw (mgr.24569) 11059 : cluster [DBG] pgmap v9524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:24.495132+0000 mgr.smithi067.rdualw (mgr.24569) 11060 : cluster [DBG] pgmap v9525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:24.495132+0000 mgr.smithi067.rdualw (mgr.24569) 11060 : cluster [DBG] pgmap v9525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:26.496013+0000 mgr.smithi067.rdualw (mgr.24569) 11061 : cluster [DBG] pgmap v9526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:46:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:26.496013+0000 mgr.smithi067.rdualw (mgr.24569) 11061 : cluster [DBG] pgmap v9526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:46:29.002 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:46:29.292 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:46:29.292 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 9m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:46:29.292 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 9m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:46:29.293 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 9m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:46:29.293 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 9m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:46:29.293 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 9m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:46:29.293 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 9m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:46:29.294 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 9m ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:46:29.294 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 9m ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:46:29.294 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 9m ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:46:29.294 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 9m ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:46:29.294 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 9m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:46:29.295 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 9m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:46:29.295 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 9m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:46:29.295 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 9m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:46:29.295 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 9m ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:46:29.296 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 9m ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:46:29.296 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 9m ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:46:29.296 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 9m ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:46:29.296 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 9m ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:46:29.296 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 9m ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:46:29.297 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 9m ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:46:29.297 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 9m ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:46:29.297 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 9m ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:46:29.692 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:46:29.692 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:46:29.693 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:46:29.693 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:46:29.693 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:46:29.693 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:46:29.694 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:46:29.694 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:46:29.694 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:46:29.694 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:46:29.695 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:46:29.695 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:46:29.695 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:46:29.695 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:46:29.696 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:46:29.696 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:46:29.696 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:46:29.696 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:46:29.696 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:46:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:28.496521+0000 mgr.smithi067.rdualw (mgr.24569) 11062 : cluster [DBG] pgmap v9527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:46:28.988278+0000 mgr.smithi067.rdualw (mgr.24569) 11063 : audit [DBG] from='client.41518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:46:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:46:29.274238+0000 mgr.smithi067.rdualw (mgr.24569) 11064 : audit [DBG] from='client.41522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:46:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:46:29.690951+0000 mon.smithi061 (mon.0) 2320 : audit [DBG] from='client.? 172.21.15.61:0/1921546406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:46:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:28.496521+0000 mgr.smithi067.rdualw (mgr.24569) 11062 : cluster [DBG] pgmap v9527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:46:28.988278+0000 mgr.smithi067.rdualw (mgr.24569) 11063 : audit [DBG] from='client.41518 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:46:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:46:29.274238+0000 mgr.smithi067.rdualw (mgr.24569) 11064 : audit [DBG] from='client.41522 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:46:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:46:29.690951+0000 mon.smithi061 (mon.0) 2320 : audit [DBG] from='client.? 172.21.15.61:0/1921546406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:46:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:30.497358+0000 mgr.smithi067.rdualw (mgr.24569) 11065 : cluster [DBG] pgmap v9528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:30.497358+0000 mgr.smithi067.rdualw (mgr.24569) 11065 : cluster [DBG] pgmap v9528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:32.497924+0000 mgr.smithi067.rdualw (mgr.24569) 11066 : cluster [DBG] pgmap v9529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:32.497924+0000 mgr.smithi067.rdualw (mgr.24569) 11066 : cluster [DBG] pgmap v9529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:34.498556+0000 mgr.smithi067.rdualw (mgr.24569) 11067 : cluster [DBG] pgmap v9530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:34.498556+0000 mgr.smithi067.rdualw (mgr.24569) 11067 : cluster [DBG] pgmap v9530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:37.206 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:46:36.207877+0000 mon.smithi067 (mon.1) 1673 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:46:37.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:46:36.208150+0000 mon.smithi067 (mon.1) 1674 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:46:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:46:36.208622+0000 mon.smithi061 (mon.0) 2321 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:46:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:46:36.209317+0000 mon.smithi061 (mon.0) 2322 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:46:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:46:36.207877+0000 mon.smithi067 (mon.1) 1673 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:46:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:46:36.208150+0000 mon.smithi067 (mon.1) 1674 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:46:37.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:46:36.208622+0000 mon.smithi061 (mon.0) 2321 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:46:37.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:46:36.209317+0000 mon.smithi061 (mon.0) 2322 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:46:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:36.499368+0000 mgr.smithi067.rdualw (mgr.24569) 11068 : cluster [DBG] pgmap v9531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:46:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:36.499368+0000 mgr.smithi067.rdualw (mgr.24569) 11068 : cluster [DBG] pgmap v9531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:46:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:38.500077+0000 mgr.smithi067.rdualw (mgr.24569) 11069 : cluster [DBG] pgmap v9532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:38.500077+0000 mgr.smithi067.rdualw (mgr.24569) 11069 : cluster [DBG] pgmap v9532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:40.501054+0000 mgr.smithi067.rdualw (mgr.24569) 11070 : cluster [DBG] pgmap v9533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:40.501054+0000 mgr.smithi067.rdualw (mgr.24569) 11070 : cluster [DBG] pgmap v9533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:42.501627+0000 mgr.smithi067.rdualw (mgr.24569) 11071 : cluster [DBG] pgmap v9534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:42.501627+0000 mgr.smithi067.rdualw (mgr.24569) 11071 : cluster [DBG] pgmap v9534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:44.502264+0000 mgr.smithi067.rdualw (mgr.24569) 11072 : cluster [DBG] pgmap v9535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:44.502264+0000 mgr.smithi067.rdualw (mgr.24569) 11072 : cluster [DBG] pgmap v9535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:46.503100+0000 mgr.smithi067.rdualw (mgr.24569) 11073 : cluster [DBG] pgmap v9536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:46:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:46.503100+0000 mgr.smithi067.rdualw (mgr.24569) 11073 : cluster [DBG] pgmap v9536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:46:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:48.503634+0000 mgr.smithi067.rdualw (mgr.24569) 11074 : cluster [DBG] pgmap v9537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:48.503634+0000 mgr.smithi067.rdualw (mgr.24569) 11074 : cluster [DBG] pgmap v9537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:50.504439+0000 mgr.smithi067.rdualw (mgr.24569) 11075 : cluster [DBG] pgmap v9538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:50.504439+0000 mgr.smithi067.rdualw (mgr.24569) 11075 : cluster [DBG] pgmap v9538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:52.505132+0000 mgr.smithi067.rdualw (mgr.24569) 11076 : cluster [DBG] pgmap v9539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:52.505132+0000 mgr.smithi067.rdualw (mgr.24569) 11076 : cluster [DBG] pgmap v9539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:54.505693+0000 mgr.smithi067.rdualw (mgr.24569) 11077 : cluster [DBG] pgmap v9540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:54.505693+0000 mgr.smithi067.rdualw (mgr.24569) 11077 : cluster [DBG] pgmap v9540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:46:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:46:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:56.506669+0000 mgr.smithi067.rdualw (mgr.24569) 11078 : cluster [DBG] pgmap v9541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:46:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:46:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:56.506669+0000 mgr.smithi067.rdualw (mgr.24569) 11078 : cluster [DBG] pgmap v9541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:46:59.999 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:47:00.294 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:47:00.294 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 9m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:47:00.295 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 9m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:47:00.295 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 9m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:47:00.295 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 9m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:47:00.295 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 9m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:47:00.296 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 9m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:47:00.296 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 9m ago 5h 488M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:47:00.296 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 9m ago 5h 648M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:47:00.296 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 9m ago 5h 1934M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:47:00.296 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 9m ago 5h 1082M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:47:00.297 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 9m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:47:00.297 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 9m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:47:00.297 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 9m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:47:00.297 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 9m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:47:00.298 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 9m ago 5h 1260M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:47:00.298 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 9m ago 5h 2168M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:47:00.298 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 9m ago 5h 1364M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:47:00.298 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 9m ago 5h 2319M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:47:00.298 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 9m ago 5h 2138M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:47:00.299 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 9m ago 5h 2293M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:47:00.299 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 9m ago 5h 1880M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:47:00.299 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 9m ago 5h 2854M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:47:00.300 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 9m ago 5h 162M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:47:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:46:58.507252+0000 mgr.smithi067.rdualw (mgr.24569) 11079 : cluster [DBG] pgmap v9542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:00.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:46:58.507252+0000 mgr.smithi067.rdualw (mgr.24569) 11079 : cluster [DBG] pgmap v9542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:00.636 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:47:00.637 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:47:00.637 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:47:00.637 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:47:00.637 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:47:00.638 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:47:00.638 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:47:00.638 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:47:00.638 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:47:00.639 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:47:00.639 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:47:00.639 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:47:00.639 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:47:00.640 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:47:00.640 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:47:00.640 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:47:00.640 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:47:00.641 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:47:00.641 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:47:01.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:46:59.985350+0000 mgr.smithi067.rdualw (mgr.24569) 11080 : audit [DBG] from='client.41530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:47:01.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:00.275988+0000 mgr.smithi067.rdualw (mgr.24569) 11081 : audit [DBG] from='client.41534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:47:01.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:00.635151+0000 mon.smithi061 (mon.0) 2323 : audit [DBG] from='client.? 172.21.15.61:0/3927447726' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:47:01.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:46:59.985350+0000 mgr.smithi067.rdualw (mgr.24569) 11080 : audit [DBG] from='client.41530 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:47:01.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:00.275988+0000 mgr.smithi067.rdualw (mgr.24569) 11081 : audit [DBG] from='client.41534 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:47:01.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:00.635151+0000 mon.smithi061 (mon.0) 2323 : audit [DBG] from='client.? 172.21.15.61:0/3927447726' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:47:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:00.508272+0000 mgr.smithi067.rdualw (mgr.24569) 11082 : cluster [DBG] pgmap v9543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:00.508272+0000 mgr.smithi067.rdualw (mgr.24569) 11082 : cluster [DBG] pgmap v9543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:02.508919+0000 mgr.smithi067.rdualw (mgr.24569) 11083 : cluster [DBG] pgmap v9544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:02.508919+0000 mgr.smithi067.rdualw (mgr.24569) 11083 : cluster [DBG] pgmap v9544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:04.509506+0000 mgr.smithi067.rdualw (mgr.24569) 11084 : cluster [DBG] pgmap v9545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:04.509506+0000 mgr.smithi067.rdualw (mgr.24569) 11084 : cluster [DBG] pgmap v9545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:08.262 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:06.510344+0000 mgr.smithi067.rdualw (mgr.24569) 11085 : cluster [DBG] pgmap v9546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:47:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:06.510344+0000 mgr.smithi067.rdualw (mgr.24569) 11085 : cluster [DBG] pgmap v9546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:47:10.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:08.510994+0000 mgr.smithi067.rdualw (mgr.24569) 11086 : cluster [DBG] pgmap v9547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:08.510994+0000 mgr.smithi067.rdualw (mgr.24569) 11086 : cluster [DBG] pgmap v9547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:11.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:11.004552+0000 mon.smithi067 (mon.1) 1675 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:47:11.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:11.006017+0000 mon.smithi067 (mon.1) 1676 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:47:11.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:11.006959+0000 mon.smithi067 (mon.1) 1677 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:47:11.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:11.004552+0000 mon.smithi067 (mon.1) 1675 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:47:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:11.006017+0000 mon.smithi067 (mon.1) 1676 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:47:11.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:11.006959+0000 mon.smithi067 (mon.1) 1677 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:47:12.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:10.512004+0000 mgr.smithi067.rdualw (mgr.24569) 11087 : cluster [DBG] pgmap v9548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:12.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:47:11.007804+0000 mgr.smithi067.rdualw (mgr.24569) 11088 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:47:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:10.512004+0000 mgr.smithi067.rdualw (mgr.24569) 11087 : cluster [DBG] pgmap v9548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:47:11.007804+0000 mgr.smithi067.rdualw (mgr.24569) 11088 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:47:14.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:12.512651+0000 mgr.smithi067.rdualw (mgr.24569) 11089 : cluster [DBG] pgmap v9549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:12.512651+0000 mgr.smithi067.rdualw (mgr.24569) 11089 : cluster [DBG] pgmap v9549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:14.513146+0000 mgr.smithi067.rdualw (mgr.24569) 11090 : cluster [DBG] pgmap v9550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:15.199928+0000 mon.smithi061 (mon.0) 2324 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:47:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:15.601015+0000 mon.smithi067 (mon.1) 1678 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:47:16.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:15.601715+0000 mon.smithi061 (mon.0) 2325 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:47:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:14.513146+0000 mgr.smithi067.rdualw (mgr.24569) 11090 : cluster [DBG] pgmap v9550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:15.199928+0000 mon.smithi061 (mon.0) 2324 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:47:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:15.601015+0000 mon.smithi067 (mon.1) 1678 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:47:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:15.601715+0000 mon.smithi061 (mon.0) 2325 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:47:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:16.514055+0000 mgr.smithi067.rdualw (mgr.24569) 11091 : cluster [DBG] pgmap v9551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:47:18.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:18.098711+0000 mon.smithi061 (mon.0) 2326 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:47:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:16.514055+0000 mgr.smithi067.rdualw (mgr.24569) 11091 : cluster [DBG] pgmap v9551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:47:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:18.098711+0000 mon.smithi061 (mon.0) 2326 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:47:19.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:18.510080+0000 mon.smithi067 (mon.1) 1679 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:47:19.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:18.510808+0000 mon.smithi061 (mon.0) 2327 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:47:19.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:18.515532+0000 mon.smithi061 (mon.0) 2328 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:47:19.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:18.524354+0000 mon.smithi061 (mon.0) 2329 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:47:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:18.510080+0000 mon.smithi067 (mon.1) 1679 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:47:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:18.510808+0000 mon.smithi061 (mon.0) 2327 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:47:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:18.515532+0000 mon.smithi061 (mon.0) 2328 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:47:19.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:18.524354+0000 mon.smithi061 (mon.0) 2329 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:47:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:18.514496+0000 mgr.smithi067.rdualw (mgr.24569) 11092 : cluster [DBG] pgmap v9552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:18.514496+0000 mgr.smithi067.rdualw (mgr.24569) 11092 : cluster [DBG] pgmap v9552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:20.515432+0000 mgr.smithi067.rdualw (mgr.24569) 11093 : cluster [DBG] pgmap v9553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:20.515432+0000 mgr.smithi067.rdualw (mgr.24569) 11093 : cluster [DBG] pgmap v9553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:22.515951+0000 mgr.smithi067.rdualw (mgr.24569) 11094 : cluster [DBG] pgmap v9554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:22.515951+0000 mgr.smithi067.rdualw (mgr.24569) 11094 : cluster [DBG] pgmap v9554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:24.516560+0000 mgr.smithi067.rdualw (mgr.24569) 11095 : cluster [DBG] pgmap v9555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:24.516560+0000 mgr.smithi067.rdualw (mgr.24569) 11095 : cluster [DBG] pgmap v9555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:26.517497+0000 mgr.smithi067.rdualw (mgr.24569) 11096 : cluster [DBG] pgmap v9556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:47:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:26.517497+0000 mgr.smithi067.rdualw (mgr.24569) 11096 : cluster [DBG] pgmap v9556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:47:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:28.517976+0000 mgr.smithi067.rdualw (mgr.24569) 11097 : cluster [DBG] pgmap v9557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:28.517976+0000 mgr.smithi067.rdualw (mgr.24569) 11097 : cluster [DBG] pgmap v9557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:30.943 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:47:31.240 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:47:31.240 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 13s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:47:31.241 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 13s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:47:31.241 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 16s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:47:31.241 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 13s ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:47:31.241 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 13s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:47:31.242 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 16s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:47:31.242 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 13s ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:47:31.242 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 16s ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:47:31.242 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 13s ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:47:31.243 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 16s ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:47:31.243 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 13s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:47:31.243 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 16s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:47:31.243 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 13s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:47:31.244 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 16s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:47:31.244 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 13s ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:47:31.244 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 13s ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:47:31.244 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 13s ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:47:31.244 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 13s ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:47:31.245 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 16s ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:47:31.245 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 16s ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:47:31.245 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 16s ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:47:31.245 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 16s ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:47:31.246 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 13s ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:47:31.580 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:47:31.581 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:47:31.581 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:47:31.581 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:47:31.582 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:47:31.582 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:47:31.582 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:47:31.582 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:47:31.583 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:47:31.583 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:47:31.583 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:47:31.583 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:47:31.583 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:47:31.584 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:47:31.584 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:47:31.584 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:47:31.584 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:47:31.585 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:47:31.585 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:47:32.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:30.519081+0000 mgr.smithi067.rdualw (mgr.24569) 11098 : cluster [DBG] pgmap v9558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:32.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:30.929311+0000 mgr.smithi067.rdualw (mgr.24569) 11099 : audit [DBG] from='client.41542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:47:32.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:31.222110+0000 mgr.smithi067.rdualw (mgr.24569) 11100 : audit [DBG] from='client.41546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:47:32.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:31.578698+0000 mon.smithi061 (mon.0) 2330 : audit [DBG] from='client.? 172.21.15.61:0/3885914832' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:47:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:30.519081+0000 mgr.smithi067.rdualw (mgr.24569) 11098 : cluster [DBG] pgmap v9558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:30.929311+0000 mgr.smithi067.rdualw (mgr.24569) 11099 : audit [DBG] from='client.41542 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:47:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:31.222110+0000 mgr.smithi067.rdualw (mgr.24569) 11100 : audit [DBG] from='client.41546 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:47:32.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:31.578698+0000 mon.smithi061 (mon.0) 2330 : audit [DBG] from='client.? 172.21.15.61:0/3885914832' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:47:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:32.519638+0000 mgr.smithi067.rdualw (mgr.24569) 11101 : cluster [DBG] pgmap v9559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:32.519638+0000 mgr.smithi067.rdualw (mgr.24569) 11101 : cluster [DBG] pgmap v9559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:34.520259+0000 mgr.smithi067.rdualw (mgr.24569) 11102 : cluster [DBG] pgmap v9560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:36.212924+0000 mon.smithi067 (mon.1) 1680 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:47:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:36.213169+0000 mon.smithi067 (mon.1) 1681 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:47:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:36.213538+0000 mon.smithi061 (mon.0) 2331 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:47:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:47:36.213826+0000 mon.smithi061 (mon.0) 2332 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:47:36.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:34.520259+0000 mgr.smithi067.rdualw (mgr.24569) 11102 : cluster [DBG] pgmap v9560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:36.212924+0000 mon.smithi067 (mon.1) 1680 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:47:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:36.213169+0000 mon.smithi067 (mon.1) 1681 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:47:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:36.213538+0000 mon.smithi061 (mon.0) 2331 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:47:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:47:36.213826+0000 mon.smithi061 (mon.0) 2332 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:47:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:36.521098+0000 mgr.smithi067.rdualw (mgr.24569) 11103 : cluster [DBG] pgmap v9561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:47:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:36.521098+0000 mgr.smithi067.rdualw (mgr.24569) 11103 : cluster [DBG] pgmap v9561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:47:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:38.521647+0000 mgr.smithi067.rdualw (mgr.24569) 11104 : cluster [DBG] pgmap v9562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:40.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:38.521647+0000 mgr.smithi067.rdualw (mgr.24569) 11104 : cluster [DBG] pgmap v9562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:40.522694+0000 mgr.smithi067.rdualw (mgr.24569) 11105 : cluster [DBG] pgmap v9563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:40.522694+0000 mgr.smithi067.rdualw (mgr.24569) 11105 : cluster [DBG] pgmap v9563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:42.523213+0000 mgr.smithi067.rdualw (mgr.24569) 11106 : cluster [DBG] pgmap v9564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:42.523213+0000 mgr.smithi067.rdualw (mgr.24569) 11106 : cluster [DBG] pgmap v9564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:44.523832+0000 mgr.smithi067.rdualw (mgr.24569) 11107 : cluster [DBG] pgmap v9565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:44.523832+0000 mgr.smithi067.rdualw (mgr.24569) 11107 : cluster [DBG] pgmap v9565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:46.524929+0000 mgr.smithi067.rdualw (mgr.24569) 11108 : cluster [DBG] pgmap v9566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:47:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:46.524929+0000 mgr.smithi067.rdualw (mgr.24569) 11108 : cluster [DBG] pgmap v9566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:47:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:48.525643+0000 mgr.smithi067.rdualw (mgr.24569) 11109 : cluster [DBG] pgmap v9567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:48.525643+0000 mgr.smithi067.rdualw (mgr.24569) 11109 : cluster [DBG] pgmap v9567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:50.526422+0000 mgr.smithi067.rdualw (mgr.24569) 11110 : cluster [DBG] pgmap v9568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:50.526422+0000 mgr.smithi067.rdualw (mgr.24569) 11110 : cluster [DBG] pgmap v9568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:52.527024+0000 mgr.smithi067.rdualw (mgr.24569) 11111 : cluster [DBG] pgmap v9569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:52.527024+0000 mgr.smithi067.rdualw (mgr.24569) 11111 : cluster [DBG] pgmap v9569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:54.527707+0000 mgr.smithi067.rdualw (mgr.24569) 11112 : cluster [DBG] pgmap v9570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:54.527707+0000 mgr.smithi067.rdualw (mgr.24569) 11112 : cluster [DBG] pgmap v9570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:47:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:47:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:56.528697+0000 mgr.smithi067.rdualw (mgr.24569) 11113 : cluster [DBG] pgmap v9571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:47:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:47:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:56.528697+0000 mgr.smithi067.rdualw (mgr.24569) 11113 : cluster [DBG] pgmap v9571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:48:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:47:58.529389+0000 mgr.smithi067.rdualw (mgr.24569) 11114 : cluster [DBG] pgmap v9572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:47:58.529389+0000 mgr.smithi067.rdualw (mgr.24569) 11114 : cluster [DBG] pgmap v9572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:01.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:00.530390+0000 mgr.smithi067.rdualw (mgr.24569) 11115 : cluster [DBG] pgmap v9573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:01.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:00.530390+0000 mgr.smithi067.rdualw (mgr.24569) 11115 : cluster [DBG] pgmap v9573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:01.891 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:48:02.183 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:48:02.183 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 44s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:48:02.183 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 44s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:48:02.184 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 46s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:48:02.184 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 44s ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:48:02.185 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 44s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:48:02.185 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 46s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:48:02.185 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 44s ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:48:02.185 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 46s ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:48:02.186 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 44s ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:48:02.186 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 46s ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:48:02.186 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 44s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:48:02.186 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 46s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:48:02.187 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 44s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:48:02.187 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 46s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:48:02.187 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 44s ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:48:02.187 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 44s ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:48:02.187 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 44s ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:48:02.188 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 44s ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:48:02.188 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 46s ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:48:02.188 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 46s ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:48:02.188 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 46s ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:48:02.189 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 46s ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:48:02.189 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 44s ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:48:02.558 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:48:02.558 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:48:02.558 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:48:02.558 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:48:02.559 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:48:02.559 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:48:02.559 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:48:02.559 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:48:02.560 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:48:02.560 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:48:02.560 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:48:02.560 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:48:02.560 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:48:02.561 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:48:02.561 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:48:02.561 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:48:02.562 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:48:02.562 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:48:02.562 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:48:03.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:48:01.877562+0000 mgr.smithi067.rdualw (mgr.24569) 11116 : audit [DBG] from='client.41554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:48:03.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:48:02.165346+0000 mgr.smithi067.rdualw (mgr.24569) 11117 : audit [DBG] from='client.41558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:48:03.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:48:02.556548+0000 mon.smithi061 (mon.0) 2333 : audit [DBG] from='client.? 172.21.15.61:0/1667997362' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:48:03.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:48:01.877562+0000 mgr.smithi067.rdualw (mgr.24569) 11116 : audit [DBG] from='client.41554 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:48:03.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:48:02.165346+0000 mgr.smithi067.rdualw (mgr.24569) 11117 : audit [DBG] from='client.41558 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:48:03.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:48:02.556548+0000 mon.smithi061 (mon.0) 2333 : audit [DBG] from='client.? 172.21.15.61:0/1667997362' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:48:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:02.530995+0000 mgr.smithi067.rdualw (mgr.24569) 11118 : cluster [DBG] pgmap v9574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:02.530995+0000 mgr.smithi067.rdualw (mgr.24569) 11118 : cluster [DBG] pgmap v9574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:06.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:04.531645+0000 mgr.smithi067.rdualw (mgr.24569) 11119 : cluster [DBG] pgmap v9575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:06.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:04.531645+0000 mgr.smithi067.rdualw (mgr.24569) 11119 : cluster [DBG] pgmap v9575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:08.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:06.532632+0000 mgr.smithi067.rdualw (mgr.24569) 11120 : cluster [DBG] pgmap v9576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:48:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:06.532632+0000 mgr.smithi067.rdualw (mgr.24569) 11120 : cluster [DBG] pgmap v9576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:48:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:08.533159+0000 mgr.smithi067.rdualw (mgr.24569) 11121 : cluster [DBG] pgmap v9577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:08.533159+0000 mgr.smithi067.rdualw (mgr.24569) 11121 : cluster [DBG] pgmap v9577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:10.534038+0000 mgr.smithi067.rdualw (mgr.24569) 11122 : cluster [DBG] pgmap v9578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:10.534038+0000 mgr.smithi067.rdualw (mgr.24569) 11122 : cluster [DBG] pgmap v9578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:12.534597+0000 mgr.smithi067.rdualw (mgr.24569) 11123 : cluster [DBG] pgmap v9579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:12.534597+0000 mgr.smithi067.rdualw (mgr.24569) 11123 : cluster [DBG] pgmap v9579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:14.535260+0000 mgr.smithi067.rdualw (mgr.24569) 11124 : cluster [DBG] pgmap v9580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:14.535260+0000 mgr.smithi067.rdualw (mgr.24569) 11124 : cluster [DBG] pgmap v9580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:16.536116+0000 mgr.smithi067.rdualw (mgr.24569) 11125 : cluster [DBG] pgmap v9581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:48:18.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:16.536116+0000 mgr.smithi067.rdualw (mgr.24569) 11125 : cluster [DBG] pgmap v9581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:48:19.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:48:18.530296+0000 mon.smithi067 (mon.1) 1682 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:48:19.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:48:18.531723+0000 mon.smithi067 (mon.1) 1683 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:48:19.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:48:18.532681+0000 mon.smithi067 (mon.1) 1684 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:48:19.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:48:18.952788+0000 mon.smithi061 (mon.0) 2334 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:48:19.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:48:18.958688+0000 mon.smithi061 (mon.0) 2335 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:48:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:48:18.530296+0000 mon.smithi067 (mon.1) 1682 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:48:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:48:18.531723+0000 mon.smithi067 (mon.1) 1683 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:48:19.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:48:18.532681+0000 mon.smithi067 (mon.1) 1684 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:48:19.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:48:18.952788+0000 mon.smithi061 (mon.0) 2334 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:48:19.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:48:18.958688+0000 mon.smithi061 (mon.0) 2335 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:48:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:48:18.533570+0000 mgr.smithi067.rdualw (mgr.24569) 11126 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:48:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:18.536580+0000 mgr.smithi067.rdualw (mgr.24569) 11127 : cluster [DBG] pgmap v9582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:48:18.533570+0000 mgr.smithi067.rdualw (mgr.24569) 11126 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:48:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:18.536580+0000 mgr.smithi067.rdualw (mgr.24569) 11127 : cluster [DBG] pgmap v9582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:20.537387+0000 mgr.smithi067.rdualw (mgr.24569) 11128 : cluster [DBG] pgmap v9583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:20.537387+0000 mgr.smithi067.rdualw (mgr.24569) 11128 : cluster [DBG] pgmap v9583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:22.537978+0000 mgr.smithi067.rdualw (mgr.24569) 11129 : cluster [DBG] pgmap v9584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:22.537978+0000 mgr.smithi067.rdualw (mgr.24569) 11129 : cluster [DBG] pgmap v9584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:24.538748+0000 mgr.smithi067.rdualw (mgr.24569) 11130 : cluster [DBG] pgmap v9585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:24.538748+0000 mgr.smithi067.rdualw (mgr.24569) 11130 : cluster [DBG] pgmap v9585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:26.539595+0000 mgr.smithi067.rdualw (mgr.24569) 11131 : cluster [DBG] pgmap v9586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:48:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:26.539595+0000 mgr.smithi067.rdualw (mgr.24569) 11131 : cluster [DBG] pgmap v9586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:48:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:28.540059+0000 mgr.smithi067.rdualw (mgr.24569) 11132 : cluster [DBG] pgmap v9587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:28.540059+0000 mgr.smithi067.rdualw (mgr.24569) 11132 : cluster [DBG] pgmap v9587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:30.540902+0000 mgr.smithi067.rdualw (mgr.24569) 11133 : cluster [DBG] pgmap v9588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:30.540902+0000 mgr.smithi067.rdualw (mgr.24569) 11133 : cluster [DBG] pgmap v9588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:32.868 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:48:33.159 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:48:33.160 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 75s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:48:33.160 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 75s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:48:33.160 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 77s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:48:33.160 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 75s ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:48:33.161 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 75s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:48:33.161 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 77s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:48:33.161 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 75s ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:48:33.161 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 77s ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:48:33.162 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 75s ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:48:33.162 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 77s ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:48:33.162 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 75s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:48:33.162 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 77s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:48:33.163 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 75s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:48:33.163 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 77s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:48:33.163 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 75s ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:48:33.163 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 75s ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:48:33.164 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 75s ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:48:33.164 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 75s ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:48:33.164 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 77s ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:48:33.164 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 77s ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:48:33.164 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 77s ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:48:33.165 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 77s ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:48:33.165 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 75s ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:48:33.574 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:48:33.575 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:48:33.575 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:48:33.575 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:48:33.576 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:48:33.576 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:48:33.576 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:48:33.576 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:48:33.576 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:48:33.577 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:48:33.577 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:48:33.577 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:48:33.577 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:48:33.578 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:48:33.578 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:48:33.578 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:48:33.578 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:48:33.579 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:48:33.579 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:48:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:32.541430+0000 mgr.smithi067.rdualw (mgr.24569) 11134 : cluster [DBG] pgmap v9589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:48:32.852098+0000 mgr.smithi067.rdualw (mgr.24569) 11135 : audit [DBG] from='client.41566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:48:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:48:33.141879+0000 mgr.smithi067.rdualw (mgr.24569) 11136 : audit [DBG] from='client.41570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:48:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:48:33.573383+0000 mon.smithi061 (mon.0) 2336 : audit [DBG] from='client.? 172.21.15.61:0/3293345883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:48:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:32.541430+0000 mgr.smithi067.rdualw (mgr.24569) 11134 : cluster [DBG] pgmap v9589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:48:32.852098+0000 mgr.smithi067.rdualw (mgr.24569) 11135 : audit [DBG] from='client.41566 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:48:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:48:33.141879+0000 mgr.smithi067.rdualw (mgr.24569) 11136 : audit [DBG] from='client.41570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:48:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:48:33.573383+0000 mon.smithi061 (mon.0) 2336 : audit [DBG] from='client.? 172.21.15.61:0/3293345883' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:48:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:34.542054+0000 mgr.smithi067.rdualw (mgr.24569) 11137 : cluster [DBG] pgmap v9590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:48:36.218730+0000 mon.smithi067 (mon.1) 1685 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:48:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:48:36.218991+0000 mon.smithi067 (mon.1) 1686 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:48:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:48:36.219398+0000 mon.smithi061 (mon.0) 2337 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:48:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:48:36.219749+0000 mon.smithi061 (mon.0) 2338 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:48:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:34.542054+0000 mgr.smithi067.rdualw (mgr.24569) 11137 : cluster [DBG] pgmap v9590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:48:36.218730+0000 mon.smithi067 (mon.1) 1685 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:48:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:48:36.218991+0000 mon.smithi067 (mon.1) 1686 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:48:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:48:36.219398+0000 mon.smithi061 (mon.0) 2337 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:48:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:48:36.219749+0000 mon.smithi061 (mon.0) 2338 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:48:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:36.542910+0000 mgr.smithi067.rdualw (mgr.24569) 11138 : cluster [DBG] pgmap v9591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:48:38.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:36.542910+0000 mgr.smithi067.rdualw (mgr.24569) 11138 : cluster [DBG] pgmap v9591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:48:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:38.543571+0000 mgr.smithi067.rdualw (mgr.24569) 11139 : cluster [DBG] pgmap v9592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:38.543571+0000 mgr.smithi067.rdualw (mgr.24569) 11139 : cluster [DBG] pgmap v9592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:40.544552+0000 mgr.smithi067.rdualw (mgr.24569) 11140 : cluster [DBG] pgmap v9593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:40.544552+0000 mgr.smithi067.rdualw (mgr.24569) 11140 : cluster [DBG] pgmap v9593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:42.545108+0000 mgr.smithi067.rdualw (mgr.24569) 11141 : cluster [DBG] pgmap v9594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:42.545108+0000 mgr.smithi067.rdualw (mgr.24569) 11141 : cluster [DBG] pgmap v9594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:44.545855+0000 mgr.smithi067.rdualw (mgr.24569) 11142 : cluster [DBG] pgmap v9595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:44.545855+0000 mgr.smithi067.rdualw (mgr.24569) 11142 : cluster [DBG] pgmap v9595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:46.546784+0000 mgr.smithi067.rdualw (mgr.24569) 11143 : cluster [DBG] pgmap v9596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:48:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:46.546784+0000 mgr.smithi067.rdualw (mgr.24569) 11143 : cluster [DBG] pgmap v9596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:48:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:48.547463+0000 mgr.smithi067.rdualw (mgr.24569) 11144 : cluster [DBG] pgmap v9597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:48.547463+0000 mgr.smithi067.rdualw (mgr.24569) 11144 : cluster [DBG] pgmap v9597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:50.548527+0000 mgr.smithi067.rdualw (mgr.24569) 11145 : cluster [DBG] pgmap v9598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:52.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:50.548527+0000 mgr.smithi067.rdualw (mgr.24569) 11145 : cluster [DBG] pgmap v9598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:52.549095+0000 mgr.smithi067.rdualw (mgr.24569) 11146 : cluster [DBG] pgmap v9599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:52.549095+0000 mgr.smithi067.rdualw (mgr.24569) 11146 : cluster [DBG] pgmap v9599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:54.549814+0000 mgr.smithi067.rdualw (mgr.24569) 11147 : cluster [DBG] pgmap v9600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:56.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:54.549814+0000 mgr.smithi067.rdualw (mgr.24569) 11147 : cluster [DBG] pgmap v9600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:48:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:48:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:56.550796+0000 mgr.smithi067.rdualw (mgr.24569) 11148 : cluster [DBG] pgmap v9601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:48:58.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:48:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:56.550796+0000 mgr.smithi067.rdualw (mgr.24569) 11148 : cluster [DBG] pgmap v9601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:49:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:48:58.551355+0000 mgr.smithi067.rdualw (mgr.24569) 11149 : cluster [DBG] pgmap v9602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:48:58.551355+0000 mgr.smithi067.rdualw (mgr.24569) 11149 : cluster [DBG] pgmap v9602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:00.552150+0000 mgr.smithi067.rdualw (mgr.24569) 11150 : cluster [DBG] pgmap v9603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:00.552150+0000 mgr.smithi067.rdualw (mgr.24569) 11150 : cluster [DBG] pgmap v9603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:03.888 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:49:04.179 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:49:04.179 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 106s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:49:04.180 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 106s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:49:04.180 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 108s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:49:04.181 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 106s ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:49:04.181 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 106s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:49:04.181 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 108s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:49:04.182 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 106s ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:49:04.182 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 108s ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:49:04.183 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 106s ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:49:04.183 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 108s ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:49:04.184 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 106s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:49:04.184 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 108s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:49:04.184 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 106s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:49:04.185 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 108s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:49:04.185 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 106s ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:49:04.185 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 106s ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:49:04.185 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 106s ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:49:04.186 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 106s ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:49:04.186 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 108s ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:49:04.186 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 108s ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:49:04.186 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 108s ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:49:04.187 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 108s ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:49:04.187 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 106s ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:49:04.522 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:49:04.523 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:49:04.523 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:49:04.523 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:49:04.523 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:49:04.524 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:49:04.524 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:49:04.524 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:49:04.525 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:49:04.525 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:49:04.525 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:49:04.525 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:49:04.526 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:49:04.526 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:49:04.527 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:49:04.527 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:49:04.527 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:49:04.527 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:49:04.528 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:49:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:02.552800+0000 mgr.smithi067.rdualw (mgr.24569) 11151 : cluster [DBG] pgmap v9604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:02.552800+0000 mgr.smithi067.rdualw (mgr.24569) 11151 : cluster [DBG] pgmap v9604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:05.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:49:03.874234+0000 mgr.smithi067.rdualw (mgr.24569) 11152 : audit [DBG] from='client.41578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:49:05.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:49:04.160947+0000 mgr.smithi067.rdualw (mgr.24569) 11153 : audit [DBG] from='client.41582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:49:05.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:49:04.521001+0000 mon.smithi061 (mon.0) 2339 : audit [DBG] from='client.? 172.21.15.61:0/2904450658' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:49:05.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:04.553428+0000 mgr.smithi067.rdualw (mgr.24569) 11154 : cluster [DBG] pgmap v9605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:05.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:49:03.874234+0000 mgr.smithi067.rdualw (mgr.24569) 11152 : audit [DBG] from='client.41578 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:49:05.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:49:04.160947+0000 mgr.smithi067.rdualw (mgr.24569) 11153 : audit [DBG] from='client.41582 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:49:05.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:49:04.521001+0000 mon.smithi061 (mon.0) 2339 : audit [DBG] from='client.? 172.21.15.61:0/2904450658' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:49:05.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:04.553428+0000 mgr.smithi067.rdualw (mgr.24569) 11154 : cluster [DBG] pgmap v9605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:08.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:06.554272+0000 mgr.smithi067.rdualw (mgr.24569) 11155 : cluster [DBG] pgmap v9606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:49:08.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:06.554272+0000 mgr.smithi067.rdualw (mgr.24569) 11155 : cluster [DBG] pgmap v9606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:49:10.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:08.554866+0000 mgr.smithi067.rdualw (mgr.24569) 11156 : cluster [DBG] pgmap v9607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:10.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:08.554866+0000 mgr.smithi067.rdualw (mgr.24569) 11156 : cluster [DBG] pgmap v9607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:12.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:10.555844+0000 mgr.smithi067.rdualw (mgr.24569) 11157 : cluster [DBG] pgmap v9608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:12.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:10.555844+0000 mgr.smithi067.rdualw (mgr.24569) 11157 : cluster [DBG] pgmap v9608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:14.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:12.556480+0000 mgr.smithi067.rdualw (mgr.24569) 11158 : cluster [DBG] pgmap v9609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:14.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:12.556480+0000 mgr.smithi067.rdualw (mgr.24569) 11158 : cluster [DBG] pgmap v9609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:16.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:14.557257+0000 mgr.smithi067.rdualw (mgr.24569) 11159 : cluster [DBG] pgmap v9610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:14.557257+0000 mgr.smithi067.rdualw (mgr.24569) 11159 : cluster [DBG] pgmap v9610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:16.558219+0000 mgr.smithi067.rdualw (mgr.24569) 11160 : cluster [DBG] pgmap v9611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:49:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:16.558219+0000 mgr.smithi067.rdualw (mgr.24569) 11160 : cluster [DBG] pgmap v9611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:49:19.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:49:18.962108+0000 mon.smithi067 (mon.1) 1687 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:49:19.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:49:18.963562+0000 mon.smithi067 (mon.1) 1688 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:49:19.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:49:18.964442+0000 mon.smithi067 (mon.1) 1689 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:49:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:49:18.962108+0000 mon.smithi067 (mon.1) 1687 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:49:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:49:18.963562+0000 mon.smithi067 (mon.1) 1688 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:49:19.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:49:18.964442+0000 mon.smithi067 (mon.1) 1689 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:49:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:18.558785+0000 mgr.smithi067.rdualw (mgr.24569) 11161 : cluster [DBG] pgmap v9612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:49:18.965261+0000 mgr.smithi067.rdualw (mgr.24569) 11162 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:49:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:49:19.320543+0000 mon.smithi061 (mon.0) 2340 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:49:20.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:49:19.329044+0000 mon.smithi061 (mon.0) 2341 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:49:20.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:49:19.729762+0000 mon.smithi061 (mon.0) 2342 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:49:20.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:49:19.735750+0000 mon.smithi061 (mon.0) 2343 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:49:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:18.558785+0000 mgr.smithi067.rdualw (mgr.24569) 11161 : cluster [DBG] pgmap v9612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:49:18.965261+0000 mgr.smithi067.rdualw (mgr.24569) 11162 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:49:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:49:19.320543+0000 mon.smithi061 (mon.0) 2340 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:49:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:49:19.329044+0000 mon.smithi061 (mon.0) 2341 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:49:20.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:49:19.729762+0000 mon.smithi061 (mon.0) 2342 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:49:20.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:49:19.735750+0000 mon.smithi061 (mon.0) 2343 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:49:22.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:20.559705+0000 mgr.smithi067.rdualw (mgr.24569) 11163 : cluster [DBG] pgmap v9613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:20.559705+0000 mgr.smithi067.rdualw (mgr.24569) 11163 : cluster [DBG] pgmap v9613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:22.560238+0000 mgr.smithi067.rdualw (mgr.24569) 11164 : cluster [DBG] pgmap v9614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:22.560238+0000 mgr.smithi067.rdualw (mgr.24569) 11164 : cluster [DBG] pgmap v9614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:24.560809+0000 mgr.smithi067.rdualw (mgr.24569) 11165 : cluster [DBG] pgmap v9615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:24.560809+0000 mgr.smithi067.rdualw (mgr.24569) 11165 : cluster [DBG] pgmap v9615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:26.561775+0000 mgr.smithi067.rdualw (mgr.24569) 11166 : cluster [DBG] pgmap v9616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:49:28.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:26.561775+0000 mgr.smithi067.rdualw (mgr.24569) 11166 : cluster [DBG] pgmap v9616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:49:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:28.562320+0000 mgr.smithi067.rdualw (mgr.24569) 11167 : cluster [DBG] pgmap v9617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:28.562320+0000 mgr.smithi067.rdualw (mgr.24569) 11167 : cluster [DBG] pgmap v9617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:30.563173+0000 mgr.smithi067.rdualw (mgr.24569) 11168 : cluster [DBG] pgmap v9618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:30.563173+0000 mgr.smithi067.rdualw (mgr.24569) 11168 : cluster [DBG] pgmap v9618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:34.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:32.563690+0000 mgr.smithi067.rdualw (mgr.24569) 11169 : cluster [DBG] pgmap v9619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:32.563690+0000 mgr.smithi067.rdualw (mgr.24569) 11169 : cluster [DBG] pgmap v9619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:34.832 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:49:35.126 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:49:35.126 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 2m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:49:35.126 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 2m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:49:35.127 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 2m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:49:35.127 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 2m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:49:35.127 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 2m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:49:35.127 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 2m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:49:35.128 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 2m ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:49:35.128 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 2m ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:49:35.128 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 2m ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:49:35.128 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 2m ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:49:35.128 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 2m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:49:35.129 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 2m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:49:35.129 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 2m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:49:35.129 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 2m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:49:35.129 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 2m ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:49:35.129 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 2m ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:49:35.130 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 2m ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:49:35.130 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 2m ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:49:35.130 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 2m ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:49:35.130 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 2m ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:49:35.131 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 2m ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:49:35.131 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 2m ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:49:35.131 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 2m ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:49:35.473 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:49:35.473 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:49:35.473 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:49:35.474 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:49:35.474 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:49:35.474 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:49:35.475 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:49:35.475 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:49:35.475 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:49:35.475 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:49:35.476 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:49:35.476 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:49:35.476 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:49:35.476 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:49:35.476 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:49:35.477 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:49:35.477 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:49:35.477 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:49:35.477 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:49:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:34.564299+0000 mgr.smithi067.rdualw (mgr.24569) 11170 : cluster [DBG] pgmap v9620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:49:34.817432+0000 mgr.smithi067.rdualw (mgr.24569) 11171 : audit [DBG] from='client.41590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:49:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:49:35.107930+0000 mgr.smithi067.rdualw (mgr.24569) 11172 : audit [DBG] from='client.41594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:49:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:49:35.471777+0000 mon.smithi061 (mon.0) 2344 : audit [DBG] from='client.? 172.21.15.61:0/3803391333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:49:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:49:36.223466+0000 mon.smithi067 (mon.1) 1690 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:49:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:49:36.223762+0000 mon.smithi067 (mon.1) 1691 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:49:36.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:49:36.224139+0000 mon.smithi061 (mon.0) 2345 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:49:36.554 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:49:36.224430+0000 mon.smithi061 (mon.0) 2346 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:49:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:34.564299+0000 mgr.smithi067.rdualw (mgr.24569) 11170 : cluster [DBG] pgmap v9620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:49:34.817432+0000 mgr.smithi067.rdualw (mgr.24569) 11171 : audit [DBG] from='client.41590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:49:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:49:35.107930+0000 mgr.smithi067.rdualw (mgr.24569) 11172 : audit [DBG] from='client.41594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:49:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:49:35.471777+0000 mon.smithi061 (mon.0) 2344 : audit [DBG] from='client.? 172.21.15.61:0/3803391333' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:49:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:49:36.223466+0000 mon.smithi067 (mon.1) 1690 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:49:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:49:36.223762+0000 mon.smithi067 (mon.1) 1691 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:49:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:49:36.224139+0000 mon.smithi061 (mon.0) 2345 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:49:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:49:36.224430+0000 mon.smithi061 (mon.0) 2346 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:49:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:36.565365+0000 mgr.smithi067.rdualw (mgr.24569) 11173 : cluster [DBG] pgmap v9621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:49:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:36.565365+0000 mgr.smithi067.rdualw (mgr.24569) 11173 : cluster [DBG] pgmap v9621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:49:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:38.565893+0000 mgr.smithi067.rdualw (mgr.24569) 11174 : cluster [DBG] pgmap v9622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:38.565893+0000 mgr.smithi067.rdualw (mgr.24569) 11174 : cluster [DBG] pgmap v9622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:40.566698+0000 mgr.smithi067.rdualw (mgr.24569) 11175 : cluster [DBG] pgmap v9623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:40.566698+0000 mgr.smithi067.rdualw (mgr.24569) 11175 : cluster [DBG] pgmap v9623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:42.567142+0000 mgr.smithi067.rdualw (mgr.24569) 11176 : cluster [DBG] pgmap v9624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:42.567142+0000 mgr.smithi067.rdualw (mgr.24569) 11176 : cluster [DBG] pgmap v9624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:44.567875+0000 mgr.smithi067.rdualw (mgr.24569) 11177 : cluster [DBG] pgmap v9625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:44.567875+0000 mgr.smithi067.rdualw (mgr.24569) 11177 : cluster [DBG] pgmap v9625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:46.568848+0000 mgr.smithi067.rdualw (mgr.24569) 11178 : cluster [DBG] pgmap v9626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:49:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:46.568848+0000 mgr.smithi067.rdualw (mgr.24569) 11178 : cluster [DBG] pgmap v9626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:49:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:48.569313+0000 mgr.smithi067.rdualw (mgr.24569) 11179 : cluster [DBG] pgmap v9627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:48.569313+0000 mgr.smithi067.rdualw (mgr.24569) 11179 : cluster [DBG] pgmap v9627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:50.570140+0000 mgr.smithi067.rdualw (mgr.24569) 11180 : cluster [DBG] pgmap v9628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:50.570140+0000 mgr.smithi067.rdualw (mgr.24569) 11180 : cluster [DBG] pgmap v9628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:52.570791+0000 mgr.smithi067.rdualw (mgr.24569) 11181 : cluster [DBG] pgmap v9629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:52.570791+0000 mgr.smithi067.rdualw (mgr.24569) 11181 : cluster [DBG] pgmap v9629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:54.571319+0000 mgr.smithi067.rdualw (mgr.24569) 11182 : cluster [DBG] pgmap v9630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:56.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:54.571319+0000 mgr.smithi067.rdualw (mgr.24569) 11182 : cluster [DBG] pgmap v9630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:49:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:49:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:56.572183+0000 mgr.smithi067.rdualw (mgr.24569) 11183 : cluster [DBG] pgmap v9631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:49:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:49:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:56.572183+0000 mgr.smithi067.rdualw (mgr.24569) 11183 : cluster [DBG] pgmap v9631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:50:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:49:58.572802+0000 mgr.smithi067.rdualw (mgr.24569) 11184 : cluster [DBG] pgmap v9632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:00.000100+0000 mon.smithi061 (mon.0) 2347 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T20:50:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:49:58.572802+0000 mgr.smithi067.rdualw (mgr.24569) 11184 : cluster [DBG] pgmap v9632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:00.000100+0000 mon.smithi061 (mon.0) 2347 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T20:50:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:00.573835+0000 mgr.smithi067.rdualw (mgr.24569) 11185 : cluster [DBG] pgmap v9633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:00.573835+0000 mgr.smithi067.rdualw (mgr.24569) 11185 : cluster [DBG] pgmap v9633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:02.574314+0000 mgr.smithi067.rdualw (mgr.24569) 11186 : cluster [DBG] pgmap v9634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:02.574314+0000 mgr.smithi067.rdualw (mgr.24569) 11186 : cluster [DBG] pgmap v9634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:05.780 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:50:06.098 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:50:06.098 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 2m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:50:06.098 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 2m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:50:06.099 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 2m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:50:06.099 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 2m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:50:06.099 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 2m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:50:06.099 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 2m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:50:06.099 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 2m ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:50:06.100 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 2m ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:50:06.100 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 2m ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:50:06.100 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 2m ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:50:06.100 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 2m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:50:06.100 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 2m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:50:06.101 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 2m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:50:06.101 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 2m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:50:06.101 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 2m ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:50:06.101 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 2m ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:50:06.102 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 2m ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:50:06.102 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 2m ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:50:06.102 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 2m ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:50:06.102 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 2m ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:50:06.102 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 2m ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:50:06.103 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 2m ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:50:06.103 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 2m ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:50:06.445 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:50:06.445 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:50:06.445 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:50:06.445 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:50:06.446 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:50:06.446 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:50:06.446 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:50:06.446 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:50:06.447 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:50:06.447 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:50:06.447 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:50:06.447 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:50:06.448 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:50:06.448 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:50:06.448 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:50:06.448 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:50:06.448 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:50:06.449 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:50:06.449 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:50:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:04.575139+0000 mgr.smithi067.rdualw (mgr.24569) 11187 : cluster [DBG] pgmap v9635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:04.575139+0000 mgr.smithi067.rdualw (mgr.24569) 11187 : cluster [DBG] pgmap v9635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:07.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:50:05.766909+0000 mgr.smithi067.rdualw (mgr.24569) 11188 : audit [DBG] from='client.41602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:50:07.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:50:06.079184+0000 mgr.smithi067.rdualw (mgr.24569) 11189 : audit [DBG] from='client.41606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:50:07.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:50:06.443423+0000 mon.smithi061 (mon.0) 2348 : audit [DBG] from='client.? 172.21.15.61:0/2895428657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:50:07.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:06.576164+0000 mgr.smithi067.rdualw (mgr.24569) 11190 : cluster [DBG] pgmap v9636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:50:07.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:50:05.766909+0000 mgr.smithi067.rdualw (mgr.24569) 11188 : audit [DBG] from='client.41602 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:50:07.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:50:06.079184+0000 mgr.smithi067.rdualw (mgr.24569) 11189 : audit [DBG] from='client.41606 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:50:07.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:50:06.443423+0000 mon.smithi061 (mon.0) 2348 : audit [DBG] from='client.? 172.21.15.61:0/2895428657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:50:07.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:06.576164+0000 mgr.smithi067.rdualw (mgr.24569) 11190 : cluster [DBG] pgmap v9636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:50:10.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:08.576720+0000 mgr.smithi067.rdualw (mgr.24569) 11191 : cluster [DBG] pgmap v9637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:08.576720+0000 mgr.smithi067.rdualw (mgr.24569) 11191 : cluster [DBG] pgmap v9637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:10.577586+0000 mgr.smithi067.rdualw (mgr.24569) 11192 : cluster [DBG] pgmap v9638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:10.577586+0000 mgr.smithi067.rdualw (mgr.24569) 11192 : cluster [DBG] pgmap v9638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:14.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:12.578268+0000 mgr.smithi067.rdualw (mgr.24569) 11193 : cluster [DBG] pgmap v9639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:12.578268+0000 mgr.smithi067.rdualw (mgr.24569) 11193 : cluster [DBG] pgmap v9639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:16.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:14.578903+0000 mgr.smithi067.rdualw (mgr.24569) 11194 : cluster [DBG] pgmap v9640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:16.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:14.578903+0000 mgr.smithi067.rdualw (mgr.24569) 11194 : cluster [DBG] pgmap v9640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:16.579921+0000 mgr.smithi067.rdualw (mgr.24569) 11195 : cluster [DBG] pgmap v9641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:50:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:16.579921+0000 mgr.smithi067.rdualw (mgr.24569) 11195 : cluster [DBG] pgmap v9641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:50:20.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:18.580423+0000 mgr.smithi067.rdualw (mgr.24569) 11196 : cluster [DBG] pgmap v9642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:50:19.738836+0000 mon.smithi067 (mon.1) 1692 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:50:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:50:19.740284+0000 mon.smithi067 (mon.1) 1693 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:50:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:50:19.741235+0000 mon.smithi067 (mon.1) 1694 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:50:20.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:50:20.159795+0000 mon.smithi061 (mon.0) 2349 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:50:20.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:50:20.165179+0000 mon.smithi061 (mon.0) 2350 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:50:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:18.580423+0000 mgr.smithi067.rdualw (mgr.24569) 11196 : cluster [DBG] pgmap v9642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:50:19.738836+0000 mon.smithi067 (mon.1) 1692 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:50:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:50:19.740284+0000 mon.smithi067 (mon.1) 1693 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:50:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:50:19.741235+0000 mon.smithi067 (mon.1) 1694 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:50:20.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:50:20.159795+0000 mon.smithi061 (mon.0) 2349 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:50:20.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:50:20.165179+0000 mon.smithi061 (mon.0) 2350 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:50:21.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:50:19.742166+0000 mgr.smithi067.rdualw (mgr.24569) 11197 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:50:21.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:50:19.742166+0000 mgr.smithi067.rdualw (mgr.24569) 11197 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:50:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:20.581359+0000 mgr.smithi067.rdualw (mgr.24569) 11198 : cluster [DBG] pgmap v9643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:20.581359+0000 mgr.smithi067.rdualw (mgr.24569) 11198 : cluster [DBG] pgmap v9643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:22.581817+0000 mgr.smithi067.rdualw (mgr.24569) 11199 : cluster [DBG] pgmap v9644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:22.581817+0000 mgr.smithi067.rdualw (mgr.24569) 11199 : cluster [DBG] pgmap v9644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:24.582515+0000 mgr.smithi067.rdualw (mgr.24569) 11200 : cluster [DBG] pgmap v9645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:24.582515+0000 mgr.smithi067.rdualw (mgr.24569) 11200 : cluster [DBG] pgmap v9645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:26.583414+0000 mgr.smithi067.rdualw (mgr.24569) 11201 : cluster [DBG] pgmap v9646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:50:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:26.583414+0000 mgr.smithi067.rdualw (mgr.24569) 11201 : cluster [DBG] pgmap v9646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:50:30.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:28.584063+0000 mgr.smithi067.rdualw (mgr.24569) 11202 : cluster [DBG] pgmap v9647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:28.584063+0000 mgr.smithi067.rdualw (mgr.24569) 11202 : cluster [DBG] pgmap v9647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:30.585022+0000 mgr.smithi067.rdualw (mgr.24569) 11203 : cluster [DBG] pgmap v9648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:32.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:30.585022+0000 mgr.smithi067.rdualw (mgr.24569) 11203 : cluster [DBG] pgmap v9648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:32.585477+0000 mgr.smithi067.rdualw (mgr.24569) 11204 : cluster [DBG] pgmap v9649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:32.585477+0000 mgr.smithi067.rdualw (mgr.24569) 11204 : cluster [DBG] pgmap v9649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:34.586222+0000 mgr.smithi067.rdualw (mgr.24569) 11205 : cluster [DBG] pgmap v9650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:50:36.229387+0000 mon.smithi067 (mon.1) 1695 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:50:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:50:36.229655+0000 mon.smithi067 (mon.1) 1696 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:50:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:50:36.230100+0000 mon.smithi061 (mon.0) 2351 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:50:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:50:36.230475+0000 mon.smithi061 (mon.0) 2352 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:50:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:34.586222+0000 mgr.smithi067.rdualw (mgr.24569) 11205 : cluster [DBG] pgmap v9650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:50:36.229387+0000 mon.smithi067 (mon.1) 1695 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:50:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:50:36.229655+0000 mon.smithi067 (mon.1) 1696 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:50:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:50:36.230100+0000 mon.smithi061 (mon.0) 2351 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:50:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:50:36.230475+0000 mon.smithi061 (mon.0) 2352 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:50:36.754 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:50:37.044 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:50:37.045 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 3m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:50:37.045 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 3m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:50:37.045 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 3m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:50:37.046 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 3m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:50:37.046 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 3m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:50:37.046 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 3m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:50:37.046 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 3m ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:50:37.047 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 3m ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:50:37.047 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 3m ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:50:37.047 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 3m ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:50:37.047 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 3m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:50:37.047 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 3m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:50:37.048 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 3m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:50:37.048 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 3m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:50:37.048 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 3m ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:50:37.048 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 3m ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:50:37.049 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 3m ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:50:37.049 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 3m ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:50:37.049 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 3m ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:50:37.049 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 3m ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:50:37.049 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 3m ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:50:37.050 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 3m ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:50:37.050 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 3m ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:50:37.387 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:50:37.388 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:50:37.388 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:50:37.388 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:50:37.388 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:50:37.389 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:50:37.389 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:50:37.389 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:50:37.389 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:50:37.390 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:50:37.390 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:50:37.390 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:50:37.390 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:50:37.390 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:50:37.391 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:50:37.391 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:50:37.391 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:50:37.391 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:50:37.392 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:50:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:36.587128+0000 mgr.smithi067.rdualw (mgr.24569) 11206 : cluster [DBG] pgmap v9651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:50:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:50:36.740948+0000 mgr.smithi067.rdualw (mgr.24569) 11207 : audit [DBG] from='client.41614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:50:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:50:37.026860+0000 mgr.smithi067.rdualw (mgr.24569) 11208 : audit [DBG] from='client.41618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:50:38.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:50:37.386161+0000 mon.smithi061 (mon.0) 2353 : audit [DBG] from='client.? 172.21.15.61:0/1832467844' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:50:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:36.587128+0000 mgr.smithi067.rdualw (mgr.24569) 11206 : cluster [DBG] pgmap v9651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:50:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:50:36.740948+0000 mgr.smithi067.rdualw (mgr.24569) 11207 : audit [DBG] from='client.41614 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:50:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:50:37.026860+0000 mgr.smithi067.rdualw (mgr.24569) 11208 : audit [DBG] from='client.41618 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:50:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:50:37.386161+0000 mon.smithi061 (mon.0) 2353 : audit [DBG] from='client.? 172.21.15.61:0/1832467844' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:50:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:38.587672+0000 mgr.smithi067.rdualw (mgr.24569) 11209 : cluster [DBG] pgmap v9652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:38.587672+0000 mgr.smithi067.rdualw (mgr.24569) 11209 : cluster [DBG] pgmap v9652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:40.588638+0000 mgr.smithi067.rdualw (mgr.24569) 11210 : cluster [DBG] pgmap v9653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:40.588638+0000 mgr.smithi067.rdualw (mgr.24569) 11210 : cluster [DBG] pgmap v9653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:42.589408+0000 mgr.smithi067.rdualw (mgr.24569) 11211 : cluster [DBG] pgmap v9654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:44.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:42.589408+0000 mgr.smithi067.rdualw (mgr.24569) 11211 : cluster [DBG] pgmap v9654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:44.589963+0000 mgr.smithi067.rdualw (mgr.24569) 11212 : cluster [DBG] pgmap v9655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:44.589963+0000 mgr.smithi067.rdualw (mgr.24569) 11212 : cluster [DBG] pgmap v9655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:46.590845+0000 mgr.smithi067.rdualw (mgr.24569) 11213 : cluster [DBG] pgmap v9656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:50:48.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:46.590845+0000 mgr.smithi067.rdualw (mgr.24569) 11213 : cluster [DBG] pgmap v9656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:50:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:48.591495+0000 mgr.smithi067.rdualw (mgr.24569) 11214 : cluster [DBG] pgmap v9657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:48.591495+0000 mgr.smithi067.rdualw (mgr.24569) 11214 : cluster [DBG] pgmap v9657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:50.592428+0000 mgr.smithi067.rdualw (mgr.24569) 11215 : cluster [DBG] pgmap v9658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:50.592428+0000 mgr.smithi067.rdualw (mgr.24569) 11215 : cluster [DBG] pgmap v9658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:52.593003+0000 mgr.smithi067.rdualw (mgr.24569) 11216 : cluster [DBG] pgmap v9659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:52.593003+0000 mgr.smithi067.rdualw (mgr.24569) 11216 : cluster [DBG] pgmap v9659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:54.593789+0000 mgr.smithi067.rdualw (mgr.24569) 11217 : cluster [DBG] pgmap v9660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:54.593789+0000 mgr.smithi067.rdualw (mgr.24569) 11217 : cluster [DBG] pgmap v9660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:50:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:50:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:56.594698+0000 mgr.smithi067.rdualw (mgr.24569) 11218 : cluster [DBG] pgmap v9661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:50:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:50:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:56.594698+0000 mgr.smithi067.rdualw (mgr.24569) 11218 : cluster [DBG] pgmap v9661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:51:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:50:58.595249+0000 mgr.smithi067.rdualw (mgr.24569) 11219 : cluster [DBG] pgmap v9662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:50:58.595249+0000 mgr.smithi067.rdualw (mgr.24569) 11219 : cluster [DBG] pgmap v9662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:00.596037+0000 mgr.smithi067.rdualw (mgr.24569) 11220 : cluster [DBG] pgmap v9663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:00.596037+0000 mgr.smithi067.rdualw (mgr.24569) 11220 : cluster [DBG] pgmap v9663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:02.596712+0000 mgr.smithi067.rdualw (mgr.24569) 11221 : cluster [DBG] pgmap v9664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:02.596712+0000 mgr.smithi067.rdualw (mgr.24569) 11221 : cluster [DBG] pgmap v9664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:04.597343+0000 mgr.smithi067.rdualw (mgr.24569) 11222 : cluster [DBG] pgmap v9665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:06.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:04.597343+0000 mgr.smithi067.rdualw (mgr.24569) 11222 : cluster [DBG] pgmap v9665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:07.700 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:51:07.991 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:51:07.992 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 3m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:51:07.992 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 3m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:51:07.992 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 3m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:51:07.993 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 3m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:51:07.993 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 3m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:51:07.993 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 3m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:51:07.993 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 3m ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:51:07.993 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 3m ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:51:07.994 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 3m ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:51:07.994 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 3m ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:51:07.994 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 3m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:51:07.995 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 3m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:51:07.995 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 3m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:51:07.995 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 3m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:51:07.995 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 3m ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:51:07.996 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 3m ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:51:07.996 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 3m ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:51:07.996 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 3m ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:51:07.997 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 3m ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:51:07.997 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 3m ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:51:07.997 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 3m ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:51:07.997 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 3m ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:51:07.998 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 3m ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:51:08.335 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:51:08.335 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:51:08.335 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:51:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:51:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:51:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:51:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:51:08.336 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:51:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:51:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:51:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:51:08.337 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:51:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:51:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:51:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:51:08.338 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:51:08.339 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:51:08.339 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:51:08.339 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:51:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:06.598331+0000 mgr.smithi067.rdualw (mgr.24569) 11223 : cluster [DBG] pgmap v9666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:51:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:06.598331+0000 mgr.smithi067.rdualw (mgr.24569) 11223 : cluster [DBG] pgmap v9666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:51:09.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:51:07.686405+0000 mgr.smithi067.rdualw (mgr.24569) 11224 : audit [DBG] from='client.41626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:51:09.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:51:07.973916+0000 mgr.smithi067.rdualw (mgr.24569) 11225 : audit [DBG] from='client.41630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:51:09.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:51:08.333540+0000 mon.smithi061 (mon.0) 2354 : audit [DBG] from='client.? 172.21.15.61:0/2182081222' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:51:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:51:07.686405+0000 mgr.smithi067.rdualw (mgr.24569) 11224 : audit [DBG] from='client.41626 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:51:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:51:07.973916+0000 mgr.smithi067.rdualw (mgr.24569) 11225 : audit [DBG] from='client.41630 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:51:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:51:08.333540+0000 mon.smithi061 (mon.0) 2354 : audit [DBG] from='client.? 172.21.15.61:0/2182081222' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:51:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:08.598990+0000 mgr.smithi067.rdualw (mgr.24569) 11226 : cluster [DBG] pgmap v9667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:08.598990+0000 mgr.smithi067.rdualw (mgr.24569) 11226 : cluster [DBG] pgmap v9667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:10.599906+0000 mgr.smithi067.rdualw (mgr.24569) 11227 : cluster [DBG] pgmap v9668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:10.599906+0000 mgr.smithi067.rdualw (mgr.24569) 11227 : cluster [DBG] pgmap v9668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:12.600422+0000 mgr.smithi067.rdualw (mgr.24569) 11228 : cluster [DBG] pgmap v9669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:12.600422+0000 mgr.smithi067.rdualw (mgr.24569) 11228 : cluster [DBG] pgmap v9669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:14.601018+0000 mgr.smithi067.rdualw (mgr.24569) 11229 : cluster [DBG] pgmap v9670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:14.601018+0000 mgr.smithi067.rdualw (mgr.24569) 11229 : cluster [DBG] pgmap v9670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:18.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:16.601982+0000 mgr.smithi067.rdualw (mgr.24569) 11230 : cluster [DBG] pgmap v9671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:51:18.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:16.601982+0000 mgr.smithi067.rdualw (mgr.24569) 11230 : cluster [DBG] pgmap v9671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:51:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:18.602422+0000 mgr.smithi067.rdualw (mgr.24569) 11231 : cluster [DBG] pgmap v9672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:51:20.170471+0000 mon.smithi067 (mon.1) 1697 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:51:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:51:20.172048+0000 mon.smithi067 (mon.1) 1698 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:51:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:51:20.173070+0000 mon.smithi067 (mon.1) 1699 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:51:20.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:18.602422+0000 mgr.smithi067.rdualw (mgr.24569) 11231 : cluster [DBG] pgmap v9672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:51:20.170471+0000 mon.smithi067 (mon.1) 1697 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:51:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:51:20.172048+0000 mon.smithi067 (mon.1) 1698 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:51:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:51:20.173070+0000 mon.smithi067 (mon.1) 1699 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:51:21.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:51:20.173988+0000 mgr.smithi067.rdualw (mgr.24569) 11232 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:51:21.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:51:20.592675+0000 mon.smithi061 (mon.0) 2355 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:51:21.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:51:20.598266+0000 mon.smithi061 (mon.0) 2356 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:51:21.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:51:20.173988+0000 mgr.smithi067.rdualw (mgr.24569) 11232 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:51:21.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:51:20.592675+0000 mon.smithi061 (mon.0) 2355 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:51:21.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:51:20.598266+0000 mon.smithi061 (mon.0) 2356 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:51:22.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:20.603394+0000 mgr.smithi067.rdualw (mgr.24569) 11233 : cluster [DBG] pgmap v9673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:20.603394+0000 mgr.smithi067.rdualw (mgr.24569) 11233 : cluster [DBG] pgmap v9673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:24.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:22.604046+0000 mgr.smithi067.rdualw (mgr.24569) 11234 : cluster [DBG] pgmap v9674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:24.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:22.604046+0000 mgr.smithi067.rdualw (mgr.24569) 11234 : cluster [DBG] pgmap v9674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:26.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:24.604655+0000 mgr.smithi067.rdualw (mgr.24569) 11235 : cluster [DBG] pgmap v9675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:26.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:24.604655+0000 mgr.smithi067.rdualw (mgr.24569) 11235 : cluster [DBG] pgmap v9675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:28.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:26.605675+0000 mgr.smithi067.rdualw (mgr.24569) 11236 : cluster [DBG] pgmap v9676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:51:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:26.605675+0000 mgr.smithi067.rdualw (mgr.24569) 11236 : cluster [DBG] pgmap v9676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:51:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:28.606220+0000 mgr.smithi067.rdualw (mgr.24569) 11237 : cluster [DBG] pgmap v9677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:30.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:28.606220+0000 mgr.smithi067.rdualw (mgr.24569) 11237 : cluster [DBG] pgmap v9677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:32.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:30.607229+0000 mgr.smithi067.rdualw (mgr.24569) 11238 : cluster [DBG] pgmap v9678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:30.607229+0000 mgr.smithi067.rdualw (mgr.24569) 11238 : cluster [DBG] pgmap v9678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:32.607838+0000 mgr.smithi067.rdualw (mgr.24569) 11239 : cluster [DBG] pgmap v9679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:34.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:32.607838+0000 mgr.smithi067.rdualw (mgr.24569) 11239 : cluster [DBG] pgmap v9679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:34.608577+0000 mgr.smithi067.rdualw (mgr.24569) 11240 : cluster [DBG] pgmap v9680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:51:36.235269+0000 mon.smithi067 (mon.1) 1700 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:51:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:51:36.235522+0000 mon.smithi067 (mon.1) 1701 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:51:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:51:36.235944+0000 mon.smithi061 (mon.0) 2357 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:51:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:51:36.236162+0000 mon.smithi061 (mon.0) 2358 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:51:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:34.608577+0000 mgr.smithi067.rdualw (mgr.24569) 11240 : cluster [DBG] pgmap v9680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:51:36.235269+0000 mon.smithi067 (mon.1) 1700 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:51:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:51:36.235522+0000 mon.smithi067 (mon.1) 1701 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:51:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:51:36.235944+0000 mon.smithi061 (mon.0) 2357 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:51:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:51:36.236162+0000 mon.smithi061 (mon.0) 2358 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:51:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:36.609646+0000 mgr.smithi067.rdualw (mgr.24569) 11241 : cluster [DBG] pgmap v9681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:51:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:36.609646+0000 mgr.smithi067.rdualw (mgr.24569) 11241 : cluster [DBG] pgmap v9681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:51:38.659 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:51:38.995 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:51:38.996 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 4m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:51:38.996 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 4m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:51:38.996 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 4m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:51:38.996 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 4m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:51:38.997 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 4m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:51:38.997 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 4m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:51:38.997 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 4m ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:51:38.998 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 4m ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:51:38.998 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 4m ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:51:38.998 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 4m ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:51:38.998 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 4m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:51:38.999 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 4m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:51:38.999 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 4m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:51:38.999 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 4m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:51:38.999 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 4m ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:51:39.000 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 4m ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:51:39.000 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 4m ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:51:39.000 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 4m ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:51:39.000 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 4m ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:51:39.001 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 4m ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:51:39.001 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 4m ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:51:39.001 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 4m ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:51:39.001 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 4m ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:51:39.375 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:51:39.376 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:51:39.376 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:51:39.376 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:51:39.377 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:51:39.377 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:51:39.377 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:51:39.377 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:51:39.377 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:51:39.378 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:51:39.378 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:51:39.378 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:51:39.378 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:51:39.379 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:51:39.379 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:51:39.379 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:51:39.379 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:51:39.379 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:51:39.380 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:51:40.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:38.610193+0000 mgr.smithi067.rdualw (mgr.24569) 11242 : cluster [DBG] pgmap v9682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:51:38.645802+0000 mgr.smithi067.rdualw (mgr.24569) 11243 : audit [DBG] from='client.41638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:51:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:51:38.978065+0000 mgr.smithi067.rdualw (mgr.24569) 11244 : audit [DBG] from='client.41642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:51:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:51:39.374472+0000 mon.smithi061 (mon.0) 2359 : audit [DBG] from='client.? 172.21.15.61:0/1967917311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:51:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:38.610193+0000 mgr.smithi067.rdualw (mgr.24569) 11242 : cluster [DBG] pgmap v9682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:51:38.645802+0000 mgr.smithi067.rdualw (mgr.24569) 11243 : audit [DBG] from='client.41638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:51:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:51:38.978065+0000 mgr.smithi067.rdualw (mgr.24569) 11244 : audit [DBG] from='client.41642 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:51:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:51:39.374472+0000 mon.smithi061 (mon.0) 2359 : audit [DBG] from='client.? 172.21.15.61:0/1967917311' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:51:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:40.611007+0000 mgr.smithi067.rdualw (mgr.24569) 11245 : cluster [DBG] pgmap v9683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:40.611007+0000 mgr.smithi067.rdualw (mgr.24569) 11245 : cluster [DBG] pgmap v9683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:42.611553+0000 mgr.smithi067.rdualw (mgr.24569) 11246 : cluster [DBG] pgmap v9684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:42.611553+0000 mgr.smithi067.rdualw (mgr.24569) 11246 : cluster [DBG] pgmap v9684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:46.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:44.612158+0000 mgr.smithi067.rdualw (mgr.24569) 11247 : cluster [DBG] pgmap v9685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:44.612158+0000 mgr.smithi067.rdualw (mgr.24569) 11247 : cluster [DBG] pgmap v9685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:48.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:46.613157+0000 mgr.smithi067.rdualw (mgr.24569) 11248 : cluster [DBG] pgmap v9686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:51:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:46.613157+0000 mgr.smithi067.rdualw (mgr.24569) 11248 : cluster [DBG] pgmap v9686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:51:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:48.613753+0000 mgr.smithi067.rdualw (mgr.24569) 11249 : cluster [DBG] pgmap v9687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:50.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:48.613753+0000 mgr.smithi067.rdualw (mgr.24569) 11249 : cluster [DBG] pgmap v9687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:52.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:50.614803+0000 mgr.smithi067.rdualw (mgr.24569) 11250 : cluster [DBG] pgmap v9688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:50.614803+0000 mgr.smithi067.rdualw (mgr.24569) 11250 : cluster [DBG] pgmap v9688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:52.615329+0000 mgr.smithi067.rdualw (mgr.24569) 11251 : cluster [DBG] pgmap v9689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:52.615329+0000 mgr.smithi067.rdualw (mgr.24569) 11251 : cluster [DBG] pgmap v9689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:54.615952+0000 mgr.smithi067.rdualw (mgr.24569) 11252 : cluster [DBG] pgmap v9690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:54.615952+0000 mgr.smithi067.rdualw (mgr.24569) 11252 : cluster [DBG] pgmap v9690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:51:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:51:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:56.616865+0000 mgr.smithi067.rdualw (mgr.24569) 11253 : cluster [DBG] pgmap v9691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:51:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:51:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:56.616865+0000 mgr.smithi067.rdualw (mgr.24569) 11253 : cluster [DBG] pgmap v9691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:52:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:51:58.617311+0000 mgr.smithi067.rdualw (mgr.24569) 11254 : cluster [DBG] pgmap v9692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:51:58.617311+0000 mgr.smithi067.rdualw (mgr.24569) 11254 : cluster [DBG] pgmap v9692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:00.618273+0000 mgr.smithi067.rdualw (mgr.24569) 11255 : cluster [DBG] pgmap v9693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:00.618273+0000 mgr.smithi067.rdualw (mgr.24569) 11255 : cluster [DBG] pgmap v9693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:02.618961+0000 mgr.smithi067.rdualw (mgr.24569) 11256 : cluster [DBG] pgmap v9694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:02.618961+0000 mgr.smithi067.rdualw (mgr.24569) 11256 : cluster [DBG] pgmap v9694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:04.619520+0000 mgr.smithi067.rdualw (mgr.24569) 11257 : cluster [DBG] pgmap v9695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:06.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:04.619520+0000 mgr.smithi067.rdualw (mgr.24569) 11257 : cluster [DBG] pgmap v9695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:06.620602+0000 mgr.smithi067.rdualw (mgr.24569) 11258 : cluster [DBG] pgmap v9696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:52:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:06.620602+0000 mgr.smithi067.rdualw (mgr.24569) 11258 : cluster [DBG] pgmap v9696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:52:09.683 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:52:09.998 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:52:09.999 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 4m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:52:09.999 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 4m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:52:09.999 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 4m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:52:09.999 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 4m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:52:10.000 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 4m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:52:10.000 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 4m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:52:10.000 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 4m ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:52:10.000 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 4m ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:52:10.001 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 4m ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:52:10.002 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 4m ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:52:10.002 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 4m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:52:10.002 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 4m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:52:10.002 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 4m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:52:10.002 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 4m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:52:10.003 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 4m ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:52:10.003 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 4m ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:52:10.003 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 4m ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:52:10.003 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 4m ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:52:10.004 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 4m ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:52:10.004 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 4m ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:52:10.004 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 4m ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:52:10.004 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 4m ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:52:10.005 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 4m ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:52:10.341 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:52:10.342 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:52:10.342 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:52:10.342 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:52:10.343 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:52:10.343 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:52:10.343 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:52:10.343 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:52:10.344 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:52:10.344 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:52:10.344 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:52:10.344 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:52:10.345 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:52:10.345 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:52:10.345 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:52:10.346 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:52:10.347 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:52:10.347 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:52:10.347 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:52:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:08.621299+0000 mgr.smithi067.rdualw (mgr.24569) 11259 : cluster [DBG] pgmap v9697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:08.621299+0000 mgr.smithi067.rdualw (mgr.24569) 11259 : cluster [DBG] pgmap v9697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:11.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:52:09.670014+0000 mgr.smithi067.rdualw (mgr.24569) 11260 : audit [DBG] from='client.41650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:52:11.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:52:09.980412+0000 mgr.smithi067.rdualw (mgr.24569) 11261 : audit [DBG] from='client.41654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:52:11.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:52:10.340286+0000 mon.smithi061 (mon.0) 2360 : audit [DBG] from='client.? 172.21.15.61:0/4057854095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:52:11.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:52:09.670014+0000 mgr.smithi067.rdualw (mgr.24569) 11260 : audit [DBG] from='client.41650 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:52:11.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:52:09.980412+0000 mgr.smithi067.rdualw (mgr.24569) 11261 : audit [DBG] from='client.41654 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:52:11.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:52:10.340286+0000 mon.smithi061 (mon.0) 2360 : audit [DBG] from='client.? 172.21.15.61:0/4057854095' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:52:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:10.622284+0000 mgr.smithi067.rdualw (mgr.24569) 11262 : cluster [DBG] pgmap v9698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:10.622284+0000 mgr.smithi067.rdualw (mgr.24569) 11262 : cluster [DBG] pgmap v9698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:12.622851+0000 mgr.smithi067.rdualw (mgr.24569) 11263 : cluster [DBG] pgmap v9699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:12.622851+0000 mgr.smithi067.rdualw (mgr.24569) 11263 : cluster [DBG] pgmap v9699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:14.623456+0000 mgr.smithi067.rdualw (mgr.24569) 11264 : cluster [DBG] pgmap v9700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:14.623456+0000 mgr.smithi067.rdualw (mgr.24569) 11264 : cluster [DBG] pgmap v9700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:16.624512+0000 mgr.smithi067.rdualw (mgr.24569) 11265 : cluster [DBG] pgmap v9701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:52:18.853 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:16.624512+0000 mgr.smithi067.rdualw (mgr.24569) 11265 : cluster [DBG] pgmap v9701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:52:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:18.625140+0000 mgr.smithi067.rdualw (mgr.24569) 11266 : cluster [DBG] pgmap v9702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:18.625140+0000 mgr.smithi067.rdualw (mgr.24569) 11266 : cluster [DBG] pgmap v9702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:52:20.601807+0000 mon.smithi067 (mon.1) 1702 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:52:21.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:52:20.603271+0000 mon.smithi067 (mon.1) 1703 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:52:21.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:52:20.604241+0000 mon.smithi067 (mon.1) 1704 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:52:21.809 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:52:21.021315+0000 mon.smithi061 (mon.0) 2361 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:52:21.809 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:52:21.026917+0000 mon.smithi061 (mon.0) 2362 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:52:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:52:20.601807+0000 mon.smithi067 (mon.1) 1702 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:52:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:52:20.603271+0000 mon.smithi067 (mon.1) 1703 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:52:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:52:20.604241+0000 mon.smithi067 (mon.1) 1704 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:52:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:52:21.021315+0000 mon.smithi061 (mon.0) 2361 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:52:21.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:52:21.026917+0000 mon.smithi061 (mon.0) 2362 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:52:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:52:20.605115+0000 mgr.smithi067.rdualw (mgr.24569) 11267 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:52:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:20.625996+0000 mgr.smithi067.rdualw (mgr.24569) 11268 : cluster [DBG] pgmap v9703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:52:20.605115+0000 mgr.smithi067.rdualw (mgr.24569) 11267 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:52:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:20.625996+0000 mgr.smithi067.rdualw (mgr.24569) 11268 : cluster [DBG] pgmap v9703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:22.626591+0000 mgr.smithi067.rdualw (mgr.24569) 11269 : cluster [DBG] pgmap v9704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:23.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:22.626591+0000 mgr.smithi067.rdualw (mgr.24569) 11269 : cluster [DBG] pgmap v9704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:26.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:24.627392+0000 mgr.smithi067.rdualw (mgr.24569) 11270 : cluster [DBG] pgmap v9705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:24.627392+0000 mgr.smithi067.rdualw (mgr.24569) 11270 : cluster [DBG] pgmap v9705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:28.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:26.628313+0000 mgr.smithi067.rdualw (mgr.24569) 11271 : cluster [DBG] pgmap v9706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:52:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:26.628313+0000 mgr.smithi067.rdualw (mgr.24569) 11271 : cluster [DBG] pgmap v9706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:52:30.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:28.628824+0000 mgr.smithi067.rdualw (mgr.24569) 11272 : cluster [DBG] pgmap v9707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:28.628824+0000 mgr.smithi067.rdualw (mgr.24569) 11272 : cluster [DBG] pgmap v9707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:32.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:30.629676+0000 mgr.smithi067.rdualw (mgr.24569) 11273 : cluster [DBG] pgmap v9708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:30.629676+0000 mgr.smithi067.rdualw (mgr.24569) 11273 : cluster [DBG] pgmap v9708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:34.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:32.630354+0000 mgr.smithi067.rdualw (mgr.24569) 11274 : cluster [DBG] pgmap v9709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:32.630354+0000 mgr.smithi067.rdualw (mgr.24569) 11274 : cluster [DBG] pgmap v9709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:36.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:34.631014+0000 mgr.smithi067.rdualw (mgr.24569) 11275 : cluster [DBG] pgmap v9710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:52:36.240780+0000 mon.smithi067 (mon.1) 1705 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:52:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:52:36.241166+0000 mon.smithi067 (mon.1) 1706 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:52:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:52:36.241711+0000 mon.smithi061 (mon.0) 2363 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:52:36.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:52:36.242341+0000 mon.smithi061 (mon.0) 2364 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:52:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:34.631014+0000 mgr.smithi067.rdualw (mgr.24569) 11275 : cluster [DBG] pgmap v9710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:52:36.240780+0000 mon.smithi067 (mon.1) 1705 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:52:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:52:36.241166+0000 mon.smithi067 (mon.1) 1706 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:52:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:52:36.241711+0000 mon.smithi061 (mon.0) 2363 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:52:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:52:36.242341+0000 mon.smithi061 (mon.0) 2364 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:52:38.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:36.631918+0000 mgr.smithi067.rdualw (mgr.24569) 11276 : cluster [DBG] pgmap v9711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:52:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:36.631918+0000 mgr.smithi067.rdualw (mgr.24569) 11276 : cluster [DBG] pgmap v9711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:52:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:38.632665+0000 mgr.smithi067.rdualw (mgr.24569) 11277 : cluster [DBG] pgmap v9712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:40.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:38.632665+0000 mgr.smithi067.rdualw (mgr.24569) 11277 : cluster [DBG] pgmap v9712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:40.651 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:52:40.959 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:52:40.959 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 5m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:52:40.959 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 5m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:52:40.960 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 5m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:52:40.960 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 5m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:52:40.960 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 5m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:52:40.960 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 5m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:52:40.960 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 5m ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:52:40.961 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 5m ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:52:40.961 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 5m ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:52:40.961 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 5m ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:52:40.962 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 5m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:52:40.962 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 5m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:52:40.962 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 5m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:52:40.962 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 5m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:52:40.963 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 5m ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:52:40.963 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 5m ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:52:40.963 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 5m ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:52:40.963 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 5m ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:52:40.963 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 5m ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:52:40.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 5m ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:52:40.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 5m ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:52:40.964 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 5m ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:52:40.964 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 5m ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:52:41.300 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:52:41.301 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:52:41.301 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:52:41.301 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:52:41.302 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:52:41.302 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:52:41.302 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:52:41.302 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:52:41.303 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:52:41.303 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:52:41.303 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:52:41.303 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:52:41.304 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:52:41.304 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:52:41.304 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:52:41.304 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:52:41.304 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:52:41.305 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:52:41.305 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:52:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:40.633443+0000 mgr.smithi067.rdualw (mgr.24569) 11278 : cluster [DBG] pgmap v9713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:52:40.638128+0000 mgr.smithi067.rdualw (mgr.24569) 11279 : audit [DBG] from='client.41662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:52:42.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:52:40.941272+0000 mgr.smithi067.rdualw (mgr.24569) 11280 : audit [DBG] from='client.41666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:52:42.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:52:41.299409+0000 mon.smithi061 (mon.0) 2365 : audit [DBG] from='client.? 172.21.15.61:0/4153475111' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:52:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:40.633443+0000 mgr.smithi067.rdualw (mgr.24569) 11278 : cluster [DBG] pgmap v9713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:52:40.638128+0000 mgr.smithi067.rdualw (mgr.24569) 11279 : audit [DBG] from='client.41662 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:52:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:52:40.941272+0000 mgr.smithi067.rdualw (mgr.24569) 11280 : audit [DBG] from='client.41666 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:52:42.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:52:41.299409+0000 mon.smithi061 (mon.0) 2365 : audit [DBG] from='client.? 172.21.15.61:0/4153475111' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:52:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:42.634055+0000 mgr.smithi067.rdualw (mgr.24569) 11281 : cluster [DBG] pgmap v9714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:42.634055+0000 mgr.smithi067.rdualw (mgr.24569) 11281 : cluster [DBG] pgmap v9714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:44.634864+0000 mgr.smithi067.rdualw (mgr.24569) 11282 : cluster [DBG] pgmap v9715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:44.634864+0000 mgr.smithi067.rdualw (mgr.24569) 11282 : cluster [DBG] pgmap v9715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:46.635690+0000 mgr.smithi067.rdualw (mgr.24569) 11283 : cluster [DBG] pgmap v9716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:52:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:46.635690+0000 mgr.smithi067.rdualw (mgr.24569) 11283 : cluster [DBG] pgmap v9716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:52:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:48.636201+0000 mgr.smithi067.rdualw (mgr.24569) 11284 : cluster [DBG] pgmap v9717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:48.636201+0000 mgr.smithi067.rdualw (mgr.24569) 11284 : cluster [DBG] pgmap v9717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:50.637112+0000 mgr.smithi067.rdualw (mgr.24569) 11285 : cluster [DBG] pgmap v9718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:50.637112+0000 mgr.smithi067.rdualw (mgr.24569) 11285 : cluster [DBG] pgmap v9718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:52.637799+0000 mgr.smithi067.rdualw (mgr.24569) 11286 : cluster [DBG] pgmap v9719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:54.565 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:52.637799+0000 mgr.smithi067.rdualw (mgr.24569) 11286 : cluster [DBG] pgmap v9719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:56.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:54.638368+0000 mgr.smithi067.rdualw (mgr.24569) 11287 : cluster [DBG] pgmap v9720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:54.638368+0000 mgr.smithi067.rdualw (mgr.24569) 11287 : cluster [DBG] pgmap v9720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:52:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:52:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:56.639241+0000 mgr.smithi067.rdualw (mgr.24569) 11288 : cluster [DBG] pgmap v9721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:52:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:52:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:56.639241+0000 mgr.smithi067.rdualw (mgr.24569) 11288 : cluster [DBG] pgmap v9721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:53:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:52:58.639899+0000 mgr.smithi067.rdualw (mgr.24569) 11289 : cluster [DBG] pgmap v9722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:52:58.639899+0000 mgr.smithi067.rdualw (mgr.24569) 11289 : cluster [DBG] pgmap v9722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:00.640926+0000 mgr.smithi067.rdualw (mgr.24569) 11290 : cluster [DBG] pgmap v9723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:00.640926+0000 mgr.smithi067.rdualw (mgr.24569) 11290 : cluster [DBG] pgmap v9723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:04.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:02.641431+0000 mgr.smithi067.rdualw (mgr.24569) 11291 : cluster [DBG] pgmap v9724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:02.641431+0000 mgr.smithi067.rdualw (mgr.24569) 11291 : cluster [DBG] pgmap v9724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:04.642010+0000 mgr.smithi067.rdualw (mgr.24569) 11292 : cluster [DBG] pgmap v9725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:06.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:04.642010+0000 mgr.smithi067.rdualw (mgr.24569) 11292 : cluster [DBG] pgmap v9725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:06.642875+0000 mgr.smithi067.rdualw (mgr.24569) 11293 : cluster [DBG] pgmap v9726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:53:08.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:06.642875+0000 mgr.smithi067.rdualw (mgr.24569) 11293 : cluster [DBG] pgmap v9726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:53:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:08.643461+0000 mgr.smithi067.rdualw (mgr.24569) 11294 : cluster [DBG] pgmap v9727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:08.643461+0000 mgr.smithi067.rdualw (mgr.24569) 11294 : cluster [DBG] pgmap v9727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:11.611 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:53:11.905 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:53:11.906 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 5m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:53:11.906 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 5m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:53:11.906 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 5m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:53:11.907 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 5m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:53:11.907 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 5m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:53:11.907 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 5m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:53:11.907 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 5m ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:53:11.908 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 5m ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:53:11.908 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 5m ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:53:11.908 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 5m ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:53:11.908 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 5m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:53:11.909 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 5m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:53:11.909 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 5m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:53:11.910 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 5m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:53:11.910 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 5m ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:53:11.910 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 5m ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:53:11.911 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 5m ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:53:11.911 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 5m ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:53:11.911 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 5m ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:53:11.912 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 5m ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:53:11.912 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 5m ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:53:11.912 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 5m ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:53:11.913 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 5m ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:53:12.247 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:53:12.248 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:53:12.248 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:53:12.248 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:53:12.249 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:53:12.249 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:53:12.249 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:53:12.249 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:53:12.250 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:53:12.250 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:53:12.250 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:53:12.250 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:53:12.250 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:53:12.251 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:53:12.251 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:53:12.251 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:53:12.251 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:53:12.252 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:53:12.252 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:53:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:10.644374+0000 mgr.smithi067.rdualw (mgr.24569) 11295 : cluster [DBG] pgmap v9728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:53:12.244982+0000 mon.smithi061 (mon.0) 2366 : audit [DBG] from='client.? 172.21.15.61:0/1327667257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:53:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:10.644374+0000 mgr.smithi067.rdualw (mgr.24569) 11295 : cluster [DBG] pgmap v9728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:53:12.244982+0000 mon.smithi061 (mon.0) 2366 : audit [DBG] from='client.? 172.21.15.61:0/1327667257' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:53:13.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:53:11.594667+0000 mgr.smithi067.rdualw (mgr.24569) 11296 : audit [DBG] from='client.41674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:53:13.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:53:11.887951+0000 mgr.smithi067.rdualw (mgr.24569) 11297 : audit [DBG] from='client.41678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:53:13.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:53:11.594667+0000 mgr.smithi067.rdualw (mgr.24569) 11296 : audit [DBG] from='client.41674 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:53:13.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:53:11.887951+0000 mgr.smithi067.rdualw (mgr.24569) 11297 : audit [DBG] from='client.41678 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:53:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:12.645054+0000 mgr.smithi067.rdualw (mgr.24569) 11298 : cluster [DBG] pgmap v9729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:12.645054+0000 mgr.smithi067.rdualw (mgr.24569) 11298 : cluster [DBG] pgmap v9729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:14.645679+0000 mgr.smithi067.rdualw (mgr.24569) 11299 : cluster [DBG] pgmap v9730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:14.645679+0000 mgr.smithi067.rdualw (mgr.24569) 11299 : cluster [DBG] pgmap v9730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:16.646734+0000 mgr.smithi067.rdualw (mgr.24569) 11300 : cluster [DBG] pgmap v9731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:53:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:16.646734+0000 mgr.smithi067.rdualw (mgr.24569) 11300 : cluster [DBG] pgmap v9731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:53:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:18.647515+0000 mgr.smithi067.rdualw (mgr.24569) 11301 : cluster [DBG] pgmap v9732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:18.647515+0000 mgr.smithi067.rdualw (mgr.24569) 11301 : cluster [DBG] pgmap v9732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:53:21.032466+0000 mon.smithi067 (mon.1) 1707 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:53:21.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:53:21.033961+0000 mon.smithi067 (mon.1) 1708 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:53:21.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:53:21.034952+0000 mon.smithi067 (mon.1) 1709 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:53:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:53:21.032466+0000 mon.smithi067 (mon.1) 1707 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:53:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:53:21.033961+0000 mon.smithi067 (mon.1) 1708 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:53:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:53:21.034952+0000 mon.smithi067 (mon.1) 1709 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:53:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:20.648355+0000 mgr.smithi067.rdualw (mgr.24569) 11302 : cluster [DBG] pgmap v9733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:53:21.035765+0000 mgr.smithi067.rdualw (mgr.24569) 11303 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:53:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:53:21.443265+0000 mon.smithi061 (mon.0) 2367 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:53:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:53:21.449117+0000 mon.smithi061 (mon.0) 2368 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:53:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:20.648355+0000 mgr.smithi067.rdualw (mgr.24569) 11302 : cluster [DBG] pgmap v9733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:53:21.035765+0000 mgr.smithi067.rdualw (mgr.24569) 11303 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:53:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:53:21.443265+0000 mon.smithi061 (mon.0) 2367 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:53:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:53:21.449117+0000 mon.smithi061 (mon.0) 2368 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:53:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:22.648900+0000 mgr.smithi067.rdualw (mgr.24569) 11304 : cluster [DBG] pgmap v9734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:22.648900+0000 mgr.smithi067.rdualw (mgr.24569) 11304 : cluster [DBG] pgmap v9734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:26.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:24.649594+0000 mgr.smithi067.rdualw (mgr.24569) 11305 : cluster [DBG] pgmap v9735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:24.649594+0000 mgr.smithi067.rdualw (mgr.24569) 11305 : cluster [DBG] pgmap v9735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:26.650526+0000 mgr.smithi067.rdualw (mgr.24569) 11306 : cluster [DBG] pgmap v9736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:53:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:26.650526+0000 mgr.smithi067.rdualw (mgr.24569) 11306 : cluster [DBG] pgmap v9736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:53:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:28.651153+0000 mgr.smithi067.rdualw (mgr.24569) 11307 : cluster [DBG] pgmap v9737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:28.651153+0000 mgr.smithi067.rdualw (mgr.24569) 11307 : cluster [DBG] pgmap v9737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:30.651988+0000 mgr.smithi067.rdualw (mgr.24569) 11308 : cluster [DBG] pgmap v9738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:30.651988+0000 mgr.smithi067.rdualw (mgr.24569) 11308 : cluster [DBG] pgmap v9738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:32.652685+0000 mgr.smithi067.rdualw (mgr.24569) 11309 : cluster [DBG] pgmap v9739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:32.652685+0000 mgr.smithi067.rdualw (mgr.24569) 11309 : cluster [DBG] pgmap v9739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:35.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:34.653405+0000 mgr.smithi067.rdualw (mgr.24569) 11310 : cluster [DBG] pgmap v9740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:34.653405+0000 mgr.smithi067.rdualw (mgr.24569) 11310 : cluster [DBG] pgmap v9740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:53:36.244289+0000 mon.smithi067 (mon.1) 1710 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:53:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:53:36.245104+0000 mon.smithi061 (mon.0) 2369 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:53:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:53:36.246992+0000 mon.smithi067 (mon.1) 1711 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:53:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:53:36.247608+0000 mon.smithi061 (mon.0) 2370 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:53:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:53:36.244289+0000 mon.smithi067 (mon.1) 1710 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:53:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:53:36.245104+0000 mon.smithi061 (mon.0) 2369 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:53:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:53:36.246992+0000 mon.smithi067 (mon.1) 1711 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:53:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:53:36.247608+0000 mon.smithi061 (mon.0) 2370 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:53:38.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:36.654352+0000 mgr.smithi067.rdualw (mgr.24569) 11311 : cluster [DBG] pgmap v9741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:53:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:36.654352+0000 mgr.smithi067.rdualw (mgr.24569) 11311 : cluster [DBG] pgmap v9741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:53:40.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:38.655036+0000 mgr.smithi067.rdualw (mgr.24569) 11312 : cluster [DBG] pgmap v9742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:38.655036+0000 mgr.smithi067.rdualw (mgr.24569) 11312 : cluster [DBG] pgmap v9742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:42.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:40.656027+0000 mgr.smithi067.rdualw (mgr.24569) 11313 : cluster [DBG] pgmap v9743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:42.553 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:53:42.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:40.656027+0000 mgr.smithi067.rdualw (mgr.24569) 11313 : cluster [DBG] pgmap v9743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:42.844 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:53:42.845 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 6m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:53:42.845 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 6m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:53:42.845 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 6m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:53:42.845 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 6m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:53:42.846 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 6m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:53:42.846 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 6m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:53:42.846 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 6m ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:53:42.847 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 6m ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:53:42.847 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 6m ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:53:42.847 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 6m ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:53:42.848 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 6m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:53:42.848 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 6m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:53:42.848 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 6m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:53:42.849 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 6m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:53:42.849 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 6m ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:53:42.849 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 6m ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:53:42.850 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 6m ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:53:42.850 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 6m ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:53:42.850 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 6m ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:53:42.851 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 6m ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:53:42.851 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 6m ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:53:42.851 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 6m ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:53:42.852 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 6m ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:53:43.222 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:53:43.223 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:53:43.223 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:53:43.223 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:53:43.223 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:53:43.224 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:53:43.224 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:53:43.224 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:53:43.224 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:53:43.225 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:53:43.225 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:53:43.225 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:53:43.225 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:53:43.225 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:53:43.226 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:53:43.226 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:53:43.226 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:53:43.226 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:53:43.227 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:53:43.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:53:43.221219+0000 mon.smithi061 (mon.0) 2371 : audit [DBG] from='client.? 172.21.15.61:0/167091008' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:53:43.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:53:43.221219+0000 mon.smithi061 (mon.0) 2371 : audit [DBG] from='client.? 172.21.15.61:0/167091008' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:53:44.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:53:42.538427+0000 mgr.smithi067.rdualw (mgr.24569) 11314 : audit [DBG] from='client.41686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:53:44.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:42.656736+0000 mgr.smithi067.rdualw (mgr.24569) 11315 : cluster [DBG] pgmap v9744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:44.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:53:42.825601+0000 mgr.smithi067.rdualw (mgr.24569) 11316 : audit [DBG] from='client.41690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:53:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:53:42.538427+0000 mgr.smithi067.rdualw (mgr.24569) 11314 : audit [DBG] from='client.41686 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:53:44.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:42.656736+0000 mgr.smithi067.rdualw (mgr.24569) 11315 : cluster [DBG] pgmap v9744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:44.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:53:42.825601+0000 mgr.smithi067.rdualw (mgr.24569) 11316 : audit [DBG] from='client.41690 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:53:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:44.657509+0000 mgr.smithi067.rdualw (mgr.24569) 11317 : cluster [DBG] pgmap v9745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:44.657509+0000 mgr.smithi067.rdualw (mgr.24569) 11317 : cluster [DBG] pgmap v9745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:46.658455+0000 mgr.smithi067.rdualw (mgr.24569) 11318 : cluster [DBG] pgmap v9746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:53:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:46.658455+0000 mgr.smithi067.rdualw (mgr.24569) 11318 : cluster [DBG] pgmap v9746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:53:50.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:48.659115+0000 mgr.smithi067.rdualw (mgr.24569) 11319 : cluster [DBG] pgmap v9747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:48.659115+0000 mgr.smithi067.rdualw (mgr.24569) 11319 : cluster [DBG] pgmap v9747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:50.659992+0000 mgr.smithi067.rdualw (mgr.24569) 11320 : cluster [DBG] pgmap v9748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:50.659992+0000 mgr.smithi067.rdualw (mgr.24569) 11320 : cluster [DBG] pgmap v9748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:52.660687+0000 mgr.smithi067.rdualw (mgr.24569) 11321 : cluster [DBG] pgmap v9749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:52.660687+0000 mgr.smithi067.rdualw (mgr.24569) 11321 : cluster [DBG] pgmap v9749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:54.661221+0000 mgr.smithi067.rdualw (mgr.24569) 11322 : cluster [DBG] pgmap v9750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:54.661221+0000 mgr.smithi067.rdualw (mgr.24569) 11322 : cluster [DBG] pgmap v9750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:53:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:53:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:56.662249+0000 mgr.smithi067.rdualw (mgr.24569) 11323 : cluster [DBG] pgmap v9751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:53:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:53:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:56.662249+0000 mgr.smithi067.rdualw (mgr.24569) 11323 : cluster [DBG] pgmap v9751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:54:00.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:53:58.662905+0000 mgr.smithi067.rdualw (mgr.24569) 11324 : cluster [DBG] pgmap v9752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:53:58.662905+0000 mgr.smithi067.rdualw (mgr.24569) 11324 : cluster [DBG] pgmap v9752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:02.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:00.663822+0000 mgr.smithi067.rdualw (mgr.24569) 11325 : cluster [DBG] pgmap v9753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:00.663822+0000 mgr.smithi067.rdualw (mgr.24569) 11325 : cluster [DBG] pgmap v9753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:02.664281+0000 mgr.smithi067.rdualw (mgr.24569) 11326 : cluster [DBG] pgmap v9754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:02.664281+0000 mgr.smithi067.rdualw (mgr.24569) 11326 : cluster [DBG] pgmap v9754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:04.664883+0000 mgr.smithi067.rdualw (mgr.24569) 11327 : cluster [DBG] pgmap v9755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:06.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:04.664883+0000 mgr.smithi067.rdualw (mgr.24569) 11327 : cluster [DBG] pgmap v9755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:06.665761+0000 mgr.smithi067.rdualw (mgr.24569) 11328 : cluster [DBG] pgmap v9756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:54:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:06.665761+0000 mgr.smithi067.rdualw (mgr.24569) 11328 : cluster [DBG] pgmap v9756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:54:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:08.666481+0000 mgr.smithi067.rdualw (mgr.24569) 11329 : cluster [DBG] pgmap v9757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:08.666481+0000 mgr.smithi067.rdualw (mgr.24569) 11329 : cluster [DBG] pgmap v9757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:10.667250+0000 mgr.smithi067.rdualw (mgr.24569) 11330 : cluster [DBG] pgmap v9758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:10.667250+0000 mgr.smithi067.rdualw (mgr.24569) 11330 : cluster [DBG] pgmap v9758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:13.531 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:54:13.823 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:54:13.823 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 6m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:54:13.825 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 6m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:54:13.825 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 6m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:54:13.825 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 6m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:54:13.825 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 6m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:54:13.826 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 6m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:54:13.826 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 6m ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:54:13.827 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 6m ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:54:13.827 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 6m ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:54:13.827 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 6m ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:54:13.827 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 6m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:54:13.828 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 6m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:54:13.828 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 6m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:54:13.828 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 6m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:54:13.828 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 6m ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:54:13.829 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 6m ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:54:13.829 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 6m ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:54:13.829 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 6m ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:54:13.829 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 6m ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:54:13.829 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 6m ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:54:13.830 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 6m ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:54:13.830 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 6m ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:54:13.830 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 6m ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:54:14.162 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:54:14.163 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:54:14.163 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:54:14.163 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:54:14.164 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:54:14.164 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:54:14.164 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:54:14.164 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:54:14.164 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:54:14.165 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:54:14.165 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:54:14.165 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:54:14.165 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:54:14.166 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:54:14.166 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:54:14.166 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:54:14.166 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:54:14.166 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:54:14.167 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:54:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:12.667939+0000 mgr.smithi067.rdualw (mgr.24569) 11331 : cluster [DBG] pgmap v9759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:54:14.161192+0000 mon.smithi061 (mon.0) 2372 : audit [DBG] from='client.? 172.21.15.61:0/812929370' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:54:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:12.667939+0000 mgr.smithi067.rdualw (mgr.24569) 11331 : cluster [DBG] pgmap v9759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:54:14.161192+0000 mon.smithi061 (mon.0) 2372 : audit [DBG] from='client.? 172.21.15.61:0/812929370' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:54:15.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:54:13.517331+0000 mgr.smithi067.rdualw (mgr.24569) 11332 : audit [DBG] from='client.41698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:54:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:54:13.804708+0000 mgr.smithi067.rdualw (mgr.24569) 11333 : audit [DBG] from='client.41702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:54:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:54:13.517331+0000 mgr.smithi067.rdualw (mgr.24569) 11332 : audit [DBG] from='client.41698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:54:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:54:13.804708+0000 mgr.smithi067.rdualw (mgr.24569) 11333 : audit [DBG] from='client.41702 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:54:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:14.668711+0000 mgr.smithi067.rdualw (mgr.24569) 11334 : cluster [DBG] pgmap v9760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:14.668711+0000 mgr.smithi067.rdualw (mgr.24569) 11334 : cluster [DBG] pgmap v9760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:16.669700+0000 mgr.smithi067.rdualw (mgr.24569) 11335 : cluster [DBG] pgmap v9761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:54:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:16.669700+0000 mgr.smithi067.rdualw (mgr.24569) 11335 : cluster [DBG] pgmap v9761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:54:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:18.670266+0000 mgr.smithi067.rdualw (mgr.24569) 11336 : cluster [DBG] pgmap v9762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:20.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:18.670266+0000 mgr.smithi067.rdualw (mgr.24569) 11336 : cluster [DBG] pgmap v9762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:20.671164+0000 mgr.smithi067.rdualw (mgr.24569) 11337 : cluster [DBG] pgmap v9763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:54:21.453741+0000 mon.smithi067 (mon.1) 1712 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:54:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:54:21.455182+0000 mon.smithi067 (mon.1) 1713 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:54:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:54:21.456144+0000 mon.smithi067 (mon.1) 1714 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:54:22.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:54:21.861364+0000 mon.smithi061 (mon.0) 2373 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:54:22.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:54:21.867176+0000 mon.smithi061 (mon.0) 2374 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:54:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:20.671164+0000 mgr.smithi067.rdualw (mgr.24569) 11337 : cluster [DBG] pgmap v9763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:54:21.453741+0000 mon.smithi067 (mon.1) 1712 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:54:22.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:54:21.455182+0000 mon.smithi067 (mon.1) 1713 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:54:22.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:54:21.456144+0000 mon.smithi067 (mon.1) 1714 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:54:22.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:54:21.861364+0000 mon.smithi061 (mon.0) 2373 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:54:22.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:54:21.867176+0000 mon.smithi061 (mon.0) 2374 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:54:23.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:54:21.457045+0000 mgr.smithi067.rdualw (mgr.24569) 11338 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:54:23.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:54:21.457045+0000 mgr.smithi067.rdualw (mgr.24569) 11338 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:54:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:22.671832+0000 mgr.smithi067.rdualw (mgr.24569) 11339 : cluster [DBG] pgmap v9764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:24.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:22.671832+0000 mgr.smithi067.rdualw (mgr.24569) 11339 : cluster [DBG] pgmap v9764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:26.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:24.672372+0000 mgr.smithi067.rdualw (mgr.24569) 11340 : cluster [DBG] pgmap v9765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:24.672372+0000 mgr.smithi067.rdualw (mgr.24569) 11340 : cluster [DBG] pgmap v9765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:26.673207+0000 mgr.smithi067.rdualw (mgr.24569) 11341 : cluster [DBG] pgmap v9766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:54:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:26.673207+0000 mgr.smithi067.rdualw (mgr.24569) 11341 : cluster [DBG] pgmap v9766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:54:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:28.673898+0000 mgr.smithi067.rdualw (mgr.24569) 11342 : cluster [DBG] pgmap v9767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:28.673898+0000 mgr.smithi067.rdualw (mgr.24569) 11342 : cluster [DBG] pgmap v9767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:30.674880+0000 mgr.smithi067.rdualw (mgr.24569) 11343 : cluster [DBG] pgmap v9768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:30.674880+0000 mgr.smithi067.rdualw (mgr.24569) 11343 : cluster [DBG] pgmap v9768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:32.675435+0000 mgr.smithi067.rdualw (mgr.24569) 11344 : cluster [DBG] pgmap v9769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:32.675435+0000 mgr.smithi067.rdualw (mgr.24569) 11344 : cluster [DBG] pgmap v9769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:34.676155+0000 mgr.smithi067.rdualw (mgr.24569) 11345 : cluster [DBG] pgmap v9770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:54:36.247176+0000 mon.smithi067 (mon.1) 1715 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:54:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:54:36.247788+0000 mon.smithi061 (mon.0) 2375 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:54:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:54:36.254308+0000 mon.smithi067 (mon.1) 1716 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:54:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:54:36.254891+0000 mon.smithi061 (mon.0) 2376 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:54:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:34.676155+0000 mgr.smithi067.rdualw (mgr.24569) 11345 : cluster [DBG] pgmap v9770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:54:36.247176+0000 mon.smithi067 (mon.1) 1715 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:54:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:54:36.247788+0000 mon.smithi061 (mon.0) 2375 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:54:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:54:36.254308+0000 mon.smithi067 (mon.1) 1716 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:54:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:54:36.254891+0000 mon.smithi061 (mon.0) 2376 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:54:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:36.677039+0000 mgr.smithi067.rdualw (mgr.24569) 11346 : cluster [DBG] pgmap v9771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:54:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:36.677039+0000 mgr.smithi067.rdualw (mgr.24569) 11346 : cluster [DBG] pgmap v9771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:54:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:38.677521+0000 mgr.smithi067.rdualw (mgr.24569) 11347 : cluster [DBG] pgmap v9772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:38.677521+0000 mgr.smithi067.rdualw (mgr.24569) 11347 : cluster [DBG] pgmap v9772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:40.678357+0000 mgr.smithi067.rdualw (mgr.24569) 11348 : cluster [DBG] pgmap v9773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:41.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:40.678357+0000 mgr.smithi067.rdualw (mgr.24569) 11348 : cluster [DBG] pgmap v9773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:44.533 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:54:44.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:42.678989+0000 mgr.smithi067.rdualw (mgr.24569) 11349 : cluster [DBG] pgmap v9774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:44.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:42.678989+0000 mgr.smithi067.rdualw (mgr.24569) 11349 : cluster [DBG] pgmap v9774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:44.825 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:54:44.826 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 7m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:54:44.826 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 7m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:54:44.826 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 7m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:54:44.826 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 7m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:54:44.827 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 7m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:54:44.827 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 7m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:54:44.827 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 7m ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:54:44.827 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 7m ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:54:44.828 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 7m ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:54:44.828 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 7m ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:54:44.828 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 7m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:54:44.828 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 7m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:54:44.828 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 7m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:54:44.829 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 7m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:54:44.829 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 7m ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:54:44.829 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 7m ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:54:44.829 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 7m ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:54:44.830 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 7m ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:54:44.830 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 7m ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:54:44.830 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 7m ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:54:44.830 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 7m ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:54:44.831 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 7m ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:54:44.831 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 7m ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:54:45.199 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:54:45.200 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:54:45.200 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:54:45.201 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:54:45.201 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:54:45.201 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:54:45.202 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:54:45.202 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:54:45.202 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:54:45.203 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:54:45.203 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:54:45.204 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:54:45.204 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:54:45.205 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:54:45.206 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:54:45.206 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:54:45.206 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:54:45.207 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:54:45.207 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:54:45.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:54:45.197524+0000 mon.smithi061 (mon.0) 2377 : audit [DBG] from='client.? 172.21.15.61:0/3531099749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:54:45.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:54:45.197524+0000 mon.smithi061 (mon.0) 2377 : audit [DBG] from='client.? 172.21.15.61:0/3531099749' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:54:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:54:44.519414+0000 mgr.smithi067.rdualw (mgr.24569) 11350 : audit [DBG] from='client.41710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:54:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:44.679756+0000 mgr.smithi067.rdualw (mgr.24569) 11351 : cluster [DBG] pgmap v9775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:46.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:54:44.807731+0000 mgr.smithi067.rdualw (mgr.24569) 11352 : audit [DBG] from='client.41714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:54:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:54:44.519414+0000 mgr.smithi067.rdualw (mgr.24569) 11350 : audit [DBG] from='client.41710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:54:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:44.679756+0000 mgr.smithi067.rdualw (mgr.24569) 11351 : cluster [DBG] pgmap v9775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:46.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:54:44.807731+0000 mgr.smithi067.rdualw (mgr.24569) 11352 : audit [DBG] from='client.41714 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:54:48.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:46.680749+0000 mgr.smithi067.rdualw (mgr.24569) 11353 : cluster [DBG] pgmap v9776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:54:48.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:46.680749+0000 mgr.smithi067.rdualw (mgr.24569) 11353 : cluster [DBG] pgmap v9776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:54:50.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:48.681313+0000 mgr.smithi067.rdualw (mgr.24569) 11354 : cluster [DBG] pgmap v9777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:50.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:48.681313+0000 mgr.smithi067.rdualw (mgr.24569) 11354 : cluster [DBG] pgmap v9777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:52.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:50.682196+0000 mgr.smithi067.rdualw (mgr.24569) 11355 : cluster [DBG] pgmap v9778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:52.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:50.682196+0000 mgr.smithi067.rdualw (mgr.24569) 11355 : cluster [DBG] pgmap v9778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:54.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:52.682835+0000 mgr.smithi067.rdualw (mgr.24569) 11356 : cluster [DBG] pgmap v9779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:54.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:52.682835+0000 mgr.smithi067.rdualw (mgr.24569) 11356 : cluster [DBG] pgmap v9779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:54.683443+0000 mgr.smithi067.rdualw (mgr.24569) 11357 : cluster [DBG] pgmap v9780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:54.683443+0000 mgr.smithi067.rdualw (mgr.24569) 11357 : cluster [DBG] pgmap v9780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:54:58.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:54:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:56.684267+0000 mgr.smithi067.rdualw (mgr.24569) 11358 : cluster [DBG] pgmap v9781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:54:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:54:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:56.684267+0000 mgr.smithi067.rdualw (mgr.24569) 11358 : cluster [DBG] pgmap v9781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:55:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:54:58.684827+0000 mgr.smithi067.rdualw (mgr.24569) 11359 : cluster [DBG] pgmap v9782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:54:58.684827+0000 mgr.smithi067.rdualw (mgr.24569) 11359 : cluster [DBG] pgmap v9782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:00.685635+0000 mgr.smithi067.rdualw (mgr.24569) 11360 : cluster [DBG] pgmap v9783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:00.685635+0000 mgr.smithi067.rdualw (mgr.24569) 11360 : cluster [DBG] pgmap v9783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:02.686376+0000 mgr.smithi067.rdualw (mgr.24569) 11361 : cluster [DBG] pgmap v9784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:02.686376+0000 mgr.smithi067.rdualw (mgr.24569) 11361 : cluster [DBG] pgmap v9784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:04.687050+0000 mgr.smithi067.rdualw (mgr.24569) 11362 : cluster [DBG] pgmap v9785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:06.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:04.687050+0000 mgr.smithi067.rdualw (mgr.24569) 11362 : cluster [DBG] pgmap v9785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:06.687964+0000 mgr.smithi067.rdualw (mgr.24569) 11363 : cluster [DBG] pgmap v9786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:55:08.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:06.687964+0000 mgr.smithi067.rdualw (mgr.24569) 11363 : cluster [DBG] pgmap v9786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:55:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:08.688594+0000 mgr.smithi067.rdualw (mgr.24569) 11364 : cluster [DBG] pgmap v9787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:08.688594+0000 mgr.smithi067.rdualw (mgr.24569) 11364 : cluster [DBG] pgmap v9787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:10.689648+0000 mgr.smithi067.rdualw (mgr.24569) 11365 : cluster [DBG] pgmap v9788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:10.689648+0000 mgr.smithi067.rdualw (mgr.24569) 11365 : cluster [DBG] pgmap v9788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:12.690185+0000 mgr.smithi067.rdualw (mgr.24569) 11366 : cluster [DBG] pgmap v9789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:12.690185+0000 mgr.smithi067.rdualw (mgr.24569) 11366 : cluster [DBG] pgmap v9789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:15.505 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:55:15.858 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:55:15.859 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 7m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:55:15.859 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 7m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:55:15.859 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 8m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:55:15.859 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 7m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:55:15.860 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 7m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:55:15.860 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 8m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:55:15.860 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 7m ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:55:15.860 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 8m ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:55:15.861 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 7m ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:55:15.861 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 8m ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:55:15.861 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 7m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:55:15.862 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 8m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:55:15.862 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 7m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:55:15.862 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 8m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:55:15.862 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 7m ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:55:15.863 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 7m ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:55:15.863 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 7m ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:55:15.863 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 7m ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:55:15.863 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 8m ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:55:15.864 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 8m ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:55:15.864 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 8m ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:55:15.864 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 8m ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:55:15.864 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 7m ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:55:16.198 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:55:16.198 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:55:16.198 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:55:16.199 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:55:16.199 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:55:16.199 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:55:16.199 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:55:16.199 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:55:16.200 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:55:16.200 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:55:16.200 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:55:16.200 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:55:16.201 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:55:16.201 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:55:16.201 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:55:16.201 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:55:16.201 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:55:16.202 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:55:16.202 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:55:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:14.690876+0000 mgr.smithi067.rdualw (mgr.24569) 11367 : cluster [DBG] pgmap v9790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:55:16.196504+0000 mon.smithi061 (mon.0) 2378 : audit [DBG] from='client.? 172.21.15.61:0/1773633075' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:55:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:14.690876+0000 mgr.smithi067.rdualw (mgr.24569) 11367 : cluster [DBG] pgmap v9790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:55:16.196504+0000 mon.smithi061 (mon.0) 2378 : audit [DBG] from='client.? 172.21.15.61:0/1773633075' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:55:17.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:55:15.492136+0000 mgr.smithi067.rdualw (mgr.24569) 11368 : audit [DBG] from='client.41722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:55:17.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:55:15.840698+0000 mgr.smithi067.rdualw (mgr.24569) 11369 : audit [DBG] from='client.41726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:55:17.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:55:15.492136+0000 mgr.smithi067.rdualw (mgr.24569) 11368 : audit [DBG] from='client.41722 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:55:17.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:55:15.840698+0000 mgr.smithi067.rdualw (mgr.24569) 11369 : audit [DBG] from='client.41726 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:55:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:16.691927+0000 mgr.smithi067.rdualw (mgr.24569) 11370 : cluster [DBG] pgmap v9791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:55:18.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:16.691927+0000 mgr.smithi067.rdualw (mgr.24569) 11370 : cluster [DBG] pgmap v9791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:55:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:18.692566+0000 mgr.smithi067.rdualw (mgr.24569) 11371 : cluster [DBG] pgmap v9792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:18.692566+0000 mgr.smithi067.rdualw (mgr.24569) 11371 : cluster [DBG] pgmap v9792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:20.693429+0000 mgr.smithi067.rdualw (mgr.24569) 11372 : cluster [DBG] pgmap v9793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:55:21.870575+0000 mon.smithi067 (mon.1) 1717 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:55:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:55:21.871951+0000 mon.smithi067 (mon.1) 1718 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:55:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:55:21.872933+0000 mon.smithi067 (mon.1) 1719 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:55:22.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:55:22.277129+0000 mon.smithi061 (mon.0) 2379 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:55:22.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:55:22.282814+0000 mon.smithi061 (mon.0) 2380 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:55:22.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:20.693429+0000 mgr.smithi067.rdualw (mgr.24569) 11372 : cluster [DBG] pgmap v9793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:55:21.870575+0000 mon.smithi067 (mon.1) 1717 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:55:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:55:21.871951+0000 mon.smithi067 (mon.1) 1718 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:55:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:55:21.872933+0000 mon.smithi067 (mon.1) 1719 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:55:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:55:22.277129+0000 mon.smithi061 (mon.0) 2379 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:55:22.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:55:22.282814+0000 mon.smithi061 (mon.0) 2380 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:55:23.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:55:21.873789+0000 mgr.smithi067.rdualw (mgr.24569) 11373 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:55:23.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:55:21.873789+0000 mgr.smithi067.rdualw (mgr.24569) 11373 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:55:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:22.694087+0000 mgr.smithi067.rdualw (mgr.24569) 11374 : cluster [DBG] pgmap v9794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:22.694087+0000 mgr.smithi067.rdualw (mgr.24569) 11374 : cluster [DBG] pgmap v9794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:26.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:24.694800+0000 mgr.smithi067.rdualw (mgr.24569) 11375 : cluster [DBG] pgmap v9795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:24.694800+0000 mgr.smithi067.rdualw (mgr.24569) 11375 : cluster [DBG] pgmap v9795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:26.695609+0000 mgr.smithi067.rdualw (mgr.24569) 11376 : cluster [DBG] pgmap v9796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:55:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:26.695609+0000 mgr.smithi067.rdualw (mgr.24569) 11376 : cluster [DBG] pgmap v9796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:55:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:28.696308+0000 mgr.smithi067.rdualw (mgr.24569) 11377 : cluster [DBG] pgmap v9797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:28.696308+0000 mgr.smithi067.rdualw (mgr.24569) 11377 : cluster [DBG] pgmap v9797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:30.697410+0000 mgr.smithi067.rdualw (mgr.24569) 11378 : cluster [DBG] pgmap v9798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:30.697410+0000 mgr.smithi067.rdualw (mgr.24569) 11378 : cluster [DBG] pgmap v9798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:32.698099+0000 mgr.smithi067.rdualw (mgr.24569) 11379 : cluster [DBG] pgmap v9799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:32.698099+0000 mgr.smithi067.rdualw (mgr.24569) 11379 : cluster [DBG] pgmap v9799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:34.698726+0000 mgr.smithi067.rdualw (mgr.24569) 11380 : cluster [DBG] pgmap v9800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:55:36.258900+0000 mon.smithi067 (mon.1) 1720 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:55:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:55:36.259159+0000 mon.smithi067 (mon.1) 1721 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:55:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:55:36.259574+0000 mon.smithi061 (mon.0) 2381 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:55:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:55:36.259801+0000 mon.smithi061 (mon.0) 2382 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:55:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:34.698726+0000 mgr.smithi067.rdualw (mgr.24569) 11380 : cluster [DBG] pgmap v9800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:55:36.258900+0000 mon.smithi067 (mon.1) 1720 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:55:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:55:36.259159+0000 mon.smithi067 (mon.1) 1721 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:55:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:55:36.259574+0000 mon.smithi061 (mon.0) 2381 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:55:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:55:36.259801+0000 mon.smithi061 (mon.0) 2382 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:55:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:36.699684+0000 mgr.smithi067.rdualw (mgr.24569) 11381 : cluster [DBG] pgmap v9801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:55:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:36.699684+0000 mgr.smithi067.rdualw (mgr.24569) 11381 : cluster [DBG] pgmap v9801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:55:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:38.700282+0000 mgr.smithi067.rdualw (mgr.24569) 11382 : cluster [DBG] pgmap v9802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:38.700282+0000 mgr.smithi067.rdualw (mgr.24569) 11382 : cluster [DBG] pgmap v9802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:42.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:40.701151+0000 mgr.smithi067.rdualw (mgr.24569) 11383 : cluster [DBG] pgmap v9803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:40.701151+0000 mgr.smithi067.rdualw (mgr.24569) 11383 : cluster [DBG] pgmap v9803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:42.701738+0000 mgr.smithi067.rdualw (mgr.24569) 11384 : cluster [DBG] pgmap v9804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:42.701738+0000 mgr.smithi067.rdualw (mgr.24569) 11384 : cluster [DBG] pgmap v9804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:46.508 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:55:46.796 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:55:46.797 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 8m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:55:46.797 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 8m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:55:46.797 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 8m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:55:46.797 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 8m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:55:46.798 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 8m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:55:46.798 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 8m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:55:46.798 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 8m ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:55:46.798 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 8m ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:55:46.799 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 8m ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:55:46.799 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 8m ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:55:46.799 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 8m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:55:46.799 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 8m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:55:46.800 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 8m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:55:46.800 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 8m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:55:46.800 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 8m ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:55:46.800 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 8m ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:55:46.801 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 8m ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:55:46.801 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 8m ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:55:46.801 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 8m ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:55:46.801 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 8m ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:55:46.801 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 8m ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:55:46.802 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 8m ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:55:46.802 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 8m ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:55:46.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:44.702277+0000 mgr.smithi067.rdualw (mgr.24569) 11385 : cluster [DBG] pgmap v9805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:44.702277+0000 mgr.smithi067.rdualw (mgr.24569) 11385 : cluster [DBG] pgmap v9805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:47.134 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:55:47.134 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:55:47.134 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:55:47.135 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:55:47.135 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:55:47.135 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:55:47.135 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:55:47.136 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:55:47.136 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:55:47.136 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:55:47.136 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:55:47.136 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:55:47.137 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:55:47.137 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:55:47.137 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:55:47.137 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:55:47.137 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:55:47.138 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:55:47.138 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:55:47.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:55:46.494712+0000 mgr.smithi067.rdualw (mgr.24569) 11386 : audit [DBG] from='client.41734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:55:47.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:46.703172+0000 mgr.smithi067.rdualw (mgr.24569) 11387 : cluster [DBG] pgmap v9806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:55:47.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:55:46.778654+0000 mgr.smithi067.rdualw (mgr.24569) 11388 : audit [DBG] from='client.41738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:55:47.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:55:47.132590+0000 mon.smithi061 (mon.0) 2383 : audit [DBG] from='client.? 172.21.15.61:0/17584537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:55:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:55:46.494712+0000 mgr.smithi067.rdualw (mgr.24569) 11386 : audit [DBG] from='client.41734 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:55:47.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:46.703172+0000 mgr.smithi067.rdualw (mgr.24569) 11387 : cluster [DBG] pgmap v9806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:55:47.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:55:46.778654+0000 mgr.smithi067.rdualw (mgr.24569) 11388 : audit [DBG] from='client.41738 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:55:47.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:55:47.132590+0000 mon.smithi061 (mon.0) 2383 : audit [DBG] from='client.? 172.21.15.61:0/17584537' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:55:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:48.703821+0000 mgr.smithi067.rdualw (mgr.24569) 11389 : cluster [DBG] pgmap v9807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:48.703821+0000 mgr.smithi067.rdualw (mgr.24569) 11389 : cluster [DBG] pgmap v9807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:50.704856+0000 mgr.smithi067.rdualw (mgr.24569) 11390 : cluster [DBG] pgmap v9808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:52.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:50.704856+0000 mgr.smithi067.rdualw (mgr.24569) 11390 : cluster [DBG] pgmap v9808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:54.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:52.705371+0000 mgr.smithi067.rdualw (mgr.24569) 11391 : cluster [DBG] pgmap v9809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:54.555 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:52.705371+0000 mgr.smithi067.rdualw (mgr.24569) 11391 : cluster [DBG] pgmap v9809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:56.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:54.705883+0000 mgr.smithi067.rdualw (mgr.24569) 11392 : cluster [DBG] pgmap v9810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:56.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:54.705883+0000 mgr.smithi067.rdualw (mgr.24569) 11392 : cluster [DBG] pgmap v9810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:55:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:55:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:56.706665+0000 mgr.smithi067.rdualw (mgr.24569) 11393 : cluster [DBG] pgmap v9811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:55:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:55:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:56.706665+0000 mgr.smithi067.rdualw (mgr.24569) 11393 : cluster [DBG] pgmap v9811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:56:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:55:58.707139+0000 mgr.smithi067.rdualw (mgr.24569) 11394 : cluster [DBG] pgmap v9812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:55:58.707139+0000 mgr.smithi067.rdualw (mgr.24569) 11394 : cluster [DBG] pgmap v9812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:02.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:00.707969+0000 mgr.smithi067.rdualw (mgr.24569) 11395 : cluster [DBG] pgmap v9813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:00.707969+0000 mgr.smithi067.rdualw (mgr.24569) 11395 : cluster [DBG] pgmap v9813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:02.708463+0000 mgr.smithi067.rdualw (mgr.24569) 11396 : cluster [DBG] pgmap v9814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:02.708463+0000 mgr.smithi067.rdualw (mgr.24569) 11396 : cluster [DBG] pgmap v9814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:04.709148+0000 mgr.smithi067.rdualw (mgr.24569) 11397 : cluster [DBG] pgmap v9815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:06.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:04.709148+0000 mgr.smithi067.rdualw (mgr.24569) 11397 : cluster [DBG] pgmap v9815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:06.709984+0000 mgr.smithi067.rdualw (mgr.24569) 11398 : cluster [DBG] pgmap v9816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:56:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:06.709984+0000 mgr.smithi067.rdualw (mgr.24569) 11398 : cluster [DBG] pgmap v9816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:56:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:08.710491+0000 mgr.smithi067.rdualw (mgr.24569) 11399 : cluster [DBG] pgmap v9817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:08.710491+0000 mgr.smithi067.rdualw (mgr.24569) 11399 : cluster [DBG] pgmap v9817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:10.711420+0000 mgr.smithi067.rdualw (mgr.24569) 11400 : cluster [DBG] pgmap v9818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:10.711420+0000 mgr.smithi067.rdualw (mgr.24569) 11400 : cluster [DBG] pgmap v9818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:14.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:12.711907+0000 mgr.smithi067.rdualw (mgr.24569) 11401 : cluster [DBG] pgmap v9819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:12.711907+0000 mgr.smithi067.rdualw (mgr.24569) 11401 : cluster [DBG] pgmap v9819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:14.712571+0000 mgr.smithi067.rdualw (mgr.24569) 11402 : cluster [DBG] pgmap v9820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:14.712571+0000 mgr.smithi067.rdualw (mgr.24569) 11402 : cluster [DBG] pgmap v9820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:17.445 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:56:17.744 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:56:17.744 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 8m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:56:17.745 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 8m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:56:17.745 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 9m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:56:17.745 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 8m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:56:17.745 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 8m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:56:17.746 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 9m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:56:17.746 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 8m ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:56:17.746 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 9m ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:56:17.746 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 8m ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:56:17.747 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 9m ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:56:17.747 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 8m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:56:17.747 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 9m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:56:17.747 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 8m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:56:17.747 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 9m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:56:17.748 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 8m ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:56:17.748 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 8m ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:56:17.748 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 8m ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:56:17.748 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 8m ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:56:17.748 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 9m ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:56:17.749 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 9m ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:56:17.749 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 9m ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:56:17.749 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 9m ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:56:17.749 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 8m ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:56:18.189 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:56:18.189 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:56:18.189 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:56:18.189 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:56:18.190 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:56:18.190 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:56:18.190 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:56:18.190 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:56:18.191 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:56:18.191 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:56:18.191 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:56:18.191 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:56:18.191 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:56:18.192 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:56:18.192 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:56:18.192 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:56:18.192 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:56:18.192 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:56:18.193 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:56:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:16.713570+0000 mgr.smithi067.rdualw (mgr.24569) 11403 : cluster [DBG] pgmap v9821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:56:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:56:18.187374+0000 mon.smithi061 (mon.0) 2384 : audit [DBG] from='client.? 172.21.15.61:0/668209676' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:56:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:16.713570+0000 mgr.smithi067.rdualw (mgr.24569) 11403 : cluster [DBG] pgmap v9821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:56:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:56:18.187374+0000 mon.smithi061 (mon.0) 2384 : audit [DBG] from='client.? 172.21.15.61:0/668209676' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:56:19.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:56:17.431957+0000 mgr.smithi067.rdualw (mgr.24569) 11404 : audit [DBG] from='client.41746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:56:19.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:56:17.722562+0000 mgr.smithi067.rdualw (mgr.24569) 11405 : audit [DBG] from='client.41750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:56:19.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:56:17.431957+0000 mgr.smithi067.rdualw (mgr.24569) 11404 : audit [DBG] from='client.41746 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:56:19.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:56:17.722562+0000 mgr.smithi067.rdualw (mgr.24569) 11405 : audit [DBG] from='client.41750 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:56:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:18.713991+0000 mgr.smithi067.rdualw (mgr.24569) 11406 : cluster [DBG] pgmap v9822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:18.713991+0000 mgr.smithi067.rdualw (mgr.24569) 11406 : cluster [DBG] pgmap v9822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:20.714809+0000 mgr.smithi067.rdualw (mgr.24569) 11407 : cluster [DBG] pgmap v9823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:56:22.286038+0000 mon.smithi067 (mon.1) 1722 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:56:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:56:22.287524+0000 mon.smithi067 (mon.1) 1723 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:56:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:56:22.288489+0000 mon.smithi067 (mon.1) 1724 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:56:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:20.714809+0000 mgr.smithi067.rdualw (mgr.24569) 11407 : cluster [DBG] pgmap v9823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:56:22.286038+0000 mon.smithi067 (mon.1) 1722 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:56:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:56:22.287524+0000 mon.smithi067 (mon.1) 1723 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:56:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:56:22.288489+0000 mon.smithi067 (mon.1) 1724 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:56:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:56:22.289393+0000 mgr.smithi067.rdualw (mgr.24569) 11408 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:56:23.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:56:22.716543+0000 mon.smithi061 (mon.0) 2385 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:56:23.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:56:22.724510+0000 mon.smithi061 (mon.0) 2386 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:56:23.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:56:22.289393+0000 mgr.smithi067.rdualw (mgr.24569) 11408 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:56:23.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:56:22.716543+0000 mon.smithi061 (mon.0) 2385 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:56:23.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:56:22.724510+0000 mon.smithi061 (mon.0) 2386 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:56:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:22.715212+0000 mgr.smithi067.rdualw (mgr.24569) 11409 : cluster [DBG] pgmap v9824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:22.715212+0000 mgr.smithi067.rdualw (mgr.24569) 11409 : cluster [DBG] pgmap v9824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:24.715819+0000 mgr.smithi067.rdualw (mgr.24569) 11410 : cluster [DBG] pgmap v9825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:24.715819+0000 mgr.smithi067.rdualw (mgr.24569) 11410 : cluster [DBG] pgmap v9825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:26.716682+0000 mgr.smithi067.rdualw (mgr.24569) 11411 : cluster [DBG] pgmap v9826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:56:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:26.716682+0000 mgr.smithi067.rdualw (mgr.24569) 11411 : cluster [DBG] pgmap v9826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:56:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:28.717326+0000 mgr.smithi067.rdualw (mgr.24569) 11412 : cluster [DBG] pgmap v9827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:28.717326+0000 mgr.smithi067.rdualw (mgr.24569) 11412 : cluster [DBG] pgmap v9827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:30.718220+0000 mgr.smithi067.rdualw (mgr.24569) 11413 : cluster [DBG] pgmap v9828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:30.718220+0000 mgr.smithi067.rdualw (mgr.24569) 11413 : cluster [DBG] pgmap v9828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:32.719012+0000 mgr.smithi067.rdualw (mgr.24569) 11414 : cluster [DBG] pgmap v9829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:32.719012+0000 mgr.smithi067.rdualw (mgr.24569) 11414 : cluster [DBG] pgmap v9829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:34.719870+0000 mgr.smithi067.rdualw (mgr.24569) 11415 : cluster [DBG] pgmap v9830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:56:36.263977+0000 mon.smithi067 (mon.1) 1725 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:56:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:56:36.264233+0000 mon.smithi067 (mon.1) 1726 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:56:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:56:36.264560+0000 mon.smithi061 (mon.0) 2387 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:56:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:56:36.264869+0000 mon.smithi061 (mon.0) 2388 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:56:36.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:34.719870+0000 mgr.smithi067.rdualw (mgr.24569) 11415 : cluster [DBG] pgmap v9830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:56:36.263977+0000 mon.smithi067 (mon.1) 1725 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:56:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:56:36.264233+0000 mon.smithi067 (mon.1) 1726 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:56:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:56:36.264560+0000 mon.smithi061 (mon.0) 2387 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:56:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:56:36.264869+0000 mon.smithi061 (mon.0) 2388 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:56:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:36.720739+0000 mgr.smithi067.rdualw (mgr.24569) 11416 : cluster [DBG] pgmap v9831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:56:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:36.720739+0000 mgr.smithi067.rdualw (mgr.24569) 11416 : cluster [DBG] pgmap v9831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:56:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:38.721273+0000 mgr.smithi067.rdualw (mgr.24569) 11417 : cluster [DBG] pgmap v9832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:38.721273+0000 mgr.smithi067.rdualw (mgr.24569) 11417 : cluster [DBG] pgmap v9832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:42.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:40.722178+0000 mgr.smithi067.rdualw (mgr.24569) 11418 : cluster [DBG] pgmap v9833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:42.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:40.722178+0000 mgr.smithi067.rdualw (mgr.24569) 11418 : cluster [DBG] pgmap v9833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:42.722834+0000 mgr.smithi067.rdualw (mgr.24569) 11419 : cluster [DBG] pgmap v9834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:42.722834+0000 mgr.smithi067.rdualw (mgr.24569) 11419 : cluster [DBG] pgmap v9834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:46.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:44.723611+0000 mgr.smithi067.rdualw (mgr.24569) 11420 : cluster [DBG] pgmap v9835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:44.723611+0000 mgr.smithi067.rdualw (mgr.24569) 11420 : cluster [DBG] pgmap v9835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:48.545 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:56:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:46.724504+0000 mgr.smithi067.rdualw (mgr.24569) 11421 : cluster [DBG] pgmap v9836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:56:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:46.724504+0000 mgr.smithi067.rdualw (mgr.24569) 11421 : cluster [DBG] pgmap v9836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:56:48.874 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:56:48.875 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 9m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:56:48.875 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 9m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:56:48.875 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 9m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:56:48.875 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 9m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:56:48.876 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 9m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:56:48.876 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 9m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:56:48.876 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 9m ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:56:48.876 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 9m ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:56:48.877 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 9m ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:56:48.877 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 9m ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:56:48.877 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 9m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:56:48.877 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 9m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:56:48.877 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 9m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:56:48.878 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 9m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:56:48.878 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 9m ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:56:48.878 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 9m ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:56:48.878 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 9m ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:56:48.879 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 9m ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:56:48.879 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 9m ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:56:48.879 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 9m ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:56:48.879 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 9m ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:56:48.880 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 9m ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:56:48.880 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 9m ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:56:49.216 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:56:49.216 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:56:49.216 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:56:49.217 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:56:49.217 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:56:49.217 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:56:49.217 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:56:49.218 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:56:49.218 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:56:49.218 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:56:49.218 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:56:49.219 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:56:49.219 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:56:49.219 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:56:49.219 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:56:49.220 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:56:49.220 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:56:49.220 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:56:49.220 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:56:49.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:56:49.214579+0000 mon.smithi061 (mon.0) 2389 : audit [DBG] from='client.? 172.21.15.61:0/1905836631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:56:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:56:49.214579+0000 mon.smithi061 (mon.0) 2389 : audit [DBG] from='client.? 172.21.15.61:0/1905836631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:56:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:56:48.531315+0000 mgr.smithi067.rdualw (mgr.24569) 11422 : audit [DBG] from='client.41758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:56:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:48.725248+0000 mgr.smithi067.rdualw (mgr.24569) 11423 : cluster [DBG] pgmap v9837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:56:48.856192+0000 mgr.smithi067.rdualw (mgr.24569) 11424 : audit [DBG] from='client.41762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:56:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:56:48.531315+0000 mgr.smithi067.rdualw (mgr.24569) 11422 : audit [DBG] from='client.41758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:56:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:48.725248+0000 mgr.smithi067.rdualw (mgr.24569) 11423 : cluster [DBG] pgmap v9837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:56:48.856192+0000 mgr.smithi067.rdualw (mgr.24569) 11424 : audit [DBG] from='client.41762 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:56:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:50.726171+0000 mgr.smithi067.rdualw (mgr.24569) 11425 : cluster [DBG] pgmap v9838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:50.726171+0000 mgr.smithi067.rdualw (mgr.24569) 11425 : cluster [DBG] pgmap v9838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:52.726818+0000 mgr.smithi067.rdualw (mgr.24569) 11426 : cluster [DBG] pgmap v9839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:52.726818+0000 mgr.smithi067.rdualw (mgr.24569) 11426 : cluster [DBG] pgmap v9839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:56.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:54.727407+0000 mgr.smithi067.rdualw (mgr.24569) 11427 : cluster [DBG] pgmap v9840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:54.727407+0000 mgr.smithi067.rdualw (mgr.24569) 11427 : cluster [DBG] pgmap v9840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:56.728270+0000 mgr.smithi067.rdualw (mgr.24569) 11428 : cluster [DBG] pgmap v9841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:56:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:56.728270+0000 mgr.smithi067.rdualw (mgr.24569) 11428 : cluster [DBG] pgmap v9841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:56:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:56:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:56:58.728900+0000 mgr.smithi067.rdualw (mgr.24569) 11429 : cluster [DBG] pgmap v9842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:56:59.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:56:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:56:58.728900+0000 mgr.smithi067.rdualw (mgr.24569) 11429 : cluster [DBG] pgmap v9842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:02.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:00.729824+0000 mgr.smithi067.rdualw (mgr.24569) 11430 : cluster [DBG] pgmap v9843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:00.729824+0000 mgr.smithi067.rdualw (mgr.24569) 11430 : cluster [DBG] pgmap v9843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:04.551 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:02.730499+0000 mgr.smithi067.rdualw (mgr.24569) 11431 : cluster [DBG] pgmap v9844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:04.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:02.730499+0000 mgr.smithi067.rdualw (mgr.24569) 11431 : cluster [DBG] pgmap v9844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:04.731065+0000 mgr.smithi067.rdualw (mgr.24569) 11432 : cluster [DBG] pgmap v9845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:06.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:04.731065+0000 mgr.smithi067.rdualw (mgr.24569) 11432 : cluster [DBG] pgmap v9845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:08.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:06.732101+0000 mgr.smithi067.rdualw (mgr.24569) 11433 : cluster [DBG] pgmap v9846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:57:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:06.732101+0000 mgr.smithi067.rdualw (mgr.24569) 11433 : cluster [DBG] pgmap v9846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:57:10.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:08.732628+0000 mgr.smithi067.rdualw (mgr.24569) 11434 : cluster [DBG] pgmap v9847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:08.732628+0000 mgr.smithi067.rdualw (mgr.24569) 11434 : cluster [DBG] pgmap v9847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:10.733436+0000 mgr.smithi067.rdualw (mgr.24569) 11435 : cluster [DBG] pgmap v9848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:10.733436+0000 mgr.smithi067.rdualw (mgr.24569) 11435 : cluster [DBG] pgmap v9848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:12.734007+0000 mgr.smithi067.rdualw (mgr.24569) 11436 : cluster [DBG] pgmap v9849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:14.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:12.734007+0000 mgr.smithi067.rdualw (mgr.24569) 11436 : cluster [DBG] pgmap v9849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:14.734876+0000 mgr.smithi067.rdualw (mgr.24569) 11437 : cluster [DBG] pgmap v9850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:14.734876+0000 mgr.smithi067.rdualw (mgr.24569) 11437 : cluster [DBG] pgmap v9850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:16.735806+0000 mgr.smithi067.rdualw (mgr.24569) 11438 : cluster [DBG] pgmap v9851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:57:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:16.735806+0000 mgr.smithi067.rdualw (mgr.24569) 11438 : cluster [DBG] pgmap v9851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:57:19.525 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:57:19.834 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:57:19.834 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 10m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:57:19.835 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 10m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:57:19.835 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 10m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:57:19.835 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 10m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:57:19.836 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 10m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:57:19.836 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 10m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:57:19.837 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 10m ago 5h 490M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:57:19.837 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 10m ago 5h 655M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:57:19.837 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 10m ago 5h 1949M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:57:19.838 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 10m ago 5h 1092M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:57:19.838 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 10m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:57:19.838 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 10m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:57:19.839 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 10m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:57:19.839 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 10m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:57:19.840 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 10m ago 5h 1289M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:57:19.840 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 10m ago 5h 2202M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:57:19.841 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 10m ago 5h 1386M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:57:19.841 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 10m ago 5h 2354M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:57:19.842 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 10m ago 5h 2169M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:57:19.842 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 10m ago 5h 2322M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:57:19.843 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 10m ago 5h 1905M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:57:19.843 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 10m ago 5h 2886M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:57:19.843 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 10m ago 5h 165M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:57:20.175 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:57:20.175 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:57:20.176 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:57:20.176 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:57:20.176 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:57:20.176 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:57:20.176 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:57:20.177 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:57:20.177 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:57:20.177 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:57:20.177 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:57:20.178 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:57:20.178 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:57:20.178 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:57:20.178 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:57:20.179 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:57:20.179 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:57:20.179 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:57:20.179 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:57:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:18.736329+0000 mgr.smithi067.rdualw (mgr.24569) 11439 : cluster [DBG] pgmap v9852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:20.173650+0000 mon.smithi061 (mon.0) 2390 : audit [DBG] from='client.? 172.21.15.61:0/3820461088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:57:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:18.736329+0000 mgr.smithi067.rdualw (mgr.24569) 11439 : cluster [DBG] pgmap v9852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:20.173650+0000 mon.smithi061 (mon.0) 2390 : audit [DBG] from='client.? 172.21.15.61:0/3820461088' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:57:21.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:19.509433+0000 mgr.smithi067.rdualw (mgr.24569) 11440 : audit [DBG] from='client.41770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:57:21.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:19.814848+0000 mgr.smithi067.rdualw (mgr.24569) 11441 : audit [DBG] from='client.41774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:57:21.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:19.509433+0000 mgr.smithi067.rdualw (mgr.24569) 11440 : audit [DBG] from='client.41770 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:57:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:19.814848+0000 mgr.smithi067.rdualw (mgr.24569) 11441 : audit [DBG] from='client.41774 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:57:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:20.737121+0000 mgr.smithi067.rdualw (mgr.24569) 11442 : cluster [DBG] pgmap v9853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:20.737121+0000 mgr.smithi067.rdualw (mgr.24569) 11442 : cluster [DBG] pgmap v9853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:22.730020+0000 mon.smithi067 (mon.1) 1727 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:57:23.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:22.731529+0000 mon.smithi067 (mon.1) 1728 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:57:23.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:22.732543+0000 mon.smithi067 (mon.1) 1729 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:57:23.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:22.730020+0000 mon.smithi067 (mon.1) 1727 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:57:23.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:22.731529+0000 mon.smithi067 (mon.1) 1728 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:57:23.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:22.732543+0000 mon.smithi067 (mon.1) 1729 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:57:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:57:22.733454+0000 mgr.smithi067.rdualw (mgr.24569) 11443 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:57:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:22.737581+0000 mgr.smithi067.rdualw (mgr.24569) 11444 : cluster [DBG] pgmap v9854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:57:22.733454+0000 mgr.smithi067.rdualw (mgr.24569) 11443 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:57:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:22.737581+0000 mgr.smithi067.rdualw (mgr.24569) 11444 : cluster [DBG] pgmap v9854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:26.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:24.738188+0000 mgr.smithi067.rdualw (mgr.24569) 11445 : cluster [DBG] pgmap v9855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:26.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:24.738188+0000 mgr.smithi067.rdualw (mgr.24569) 11445 : cluster [DBG] pgmap v9855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:28.307 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:26.738984+0000 mgr.smithi067.rdualw (mgr.24569) 11446 : cluster [DBG] pgmap v9856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:57:28.308 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:27.076922+0000 mon.smithi061 (mon.0) 2391 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:57:28.308 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:27.465317+0000 mon.smithi067 (mon.1) 1730 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:57:28.308 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:27.466127+0000 mon.smithi061 (mon.0) 2392 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:57:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:26.738984+0000 mgr.smithi067.rdualw (mgr.24569) 11446 : cluster [DBG] pgmap v9856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:57:28.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:27.076922+0000 mon.smithi061 (mon.0) 2391 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:57:28.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:27.465317+0000 mon.smithi067 (mon.1) 1730 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:57:28.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:27.466127+0000 mon.smithi061 (mon.0) 2392 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:57:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:28.739551+0000 mgr.smithi067.rdualw (mgr.24569) 11447 : cluster [DBG] pgmap v9857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:30.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:29.726890+0000 mon.smithi061 (mon.0) 2393 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:57:30.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:28.739551+0000 mgr.smithi067.rdualw (mgr.24569) 11447 : cluster [DBG] pgmap v9857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:30.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:29.726890+0000 mon.smithi061 (mon.0) 2393 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:57:31.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:30.151665+0000 mon.smithi067 (mon.1) 1731 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:57:31.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:30.152582+0000 mon.smithi061 (mon.0) 2394 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:57:31.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:30.157610+0000 mon.smithi061 (mon.0) 2395 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:57:31.303 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:30.164810+0000 mon.smithi061 (mon.0) 2396 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:57:31.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:30.151665+0000 mon.smithi067 (mon.1) 1731 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:57:31.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:30.152582+0000 mon.smithi061 (mon.0) 2394 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T20:57:31.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:30.157610+0000 mon.smithi061 (mon.0) 2395 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:57:31.568 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:30.164810+0000 mon.smithi061 (mon.0) 2396 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:57:32.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:30.740616+0000 mgr.smithi067.rdualw (mgr.24569) 11448 : cluster [DBG] pgmap v9858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:30.740616+0000 mgr.smithi067.rdualw (mgr.24569) 11448 : cluster [DBG] pgmap v9858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:34.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:32.741255+0000 mgr.smithi067.rdualw (mgr.24569) 11449 : cluster [DBG] pgmap v9859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:32.741255+0000 mgr.smithi067.rdualw (mgr.24569) 11449 : cluster [DBG] pgmap v9859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:34.741869+0000 mgr.smithi067.rdualw (mgr.24569) 11450 : cluster [DBG] pgmap v9860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:36.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:36.269729+0000 mon.smithi067 (mon.1) 1732 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:57:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:36.270100+0000 mon.smithi067 (mon.1) 1733 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:57:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:36.270415+0000 mon.smithi061 (mon.0) 2397 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:57:36.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:36.270680+0000 mon.smithi061 (mon.0) 2398 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:57:36.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:34.741869+0000 mgr.smithi067.rdualw (mgr.24569) 11450 : cluster [DBG] pgmap v9860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:36.269729+0000 mon.smithi067 (mon.1) 1732 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:57:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:36.270100+0000 mon.smithi067 (mon.1) 1733 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:57:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:36.270415+0000 mon.smithi061 (mon.0) 2397 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:57:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:36.270680+0000 mon.smithi061 (mon.0) 2398 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:57:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:36.742792+0000 mgr.smithi067.rdualw (mgr.24569) 11451 : cluster [DBG] pgmap v9861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:57:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:36.742792+0000 mgr.smithi067.rdualw (mgr.24569) 11451 : cluster [DBG] pgmap v9861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:57:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:38.743268+0000 mgr.smithi067.rdualw (mgr.24569) 11452 : cluster [DBG] pgmap v9862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:38.743268+0000 mgr.smithi067.rdualw (mgr.24569) 11452 : cluster [DBG] pgmap v9862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:42.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:40.744370+0000 mgr.smithi067.rdualw (mgr.24569) 11453 : cluster [DBG] pgmap v9863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:40.744370+0000 mgr.smithi067.rdualw (mgr.24569) 11453 : cluster [DBG] pgmap v9863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:44.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:42.745136+0000 mgr.smithi067.rdualw (mgr.24569) 11454 : cluster [DBG] pgmap v9864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:42.745136+0000 mgr.smithi067.rdualw (mgr.24569) 11454 : cluster [DBG] pgmap v9864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:46.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:44.745769+0000 mgr.smithi067.rdualw (mgr.24569) 11455 : cluster [DBG] pgmap v9865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:44.745769+0000 mgr.smithi067.rdualw (mgr.24569) 11455 : cluster [DBG] pgmap v9865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:46.746662+0000 mgr.smithi067.rdualw (mgr.24569) 11456 : cluster [DBG] pgmap v9866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:57:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:46.746662+0000 mgr.smithi067.rdualw (mgr.24569) 11456 : cluster [DBG] pgmap v9866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:57:50.484 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:57:50.773 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:57:50.774 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 21s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:57:50.774 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 21s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:57:50.774 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 23s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:57:50.774 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 21s ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:57:50.775 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 21s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:57:50.775 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 23s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:57:50.775 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 21s ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:57:50.775 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 23s ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:57:50.776 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 21s ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:57:50.776 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 23s ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:57:50.776 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 21s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:57:50.776 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 23s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:57:50.777 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 21s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:57:50.777 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 23s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:57:50.777 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 21s ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:57:50.777 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 21s ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:57:50.778 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 21s ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:57:50.778 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 21s ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:57:50.778 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 23s ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:57:50.778 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 23s ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:57:50.779 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 23s ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:57:50.779 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 23s ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:57:50.779 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 21s ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:57:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:48.747243+0000 mgr.smithi067.rdualw (mgr.24569) 11457 : cluster [DBG] pgmap v9867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:48.747243+0000 mgr.smithi067.rdualw (mgr.24569) 11457 : cluster [DBG] pgmap v9867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:51.113 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:57:51.113 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:57:51.114 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:57:51.114 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:57:51.114 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:57:51.114 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:57:51.114 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:57:51.115 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:57:51.115 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:57:51.115 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:57:51.115 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:57:51.116 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:57:51.116 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:57:51.116 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:57:51.116 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:57:51.117 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:57:51.117 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:57:51.117 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:57:51.117 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:57:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:51.111762+0000 mon.smithi061 (mon.0) 2399 : audit [DBG] from='client.? 172.21.15.61:0/127083953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:57:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:51.111762+0000 mon.smithi061 (mon.0) 2399 : audit [DBG] from='client.? 172.21.15.61:0/127083953' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:57:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:50.469429+0000 mgr.smithi067.rdualw (mgr.24569) 11458 : audit [DBG] from='client.41782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:57:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:50.748296+0000 mgr.smithi067.rdualw (mgr.24569) 11459 : cluster [DBG] pgmap v9868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:57:50.755177+0000 mgr.smithi067.rdualw (mgr.24569) 11460 : audit [DBG] from='client.41786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:57:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:50.469429+0000 mgr.smithi067.rdualw (mgr.24569) 11458 : audit [DBG] from='client.41782 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:57:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:50.748296+0000 mgr.smithi067.rdualw (mgr.24569) 11459 : cluster [DBG] pgmap v9868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:57:50.755177+0000 mgr.smithi067.rdualw (mgr.24569) 11460 : audit [DBG] from='client.41786 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:57:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:52.748978+0000 mgr.smithi067.rdualw (mgr.24569) 11461 : cluster [DBG] pgmap v9869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:52.748978+0000 mgr.smithi067.rdualw (mgr.24569) 11461 : cluster [DBG] pgmap v9869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:54.749783+0000 mgr.smithi067.rdualw (mgr.24569) 11462 : cluster [DBG] pgmap v9870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:54.749783+0000 mgr.smithi067.rdualw (mgr.24569) 11462 : cluster [DBG] pgmap v9870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:57:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:57:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:56.750758+0000 mgr.smithi067.rdualw (mgr.24569) 11463 : cluster [DBG] pgmap v9871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:57:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:57:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:56.750758+0000 mgr.smithi067.rdualw (mgr.24569) 11463 : cluster [DBG] pgmap v9871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:58:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:57:58.751356+0000 mgr.smithi067.rdualw (mgr.24569) 11464 : cluster [DBG] pgmap v9872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:57:58.751356+0000 mgr.smithi067.rdualw (mgr.24569) 11464 : cluster [DBG] pgmap v9872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:00.752142+0000 mgr.smithi067.rdualw (mgr.24569) 11465 : cluster [DBG] pgmap v9873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:00.752142+0000 mgr.smithi067.rdualw (mgr.24569) 11465 : cluster [DBG] pgmap v9873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:02.752753+0000 mgr.smithi067.rdualw (mgr.24569) 11466 : cluster [DBG] pgmap v9874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:02.752753+0000 mgr.smithi067.rdualw (mgr.24569) 11466 : cluster [DBG] pgmap v9874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:06.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:04.753486+0000 mgr.smithi067.rdualw (mgr.24569) 11467 : cluster [DBG] pgmap v9875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:04.753486+0000 mgr.smithi067.rdualw (mgr.24569) 11467 : cluster [DBG] pgmap v9875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:06.754447+0000 mgr.smithi067.rdualw (mgr.24569) 11468 : cluster [DBG] pgmap v9876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:58:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:06.754447+0000 mgr.smithi067.rdualw (mgr.24569) 11468 : cluster [DBG] pgmap v9876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:58:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:08.754976+0000 mgr.smithi067.rdualw (mgr.24569) 11469 : cluster [DBG] pgmap v9877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:08.754976+0000 mgr.smithi067.rdualw (mgr.24569) 11469 : cluster [DBG] pgmap v9877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:10.755948+0000 mgr.smithi067.rdualw (mgr.24569) 11470 : cluster [DBG] pgmap v9878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:10.755948+0000 mgr.smithi067.rdualw (mgr.24569) 11470 : cluster [DBG] pgmap v9878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:12.756583+0000 mgr.smithi067.rdualw (mgr.24569) 11471 : cluster [DBG] pgmap v9879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:12.756583+0000 mgr.smithi067.rdualw (mgr.24569) 11471 : cluster [DBG] pgmap v9879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:14.757231+0000 mgr.smithi067.rdualw (mgr.24569) 11472 : cluster [DBG] pgmap v9880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:14.757231+0000 mgr.smithi067.rdualw (mgr.24569) 11472 : cluster [DBG] pgmap v9880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:16.758264+0000 mgr.smithi067.rdualw (mgr.24569) 11473 : cluster [DBG] pgmap v9881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:58:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:16.758264+0000 mgr.smithi067.rdualw (mgr.24569) 11473 : cluster [DBG] pgmap v9881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:58:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:18.758854+0000 mgr.smithi067.rdualw (mgr.24569) 11474 : cluster [DBG] pgmap v9882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:18.758854+0000 mgr.smithi067.rdualw (mgr.24569) 11474 : cluster [DBG] pgmap v9882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:21.422 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:58:21.718 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:58:21.719 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 51s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:58:21.719 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 51s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:58:21.719 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 54s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:58:21.719 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 51s ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:58:21.719 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 51s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:58:21.720 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 54s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:58:21.720 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 51s ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:58:21.720 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 54s ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:58:21.720 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 51s ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:58:21.721 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 54s ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:58:21.721 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 51s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:58:21.721 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 54s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:58:21.721 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 51s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:58:21.722 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 54s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:58:21.722 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 51s ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:58:21.722 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 51s ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:58:21.722 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 51s ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:58:21.723 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 51s ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:58:21.723 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 54s ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:58:21.723 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 54s ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:58:21.723 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 54s ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:58:21.724 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 54s ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:58:21.724 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 51s ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:58:22.058 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:58:22.059 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:58:22.059 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:58:22.059 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:58:22.060 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:58:22.060 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:58:22.060 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:58:22.061 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:58:22.061 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:58:22.061 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:58:22.061 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:58:22.062 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:58:22.062 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:58:22.062 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:58:22.063 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:58:22.063 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:58:22.063 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:58:22.063 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:58:22.064 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:58:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:20.759716+0000 mgr.smithi067.rdualw (mgr.24569) 11475 : cluster [DBG] pgmap v9883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:58:22.056951+0000 mon.smithi061 (mon.0) 2400 : audit [DBG] from='client.? 172.21.15.61:0/3968301324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:58:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:20.759716+0000 mgr.smithi067.rdualw (mgr.24569) 11475 : cluster [DBG] pgmap v9883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:58:22.056951+0000 mon.smithi061 (mon.0) 2400 : audit [DBG] from='client.? 172.21.15.61:0/3968301324' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:58:23.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:58:21.408730+0000 mgr.smithi067.rdualw (mgr.24569) 11476 : audit [DBG] from='client.41794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:58:23.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:58:21.700355+0000 mgr.smithi067.rdualw (mgr.24569) 11477 : audit [DBG] from='client.41798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:58:23.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:58:21.408730+0000 mgr.smithi067.rdualw (mgr.24569) 11476 : audit [DBG] from='client.41794 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:58:23.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:58:21.700355+0000 mgr.smithi067.rdualw (mgr.24569) 11477 : audit [DBG] from='client.41798 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:58:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:22.760189+0000 mgr.smithi067.rdualw (mgr.24569) 11478 : cluster [DBG] pgmap v9884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:22.760189+0000 mgr.smithi067.rdualw (mgr.24569) 11478 : cluster [DBG] pgmap v9884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:24.760821+0000 mgr.smithi067.rdualw (mgr.24569) 11479 : cluster [DBG] pgmap v9885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:24.760821+0000 mgr.smithi067.rdualw (mgr.24569) 11479 : cluster [DBG] pgmap v9885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:26.761713+0000 mgr.smithi067.rdualw (mgr.24569) 11480 : cluster [DBG] pgmap v9886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:58:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:26.761713+0000 mgr.smithi067.rdualw (mgr.24569) 11480 : cluster [DBG] pgmap v9886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:58:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:28.762184+0000 mgr.smithi067.rdualw (mgr.24569) 11481 : cluster [DBG] pgmap v9887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:58:30.169064+0000 mon.smithi067 (mon.1) 1734 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:58:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:58:30.170556+0000 mon.smithi067 (mon.1) 1735 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:58:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:58:30.171526+0000 mon.smithi067 (mon.1) 1736 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:58:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:28.762184+0000 mgr.smithi067.rdualw (mgr.24569) 11481 : cluster [DBG] pgmap v9887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:58:30.169064+0000 mon.smithi067 (mon.1) 1734 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:58:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:58:30.170556+0000 mon.smithi067 (mon.1) 1735 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:58:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:58:30.171526+0000 mon.smithi067 (mon.1) 1736 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:58:31.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:58:30.172448+0000 mgr.smithi067.rdualw (mgr.24569) 11482 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:58:31.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:58:30.589634+0000 mon.smithi061 (mon.0) 2401 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:58:31.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:58:30.594953+0000 mon.smithi061 (mon.0) 2402 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:58:31.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:58:30.172448+0000 mgr.smithi067.rdualw (mgr.24569) 11482 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:58:31.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:58:30.589634+0000 mon.smithi061 (mon.0) 2401 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:58:31.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:58:30.594953+0000 mon.smithi061 (mon.0) 2402 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:58:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:30.763092+0000 mgr.smithi067.rdualw (mgr.24569) 11483 : cluster [DBG] pgmap v9888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:30.763092+0000 mgr.smithi067.rdualw (mgr.24569) 11483 : cluster [DBG] pgmap v9888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:32.763767+0000 mgr.smithi067.rdualw (mgr.24569) 11484 : cluster [DBG] pgmap v9889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:32.763767+0000 mgr.smithi067.rdualw (mgr.24569) 11484 : cluster [DBG] pgmap v9889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:34.764324+0000 mgr.smithi067.rdualw (mgr.24569) 11485 : cluster [DBG] pgmap v9890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:58:36.275448+0000 mon.smithi067 (mon.1) 1737 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:58:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:58:36.275808+0000 mon.smithi067 (mon.1) 1738 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:58:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:58:36.276064+0000 mon.smithi061 (mon.0) 2403 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:58:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:58:36.276316+0000 mon.smithi061 (mon.0) 2404 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:58:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:34.764324+0000 mgr.smithi067.rdualw (mgr.24569) 11485 : cluster [DBG] pgmap v9890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:58:36.275448+0000 mon.smithi067 (mon.1) 1737 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:58:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:58:36.275808+0000 mon.smithi067 (mon.1) 1738 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:58:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:58:36.276064+0000 mon.smithi061 (mon.0) 2403 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:58:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:58:36.276316+0000 mon.smithi061 (mon.0) 2404 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:58:38.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:36.765177+0000 mgr.smithi067.rdualw (mgr.24569) 11486 : cluster [DBG] pgmap v9891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:58:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:36.765177+0000 mgr.smithi067.rdualw (mgr.24569) 11486 : cluster [DBG] pgmap v9891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:58:40.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:38.765742+0000 mgr.smithi067.rdualw (mgr.24569) 11487 : cluster [DBG] pgmap v9892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:38.765742+0000 mgr.smithi067.rdualw (mgr.24569) 11487 : cluster [DBG] pgmap v9892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:42.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:40.766784+0000 mgr.smithi067.rdualw (mgr.24569) 11488 : cluster [DBG] pgmap v9893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:40.766784+0000 mgr.smithi067.rdualw (mgr.24569) 11488 : cluster [DBG] pgmap v9893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:44.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:42.767294+0000 mgr.smithi067.rdualw (mgr.24569) 11489 : cluster [DBG] pgmap v9894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:42.767294+0000 mgr.smithi067.rdualw (mgr.24569) 11489 : cluster [DBG] pgmap v9894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:46.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:44.768069+0000 mgr.smithi067.rdualw (mgr.24569) 11490 : cluster [DBG] pgmap v9895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:44.768069+0000 mgr.smithi067.rdualw (mgr.24569) 11490 : cluster [DBG] pgmap v9895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:46.768922+0000 mgr.smithi067.rdualw (mgr.24569) 11491 : cluster [DBG] pgmap v9896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:58:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:46.768922+0000 mgr.smithi067.rdualw (mgr.24569) 11491 : cluster [DBG] pgmap v9896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:58:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:48.769494+0000 mgr.smithi067.rdualw (mgr.24569) 11492 : cluster [DBG] pgmap v9897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:48.769494+0000 mgr.smithi067.rdualw (mgr.24569) 11492 : cluster [DBG] pgmap v9897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:52.368 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:58:52.665 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:58:52.665 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 82s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:58:52.665 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 82s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:58:52.666 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 85s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:58:52.666 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 82s ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:58:52.666 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 82s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:58:52.667 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 85s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:58:52.667 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 82s ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:58:52.667 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 85s ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:58:52.667 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 82s ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:58:52.668 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 85s ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:58:52.668 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 82s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:58:52.668 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 85s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:58:52.668 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 82s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:58:52.668 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 85s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:58:52.669 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 82s ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:58:52.669 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 82s ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:58:52.669 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 82s ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:58:52.669 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 82s ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:58:52.670 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 85s ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:58:52.670 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 85s ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:58:52.670 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 85s ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:58:52.670 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 85s ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:58:52.671 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 82s ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:58:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:50.770279+0000 mgr.smithi067.rdualw (mgr.24569) 11493 : cluster [DBG] pgmap v9898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:50.770279+0000 mgr.smithi067.rdualw (mgr.24569) 11493 : cluster [DBG] pgmap v9898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:53.007 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:58:53.008 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:58:53.008 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:58:53.008 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:58:53.009 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:58:53.009 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:58:53.009 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:58:53.009 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:58:53.010 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:58:53.010 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:58:53.010 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:58:53.010 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:58:53.011 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:58:53.011 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:58:53.011 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:58:53.011 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:58:53.012 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:58:53.012 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:58:53.012 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:58:53.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:58:52.354026+0000 mgr.smithi067.rdualw (mgr.24569) 11494 : audit [DBG] from='client.41806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:58:53.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:58:53.005658+0000 mon.smithi061 (mon.0) 2405 : audit [DBG] from='client.? 172.21.15.61:0/2756406645' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:58:53.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:58:52.354026+0000 mgr.smithi067.rdualw (mgr.24569) 11494 : audit [DBG] from='client.41806 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:58:53.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:58:53.005658+0000 mon.smithi061 (mon.0) 2405 : audit [DBG] from='client.? 172.21.15.61:0/2756406645' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:58:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:58:52.646769+0000 mgr.smithi067.rdualw (mgr.24569) 11495 : audit [DBG] from='client.41810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:58:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:52.770779+0000 mgr.smithi067.rdualw (mgr.24569) 11496 : cluster [DBG] pgmap v9899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:58:52.646769+0000 mgr.smithi067.rdualw (mgr.24569) 11495 : audit [DBG] from='client.41810 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:58:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:52.770779+0000 mgr.smithi067.rdualw (mgr.24569) 11496 : cluster [DBG] pgmap v9899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:54.771519+0000 mgr.smithi067.rdualw (mgr.24569) 11497 : cluster [DBG] pgmap v9900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:54.771519+0000 mgr.smithi067.rdualw (mgr.24569) 11497 : cluster [DBG] pgmap v9900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:58:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:58:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:56.772379+0000 mgr.smithi067.rdualw (mgr.24569) 11498 : cluster [DBG] pgmap v9901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:58:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:58:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:56.772379+0000 mgr.smithi067.rdualw (mgr.24569) 11498 : cluster [DBG] pgmap v9901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:59:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:58:58.773100+0000 mgr.smithi067.rdualw (mgr.24569) 11499 : cluster [DBG] pgmap v9902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:00.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:58:58.773100+0000 mgr.smithi067.rdualw (mgr.24569) 11499 : cluster [DBG] pgmap v9902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:00.773921+0000 mgr.smithi067.rdualw (mgr.24569) 11500 : cluster [DBG] pgmap v9903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:00.773921+0000 mgr.smithi067.rdualw (mgr.24569) 11500 : cluster [DBG] pgmap v9903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:02.774455+0000 mgr.smithi067.rdualw (mgr.24569) 11501 : cluster [DBG] pgmap v9904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:02.774455+0000 mgr.smithi067.rdualw (mgr.24569) 11501 : cluster [DBG] pgmap v9904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:06.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:04.775053+0000 mgr.smithi067.rdualw (mgr.24569) 11502 : cluster [DBG] pgmap v9905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:04.775053+0000 mgr.smithi067.rdualw (mgr.24569) 11502 : cluster [DBG] pgmap v9905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:06.776057+0000 mgr.smithi067.rdualw (mgr.24569) 11503 : cluster [DBG] pgmap v9906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:59:08.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:06.776057+0000 mgr.smithi067.rdualw (mgr.24569) 11503 : cluster [DBG] pgmap v9906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:59:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:08.776642+0000 mgr.smithi067.rdualw (mgr.24569) 11504 : cluster [DBG] pgmap v9907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:08.776642+0000 mgr.smithi067.rdualw (mgr.24569) 11504 : cluster [DBG] pgmap v9907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:10.777496+0000 mgr.smithi067.rdualw (mgr.24569) 11505 : cluster [DBG] pgmap v9908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:12.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:10.777496+0000 mgr.smithi067.rdualw (mgr.24569) 11505 : cluster [DBG] pgmap v9908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:12.778198+0000 mgr.smithi067.rdualw (mgr.24569) 11506 : cluster [DBG] pgmap v9909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:12.778198+0000 mgr.smithi067.rdualw (mgr.24569) 11506 : cluster [DBG] pgmap v9909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:14.779029+0000 mgr.smithi067.rdualw (mgr.24569) 11507 : cluster [DBG] pgmap v9910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:14.779029+0000 mgr.smithi067.rdualw (mgr.24569) 11507 : cluster [DBG] pgmap v9910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:16.779886+0000 mgr.smithi067.rdualw (mgr.24569) 11508 : cluster [DBG] pgmap v9911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:59:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:16.779886+0000 mgr.smithi067.rdualw (mgr.24569) 11508 : cluster [DBG] pgmap v9911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:59:20.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:18.780609+0000 mgr.smithi067.rdualw (mgr.24569) 11509 : cluster [DBG] pgmap v9912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:18.780609+0000 mgr.smithi067.rdualw (mgr.24569) 11509 : cluster [DBG] pgmap v9912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:20.781504+0000 mgr.smithi067.rdualw (mgr.24569) 11510 : cluster [DBG] pgmap v9913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:20.781504+0000 mgr.smithi067.rdualw (mgr.24569) 11510 : cluster [DBG] pgmap v9913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:23.381 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:59:23.731 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:59:23.732 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 114s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:59:23.732 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 114s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:59:23.732 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 116s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:59:23.733 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 114s ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:59:23.733 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 113s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:59:23.733 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 116s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:59:23.733 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 114s ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:59:23.733 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 116s ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:59:23.734 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 114s ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:59:23.734 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 116s ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:59:23.734 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 113s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:59:23.734 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 116s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:59:23.735 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 114s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:59:23.735 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 116s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:59:23.735 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 113s ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:59:23.735 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 113s ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:59:23.735 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 113s ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:59:23.736 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 113s ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:59:23.736 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 116s ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:59:23.736 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 116s ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:59:23.736 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 116s ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:59:23.736 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 116s ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:59:23.737 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 114s ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:59:24.072 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:59:24.073 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:59:24.073 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:59:24.074 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:59:24.074 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:59:24.075 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:59:24.075 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:59:24.076 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:59:24.076 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:59:24.077 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:59:24.078 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:59:24.078 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:59:24.078 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:59:24.078 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:59:24.078 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:59:24.079 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:59:24.079 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:59:24.079 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:59:24.080 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:59:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:22.782088+0000 mgr.smithi067.rdualw (mgr.24569) 11511 : cluster [DBG] pgmap v9914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:59:23.367920+0000 mgr.smithi067.rdualw (mgr.24569) 11512 : audit [DBG] from='client.41818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:59:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:59:24.070849+0000 mon.smithi061 (mon.0) 2406 : audit [DBG] from='client.? 172.21.15.61:0/617746556' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:59:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:22.782088+0000 mgr.smithi067.rdualw (mgr.24569) 11511 : cluster [DBG] pgmap v9914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:59:23.367920+0000 mgr.smithi067.rdualw (mgr.24569) 11512 : audit [DBG] from='client.41818 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:59:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:59:24.070849+0000 mon.smithi061 (mon.0) 2406 : audit [DBG] from='client.? 172.21.15.61:0/617746556' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:59:25.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:59:23.713800+0000 mgr.smithi067.rdualw (mgr.24569) 11513 : audit [DBG] from='client.41822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:59:25.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:59:23.713800+0000 mgr.smithi067.rdualw (mgr.24569) 11513 : audit [DBG] from='client.41822 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:59:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:24.782703+0000 mgr.smithi067.rdualw (mgr.24569) 11514 : cluster [DBG] pgmap v9915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:26.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:24.782703+0000 mgr.smithi067.rdualw (mgr.24569) 11514 : cluster [DBG] pgmap v9915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:26.783483+0000 mgr.smithi067.rdualw (mgr.24569) 11515 : cluster [DBG] pgmap v9916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:59:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:26.783483+0000 mgr.smithi067.rdualw (mgr.24569) 11515 : cluster [DBG] pgmap v9916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:59:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:28.784305+0000 mgr.smithi067.rdualw (mgr.24569) 11516 : cluster [DBG] pgmap v9917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:30.822 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:28.784305+0000 mgr.smithi067.rdualw (mgr.24569) 11516 : cluster [DBG] pgmap v9917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:31.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:59:30.598165+0000 mon.smithi067 (mon.1) 1739 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:59:31.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:59:30.599565+0000 mon.smithi067 (mon.1) 1740 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:59:31.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:59:30.600473+0000 mon.smithi067 (mon.1) 1741 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:59:31.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:59:30.959490+0000 mon.smithi061 (mon.0) 2407 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:59:31.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:59:30.964471+0000 mon.smithi061 (mon.0) 2408 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:59:31.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:59:31.366917+0000 mon.smithi061 (mon.0) 2409 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:59:31.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:59:31.375198+0000 mon.smithi061 (mon.0) 2410 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:59:31.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:59:30.598165+0000 mon.smithi067 (mon.1) 1739 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T20:59:31.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:59:30.599565+0000 mon.smithi067 (mon.1) 1740 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T20:59:31.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:59:30.600473+0000 mon.smithi067 (mon.1) 1741 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T20:59:31.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:59:30.959490+0000 mon.smithi061 (mon.0) 2407 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:59:31.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:59:30.964471+0000 mon.smithi061 (mon.0) 2408 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:59:31.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:59:31.366917+0000 mon.smithi061 (mon.0) 2409 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:59:31.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:59:31.375198+0000 mon.smithi061 (mon.0) 2410 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T20:59:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T20:59:30.601271+0000 mgr.smithi067.rdualw (mgr.24569) 11517 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:59:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:30.785054+0000 mgr.smithi067.rdualw (mgr.24569) 11518 : cluster [DBG] pgmap v9918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T20:59:30.601271+0000 mgr.smithi067.rdualw (mgr.24569) 11517 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T20:59:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:30.785054+0000 mgr.smithi067.rdualw (mgr.24569) 11518 : cluster [DBG] pgmap v9918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:32.785583+0000 mgr.smithi067.rdualw (mgr.24569) 11519 : cluster [DBG] pgmap v9919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:32.785583+0000 mgr.smithi067.rdualw (mgr.24569) 11519 : cluster [DBG] pgmap v9919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:34.786229+0000 mgr.smithi067.rdualw (mgr.24569) 11520 : cluster [DBG] pgmap v9920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:59:36.280814+0000 mon.smithi067 (mon.1) 1742 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:59:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:59:36.281109+0000 mon.smithi067 (mon.1) 1743 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:59:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:59:36.281741+0000 mon.smithi061 (mon.0) 2411 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:59:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:59:36.282068+0000 mon.smithi061 (mon.0) 2412 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:59:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:34.786229+0000 mgr.smithi067.rdualw (mgr.24569) 11520 : cluster [DBG] pgmap v9920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:59:36.280814+0000 mon.smithi067 (mon.1) 1742 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:59:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:59:36.281109+0000 mon.smithi067 (mon.1) 1743 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:59:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:59:36.281741+0000 mon.smithi061 (mon.0) 2411 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T20:59:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:59:36.282068+0000 mon.smithi061 (mon.0) 2412 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T20:59:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:36.787261+0000 mgr.smithi067.rdualw (mgr.24569) 11521 : cluster [DBG] pgmap v9921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:59:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:36.787261+0000 mgr.smithi067.rdualw (mgr.24569) 11521 : cluster [DBG] pgmap v9921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:59:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:38.787775+0000 mgr.smithi067.rdualw (mgr.24569) 11522 : cluster [DBG] pgmap v9922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:38.787775+0000 mgr.smithi067.rdualw (mgr.24569) 11522 : cluster [DBG] pgmap v9922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:40.788645+0000 mgr.smithi067.rdualw (mgr.24569) 11523 : cluster [DBG] pgmap v9923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:40.788645+0000 mgr.smithi067.rdualw (mgr.24569) 11523 : cluster [DBG] pgmap v9923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:43.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:42.789228+0000 mgr.smithi067.rdualw (mgr.24569) 11524 : cluster [DBG] pgmap v9924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:43.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:42.789228+0000 mgr.smithi067.rdualw (mgr.24569) 11524 : cluster [DBG] pgmap v9924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:46.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:44.790041+0000 mgr.smithi067.rdualw (mgr.24569) 11525 : cluster [DBG] pgmap v9925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:46.315 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:44.790041+0000 mgr.smithi067.rdualw (mgr.24569) 11525 : cluster [DBG] pgmap v9925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:46.791080+0000 mgr.smithi067.rdualw (mgr.24569) 11526 : cluster [DBG] pgmap v9926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:59:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:46.791080+0000 mgr.smithi067.rdualw (mgr.24569) 11526 : cluster [DBG] pgmap v9926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:59:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:48.791816+0000 mgr.smithi067.rdualw (mgr.24569) 11527 : cluster [DBG] pgmap v9927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:48.791816+0000 mgr.smithi067.rdualw (mgr.24569) 11527 : cluster [DBG] pgmap v9927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:50.792698+0000 mgr.smithi067.rdualw (mgr.24569) 11528 : cluster [DBG] pgmap v9928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:50.792698+0000 mgr.smithi067.rdualw (mgr.24569) 11528 : cluster [DBG] pgmap v9928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:54.380 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T20:59:54.672 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T20:59:54.673 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 2m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T20:59:54.673 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 2m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T20:59:54.673 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 2m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T20:59:54.673 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 2m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T20:59:54.674 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 2m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T20:59:54.674 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 2m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T20:59:54.675 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 2m ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T20:59:54.675 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 2m ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T20:59:54.675 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 2m ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T20:59:54.676 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 2m ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T20:59:54.676 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 2m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T20:59:54.676 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 2m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T20:59:54.677 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 2m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T20:59:54.677 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 2m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T20:59:54.677 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 2m ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T20:59:54.677 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 2m ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T20:59:54.678 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 2m ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T20:59:54.678 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 2m ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T20:59:54.678 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 2m ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T20:59:54.678 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 2m ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T20:59:54.679 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 2m ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T20:59:54.679 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 2m ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T20:59:54.679 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 2m ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T20:59:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:52.793431+0000 mgr.smithi067.rdualw (mgr.24569) 11529 : cluster [DBG] pgmap v9929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:52.793431+0000 mgr.smithi067.rdualw (mgr.24569) 11529 : cluster [DBG] pgmap v9929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:55.021 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T20:59:55.021 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T20:59:55.021 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T20:59:55.022 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:59:55.022 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T20:59:55.022 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:59:55.023 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:59:55.023 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T20:59:55.023 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T20:59:55.023 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T20:59:55.024 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:59:55.024 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T20:59:55.024 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T20:59:55.024 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T20:59:55.024 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T20:59:55.025 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T20:59:55.025 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T20:59:55.025 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T20:59:55.025 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T20:59:55.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:59:54.365838+0000 mgr.smithi067.rdualw (mgr.24569) 11530 : audit [DBG] from='client.41830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:59:55.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:59:55.019612+0000 mon.smithi061 (mon.0) 2413 : audit [DBG] from='client.? 172.21.15.61:0/1265477898' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:59:55.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:59:54.365838+0000 mgr.smithi067.rdualw (mgr.24569) 11530 : audit [DBG] from='client.41830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:59:55.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:59:55.019612+0000 mon.smithi061 (mon.0) 2413 : audit [DBG] from='client.? 172.21.15.61:0/1265477898' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T20:59:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T20:59:54.654759+0000 mgr.smithi067.rdualw (mgr.24569) 11531 : audit [DBG] from='client.41834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:59:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:54.794039+0000 mgr.smithi067.rdualw (mgr.24569) 11532 : cluster [DBG] pgmap v9930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T20:59:54.654759+0000 mgr.smithi067.rdualw (mgr.24569) 11531 : audit [DBG] from='client.41834 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T20:59:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:54.794039+0000 mgr.smithi067.rdualw (mgr.24569) 11532 : cluster [DBG] pgmap v9930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T20:59:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 20:59:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:56.794892+0000 mgr.smithi067.rdualw (mgr.24569) 11533 : cluster [DBG] pgmap v9931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T20:59:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 20:59:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:56.794892+0000 mgr.smithi067.rdualw (mgr.24569) 11533 : cluster [DBG] pgmap v9931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:00:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T20:59:58.795514+0000 mgr.smithi067.rdualw (mgr.24569) 11534 : cluster [DBG] pgmap v9932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:00.000103+0000 mon.smithi061 (mon.0) 2414 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T21:00:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T20:59:58.795514+0000 mgr.smithi067.rdualw (mgr.24569) 11534 : cluster [DBG] pgmap v9932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:00.000103+0000 mon.smithi061 (mon.0) 2414 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T21:00:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:00.796351+0000 mgr.smithi067.rdualw (mgr.24569) 11535 : cluster [DBG] pgmap v9933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:00.796351+0000 mgr.smithi067.rdualw (mgr.24569) 11535 : cluster [DBG] pgmap v9933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:02.796890+0000 mgr.smithi067.rdualw (mgr.24569) 11536 : cluster [DBG] pgmap v9934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:02.796890+0000 mgr.smithi067.rdualw (mgr.24569) 11536 : cluster [DBG] pgmap v9934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:04.797602+0000 mgr.smithi067.rdualw (mgr.24569) 11537 : cluster [DBG] pgmap v9935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:04.797602+0000 mgr.smithi067.rdualw (mgr.24569) 11537 : cluster [DBG] pgmap v9935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:08.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:06.798565+0000 mgr.smithi067.rdualw (mgr.24569) 11538 : cluster [DBG] pgmap v9936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:00:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:06.798565+0000 mgr.smithi067.rdualw (mgr.24569) 11538 : cluster [DBG] pgmap v9936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:00:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:08.799168+0000 mgr.smithi067.rdualw (mgr.24569) 11539 : cluster [DBG] pgmap v9937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:08.799168+0000 mgr.smithi067.rdualw (mgr.24569) 11539 : cluster [DBG] pgmap v9937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:10.800270+0000 mgr.smithi067.rdualw (mgr.24569) 11540 : cluster [DBG] pgmap v9938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:10.800270+0000 mgr.smithi067.rdualw (mgr.24569) 11540 : cluster [DBG] pgmap v9938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:12.800921+0000 mgr.smithi067.rdualw (mgr.24569) 11541 : cluster [DBG] pgmap v9939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:12.800921+0000 mgr.smithi067.rdualw (mgr.24569) 11541 : cluster [DBG] pgmap v9939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:14.801672+0000 mgr.smithi067.rdualw (mgr.24569) 11542 : cluster [DBG] pgmap v9940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:14.801672+0000 mgr.smithi067.rdualw (mgr.24569) 11542 : cluster [DBG] pgmap v9940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:16.802615+0000 mgr.smithi067.rdualw (mgr.24569) 11543 : cluster [DBG] pgmap v9941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:00:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:16.802615+0000 mgr.smithi067.rdualw (mgr.24569) 11543 : cluster [DBG] pgmap v9941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:00:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:18.803153+0000 mgr.smithi067.rdualw (mgr.24569) 11544 : cluster [DBG] pgmap v9942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:18.803153+0000 mgr.smithi067.rdualw (mgr.24569) 11544 : cluster [DBG] pgmap v9942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:20.804192+0000 mgr.smithi067.rdualw (mgr.24569) 11545 : cluster [DBG] pgmap v9943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:20.804192+0000 mgr.smithi067.rdualw (mgr.24569) 11545 : cluster [DBG] pgmap v9943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:22.804817+0000 mgr.smithi067.rdualw (mgr.24569) 11546 : cluster [DBG] pgmap v9944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:22.804817+0000 mgr.smithi067.rdualw (mgr.24569) 11546 : cluster [DBG] pgmap v9944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:25.333 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:00:25.623 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:00:25.623 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 2m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:00:25.624 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 2m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:00:25.624 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 2m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:00:25.624 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 2m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:00:25.624 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 2m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:00:25.625 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 2m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:00:25.625 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 2m ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:00:25.625 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 2m ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:00:25.625 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 2m ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:00:25.626 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 2m ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:00:25.626 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 2m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:00:25.626 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 2m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:00:25.626 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 2m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:00:25.626 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 2m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:00:25.627 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 2m ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:00:25.627 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 2m ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:00:25.627 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 2m ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:00:25.627 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 2m ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:00:25.628 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 2m ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:00:25.628 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 2m ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:00:25.628 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 2m ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:00:25.628 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 2m ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:00:25.628 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 2m ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:00:25.964 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:00:25.964 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:00:25.964 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:00:25.965 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:00:25.965 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:00:25.965 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:00:25.965 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:00:25.966 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:00:25.966 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:00:25.966 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:00:25.966 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:00:25.967 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:00:25.967 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:00:25.967 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:00:25.967 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:00:25.967 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:00:25.968 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:00:25.968 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:00:25.968 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:00:26.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:24.805654+0000 mgr.smithi067.rdualw (mgr.24569) 11547 : cluster [DBG] pgmap v9945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:00:25.316500+0000 mgr.smithi067.rdualw (mgr.24569) 11548 : audit [DBG] from='client.41842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:00:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:00:25.962376+0000 mon.smithi061 (mon.0) 2415 : audit [DBG] from='client.? 172.21.15.61:0/714302407' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:00:26.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:24.805654+0000 mgr.smithi067.rdualw (mgr.24569) 11547 : cluster [DBG] pgmap v9945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:26.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:00:25.316500+0000 mgr.smithi067.rdualw (mgr.24569) 11548 : audit [DBG] from='client.41842 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:00:26.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:00:25.962376+0000 mon.smithi061 (mon.0) 2415 : audit [DBG] from='client.? 172.21.15.61:0/714302407' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:00:27.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:00:25.605203+0000 mgr.smithi067.rdualw (mgr.24569) 11549 : audit [DBG] from='client.41846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:00:27.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:00:25.605203+0000 mgr.smithi067.rdualw (mgr.24569) 11549 : audit [DBG] from='client.41846 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:00:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:26.806669+0000 mgr.smithi067.rdualw (mgr.24569) 11550 : cluster [DBG] pgmap v9946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:00:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:26.806669+0000 mgr.smithi067.rdualw (mgr.24569) 11550 : cluster [DBG] pgmap v9946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:00:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:28.807329+0000 mgr.smithi067.rdualw (mgr.24569) 11551 : cluster [DBG] pgmap v9947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:30.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:28.807329+0000 mgr.smithi067.rdualw (mgr.24569) 11551 : cluster [DBG] pgmap v9947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:31.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:00:31.380333+0000 mon.smithi067 (mon.1) 1744 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:00:31.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:00:31.381945+0000 mon.smithi067 (mon.1) 1745 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:00:31.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:00:31.383010+0000 mon.smithi067 (mon.1) 1746 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:00:31.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:00:31.380333+0000 mon.smithi067 (mon.1) 1744 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:00:31.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:00:31.381945+0000 mon.smithi067 (mon.1) 1745 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:00:31.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:00:31.383010+0000 mon.smithi067 (mon.1) 1746 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:00:32.687 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:30.808165+0000 mgr.smithi067.rdualw (mgr.24569) 11552 : cluster [DBG] pgmap v9948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:32.687 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:00:31.383899+0000 mgr.smithi067.rdualw (mgr.24569) 11553 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:00:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:30.808165+0000 mgr.smithi067.rdualw (mgr.24569) 11552 : cluster [DBG] pgmap v9948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:00:31.383899+0000 mgr.smithi067.rdualw (mgr.24569) 11553 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:00:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:32.808624+0000 mgr.smithi067.rdualw (mgr.24569) 11554 : cluster [DBG] pgmap v9949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:32.808624+0000 mgr.smithi067.rdualw (mgr.24569) 11554 : cluster [DBG] pgmap v9949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:00:34.798047+0000 mon.smithi061 (mon.0) 2416 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:00:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:34.809187+0000 mgr.smithi067.rdualw (mgr.24569) 11555 : cluster [DBG] pgmap v9950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:00:35.207937+0000 mon.smithi061 (mon.0) 2417 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:00:36.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:00:35.215764+0000 mon.smithi061 (mon.0) 2418 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:00:36.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:00:34.798047+0000 mon.smithi061 (mon.0) 2416 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:00:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:34.809187+0000 mgr.smithi067.rdualw (mgr.24569) 11555 : cluster [DBG] pgmap v9950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:00:35.207937+0000 mon.smithi061 (mon.0) 2417 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:00:36.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:00:35.215764+0000 mon.smithi061 (mon.0) 2418 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:00:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:00:36.287542+0000 mon.smithi067 (mon.1) 1747 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:00:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:00:36.287919+0000 mon.smithi067 (mon.1) 1748 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:00:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:00:36.288221+0000 mon.smithi061 (mon.0) 2419 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:00:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:00:36.288518+0000 mon.smithi061 (mon.0) 2420 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:00:37.301 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:00:36.287542+0000 mon.smithi067 (mon.1) 1747 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:00:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:00:36.287919+0000 mon.smithi067 (mon.1) 1748 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:00:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:00:36.288221+0000 mon.smithi061 (mon.0) 2419 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:00:37.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:00:36.288518+0000 mon.smithi061 (mon.0) 2420 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:00:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:36.810199+0000 mgr.smithi067.rdualw (mgr.24569) 11556 : cluster [DBG] pgmap v9951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:00:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:36.810199+0000 mgr.smithi067.rdualw (mgr.24569) 11556 : cluster [DBG] pgmap v9951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:00:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:38.810978+0000 mgr.smithi067.rdualw (mgr.24569) 11557 : cluster [DBG] pgmap v9952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:38.810978+0000 mgr.smithi067.rdualw (mgr.24569) 11557 : cluster [DBG] pgmap v9952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:42.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:40.811939+0000 mgr.smithi067.rdualw (mgr.24569) 11558 : cluster [DBG] pgmap v9953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:40.811939+0000 mgr.smithi067.rdualw (mgr.24569) 11558 : cluster [DBG] pgmap v9953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:42.812459+0000 mgr.smithi067.rdualw (mgr.24569) 11559 : cluster [DBG] pgmap v9954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:42.812459+0000 mgr.smithi067.rdualw (mgr.24569) 11559 : cluster [DBG] pgmap v9954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:44.813197+0000 mgr.smithi067.rdualw (mgr.24569) 11560 : cluster [DBG] pgmap v9955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:44.813197+0000 mgr.smithi067.rdualw (mgr.24569) 11560 : cluster [DBG] pgmap v9955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:46.814267+0000 mgr.smithi067.rdualw (mgr.24569) 11561 : cluster [DBG] pgmap v9956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:00:48.821 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:46.814267+0000 mgr.smithi067.rdualw (mgr.24569) 11561 : cluster [DBG] pgmap v9956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:00:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:48.815124+0000 mgr.smithi067.rdualw (mgr.24569) 11562 : cluster [DBG] pgmap v9957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:50.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:48.815124+0000 mgr.smithi067.rdualw (mgr.24569) 11562 : cluster [DBG] pgmap v9957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:50.816036+0000 mgr.smithi067.rdualw (mgr.24569) 11563 : cluster [DBG] pgmap v9958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:50.816036+0000 mgr.smithi067.rdualw (mgr.24569) 11563 : cluster [DBG] pgmap v9958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:52.816649+0000 mgr.smithi067.rdualw (mgr.24569) 11564 : cluster [DBG] pgmap v9959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:52.816649+0000 mgr.smithi067.rdualw (mgr.24569) 11564 : cluster [DBG] pgmap v9959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:56.278 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:00:56.609 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:00:56.610 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 3m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:00:56.610 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 3m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:00:56.610 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 3m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:00:56.610 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 3m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:00:56.611 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 3m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:00:56.611 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 3m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:00:56.611 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 3m ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:00:56.611 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 3m ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:00:56.612 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 3m ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:00:56.612 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 3m ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:00:56.612 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 3m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:00:56.612 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 3m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:00:56.612 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 3m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:00:56.613 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 3m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:00:56.613 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 3m ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:00:56.613 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 3m ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:00:56.613 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 3m ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:00:56.613 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 3m ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:00:56.614 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 3m ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:00:56.614 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 3m ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:00:56.614 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 3m ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:00:56.614 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 3m ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:00:56.615 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 3m ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:00:56.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:54.817300+0000 mgr.smithi067.rdualw (mgr.24569) 11565 : cluster [DBG] pgmap v9960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:54.817300+0000 mgr.smithi067.rdualw (mgr.24569) 11565 : cluster [DBG] pgmap v9960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:00:56.951 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:00:56.951 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:00:56.951 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:00:56.951 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:00:56.952 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:00:56.952 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:00:56.952 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:00:56.952 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:00:56.953 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:00:56.953 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:00:56.953 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:00:56.953 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:00:56.953 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:00:56.954 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:00:56.954 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:00:56.954 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:00:56.954 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:00:56.955 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:00:56.955 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:00:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:00:56.260320+0000 mgr.smithi067.rdualw (mgr.24569) 11566 : audit [DBG] from='client.41854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:00:57.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:00:56.949347+0000 mon.smithi061 (mon.0) 2421 : audit [DBG] from='client.? 172.21.15.61:0/746516697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:00:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:00:56.260320+0000 mgr.smithi067.rdualw (mgr.24569) 11566 : audit [DBG] from='client.41854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:00:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:00:56.949347+0000 mon.smithi061 (mon.0) 2421 : audit [DBG] from='client.? 172.21.15.61:0/746516697' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:00:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:00:56.591837+0000 mgr.smithi067.rdualw (mgr.24569) 11567 : audit [DBG] from='client.41858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:00:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:00:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:56.818266+0000 mgr.smithi067.rdualw (mgr.24569) 11568 : cluster [DBG] pgmap v9961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:00:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:00:56.591837+0000 mgr.smithi067.rdualw (mgr.24569) 11567 : audit [DBG] from='client.41858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:00:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:00:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:56.818266+0000 mgr.smithi067.rdualw (mgr.24569) 11568 : cluster [DBG] pgmap v9961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:01:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:00:58.818869+0000 mgr.smithi067.rdualw (mgr.24569) 11569 : cluster [DBG] pgmap v9962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:00:58.818869+0000 mgr.smithi067.rdualw (mgr.24569) 11569 : cluster [DBG] pgmap v9962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:00.819789+0000 mgr.smithi067.rdualw (mgr.24569) 11570 : cluster [DBG] pgmap v9963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:00.819789+0000 mgr.smithi067.rdualw (mgr.24569) 11570 : cluster [DBG] pgmap v9963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:02.820340+0000 mgr.smithi067.rdualw (mgr.24569) 11571 : cluster [DBG] pgmap v9964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:02.820340+0000 mgr.smithi067.rdualw (mgr.24569) 11571 : cluster [DBG] pgmap v9964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:06.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:04.820924+0000 mgr.smithi067.rdualw (mgr.24569) 11572 : cluster [DBG] pgmap v9965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:04.820924+0000 mgr.smithi067.rdualw (mgr.24569) 11572 : cluster [DBG] pgmap v9965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:08.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:06.821890+0000 mgr.smithi067.rdualw (mgr.24569) 11573 : cluster [DBG] pgmap v9966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:01:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:06.821890+0000 mgr.smithi067.rdualw (mgr.24569) 11573 : cluster [DBG] pgmap v9966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:01:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:08.822431+0000 mgr.smithi067.rdualw (mgr.24569) 11574 : cluster [DBG] pgmap v9967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:08.822431+0000 mgr.smithi067.rdualw (mgr.24569) 11574 : cluster [DBG] pgmap v9967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:10.823432+0000 mgr.smithi067.rdualw (mgr.24569) 11575 : cluster [DBG] pgmap v9968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:10.823432+0000 mgr.smithi067.rdualw (mgr.24569) 11575 : cluster [DBG] pgmap v9968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:12.824031+0000 mgr.smithi067.rdualw (mgr.24569) 11576 : cluster [DBG] pgmap v9969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:12.824031+0000 mgr.smithi067.rdualw (mgr.24569) 11576 : cluster [DBG] pgmap v9969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:14.824738+0000 mgr.smithi067.rdualw (mgr.24569) 11577 : cluster [DBG] pgmap v9970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:14.824738+0000 mgr.smithi067.rdualw (mgr.24569) 11577 : cluster [DBG] pgmap v9970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:18.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:16.825745+0000 mgr.smithi067.rdualw (mgr.24569) 11578 : cluster [DBG] pgmap v9971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:01:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:16.825745+0000 mgr.smithi067.rdualw (mgr.24569) 11578 : cluster [DBG] pgmap v9971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:01:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:18.826249+0000 mgr.smithi067.rdualw (mgr.24569) 11579 : cluster [DBG] pgmap v9972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:18.826249+0000 mgr.smithi067.rdualw (mgr.24569) 11579 : cluster [DBG] pgmap v9972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:20.827044+0000 mgr.smithi067.rdualw (mgr.24569) 11580 : cluster [DBG] pgmap v9973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:20.827044+0000 mgr.smithi067.rdualw (mgr.24569) 11580 : cluster [DBG] pgmap v9973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:22.827603+0000 mgr.smithi067.rdualw (mgr.24569) 11581 : cluster [DBG] pgmap v9974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:22.827603+0000 mgr.smithi067.rdualw (mgr.24569) 11581 : cluster [DBG] pgmap v9974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:24.828201+0000 mgr.smithi067.rdualw (mgr.24569) 11582 : cluster [DBG] pgmap v9975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:24.828201+0000 mgr.smithi067.rdualw (mgr.24569) 11582 : cluster [DBG] pgmap v9975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:27.264 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:01:27.556 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:01:27.556 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 3m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:01:27.557 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 3m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:01:27.557 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 4m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:01:27.557 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 3m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:01:27.557 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 3m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:01:27.558 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 4m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:01:27.558 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 3m ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:01:27.558 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 4m ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:01:27.558 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 3m ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:01:27.559 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 4m ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:01:27.559 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 3m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:01:27.559 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 4m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:01:27.559 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 3m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:01:27.559 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 4m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:01:27.560 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 3m ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:01:27.560 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 3m ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:01:27.560 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 3m ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:01:27.560 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 3m ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:01:27.561 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 4m ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:01:27.561 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 4m ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:01:27.562 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 4m ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:01:27.562 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 4m ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:01:27.562 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 3m ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:01:27.917 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:01:27.917 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:01:27.918 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:01:27.918 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:01:27.918 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:01:27.918 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:01:27.919 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:01:27.919 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:01:27.919 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:01:27.919 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:01:27.919 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:01:27.920 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:01:27.920 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:01:27.920 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:01:27.920 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:01:27.921 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:01:27.921 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:01:27.921 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:01:27.921 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:01:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:26.829135+0000 mgr.smithi067.rdualw (mgr.24569) 11583 : cluster [DBG] pgmap v9976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:01:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:01:27.249919+0000 mgr.smithi067.rdualw (mgr.24569) 11584 : audit [DBG] from='client.41866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:01:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:01:27.915760+0000 mon.smithi061 (mon.0) 2422 : audit [DBG] from='client.? 172.21.15.61:0/3736022375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:01:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:26.829135+0000 mgr.smithi067.rdualw (mgr.24569) 11583 : cluster [DBG] pgmap v9976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:01:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:01:27.249919+0000 mgr.smithi067.rdualw (mgr.24569) 11584 : audit [DBG] from='client.41866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:01:28.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:01:27.915760+0000 mon.smithi061 (mon.0) 2422 : audit [DBG] from='client.? 172.21.15.61:0/3736022375' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:01:29.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:01:27.538099+0000 mgr.smithi067.rdualw (mgr.24569) 11585 : audit [DBG] from='client.41870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:01:29.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:01:27.538099+0000 mgr.smithi067.rdualw (mgr.24569) 11585 : audit [DBG] from='client.41870 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:01:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:28.829672+0000 mgr.smithi067.rdualw (mgr.24569) 11586 : cluster [DBG] pgmap v9977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:28.829672+0000 mgr.smithi067.rdualw (mgr.24569) 11586 : cluster [DBG] pgmap v9977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:30.830692+0000 mgr.smithi067.rdualw (mgr.24569) 11587 : cluster [DBG] pgmap v9978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:30.830692+0000 mgr.smithi067.rdualw (mgr.24569) 11587 : cluster [DBG] pgmap v9978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:32.831296+0000 mgr.smithi067.rdualw (mgr.24569) 11588 : cluster [DBG] pgmap v9979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:34.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:32.831296+0000 mgr.smithi067.rdualw (mgr.24569) 11588 : cluster [DBG] pgmap v9979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:01:35.220510+0000 mon.smithi067 (mon.1) 1749 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:01:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:01:35.221940+0000 mon.smithi067 (mon.1) 1750 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:01:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:01:35.222839+0000 mon.smithi067 (mon.1) 1751 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:01:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:01:35.220510+0000 mon.smithi067 (mon.1) 1749 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:01:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:01:35.221940+0000 mon.smithi067 (mon.1) 1750 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:01:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:01:35.222839+0000 mon.smithi067 (mon.1) 1751 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:01:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:34.832077+0000 mgr.smithi067.rdualw (mgr.24569) 11589 : cluster [DBG] pgmap v9980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:01:35.223651+0000 mgr.smithi067.rdualw (mgr.24569) 11590 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:01:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:01:36.291546+0000 mon.smithi067 (mon.1) 1752 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:01:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:01:36.291853+0000 mon.smithi067 (mon.1) 1753 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:01:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:01:36.292166+0000 mon.smithi061 (mon.0) 2423 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:01:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:01:36.292666+0000 mon.smithi061 (mon.0) 2424 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:01:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:34.832077+0000 mgr.smithi067.rdualw (mgr.24569) 11589 : cluster [DBG] pgmap v9980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:01:35.223651+0000 mgr.smithi067.rdualw (mgr.24569) 11590 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:01:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:01:36.291546+0000 mon.smithi067 (mon.1) 1752 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:01:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:01:36.291853+0000 mon.smithi067 (mon.1) 1753 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:01:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:01:36.292166+0000 mon.smithi061 (mon.0) 2423 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:01:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:01:36.292666+0000 mon.smithi061 (mon.0) 2424 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:01:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:36.832843+0000 mgr.smithi067.rdualw (mgr.24569) 11591 : cluster [DBG] pgmap v9981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:01:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:01:38.233796+0000 mon.smithi061 (mon.0) 2425 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:01:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:36.832843+0000 mgr.smithi067.rdualw (mgr.24569) 11591 : cluster [DBG] pgmap v9981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:01:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:01:38.233796+0000 mon.smithi061 (mon.0) 2425 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:01:39.970 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:01:38.625644+0000 mon.smithi061 (mon.0) 2426 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:01:39.970 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:01:38.633617+0000 mon.smithi061 (mon.0) 2427 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:01:39.971 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:38.833522+0000 mgr.smithi067.rdualw (mgr.24569) 11592 : cluster [DBG] pgmap v9982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:01:38.625644+0000 mon.smithi061 (mon.0) 2426 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:01:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:01:38.633617+0000 mon.smithi061 (mon.0) 2427 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:01:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:38.833522+0000 mgr.smithi067.rdualw (mgr.24569) 11592 : cluster [DBG] pgmap v9982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:42.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:40.834341+0000 mgr.smithi067.rdualw (mgr.24569) 11593 : cluster [DBG] pgmap v9983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:42.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:40.834341+0000 mgr.smithi067.rdualw (mgr.24569) 11593 : cluster [DBG] pgmap v9983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:42.835056+0000 mgr.smithi067.rdualw (mgr.24569) 11594 : cluster [DBG] pgmap v9984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:42.835056+0000 mgr.smithi067.rdualw (mgr.24569) 11594 : cluster [DBG] pgmap v9984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:44.835813+0000 mgr.smithi067.rdualw (mgr.24569) 11595 : cluster [DBG] pgmap v9985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:44.835813+0000 mgr.smithi067.rdualw (mgr.24569) 11595 : cluster [DBG] pgmap v9985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:46.836645+0000 mgr.smithi067.rdualw (mgr.24569) 11596 : cluster [DBG] pgmap v9986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:01:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:46.836645+0000 mgr.smithi067.rdualw (mgr.24569) 11596 : cluster [DBG] pgmap v9986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:01:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:48.837399+0000 mgr.smithi067.rdualw (mgr.24569) 11597 : cluster [DBG] pgmap v9987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:48.837399+0000 mgr.smithi067.rdualw (mgr.24569) 11597 : cluster [DBG] pgmap v9987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:50.838243+0000 mgr.smithi067.rdualw (mgr.24569) 11598 : cluster [DBG] pgmap v9988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:50.838243+0000 mgr.smithi067.rdualw (mgr.24569) 11598 : cluster [DBG] pgmap v9988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:52.838922+0000 mgr.smithi067.rdualw (mgr.24569) 11599 : cluster [DBG] pgmap v9989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:52.838922+0000 mgr.smithi067.rdualw (mgr.24569) 11599 : cluster [DBG] pgmap v9989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:54.839646+0000 mgr.smithi067.rdualw (mgr.24569) 11600 : cluster [DBG] pgmap v9990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:54.839646+0000 mgr.smithi067.rdualw (mgr.24569) 11600 : cluster [DBG] pgmap v9990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:01:58.309 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:01:58.663 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:01:58.664 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 4m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:01:58.664 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 4m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:01:58.664 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 4m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:01:58.664 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 4m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:01:58.665 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 4m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:01:58.665 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 4m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:01:58.665 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 4m ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:01:58.665 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 4m ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:01:58.665 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 4m ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:01:58.666 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 4m ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:01:58.666 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 4m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:01:58.666 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 4m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:01:58.666 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 4m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:01:58.667 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 4m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:01:58.667 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 4m ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:01:58.667 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 4m ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:01:58.667 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 4m ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:01:58.668 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 4m ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:01:58.668 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 4m ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:01:58.668 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 4m ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:01:58.668 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 4m ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:01:58.668 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 4m ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:01:58.669 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 4m ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:01:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:56.840628+0000 mgr.smithi067.rdualw (mgr.24569) 11601 : cluster [DBG] pgmap v9991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:01:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:56.840628+0000 mgr.smithi067.rdualw (mgr.24569) 11601 : cluster [DBG] pgmap v9991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:01:58.969 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:01:58.970 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:01:58.970 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:01:58.970 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:01:58.970 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:01:58.971 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:01:58.971 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:01:58.971 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:01:58.971 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:01:58.972 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:01:58.972 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:01:58.972 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:01:58.972 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:01:58.973 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:01:58.973 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:01:58.973 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:01:58.973 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:01:58.974 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:01:58.974 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:01:59.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:01:58.294422+0000 mgr.smithi067.rdualw (mgr.24569) 11602 : audit [DBG] from='client.41878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:01:59.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:01:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:01:58.967944+0000 mon.smithi061 (mon.0) 2428 : audit [DBG] from='client.? 172.21.15.61:0/230600278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:01:59.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:01:58.294422+0000 mgr.smithi067.rdualw (mgr.24569) 11602 : audit [DBG] from='client.41878 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:01:59.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:01:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:01:58.967944+0000 mon.smithi061 (mon.0) 2428 : audit [DBG] from='client.? 172.21.15.61:0/230600278' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:02:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:01:58.609721+0000 mgr.smithi067.rdualw (mgr.24569) 11603 : audit [DBG] from='client.41882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:02:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:01:58.841148+0000 mgr.smithi067.rdualw (mgr.24569) 11604 : cluster [DBG] pgmap v9992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:01:58.609721+0000 mgr.smithi067.rdualw (mgr.24569) 11603 : audit [DBG] from='client.41882 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:02:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:01:58.841148+0000 mgr.smithi067.rdualw (mgr.24569) 11604 : cluster [DBG] pgmap v9992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:00.842116+0000 mgr.smithi067.rdualw (mgr.24569) 11605 : cluster [DBG] pgmap v9993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:00.842116+0000 mgr.smithi067.rdualw (mgr.24569) 11605 : cluster [DBG] pgmap v9993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:02.842726+0000 mgr.smithi067.rdualw (mgr.24569) 11606 : cluster [DBG] pgmap v9994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:02.842726+0000 mgr.smithi067.rdualw (mgr.24569) 11606 : cluster [DBG] pgmap v9994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:04.843285+0000 mgr.smithi067.rdualw (mgr.24569) 11607 : cluster [DBG] pgmap v9995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:04.843285+0000 mgr.smithi067.rdualw (mgr.24569) 11607 : cluster [DBG] pgmap v9995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:06.844106+0000 mgr.smithi067.rdualw (mgr.24569) 11608 : cluster [DBG] pgmap v9996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:02:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:06.844106+0000 mgr.smithi067.rdualw (mgr.24569) 11608 : cluster [DBG] pgmap v9996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:02:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:08.844831+0000 mgr.smithi067.rdualw (mgr.24569) 11609 : cluster [DBG] pgmap v9997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:08.844831+0000 mgr.smithi067.rdualw (mgr.24569) 11609 : cluster [DBG] pgmap v9997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:10.845797+0000 mgr.smithi067.rdualw (mgr.24569) 11610 : cluster [DBG] pgmap v9998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:10.845797+0000 mgr.smithi067.rdualw (mgr.24569) 11610 : cluster [DBG] pgmap v9998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:12.846582+0000 mgr.smithi067.rdualw (mgr.24569) 11611 : cluster [DBG] pgmap v9999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:12.846582+0000 mgr.smithi067.rdualw (mgr.24569) 11611 : cluster [DBG] pgmap v9999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:14.847170+0000 mgr.smithi067.rdualw (mgr.24569) 11612 : cluster [DBG] pgmap v10000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:14.847170+0000 mgr.smithi067.rdualw (mgr.24569) 11612 : cluster [DBG] pgmap v10000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:16.848000+0000 mgr.smithi067.rdualw (mgr.24569) 11613 : cluster [DBG] pgmap v10001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:02:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:16.848000+0000 mgr.smithi067.rdualw (mgr.24569) 11613 : cluster [DBG] pgmap v10001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:02:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:18.848766+0000 mgr.smithi067.rdualw (mgr.24569) 11614 : cluster [DBG] pgmap v10002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:18.848766+0000 mgr.smithi067.rdualw (mgr.24569) 11614 : cluster [DBG] pgmap v10002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:20.849525+0000 mgr.smithi067.rdualw (mgr.24569) 11615 : cluster [DBG] pgmap v10003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:20.849525+0000 mgr.smithi067.rdualw (mgr.24569) 11615 : cluster [DBG] pgmap v10003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:22.850032+0000 mgr.smithi067.rdualw (mgr.24569) 11616 : cluster [DBG] pgmap v10004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:22.850032+0000 mgr.smithi067.rdualw (mgr.24569) 11616 : cluster [DBG] pgmap v10004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:24.850717+0000 mgr.smithi067.rdualw (mgr.24569) 11617 : cluster [DBG] pgmap v10005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:26.851 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:24.850717+0000 mgr.smithi067.rdualw (mgr.24569) 11617 : cluster [DBG] pgmap v10005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:26.851690+0000 mgr.smithi067.rdualw (mgr.24569) 11618 : cluster [DBG] pgmap v10006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:02:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:26.851690+0000 mgr.smithi067.rdualw (mgr.24569) 11618 : cluster [DBG] pgmap v10006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:02:29.276 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:02:29.603 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:02:29.603 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 4m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:02:29.603 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 4m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:02:29.604 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 5m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:02:29.604 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 4m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:02:29.604 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 4m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:02:29.604 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 5m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:02:29.605 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 4m ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:02:29.605 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 5m ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:02:29.605 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 4m ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:02:29.605 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 5m ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:02:29.606 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 4m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:02:29.606 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 5m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:02:29.606 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 4m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:02:29.606 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 5m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:02:29.606 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 4m ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:02:29.607 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 4m ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:02:29.607 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 4m ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:02:29.607 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 4m ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:02:29.607 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 5m ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:02:29.608 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 5m ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:02:29.608 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 5m ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:02:29.608 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 5m ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:02:29.608 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 4m ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:02:29.951 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:02:29.951 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:02:29.952 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:02:29.952 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:02:29.952 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:02:29.952 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:02:29.953 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:02:29.953 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:02:29.954 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:02:29.954 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:02:29.954 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:02:29.954 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:02:29.955 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:02:29.955 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:02:29.955 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:02:29.955 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:02:29.955 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:02:29.956 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:02:29.956 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:02:30.806 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:28.852398+0000 mgr.smithi067.rdualw (mgr.24569) 11619 : cluster [DBG] pgmap v10007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:30.807 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:02:29.262397+0000 mgr.smithi067.rdualw (mgr.24569) 11620 : audit [DBG] from='client.41890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:02:30.807 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:02:29.949375+0000 mon.smithi061 (mon.0) 2429 : audit [DBG] from='client.? 172.21.15.61:0/4253480245' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:02:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:28.852398+0000 mgr.smithi067.rdualw (mgr.24569) 11619 : cluster [DBG] pgmap v10007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:02:29.262397+0000 mgr.smithi067.rdualw (mgr.24569) 11620 : audit [DBG] from='client.41890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:02:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:02:29.949375+0000 mon.smithi061 (mon.0) 2429 : audit [DBG] from='client.? 172.21.15.61:0/4253480245' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:02:31.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:02:29.584913+0000 mgr.smithi067.rdualw (mgr.24569) 11621 : audit [DBG] from='client.41894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:02:31.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:02:29.584913+0000 mgr.smithi067.rdualw (mgr.24569) 11621 : audit [DBG] from='client.41894 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:02:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:30.853394+0000 mgr.smithi067.rdualw (mgr.24569) 11622 : cluster [DBG] pgmap v10008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:30.853394+0000 mgr.smithi067.rdualw (mgr.24569) 11622 : cluster [DBG] pgmap v10008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:32.853891+0000 mgr.smithi067.rdualw (mgr.24569) 11623 : cluster [DBG] pgmap v10009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:32.853891+0000 mgr.smithi067.rdualw (mgr.24569) 11623 : cluster [DBG] pgmap v10009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:34.854421+0000 mgr.smithi067.rdualw (mgr.24569) 11624 : cluster [DBG] pgmap v10010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:02:36.297296+0000 mon.smithi067 (mon.1) 1754 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:02:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:02:36.297563+0000 mon.smithi067 (mon.1) 1755 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:02:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:02:36.298049+0000 mon.smithi061 (mon.0) 2430 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:02:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:02:36.298361+0000 mon.smithi061 (mon.0) 2431 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:02:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:34.854421+0000 mgr.smithi067.rdualw (mgr.24569) 11624 : cluster [DBG] pgmap v10010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:02:36.297296+0000 mon.smithi067 (mon.1) 1754 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:02:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:02:36.297563+0000 mon.smithi067 (mon.1) 1755 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:02:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:02:36.298049+0000 mon.smithi061 (mon.0) 2430 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:02:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:02:36.298361+0000 mon.smithi061 (mon.0) 2431 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:02:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:36.855432+0000 mgr.smithi067.rdualw (mgr.24569) 11625 : cluster [DBG] pgmap v10011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:02:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:36.855432+0000 mgr.smithi067.rdualw (mgr.24569) 11625 : cluster [DBG] pgmap v10011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:02:39.430 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:02:38.638959+0000 mon.smithi067 (mon.1) 1756 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:02:39.430 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:02:38.640415+0000 mon.smithi067 (mon.1) 1757 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:02:39.431 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:02:38.641406+0000 mon.smithi067 (mon.1) 1758 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:02:39.431 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:02:39.074965+0000 mon.smithi061 (mon.0) 2432 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:02:39.431 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:02:39.080802+0000 mon.smithi061 (mon.0) 2433 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:02:39.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:02:38.638959+0000 mon.smithi067 (mon.1) 1756 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:02:39.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:02:38.640415+0000 mon.smithi067 (mon.1) 1757 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:02:39.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:02:38.641406+0000 mon.smithi067 (mon.1) 1758 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:02:39.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:02:39.074965+0000 mon.smithi061 (mon.0) 2432 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:02:39.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:02:39.080802+0000 mon.smithi061 (mon.0) 2433 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:02:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:02:38.642322+0000 mgr.smithi067.rdualw (mgr.24569) 11626 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:02:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:38.856035+0000 mgr.smithi067.rdualw (mgr.24569) 11627 : cluster [DBG] pgmap v10012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:02:38.642322+0000 mgr.smithi067.rdualw (mgr.24569) 11626 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:02:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:38.856035+0000 mgr.smithi067.rdualw (mgr.24569) 11627 : cluster [DBG] pgmap v10012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:42.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:40.856860+0000 mgr.smithi067.rdualw (mgr.24569) 11628 : cluster [DBG] pgmap v10013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:40.856860+0000 mgr.smithi067.rdualw (mgr.24569) 11628 : cluster [DBG] pgmap v10013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:44.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:42.857414+0000 mgr.smithi067.rdualw (mgr.24569) 11629 : cluster [DBG] pgmap v10014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:42.857414+0000 mgr.smithi067.rdualw (mgr.24569) 11629 : cluster [DBG] pgmap v10014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:44.858000+0000 mgr.smithi067.rdualw (mgr.24569) 11630 : cluster [DBG] pgmap v10015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:44.858000+0000 mgr.smithi067.rdualw (mgr.24569) 11630 : cluster [DBG] pgmap v10015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:46.858829+0000 mgr.smithi067.rdualw (mgr.24569) 11631 : cluster [DBG] pgmap v10016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:02:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:46.858829+0000 mgr.smithi067.rdualw (mgr.24569) 11631 : cluster [DBG] pgmap v10016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:02:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:48.859354+0000 mgr.smithi067.rdualw (mgr.24569) 11632 : cluster [DBG] pgmap v10017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:48.859354+0000 mgr.smithi067.rdualw (mgr.24569) 11632 : cluster [DBG] pgmap v10017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:50.860254+0000 mgr.smithi067.rdualw (mgr.24569) 11633 : cluster [DBG] pgmap v10018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:50.860254+0000 mgr.smithi067.rdualw (mgr.24569) 11633 : cluster [DBG] pgmap v10018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:52.860762+0000 mgr.smithi067.rdualw (mgr.24569) 11634 : cluster [DBG] pgmap v10019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:52.860762+0000 mgr.smithi067.rdualw (mgr.24569) 11634 : cluster [DBG] pgmap v10019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:56.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:54.861366+0000 mgr.smithi067.rdualw (mgr.24569) 11635 : cluster [DBG] pgmap v10020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:56.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:54.861366+0000 mgr.smithi067.rdualw (mgr.24569) 11635 : cluster [DBG] pgmap v10020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:56.862330+0000 mgr.smithi067.rdualw (mgr.24569) 11636 : cluster [DBG] pgmap v10021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:02:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:56.862330+0000 mgr.smithi067.rdualw (mgr.24569) 11636 : cluster [DBG] pgmap v10021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:02:59.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:02:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:02:58.863053+0000 mgr.smithi067.rdualw (mgr.24569) 11637 : cluster [DBG] pgmap v10022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:02:59.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:02:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:02:58.863053+0000 mgr.smithi067.rdualw (mgr.24569) 11637 : cluster [DBG] pgmap v10022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:00.256 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:03:00.551 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:03:00.551 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 5m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:03:00.551 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 5m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:03:00.552 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 5m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:03:00.552 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 5m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:03:00.552 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 5m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:03:00.552 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 5m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:03:00.553 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 5m ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:03:00.553 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 5m ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:03:00.553 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 5m ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:03:00.553 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 5m ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:03:00.553 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 5m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:03:00.554 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 5m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:03:00.554 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 5m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:03:00.554 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 5m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:03:00.554 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 5m ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:03:00.554 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 5m ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:03:00.555 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 5m ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:03:00.555 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 5m ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:03:00.555 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 5m ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:03:00.555 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 5m ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:03:00.556 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 5m ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:03:00.556 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 5m ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:03:00.556 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 5m ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:03:00.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:03:00.242498+0000 mgr.smithi067.rdualw (mgr.24569) 11638 : audit [DBG] from='client.41902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:03:00.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:03:00.242498+0000 mgr.smithi067.rdualw (mgr.24569) 11638 : audit [DBG] from='client.41902 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:03:00.955 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:03:00.956 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:03:00.956 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:03:00.956 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:03:00.957 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:03:00.957 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:03:00.957 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:03:00.957 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:03:00.957 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:03:00.958 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:03:00.958 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:03:00.958 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:03:00.958 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:03:00.959 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:03:00.959 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:03:00.959 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:03:00.959 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:03:00.960 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:03:00.960 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:03:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:03:00.532757+0000 mgr.smithi067.rdualw (mgr.24569) 11639 : audit [DBG] from='client.41906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:03:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:00.863834+0000 mgr.smithi067.rdualw (mgr.24569) 11640 : cluster [DBG] pgmap v10023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:01.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:03:00.954228+0000 mon.smithi061 (mon.0) 2434 : audit [DBG] from='client.? 172.21.15.61:0/4066456383' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:03:01.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:03:00.532757+0000 mgr.smithi067.rdualw (mgr.24569) 11639 : audit [DBG] from='client.41906 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:03:01.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:00.863834+0000 mgr.smithi067.rdualw (mgr.24569) 11640 : cluster [DBG] pgmap v10023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:01.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:03:00.954228+0000 mon.smithi061 (mon.0) 2434 : audit [DBG] from='client.? 172.21.15.61:0/4066456383' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:03:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:02.864297+0000 mgr.smithi067.rdualw (mgr.24569) 11641 : cluster [DBG] pgmap v10024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:02.864297+0000 mgr.smithi067.rdualw (mgr.24569) 11641 : cluster [DBG] pgmap v10024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:04.864946+0000 mgr.smithi067.rdualw (mgr.24569) 11642 : cluster [DBG] pgmap v10025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:04.864946+0000 mgr.smithi067.rdualw (mgr.24569) 11642 : cluster [DBG] pgmap v10025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:06.866038+0000 mgr.smithi067.rdualw (mgr.24569) 11643 : cluster [DBG] pgmap v10026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:03:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:06.866038+0000 mgr.smithi067.rdualw (mgr.24569) 11643 : cluster [DBG] pgmap v10026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:03:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:08.866575+0000 mgr.smithi067.rdualw (mgr.24569) 11644 : cluster [DBG] pgmap v10027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:08.866575+0000 mgr.smithi067.rdualw (mgr.24569) 11644 : cluster [DBG] pgmap v10027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:10.867329+0000 mgr.smithi067.rdualw (mgr.24569) 11645 : cluster [DBG] pgmap v10028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:10.867329+0000 mgr.smithi067.rdualw (mgr.24569) 11645 : cluster [DBG] pgmap v10028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:12.867835+0000 mgr.smithi067.rdualw (mgr.24569) 11646 : cluster [DBG] pgmap v10029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:12.867835+0000 mgr.smithi067.rdualw (mgr.24569) 11646 : cluster [DBG] pgmap v10029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:14.868591+0000 mgr.smithi067.rdualw (mgr.24569) 11647 : cluster [DBG] pgmap v10030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:14.868591+0000 mgr.smithi067.rdualw (mgr.24569) 11647 : cluster [DBG] pgmap v10030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:16.869572+0000 mgr.smithi067.rdualw (mgr.24569) 11648 : cluster [DBG] pgmap v10031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:03:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:16.869572+0000 mgr.smithi067.rdualw (mgr.24569) 11648 : cluster [DBG] pgmap v10031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:03:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:18.870147+0000 mgr.smithi067.rdualw (mgr.24569) 11649 : cluster [DBG] pgmap v10032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:18.870147+0000 mgr.smithi067.rdualw (mgr.24569) 11649 : cluster [DBG] pgmap v10032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:20.870989+0000 mgr.smithi067.rdualw (mgr.24569) 11650 : cluster [DBG] pgmap v10033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:20.870989+0000 mgr.smithi067.rdualw (mgr.24569) 11650 : cluster [DBG] pgmap v10033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:22.871576+0000 mgr.smithi067.rdualw (mgr.24569) 11651 : cluster [DBG] pgmap v10034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:22.871576+0000 mgr.smithi067.rdualw (mgr.24569) 11651 : cluster [DBG] pgmap v10034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:24.872186+0000 mgr.smithi067.rdualw (mgr.24569) 11652 : cluster [DBG] pgmap v10035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:24.872186+0000 mgr.smithi067.rdualw (mgr.24569) 11652 : cluster [DBG] pgmap v10035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:26.873094+0000 mgr.smithi067.rdualw (mgr.24569) 11653 : cluster [DBG] pgmap v10036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:03:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:26.873094+0000 mgr.smithi067.rdualw (mgr.24569) 11653 : cluster [DBG] pgmap v10036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:03:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:28.873931+0000 mgr.smithi067.rdualw (mgr.24569) 11654 : cluster [DBG] pgmap v10037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:28.873931+0000 mgr.smithi067.rdualw (mgr.24569) 11654 : cluster [DBG] pgmap v10037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:31.267 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:03:31.559 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:03:31.560 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 6m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:03:31.560 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 6m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:03:31.560 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 6m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:03:31.561 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 6m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:03:31.561 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 6m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:03:31.561 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 6m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:03:31.561 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 6m ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:03:31.561 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 6m ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:03:31.562 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 6m ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:03:31.562 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 6m ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:03:31.562 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 6m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:03:31.562 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 6m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:03:31.563 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 6m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:03:31.563 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 6m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:03:31.563 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 6m ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:03:31.563 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 6m ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:03:31.563 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 6m ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:03:31.564 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 6m ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:03:31.564 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 6m ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:03:31.564 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 6m ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:03:31.564 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 6m ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:03:31.565 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 6m ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:03:31.565 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 6m ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:03:31.906 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:03:31.906 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:03:31.907 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:03:31.907 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:03:31.907 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:03:31.907 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:03:31.907 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:03:31.908 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:03:31.908 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:03:31.908 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:03:31.908 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:03:31.909 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:03:31.909 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:03:31.909 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:03:31.909 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:03:31.910 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:03:31.910 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:03:31.910 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:03:31.910 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:03:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:30.874939+0000 mgr.smithi067.rdualw (mgr.24569) 11655 : cluster [DBG] pgmap v10038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:03:31.253624+0000 mgr.smithi067.rdualw (mgr.24569) 11656 : audit [DBG] from='client.41914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:03:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:03:31.904632+0000 mon.smithi061 (mon.0) 2435 : audit [DBG] from='client.? 172.21.15.61:0/3813616760' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:03:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:30.874939+0000 mgr.smithi067.rdualw (mgr.24569) 11655 : cluster [DBG] pgmap v10038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:03:31.253624+0000 mgr.smithi067.rdualw (mgr.24569) 11656 : audit [DBG] from='client.41914 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:03:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:03:31.904632+0000 mon.smithi061 (mon.0) 2435 : audit [DBG] from='client.? 172.21.15.61:0/3813616760' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:03:33.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:03:31.541455+0000 mgr.smithi067.rdualw (mgr.24569) 11657 : audit [DBG] from='client.41918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:03:33.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:03:31.541455+0000 mgr.smithi067.rdualw (mgr.24569) 11657 : audit [DBG] from='client.41918 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:03:34.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:32.875623+0000 mgr.smithi067.rdualw (mgr.24569) 11658 : cluster [DBG] pgmap v10039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:34.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:32.875623+0000 mgr.smithi067.rdualw (mgr.24569) 11658 : cluster [DBG] pgmap v10039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:34.876113+0000 mgr.smithi067.rdualw (mgr.24569) 11659 : cluster [DBG] pgmap v10040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:03:36.302084+0000 mon.smithi067 (mon.1) 1759 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:03:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:03:36.302477+0000 mon.smithi067 (mon.1) 1760 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:03:36.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:03:36.302658+0000 mon.smithi061 (mon.0) 2436 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:03:36.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:03:36.302980+0000 mon.smithi061 (mon.0) 2437 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:03:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:34.876113+0000 mgr.smithi067.rdualw (mgr.24569) 11659 : cluster [DBG] pgmap v10040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:03:36.302084+0000 mon.smithi067 (mon.1) 1759 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:03:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:03:36.302477+0000 mon.smithi067 (mon.1) 1760 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:03:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:03:36.302658+0000 mon.smithi061 (mon.0) 2436 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:03:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:03:36.302980+0000 mon.smithi061 (mon.0) 2437 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:03:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:36.876996+0000 mgr.smithi067.rdualw (mgr.24569) 11660 : cluster [DBG] pgmap v10041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:03:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:36.876996+0000 mgr.smithi067.rdualw (mgr.24569) 11660 : cluster [DBG] pgmap v10041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:03:39.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:03:39.084018+0000 mon.smithi067 (mon.1) 1761 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:03:39.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:03:39.085507+0000 mon.smithi067 (mon.1) 1762 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:03:39.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:03:39.086484+0000 mon.smithi067 (mon.1) 1763 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:03:39.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:03:39.084018+0000 mon.smithi067 (mon.1) 1761 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:03:39.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:03:39.085507+0000 mon.smithi067 (mon.1) 1762 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:03:39.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:03:39.086484+0000 mon.smithi067 (mon.1) 1763 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:03:40.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:38.877577+0000 mgr.smithi067.rdualw (mgr.24569) 11661 : cluster [DBG] pgmap v10042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:03:39.087313+0000 mgr.smithi067.rdualw (mgr.24569) 11662 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:03:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:03:39.501345+0000 mon.smithi061 (mon.0) 2438 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:03:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:03:39.508895+0000 mon.smithi061 (mon.0) 2439 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:03:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:38.877577+0000 mgr.smithi067.rdualw (mgr.24569) 11661 : cluster [DBG] pgmap v10042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:03:39.087313+0000 mgr.smithi067.rdualw (mgr.24569) 11662 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:03:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:03:39.501345+0000 mon.smithi061 (mon.0) 2438 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:03:40.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:03:39.508895+0000 mon.smithi061 (mon.0) 2439 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:03:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:40.878496+0000 mgr.smithi067.rdualw (mgr.24569) 11663 : cluster [DBG] pgmap v10043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:40.878496+0000 mgr.smithi067.rdualw (mgr.24569) 11663 : cluster [DBG] pgmap v10043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:42.879158+0000 mgr.smithi067.rdualw (mgr.24569) 11664 : cluster [DBG] pgmap v10044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:44.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:42.879158+0000 mgr.smithi067.rdualw (mgr.24569) 11664 : cluster [DBG] pgmap v10044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:44.880009+0000 mgr.smithi067.rdualw (mgr.24569) 11665 : cluster [DBG] pgmap v10045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:44.880009+0000 mgr.smithi067.rdualw (mgr.24569) 11665 : cluster [DBG] pgmap v10045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:46.881097+0000 mgr.smithi067.rdualw (mgr.24569) 11666 : cluster [DBG] pgmap v10046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:03:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:46.881097+0000 mgr.smithi067.rdualw (mgr.24569) 11666 : cluster [DBG] pgmap v10046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:03:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:48.881832+0000 mgr.smithi067.rdualw (mgr.24569) 11667 : cluster [DBG] pgmap v10047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:48.881832+0000 mgr.smithi067.rdualw (mgr.24569) 11667 : cluster [DBG] pgmap v10047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:50.882899+0000 mgr.smithi067.rdualw (mgr.24569) 11668 : cluster [DBG] pgmap v10048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:50.882899+0000 mgr.smithi067.rdualw (mgr.24569) 11668 : cluster [DBG] pgmap v10048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:52.883665+0000 mgr.smithi067.rdualw (mgr.24569) 11669 : cluster [DBG] pgmap v10049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:52.883665+0000 mgr.smithi067.rdualw (mgr.24569) 11669 : cluster [DBG] pgmap v10049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:54.884249+0000 mgr.smithi067.rdualw (mgr.24569) 11670 : cluster [DBG] pgmap v10050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:56.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:54.884249+0000 mgr.smithi067.rdualw (mgr.24569) 11670 : cluster [DBG] pgmap v10050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:03:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:03:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:56.885334+0000 mgr.smithi067.rdualw (mgr.24569) 11671 : cluster [DBG] pgmap v10051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:03:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:03:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:56.885334+0000 mgr.smithi067.rdualw (mgr.24569) 11671 : cluster [DBG] pgmap v10051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:04:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:03:58.886081+0000 mgr.smithi067.rdualw (mgr.24569) 11672 : cluster [DBG] pgmap v10052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:03:58.886081+0000 mgr.smithi067.rdualw (mgr.24569) 11672 : cluster [DBG] pgmap v10052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:02.212 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:04:02.506 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:04:02.506 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 6m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:04:02.506 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 6m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:04:02.507 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 6m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:04:02.507 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 6m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:04:02.507 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 6m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:04:02.507 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 6m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:04:02.508 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 6m ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:04:02.508 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 6m ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:04:02.508 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 6m ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:04:02.508 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 6m ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:04:02.509 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 6m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:04:02.509 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 6m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:04:02.509 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 6m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:04:02.509 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 6m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:04:02.510 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 6m ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:04:02.510 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 6m ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:04:02.510 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 6m ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:04:02.510 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 6m ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:04:02.511 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 6m ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:04:02.511 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 6m ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:04:02.511 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 6m ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:04:02.511 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 6m ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:04:02.511 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 6m ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:04:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:00.887092+0000 mgr.smithi067.rdualw (mgr.24569) 11673 : cluster [DBG] pgmap v10053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:02.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:00.887092+0000 mgr.smithi067.rdualw (mgr.24569) 11673 : cluster [DBG] pgmap v10053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:02.910 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:04:02.910 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:04:02.910 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:04:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:04:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:04:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:04:02.911 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:04:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:04:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:04:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:04:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:04:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:04:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:04:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:04:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:04:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:04:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:04:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:04:02.914 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:04:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:04:02.198438+0000 mgr.smithi067.rdualw (mgr.24569) 11674 : audit [DBG] from='client.41926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:04:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:04:02.908445+0000 mon.smithi061 (mon.0) 2440 : audit [DBG] from='client.? 172.21.15.61:0/2975815209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:04:03.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:04:02.198438+0000 mgr.smithi067.rdualw (mgr.24569) 11674 : audit [DBG] from='client.41926 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:04:03.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:04:02.908445+0000 mon.smithi061 (mon.0) 2440 : audit [DBG] from='client.? 172.21.15.61:0/2975815209' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:04:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:04:02.487686+0000 mgr.smithi067.rdualw (mgr.24569) 11675 : audit [DBG] from='client.41930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:04:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:02.887687+0000 mgr.smithi067.rdualw (mgr.24569) 11676 : cluster [DBG] pgmap v10054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:04:02.487686+0000 mgr.smithi067.rdualw (mgr.24569) 11675 : audit [DBG] from='client.41930 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:04:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:02.887687+0000 mgr.smithi067.rdualw (mgr.24569) 11676 : cluster [DBG] pgmap v10054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:04.888354+0000 mgr.smithi067.rdualw (mgr.24569) 11677 : cluster [DBG] pgmap v10055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:04.888354+0000 mgr.smithi067.rdualw (mgr.24569) 11677 : cluster [DBG] pgmap v10055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:08.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:06.889245+0000 mgr.smithi067.rdualw (mgr.24569) 11678 : cluster [DBG] pgmap v10056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:04:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:06.889245+0000 mgr.smithi067.rdualw (mgr.24569) 11678 : cluster [DBG] pgmap v10056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:04:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:08.890034+0000 mgr.smithi067.rdualw (mgr.24569) 11679 : cluster [DBG] pgmap v10057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:08.890034+0000 mgr.smithi067.rdualw (mgr.24569) 11679 : cluster [DBG] pgmap v10057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:10.891147+0000 mgr.smithi067.rdualw (mgr.24569) 11680 : cluster [DBG] pgmap v10058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:10.891147+0000 mgr.smithi067.rdualw (mgr.24569) 11680 : cluster [DBG] pgmap v10058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:13.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:12.891677+0000 mgr.smithi067.rdualw (mgr.24569) 11681 : cluster [DBG] pgmap v10059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:13.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:12.891677+0000 mgr.smithi067.rdualw (mgr.24569) 11681 : cluster [DBG] pgmap v10059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:16.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:14.892389+0000 mgr.smithi067.rdualw (mgr.24569) 11682 : cluster [DBG] pgmap v10060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:16.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:14.892389+0000 mgr.smithi067.rdualw (mgr.24569) 11682 : cluster [DBG] pgmap v10060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:16.893364+0000 mgr.smithi067.rdualw (mgr.24569) 11683 : cluster [DBG] pgmap v10061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:04:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:16.893364+0000 mgr.smithi067.rdualw (mgr.24569) 11683 : cluster [DBG] pgmap v10061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:04:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:18.894073+0000 mgr.smithi067.rdualw (mgr.24569) 11684 : cluster [DBG] pgmap v10062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:18.894073+0000 mgr.smithi067.rdualw (mgr.24569) 11684 : cluster [DBG] pgmap v10062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:20.894927+0000 mgr.smithi067.rdualw (mgr.24569) 11685 : cluster [DBG] pgmap v10063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:20.894927+0000 mgr.smithi067.rdualw (mgr.24569) 11685 : cluster [DBG] pgmap v10063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:22.895464+0000 mgr.smithi067.rdualw (mgr.24569) 11686 : cluster [DBG] pgmap v10064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:22.895464+0000 mgr.smithi067.rdualw (mgr.24569) 11686 : cluster [DBG] pgmap v10064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:26.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:24.896206+0000 mgr.smithi067.rdualw (mgr.24569) 11687 : cluster [DBG] pgmap v10065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:24.896206+0000 mgr.smithi067.rdualw (mgr.24569) 11687 : cluster [DBG] pgmap v10065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:26.897065+0000 mgr.smithi067.rdualw (mgr.24569) 11688 : cluster [DBG] pgmap v10066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:04:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:26.897065+0000 mgr.smithi067.rdualw (mgr.24569) 11688 : cluster [DBG] pgmap v10066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:04:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:28.897654+0000 mgr.smithi067.rdualw (mgr.24569) 11689 : cluster [DBG] pgmap v10067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:28.897654+0000 mgr.smithi067.rdualw (mgr.24569) 11689 : cluster [DBG] pgmap v10067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:30.898446+0000 mgr.smithi067.rdualw (mgr.24569) 11690 : cluster [DBG] pgmap v10068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:30.898446+0000 mgr.smithi067.rdualw (mgr.24569) 11690 : cluster [DBG] pgmap v10068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:33.221 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:04:33.511 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:04:33.511 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 7m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:04:33.511 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 7m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:04:33.512 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 7m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:04:33.512 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 7m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:04:33.512 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 7m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:04:33.512 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 7m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:04:33.513 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 7m ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:04:33.513 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 7m ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:04:33.513 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 7m ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:04:33.513 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 7m ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:04:33.514 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 7m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:04:33.514 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 7m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:04:33.514 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 7m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:04:33.514 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 7m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:04:33.514 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 7m ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:04:33.515 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 7m ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:04:33.515 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 7m ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:04:33.515 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 7m ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:04:33.515 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 7m ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:04:33.516 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 7m ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:04:33.516 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 7m ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:04:33.516 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 7m ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:04:33.516 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 7m ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:04:33.861 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:04:33.861 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:04:33.861 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:04:33.862 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:04:33.862 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:04:33.862 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:04:33.863 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:04:33.863 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:04:33.863 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:04:33.863 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:04:33.864 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:04:33.864 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:04:33.864 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:04:33.864 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:04:33.865 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:04:33.865 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:04:33.865 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:04:33.865 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:04:33.865 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:04:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:32.899210+0000 mgr.smithi067.rdualw (mgr.24569) 11691 : cluster [DBG] pgmap v10069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:04:33.207643+0000 mgr.smithi067.rdualw (mgr.24569) 11692 : audit [DBG] from='client.41938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:04:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:04:33.859423+0000 mon.smithi061 (mon.0) 2441 : audit [DBG] from='client.? 172.21.15.61:0/4084941166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:04:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:32.899210+0000 mgr.smithi067.rdualw (mgr.24569) 11691 : cluster [DBG] pgmap v10069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:04:33.207643+0000 mgr.smithi067.rdualw (mgr.24569) 11692 : audit [DBG] from='client.41938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:04:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:04:33.859423+0000 mon.smithi061 (mon.0) 2441 : audit [DBG] from='client.? 172.21.15.61:0/4084941166' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:04:35.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:04:33.493143+0000 mgr.smithi067.rdualw (mgr.24569) 11693 : audit [DBG] from='client.41942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:04:35.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:04:33.493143+0000 mgr.smithi067.rdualw (mgr.24569) 11693 : audit [DBG] from='client.41942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:04:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:34.899967+0000 mgr.smithi067.rdualw (mgr.24569) 11694 : cluster [DBG] pgmap v10070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:04:36.307669+0000 mon.smithi067 (mon.1) 1764 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:04:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:04:36.307995+0000 mon.smithi067 (mon.1) 1765 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:04:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:04:36.308272+0000 mon.smithi061 (mon.0) 2442 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:04:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:04:36.308754+0000 mon.smithi061 (mon.0) 2443 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:04:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:34.899967+0000 mgr.smithi067.rdualw (mgr.24569) 11694 : cluster [DBG] pgmap v10070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:36.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:04:36.307669+0000 mon.smithi067 (mon.1) 1764 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:04:36.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:04:36.307995+0000 mon.smithi067 (mon.1) 1765 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:04:36.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:04:36.308272+0000 mon.smithi061 (mon.0) 2442 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:04:36.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:04:36.308754+0000 mon.smithi061 (mon.0) 2443 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:04:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:36.900949+0000 mgr.smithi067.rdualw (mgr.24569) 11695 : cluster [DBG] pgmap v10071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:04:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:36.900949+0000 mgr.smithi067.rdualw (mgr.24569) 11695 : cluster [DBG] pgmap v10071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:04:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:38.901592+0000 mgr.smithi067.rdualw (mgr.24569) 11696 : cluster [DBG] pgmap v10072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:04:39.514024+0000 mon.smithi067 (mon.1) 1766 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:04:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:04:39.515389+0000 mon.smithi067 (mon.1) 1767 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:04:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:04:39.516282+0000 mon.smithi067 (mon.1) 1768 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:04:40.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:04:39.934381+0000 mon.smithi061 (mon.0) 2444 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:04:40.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:04:39.939755+0000 mon.smithi061 (mon.0) 2445 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:04:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:38.901592+0000 mgr.smithi067.rdualw (mgr.24569) 11696 : cluster [DBG] pgmap v10072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:04:39.514024+0000 mon.smithi067 (mon.1) 1766 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:04:40.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:04:39.515389+0000 mon.smithi067 (mon.1) 1767 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:04:40.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:04:39.516282+0000 mon.smithi067 (mon.1) 1768 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:04:40.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:04:39.934381+0000 mon.smithi061 (mon.0) 2444 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:04:40.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:04:39.939755+0000 mon.smithi061 (mon.0) 2445 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:04:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:04:39.517107+0000 mgr.smithi067.rdualw (mgr.24569) 11697 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:04:41.883 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:04:39.517107+0000 mgr.smithi067.rdualw (mgr.24569) 11697 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:04:42.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:40.902547+0000 mgr.smithi067.rdualw (mgr.24569) 11698 : cluster [DBG] pgmap v10073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:40.902547+0000 mgr.smithi067.rdualw (mgr.24569) 11698 : cluster [DBG] pgmap v10073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:42.903077+0000 mgr.smithi067.rdualw (mgr.24569) 11699 : cluster [DBG] pgmap v10074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:42.903077+0000 mgr.smithi067.rdualw (mgr.24569) 11699 : cluster [DBG] pgmap v10074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:44.903836+0000 mgr.smithi067.rdualw (mgr.24569) 11700 : cluster [DBG] pgmap v10075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:44.903836+0000 mgr.smithi067.rdualw (mgr.24569) 11700 : cluster [DBG] pgmap v10075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:48.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:46.904896+0000 mgr.smithi067.rdualw (mgr.24569) 11701 : cluster [DBG] pgmap v10076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:04:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:46.904896+0000 mgr.smithi067.rdualw (mgr.24569) 11701 : cluster [DBG] pgmap v10076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:04:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:48.905584+0000 mgr.smithi067.rdualw (mgr.24569) 11702 : cluster [DBG] pgmap v10077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:48.905584+0000 mgr.smithi067.rdualw (mgr.24569) 11702 : cluster [DBG] pgmap v10077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:50.906478+0000 mgr.smithi067.rdualw (mgr.24569) 11703 : cluster [DBG] pgmap v10078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:50.906478+0000 mgr.smithi067.rdualw (mgr.24569) 11703 : cluster [DBG] pgmap v10078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:52.907148+0000 mgr.smithi067.rdualw (mgr.24569) 11704 : cluster [DBG] pgmap v10079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:52.907148+0000 mgr.smithi067.rdualw (mgr.24569) 11704 : cluster [DBG] pgmap v10079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:54.907821+0000 mgr.smithi067.rdualw (mgr.24569) 11705 : cluster [DBG] pgmap v10080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:54.907821+0000 mgr.smithi067.rdualw (mgr.24569) 11705 : cluster [DBG] pgmap v10080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:04:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:04:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:56.908698+0000 mgr.smithi067.rdualw (mgr.24569) 11706 : cluster [DBG] pgmap v10081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:04:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:04:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:56.908698+0000 mgr.smithi067.rdualw (mgr.24569) 11706 : cluster [DBG] pgmap v10081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:05:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:04:58.909397+0000 mgr.smithi067.rdualw (mgr.24569) 11707 : cluster [DBG] pgmap v10082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:04:58.909397+0000 mgr.smithi067.rdualw (mgr.24569) 11707 : cluster [DBG] pgmap v10082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:02.806 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:00.910481+0000 mgr.smithi067.rdualw (mgr.24569) 11708 : cluster [DBG] pgmap v10083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:00.910481+0000 mgr.smithi067.rdualw (mgr.24569) 11708 : cluster [DBG] pgmap v10083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:04.171 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:05:04.463 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:05:04.464 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 7m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:05:04.464 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 7m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:05:04.464 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 7m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:05:04.464 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 7m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:05:04.465 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 7m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:05:04.465 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 7m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:05:04.465 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 7m ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:05:04.465 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 7m ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:05:04.466 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 7m ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:05:04.466 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 7m ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:05:04.466 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 7m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:05:04.466 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 7m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:05:04.467 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 7m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:05:04.467 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 7m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:05:04.467 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 7m ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:05:04.467 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 7m ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:05:04.468 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 7m ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:05:04.468 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 7m ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:05:04.468 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 7m ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:05:04.468 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 7m ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:05:04.468 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 7m ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:05:04.469 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 7m ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:05:04.469 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 7m ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:05:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:02.911049+0000 mgr.smithi067.rdualw (mgr.24569) 11709 : cluster [DBG] pgmap v10084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:04.811 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:05:04.811 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:05:04.812 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:05:04.812 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:05:04.812 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:05:04.812 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:05:04.812 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:05:04.813 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:05:04.813 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:05:04.813 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:05:04.813 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:05:04.814 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:05:04.814 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:05:04.814 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:05:04.814 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:05:04.814 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:05:04.815 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:05:04.815 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:05:04.815 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:05:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:02.911049+0000 mgr.smithi067.rdualw (mgr.24569) 11709 : cluster [DBG] pgmap v10084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:05.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:05:04.157166+0000 mgr.smithi067.rdualw (mgr.24569) 11710 : audit [DBG] from='client.41950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:05:05.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:05:04.445406+0000 mgr.smithi067.rdualw (mgr.24569) 11711 : audit [DBG] from='client.41954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:05:05.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:05:04.809959+0000 mon.smithi061 (mon.0) 2446 : audit [DBG] from='client.? 172.21.15.61:0/55748980' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:05:05.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:05:04.157166+0000 mgr.smithi067.rdualw (mgr.24569) 11710 : audit [DBG] from='client.41950 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:05:05.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:05:04.445406+0000 mgr.smithi067.rdualw (mgr.24569) 11711 : audit [DBG] from='client.41954 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:05:05.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:05:04.809959+0000 mon.smithi061 (mon.0) 2446 : audit [DBG] from='client.? 172.21.15.61:0/55748980' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:05:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:04.911812+0000 mgr.smithi067.rdualw (mgr.24569) 11712 : cluster [DBG] pgmap v10085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:04.911812+0000 mgr.smithi067.rdualw (mgr.24569) 11712 : cluster [DBG] pgmap v10085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:08.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:06.912617+0000 mgr.smithi067.rdualw (mgr.24569) 11713 : cluster [DBG] pgmap v10086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:05:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:06.912617+0000 mgr.smithi067.rdualw (mgr.24569) 11713 : cluster [DBG] pgmap v10086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:05:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:08.913144+0000 mgr.smithi067.rdualw (mgr.24569) 11714 : cluster [DBG] pgmap v10087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:08.913144+0000 mgr.smithi067.rdualw (mgr.24569) 11714 : cluster [DBG] pgmap v10087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:10.913963+0000 mgr.smithi067.rdualw (mgr.24569) 11715 : cluster [DBG] pgmap v10088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:10.913963+0000 mgr.smithi067.rdualw (mgr.24569) 11715 : cluster [DBG] pgmap v10088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:12.914521+0000 mgr.smithi067.rdualw (mgr.24569) 11716 : cluster [DBG] pgmap v10089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:12.914521+0000 mgr.smithi067.rdualw (mgr.24569) 11716 : cluster [DBG] pgmap v10089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:14.915291+0000 mgr.smithi067.rdualw (mgr.24569) 11717 : cluster [DBG] pgmap v10090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:16.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:14.915291+0000 mgr.smithi067.rdualw (mgr.24569) 11717 : cluster [DBG] pgmap v10090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:16.916142+0000 mgr.smithi067.rdualw (mgr.24569) 11718 : cluster [DBG] pgmap v10091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:05:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:16.916142+0000 mgr.smithi067.rdualw (mgr.24569) 11718 : cluster [DBG] pgmap v10091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:05:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:18.916776+0000 mgr.smithi067.rdualw (mgr.24569) 11719 : cluster [DBG] pgmap v10092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:18.916776+0000 mgr.smithi067.rdualw (mgr.24569) 11719 : cluster [DBG] pgmap v10092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:20.917653+0000 mgr.smithi067.rdualw (mgr.24569) 11720 : cluster [DBG] pgmap v10093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:20.917653+0000 mgr.smithi067.rdualw (mgr.24569) 11720 : cluster [DBG] pgmap v10093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:22.918346+0000 mgr.smithi067.rdualw (mgr.24569) 11721 : cluster [DBG] pgmap v10094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:22.918346+0000 mgr.smithi067.rdualw (mgr.24569) 11721 : cluster [DBG] pgmap v10094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:26.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:24.919020+0000 mgr.smithi067.rdualw (mgr.24569) 11722 : cluster [DBG] pgmap v10095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:24.919020+0000 mgr.smithi067.rdualw (mgr.24569) 11722 : cluster [DBG] pgmap v10095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:26.919956+0000 mgr.smithi067.rdualw (mgr.24569) 11723 : cluster [DBG] pgmap v10096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:05:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:26.919956+0000 mgr.smithi067.rdualw (mgr.24569) 11723 : cluster [DBG] pgmap v10096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:05:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:28.920685+0000 mgr.smithi067.rdualw (mgr.24569) 11724 : cluster [DBG] pgmap v10097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:28.920685+0000 mgr.smithi067.rdualw (mgr.24569) 11724 : cluster [DBG] pgmap v10097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:31.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:31 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:30.921584+0000 mgr.smithi067.rdualw (mgr.24569) 11725 : cluster [DBG] pgmap v10098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:31.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:31 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:30.921584+0000 mgr.smithi067.rdualw (mgr.24569) 11725 : cluster [DBG] pgmap v10098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:32.922118+0000 mgr.smithi067.rdualw (mgr.24569) 11726 : cluster [DBG] pgmap v10099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:32.922118+0000 mgr.smithi067.rdualw (mgr.24569) 11726 : cluster [DBG] pgmap v10099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:35.127 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:05:35.419 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:05:35.419 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 8m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:05:35.419 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 8m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:05:35.419 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 8m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:05:35.420 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 8m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:05:35.420 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 8m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:05:35.420 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 8m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:05:35.421 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 8m ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:05:35.421 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 8m ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:05:35.421 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 8m ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:05:35.421 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 8m ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:05:35.422 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 8m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:05:35.422 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 8m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:05:35.422 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 8m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:05:35.422 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 8m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:05:35.423 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 8m ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:05:35.423 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 8m ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:05:35.423 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 8m ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:05:35.423 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 8m ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:05:35.424 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 8m ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:05:35.424 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 8m ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:05:35.424 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 8m ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:05:35.424 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 8m ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:05:35.425 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 8m ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:05:35.765 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:05:35.766 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:05:35.766 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:05:35.766 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:05:35.767 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:05:35.767 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:05:35.767 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:05:35.767 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:05:35.767 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:05:35.768 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:05:35.768 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:05:35.768 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:05:35.768 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:05:35.769 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:05:35.769 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:05:35.769 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:05:35.769 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:05:35.769 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:05:35.770 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:05:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:34.922626+0000 mgr.smithi067.rdualw (mgr.24569) 11727 : cluster [DBG] pgmap v10100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:05:35.111106+0000 mgr.smithi067.rdualw (mgr.24569) 11728 : audit [DBG] from='client.41962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:05:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:05:35.400493+0000 mgr.smithi067.rdualw (mgr.24569) 11729 : audit [DBG] from='client.41966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:05:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:05:35.764128+0000 mon.smithi061 (mon.0) 2447 : audit [DBG] from='client.? 172.21.15.61:0/1904688483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:05:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:05:36.313660+0000 mon.smithi067 (mon.1) 1769 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:05:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:05:36.313934+0000 mon.smithi067 (mon.1) 1770 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:05:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:05:36.314560+0000 mon.smithi061 (mon.0) 2448 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:05:36.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:05:36.314921+0000 mon.smithi061 (mon.0) 2449 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:05:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:34.922626+0000 mgr.smithi067.rdualw (mgr.24569) 11727 : cluster [DBG] pgmap v10100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:05:35.111106+0000 mgr.smithi067.rdualw (mgr.24569) 11728 : audit [DBG] from='client.41962 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:05:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:05:35.400493+0000 mgr.smithi067.rdualw (mgr.24569) 11729 : audit [DBG] from='client.41966 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:05:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:05:35.764128+0000 mon.smithi061 (mon.0) 2447 : audit [DBG] from='client.? 172.21.15.61:0/1904688483' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:05:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:05:36.313660+0000 mon.smithi067 (mon.1) 1769 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:05:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:05:36.313934+0000 mon.smithi067 (mon.1) 1770 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:05:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:05:36.314560+0000 mon.smithi061 (mon.0) 2448 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:05:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:05:36.314921+0000 mon.smithi061 (mon.0) 2449 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:05:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:36.923395+0000 mgr.smithi067.rdualw (mgr.24569) 11730 : cluster [DBG] pgmap v10101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:05:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:36.923395+0000 mgr.smithi067.rdualw (mgr.24569) 11730 : cluster [DBG] pgmap v10101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:05:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:38.924092+0000 mgr.smithi067.rdualw (mgr.24569) 11731 : cluster [DBG] pgmap v10102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:05:39.942957+0000 mon.smithi067 (mon.1) 1771 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:05:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:05:39.944382+0000 mon.smithi067 (mon.1) 1772 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:05:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:05:39.945335+0000 mon.smithi067 (mon.1) 1773 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:05:40.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:05:40.361980+0000 mon.smithi061 (mon.0) 2450 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:05:40.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:05:40.367770+0000 mon.smithi061 (mon.0) 2451 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:05:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:38.924092+0000 mgr.smithi067.rdualw (mgr.24569) 11731 : cluster [DBG] pgmap v10102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:05:39.942957+0000 mon.smithi067 (mon.1) 1771 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:05:40.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:05:39.944382+0000 mon.smithi067 (mon.1) 1772 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:05:40.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:05:39.945335+0000 mon.smithi067 (mon.1) 1773 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:05:40.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:05:40.361980+0000 mon.smithi061 (mon.0) 2450 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:05:40.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:05:40.367770+0000 mon.smithi061 (mon.0) 2451 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:05:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:05:39.946239+0000 mgr.smithi067.rdualw (mgr.24569) 11732 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:05:41.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:05:39.946239+0000 mgr.smithi067.rdualw (mgr.24569) 11732 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:05:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:40.924875+0000 mgr.smithi067.rdualw (mgr.24569) 11733 : cluster [DBG] pgmap v10103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:40.924875+0000 mgr.smithi067.rdualw (mgr.24569) 11733 : cluster [DBG] pgmap v10103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:44.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:42.925459+0000 mgr.smithi067.rdualw (mgr.24569) 11734 : cluster [DBG] pgmap v10104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:44.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:42.925459+0000 mgr.smithi067.rdualw (mgr.24569) 11734 : cluster [DBG] pgmap v10104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:44.926081+0000 mgr.smithi067.rdualw (mgr.24569) 11735 : cluster [DBG] pgmap v10105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:44.926081+0000 mgr.smithi067.rdualw (mgr.24569) 11735 : cluster [DBG] pgmap v10105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:46.926922+0000 mgr.smithi067.rdualw (mgr.24569) 11736 : cluster [DBG] pgmap v10106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:05:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:46.926922+0000 mgr.smithi067.rdualw (mgr.24569) 11736 : cluster [DBG] pgmap v10106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:05:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:48.927669+0000 mgr.smithi067.rdualw (mgr.24569) 11737 : cluster [DBG] pgmap v10107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:48.927669+0000 mgr.smithi067.rdualw (mgr.24569) 11737 : cluster [DBG] pgmap v10107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:50.928520+0000 mgr.smithi067.rdualw (mgr.24569) 11738 : cluster [DBG] pgmap v10108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:50.928520+0000 mgr.smithi067.rdualw (mgr.24569) 11738 : cluster [DBG] pgmap v10108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:52.929140+0000 mgr.smithi067.rdualw (mgr.24569) 11739 : cluster [DBG] pgmap v10109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:52.929140+0000 mgr.smithi067.rdualw (mgr.24569) 11739 : cluster [DBG] pgmap v10109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:56.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:54.929866+0000 mgr.smithi067.rdualw (mgr.24569) 11740 : cluster [DBG] pgmap v10110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:54.929866+0000 mgr.smithi067.rdualw (mgr.24569) 11740 : cluster [DBG] pgmap v10110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:05:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:05:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:56.930709+0000 mgr.smithi067.rdualw (mgr.24569) 11741 : cluster [DBG] pgmap v10111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:05:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:05:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:56.930709+0000 mgr.smithi067.rdualw (mgr.24569) 11741 : cluster [DBG] pgmap v10111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:06:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:05:58.931321+0000 mgr.smithi067.rdualw (mgr.24569) 11742 : cluster [DBG] pgmap v10112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:05:58.931321+0000 mgr.smithi067.rdualw (mgr.24569) 11742 : cluster [DBG] pgmap v10112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:00.932328+0000 mgr.smithi067.rdualw (mgr.24569) 11743 : cluster [DBG] pgmap v10113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:00.932328+0000 mgr.smithi067.rdualw (mgr.24569) 11743 : cluster [DBG] pgmap v10113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:02.933031+0000 mgr.smithi067.rdualw (mgr.24569) 11744 : cluster [DBG] pgmap v10114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:04.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:02.933031+0000 mgr.smithi067.rdualw (mgr.24569) 11744 : cluster [DBG] pgmap v10114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:06.112 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:06:06.414 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:06:06.414 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 8m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:06:06.415 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 8m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:06:06.415 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 8m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:06:06.415 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 8m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:06:06.415 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 8m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:06:06.416 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 8m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:06:06.416 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 8m ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:06:06.416 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 8m ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:06:06.416 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 8m ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:06:06.417 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 8m ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:06:06.417 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 8m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:06:06.417 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 8m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:06:06.418 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 8m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:06:06.418 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 8m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:06:06.418 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 8m ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:06:06.418 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 8m ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:06:06.419 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 8m ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:06:06.419 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 8m ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:06:06.419 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 8m ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:06:06.419 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 8m ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:06:06.420 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 8m ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:06:06.420 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 8m ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:06:06.420 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 8m ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:06:06.753 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:06:06.753 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:06:06.753 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:06:06.753 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:06:06.754 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:06:06.754 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:06:06.754 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:06:06.755 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:06:06.755 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:06:06.755 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:06:06.755 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:06:06.755 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:06:06.756 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:06:06.756 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:06:06.756 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:06:06.757 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:06:06.757 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:06:06.757 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:06:06.757 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:06:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:04.933821+0000 mgr.smithi067.rdualw (mgr.24569) 11745 : cluster [DBG] pgmap v10115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:04.933821+0000 mgr.smithi067.rdualw (mgr.24569) 11745 : cluster [DBG] pgmap v10115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:07.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:06:06.098065+0000 mgr.smithi067.rdualw (mgr.24569) 11746 : audit [DBG] from='client.41974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:06:07.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:06:06.396304+0000 mgr.smithi067.rdualw (mgr.24569) 11747 : audit [DBG] from='client.41978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:06:07.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:06:06.751330+0000 mon.smithi061 (mon.0) 2452 : audit [DBG] from='client.? 172.21.15.61:0/2729923551' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:06:07.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:06:06.098065+0000 mgr.smithi067.rdualw (mgr.24569) 11746 : audit [DBG] from='client.41974 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:06:07.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:06:06.396304+0000 mgr.smithi067.rdualw (mgr.24569) 11747 : audit [DBG] from='client.41978 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:06:07.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:06:06.751330+0000 mon.smithi061 (mon.0) 2452 : audit [DBG] from='client.? 172.21.15.61:0/2729923551' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:06:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:06.934707+0000 mgr.smithi067.rdualw (mgr.24569) 11748 : cluster [DBG] pgmap v10116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:06:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:06.934707+0000 mgr.smithi067.rdualw (mgr.24569) 11748 : cluster [DBG] pgmap v10116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:06:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:08.935508+0000 mgr.smithi067.rdualw (mgr.24569) 11749 : cluster [DBG] pgmap v10117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:08.935508+0000 mgr.smithi067.rdualw (mgr.24569) 11749 : cluster [DBG] pgmap v10117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:11.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:10.936575+0000 mgr.smithi067.rdualw (mgr.24569) 11750 : cluster [DBG] pgmap v10118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:11.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:10.936575+0000 mgr.smithi067.rdualw (mgr.24569) 11750 : cluster [DBG] pgmap v10118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:14.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:12.937189+0000 mgr.smithi067.rdualw (mgr.24569) 11751 : cluster [DBG] pgmap v10119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:12.937189+0000 mgr.smithi067.rdualw (mgr.24569) 11751 : cluster [DBG] pgmap v10119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:16.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:14.937758+0000 mgr.smithi067.rdualw (mgr.24569) 11752 : cluster [DBG] pgmap v10120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:14.937758+0000 mgr.smithi067.rdualw (mgr.24569) 11752 : cluster [DBG] pgmap v10120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:16.938679+0000 mgr.smithi067.rdualw (mgr.24569) 11753 : cluster [DBG] pgmap v10121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:06:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:16.938679+0000 mgr.smithi067.rdualw (mgr.24569) 11753 : cluster [DBG] pgmap v10121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:06:20.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:18.939394+0000 mgr.smithi067.rdualw (mgr.24569) 11754 : cluster [DBG] pgmap v10122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:18.939394+0000 mgr.smithi067.rdualw (mgr.24569) 11754 : cluster [DBG] pgmap v10122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:22.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:20.940311+0000 mgr.smithi067.rdualw (mgr.24569) 11755 : cluster [DBG] pgmap v10123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:20.940311+0000 mgr.smithi067.rdualw (mgr.24569) 11755 : cluster [DBG] pgmap v10123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:22.940963+0000 mgr.smithi067.rdualw (mgr.24569) 11756 : cluster [DBG] pgmap v10124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:22.940963+0000 mgr.smithi067.rdualw (mgr.24569) 11756 : cluster [DBG] pgmap v10124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:24.941667+0000 mgr.smithi067.rdualw (mgr.24569) 11757 : cluster [DBG] pgmap v10125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:24.941667+0000 mgr.smithi067.rdualw (mgr.24569) 11757 : cluster [DBG] pgmap v10125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:26.942603+0000 mgr.smithi067.rdualw (mgr.24569) 11758 : cluster [DBG] pgmap v10126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:06:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:26.942603+0000 mgr.smithi067.rdualw (mgr.24569) 11758 : cluster [DBG] pgmap v10126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:06:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:28.943375+0000 mgr.smithi067.rdualw (mgr.24569) 11759 : cluster [DBG] pgmap v10127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:28.943375+0000 mgr.smithi067.rdualw (mgr.24569) 11759 : cluster [DBG] pgmap v10127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:30.944367+0000 mgr.smithi067.rdualw (mgr.24569) 11760 : cluster [DBG] pgmap v10128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:30.944367+0000 mgr.smithi067.rdualw (mgr.24569) 11760 : cluster [DBG] pgmap v10128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:32.944844+0000 mgr.smithi067.rdualw (mgr.24569) 11761 : cluster [DBG] pgmap v10129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:32.944844+0000 mgr.smithi067.rdualw (mgr.24569) 11761 : cluster [DBG] pgmap v10129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:34.945666+0000 mgr.smithi067.rdualw (mgr.24569) 11762 : cluster [DBG] pgmap v10130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:06:36.319285+0000 mon.smithi067 (mon.1) 1774 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:06:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:06:36.319612+0000 mon.smithi067 (mon.1) 1775 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:06:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:06:36.319843+0000 mon.smithi061 (mon.0) 2453 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:06:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:06:36.320113+0000 mon.smithi061 (mon.0) 2454 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:06:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:34.945666+0000 mgr.smithi067.rdualw (mgr.24569) 11762 : cluster [DBG] pgmap v10130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:06:36.319285+0000 mon.smithi067 (mon.1) 1774 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:06:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:06:36.319612+0000 mon.smithi067 (mon.1) 1775 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:06:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:06:36.319843+0000 mon.smithi061 (mon.0) 2453 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:06:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:06:36.320113+0000 mon.smithi061 (mon.0) 2454 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:06:37.095 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:06:37.446 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:06:37.755 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 9m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:06:37.755 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 9m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:06:37.756 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 9m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:06:37.756 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 9m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:06:37.756 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 9m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:06:37.756 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 9m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:06:37.757 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 9m ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:06:37.757 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 9m ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:06:37.757 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 9m ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:06:37.757 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 9m ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:06:37.758 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 9m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:06:37.758 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 9m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:06:37.758 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 9m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:06:37.758 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 9m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:06:37.759 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 9m ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:06:37.759 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 9m ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:06:37.759 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 9m ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:06:37.759 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 9m ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:06:37.760 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 9m ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:06:37.760 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 9m ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:06:37.760 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 9m ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:06:37.760 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 9m ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:06:37.760 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 9m ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:06:37.786 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:06:37.787 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:06:37.787 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:06:37.787 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:06:37.788 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:06:37.788 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:06:37.788 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:06:37.788 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:06:37.789 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:06:37.789 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:06:37.789 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:06:37.789 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:06:37.789 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:06:37.790 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:06:37.790 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:06:37.790 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:06:37.790 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:06:37.791 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:06:37.791 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:06:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:36.946508+0000 mgr.smithi067.rdualw (mgr.24569) 11763 : cluster [DBG] pgmap v10131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:06:38.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:06:37.079390+0000 mgr.smithi067.rdualw (mgr.24569) 11764 : audit [DBG] from='client.41986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:06:38.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:06:37.427828+0000 mgr.smithi067.rdualw (mgr.24569) 11765 : audit [DBG] from='client.41990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:06:38.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:06:37.785216+0000 mon.smithi061 (mon.0) 2455 : audit [DBG] from='client.? 172.21.15.61:0/706025789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:06:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:36.946508+0000 mgr.smithi067.rdualw (mgr.24569) 11763 : cluster [DBG] pgmap v10131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:06:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:06:37.079390+0000 mgr.smithi067.rdualw (mgr.24569) 11764 : audit [DBG] from='client.41986 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:06:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:06:37.427828+0000 mgr.smithi067.rdualw (mgr.24569) 11765 : audit [DBG] from='client.41990 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:06:38.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:06:37.785216+0000 mon.smithi061 (mon.0) 2455 : audit [DBG] from='client.? 172.21.15.61:0/706025789' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:06:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:38.947226+0000 mgr.smithi067.rdualw (mgr.24569) 11766 : cluster [DBG] pgmap v10132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:06:40.370766+0000 mon.smithi067 (mon.1) 1776 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:06:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:06:40.372287+0000 mon.smithi067 (mon.1) 1777 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:06:40.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:06:40.373235+0000 mon.smithi067 (mon.1) 1778 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:06:40.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:38.947226+0000 mgr.smithi067.rdualw (mgr.24569) 11766 : cluster [DBG] pgmap v10132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:40.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:06:40.370766+0000 mon.smithi067 (mon.1) 1776 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:06:40.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:06:40.372287+0000 mon.smithi067 (mon.1) 1777 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:06:40.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:06:40.373235+0000 mon.smithi067 (mon.1) 1778 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:06:41.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:06:40.374065+0000 mgr.smithi067.rdualw (mgr.24569) 11767 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:06:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:06:40.788815+0000 mon.smithi061 (mon.0) 2456 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:06:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:06:40.794754+0000 mon.smithi061 (mon.0) 2457 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:06:41.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:06:40.374065+0000 mgr.smithi067.rdualw (mgr.24569) 11767 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:06:41.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:06:40.788815+0000 mon.smithi061 (mon.0) 2456 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:06:41.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:06:40.794754+0000 mon.smithi061 (mon.0) 2457 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:06:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:40.948151+0000 mgr.smithi067.rdualw (mgr.24569) 11768 : cluster [DBG] pgmap v10133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:40.948151+0000 mgr.smithi067.rdualw (mgr.24569) 11768 : cluster [DBG] pgmap v10133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:42.948643+0000 mgr.smithi067.rdualw (mgr.24569) 11769 : cluster [DBG] pgmap v10134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:42.948643+0000 mgr.smithi067.rdualw (mgr.24569) 11769 : cluster [DBG] pgmap v10134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:44.949377+0000 mgr.smithi067.rdualw (mgr.24569) 11770 : cluster [DBG] pgmap v10135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:46.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:44.949377+0000 mgr.smithi067.rdualw (mgr.24569) 11770 : cluster [DBG] pgmap v10135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:46.950462+0000 mgr.smithi067.rdualw (mgr.24569) 11771 : cluster [DBG] pgmap v10136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:06:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:46.950462+0000 mgr.smithi067.rdualw (mgr.24569) 11771 : cluster [DBG] pgmap v10136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:06:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:48.951304+0000 mgr.smithi067.rdualw (mgr.24569) 11772 : cluster [DBG] pgmap v10137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:48.951304+0000 mgr.smithi067.rdualw (mgr.24569) 11772 : cluster [DBG] pgmap v10137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:50.952221+0000 mgr.smithi067.rdualw (mgr.24569) 11773 : cluster [DBG] pgmap v10138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:50.952221+0000 mgr.smithi067.rdualw (mgr.24569) 11773 : cluster [DBG] pgmap v10138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:54.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:52.952719+0000 mgr.smithi067.rdualw (mgr.24569) 11774 : cluster [DBG] pgmap v10139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:52.952719+0000 mgr.smithi067.rdualw (mgr.24569) 11774 : cluster [DBG] pgmap v10139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:54.953460+0000 mgr.smithi067.rdualw (mgr.24569) 11775 : cluster [DBG] pgmap v10140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:54.953460+0000 mgr.smithi067.rdualw (mgr.24569) 11775 : cluster [DBG] pgmap v10140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:06:58.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:06:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:56.954479+0000 mgr.smithi067.rdualw (mgr.24569) 11776 : cluster [DBG] pgmap v10141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:06:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:06:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:56.954479+0000 mgr.smithi067.rdualw (mgr.24569) 11776 : cluster [DBG] pgmap v10141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:07:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:06:58.955237+0000 mgr.smithi067.rdualw (mgr.24569) 11777 : cluster [DBG] pgmap v10142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:06:58.955237+0000 mgr.smithi067.rdualw (mgr.24569) 11777 : cluster [DBG] pgmap v10142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:02.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:00.956177+0000 mgr.smithi067.rdualw (mgr.24569) 11778 : cluster [DBG] pgmap v10143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:00.956177+0000 mgr.smithi067.rdualw (mgr.24569) 11778 : cluster [DBG] pgmap v10143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:02.956753+0000 mgr.smithi067.rdualw (mgr.24569) 11779 : cluster [DBG] pgmap v10144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:02.956753+0000 mgr.smithi067.rdualw (mgr.24569) 11779 : cluster [DBG] pgmap v10144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:04.957470+0000 mgr.smithi067.rdualw (mgr.24569) 11780 : cluster [DBG] pgmap v10145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:04.957470+0000 mgr.smithi067.rdualw (mgr.24569) 11780 : cluster [DBG] pgmap v10145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:08.094 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:07:08.387 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:07:08.387 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 9m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:07:08.388 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 9m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:07:08.388 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 9m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:07:08.388 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 9m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:07:08.390 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 9m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:07:08.390 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 9m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:07:08.390 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 9m ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:07:08.390 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 9m ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:07:08.391 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 9m ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:07:08.391 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 9m ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:07:08.391 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 9m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:07:08.391 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 9m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:07:08.392 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 9m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:07:08.392 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 9m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:07:08.392 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 9m ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:07:08.392 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 9m ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:07:08.393 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 9m ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:07:08.393 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 9m ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:07:08.393 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 9m ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:07:08.393 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 9m ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:07:08.393 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 9m ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:07:08.394 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 9m ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:07:08.394 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 9m ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:07:08.730 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:07:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:07:08.730 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:07:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:07:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:07:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:07:08.731 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:07:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:07:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:07:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:07:08.732 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:07:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:07:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:07:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:07:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:07:08.733 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:07:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:07:08.734 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:07:08.734 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:07:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:06.958278+0000 mgr.smithi067.rdualw (mgr.24569) 11781 : cluster [DBG] pgmap v10146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:07:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:06.958278+0000 mgr.smithi067.rdualw (mgr.24569) 11781 : cluster [DBG] pgmap v10146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:07:09.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:08.080446+0000 mgr.smithi067.rdualw (mgr.24569) 11782 : audit [DBG] from='client.41998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:07:09.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:08.368727+0000 mgr.smithi067.rdualw (mgr.24569) 11783 : audit [DBG] from='client.42002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:07:09.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:08.728418+0000 mon.smithi061 (mon.0) 2458 : audit [DBG] from='client.? 172.21.15.61:0/1934730893' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:07:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:08.080446+0000 mgr.smithi067.rdualw (mgr.24569) 11782 : audit [DBG] from='client.41998 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:07:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:08.368727+0000 mgr.smithi067.rdualw (mgr.24569) 11783 : audit [DBG] from='client.42002 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:07:09.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:08.728418+0000 mon.smithi061 (mon.0) 2458 : audit [DBG] from='client.? 172.21.15.61:0/1934730893' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:07:10.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:08.958802+0000 mgr.smithi067.rdualw (mgr.24569) 11784 : cluster [DBG] pgmap v10147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:08.958802+0000 mgr.smithi067.rdualw (mgr.24569) 11784 : cluster [DBG] pgmap v10147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:10.959692+0000 mgr.smithi067.rdualw (mgr.24569) 11785 : cluster [DBG] pgmap v10148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:10.959692+0000 mgr.smithi067.rdualw (mgr.24569) 11785 : cluster [DBG] pgmap v10148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:12.960367+0000 mgr.smithi067.rdualw (mgr.24569) 11786 : cluster [DBG] pgmap v10149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:12.960367+0000 mgr.smithi067.rdualw (mgr.24569) 11786 : cluster [DBG] pgmap v10149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:14.960933+0000 mgr.smithi067.rdualw (mgr.24569) 11787 : cluster [DBG] pgmap v10150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:14.960933+0000 mgr.smithi067.rdualw (mgr.24569) 11787 : cluster [DBG] pgmap v10150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:16.961987+0000 mgr.smithi067.rdualw (mgr.24569) 11788 : cluster [DBG] pgmap v10151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:07:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:16.961987+0000 mgr.smithi067.rdualw (mgr.24569) 11788 : cluster [DBG] pgmap v10151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:07:20.805 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:18.962750+0000 mgr.smithi067.rdualw (mgr.24569) 11789 : cluster [DBG] pgmap v10152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:18.962750+0000 mgr.smithi067.rdualw (mgr.24569) 11789 : cluster [DBG] pgmap v10152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:20.963559+0000 mgr.smithi067.rdualw (mgr.24569) 11790 : cluster [DBG] pgmap v10153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:20.963559+0000 mgr.smithi067.rdualw (mgr.24569) 11790 : cluster [DBG] pgmap v10153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:22.964195+0000 mgr.smithi067.rdualw (mgr.24569) 11791 : cluster [DBG] pgmap v10154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:22.964195+0000 mgr.smithi067.rdualw (mgr.24569) 11791 : cluster [DBG] pgmap v10154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:24.965019+0000 mgr.smithi067.rdualw (mgr.24569) 11792 : cluster [DBG] pgmap v10155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:24.965019+0000 mgr.smithi067.rdualw (mgr.24569) 11792 : cluster [DBG] pgmap v10155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:26.965975+0000 mgr.smithi067.rdualw (mgr.24569) 11793 : cluster [DBG] pgmap v10156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:07:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:26.965975+0000 mgr.smithi067.rdualw (mgr.24569) 11793 : cluster [DBG] pgmap v10156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:07:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:28.966592+0000 mgr.smithi067.rdualw (mgr.24569) 11794 : cluster [DBG] pgmap v10157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:28.966592+0000 mgr.smithi067.rdualw (mgr.24569) 11794 : cluster [DBG] pgmap v10157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:30.967447+0000 mgr.smithi067.rdualw (mgr.24569) 11795 : cluster [DBG] pgmap v10158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:30.967447+0000 mgr.smithi067.rdualw (mgr.24569) 11795 : cluster [DBG] pgmap v10158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:34.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:32.967974+0000 mgr.smithi067.rdualw (mgr.24569) 11796 : cluster [DBG] pgmap v10159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:32.967974+0000 mgr.smithi067.rdualw (mgr.24569) 11796 : cluster [DBG] pgmap v10159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:34.968627+0000 mgr.smithi067.rdualw (mgr.24569) 11797 : cluster [DBG] pgmap v10160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:36.325156+0000 mon.smithi067 (mon.1) 1779 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:07:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:36.325508+0000 mon.smithi067 (mon.1) 1780 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:07:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:36.325980+0000 mon.smithi061 (mon.0) 2459 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:07:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:36.326302+0000 mon.smithi061 (mon.0) 2460 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:07:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:34.968627+0000 mgr.smithi067.rdualw (mgr.24569) 11797 : cluster [DBG] pgmap v10160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:36.325156+0000 mon.smithi067 (mon.1) 1779 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:07:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:36.325508+0000 mon.smithi067 (mon.1) 1780 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:07:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:36.325980+0000 mon.smithi061 (mon.0) 2459 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:07:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:36.326302+0000 mon.smithi061 (mon.0) 2460 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:07:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:36.969624+0000 mgr.smithi067.rdualw (mgr.24569) 11798 : cluster [DBG] pgmap v10161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:07:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:36.969624+0000 mgr.smithi067.rdualw (mgr.24569) 11798 : cluster [DBG] pgmap v10161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:07:39.039 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:07:39.335 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:07:39.335 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 10m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:07:39.336 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 10m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:07:39.336 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 10m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:07:39.336 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 10m ago 5h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:07:39.336 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 10m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:07:39.337 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 10m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:07:39.337 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 10m ago 5h 492M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:07:39.337 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 10m ago 5h 660M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:07:39.337 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 10m ago 5h 1981M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:07:39.337 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 10m ago 5h 1129M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:07:39.338 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 10m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:07:39.338 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 10m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:07:39.338 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 10m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:07:39.339 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 10m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:07:39.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 10m ago 5h 1317M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:07:39.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 10m ago 5h 2235M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:07:39.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 10m ago 5h 1408M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:07:39.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 10m ago 5h 2390M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:07:39.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 10m ago 5h 2201M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:07:39.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 10m ago 5h 2350M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:07:39.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 10m ago 5h 1931M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:07:39.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 10m ago 5h 2918M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:07:39.341 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 10m ago 5h 167M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:07:39.675 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:07:39.675 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:07:39.676 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:07:39.676 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:07:39.677 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:07:39.677 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:07:39.678 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:07:39.678 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:07:39.678 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:07:39.679 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:07:39.679 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:07:39.680 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:07:39.680 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:07:39.680 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:07:39.681 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:07:39.681 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:07:39.681 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:07:39.682 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:07:39.682 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:07:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:38.970248+0000 mgr.smithi067.rdualw (mgr.24569) 11799 : cluster [DBG] pgmap v10162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:39.025219+0000 mgr.smithi067.rdualw (mgr.24569) 11800 : audit [DBG] from='client.42010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:07:40.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:39.316763+0000 mgr.smithi067.rdualw (mgr.24569) 11801 : audit [DBG] from='client.42014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:07:40.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:39.673055+0000 mon.smithi061 (mon.0) 2461 : audit [DBG] from='client.? 172.21.15.61:0/2000762320' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:07:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:38.970248+0000 mgr.smithi067.rdualw (mgr.24569) 11799 : cluster [DBG] pgmap v10162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:39.025219+0000 mgr.smithi067.rdualw (mgr.24569) 11800 : audit [DBG] from='client.42010 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:07:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:39.316763+0000 mgr.smithi067.rdualw (mgr.24569) 11801 : audit [DBG] from='client.42014 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:07:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:39.673055+0000 mon.smithi061 (mon.0) 2461 : audit [DBG] from='client.? 172.21.15.61:0/2000762320' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:07:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:40.800546+0000 mon.smithi067 (mon.1) 1781 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:07:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:40.801987+0000 mon.smithi067 (mon.1) 1782 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:07:41.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:40.802952+0000 mon.smithi067 (mon.1) 1783 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:07:41.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:40.800546+0000 mon.smithi067 (mon.1) 1781 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:07:41.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:40.801987+0000 mon.smithi067 (mon.1) 1782 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:07:41.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:40.802952+0000 mon.smithi067 (mon.1) 1783 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:07:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:07:40.803830+0000 mgr.smithi067.rdualw (mgr.24569) 11802 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:07:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:40.971035+0000 mgr.smithi067.rdualw (mgr.24569) 11803 : cluster [DBG] pgmap v10163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:07:40.803830+0000 mgr.smithi067.rdualw (mgr.24569) 11802 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:07:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:40.971035+0000 mgr.smithi067.rdualw (mgr.24569) 11803 : cluster [DBG] pgmap v10163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:42.971712+0000 mgr.smithi067.rdualw (mgr.24569) 11804 : cluster [DBG] pgmap v10164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:42.971712+0000 mgr.smithi067.rdualw (mgr.24569) 11804 : cluster [DBG] pgmap v10164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:44.972245+0000 mgr.smithi067.rdualw (mgr.24569) 11805 : cluster [DBG] pgmap v10165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:45.396203+0000 mon.smithi061 (mon.0) 2462 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:07:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:45.695232+0000 mon.smithi067 (mon.1) 1784 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:07:46.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:45.696092+0000 mon.smithi061 (mon.0) 2463 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:07:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:44.972245+0000 mgr.smithi067.rdualw (mgr.24569) 11805 : cluster [DBG] pgmap v10165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:45.396203+0000 mon.smithi061 (mon.0) 2462 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:07:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:45.695232+0000 mon.smithi067 (mon.1) 1784 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:07:46.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:45.696092+0000 mon.smithi061 (mon.0) 2463 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:07:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:46.973150+0000 mgr.smithi067.rdualw (mgr.24569) 11806 : cluster [DBG] pgmap v10166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:07:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:47.735544+0000 mon.smithi061 (mon.0) 2464 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:07:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:48.141463+0000 mon.smithi067 (mon.1) 1785 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:07:48.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:48.142227+0000 mon.smithi061 (mon.0) 2465 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:07:48.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:48.146980+0000 mon.smithi061 (mon.0) 2466 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:07:48.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:07:48.154214+0000 mon.smithi061 (mon.0) 2467 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:07:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:46.973150+0000 mgr.smithi067.rdualw (mgr.24569) 11806 : cluster [DBG] pgmap v10166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:07:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:47.735544+0000 mon.smithi061 (mon.0) 2464 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:07:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:48.141463+0000 mon.smithi067 (mon.1) 1785 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:07:48.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:48.142227+0000 mon.smithi061 (mon.0) 2465 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:07:48.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:48.146980+0000 mon.smithi061 (mon.0) 2466 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:07:48.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:07:48.154214+0000 mon.smithi061 (mon.0) 2467 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:07:50.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:48.973832+0000 mgr.smithi067.rdualw (mgr.24569) 11807 : cluster [DBG] pgmap v10167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:48.973832+0000 mgr.smithi067.rdualw (mgr.24569) 11807 : cluster [DBG] pgmap v10167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:50.974595+0000 mgr.smithi067.rdualw (mgr.24569) 11808 : cluster [DBG] pgmap v10168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:52.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:50.974595+0000 mgr.smithi067.rdualw (mgr.24569) 11808 : cluster [DBG] pgmap v10168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:52.975112+0000 mgr.smithi067.rdualw (mgr.24569) 11809 : cluster [DBG] pgmap v10169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:52.975112+0000 mgr.smithi067.rdualw (mgr.24569) 11809 : cluster [DBG] pgmap v10169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:54.975773+0000 mgr.smithi067.rdualw (mgr.24569) 11810 : cluster [DBG] pgmap v10170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:54.975773+0000 mgr.smithi067.rdualw (mgr.24569) 11810 : cluster [DBG] pgmap v10170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:07:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:07:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:56.976745+0000 mgr.smithi067.rdualw (mgr.24569) 11811 : cluster [DBG] pgmap v10171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:07:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:07:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:56.976745+0000 mgr.smithi067.rdualw (mgr.24569) 11811 : cluster [DBG] pgmap v10171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:08:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:07:58.977322+0000 mgr.smithi067.rdualw (mgr.24569) 11812 : cluster [DBG] pgmap v10172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:07:58.977322+0000 mgr.smithi067.rdualw (mgr.24569) 11812 : cluster [DBG] pgmap v10172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:00.978272+0000 mgr.smithi067.rdualw (mgr.24569) 11813 : cluster [DBG] pgmap v10173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:00.978272+0000 mgr.smithi067.rdualw (mgr.24569) 11813 : cluster [DBG] pgmap v10173: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:02.978834+0000 mgr.smithi067.rdualw (mgr.24569) 11814 : cluster [DBG] pgmap v10174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:02.978834+0000 mgr.smithi067.rdualw (mgr.24569) 11814 : cluster [DBG] pgmap v10174: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:04.979440+0000 mgr.smithi067.rdualw (mgr.24569) 11815 : cluster [DBG] pgmap v10175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:04.979440+0000 mgr.smithi067.rdualw (mgr.24569) 11815 : cluster [DBG] pgmap v10175: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:06.980476+0000 mgr.smithi067.rdualw (mgr.24569) 11816 : cluster [DBG] pgmap v10176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:08:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:06.980476+0000 mgr.smithi067.rdualw (mgr.24569) 11816 : cluster [DBG] pgmap v10176: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:08:09.984 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:08:10.272 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:08:10.273 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 22s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:08:10.273 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 22s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:08:10.274 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 24s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:08:10.274 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 22s ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:08:10.274 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 22s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:08:10.274 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 24s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:08:10.274 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 22s ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:08:10.275 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 24s ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:08:10.275 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 22s ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:08:10.275 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 24s ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:08:10.275 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 22s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:08:10.276 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 24s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:08:10.276 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 22s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:08:10.276 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 24s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:08:10.276 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 22s ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:08:10.277 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 22s ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:08:10.277 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 22s ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:08:10.277 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 22s ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:08:10.277 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 24s ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:08:10.277 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 24s ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:08:10.278 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 24s ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:08:10.278 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 24s ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:08:10.278 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 22s ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:08:10.616 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:08:10.616 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:08:10.616 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:08:10.616 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:08:10.617 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:08:10.617 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:08:10.617 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:08:10.617 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:08:10.618 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:08:10.618 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:08:10.618 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:08:10.618 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:08:10.619 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:08:10.619 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:08:10.619 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:08:10.619 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:08:10.619 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:08:10.620 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:08:10.620 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:08:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:08.981080+0000 mgr.smithi067.rdualw (mgr.24569) 11817 : cluster [DBG] pgmap v10177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:08.981080+0000 mgr.smithi067.rdualw (mgr.24569) 11817 : cluster [DBG] pgmap v10177: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:11.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:08:09.969702+0000 mgr.smithi067.rdualw (mgr.24569) 11818 : audit [DBG] from='client.42022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:08:11.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:08:10.254719+0000 mgr.smithi067.rdualw (mgr.24569) 11819 : audit [DBG] from='client.42026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:08:11.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:08:10.614389+0000 mon.smithi061 (mon.0) 2468 : audit [DBG] from='client.? 172.21.15.61:0/2769390494' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:08:11.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:08:09.969702+0000 mgr.smithi067.rdualw (mgr.24569) 11818 : audit [DBG] from='client.42022 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:08:11.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:08:10.254719+0000 mgr.smithi067.rdualw (mgr.24569) 11819 : audit [DBG] from='client.42026 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:08:11.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:08:10.614389+0000 mon.smithi061 (mon.0) 2468 : audit [DBG] from='client.? 172.21.15.61:0/2769390494' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:08:12.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:10.981877+0000 mgr.smithi067.rdualw (mgr.24569) 11820 : cluster [DBG] pgmap v10178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:10.981877+0000 mgr.smithi067.rdualw (mgr.24569) 11820 : cluster [DBG] pgmap v10178: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:12.982481+0000 mgr.smithi067.rdualw (mgr.24569) 11821 : cluster [DBG] pgmap v10179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:14.911 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:12.982481+0000 mgr.smithi067.rdualw (mgr.24569) 11821 : cluster [DBG] pgmap v10179: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:14.983188+0000 mgr.smithi067.rdualw (mgr.24569) 11822 : cluster [DBG] pgmap v10180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:14.983188+0000 mgr.smithi067.rdualw (mgr.24569) 11822 : cluster [DBG] pgmap v10180: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:16.984177+0000 mgr.smithi067.rdualw (mgr.24569) 11823 : cluster [DBG] pgmap v10181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:08:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:16.984177+0000 mgr.smithi067.rdualw (mgr.24569) 11823 : cluster [DBG] pgmap v10181: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:08:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:18.984953+0000 mgr.smithi067.rdualw (mgr.24569) 11824 : cluster [DBG] pgmap v10182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:18.984953+0000 mgr.smithi067.rdualw (mgr.24569) 11824 : cluster [DBG] pgmap v10182: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:20.985834+0000 mgr.smithi067.rdualw (mgr.24569) 11825 : cluster [DBG] pgmap v10183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:20.985834+0000 mgr.smithi067.rdualw (mgr.24569) 11825 : cluster [DBG] pgmap v10183: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:22.986310+0000 mgr.smithi067.rdualw (mgr.24569) 11826 : cluster [DBG] pgmap v10184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:22.986310+0000 mgr.smithi067.rdualw (mgr.24569) 11826 : cluster [DBG] pgmap v10184: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:26.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:24.986994+0000 mgr.smithi067.rdualw (mgr.24569) 11827 : cluster [DBG] pgmap v10185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:24.986994+0000 mgr.smithi067.rdualw (mgr.24569) 11827 : cluster [DBG] pgmap v10185: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:26.987860+0000 mgr.smithi067.rdualw (mgr.24569) 11828 : cluster [DBG] pgmap v10186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:08:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:26.987860+0000 mgr.smithi067.rdualw (mgr.24569) 11828 : cluster [DBG] pgmap v10186: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:08:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:28.988408+0000 mgr.smithi067.rdualw (mgr.24569) 11829 : cluster [DBG] pgmap v10187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:28.988408+0000 mgr.smithi067.rdualw (mgr.24569) 11829 : cluster [DBG] pgmap v10187: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:30.989221+0000 mgr.smithi067.rdualw (mgr.24569) 11830 : cluster [DBG] pgmap v10188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:30.989221+0000 mgr.smithi067.rdualw (mgr.24569) 11830 : cluster [DBG] pgmap v10188: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:32.989929+0000 mgr.smithi067.rdualw (mgr.24569) 11831 : cluster [DBG] pgmap v10189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:32.989929+0000 mgr.smithi067.rdualw (mgr.24569) 11831 : cluster [DBG] pgmap v10189: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:34.990496+0000 mgr.smithi067.rdualw (mgr.24569) 11832 : cluster [DBG] pgmap v10190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:08:36.331396+0000 mon.smithi067 (mon.1) 1786 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:08:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:08:36.331682+0000 mon.smithi067 (mon.1) 1787 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:08:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:08:36.332066+0000 mon.smithi061 (mon.0) 2469 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:08:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:08:36.332311+0000 mon.smithi061 (mon.0) 2470 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:08:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:34.990496+0000 mgr.smithi067.rdualw (mgr.24569) 11832 : cluster [DBG] pgmap v10190: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:08:36.331396+0000 mon.smithi067 (mon.1) 1786 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:08:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:08:36.331682+0000 mon.smithi067 (mon.1) 1787 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:08:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:08:36.332066+0000 mon.smithi061 (mon.0) 2469 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:08:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:08:36.332311+0000 mon.smithi061 (mon.0) 2470 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:08:38.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:36.991314+0000 mgr.smithi067.rdualw (mgr.24569) 11833 : cluster [DBG] pgmap v10191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:08:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:36.991314+0000 mgr.smithi067.rdualw (mgr.24569) 11833 : cluster [DBG] pgmap v10191: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:08:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:38.992071+0000 mgr.smithi067.rdualw (mgr.24569) 11834 : cluster [DBG] pgmap v10192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:40.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:38.992071+0000 mgr.smithi067.rdualw (mgr.24569) 11834 : cluster [DBG] pgmap v10192: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:40.923 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:08:41.218 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:08:41.218 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 53s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:08:41.218 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 53s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:08:41.219 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 55s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:08:41.219 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 53s ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:08:41.219 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 53s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:08:41.219 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 55s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:08:41.219 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 53s ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:08:41.220 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 55s ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:08:41.220 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 53s ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:08:41.220 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 55s ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:08:41.220 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 53s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:08:41.221 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 55s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:08:41.221 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 53s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:08:41.221 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 55s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:08:41.221 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 53s ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:08:41.221 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 53s ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:08:41.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 53s ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:08:41.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 53s ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:08:41.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 55s ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:08:41.222 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 55s ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:08:41.223 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 55s ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:08:41.223 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 55s ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:08:41.223 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 53s ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:08:41.589 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:08:41.589 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:08:41.589 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:08:41.590 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:08:41.590 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:08:41.590 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:08:41.590 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:08:41.591 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:08:41.591 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:08:41.591 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:08:41.591 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:08:41.592 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:08:41.592 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:08:41.592 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:08:41.592 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:08:41.592 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:08:41.593 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:08:41.593 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:08:41.593 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:08:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:08:40.909470+0000 mgr.smithi067.rdualw (mgr.24569) 11835 : audit [DBG] from='client.42034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:08:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:40.992900+0000 mgr.smithi067.rdualw (mgr.24569) 11836 : cluster [DBG] pgmap v10193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:42.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:08:41.199407+0000 mgr.smithi067.rdualw (mgr.24569) 11837 : audit [DBG] from='client.42038 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:08:42.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:08:41.587510+0000 mon.smithi061 (mon.0) 2471 : audit [DBG] from='client.? 172.21.15.61:0/3707316462' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:08:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:08:40.909470+0000 mgr.smithi067.rdualw (mgr.24569) 11835 : audit [DBG] from='client.42034 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:08:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:40.992900+0000 mgr.smithi067.rdualw (mgr.24569) 11836 : cluster [DBG] pgmap v10193: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:42.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:08:41.199407+0000 mgr.smithi067.rdualw (mgr.24569) 11837 : audit [DBG] from='client.42038 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:08:42.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:08:41.587510+0000 mon.smithi061 (mon.0) 2471 : audit [DBG] from='client.? 172.21.15.61:0/3707316462' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:08:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:42.993421+0000 mgr.smithi067.rdualw (mgr.24569) 11838 : cluster [DBG] pgmap v10194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:42.993421+0000 mgr.smithi067.rdualw (mgr.24569) 11838 : cluster [DBG] pgmap v10194: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:44.994215+0000 mgr.smithi067.rdualw (mgr.24569) 11839 : cluster [DBG] pgmap v10195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:44.994215+0000 mgr.smithi067.rdualw (mgr.24569) 11839 : cluster [DBG] pgmap v10195: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:46.995075+0000 mgr.smithi067.rdualw (mgr.24569) 11840 : cluster [DBG] pgmap v10196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:08:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:08:48.158147+0000 mon.smithi067 (mon.1) 1788 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:08:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:08:48.159625+0000 mon.smithi067 (mon.1) 1789 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:08:48.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:08:48.160560+0000 mon.smithi067 (mon.1) 1790 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:08:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:46.995075+0000 mgr.smithi067.rdualw (mgr.24569) 11840 : cluster [DBG] pgmap v10196: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:08:48.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:08:48.158147+0000 mon.smithi067 (mon.1) 1788 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:08:48.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:08:48.159625+0000 mon.smithi067 (mon.1) 1789 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:08:48.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:08:48.160560+0000 mon.smithi067 (mon.1) 1790 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:08:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:08:48.161424+0000 mgr.smithi067.rdualw (mgr.24569) 11841 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:08:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:08:48.581114+0000 mon.smithi061 (mon.0) 2472 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:08:49.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:08:48.587093+0000 mon.smithi061 (mon.0) 2473 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:08:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:08:48.161424+0000 mgr.smithi067.rdualw (mgr.24569) 11841 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:08:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:08:48.581114+0000 mon.smithi061 (mon.0) 2472 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:08:49.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:08:48.587093+0000 mon.smithi061 (mon.0) 2473 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:08:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:48.995780+0000 mgr.smithi067.rdualw (mgr.24569) 11842 : cluster [DBG] pgmap v10197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:48.995780+0000 mgr.smithi067.rdualw (mgr.24569) 11842 : cluster [DBG] pgmap v10197: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:50.996681+0000 mgr.smithi067.rdualw (mgr.24569) 11843 : cluster [DBG] pgmap v10198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:50.996681+0000 mgr.smithi067.rdualw (mgr.24569) 11843 : cluster [DBG] pgmap v10198: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:52.997224+0000 mgr.smithi067.rdualw (mgr.24569) 11844 : cluster [DBG] pgmap v10199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:52.997224+0000 mgr.smithi067.rdualw (mgr.24569) 11844 : cluster [DBG] pgmap v10199: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:56.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:54.997822+0000 mgr.smithi067.rdualw (mgr.24569) 11845 : cluster [DBG] pgmap v10200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:54.997822+0000 mgr.smithi067.rdualw (mgr.24569) 11845 : cluster [DBG] pgmap v10200: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:08:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:08:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:56.998820+0000 mgr.smithi067.rdualw (mgr.24569) 11846 : cluster [DBG] pgmap v10201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:08:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:08:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:56.998820+0000 mgr.smithi067.rdualw (mgr.24569) 11846 : cluster [DBG] pgmap v10201: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:09:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:08:58.999384+0000 mgr.smithi067.rdualw (mgr.24569) 11847 : cluster [DBG] pgmap v10202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:08:58.999384+0000 mgr.smithi067.rdualw (mgr.24569) 11847 : cluster [DBG] pgmap v10202: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:01.000230+0000 mgr.smithi067.rdualw (mgr.24569) 11848 : cluster [DBG] pgmap v10203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:01.000230+0000 mgr.smithi067.rdualw (mgr.24569) 11848 : cluster [DBG] pgmap v10203: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:03.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:03.000831+0000 mgr.smithi067.rdualw (mgr.24569) 11849 : cluster [DBG] pgmap v10204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:03.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:03.000831+0000 mgr.smithi067.rdualw (mgr.24569) 11849 : cluster [DBG] pgmap v10204: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:05.001567+0000 mgr.smithi067.rdualw (mgr.24569) 11850 : cluster [DBG] pgmap v10205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:06.752 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:05.001567+0000 mgr.smithi067.rdualw (mgr.24569) 11850 : cluster [DBG] pgmap v10205: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:08.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:07.002380+0000 mgr.smithi067.rdualw (mgr.24569) 11851 : cluster [DBG] pgmap v10206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:09:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:07.002380+0000 mgr.smithi067.rdualw (mgr.24569) 11851 : cluster [DBG] pgmap v10206: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:09:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:09.003099+0000 mgr.smithi067.rdualw (mgr.24569) 11852 : cluster [DBG] pgmap v10207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:09.003099+0000 mgr.smithi067.rdualw (mgr.24569) 11852 : cluster [DBG] pgmap v10207: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:11.905 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:09:12.201 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:09:12.201 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 84s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:09:12.202 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 84s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:09:12.202 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 86s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:09:12.203 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 84s ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:09:12.203 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 84s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:09:12.204 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 86s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:09:12.204 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 84s ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:09:12.205 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 86s ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:09:12.205 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 84s ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:09:12.206 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 86s ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:09:12.206 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 84s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:09:12.206 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 86s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:09:12.207 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 84s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:09:12.207 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 86s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:09:12.208 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 84s ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:09:12.209 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 84s ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:09:12.209 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 84s ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:09:12.210 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 84s ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:09:12.210 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 86s ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:09:12.211 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 86s ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:09:12.211 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 86s ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:09:12.212 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 86s ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:09:12.212 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 84s ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:09:12.557 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:09:12.558 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:09:12.558 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:09:12.559 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:09:12.559 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:09:12.559 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:09:12.559 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:09:12.560 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:09:12.560 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:09:12.560 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:09:12.560 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:09:12.561 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:09:12.561 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:09:12.561 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:09:12.561 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:09:12.561 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:09:12.562 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:09:12.562 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:09:12.562 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:09:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:11.004099+0000 mgr.smithi067.rdualw (mgr.24569) 11853 : cluster [DBG] pgmap v10208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:11.004099+0000 mgr.smithi067.rdualw (mgr.24569) 11853 : cluster [DBG] pgmap v10208: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:13.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:09:11.890953+0000 mgr.smithi067.rdualw (mgr.24569) 11854 : audit [DBG] from='client.42046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:09:13.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:09:12.182701+0000 mgr.smithi067.rdualw (mgr.24569) 11855 : audit [DBG] from='client.42050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:09:13.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:09:12.555724+0000 mon.smithi061 (mon.0) 2474 : audit [DBG] from='client.? 172.21.15.61:0/2335227084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:09:13.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:09:11.890953+0000 mgr.smithi067.rdualw (mgr.24569) 11854 : audit [DBG] from='client.42046 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:09:13.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:09:12.182701+0000 mgr.smithi067.rdualw (mgr.24569) 11855 : audit [DBG] from='client.42050 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:09:13.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:09:12.555724+0000 mon.smithi061 (mon.0) 2474 : audit [DBG] from='client.? 172.21.15.61:0/2335227084' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:09:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:13.004626+0000 mgr.smithi067.rdualw (mgr.24569) 11856 : cluster [DBG] pgmap v10209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:13.004626+0000 mgr.smithi067.rdualw (mgr.24569) 11856 : cluster [DBG] pgmap v10209: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:15.005146+0000 mgr.smithi067.rdualw (mgr.24569) 11857 : cluster [DBG] pgmap v10210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:15.005146+0000 mgr.smithi067.rdualw (mgr.24569) 11857 : cluster [DBG] pgmap v10210: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:17.006169+0000 mgr.smithi067.rdualw (mgr.24569) 11858 : cluster [DBG] pgmap v10211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:09:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:17.006169+0000 mgr.smithi067.rdualw (mgr.24569) 11858 : cluster [DBG] pgmap v10211: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:09:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:19.006717+0000 mgr.smithi067.rdualw (mgr.24569) 11859 : cluster [DBG] pgmap v10212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:19.006717+0000 mgr.smithi067.rdualw (mgr.24569) 11859 : cluster [DBG] pgmap v10212: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:21.007662+0000 mgr.smithi067.rdualw (mgr.24569) 11860 : cluster [DBG] pgmap v10213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:21.007662+0000 mgr.smithi067.rdualw (mgr.24569) 11860 : cluster [DBG] pgmap v10213: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:23.008205+0000 mgr.smithi067.rdualw (mgr.24569) 11861 : cluster [DBG] pgmap v10214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:23.008205+0000 mgr.smithi067.rdualw (mgr.24569) 11861 : cluster [DBG] pgmap v10214: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:25.009000+0000 mgr.smithi067.rdualw (mgr.24569) 11862 : cluster [DBG] pgmap v10215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:25.009000+0000 mgr.smithi067.rdualw (mgr.24569) 11862 : cluster [DBG] pgmap v10215: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:27.009863+0000 mgr.smithi067.rdualw (mgr.24569) 11863 : cluster [DBG] pgmap v10216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:09:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:27.009863+0000 mgr.smithi067.rdualw (mgr.24569) 11863 : cluster [DBG] pgmap v10216: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:09:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:29.010531+0000 mgr.smithi067.rdualw (mgr.24569) 11864 : cluster [DBG] pgmap v10217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:29.010531+0000 mgr.smithi067.rdualw (mgr.24569) 11864 : cluster [DBG] pgmap v10217: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:32.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:31.011459+0000 mgr.smithi067.rdualw (mgr.24569) 11865 : cluster [DBG] pgmap v10218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:31.011459+0000 mgr.smithi067.rdualw (mgr.24569) 11865 : cluster [DBG] pgmap v10218: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:33.011929+0000 mgr.smithi067.rdualw (mgr.24569) 11866 : cluster [DBG] pgmap v10219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:33.011929+0000 mgr.smithi067.rdualw (mgr.24569) 11866 : cluster [DBG] pgmap v10219: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:35.012599+0000 mgr.smithi067.rdualw (mgr.24569) 11867 : cluster [DBG] pgmap v10220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:09:36.337280+0000 mon.smithi067 (mon.1) 1791 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:09:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:09:36.337524+0000 mon.smithi067 (mon.1) 1792 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:09:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:09:36.337899+0000 mon.smithi061 (mon.0) 2475 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:09:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:09:36.338376+0000 mon.smithi061 (mon.0) 2476 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:09:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:35.012599+0000 mgr.smithi067.rdualw (mgr.24569) 11867 : cluster [DBG] pgmap v10220: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:09:36.337280+0000 mon.smithi067 (mon.1) 1791 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:09:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:09:36.337524+0000 mon.smithi067 (mon.1) 1792 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:09:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:09:36.337899+0000 mon.smithi061 (mon.0) 2475 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:09:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:09:36.338376+0000 mon.smithi061 (mon.0) 2476 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:09:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:37.013377+0000 mgr.smithi067.rdualw (mgr.24569) 11868 : cluster [DBG] pgmap v10221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:09:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:37.013377+0000 mgr.smithi067.rdualw (mgr.24569) 11868 : cluster [DBG] pgmap v10221: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:09:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:39.013911+0000 mgr.smithi067.rdualw (mgr.24569) 11869 : cluster [DBG] pgmap v10222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:39.013911+0000 mgr.smithi067.rdualw (mgr.24569) 11869 : cluster [DBG] pgmap v10222: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:41.014725+0000 mgr.smithi067.rdualw (mgr.24569) 11870 : cluster [DBG] pgmap v10223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:41.014725+0000 mgr.smithi067.rdualw (mgr.24569) 11870 : cluster [DBG] pgmap v10223: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:42.869 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:09:43.161 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:09:43.162 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 115s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:09:43.162 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 115s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:09:43.162 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 117s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:09:43.163 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 115s ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:09:43.163 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 115s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:09:43.163 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 117s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:09:43.163 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 115s ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:09:43.163 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 117s ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:09:43.164 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 115s ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:09:43.164 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 117s ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:09:43.164 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 115s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:09:43.164 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 117s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:09:43.165 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 115s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:09:43.165 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 117s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:09:43.165 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 115s ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:09:43.165 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 115s ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:09:43.165 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 115s ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:09:43.166 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 115s ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:09:43.166 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 117s ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:09:43.166 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 117s ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:09:43.167 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 117s ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:09:43.167 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 117s ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:09:43.167 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 115s ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:09:43.503 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:09:43.504 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:09:43.504 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:09:43.505 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:09:43.505 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:09:43.505 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:09:43.506 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:09:43.506 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:09:43.507 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:09:43.507 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:09:43.508 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:09:43.508 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:09:43.508 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:09:43.509 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:09:43.509 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:09:43.510 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:09:43.510 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:09:43.511 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:09:43.511 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:09:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:09:42.855636+0000 mgr.smithi067.rdualw (mgr.24569) 11871 : audit [DBG] from='client.42058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:09:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:43.015212+0000 mgr.smithi067.rdualw (mgr.24569) 11872 : cluster [DBG] pgmap v10224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:09:43.143705+0000 mgr.smithi067.rdualw (mgr.24569) 11873 : audit [DBG] from='client.42062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:09:44.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:09:43.501780+0000 mon.smithi061 (mon.0) 2477 : audit [DBG] from='client.? 172.21.15.61:0/3788819785' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:09:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:09:42.855636+0000 mgr.smithi067.rdualw (mgr.24569) 11871 : audit [DBG] from='client.42058 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:09:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:43.015212+0000 mgr.smithi067.rdualw (mgr.24569) 11872 : cluster [DBG] pgmap v10224: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:09:43.143705+0000 mgr.smithi067.rdualw (mgr.24569) 11873 : audit [DBG] from='client.42062 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:09:44.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:09:43.501780+0000 mon.smithi061 (mon.0) 2477 : audit [DBG] from='client.? 172.21.15.61:0/3788819785' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:09:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:45.015866+0000 mgr.smithi067.rdualw (mgr.24569) 11874 : cluster [DBG] pgmap v10225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:45.015866+0000 mgr.smithi067.rdualw (mgr.24569) 11874 : cluster [DBG] pgmap v10225: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:47.016736+0000 mgr.smithi067.rdualw (mgr.24569) 11875 : cluster [DBG] pgmap v10226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:09:48.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:47.016736+0000 mgr.smithi067.rdualw (mgr.24569) 11875 : cluster [DBG] pgmap v10226: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:09:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:09:48.591675+0000 mon.smithi067 (mon.1) 1793 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:09:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:09:48.593194+0000 mon.smithi067 (mon.1) 1794 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:09:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:09:48.594174+0000 mon.smithi067 (mon.1) 1795 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:09:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:09:48.958197+0000 mon.smithi061 (mon.0) 2478 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:09:49.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:09:48.963868+0000 mon.smithi061 (mon.0) 2479 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:09:49.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:09:49.368070+0000 mon.smithi061 (mon.0) 2480 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:09:49.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:09:49.375944+0000 mon.smithi061 (mon.0) 2481 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:09:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:09:48.591675+0000 mon.smithi067 (mon.1) 1793 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:09:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:09:48.593194+0000 mon.smithi067 (mon.1) 1794 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:09:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:09:48.594174+0000 mon.smithi067 (mon.1) 1795 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:09:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:09:48.958197+0000 mon.smithi061 (mon.0) 2478 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:09:49.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:09:48.963868+0000 mon.smithi061 (mon.0) 2479 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:09:49.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:09:49.368070+0000 mon.smithi061 (mon.0) 2480 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:09:49.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:09:49.375944+0000 mon.smithi061 (mon.0) 2481 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:09:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:09:48.595062+0000 mgr.smithi067.rdualw (mgr.24569) 11876 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:09:50.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:49.017261+0000 mgr.smithi067.rdualw (mgr.24569) 11877 : cluster [DBG] pgmap v10227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:09:48.595062+0000 mgr.smithi067.rdualw (mgr.24569) 11876 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:09:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:49.017261+0000 mgr.smithi067.rdualw (mgr.24569) 11877 : cluster [DBG] pgmap v10227: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:52.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:51.018210+0000 mgr.smithi067.rdualw (mgr.24569) 11878 : cluster [DBG] pgmap v10228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:51.018210+0000 mgr.smithi067.rdualw (mgr.24569) 11878 : cluster [DBG] pgmap v10228: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:53.018950+0000 mgr.smithi067.rdualw (mgr.24569) 11879 : cluster [DBG] pgmap v10229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:53.018950+0000 mgr.smithi067.rdualw (mgr.24569) 11879 : cluster [DBG] pgmap v10229: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:56.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:55.019654+0000 mgr.smithi067.rdualw (mgr.24569) 11880 : cluster [DBG] pgmap v10230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:55.019654+0000 mgr.smithi067.rdualw (mgr.24569) 11880 : cluster [DBG] pgmap v10230: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:09:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:09:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:57.020474+0000 mgr.smithi067.rdualw (mgr.24569) 11881 : cluster [DBG] pgmap v10231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:09:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:09:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:57.020474+0000 mgr.smithi067.rdualw (mgr.24569) 11881 : cluster [DBG] pgmap v10231: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:10:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:09:59.021191+0000 mgr.smithi067.rdualw (mgr.24569) 11882 : cluster [DBG] pgmap v10232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:00.000164+0000 mon.smithi061 (mon.0) 2482 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T21:10:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:09:59.021191+0000 mgr.smithi067.rdualw (mgr.24569) 11882 : cluster [DBG] pgmap v10232: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:00.000164+0000 mon.smithi061 (mon.0) 2482 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T21:10:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:01.022077+0000 mgr.smithi067.rdualw (mgr.24569) 11883 : cluster [DBG] pgmap v10233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:01.022077+0000 mgr.smithi067.rdualw (mgr.24569) 11883 : cluster [DBG] pgmap v10233: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:03.022551+0000 mgr.smithi067.rdualw (mgr.24569) 11884 : cluster [DBG] pgmap v10234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:04.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:03.022551+0000 mgr.smithi067.rdualw (mgr.24569) 11884 : cluster [DBG] pgmap v10234: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:05.023093+0000 mgr.smithi067.rdualw (mgr.24569) 11885 : cluster [DBG] pgmap v10235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:05.023093+0000 mgr.smithi067.rdualw (mgr.24569) 11885 : cluster [DBG] pgmap v10235: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:08.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:07.024083+0000 mgr.smithi067.rdualw (mgr.24569) 11886 : cluster [DBG] pgmap v10236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:10:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:07.024083+0000 mgr.smithi067.rdualw (mgr.24569) 11886 : cluster [DBG] pgmap v10236: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:10:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:09.024795+0000 mgr.smithi067.rdualw (mgr.24569) 11887 : cluster [DBG] pgmap v10237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:09.024795+0000 mgr.smithi067.rdualw (mgr.24569) 11887 : cluster [DBG] pgmap v10237: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:11.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:11.025639+0000 mgr.smithi067.rdualw (mgr.24569) 11888 : cluster [DBG] pgmap v10238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:11.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:11.025639+0000 mgr.smithi067.rdualw (mgr.24569) 11888 : cluster [DBG] pgmap v10238: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:13.810 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:10:14.100 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:10:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 2m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:10:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 2m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:10:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 2m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:10:14.101 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 2m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:10:14.102 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 2m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:10:14.102 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 2m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:10:14.102 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 2m ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:10:14.102 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 2m ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:10:14.102 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 2m ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:10:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 2m ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:10:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 2m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:10:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 2m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:10:14.103 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 2m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:10:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 2m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:10:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 2m ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:10:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 2m ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:10:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 2m ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:10:14.104 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 2m ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:10:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 2m ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:10:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 2m ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:10:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 2m ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:10:14.105 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 2m ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:10:14.106 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 2m ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:10:14.442 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:10:14.442 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:10:14.443 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:10:14.443 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:10:14.443 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:10:14.443 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:10:14.444 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:10:14.444 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:10:14.444 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:10:14.444 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:10:14.445 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:10:14.445 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:10:14.445 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:10:14.445 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:10:14.445 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:10:14.446 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:10:14.446 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:10:14.446 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:10:14.446 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:10:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:13.026257+0000 mgr.smithi067.rdualw (mgr.24569) 11889 : cluster [DBG] pgmap v10239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:13.026257+0000 mgr.smithi067.rdualw (mgr.24569) 11889 : cluster [DBG] pgmap v10239: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:10:13.796387+0000 mgr.smithi067.rdualw (mgr.24569) 11890 : audit [DBG] from='client.42070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:10:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:10:14.082786+0000 mgr.smithi067.rdualw (mgr.24569) 11891 : audit [DBG] from='client.42074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:10:15.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:10:14.440750+0000 mon.smithi061 (mon.0) 2483 : audit [DBG] from='client.? 172.21.15.61:0/1938758688' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:10:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:10:13.796387+0000 mgr.smithi067.rdualw (mgr.24569) 11890 : audit [DBG] from='client.42070 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:10:15.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:10:14.082786+0000 mgr.smithi067.rdualw (mgr.24569) 11891 : audit [DBG] from='client.42074 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:10:15.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:10:14.440750+0000 mon.smithi061 (mon.0) 2483 : audit [DBG] from='client.? 172.21.15.61:0/1938758688' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:10:16.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:15.027025+0000 mgr.smithi067.rdualw (mgr.24569) 11892 : cluster [DBG] pgmap v10240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:15.027025+0000 mgr.smithi067.rdualw (mgr.24569) 11892 : cluster [DBG] pgmap v10240: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:17.027869+0000 mgr.smithi067.rdualw (mgr.24569) 11893 : cluster [DBG] pgmap v10241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:10:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:17.027869+0000 mgr.smithi067.rdualw (mgr.24569) 11893 : cluster [DBG] pgmap v10241: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:10:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:19.028402+0000 mgr.smithi067.rdualw (mgr.24569) 11894 : cluster [DBG] pgmap v10242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:19.028402+0000 mgr.smithi067.rdualw (mgr.24569) 11894 : cluster [DBG] pgmap v10242: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:21.029251+0000 mgr.smithi067.rdualw (mgr.24569) 11895 : cluster [DBG] pgmap v10243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:21.029251+0000 mgr.smithi067.rdualw (mgr.24569) 11895 : cluster [DBG] pgmap v10243: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:24.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:23.029791+0000 mgr.smithi067.rdualw (mgr.24569) 11896 : cluster [DBG] pgmap v10244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:23.029791+0000 mgr.smithi067.rdualw (mgr.24569) 11896 : cluster [DBG] pgmap v10244: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:25.030513+0000 mgr.smithi067.rdualw (mgr.24569) 11897 : cluster [DBG] pgmap v10245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:25.030513+0000 mgr.smithi067.rdualw (mgr.24569) 11897 : cluster [DBG] pgmap v10245: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:27.031604+0000 mgr.smithi067.rdualw (mgr.24569) 11898 : cluster [DBG] pgmap v10246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:10:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:27.031604+0000 mgr.smithi067.rdualw (mgr.24569) 11898 : cluster [DBG] pgmap v10246: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:10:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:29.032209+0000 mgr.smithi067.rdualw (mgr.24569) 11899 : cluster [DBG] pgmap v10247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:29.032209+0000 mgr.smithi067.rdualw (mgr.24569) 11899 : cluster [DBG] pgmap v10247: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:31.033092+0000 mgr.smithi067.rdualw (mgr.24569) 11900 : cluster [DBG] pgmap v10248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:31.033092+0000 mgr.smithi067.rdualw (mgr.24569) 11900 : cluster [DBG] pgmap v10248: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:33.033763+0000 mgr.smithi067.rdualw (mgr.24569) 11901 : cluster [DBG] pgmap v10249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:33.033763+0000 mgr.smithi067.rdualw (mgr.24569) 11901 : cluster [DBG] pgmap v10249: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:35.034395+0000 mgr.smithi067.rdualw (mgr.24569) 11902 : cluster [DBG] pgmap v10250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:10:36.343201+0000 mon.smithi067 (mon.1) 1796 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:10:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:10:36.343461+0000 mon.smithi067 (mon.1) 1797 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:10:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:10:36.343722+0000 mon.smithi061 (mon.0) 2484 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:10:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:10:36.344014+0000 mon.smithi061 (mon.0) 2485 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:10:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:35.034395+0000 mgr.smithi067.rdualw (mgr.24569) 11902 : cluster [DBG] pgmap v10250: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:10:36.343201+0000 mon.smithi067 (mon.1) 1796 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:10:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:10:36.343461+0000 mon.smithi067 (mon.1) 1797 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:10:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:10:36.343722+0000 mon.smithi061 (mon.0) 2484 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:10:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:10:36.344014+0000 mon.smithi061 (mon.0) 2485 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:10:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:37.035220+0000 mgr.smithi067.rdualw (mgr.24569) 11903 : cluster [DBG] pgmap v10251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:10:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:37.035220+0000 mgr.smithi067.rdualw (mgr.24569) 11903 : cluster [DBG] pgmap v10251: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:10:40.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:39.035879+0000 mgr.smithi067.rdualw (mgr.24569) 11904 : cluster [DBG] pgmap v10252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:39.035879+0000 mgr.smithi067.rdualw (mgr.24569) 11904 : cluster [DBG] pgmap v10252: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:41.036766+0000 mgr.smithi067.rdualw (mgr.24569) 11905 : cluster [DBG] pgmap v10253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:41.036766+0000 mgr.smithi067.rdualw (mgr.24569) 11905 : cluster [DBG] pgmap v10253: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:44.755 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:10:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:43.037378+0000 mgr.smithi067.rdualw (mgr.24569) 11906 : cluster [DBG] pgmap v10254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:43.037378+0000 mgr.smithi067.rdualw (mgr.24569) 11906 : cluster [DBG] pgmap v10254: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:45.043 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:10:45.043 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 2m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:10:45.043 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 2m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:10:45.044 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 2m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:10:45.044 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 2m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:10:45.044 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 2m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:10:45.044 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 2m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:10:45.045 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 2m ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:10:45.045 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 2m ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:10:45.045 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 2m ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:10:45.045 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 2m ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:10:45.046 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 2m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:10:45.046 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 2m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:10:45.046 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 2m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:10:45.046 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 2m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:10:45.046 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 2m ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:10:45.047 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 2m ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:10:45.047 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 2m ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:10:45.047 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 2m ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:10:45.047 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 2m ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:10:45.048 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 2m ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:10:45.048 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 2m ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:10:45.050 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 2m ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:10:45.051 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 2m ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:10:45.385 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:10:45.386 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:10:45.386 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:10:45.386 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:10:45.386 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:10:45.387 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:10:45.387 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:10:45.387 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:10:45.387 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:10:45.387 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:10:45.388 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:10:45.388 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:10:45.388 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:10:45.388 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:10:45.389 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:10:45.389 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:10:45.389 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:10:45.389 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:10:45.390 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:10:45.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:10:45.383962+0000 mon.smithi061 (mon.0) 2486 : audit [DBG] from='client.? 172.21.15.61:0/2276527900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:10:45.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:10:45.383962+0000 mon.smithi061 (mon.0) 2486 : audit [DBG] from='client.? 172.21.15.61:0/2276527900' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:10:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:10:44.736469+0000 mgr.smithi067.rdualw (mgr.24569) 11907 : audit [DBG] from='client.42082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:10:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:10:45.024485+0000 mgr.smithi067.rdualw (mgr.24569) 11908 : audit [DBG] from='client.42086 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:10:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:45.037919+0000 mgr.smithi067.rdualw (mgr.24569) 11909 : cluster [DBG] pgmap v10255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:10:44.736469+0000 mgr.smithi067.rdualw (mgr.24569) 11907 : audit [DBG] from='client.42082 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:10:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:10:45.024485+0000 mgr.smithi067.rdualw (mgr.24569) 11908 : audit [DBG] from='client.42086 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:10:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:45.037919+0000 mgr.smithi067.rdualw (mgr.24569) 11909 : cluster [DBG] pgmap v10255: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:48.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:47.038972+0000 mgr.smithi067.rdualw (mgr.24569) 11910 : cluster [DBG] pgmap v10256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:10:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:47.038972+0000 mgr.smithi067.rdualw (mgr.24569) 11910 : cluster [DBG] pgmap v10256: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:10:49.647 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:10:49.379127+0000 mon.smithi067 (mon.1) 1798 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:10:49.647 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:10:49.380560+0000 mon.smithi067 (mon.1) 1799 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:10:49.648 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:10:49.381495+0000 mon.smithi067 (mon.1) 1800 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:10:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:10:49.379127+0000 mon.smithi067 (mon.1) 1798 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:10:49.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:10:49.380560+0000 mon.smithi067 (mon.1) 1799 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:10:49.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:10:49.381495+0000 mon.smithi067 (mon.1) 1800 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:10:50.808 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:49.039712+0000 mgr.smithi067.rdualw (mgr.24569) 11911 : cluster [DBG] pgmap v10257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:50.808 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:10:49.382353+0000 mgr.smithi067.rdualw (mgr.24569) 11912 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:10:50.809 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:10:49.841865+0000 mon.smithi061 (mon.0) 2487 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:10:50.809 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:10:49.849055+0000 mon.smithi061 (mon.0) 2488 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:10:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:49.039712+0000 mgr.smithi067.rdualw (mgr.24569) 11911 : cluster [DBG] pgmap v10257: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:10:49.382353+0000 mgr.smithi067.rdualw (mgr.24569) 11912 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:10:50.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:10:49.841865+0000 mon.smithi061 (mon.0) 2487 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:10:50.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:10:49.849055+0000 mon.smithi061 (mon.0) 2488 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:10:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:51.040557+0000 mgr.smithi067.rdualw (mgr.24569) 11913 : cluster [DBG] pgmap v10258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:52.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:51.040557+0000 mgr.smithi067.rdualw (mgr.24569) 11913 : cluster [DBG] pgmap v10258: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:53.041100+0000 mgr.smithi067.rdualw (mgr.24569) 11914 : cluster [DBG] pgmap v10259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:53.041100+0000 mgr.smithi067.rdualw (mgr.24569) 11914 : cluster [DBG] pgmap v10259: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:55.041722+0000 mgr.smithi067.rdualw (mgr.24569) 11915 : cluster [DBG] pgmap v10260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:55.041722+0000 mgr.smithi067.rdualw (mgr.24569) 11915 : cluster [DBG] pgmap v10260: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:10:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:10:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:57.042832+0000 mgr.smithi067.rdualw (mgr.24569) 11916 : cluster [DBG] pgmap v10261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:10:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:10:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:57.042832+0000 mgr.smithi067.rdualw (mgr.24569) 11916 : cluster [DBG] pgmap v10261: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:11:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:10:59.043642+0000 mgr.smithi067.rdualw (mgr.24569) 11917 : cluster [DBG] pgmap v10262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:10:59.043642+0000 mgr.smithi067.rdualw (mgr.24569) 11917 : cluster [DBG] pgmap v10262: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:01.044431+0000 mgr.smithi067.rdualw (mgr.24569) 11918 : cluster [DBG] pgmap v10263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:01.044431+0000 mgr.smithi067.rdualw (mgr.24569) 11918 : cluster [DBG] pgmap v10263: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:03.044991+0000 mgr.smithi067.rdualw (mgr.24569) 11919 : cluster [DBG] pgmap v10264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:03.044991+0000 mgr.smithi067.rdualw (mgr.24569) 11919 : cluster [DBG] pgmap v10264: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:05.045754+0000 mgr.smithi067.rdualw (mgr.24569) 11920 : cluster [DBG] pgmap v10265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:05.045754+0000 mgr.smithi067.rdualw (mgr.24569) 11920 : cluster [DBG] pgmap v10265: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:08.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:07.046803+0000 mgr.smithi067.rdualw (mgr.24569) 11921 : cluster [DBG] pgmap v10266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:11:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:07.046803+0000 mgr.smithi067.rdualw (mgr.24569) 11921 : cluster [DBG] pgmap v10266: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:11:10.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:09.047398+0000 mgr.smithi067.rdualw (mgr.24569) 11922 : cluster [DBG] pgmap v10267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:09.047398+0000 mgr.smithi067.rdualw (mgr.24569) 11922 : cluster [DBG] pgmap v10267: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:11.048283+0000 mgr.smithi067.rdualw (mgr.24569) 11923 : cluster [DBG] pgmap v10268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:11.048283+0000 mgr.smithi067.rdualw (mgr.24569) 11923 : cluster [DBG] pgmap v10268: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:13.048927+0000 mgr.smithi067.rdualw (mgr.24569) 11924 : cluster [DBG] pgmap v10269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:13.048927+0000 mgr.smithi067.rdualw (mgr.24569) 11924 : cluster [DBG] pgmap v10269: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:15.703 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:11:15.993 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:11:15.994 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 3m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:11:15.994 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 3m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:11:15.994 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 3m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:11:15.995 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 3m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:11:15.995 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 3m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:11:15.995 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 3m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:11:15.995 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 3m ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:11:15.996 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 3m ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:11:15.996 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 3m ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:11:15.996 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 3m ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:11:15.996 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 3m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:11:15.996 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 3m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:11:15.997 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 3m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:11:15.997 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 3m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:11:15.997 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 3m ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:11:15.997 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 3m ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:11:15.998 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 3m ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:11:15.998 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 3m ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:11:15.998 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 3m ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:11:15.998 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 3m ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:11:15.999 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 3m ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:11:15.999 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 3m ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:11:15.999 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 3m ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:11:16.338 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:11:16.339 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:11:16.339 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:11:16.340 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:11:16.340 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:11:16.340 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:11:16.340 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:11:16.341 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:11:16.341 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:11:16.341 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:11:16.341 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:11:16.341 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:11:16.342 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:11:16.342 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:11:16.342 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:11:16.342 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:11:16.343 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:11:16.343 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:11:16.343 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:11:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:15.049601+0000 mgr.smithi067.rdualw (mgr.24569) 11925 : cluster [DBG] pgmap v10270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:11:16.337062+0000 mon.smithi061 (mon.0) 2489 : audit [DBG] from='client.? 172.21.15.61:0/3801720678' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:11:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:15.049601+0000 mgr.smithi067.rdualw (mgr.24569) 11925 : cluster [DBG] pgmap v10270: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:11:16.337062+0000 mon.smithi061 (mon.0) 2489 : audit [DBG] from='client.? 172.21.15.61:0/3801720678' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:11:17.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:11:15.688191+0000 mgr.smithi067.rdualw (mgr.24569) 11926 : audit [DBG] from='client.42094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:11:17.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:11:15.975380+0000 mgr.smithi067.rdualw (mgr.24569) 11927 : audit [DBG] from='client.42098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:11:17.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:11:15.688191+0000 mgr.smithi067.rdualw (mgr.24569) 11926 : audit [DBG] from='client.42094 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:11:17.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:11:15.975380+0000 mgr.smithi067.rdualw (mgr.24569) 11927 : audit [DBG] from='client.42098 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:11:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:17.050482+0000 mgr.smithi067.rdualw (mgr.24569) 11928 : cluster [DBG] pgmap v10271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:11:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:17.050482+0000 mgr.smithi067.rdualw (mgr.24569) 11928 : cluster [DBG] pgmap v10271: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:11:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:19.051193+0000 mgr.smithi067.rdualw (mgr.24569) 11929 : cluster [DBG] pgmap v10272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:19.051193+0000 mgr.smithi067.rdualw (mgr.24569) 11929 : cluster [DBG] pgmap v10272: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:21.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:21.052075+0000 mgr.smithi067.rdualw (mgr.24569) 11930 : cluster [DBG] pgmap v10273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:21.052075+0000 mgr.smithi067.rdualw (mgr.24569) 11930 : cluster [DBG] pgmap v10273: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:23.052655+0000 mgr.smithi067.rdualw (mgr.24569) 11931 : cluster [DBG] pgmap v10274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:24.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:23.052655+0000 mgr.smithi067.rdualw (mgr.24569) 11931 : cluster [DBG] pgmap v10274: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:25.053430+0000 mgr.smithi067.rdualw (mgr.24569) 11932 : cluster [DBG] pgmap v10275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:25.053430+0000 mgr.smithi067.rdualw (mgr.24569) 11932 : cluster [DBG] pgmap v10275: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:28.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:27.054378+0000 mgr.smithi067.rdualw (mgr.24569) 11933 : cluster [DBG] pgmap v10276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:11:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:27.054378+0000 mgr.smithi067.rdualw (mgr.24569) 11933 : cluster [DBG] pgmap v10276: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:11:30.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:29.055055+0000 mgr.smithi067.rdualw (mgr.24569) 11934 : cluster [DBG] pgmap v10277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:29.055055+0000 mgr.smithi067.rdualw (mgr.24569) 11934 : cluster [DBG] pgmap v10277: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:31.055843+0000 mgr.smithi067.rdualw (mgr.24569) 11935 : cluster [DBG] pgmap v10278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:31.055843+0000 mgr.smithi067.rdualw (mgr.24569) 11935 : cluster [DBG] pgmap v10278: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:33.056428+0000 mgr.smithi067.rdualw (mgr.24569) 11936 : cluster [DBG] pgmap v10279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:33.056428+0000 mgr.smithi067.rdualw (mgr.24569) 11936 : cluster [DBG] pgmap v10279: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:35.057206+0000 mgr.smithi067.rdualw (mgr.24569) 11937 : cluster [DBG] pgmap v10280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:11:36.348755+0000 mon.smithi067 (mon.1) 1801 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:11:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:11:36.349088+0000 mon.smithi067 (mon.1) 1802 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:11:36.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:11:36.349448+0000 mon.smithi061 (mon.0) 2490 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:11:36.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:11:36.349789+0000 mon.smithi061 (mon.0) 2491 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:11:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:35.057206+0000 mgr.smithi067.rdualw (mgr.24569) 11937 : cluster [DBG] pgmap v10280: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:11:36.348755+0000 mon.smithi067 (mon.1) 1801 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:11:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:11:36.349088+0000 mon.smithi067 (mon.1) 1802 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:11:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:11:36.349448+0000 mon.smithi061 (mon.0) 2490 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:11:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:11:36.349789+0000 mon.smithi061 (mon.0) 2491 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:11:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:37.058161+0000 mgr.smithi067.rdualw (mgr.24569) 11938 : cluster [DBG] pgmap v10281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:11:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:37.058161+0000 mgr.smithi067.rdualw (mgr.24569) 11938 : cluster [DBG] pgmap v10281: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:11:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:39.058731+0000 mgr.smithi067.rdualw (mgr.24569) 11939 : cluster [DBG] pgmap v10282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:41.322 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:39.058731+0000 mgr.smithi067.rdualw (mgr.24569) 11939 : cluster [DBG] pgmap v10282: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:41.059624+0000 mgr.smithi067.rdualw (mgr.24569) 11940 : cluster [DBG] pgmap v10283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:41.059624+0000 mgr.smithi067.rdualw (mgr.24569) 11940 : cluster [DBG] pgmap v10283: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:43.060161+0000 mgr.smithi067.rdualw (mgr.24569) 11941 : cluster [DBG] pgmap v10284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:43.060161+0000 mgr.smithi067.rdualw (mgr.24569) 11941 : cluster [DBG] pgmap v10284: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:46.650 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:11:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:45.060930+0000 mgr.smithi067.rdualw (mgr.24569) 11942 : cluster [DBG] pgmap v10285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:45.060930+0000 mgr.smithi067.rdualw (mgr.24569) 11942 : cluster [DBG] pgmap v10285: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:46.942 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:11:46.942 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 3m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:11:46.943 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 3m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:11:46.943 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 4m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:11:46.943 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 3m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:11:46.944 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 3m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:11:46.944 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 4m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:11:46.944 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 3m ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:11:46.945 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 4m ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:11:46.945 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 3m ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:11:46.945 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 4m ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:11:46.946 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 3m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:11:46.946 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 4m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:11:46.946 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 3m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:11:46.947 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 4m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:11:46.947 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 3m ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:11:46.948 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 3m ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:11:46.948 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 3m ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:11:46.948 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 3m ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:11:46.949 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 4m ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:11:46.949 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 4m ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:11:46.949 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 4m ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:11:46.950 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 4m ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:11:46.950 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 3m ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:11:47.286 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:11:47.287 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:11:47.287 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:11:47.287 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:11:47.288 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:11:47.288 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:11:47.289 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:11:47.289 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:11:47.290 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:11:47.290 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:11:47.291 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:11:47.291 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:11:47.292 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:11:47.292 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:11:47.293 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:11:47.294 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:11:47.295 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:11:47.296 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:11:47.296 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:11:47.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:11:47.283617+0000 mon.smithi061 (mon.0) 2492 : audit [DBG] from='client.? 172.21.15.61:0/382557289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:11:47.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:11:47.283617+0000 mon.smithi061 (mon.0) 2492 : audit [DBG] from='client.? 172.21.15.61:0/382557289' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:11:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:11:46.635989+0000 mgr.smithi067.rdualw (mgr.24569) 11943 : audit [DBG] from='client.42106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:11:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:11:46.922707+0000 mgr.smithi067.rdualw (mgr.24569) 11944 : audit [DBG] from='client.42110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:11:48.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:47.061768+0000 mgr.smithi067.rdualw (mgr.24569) 11945 : cluster [DBG] pgmap v10286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:11:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:11:46.635989+0000 mgr.smithi067.rdualw (mgr.24569) 11943 : audit [DBG] from='client.42106 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:11:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:11:46.922707+0000 mgr.smithi067.rdualw (mgr.24569) 11944 : audit [DBG] from='client.42110 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:11:48.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:47.061768+0000 mgr.smithi067.rdualw (mgr.24569) 11945 : cluster [DBG] pgmap v10286: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:11:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:49.062350+0000 mgr.smithi067.rdualw (mgr.24569) 11946 : cluster [DBG] pgmap v10287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:11:49.855349+0000 mon.smithi067 (mon.1) 1803 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:11:50.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:11:49.856843+0000 mon.smithi067 (mon.1) 1804 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:11:50.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:11:49.858001+0000 mon.smithi067 (mon.1) 1805 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:11:50.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:11:50.293741+0000 mon.smithi061 (mon.0) 2493 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:11:50.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:11:50.299435+0000 mon.smithi061 (mon.0) 2494 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:11:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:49.062350+0000 mgr.smithi067.rdualw (mgr.24569) 11946 : cluster [DBG] pgmap v10287: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:11:49.855349+0000 mon.smithi067 (mon.1) 1803 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:11:50.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:11:49.856843+0000 mon.smithi067 (mon.1) 1804 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:11:50.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:11:49.858001+0000 mon.smithi067 (mon.1) 1805 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:11:50.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:11:50.293741+0000 mon.smithi061 (mon.0) 2493 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:11:50.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:11:50.299435+0000 mon.smithi061 (mon.0) 2494 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:11:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:11:49.858988+0000 mgr.smithi067.rdualw (mgr.24569) 11947 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:11:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:11:49.858988+0000 mgr.smithi067.rdualw (mgr.24569) 11947 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:11:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:51.063128+0000 mgr.smithi067.rdualw (mgr.24569) 11948 : cluster [DBG] pgmap v10288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:51.063128+0000 mgr.smithi067.rdualw (mgr.24569) 11948 : cluster [DBG] pgmap v10288: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:53.063751+0000 mgr.smithi067.rdualw (mgr.24569) 11949 : cluster [DBG] pgmap v10289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:53.063751+0000 mgr.smithi067.rdualw (mgr.24569) 11949 : cluster [DBG] pgmap v10289: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:55.064450+0000 mgr.smithi067.rdualw (mgr.24569) 11950 : cluster [DBG] pgmap v10290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:55.064450+0000 mgr.smithi067.rdualw (mgr.24569) 11950 : cluster [DBG] pgmap v10290: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:11:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:11:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:57.065509+0000 mgr.smithi067.rdualw (mgr.24569) 11951 : cluster [DBG] pgmap v10291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:11:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:11:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:57.065509+0000 mgr.smithi067.rdualw (mgr.24569) 11951 : cluster [DBG] pgmap v10291: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:12:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:11:59.066149+0000 mgr.smithi067.rdualw (mgr.24569) 11952 : cluster [DBG] pgmap v10292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:11:59.066149+0000 mgr.smithi067.rdualw (mgr.24569) 11952 : cluster [DBG] pgmap v10292: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:01.067145+0000 mgr.smithi067.rdualw (mgr.24569) 11953 : cluster [DBG] pgmap v10293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:01.067145+0000 mgr.smithi067.rdualw (mgr.24569) 11953 : cluster [DBG] pgmap v10293: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:03.067745+0000 mgr.smithi067.rdualw (mgr.24569) 11954 : cluster [DBG] pgmap v10294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:03.067745+0000 mgr.smithi067.rdualw (mgr.24569) 11954 : cluster [DBG] pgmap v10294: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:05.068497+0000 mgr.smithi067.rdualw (mgr.24569) 11955 : cluster [DBG] pgmap v10295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:05.068497+0000 mgr.smithi067.rdualw (mgr.24569) 11955 : cluster [DBG] pgmap v10295: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:08.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:07.069391+0000 mgr.smithi067.rdualw (mgr.24569) 11956 : cluster [DBG] pgmap v10296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:12:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:07.069391+0000 mgr.smithi067.rdualw (mgr.24569) 11956 : cluster [DBG] pgmap v10296: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:12:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:09.070182+0000 mgr.smithi067.rdualw (mgr.24569) 11957 : cluster [DBG] pgmap v10297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:09.070182+0000 mgr.smithi067.rdualw (mgr.24569) 11957 : cluster [DBG] pgmap v10297: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:11.071211+0000 mgr.smithi067.rdualw (mgr.24569) 11958 : cluster [DBG] pgmap v10298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:11.071211+0000 mgr.smithi067.rdualw (mgr.24569) 11958 : cluster [DBG] pgmap v10298: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:13.071909+0000 mgr.smithi067.rdualw (mgr.24569) 11959 : cluster [DBG] pgmap v10299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:13.071909+0000 mgr.smithi067.rdualw (mgr.24569) 11959 : cluster [DBG] pgmap v10299: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:16.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:15.072670+0000 mgr.smithi067.rdualw (mgr.24569) 11960 : cluster [DBG] pgmap v10300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:15.072670+0000 mgr.smithi067.rdualw (mgr.24569) 11960 : cluster [DBG] pgmap v10300: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:17.593 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:12:17.894 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:12:17.894 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 4m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:12:17.895 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 4m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:12:17.895 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 4m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:12:17.895 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 4m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:12:17.895 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 4m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:12:17.895 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 4m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:12:17.896 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 4m ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:12:17.896 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 4m ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:12:17.896 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 4m ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:12:17.896 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 4m ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:12:17.896 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 4m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:12:17.897 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 4m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:12:17.897 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 4m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:12:17.897 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 4m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:12:17.897 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 4m ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:12:17.898 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 4m ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:12:17.898 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 4m ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:12:17.898 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 4m ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:12:17.898 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 4m ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:12:17.898 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 4m ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:12:17.899 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 4m ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:12:17.899 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 4m ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:12:17.899 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 4m ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:12:18.233 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:12:18.233 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:12:18.233 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:12:18.234 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:12:18.234 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:12:18.234 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:12:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:12:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:12:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:12:18.235 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:12:18.236 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:12:18.236 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:12:18.236 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:12:18.236 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:12:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:12:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:12:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:12:18.237 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:12:18.238 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:12:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:17.073598+0000 mgr.smithi067.rdualw (mgr.24569) 11961 : cluster [DBG] pgmap v10301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:12:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:12:18.231336+0000 mon.smithi061 (mon.0) 2495 : audit [DBG] from='client.? 172.21.15.61:0/4120577363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:12:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:17.073598+0000 mgr.smithi067.rdualw (mgr.24569) 11961 : cluster [DBG] pgmap v10301: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:12:18.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:12:18.231336+0000 mon.smithi061 (mon.0) 2495 : audit [DBG] from='client.? 172.21.15.61:0/4120577363' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:12:19.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:12:17.579141+0000 mgr.smithi067.rdualw (mgr.24569) 11962 : audit [DBG] from='client.42118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:12:19.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:12:17.875391+0000 mgr.smithi067.rdualw (mgr.24569) 11963 : audit [DBG] from='client.42122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:12:19.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:12:17.579141+0000 mgr.smithi067.rdualw (mgr.24569) 11962 : audit [DBG] from='client.42118 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:12:19.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:12:17.875391+0000 mgr.smithi067.rdualw (mgr.24569) 11963 : audit [DBG] from='client.42122 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:12:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:19.074138+0000 mgr.smithi067.rdualw (mgr.24569) 11964 : cluster [DBG] pgmap v10302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:19.074138+0000 mgr.smithi067.rdualw (mgr.24569) 11964 : cluster [DBG] pgmap v10302: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:21.075151+0000 mgr.smithi067.rdualw (mgr.24569) 11965 : cluster [DBG] pgmap v10303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:21.075151+0000 mgr.smithi067.rdualw (mgr.24569) 11965 : cluster [DBG] pgmap v10303: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:23.075709+0000 mgr.smithi067.rdualw (mgr.24569) 11966 : cluster [DBG] pgmap v10304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:23.075709+0000 mgr.smithi067.rdualw (mgr.24569) 11966 : cluster [DBG] pgmap v10304: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:25.076362+0000 mgr.smithi067.rdualw (mgr.24569) 11967 : cluster [DBG] pgmap v10305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:25.076362+0000 mgr.smithi067.rdualw (mgr.24569) 11967 : cluster [DBG] pgmap v10305: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:27.077261+0000 mgr.smithi067.rdualw (mgr.24569) 11968 : cluster [DBG] pgmap v10306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:12:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:27.077261+0000 mgr.smithi067.rdualw (mgr.24569) 11968 : cluster [DBG] pgmap v10306: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:12:30.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:29.078006+0000 mgr.smithi067.rdualw (mgr.24569) 11969 : cluster [DBG] pgmap v10307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:29.078006+0000 mgr.smithi067.rdualw (mgr.24569) 11969 : cluster [DBG] pgmap v10307: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:32.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:31.078995+0000 mgr.smithi067.rdualw (mgr.24569) 11970 : cluster [DBG] pgmap v10308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:32.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:31.078995+0000 mgr.smithi067.rdualw (mgr.24569) 11970 : cluster [DBG] pgmap v10308: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:33.079629+0000 mgr.smithi067.rdualw (mgr.24569) 11971 : cluster [DBG] pgmap v10309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:33.079629+0000 mgr.smithi067.rdualw (mgr.24569) 11971 : cluster [DBG] pgmap v10309: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:35.080259+0000 mgr.smithi067.rdualw (mgr.24569) 11972 : cluster [DBG] pgmap v10310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:12:36.354375+0000 mon.smithi067 (mon.1) 1806 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:12:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:12:36.354648+0000 mon.smithi067 (mon.1) 1807 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:12:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:12:36.355189+0000 mon.smithi061 (mon.0) 2496 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:12:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:12:36.355538+0000 mon.smithi061 (mon.0) 2497 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:12:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:35.080259+0000 mgr.smithi067.rdualw (mgr.24569) 11972 : cluster [DBG] pgmap v10310: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:12:36.354375+0000 mon.smithi067 (mon.1) 1806 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:12:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:12:36.354648+0000 mon.smithi067 (mon.1) 1807 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:12:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:12:36.355189+0000 mon.smithi061 (mon.0) 2496 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:12:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:12:36.355538+0000 mon.smithi061 (mon.0) 2497 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:12:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:37.081242+0000 mgr.smithi067.rdualw (mgr.24569) 11973 : cluster [DBG] pgmap v10311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:12:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:37.081242+0000 mgr.smithi067.rdualw (mgr.24569) 11973 : cluster [DBG] pgmap v10311: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:12:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:39.081796+0000 mgr.smithi067.rdualw (mgr.24569) 11974 : cluster [DBG] pgmap v10312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:39.081796+0000 mgr.smithi067.rdualw (mgr.24569) 11974 : cluster [DBG] pgmap v10312: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:41.082771+0000 mgr.smithi067.rdualw (mgr.24569) 11975 : cluster [DBG] pgmap v10313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:41.082771+0000 mgr.smithi067.rdualw (mgr.24569) 11975 : cluster [DBG] pgmap v10313: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:43.083399+0000 mgr.smithi067.rdualw (mgr.24569) 11976 : cluster [DBG] pgmap v10314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:43.083399+0000 mgr.smithi067.rdualw (mgr.24569) 11976 : cluster [DBG] pgmap v10314: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:45.084076+0000 mgr.smithi067.rdualw (mgr.24569) 11977 : cluster [DBG] pgmap v10315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:45.084076+0000 mgr.smithi067.rdualw (mgr.24569) 11977 : cluster [DBG] pgmap v10315: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:48.607 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:12:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:47.085047+0000 mgr.smithi067.rdualw (mgr.24569) 11978 : cluster [DBG] pgmap v10316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:12:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:47.085047+0000 mgr.smithi067.rdualw (mgr.24569) 11978 : cluster [DBG] pgmap v10316: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:12:48.897 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:12:48.897 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 5m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:12:48.898 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 5m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:12:48.898 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 5m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:12:48.898 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 5m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:12:48.898 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 5m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:12:48.899 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 5m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:12:48.899 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 5m ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:12:48.899 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 5m ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:12:48.899 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 5m ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:12:48.900 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 5m ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:12:48.900 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 5m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:12:48.900 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 5m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:12:48.900 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 5m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:12:48.901 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 5m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:12:48.901 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 5m ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:12:48.901 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 5m ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:12:48.901 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 5m ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:12:48.901 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 5m ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:12:48.902 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 5m ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:12:48.902 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 5m ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:12:48.902 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 5m ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:12:48.902 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 5m ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:12:48.903 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 5m ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:12:49.241 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:12:49.242 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:12:49.242 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:12:49.242 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:12:49.243 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:12:49.243 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:12:49.243 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:12:49.243 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:12:49.244 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:12:49.244 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:12:49.244 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:12:49.244 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:12:49.244 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:12:49.245 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:12:49.245 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:12:49.245 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:12:49.245 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:12:49.246 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:12:49.246 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:12:49.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:12:49.240108+0000 mon.smithi061 (mon.0) 2498 : audit [DBG] from='client.? 172.21.15.61:0/4149558072' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:12:49.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:12:49.240108+0000 mon.smithi061 (mon.0) 2498 : audit [DBG] from='client.? 172.21.15.61:0/4149558072' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:12:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:12:48.591847+0000 mgr.smithi067.rdualw (mgr.24569) 11979 : audit [DBG] from='client.42130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:12:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:12:48.879559+0000 mgr.smithi067.rdualw (mgr.24569) 11980 : audit [DBG] from='client.42134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:12:50.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:49.085686+0000 mgr.smithi067.rdualw (mgr.24569) 11981 : cluster [DBG] pgmap v10317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:50.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:12:50.302881+0000 mon.smithi067 (mon.1) 1808 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:12:50.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:12:50.304412+0000 mon.smithi067 (mon.1) 1809 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:12:50.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:12:50.305303+0000 mon.smithi067 (mon.1) 1810 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:12:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:12:48.591847+0000 mgr.smithi067.rdualw (mgr.24569) 11979 : audit [DBG] from='client.42130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:12:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:12:48.879559+0000 mgr.smithi067.rdualw (mgr.24569) 11980 : audit [DBG] from='client.42134 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:12:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:49.085686+0000 mgr.smithi067.rdualw (mgr.24569) 11981 : cluster [DBG] pgmap v10317: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:50.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:12:50.302881+0000 mon.smithi067 (mon.1) 1808 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:12:50.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:12:50.304412+0000 mon.smithi067 (mon.1) 1809 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:12:50.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:12:50.305303+0000 mon.smithi067 (mon.1) 1810 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:12:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:12:50.306094+0000 mgr.smithi067.rdualw (mgr.24569) 11982 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:12:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:12:50.726612+0000 mon.smithi061 (mon.0) 2499 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:12:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:12:50.732255+0000 mon.smithi061 (mon.0) 2500 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:12:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:12:50.306094+0000 mgr.smithi067.rdualw (mgr.24569) 11982 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:12:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:12:50.726612+0000 mon.smithi061 (mon.0) 2499 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:12:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:12:50.732255+0000 mon.smithi061 (mon.0) 2500 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:12:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:51.086471+0000 mgr.smithi067.rdualw (mgr.24569) 11983 : cluster [DBG] pgmap v10318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:51.086471+0000 mgr.smithi067.rdualw (mgr.24569) 11983 : cluster [DBG] pgmap v10318: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:53.087083+0000 mgr.smithi067.rdualw (mgr.24569) 11984 : cluster [DBG] pgmap v10319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:54.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:53.087083+0000 mgr.smithi067.rdualw (mgr.24569) 11984 : cluster [DBG] pgmap v10319: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:55.087753+0000 mgr.smithi067.rdualw (mgr.24569) 11985 : cluster [DBG] pgmap v10320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:55.087753+0000 mgr.smithi067.rdualw (mgr.24569) 11985 : cluster [DBG] pgmap v10320: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:12:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:12:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:57.088848+0000 mgr.smithi067.rdualw (mgr.24569) 11986 : cluster [DBG] pgmap v10321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:12:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:12:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:57.088848+0000 mgr.smithi067.rdualw (mgr.24569) 11986 : cluster [DBG] pgmap v10321: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:13:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:12:59.089590+0000 mgr.smithi067.rdualw (mgr.24569) 11987 : cluster [DBG] pgmap v10322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:12:59.089590+0000 mgr.smithi067.rdualw (mgr.24569) 11987 : cluster [DBG] pgmap v10322: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:01.090627+0000 mgr.smithi067.rdualw (mgr.24569) 11988 : cluster [DBG] pgmap v10323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:01.090627+0000 mgr.smithi067.rdualw (mgr.24569) 11988 : cluster [DBG] pgmap v10323: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:03.091164+0000 mgr.smithi067.rdualw (mgr.24569) 11989 : cluster [DBG] pgmap v10324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:03.091164+0000 mgr.smithi067.rdualw (mgr.24569) 11989 : cluster [DBG] pgmap v10324: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:05.091705+0000 mgr.smithi067.rdualw (mgr.24569) 11990 : cluster [DBG] pgmap v10325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:05.091705+0000 mgr.smithi067.rdualw (mgr.24569) 11990 : cluster [DBG] pgmap v10325: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:08.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:07.092713+0000 mgr.smithi067.rdualw (mgr.24569) 11991 : cluster [DBG] pgmap v10326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:13:08.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:07.092713+0000 mgr.smithi067.rdualw (mgr.24569) 11991 : cluster [DBG] pgmap v10326: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:13:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:09.093278+0000 mgr.smithi067.rdualw (mgr.24569) 11992 : cluster [DBG] pgmap v10327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:09.093278+0000 mgr.smithi067.rdualw (mgr.24569) 11992 : cluster [DBG] pgmap v10327: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:11.094342+0000 mgr.smithi067.rdualw (mgr.24569) 11993 : cluster [DBG] pgmap v10328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:11.094342+0000 mgr.smithi067.rdualw (mgr.24569) 11993 : cluster [DBG] pgmap v10328: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:13.095014+0000 mgr.smithi067.rdualw (mgr.24569) 11994 : cluster [DBG] pgmap v10329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:13.095014+0000 mgr.smithi067.rdualw (mgr.24569) 11994 : cluster [DBG] pgmap v10329: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:15.095683+0000 mgr.smithi067.rdualw (mgr.24569) 11995 : cluster [DBG] pgmap v10330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:15.095683+0000 mgr.smithi067.rdualw (mgr.24569) 11995 : cluster [DBG] pgmap v10330: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:17.096562+0000 mgr.smithi067.rdualw (mgr.24569) 11996 : cluster [DBG] pgmap v10331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:13:18.847 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:17.096562+0000 mgr.smithi067.rdualw (mgr.24569) 11996 : cluster [DBG] pgmap v10331: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:13:19.548 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:13:19.837 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:13:19.837 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 5m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:13:19.837 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 5m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:13:19.837 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 5m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:13:19.838 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 5m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:13:19.838 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 5m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:13:19.838 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 5m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:13:19.839 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 5m ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:13:19.839 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 5m ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:13:19.839 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 5m ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:13:19.839 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 5m ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:13:19.840 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 5m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:13:19.840 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 5m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:13:19.840 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 5m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:13:19.840 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 5m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:13:19.841 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 5m ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:13:19.841 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 5m ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:13:19.841 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 5m ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:13:19.841 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 5m ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:13:19.842 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 5m ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:13:19.842 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 5m ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:13:19.842 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 5m ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:13:19.842 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 5m ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:13:19.843 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 5m ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:13:20.178 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:13:20.179 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:13:20.179 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:13:20.179 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:13:20.179 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:13:20.180 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:13:20.180 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:13:20.180 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:13:20.180 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:13:20.181 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:13:20.181 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:13:20.181 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:13:20.181 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:13:20.182 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:13:20.182 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:13:20.182 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:13:20.182 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:13:20.182 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:13:20.183 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:13:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:19.097050+0000 mgr.smithi067.rdualw (mgr.24569) 11997 : cluster [DBG] pgmap v10332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:13:19.533957+0000 mgr.smithi067.rdualw (mgr.24569) 11998 : audit [DBG] from='client.42142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:13:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:13:20.176726+0000 mon.smithi061 (mon.0) 2501 : audit [DBG] from='client.? 172.21.15.61:0/583217231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:13:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:19.097050+0000 mgr.smithi067.rdualw (mgr.24569) 11997 : cluster [DBG] pgmap v10332: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:13:19.533957+0000 mgr.smithi067.rdualw (mgr.24569) 11998 : audit [DBG] from='client.42142 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:13:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:13:20.176726+0000 mon.smithi061 (mon.0) 2501 : audit [DBG] from='client.? 172.21.15.61:0/583217231' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:13:21.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:13:19.818968+0000 mgr.smithi067.rdualw (mgr.24569) 11999 : audit [DBG] from='client.42146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:13:21.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:13:19.818968+0000 mgr.smithi067.rdualw (mgr.24569) 11999 : audit [DBG] from='client.42146 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:13:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:21.097909+0000 mgr.smithi067.rdualw (mgr.24569) 12000 : cluster [DBG] pgmap v10333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:22.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:21.097909+0000 mgr.smithi067.rdualw (mgr.24569) 12000 : cluster [DBG] pgmap v10333: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:23.098678+0000 mgr.smithi067.rdualw (mgr.24569) 12001 : cluster [DBG] pgmap v10334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:23.098678+0000 mgr.smithi067.rdualw (mgr.24569) 12001 : cluster [DBG] pgmap v10334: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:25.099413+0000 mgr.smithi067.rdualw (mgr.24569) 12002 : cluster [DBG] pgmap v10335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:25.099413+0000 mgr.smithi067.rdualw (mgr.24569) 12002 : cluster [DBG] pgmap v10335: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:27.100456+0000 mgr.smithi067.rdualw (mgr.24569) 12003 : cluster [DBG] pgmap v10336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:13:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:27.100456+0000 mgr.smithi067.rdualw (mgr.24569) 12003 : cluster [DBG] pgmap v10336: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:13:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:29.101044+0000 mgr.smithi067.rdualw (mgr.24569) 12004 : cluster [DBG] pgmap v10337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:29.101044+0000 mgr.smithi067.rdualw (mgr.24569) 12004 : cluster [DBG] pgmap v10337: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:31.102141+0000 mgr.smithi067.rdualw (mgr.24569) 12005 : cluster [DBG] pgmap v10338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:31.102141+0000 mgr.smithi067.rdualw (mgr.24569) 12005 : cluster [DBG] pgmap v10338: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:33.102857+0000 mgr.smithi067.rdualw (mgr.24569) 12006 : cluster [DBG] pgmap v10339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:33.102857+0000 mgr.smithi067.rdualw (mgr.24569) 12006 : cluster [DBG] pgmap v10339: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:35.103678+0000 mgr.smithi067.rdualw (mgr.24569) 12007 : cluster [DBG] pgmap v10340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:13:36.359683+0000 mon.smithi067 (mon.1) 1811 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:13:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:13:36.360252+0000 mon.smithi061 (mon.0) 2502 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:13:36.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:13:36.360456+0000 mon.smithi067 (mon.1) 1812 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:13:36.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:13:36.360900+0000 mon.smithi061 (mon.0) 2503 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:13:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:35.103678+0000 mgr.smithi067.rdualw (mgr.24569) 12007 : cluster [DBG] pgmap v10340: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:13:36.359683+0000 mon.smithi067 (mon.1) 1811 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:13:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:13:36.360252+0000 mon.smithi061 (mon.0) 2502 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:13:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:13:36.360456+0000 mon.smithi067 (mon.1) 1812 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:13:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:13:36.360900+0000 mon.smithi061 (mon.0) 2503 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:13:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:37.104592+0000 mgr.smithi067.rdualw (mgr.24569) 12008 : cluster [DBG] pgmap v10341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:13:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:37.104592+0000 mgr.smithi067.rdualw (mgr.24569) 12008 : cluster [DBG] pgmap v10341: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:13:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:39.105151+0000 mgr.smithi067.rdualw (mgr.24569) 12009 : cluster [DBG] pgmap v10342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:39.105151+0000 mgr.smithi067.rdualw (mgr.24569) 12009 : cluster [DBG] pgmap v10342: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:41.106043+0000 mgr.smithi067.rdualw (mgr.24569) 12010 : cluster [DBG] pgmap v10343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:41.106043+0000 mgr.smithi067.rdualw (mgr.24569) 12010 : cluster [DBG] pgmap v10343: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:43.106738+0000 mgr.smithi067.rdualw (mgr.24569) 12011 : cluster [DBG] pgmap v10344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:43.106738+0000 mgr.smithi067.rdualw (mgr.24569) 12011 : cluster [DBG] pgmap v10344: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:45.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:45.107380+0000 mgr.smithi067.rdualw (mgr.24569) 12012 : cluster [DBG] pgmap v10345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:45.107380+0000 mgr.smithi067.rdualw (mgr.24569) 12012 : cluster [DBG] pgmap v10345: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:47.108250+0000 mgr.smithi067.rdualw (mgr.24569) 12013 : cluster [DBG] pgmap v10346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:13:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:47.108250+0000 mgr.smithi067.rdualw (mgr.24569) 12013 : cluster [DBG] pgmap v10346: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:13:50.489 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:13:50.790 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:13:50.790 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 6m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:13:50.791 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 6m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:13:50.791 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 6m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:13:50.791 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 6m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:13:50.791 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 6m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:13:50.791 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 6m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:13:50.792 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 6m ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:13:50.792 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 6m ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:13:50.792 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 6m ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:13:50.792 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 6m ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:13:50.793 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 6m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:13:50.793 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 6m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:13:50.793 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 6m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:13:50.793 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 6m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:13:50.793 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 6m ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:13:50.794 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 6m ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:13:50.794 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 6m ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:13:50.794 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 6m ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:13:50.794 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 6m ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:13:50.795 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 6m ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:13:50.795 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 6m ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:13:50.795 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 6m ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:13:50.795 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 6m ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:13:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:49.109088+0000 mgr.smithi067.rdualw (mgr.24569) 12014 : cluster [DBG] pgmap v10347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:49.109088+0000 mgr.smithi067.rdualw (mgr.24569) 12014 : cluster [DBG] pgmap v10347: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:51.149 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:13:51.149 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:13:51.149 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:13:51.150 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:13:51.150 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:13:51.150 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:13:51.151 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:13:51.151 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:13:51.151 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:13:51.152 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:13:51.152 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:13:51.152 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:13:51.152 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:13:51.153 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:13:51.153 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:13:51.153 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:13:51.153 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:13:51.153 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:13:51.154 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:13:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:13:50.474967+0000 mgr.smithi067.rdualw (mgr.24569) 12015 : audit [DBG] from='client.42154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:13:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:13:50.737396+0000 mon.smithi067 (mon.1) 1813 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:13:51.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:13:50.738885+0000 mon.smithi067 (mon.1) 1814 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:13:51.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:13:50.739796+0000 mon.smithi067 (mon.1) 1815 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:13:51.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:13:51.146068+0000 mon.smithi061 (mon.0) 2504 : audit [DBG] from='client.? 172.21.15.61:0/2906193872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:13:51.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:13:51.175012+0000 mon.smithi061 (mon.0) 2505 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:13:51.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:13:51.180573+0000 mon.smithi061 (mon.0) 2506 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:13:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:13:50.474967+0000 mgr.smithi067.rdualw (mgr.24569) 12015 : audit [DBG] from='client.42154 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:13:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:13:50.737396+0000 mon.smithi067 (mon.1) 1813 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:13:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:13:50.738885+0000 mon.smithi067 (mon.1) 1814 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:13:51.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:13:50.739796+0000 mon.smithi067 (mon.1) 1815 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:13:51.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:13:51.146068+0000 mon.smithi061 (mon.0) 2504 : audit [DBG] from='client.? 172.21.15.61:0/2906193872' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:13:51.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:13:51.175012+0000 mon.smithi061 (mon.0) 2505 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:13:51.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:13:51.180573+0000 mon.smithi061 (mon.0) 2506 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:13:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:13:50.740659+0000 mgr.smithi067.rdualw (mgr.24569) 12016 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:13:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:13:50.760959+0000 mgr.smithi067.rdualw (mgr.24569) 12017 : audit [DBG] from='client.42158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:13:52.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:51.110099+0000 mgr.smithi067.rdualw (mgr.24569) 12018 : cluster [DBG] pgmap v10348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:13:50.740659+0000 mgr.smithi067.rdualw (mgr.24569) 12016 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:13:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:13:50.760959+0000 mgr.smithi067.rdualw (mgr.24569) 12017 : audit [DBG] from='client.42158 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:13:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:51.110099+0000 mgr.smithi067.rdualw (mgr.24569) 12018 : cluster [DBG] pgmap v10348: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:53.110822+0000 mgr.smithi067.rdualw (mgr.24569) 12019 : cluster [DBG] pgmap v10349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:53.110822+0000 mgr.smithi067.rdualw (mgr.24569) 12019 : cluster [DBG] pgmap v10349: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:55.111580+0000 mgr.smithi067.rdualw (mgr.24569) 12020 : cluster [DBG] pgmap v10350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:55.111580+0000 mgr.smithi067.rdualw (mgr.24569) 12020 : cluster [DBG] pgmap v10350: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:13:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:13:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:57.112481+0000 mgr.smithi067.rdualw (mgr.24569) 12021 : cluster [DBG] pgmap v10351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:13:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:13:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:57.112481+0000 mgr.smithi067.rdualw (mgr.24569) 12021 : cluster [DBG] pgmap v10351: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:14:00.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:13:59.113282+0000 mgr.smithi067.rdualw (mgr.24569) 12022 : cluster [DBG] pgmap v10352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:13:59.113282+0000 mgr.smithi067.rdualw (mgr.24569) 12022 : cluster [DBG] pgmap v10352: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:02.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:01.114325+0000 mgr.smithi067.rdualw (mgr.24569) 12023 : cluster [DBG] pgmap v10353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:01.114325+0000 mgr.smithi067.rdualw (mgr.24569) 12023 : cluster [DBG] pgmap v10353: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:03.115111+0000 mgr.smithi067.rdualw (mgr.24569) 12024 : cluster [DBG] pgmap v10354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:03.115111+0000 mgr.smithi067.rdualw (mgr.24569) 12024 : cluster [DBG] pgmap v10354: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:06.808 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:05.115675+0000 mgr.smithi067.rdualw (mgr.24569) 12025 : cluster [DBG] pgmap v10355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:05.115675+0000 mgr.smithi067.rdualw (mgr.24569) 12025 : cluster [DBG] pgmap v10355: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:08.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:07.116529+0000 mgr.smithi067.rdualw (mgr.24569) 12026 : cluster [DBG] pgmap v10356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:14:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:07.116529+0000 mgr.smithi067.rdualw (mgr.24569) 12026 : cluster [DBG] pgmap v10356: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:14:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:09.117157+0000 mgr.smithi067.rdualw (mgr.24569) 12027 : cluster [DBG] pgmap v10357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:09.117157+0000 mgr.smithi067.rdualw (mgr.24569) 12027 : cluster [DBG] pgmap v10357: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:11.118146+0000 mgr.smithi067.rdualw (mgr.24569) 12028 : cluster [DBG] pgmap v10358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:11.118146+0000 mgr.smithi067.rdualw (mgr.24569) 12028 : cluster [DBG] pgmap v10358: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:13.118729+0000 mgr.smithi067.rdualw (mgr.24569) 12029 : cluster [DBG] pgmap v10359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:13.118729+0000 mgr.smithi067.rdualw (mgr.24569) 12029 : cluster [DBG] pgmap v10359: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:15.119499+0000 mgr.smithi067.rdualw (mgr.24569) 12030 : cluster [DBG] pgmap v10360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:16.822 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:15.119499+0000 mgr.smithi067.rdualw (mgr.24569) 12030 : cluster [DBG] pgmap v10360: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:17.120562+0000 mgr.smithi067.rdualw (mgr.24569) 12031 : cluster [DBG] pgmap v10361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:14:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:17.120562+0000 mgr.smithi067.rdualw (mgr.24569) 12031 : cluster [DBG] pgmap v10361: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:14:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:19.121136+0000 mgr.smithi067.rdualw (mgr.24569) 12032 : cluster [DBG] pgmap v10362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:19.121136+0000 mgr.smithi067.rdualw (mgr.24569) 12032 : cluster [DBG] pgmap v10362: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:21.459 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:14:21.758 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:14:21.758 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 6m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:14:21.758 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 6m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:14:21.759 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 6m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:14:21.759 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 6m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:14:21.759 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 6m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:14:21.759 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 6m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:14:21.760 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 6m ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:14:21.760 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 6m ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:14:21.760 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 6m ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:14:21.760 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 6m ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:14:21.761 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 6m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:14:21.761 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 6m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:14:21.761 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 6m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:14:21.761 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 6m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:14:21.761 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 6m ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:14:21.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 6m ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:14:21.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 6m ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:14:21.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 6m ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:14:21.762 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 6m ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:14:21.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 6m ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:14:21.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 6m ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:14:21.763 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 6m ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:14:21.764 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 6m ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:14:22.099 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:14:22.099 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:14:22.099 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:14:22.100 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:14:22.100 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:14:22.100 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:14:22.100 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:14:22.100 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:14:22.101 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:14:22.101 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:14:22.101 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:14:22.101 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:14:22.102 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:14:22.102 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:14:22.102 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:14:22.102 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:14:22.102 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:14:22.103 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:14:22.103 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:14:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:21.122007+0000 mgr.smithi067.rdualw (mgr.24569) 12033 : cluster [DBG] pgmap v10363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:14:21.445105+0000 mgr.smithi067.rdualw (mgr.24569) 12034 : audit [DBG] from='client.42166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:14:22.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:14:22.097214+0000 mon.smithi061 (mon.0) 2507 : audit [DBG] from='client.? 172.21.15.61:0/1814132464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:14:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:21.122007+0000 mgr.smithi067.rdualw (mgr.24569) 12033 : cluster [DBG] pgmap v10363: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:14:21.445105+0000 mgr.smithi067.rdualw (mgr.24569) 12034 : audit [DBG] from='client.42166 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:14:22.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:14:22.097214+0000 mon.smithi061 (mon.0) 2507 : audit [DBG] from='client.? 172.21.15.61:0/1814132464' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:14:23.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:14:21.739787+0000 mgr.smithi067.rdualw (mgr.24569) 12035 : audit [DBG] from='client.42170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:14:23.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:14:21.739787+0000 mgr.smithi067.rdualw (mgr.24569) 12035 : audit [DBG] from='client.42170 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:14:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:23.122482+0000 mgr.smithi067.rdualw (mgr.24569) 12036 : cluster [DBG] pgmap v10364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:24.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:23.122482+0000 mgr.smithi067.rdualw (mgr.24569) 12036 : cluster [DBG] pgmap v10364: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:25.123087+0000 mgr.smithi067.rdualw (mgr.24569) 12037 : cluster [DBG] pgmap v10365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:25.123087+0000 mgr.smithi067.rdualw (mgr.24569) 12037 : cluster [DBG] pgmap v10365: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:27.124190+0000 mgr.smithi067.rdualw (mgr.24569) 12038 : cluster [DBG] pgmap v10366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:14:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:27.124190+0000 mgr.smithi067.rdualw (mgr.24569) 12038 : cluster [DBG] pgmap v10366: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2022-03-17T21:14:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:29.124869+0000 mgr.smithi067.rdualw (mgr.24569) 12039 : cluster [DBG] pgmap v10367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:29.124869+0000 mgr.smithi067.rdualw (mgr.24569) 12039 : cluster [DBG] pgmap v10367: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:31.125857+0000 mgr.smithi067.rdualw (mgr.24569) 12040 : cluster [DBG] pgmap v10368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:31.125857+0000 mgr.smithi067.rdualw (mgr.24569) 12040 : cluster [DBG] pgmap v10368: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:33.126527+0000 mgr.smithi067.rdualw (mgr.24569) 12041 : cluster [DBG] pgmap v10369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:33.126527+0000 mgr.smithi067.rdualw (mgr.24569) 12041 : cluster [DBG] pgmap v10369: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:35.127081+0000 mgr.smithi067.rdualw (mgr.24569) 12042 : cluster [DBG] pgmap v10370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:14:36.366336+0000 mon.smithi067 (mon.1) 1816 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:14:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:14:36.366609+0000 mon.smithi067 (mon.1) 1817 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:14:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:14:36.366849+0000 mon.smithi061 (mon.0) 2508 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:14:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:14:36.367155+0000 mon.smithi061 (mon.0) 2509 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:14:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:35.127081+0000 mgr.smithi067.rdualw (mgr.24569) 12042 : cluster [DBG] pgmap v10370: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:14:36.366336+0000 mon.smithi067 (mon.1) 1816 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:14:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:14:36.366609+0000 mon.smithi067 (mon.1) 1817 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:14:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:14:36.366849+0000 mon.smithi061 (mon.0) 2508 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:14:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:14:36.367155+0000 mon.smithi061 (mon.0) 2509 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:14:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:37.128165+0000 mgr.smithi067.rdualw (mgr.24569) 12043 : cluster [DBG] pgmap v10371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:14:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:37.128165+0000 mgr.smithi067.rdualw (mgr.24569) 12043 : cluster [DBG] pgmap v10371: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:14:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:39.128736+0000 mgr.smithi067.rdualw (mgr.24569) 12044 : cluster [DBG] pgmap v10372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2022-03-17T21:14:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:39.128736+0000 mgr.smithi067.rdualw (mgr.24569) 12044 : cluster [DBG] pgmap v10372: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2022-03-17T21:14:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:41.129703+0000 mgr.smithi067.rdualw (mgr.24569) 12045 : cluster [DBG] pgmap v10373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:41.129703+0000 mgr.smithi067.rdualw (mgr.24569) 12045 : cluster [DBG] pgmap v10373: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:43.130166+0000 mgr.smithi067.rdualw (mgr.24569) 12046 : cluster [DBG] pgmap v10374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:43.130166+0000 mgr.smithi067.rdualw (mgr.24569) 12046 : cluster [DBG] pgmap v10374: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:45.130927+0000 mgr.smithi067.rdualw (mgr.24569) 12047 : cluster [DBG] pgmap v10375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:45.130927+0000 mgr.smithi067.rdualw (mgr.24569) 12047 : cluster [DBG] pgmap v10375: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:47.132031+0000 mgr.smithi067.rdualw (mgr.24569) 12048 : cluster [DBG] pgmap v10376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:14:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:47.132031+0000 mgr.smithi067.rdualw (mgr.24569) 12048 : cluster [DBG] pgmap v10376: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:14:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:49.132704+0000 mgr.smithi067.rdualw (mgr.24569) 12049 : cluster [DBG] pgmap v10377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:49.132704+0000 mgr.smithi067.rdualw (mgr.24569) 12049 : cluster [DBG] pgmap v10377: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:51.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:14:51.184264+0000 mon.smithi067 (mon.1) 1818 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:14:51.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:14:51.185868+0000 mon.smithi067 (mon.1) 1819 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:14:51.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:14:51.186993+0000 mon.smithi067 (mon.1) 1820 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:14:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:14:51.184264+0000 mon.smithi067 (mon.1) 1818 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:14:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:14:51.185868+0000 mon.smithi067 (mon.1) 1819 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:14:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:14:51.186993+0000 mon.smithi067 (mon.1) 1820 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:14:52.406 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:14:52.700 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:14:52.700 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 7m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:14:52.700 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 7m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:14:52.701 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 7m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:14:52.701 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 7m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:14:52.701 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 7m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:14:52.701 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 7m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:14:52.702 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 7m ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:14:52.702 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 7m ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:14:52.702 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 7m ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:14:52.702 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 7m ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:14:52.702 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 7m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:14:52.703 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 7m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:14:52.703 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 7m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:14:52.703 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 7m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:14:52.703 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 7m ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:14:52.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 7m ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:14:52.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 7m ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:14:52.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 7m ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:14:52.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 7m ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:14:52.704 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 7m ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:14:52.705 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 7m ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:14:52.705 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 7m ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:14:52.705 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 7m ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:14:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:51.133726+0000 mgr.smithi067.rdualw (mgr.24569) 12050 : cluster [DBG] pgmap v10378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:14:52.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:14:51.187975+0000 mgr.smithi067.rdualw (mgr.24569) 12051 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:14:52.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:14:51.607721+0000 mon.smithi061 (mon.0) 2510 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:14:52.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:14:51.615631+0000 mon.smithi061 (mon.0) 2511 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:14:53.041 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:14:53.041 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:14:53.042 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:14:53.042 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:14:53.042 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:14:53.042 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:14:53.043 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:14:53.043 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:14:53.043 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:14:53.043 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:14:53.043 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:14:53.044 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:14:53.044 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:14:53.044 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:14:53.044 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:14:53.044 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:14:53.045 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:14:53.045 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:14:53.045 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:14:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:51.133726+0000 mgr.smithi067.rdualw (mgr.24569) 12050 : cluster [DBG] pgmap v10378: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:14:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:14:51.187975+0000 mgr.smithi067.rdualw (mgr.24569) 12051 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:14:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:14:51.607721+0000 mon.smithi061 (mon.0) 2510 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:14:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:14:51.615631+0000 mon.smithi061 (mon.0) 2511 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:14:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:14:52.392102+0000 mgr.smithi067.rdualw (mgr.24569) 12052 : audit [DBG] from='client.42178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:14:54.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:14:53.039674+0000 mon.smithi061 (mon.0) 2512 : audit [DBG] from='client.? 172.21.15.61:0/4110835497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:14:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:14:52.392102+0000 mgr.smithi067.rdualw (mgr.24569) 12052 : audit [DBG] from='client.42178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:14:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:14:53.039674+0000 mon.smithi061 (mon.0) 2512 : audit [DBG] from='client.? 172.21.15.61:0/4110835497' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:14:54.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:14:52.681944+0000 mgr.smithi067.rdualw (mgr.24569) 12053 : audit [DBG] from='client.42182 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:14:54.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:53.134274+0000 mgr.smithi067.rdualw (mgr.24569) 12054 : cluster [DBG] pgmap v10379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:14:52.681944+0000 mgr.smithi067.rdualw (mgr.24569) 12053 : audit [DBG] from='client.42182 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:14:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:53.134274+0000 mgr.smithi067.rdualw (mgr.24569) 12054 : cluster [DBG] pgmap v10379: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:56.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:55.134913+0000 mgr.smithi067.rdualw (mgr.24569) 12055 : cluster [DBG] pgmap v10380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:55.134913+0000 mgr.smithi067.rdualw (mgr.24569) 12055 : cluster [DBG] pgmap v10380: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:14:58.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:14:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:57.135826+0000 mgr.smithi067.rdualw (mgr.24569) 12056 : cluster [DBG] pgmap v10381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:14:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:14:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:57.135826+0000 mgr.smithi067.rdualw (mgr.24569) 12056 : cluster [DBG] pgmap v10381: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:00.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:14:59.136335+0000 mgr.smithi067.rdualw (mgr.24569) 12057 : cluster [DBG] pgmap v10382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:00.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:14:59.136335+0000 mgr.smithi067.rdualw (mgr.24569) 12057 : cluster [DBG] pgmap v10382: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:02.804 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:01.137184+0000 mgr.smithi067.rdualw (mgr.24569) 12058 : cluster [DBG] pgmap v10383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:01.137184+0000 mgr.smithi067.rdualw (mgr.24569) 12058 : cluster [DBG] pgmap v10383: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:04.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:03.137673+0000 mgr.smithi067.rdualw (mgr.24569) 12059 : cluster [DBG] pgmap v10384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:04.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:03.137673+0000 mgr.smithi067.rdualw (mgr.24569) 12059 : cluster [DBG] pgmap v10384: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:05.138426+0000 mgr.smithi067.rdualw (mgr.24569) 12060 : cluster [DBG] pgmap v10385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:05.138426+0000 mgr.smithi067.rdualw (mgr.24569) 12060 : cluster [DBG] pgmap v10385: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:08.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:07.139259+0000 mgr.smithi067.rdualw (mgr.24569) 12061 : cluster [DBG] pgmap v10386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:07.139259+0000 mgr.smithi067.rdualw (mgr.24569) 12061 : cluster [DBG] pgmap v10386: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:09.139846+0000 mgr.smithi067.rdualw (mgr.24569) 12062 : cluster [DBG] pgmap v10387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:09.139846+0000 mgr.smithi067.rdualw (mgr.24569) 12062 : cluster [DBG] pgmap v10387: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:11.140695+0000 mgr.smithi067.rdualw (mgr.24569) 12063 : cluster [DBG] pgmap v10388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:11.140695+0000 mgr.smithi067.rdualw (mgr.24569) 12063 : cluster [DBG] pgmap v10388: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:13.141211+0000 mgr.smithi067.rdualw (mgr.24569) 12064 : cluster [DBG] pgmap v10389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:13.141211+0000 mgr.smithi067.rdualw (mgr.24569) 12064 : cluster [DBG] pgmap v10389: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:15.141870+0000 mgr.smithi067.rdualw (mgr.24569) 12065 : cluster [DBG] pgmap v10390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:15.141870+0000 mgr.smithi067.rdualw (mgr.24569) 12065 : cluster [DBG] pgmap v10390: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:17.142949+0000 mgr.smithi067.rdualw (mgr.24569) 12066 : cluster [DBG] pgmap v10391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:17.142949+0000 mgr.smithi067.rdualw (mgr.24569) 12066 : cluster [DBG] pgmap v10391: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:19.143766+0000 mgr.smithi067.rdualw (mgr.24569) 12067 : cluster [DBG] pgmap v10392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:19.143766+0000 mgr.smithi067.rdualw (mgr.24569) 12067 : cluster [DBG] pgmap v10392: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:21.144526+0000 mgr.smithi067.rdualw (mgr.24569) 12068 : cluster [DBG] pgmap v10393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:21.144526+0000 mgr.smithi067.rdualw (mgr.24569) 12068 : cluster [DBG] pgmap v10393: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:23.350 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:15:23.643 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:15:23.643 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 7m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:15:23.644 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 7m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:15:23.644 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 7m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:15:23.644 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 7m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:15:23.644 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 7m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:15:23.645 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 7m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:15:23.645 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 7m ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:15:23.645 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 7m ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:15:23.645 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 7m ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:15:23.646 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 7m ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:15:23.646 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 7m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:15:23.646 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 7m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:15:23.646 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 7m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:15:23.647 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 7m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:15:23.647 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 7m ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:15:23.647 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 7m ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:15:23.647 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 7m ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:15:23.647 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 7m ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:15:23.648 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 7m ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:15:23.648 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 7m ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:15:23.648 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 7m ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:15:23.649 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 7m ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:15:23.649 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 7m ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:15:23.988 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:15:23.989 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:15:23.989 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:15:23.989 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:15:23.989 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:15:23.990 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:15:23.990 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:15:23.990 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:15:23.990 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:15:23.991 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:15:23.991 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:15:23.991 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:15:23.991 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:15:23.992 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:15:23.992 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:15:23.992 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:15:23.993 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:15:23.993 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:15:23.993 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:15:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:23.145025+0000 mgr.smithi067.rdualw (mgr.24569) 12069 : cluster [DBG] pgmap v10394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:15:23.334098+0000 mgr.smithi067.rdualw (mgr.24569) 12070 : audit [DBG] from='client.42190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:15:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:15:23.986954+0000 mon.smithi061 (mon.0) 2513 : audit [DBG] from='client.? 172.21.15.61:0/2778422585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:15:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:23.145025+0000 mgr.smithi067.rdualw (mgr.24569) 12069 : cluster [DBG] pgmap v10394: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:15:23.334098+0000 mgr.smithi067.rdualw (mgr.24569) 12070 : audit [DBG] from='client.42190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:15:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:15:23.986954+0000 mon.smithi061 (mon.0) 2513 : audit [DBG] from='client.? 172.21.15.61:0/2778422585' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:15:25.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:15:23.625020+0000 mgr.smithi067.rdualw (mgr.24569) 12071 : audit [DBG] from='client.42194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:15:25.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:15:23.625020+0000 mgr.smithi067.rdualw (mgr.24569) 12071 : audit [DBG] from='client.42194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:15:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:25.145608+0000 mgr.smithi067.rdualw (mgr.24569) 12072 : cluster [DBG] pgmap v10395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:25.145608+0000 mgr.smithi067.rdualw (mgr.24569) 12072 : cluster [DBG] pgmap v10395: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:27.146450+0000 mgr.smithi067.rdualw (mgr.24569) 12073 : cluster [DBG] pgmap v10396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:27.146450+0000 mgr.smithi067.rdualw (mgr.24569) 12073 : cluster [DBG] pgmap v10396: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:29.147156+0000 mgr.smithi067.rdualw (mgr.24569) 12074 : cluster [DBG] pgmap v10397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:29.147156+0000 mgr.smithi067.rdualw (mgr.24569) 12074 : cluster [DBG] pgmap v10397: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:31.148174+0000 mgr.smithi067.rdualw (mgr.24569) 12075 : cluster [DBG] pgmap v10398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:31.148174+0000 mgr.smithi067.rdualw (mgr.24569) 12075 : cluster [DBG] pgmap v10398: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:33.148827+0000 mgr.smithi067.rdualw (mgr.24569) 12076 : cluster [DBG] pgmap v10399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:33.148827+0000 mgr.smithi067.rdualw (mgr.24569) 12076 : cluster [DBG] pgmap v10399: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:35.149367+0000 mgr.smithi067.rdualw (mgr.24569) 12077 : cluster [DBG] pgmap v10400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:15:36.372160+0000 mon.smithi067 (mon.1) 1821 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:15:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:15:36.372432+0000 mon.smithi067 (mon.1) 1822 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:15:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:15:36.372949+0000 mon.smithi061 (mon.0) 2514 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:15:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:15:36.373280+0000 mon.smithi061 (mon.0) 2515 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:15:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:35.149367+0000 mgr.smithi067.rdualw (mgr.24569) 12077 : cluster [DBG] pgmap v10400: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:15:36.372160+0000 mon.smithi067 (mon.1) 1821 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:15:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:15:36.372432+0000 mon.smithi067 (mon.1) 1822 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:15:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:15:36.372949+0000 mon.smithi061 (mon.0) 2514 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:15:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:15:36.373280+0000 mon.smithi061 (mon.0) 2515 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:15:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:37.150257+0000 mgr.smithi067.rdualw (mgr.24569) 12078 : cluster [DBG] pgmap v10401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:37.150257+0000 mgr.smithi067.rdualw (mgr.24569) 12078 : cluster [DBG] pgmap v10401: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:39.150873+0000 mgr.smithi067.rdualw (mgr.24569) 12079 : cluster [DBG] pgmap v10402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:39.150873+0000 mgr.smithi067.rdualw (mgr.24569) 12079 : cluster [DBG] pgmap v10402: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:41.151877+0000 mgr.smithi067.rdualw (mgr.24569) 12080 : cluster [DBG] pgmap v10403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:41.151877+0000 mgr.smithi067.rdualw (mgr.24569) 12080 : cluster [DBG] pgmap v10403: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:43.152633+0000 mgr.smithi067.rdualw (mgr.24569) 12081 : cluster [DBG] pgmap v10404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:43.152633+0000 mgr.smithi067.rdualw (mgr.24569) 12081 : cluster [DBG] pgmap v10404: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:45.153253+0000 mgr.smithi067.rdualw (mgr.24569) 12082 : cluster [DBG] pgmap v10405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:45.153253+0000 mgr.smithi067.rdualw (mgr.24569) 12082 : cluster [DBG] pgmap v10405: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:47.154253+0000 mgr.smithi067.rdualw (mgr.24569) 12083 : cluster [DBG] pgmap v10406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:47.154253+0000 mgr.smithi067.rdualw (mgr.24569) 12083 : cluster [DBG] pgmap v10406: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:49.155064+0000 mgr.smithi067.rdualw (mgr.24569) 12084 : cluster [DBG] pgmap v10407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:49.155064+0000 mgr.smithi067.rdualw (mgr.24569) 12084 : cluster [DBG] pgmap v10407: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:51.156098+0000 mgr.smithi067.rdualw (mgr.24569) 12085 : cluster [DBG] pgmap v10408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:52.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:15:51.621298+0000 mon.smithi067 (mon.1) 1823 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:15:52.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:15:51.622842+0000 mon.smithi067 (mon.1) 1824 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:15:52.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:15:51.623865+0000 mon.smithi067 (mon.1) 1825 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:15:52.819 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:15:52.030680+0000 mon.smithi061 (mon.0) 2516 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:15:52.820 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:15:52.036501+0000 mon.smithi061 (mon.0) 2517 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:15:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:51.156098+0000 mgr.smithi067.rdualw (mgr.24569) 12085 : cluster [DBG] pgmap v10408: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:15:51.621298+0000 mon.smithi067 (mon.1) 1823 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:15:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:15:51.622842+0000 mon.smithi067 (mon.1) 1824 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:15:53.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:15:51.623865+0000 mon.smithi067 (mon.1) 1825 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:15:53.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:15:52.030680+0000 mon.smithi061 (mon.0) 2516 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:15:53.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:15:52.036501+0000 mon.smithi061 (mon.0) 2517 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:15:53.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:15:51.624794+0000 mgr.smithi067.rdualw (mgr.24569) 12086 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:15:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:15:51.624794+0000 mgr.smithi067.rdualw (mgr.24569) 12086 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:15:54.298 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:15:54.591 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:15:54.709 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 8m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:15:54.709 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 8m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:15:54.709 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 8m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:15:54.709 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 8m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:15:54.710 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 8m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:15:54.710 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 8m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:15:54.710 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 8m ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:15:54.710 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 8m ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:15:54.711 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 8m ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:15:54.711 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 8m ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:15:54.711 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 8m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:15:54.711 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 8m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:15:54.712 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 8m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:15:54.712 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 8m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:15:54.712 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 8m ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:15:54.712 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 8m ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:15:54.712 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 8m ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:15:54.713 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 8m ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:15:54.713 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 8m ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:15:54.713 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 8m ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:15:54.713 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 8m ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:15:54.713 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 8m ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:15:54.714 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 8m ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:15:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:53.156613+0000 mgr.smithi067.rdualw (mgr.24569) 12087 : cluster [DBG] pgmap v10409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:55.016 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:15:55.017 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:15:55.017 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:15:55.017 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:15:55.018 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:15:55.018 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:15:55.018 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:15:55.019 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:15:55.019 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:15:55.019 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:15:55.019 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:15:55.020 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:15:55.020 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:15:55.020 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:15:55.020 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:15:55.020 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:15:55.021 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:15:55.021 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:15:55.021 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:15:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:53.156613+0000 mgr.smithi067.rdualw (mgr.24569) 12087 : cluster [DBG] pgmap v10409: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:55.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:15:54.284058+0000 mgr.smithi067.rdualw (mgr.24569) 12088 : audit [DBG] from='client.42202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:15:55.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:15:55.014359+0000 mon.smithi061 (mon.0) 2518 : audit [DBG] from='client.? 172.21.15.61:0/3876715651' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:15:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:15:54.284058+0000 mgr.smithi067.rdualw (mgr.24569) 12088 : audit [DBG] from='client.42202 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:15:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:15:55.014359+0000 mon.smithi061 (mon.0) 2518 : audit [DBG] from='client.? 172.21.15.61:0/3876715651' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:15:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:15:54.573812+0000 mgr.smithi067.rdualw (mgr.24569) 12089 : audit [DBG] from='client.42206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:15:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:55.157385+0000 mgr.smithi067.rdualw (mgr.24569) 12090 : cluster [DBG] pgmap v10410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:15:54.573812+0000 mgr.smithi067.rdualw (mgr.24569) 12089 : audit [DBG] from='client.42206 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:15:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:55.157385+0000 mgr.smithi067.rdualw (mgr.24569) 12090 : cluster [DBG] pgmap v10410: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:15:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:15:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:57.158258+0000 mgr.smithi067.rdualw (mgr.24569) 12091 : cluster [DBG] pgmap v10411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:15:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:15:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:57.158258+0000 mgr.smithi067.rdualw (mgr.24569) 12091 : cluster [DBG] pgmap v10411: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:15:59.158951+0000 mgr.smithi067.rdualw (mgr.24569) 12092 : cluster [DBG] pgmap v10412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:01.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:15:59.158951+0000 mgr.smithi067.rdualw (mgr.24569) 12092 : cluster [DBG] pgmap v10412: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:01.159927+0000 mgr.smithi067.rdualw (mgr.24569) 12093 : cluster [DBG] pgmap v10413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:01.159927+0000 mgr.smithi067.rdualw (mgr.24569) 12093 : cluster [DBG] pgmap v10413: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:03.160418+0000 mgr.smithi067.rdualw (mgr.24569) 12094 : cluster [DBG] pgmap v10414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:03.160418+0000 mgr.smithi067.rdualw (mgr.24569) 12094 : cluster [DBG] pgmap v10414: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:06.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:05.161148+0000 mgr.smithi067.rdualw (mgr.24569) 12095 : cluster [DBG] pgmap v10415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:06.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:05.161148+0000 mgr.smithi067.rdualw (mgr.24569) 12095 : cluster [DBG] pgmap v10415: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:08.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:07.162000+0000 mgr.smithi067.rdualw (mgr.24569) 12096 : cluster [DBG] pgmap v10416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:07.162000+0000 mgr.smithi067.rdualw (mgr.24569) 12096 : cluster [DBG] pgmap v10416: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:09.162566+0000 mgr.smithi067.rdualw (mgr.24569) 12097 : cluster [DBG] pgmap v10417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:09.162566+0000 mgr.smithi067.rdualw (mgr.24569) 12097 : cluster [DBG] pgmap v10417: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:11.163382+0000 mgr.smithi067.rdualw (mgr.24569) 12098 : cluster [DBG] pgmap v10418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:11.163382+0000 mgr.smithi067.rdualw (mgr.24569) 12098 : cluster [DBG] pgmap v10418: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:13.164012+0000 mgr.smithi067.rdualw (mgr.24569) 12099 : cluster [DBG] pgmap v10419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:13.164012+0000 mgr.smithi067.rdualw (mgr.24569) 12099 : cluster [DBG] pgmap v10419: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:15.164760+0000 mgr.smithi067.rdualw (mgr.24569) 12100 : cluster [DBG] pgmap v10420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:15.164760+0000 mgr.smithi067.rdualw (mgr.24569) 12100 : cluster [DBG] pgmap v10420: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:17.165567+0000 mgr.smithi067.rdualw (mgr.24569) 12101 : cluster [DBG] pgmap v10421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:17.165567+0000 mgr.smithi067.rdualw (mgr.24569) 12101 : cluster [DBG] pgmap v10421: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:19.166073+0000 mgr.smithi067.rdualw (mgr.24569) 12102 : cluster [DBG] pgmap v10422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:19.166073+0000 mgr.smithi067.rdualw (mgr.24569) 12102 : cluster [DBG] pgmap v10422: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:21.166997+0000 mgr.smithi067.rdualw (mgr.24569) 12103 : cluster [DBG] pgmap v10423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:21.166997+0000 mgr.smithi067.rdualw (mgr.24569) 12103 : cluster [DBG] pgmap v10423: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:23.167552+0000 mgr.smithi067.rdualw (mgr.24569) 12104 : cluster [DBG] pgmap v10424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:23.167552+0000 mgr.smithi067.rdualw (mgr.24569) 12104 : cluster [DBG] pgmap v10424: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:25.328 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:16:25.639 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:16:25.640 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 8m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:16:25.640 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 8m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:16:25.640 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 8m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:16:25.640 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 8m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:16:25.640 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 8m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:16:25.641 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 8m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:16:25.641 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 8m ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:16:25.641 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 8m ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:16:25.641 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 8m ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:16:25.642 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 8m ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:16:25.642 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 8m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:16:25.642 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 8m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:16:25.642 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 8m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:16:25.643 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 8m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:16:25.643 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 8m ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:16:25.643 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 8m ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:16:25.643 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 8m ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:16:25.643 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 8m ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:16:25.644 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 8m ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:16:25.644 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 8m ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:16:25.644 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 8m ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:16:25.644 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 8m ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:16:25.645 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 8m ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:16:25.980 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:16:26.064 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:16:26.064 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:16:26.064 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:16:26.065 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:16:26.065 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:16:26.065 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:16:26.065 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:16:26.066 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:16:26.066 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:16:26.066 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:16:26.066 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:16:26.067 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:16:26.067 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:16:26.067 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:16:26.067 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:16:26.067 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:16:26.068 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:16:26.068 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:16:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:25.168175+0000 mgr.smithi067.rdualw (mgr.24569) 12105 : cluster [DBG] pgmap v10425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:16:25.314247+0000 mgr.smithi067.rdualw (mgr.24569) 12106 : audit [DBG] from='client.42214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:16:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:16:25.977974+0000 mon.smithi061 (mon.0) 2519 : audit [DBG] from='client.? 172.21.15.61:0/3001084824' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:16:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:25.168175+0000 mgr.smithi067.rdualw (mgr.24569) 12105 : cluster [DBG] pgmap v10425: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:26.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:16:25.314247+0000 mgr.smithi067.rdualw (mgr.24569) 12106 : audit [DBG] from='client.42214 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:16:26.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:16:25.977974+0000 mon.smithi061 (mon.0) 2519 : audit [DBG] from='client.? 172.21.15.61:0/3001084824' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:16:27.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:16:25.621349+0000 mgr.smithi067.rdualw (mgr.24569) 12107 : audit [DBG] from='client.42218 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:16:27.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:16:25.621349+0000 mgr.smithi067.rdualw (mgr.24569) 12107 : audit [DBG] from='client.42218 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:16:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:27.169260+0000 mgr.smithi067.rdualw (mgr.24569) 12108 : cluster [DBG] pgmap v10426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:27.169260+0000 mgr.smithi067.rdualw (mgr.24569) 12108 : cluster [DBG] pgmap v10426: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:29.169859+0000 mgr.smithi067.rdualw (mgr.24569) 12109 : cluster [DBG] pgmap v10427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:29.169859+0000 mgr.smithi067.rdualw (mgr.24569) 12109 : cluster [DBG] pgmap v10427: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:31.170726+0000 mgr.smithi067.rdualw (mgr.24569) 12110 : cluster [DBG] pgmap v10428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:31.170726+0000 mgr.smithi067.rdualw (mgr.24569) 12110 : cluster [DBG] pgmap v10428: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:33.171392+0000 mgr.smithi067.rdualw (mgr.24569) 12111 : cluster [DBG] pgmap v10429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:33.171392+0000 mgr.smithi067.rdualw (mgr.24569) 12111 : cluster [DBG] pgmap v10429: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:35.172052+0000 mgr.smithi067.rdualw (mgr.24569) 12112 : cluster [DBG] pgmap v10430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:16:36.377359+0000 mon.smithi067 (mon.1) 1826 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:16:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:16:36.377643+0000 mon.smithi067 (mon.1) 1827 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:16:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:16:36.377842+0000 mon.smithi061 (mon.0) 2520 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:16:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:16:36.378123+0000 mon.smithi061 (mon.0) 2521 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:16:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:35.172052+0000 mgr.smithi067.rdualw (mgr.24569) 12112 : cluster [DBG] pgmap v10430: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:16:36.377359+0000 mon.smithi067 (mon.1) 1826 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:16:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:16:36.377643+0000 mon.smithi067 (mon.1) 1827 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:16:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:16:36.377842+0000 mon.smithi061 (mon.0) 2520 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:16:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:16:36.378123+0000 mon.smithi061 (mon.0) 2521 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:16:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:37.172979+0000 mgr.smithi067.rdualw (mgr.24569) 12113 : cluster [DBG] pgmap v10431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:37.172979+0000 mgr.smithi067.rdualw (mgr.24569) 12113 : cluster [DBG] pgmap v10431: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:39.173700+0000 mgr.smithi067.rdualw (mgr.24569) 12114 : cluster [DBG] pgmap v10432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:39.173700+0000 mgr.smithi067.rdualw (mgr.24569) 12114 : cluster [DBG] pgmap v10432: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:41.174575+0000 mgr.smithi067.rdualw (mgr.24569) 12115 : cluster [DBG] pgmap v10433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:41.174575+0000 mgr.smithi067.rdualw (mgr.24569) 12115 : cluster [DBG] pgmap v10433: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:44.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:43.175119+0000 mgr.smithi067.rdualw (mgr.24569) 12116 : cluster [DBG] pgmap v10434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:43.175119+0000 mgr.smithi067.rdualw (mgr.24569) 12116 : cluster [DBG] pgmap v10434: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:45.175898+0000 mgr.smithi067.rdualw (mgr.24569) 12117 : cluster [DBG] pgmap v10435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:45.175898+0000 mgr.smithi067.rdualw (mgr.24569) 12117 : cluster [DBG] pgmap v10435: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:47.176835+0000 mgr.smithi067.rdualw (mgr.24569) 12118 : cluster [DBG] pgmap v10436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:47.176835+0000 mgr.smithi067.rdualw (mgr.24569) 12118 : cluster [DBG] pgmap v10436: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:49.177500+0000 mgr.smithi067.rdualw (mgr.24569) 12119 : cluster [DBG] pgmap v10437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:49.177500+0000 mgr.smithi067.rdualw (mgr.24569) 12119 : cluster [DBG] pgmap v10437: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:51.178316+0000 mgr.smithi067.rdualw (mgr.24569) 12120 : cluster [DBG] pgmap v10438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:16:52.040480+0000 mon.smithi067 (mon.1) 1828 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:16:52.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:16:52.041868+0000 mon.smithi067 (mon.1) 1829 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:16:52.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:16:52.042769+0000 mon.smithi067 (mon.1) 1830 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:16:52.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:16:52.460149+0000 mon.smithi061 (mon.0) 2522 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:16:52.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:16:52.465308+0000 mon.smithi061 (mon.0) 2523 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:16:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:51.178316+0000 mgr.smithi067.rdualw (mgr.24569) 12120 : cluster [DBG] pgmap v10438: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:16:52.040480+0000 mon.smithi067 (mon.1) 1828 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:16:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:16:52.041868+0000 mon.smithi067 (mon.1) 1829 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:16:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:16:52.042769+0000 mon.smithi067 (mon.1) 1830 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:16:52.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:16:52.460149+0000 mon.smithi061 (mon.0) 2522 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:16:52.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:16:52.465308+0000 mon.smithi061 (mon.0) 2523 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:16:53.801 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:16:52.043607+0000 mgr.smithi067.rdualw (mgr.24569) 12121 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:16:53.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:16:52.043607+0000 mgr.smithi067.rdualw (mgr.24569) 12121 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:16:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:53.179069+0000 mgr.smithi067.rdualw (mgr.24569) 12122 : cluster [DBG] pgmap v10439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:53.179069+0000 mgr.smithi067.rdualw (mgr.24569) 12122 : cluster [DBG] pgmap v10439: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:56.289 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:16:56.581 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:16:56.582 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 9m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:16:56.582 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 9m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:16:56.582 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 9m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:16:56.582 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 9m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:16:56.583 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 9m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:16:56.583 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 9m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:16:56.583 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 9m ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:16:56.583 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 9m ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:16:56.583 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 9m ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:16:56.584 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 9m ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:16:56.584 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 9m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:16:56.584 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 9m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:16:56.584 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 9m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:16:56.585 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 9m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:16:56.585 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 9m ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:16:56.585 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 9m ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:16:56.585 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 9m ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:16:56.585 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 9m ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:16:56.586 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 9m ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:16:56.586 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 9m ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:16:56.586 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 9m ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:16:56.587 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 9m ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:16:56.587 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 9m ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:16:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:55.179744+0000 mgr.smithi067.rdualw (mgr.24569) 12123 : cluster [DBG] pgmap v10440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:55.179744+0000 mgr.smithi067.rdualw (mgr.24569) 12123 : cluster [DBG] pgmap v10440: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:16:56.921 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:16:56.921 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:16:56.921 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:16:56.921 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:16:56.922 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:16:56.922 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:16:56.922 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:16:56.922 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:16:56.923 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:16:56.923 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:16:56.923 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:16:56.923 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:16:56.924 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:16:56.924 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:16:56.924 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:16:56.924 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:16:56.924 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:16:56.925 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:16:56.925 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:16:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:16:56.275241+0000 mgr.smithi067.rdualw (mgr.24569) 12124 : audit [DBG] from='client.42226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:16:57.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:16:56.563382+0000 mgr.smithi067.rdualw (mgr.24569) 12125 : audit [DBG] from='client.42230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:16:57.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:16:56.919323+0000 mon.smithi061 (mon.0) 2524 : audit [DBG] from='client.? 172.21.15.61:0/415879334' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:16:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:16:56.275241+0000 mgr.smithi067.rdualw (mgr.24569) 12124 : audit [DBG] from='client.42226 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:16:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:16:56.563382+0000 mgr.smithi067.rdualw (mgr.24569) 12125 : audit [DBG] from='client.42230 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:16:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:16:56.919323+0000 mon.smithi061 (mon.0) 2524 : audit [DBG] from='client.? 172.21.15.61:0/415879334' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:16:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:16:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:57.180634+0000 mgr.smithi067.rdualw (mgr.24569) 12126 : cluster [DBG] pgmap v10441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:16:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:16:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:57.180634+0000 mgr.smithi067.rdualw (mgr.24569) 12126 : cluster [DBG] pgmap v10441: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:00.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:16:59.181135+0000 mgr.smithi067.rdualw (mgr.24569) 12127 : cluster [DBG] pgmap v10442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:16:59.181135+0000 mgr.smithi067.rdualw (mgr.24569) 12127 : cluster [DBG] pgmap v10442: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:02.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:01.182129+0000 mgr.smithi067.rdualw (mgr.24569) 12128 : cluster [DBG] pgmap v10443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:01.182129+0000 mgr.smithi067.rdualw (mgr.24569) 12128 : cluster [DBG] pgmap v10443: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:03.182665+0000 mgr.smithi067.rdualw (mgr.24569) 12129 : cluster [DBG] pgmap v10444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:03.182665+0000 mgr.smithi067.rdualw (mgr.24569) 12129 : cluster [DBG] pgmap v10444: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:05.183277+0000 mgr.smithi067.rdualw (mgr.24569) 12130 : cluster [DBG] pgmap v10445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:05.183277+0000 mgr.smithi067.rdualw (mgr.24569) 12130 : cluster [DBG] pgmap v10445: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:07.184199+0000 mgr.smithi067.rdualw (mgr.24569) 12131 : cluster [DBG] pgmap v10446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:07.184199+0000 mgr.smithi067.rdualw (mgr.24569) 12131 : cluster [DBG] pgmap v10446: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:09.184774+0000 mgr.smithi067.rdualw (mgr.24569) 12132 : cluster [DBG] pgmap v10447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:09.184774+0000 mgr.smithi067.rdualw (mgr.24569) 12132 : cluster [DBG] pgmap v10447: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:11.185648+0000 mgr.smithi067.rdualw (mgr.24569) 12133 : cluster [DBG] pgmap v10448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:11.185648+0000 mgr.smithi067.rdualw (mgr.24569) 12133 : cluster [DBG] pgmap v10448: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:14.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:13.186163+0000 mgr.smithi067.rdualw (mgr.24569) 12134 : cluster [DBG] pgmap v10449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:13.186163+0000 mgr.smithi067.rdualw (mgr.24569) 12134 : cluster [DBG] pgmap v10449: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:17.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:15.186956+0000 mgr.smithi067.rdualw (mgr.24569) 12135 : cluster [DBG] pgmap v10450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:15.186956+0000 mgr.smithi067.rdualw (mgr.24569) 12135 : cluster [DBG] pgmap v10450: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:17.187945+0000 mgr.smithi067.rdualw (mgr.24569) 12136 : cluster [DBG] pgmap v10451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:17.187945+0000 mgr.smithi067.rdualw (mgr.24569) 12136 : cluster [DBG] pgmap v10451: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:19.188484+0000 mgr.smithi067.rdualw (mgr.24569) 12137 : cluster [DBG] pgmap v10452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:19.188484+0000 mgr.smithi067.rdualw (mgr.24569) 12137 : cluster [DBG] pgmap v10452: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:22.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:21.189306+0000 mgr.smithi067.rdualw (mgr.24569) 12138 : cluster [DBG] pgmap v10453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:22.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:21.189306+0000 mgr.smithi067.rdualw (mgr.24569) 12138 : cluster [DBG] pgmap v10453: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:23.189885+0000 mgr.smithi067.rdualw (mgr.24569) 12139 : cluster [DBG] pgmap v10454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:23.189885+0000 mgr.smithi067.rdualw (mgr.24569) 12139 : cluster [DBG] pgmap v10454: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:25.190513+0000 mgr.smithi067.rdualw (mgr.24569) 12140 : cluster [DBG] pgmap v10455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:25.190513+0000 mgr.smithi067.rdualw (mgr.24569) 12140 : cluster [DBG] pgmap v10455: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:27.230 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:17:27.522 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:17:27.522 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 9m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:17:27.522 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 9m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:17:27.523 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 9m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:17:27.523 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 9m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:17:27.523 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 9m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:17:27.523 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 9m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:17:27.524 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 9m ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:17:27.524 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 9m ago 5h 666M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:17:27.524 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 9m ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:17:27.524 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 9m ago 5h 1171M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:17:27.525 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 9m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:17:27.525 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 9m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:17:27.525 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 9m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:17:27.526 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 9m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:17:27.527 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 9m ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:17:27.527 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 9m ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:17:27.527 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 9m ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:17:27.528 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 9m ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:17:27.528 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 9m ago 5h 2234M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:17:27.528 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 9m ago 5h 2378M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:17:27.528 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 9m ago 5h 1957M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:17:27.529 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 9m ago 5h 2950M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:17:27.529 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 9m ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:17:27.883 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:17:27.883 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:17:27.883 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:17:27.883 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:17:27.884 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:17:27.884 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:17:27.884 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:17:27.884 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:17:27.885 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:17:27.885 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:17:27.885 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:17:27.885 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:17:27.886 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:17:27.886 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:17:27.886 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:17:27.886 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:17:27.886 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:17:27.887 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:17:27.887 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:17:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:27.191588+0000 mgr.smithi067.rdualw (mgr.24569) 12141 : cluster [DBG] pgmap v10456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:17:27.214607+0000 mgr.smithi067.rdualw (mgr.24569) 12142 : audit [DBG] from='client.42238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:17:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:17:27.504207+0000 mgr.smithi067.rdualw (mgr.24569) 12143 : audit [DBG] from='client.42242 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:17:28.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:17:27.881071+0000 mon.smithi061 (mon.0) 2525 : audit [DBG] from='client.? 172.21.15.61:0/984890255' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:17:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:27.191588+0000 mgr.smithi067.rdualw (mgr.24569) 12141 : cluster [DBG] pgmap v10456: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:28.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:17:27.214607+0000 mgr.smithi067.rdualw (mgr.24569) 12142 : audit [DBG] from='client.42238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:17:28.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:17:27.504207+0000 mgr.smithi067.rdualw (mgr.24569) 12143 : audit [DBG] from='client.42242 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:17:28.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:17:27.881071+0000 mon.smithi061 (mon.0) 2525 : audit [DBG] from='client.? 172.21.15.61:0/984890255' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:17:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:29.192150+0000 mgr.smithi067.rdualw (mgr.24569) 12144 : cluster [DBG] pgmap v10457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:29.192150+0000 mgr.smithi067.rdualw (mgr.24569) 12144 : cluster [DBG] pgmap v10457: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:31.193029+0000 mgr.smithi067.rdualw (mgr.24569) 12145 : cluster [DBG] pgmap v10458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:31.193029+0000 mgr.smithi067.rdualw (mgr.24569) 12145 : cluster [DBG] pgmap v10458: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:33.193712+0000 mgr.smithi067.rdualw (mgr.24569) 12146 : cluster [DBG] pgmap v10459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:33.193712+0000 mgr.smithi067.rdualw (mgr.24569) 12146 : cluster [DBG] pgmap v10459: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:35.194458+0000 mgr.smithi067.rdualw (mgr.24569) 12147 : cluster [DBG] pgmap v10460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:17:36.382986+0000 mon.smithi067 (mon.1) 1831 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:17:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:17:36.383356+0000 mon.smithi067 (mon.1) 1832 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:17:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:17:36.383518+0000 mon.smithi061 (mon.0) 2526 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:17:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:17:36.383765+0000 mon.smithi061 (mon.0) 2527 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:17:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:35.194458+0000 mgr.smithi067.rdualw (mgr.24569) 12147 : cluster [DBG] pgmap v10460: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:17:36.382986+0000 mon.smithi067 (mon.1) 1831 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:17:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:17:36.383356+0000 mon.smithi067 (mon.1) 1832 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:17:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:17:36.383518+0000 mon.smithi061 (mon.0) 2526 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:17:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:17:36.383765+0000 mon.smithi061 (mon.0) 2527 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:17:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:37.195373+0000 mgr.smithi067.rdualw (mgr.24569) 12148 : cluster [DBG] pgmap v10461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:37.195373+0000 mgr.smithi067.rdualw (mgr.24569) 12148 : cluster [DBG] pgmap v10461: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:39.196179+0000 mgr.smithi067.rdualw (mgr.24569) 12149 : cluster [DBG] pgmap v10462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:39.196179+0000 mgr.smithi067.rdualw (mgr.24569) 12149 : cluster [DBG] pgmap v10462: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:41.197222+0000 mgr.smithi067.rdualw (mgr.24569) 12150 : cluster [DBG] pgmap v10463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:41.197222+0000 mgr.smithi067.rdualw (mgr.24569) 12150 : cluster [DBG] pgmap v10463: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:43.197853+0000 mgr.smithi067.rdualw (mgr.24569) 12151 : cluster [DBG] pgmap v10464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:43.197853+0000 mgr.smithi067.rdualw (mgr.24569) 12151 : cluster [DBG] pgmap v10464: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:45.198654+0000 mgr.smithi067.rdualw (mgr.24569) 12152 : cluster [DBG] pgmap v10465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:45.198654+0000 mgr.smithi067.rdualw (mgr.24569) 12152 : cluster [DBG] pgmap v10465: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:47.199690+0000 mgr.smithi067.rdualw (mgr.24569) 12153 : cluster [DBG] pgmap v10466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:47.199690+0000 mgr.smithi067.rdualw (mgr.24569) 12153 : cluster [DBG] pgmap v10466: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:49.200196+0000 mgr.smithi067.rdualw (mgr.24569) 12154 : cluster [DBG] pgmap v10467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:49.200196+0000 mgr.smithi067.rdualw (mgr.24569) 12154 : cluster [DBG] pgmap v10467: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:52.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:51.201159+0000 mgr.smithi067.rdualw (mgr.24569) 12155 : cluster [DBG] pgmap v10468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:52.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:17:52.468953+0000 mon.smithi067 (mon.1) 1833 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:17:52.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:17:52.470427+0000 mon.smithi067 (mon.1) 1834 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:17:52.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:17:52.471399+0000 mon.smithi067 (mon.1) 1835 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:17:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:51.201159+0000 mgr.smithi067.rdualw (mgr.24569) 12155 : cluster [DBG] pgmap v10468: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:17:52.468953+0000 mon.smithi067 (mon.1) 1833 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:17:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:17:52.470427+0000 mon.smithi067 (mon.1) 1834 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:17:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:17:52.471399+0000 mon.smithi067 (mon.1) 1835 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:17:53.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:17:52.472288+0000 mgr.smithi067.rdualw (mgr.24569) 12156 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:17:53.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:17:52.472288+0000 mgr.smithi067.rdualw (mgr.24569) 12156 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:17:54.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:53.201736+0000 mgr.smithi067.rdualw (mgr.24569) 12157 : cluster [DBG] pgmap v10469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:53.201736+0000 mgr.smithi067.rdualw (mgr.24569) 12157 : cluster [DBG] pgmap v10469: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:56.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:55.202242+0000 mgr.smithi067.rdualw (mgr.24569) 12158 : cluster [DBG] pgmap v10470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:55.202242+0000 mgr.smithi067.rdualw (mgr.24569) 12158 : cluster [DBG] pgmap v10470: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:17:58.203 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:17:58.520 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:17:58.520 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 10m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:17:58.520 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 10m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:17:58.521 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 1s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:17:58.521 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 10m ago 5h 42.5M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:17:58.521 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 10m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:17:58.521 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 1s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:17:58.522 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 10m ago 5h 494M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:17:58.522 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 1s ago 5h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:17:58.522 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 10m ago 5h 2018M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:17:58.522 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 1s ago 5h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:17:58.523 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 10m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:17:58.523 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 1s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:17:58.525 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 10m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:17:58.526 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 1s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:17:58.526 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 10m ago 5h 1345M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:17:58.526 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 10m ago 5h 2269M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:17:58.526 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 10m ago 5h 1429M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:17:58.527 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 10m ago 5h 2424M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:17:58.527 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 1s ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:17:58.527 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 1s ago 5h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:17:58.527 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 1s ago 5h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:17:58.527 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 1s ago 5h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:17:58.528 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 10m ago 5h 132M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:17:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:17:57.069581+0000 mon.smithi061 (mon.0) 2528 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:17:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:57.202962+0000 mgr.smithi067.rdualw (mgr.24569) 12159 : cluster [DBG] pgmap v10471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:58.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:17:57.468312+0000 mon.smithi067 (mon.1) 1836 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:17:58.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:17:57.469485+0000 mon.smithi061 (mon.0) 2529 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:17:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:17:57.069581+0000 mon.smithi061 (mon.0) 2528 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:17:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:57.202962+0000 mgr.smithi067.rdualw (mgr.24569) 12159 : cluster [DBG] pgmap v10471: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:17:58.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:17:57.468312+0000 mon.smithi067 (mon.1) 1836 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:17:58.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:17:57.469485+0000 mon.smithi061 (mon.0) 2529 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:17:58.917 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:17:58.918 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:17:58.918 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:17:58.918 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:17:58.919 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:17:58.919 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:17:58.919 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:17:58.919 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:17:58.919 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:17:58.920 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:17:58.920 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:17:58.920 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:17:58.920 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:17:58.921 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:17:58.921 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:17:58.921 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:17:58.921 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:17:58.921 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:17:58.922 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:17:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:17:58.187029+0000 mgr.smithi067.rdualw (mgr.24569) 12160 : audit [DBG] from='client.42250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:17:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:17:58.501874+0000 mgr.smithi067.rdualw (mgr.24569) 12161 : audit [DBG] from='client.42254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:17:59.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:17:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:17:58.915998+0000 mon.smithi061 (mon.0) 2530 : audit [DBG] from='client.? 172.21.15.61:0/2907308848' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:17:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:17:58.187029+0000 mgr.smithi067.rdualw (mgr.24569) 12160 : audit [DBG] from='client.42250 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:17:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:17:58.501874+0000 mgr.smithi067.rdualw (mgr.24569) 12161 : audit [DBG] from='client.42254 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:17:59.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:17:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:17:58.915998+0000 mon.smithi061 (mon.0) 2530 : audit [DBG] from='client.? 172.21.15.61:0/2907308848' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:18:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:17:59.203793+0000 mgr.smithi067.rdualw (mgr.24569) 12162 : cluster [DBG] pgmap v10472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:00.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:17:59.612007+0000 mon.smithi061 (mon.0) 2531 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:18:00.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:18:00.016662+0000 mon.smithi067 (mon.1) 1837 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:18:00.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:18:00.017491+0000 mon.smithi061 (mon.0) 2532 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:18:00.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:18:00.022230+0000 mon.smithi061 (mon.0) 2533 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:18:00.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:18:00.028945+0000 mon.smithi061 (mon.0) 2534 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:18:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:17:59.203793+0000 mgr.smithi067.rdualw (mgr.24569) 12162 : cluster [DBG] pgmap v10472: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:00.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:17:59.612007+0000 mon.smithi061 (mon.0) 2531 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:18:00.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:18:00.016662+0000 mon.smithi067 (mon.1) 1837 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:18:00.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:18:00.017491+0000 mon.smithi061 (mon.0) 2532 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:18:00.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:18:00.022230+0000 mon.smithi061 (mon.0) 2533 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:18:00.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:18:00.028945+0000 mon.smithi061 (mon.0) 2534 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:18:02.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:01.204840+0000 mgr.smithi067.rdualw (mgr.24569) 12163 : cluster [DBG] pgmap v10473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:02.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:01.204840+0000 mgr.smithi067.rdualw (mgr.24569) 12163 : cluster [DBG] pgmap v10473: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:04.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:03.205526+0000 mgr.smithi067.rdualw (mgr.24569) 12164 : cluster [DBG] pgmap v10474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:04.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:03.205526+0000 mgr.smithi067.rdualw (mgr.24569) 12164 : cluster [DBG] pgmap v10474: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:06.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:05.206326+0000 mgr.smithi067.rdualw (mgr.24569) 12165 : cluster [DBG] pgmap v10475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:06.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:05.206326+0000 mgr.smithi067.rdualw (mgr.24569) 12165 : cluster [DBG] pgmap v10475: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:08.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:07.207451+0000 mgr.smithi067.rdualw (mgr.24569) 12166 : cluster [DBG] pgmap v10476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:08.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:07.207451+0000 mgr.smithi067.rdualw (mgr.24569) 12166 : cluster [DBG] pgmap v10476: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:10.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:09.208087+0000 mgr.smithi067.rdualw (mgr.24569) 12167 : cluster [DBG] pgmap v10477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:10.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:09.208087+0000 mgr.smithi067.rdualw (mgr.24569) 12167 : cluster [DBG] pgmap v10477: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:12.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:11.208949+0000 mgr.smithi067.rdualw (mgr.24569) 12168 : cluster [DBG] pgmap v10478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:11.208949+0000 mgr.smithi067.rdualw (mgr.24569) 12168 : cluster [DBG] pgmap v10478: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:13.209434+0000 mgr.smithi067.rdualw (mgr.24569) 12169 : cluster [DBG] pgmap v10479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:13.209434+0000 mgr.smithi067.rdualw (mgr.24569) 12169 : cluster [DBG] pgmap v10479: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:15.210031+0000 mgr.smithi067.rdualw (mgr.24569) 12170 : cluster [DBG] pgmap v10480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:15.210031+0000 mgr.smithi067.rdualw (mgr.24569) 12170 : cluster [DBG] pgmap v10480: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:17.210925+0000 mgr.smithi067.rdualw (mgr.24569) 12171 : cluster [DBG] pgmap v10481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:17.210925+0000 mgr.smithi067.rdualw (mgr.24569) 12171 : cluster [DBG] pgmap v10481: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:19.211589+0000 mgr.smithi067.rdualw (mgr.24569) 12172 : cluster [DBG] pgmap v10482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:19.211589+0000 mgr.smithi067.rdualw (mgr.24569) 12172 : cluster [DBG] pgmap v10482: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:21.212479+0000 mgr.smithi067.rdualw (mgr.24569) 12173 : cluster [DBG] pgmap v10483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:21.212479+0000 mgr.smithi067.rdualw (mgr.24569) 12173 : cluster [DBG] pgmap v10483: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:23.213130+0000 mgr.smithi067.rdualw (mgr.24569) 12174 : cluster [DBG] pgmap v10484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:24.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:23.213130+0000 mgr.smithi067.rdualw (mgr.24569) 12174 : cluster [DBG] pgmap v10484: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:25.213752+0000 mgr.smithi067.rdualw (mgr.24569) 12175 : cluster [DBG] pgmap v10485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:25.213752+0000 mgr.smithi067.rdualw (mgr.24569) 12175 : cluster [DBG] pgmap v10485: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:27.214731+0000 mgr.smithi067.rdualw (mgr.24569) 12176 : cluster [DBG] pgmap v10486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:29.360 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:27.214731+0000 mgr.smithi067.rdualw (mgr.24569) 12176 : cluster [DBG] pgmap v10486: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:29.360 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:18:29.517 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:18:29.517 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 29s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:18:29.518 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 29s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:18:29.518 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 32s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:18:29.518 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 29s ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:18:29.518 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 29s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:18:29.518 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 32s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:18:29.519 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 29s ago 5h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:18:29.519 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 32s ago 5h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:18:29.519 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 29s ago 5h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:18:29.519 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 32s ago 5h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:18:29.520 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 29s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:18:29.520 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 32s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:18:29.520 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 29s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:18:29.520 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 32s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:18:29.520 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 29s ago 5h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:18:29.521 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 29s ago 5h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:18:29.521 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 29s ago 5h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:18:29.521 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 29s ago 5h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:18:29.521 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 32s ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:18:29.521 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 32s ago 5h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:18:29.522 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 32s ago 5h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:18:29.522 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 32s ago 5h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:18:29.522 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 29s ago 5h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:18:29.938 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:18:29.938 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:18:29.939 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:18:29.939 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:18:29.939 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:18:29.939 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:18:29.940 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:18:29.940 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:18:29.940 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:18:29.940 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:18:29.940 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:18:29.941 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:18:29.941 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:18:29.941 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:18:29.941 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:18:29.942 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:18:29.942 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:18:29.942 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:18:29.942 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:18:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:18:29.210975+0000 mgr.smithi067.rdualw (mgr.24569) 12177 : audit [DBG] from='client.42262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:18:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:29.215496+0000 mgr.smithi067.rdualw (mgr.24569) 12178 : cluster [DBG] pgmap v10487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:18:29.498989+0000 mgr.smithi067.rdualw (mgr.24569) 12179 : audit [DBG] from='client.42266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:18:30.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:18:29.936236+0000 mon.smithi061 (mon.0) 2535 : audit [DBG] from='client.? 172.21.15.61:0/3774143685' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:18:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:18:29.210975+0000 mgr.smithi067.rdualw (mgr.24569) 12177 : audit [DBG] from='client.42262 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:18:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:29.215496+0000 mgr.smithi067.rdualw (mgr.24569) 12178 : cluster [DBG] pgmap v10487: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:30.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:18:29.498989+0000 mgr.smithi067.rdualw (mgr.24569) 12179 : audit [DBG] from='client.42266 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:18:30.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:18:29.936236+0000 mon.smithi061 (mon.0) 2535 : audit [DBG] from='client.? 172.21.15.61:0/3774143685' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:18:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:31.216524+0000 mgr.smithi067.rdualw (mgr.24569) 12180 : cluster [DBG] pgmap v10488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:31.216524+0000 mgr.smithi067.rdualw (mgr.24569) 12180 : cluster [DBG] pgmap v10488: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:33.217135+0000 mgr.smithi067.rdualw (mgr.24569) 12181 : cluster [DBG] pgmap v10489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:33.217135+0000 mgr.smithi067.rdualw (mgr.24569) 12181 : cluster [DBG] pgmap v10489: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:35.217872+0000 mgr.smithi067.rdualw (mgr.24569) 12182 : cluster [DBG] pgmap v10490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:18:36.388145+0000 mon.smithi067 (mon.1) 1838 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:18:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:18:36.388391+0000 mon.smithi067 (mon.1) 1839 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:18:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:18:36.388716+0000 mon.smithi061 (mon.0) 2536 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:18:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:18:36.389060+0000 mon.smithi061 (mon.0) 2537 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:18:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:35.217872+0000 mgr.smithi067.rdualw (mgr.24569) 12182 : cluster [DBG] pgmap v10490: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:18:36.388145+0000 mon.smithi067 (mon.1) 1838 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:18:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:18:36.388391+0000 mon.smithi067 (mon.1) 1839 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:18:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:18:36.388716+0000 mon.smithi061 (mon.0) 2536 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:18:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:18:36.389060+0000 mon.smithi061 (mon.0) 2537 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:18:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:37.218735+0000 mgr.smithi067.rdualw (mgr.24569) 12183 : cluster [DBG] pgmap v10491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:38.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:37.218735+0000 mgr.smithi067.rdualw (mgr.24569) 12183 : cluster [DBG] pgmap v10491: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:39.219482+0000 mgr.smithi067.rdualw (mgr.24569) 12184 : cluster [DBG] pgmap v10492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:40.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:39.219482+0000 mgr.smithi067.rdualw (mgr.24569) 12184 : cluster [DBG] pgmap v10492: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:41.220438+0000 mgr.smithi067.rdualw (mgr.24569) 12185 : cluster [DBG] pgmap v10493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:41.220438+0000 mgr.smithi067.rdualw (mgr.24569) 12185 : cluster [DBG] pgmap v10493: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:43.220945+0000 mgr.smithi067.rdualw (mgr.24569) 12186 : cluster [DBG] pgmap v10494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:43.220945+0000 mgr.smithi067.rdualw (mgr.24569) 12186 : cluster [DBG] pgmap v10494: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:45.221689+0000 mgr.smithi067.rdualw (mgr.24569) 12187 : cluster [DBG] pgmap v10495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:45.221689+0000 mgr.smithi067.rdualw (mgr.24569) 12187 : cluster [DBG] pgmap v10495: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:47.222795+0000 mgr.smithi067.rdualw (mgr.24569) 12188 : cluster [DBG] pgmap v10496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:47.222795+0000 mgr.smithi067.rdualw (mgr.24569) 12188 : cluster [DBG] pgmap v10496: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:49.223449+0000 mgr.smithi067.rdualw (mgr.24569) 12189 : cluster [DBG] pgmap v10497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:49.223449+0000 mgr.smithi067.rdualw (mgr.24569) 12189 : cluster [DBG] pgmap v10497: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:51.224319+0000 mgr.smithi067.rdualw (mgr.24569) 12190 : cluster [DBG] pgmap v10498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:51.224319+0000 mgr.smithi067.rdualw (mgr.24569) 12190 : cluster [DBG] pgmap v10498: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:54.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:53.224876+0000 mgr.smithi067.rdualw (mgr.24569) 12191 : cluster [DBG] pgmap v10499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:53.224876+0000 mgr.smithi067.rdualw (mgr.24569) 12191 : cluster [DBG] pgmap v10499: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:55.225712+0000 mgr.smithi067.rdualw (mgr.24569) 12192 : cluster [DBG] pgmap v10500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:55.225712+0000 mgr.smithi067.rdualw (mgr.24569) 12192 : cluster [DBG] pgmap v10500: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:18:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:18:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:57.226661+0000 mgr.smithi067.rdualw (mgr.24569) 12193 : cluster [DBG] pgmap v10501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:18:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:18:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:57.226661+0000 mgr.smithi067.rdualw (mgr.24569) 12193 : cluster [DBG] pgmap v10501: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:00.247 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:19:00.544 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:19:00.544 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 60s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:19:00.545 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 60s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:19:00.545 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 63s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:19:00.545 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 60s ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:19:00.545 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 60s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:19:00.546 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 63s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:19:00.546 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 60s ago 5h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:19:00.546 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 63s ago 5h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:19:00.546 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 60s ago 5h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:19:00.547 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 63s ago 5h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:19:00.547 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 60s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:19:00.547 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 63s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:19:00.547 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 60s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:19:00.548 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 63s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:19:00.548 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 60s ago 5h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:19:00.548 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 60s ago 5h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:19:00.548 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 60s ago 5h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:19:00.548 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 60s ago 5h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:19:00.549 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 63s ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:19:00.549 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 63s ago 5h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:19:00.549 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 63s ago 5h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:19:00.549 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 63s ago 5h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:19:00.550 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 60s ago 5h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:19:00.980 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:19:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:19:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:19:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:19:00.981 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:19:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:19:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:19:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:19:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:19:00.982 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:19:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:19:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:19:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:19:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:19:00.983 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:19:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:19:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:19:00.984 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:19:00.984 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:19:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:18:59.227242+0000 mgr.smithi067.rdualw (mgr.24569) 12194 : cluster [DBG] pgmap v10502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:19:00.033397+0000 mon.smithi067 (mon.1) 1840 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:19:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:19:00.034916+0000 mon.smithi067 (mon.1) 1841 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:19:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:19:00.035920+0000 mon.smithi067 (mon.1) 1842 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:19:01.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:19:00.469599+0000 mon.smithi061 (mon.0) 2538 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:19:01.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:19:00.475647+0000 mon.smithi061 (mon.0) 2539 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:19:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:18:59.227242+0000 mgr.smithi067.rdualw (mgr.24569) 12194 : cluster [DBG] pgmap v10502: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:19:00.033397+0000 mon.smithi067 (mon.1) 1840 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:19:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:19:00.034916+0000 mon.smithi067 (mon.1) 1841 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:19:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:19:00.035920+0000 mon.smithi067 (mon.1) 1842 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:19:01.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:19:00.469599+0000 mon.smithi061 (mon.0) 2538 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:19:01.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:19:00.475647+0000 mon.smithi061 (mon.0) 2539 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:19:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:19:00.036777+0000 mgr.smithi067.rdualw (mgr.24569) 12195 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:19:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:19:00.232295+0000 mgr.smithi067.rdualw (mgr.24569) 12196 : audit [DBG] from='client.42274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:19:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:19:00.527841+0000 mgr.smithi067.rdualw (mgr.24569) 12197 : audit [DBG] from='client.42278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:19:02.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:19:00.978610+0000 mon.smithi061 (mon.0) 2540 : audit [DBG] from='client.? 172.21.15.61:0/338600575' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:19:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:19:00.036777+0000 mgr.smithi067.rdualw (mgr.24569) 12195 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:19:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:19:00.232295+0000 mgr.smithi067.rdualw (mgr.24569) 12196 : audit [DBG] from='client.42274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:19:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:19:00.527841+0000 mgr.smithi067.rdualw (mgr.24569) 12197 : audit [DBG] from='client.42278 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:19:02.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:19:00.978610+0000 mon.smithi061 (mon.0) 2540 : audit [DBG] from='client.? 172.21.15.61:0/338600575' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:19:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:01.228355+0000 mgr.smithi067.rdualw (mgr.24569) 12198 : cluster [DBG] pgmap v10503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:01.228355+0000 mgr.smithi067.rdualw (mgr.24569) 12198 : cluster [DBG] pgmap v10503: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:03.228927+0000 mgr.smithi067.rdualw (mgr.24569) 12199 : cluster [DBG] pgmap v10504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:03.228927+0000 mgr.smithi067.rdualw (mgr.24569) 12199 : cluster [DBG] pgmap v10504: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:05.229755+0000 mgr.smithi067.rdualw (mgr.24569) 12200 : cluster [DBG] pgmap v10505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:05.229755+0000 mgr.smithi067.rdualw (mgr.24569) 12200 : cluster [DBG] pgmap v10505: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:07.230682+0000 mgr.smithi067.rdualw (mgr.24569) 12201 : cluster [DBG] pgmap v10506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:07.230682+0000 mgr.smithi067.rdualw (mgr.24569) 12201 : cluster [DBG] pgmap v10506: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:09.231451+0000 mgr.smithi067.rdualw (mgr.24569) 12202 : cluster [DBG] pgmap v10507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:11.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:09.231451+0000 mgr.smithi067.rdualw (mgr.24569) 12202 : cluster [DBG] pgmap v10507: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:11.232363+0000 mgr.smithi067.rdualw (mgr.24569) 12203 : cluster [DBG] pgmap v10508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:11.232363+0000 mgr.smithi067.rdualw (mgr.24569) 12203 : cluster [DBG] pgmap v10508: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:13.233109+0000 mgr.smithi067.rdualw (mgr.24569) 12204 : cluster [DBG] pgmap v10509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:13.233109+0000 mgr.smithi067.rdualw (mgr.24569) 12204 : cluster [DBG] pgmap v10509: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:15.233952+0000 mgr.smithi067.rdualw (mgr.24569) 12205 : cluster [DBG] pgmap v10510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:15.233952+0000 mgr.smithi067.rdualw (mgr.24569) 12205 : cluster [DBG] pgmap v10510: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:17.235083+0000 mgr.smithi067.rdualw (mgr.24569) 12206 : cluster [DBG] pgmap v10511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:17.235083+0000 mgr.smithi067.rdualw (mgr.24569) 12206 : cluster [DBG] pgmap v10511: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:19.235768+0000 mgr.smithi067.rdualw (mgr.24569) 12207 : cluster [DBG] pgmap v10512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:19.235768+0000 mgr.smithi067.rdualw (mgr.24569) 12207 : cluster [DBG] pgmap v10512: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:21.236706+0000 mgr.smithi067.rdualw (mgr.24569) 12208 : cluster [DBG] pgmap v10513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:21.236706+0000 mgr.smithi067.rdualw (mgr.24569) 12208 : cluster [DBG] pgmap v10513: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:23.237257+0000 mgr.smithi067.rdualw (mgr.24569) 12209 : cluster [DBG] pgmap v10514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:23.237257+0000 mgr.smithi067.rdualw (mgr.24569) 12209 : cluster [DBG] pgmap v10514: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:25.237916+0000 mgr.smithi067.rdualw (mgr.24569) 12210 : cluster [DBG] pgmap v10515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:25.237916+0000 mgr.smithi067.rdualw (mgr.24569) 12210 : cluster [DBG] pgmap v10515: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:27.238949+0000 mgr.smithi067.rdualw (mgr.24569) 12211 : cluster [DBG] pgmap v10516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:27.238949+0000 mgr.smithi067.rdualw (mgr.24569) 12211 : cluster [DBG] pgmap v10516: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:29.239695+0000 mgr.smithi067.rdualw (mgr.24569) 12212 : cluster [DBG] pgmap v10517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:29.239695+0000 mgr.smithi067.rdualw (mgr.24569) 12212 : cluster [DBG] pgmap v10517: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:31.328 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:19:31.618 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:19:31.619 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 92s ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:19:31.619 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 92s ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:19:31.620 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 94s ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:19:31.620 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 92s ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:19:31.620 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 92s ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:19:31.620 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 94s ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:19:31.621 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 92s ago 5h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:19:31.621 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 94s ago 5h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:19:31.621 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 92s ago 5h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:19:31.621 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 94s ago 5h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:19:31.621 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 92s ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:19:31.622 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 94s ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:19:31.622 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 92s ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:19:31.622 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 94s ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:19:31.622 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 92s ago 5h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:19:31.623 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 92s ago 5h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:19:31.623 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 92s ago 5h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:19:31.623 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 92s ago 5h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:19:31.623 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 94s ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:19:31.624 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 94s ago 5h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:19:31.624 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 94s ago 5h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:19:31.624 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 94s ago 5h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:19:31.624 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 92s ago 5h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:19:31.963 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:19:31.964 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:19:31.964 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:19:31.964 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:19:31.965 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:19:31.965 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:19:31.965 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:19:31.965 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:19:31.966 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:19:31.966 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:19:31.966 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:19:31.966 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:19:31.967 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:19:31.967 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:19:31.967 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:19:31.968 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:19:31.968 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:19:31.968 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:19:31.968 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:19:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:31.240504+0000 mgr.smithi067.rdualw (mgr.24569) 12213 : cluster [DBG] pgmap v10518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:19:31.314251+0000 mgr.smithi067.rdualw (mgr.24569) 12214 : audit [DBG] from='client.42286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:19:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:19:31.600576+0000 mgr.smithi067.rdualw (mgr.24569) 12215 : audit [DBG] from='client.42290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:19:32.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:19:31.962062+0000 mon.smithi061 (mon.0) 2541 : audit [DBG] from='client.? 172.21.15.61:0/1223970350' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:19:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:31.240504+0000 mgr.smithi067.rdualw (mgr.24569) 12213 : cluster [DBG] pgmap v10518: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:19:31.314251+0000 mgr.smithi067.rdualw (mgr.24569) 12214 : audit [DBG] from='client.42286 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:19:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:19:31.600576+0000 mgr.smithi067.rdualw (mgr.24569) 12215 : audit [DBG] from='client.42290 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:19:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:19:31.962062+0000 mon.smithi061 (mon.0) 2541 : audit [DBG] from='client.? 172.21.15.61:0/1223970350' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:19:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:33.241200+0000 mgr.smithi067.rdualw (mgr.24569) 12216 : cluster [DBG] pgmap v10519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:33.241200+0000 mgr.smithi067.rdualw (mgr.24569) 12216 : cluster [DBG] pgmap v10519: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:35.241789+0000 mgr.smithi067.rdualw (mgr.24569) 12217 : cluster [DBG] pgmap v10520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:19:36.394158+0000 mon.smithi067 (mon.1) 1843 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:19:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:19:36.394399+0000 mon.smithi067 (mon.1) 1844 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:19:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:19:36.394616+0000 mon.smithi061 (mon.0) 2542 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:19:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:19:36.395108+0000 mon.smithi061 (mon.0) 2543 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:19:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:35.241789+0000 mgr.smithi067.rdualw (mgr.24569) 12217 : cluster [DBG] pgmap v10520: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:19:36.394158+0000 mon.smithi067 (mon.1) 1843 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:19:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:19:36.394399+0000 mon.smithi067 (mon.1) 1844 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:19:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:19:36.394616+0000 mon.smithi061 (mon.0) 2542 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:19:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:19:36.395108+0000 mon.smithi061 (mon.0) 2543 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:19:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:37.242844+0000 mgr.smithi067.rdualw (mgr.24569) 12218 : cluster [DBG] pgmap v10521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:37.242844+0000 mgr.smithi067.rdualw (mgr.24569) 12218 : cluster [DBG] pgmap v10521: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:40.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:39.243422+0000 mgr.smithi067.rdualw (mgr.24569) 12219 : cluster [DBG] pgmap v10522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:39.243422+0000 mgr.smithi067.rdualw (mgr.24569) 12219 : cluster [DBG] pgmap v10522: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:41.244558+0000 mgr.smithi067.rdualw (mgr.24569) 12220 : cluster [DBG] pgmap v10523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:41.244558+0000 mgr.smithi067.rdualw (mgr.24569) 12220 : cluster [DBG] pgmap v10523: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:43.245063+0000 mgr.smithi067.rdualw (mgr.24569) 12221 : cluster [DBG] pgmap v10524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:43.245063+0000 mgr.smithi067.rdualw (mgr.24569) 12221 : cluster [DBG] pgmap v10524: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:45.245783+0000 mgr.smithi067.rdualw (mgr.24569) 12222 : cluster [DBG] pgmap v10525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:47.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:45.245783+0000 mgr.smithi067.rdualw (mgr.24569) 12222 : cluster [DBG] pgmap v10525: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:47.247078+0000 mgr.smithi067.rdualw (mgr.24569) 12223 : cluster [DBG] pgmap v10526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:47.247078+0000 mgr.smithi067.rdualw (mgr.24569) 12223 : cluster [DBG] pgmap v10526: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:49.247725+0000 mgr.smithi067.rdualw (mgr.24569) 12224 : cluster [DBG] pgmap v10527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:49.247725+0000 mgr.smithi067.rdualw (mgr.24569) 12224 : cluster [DBG] pgmap v10527: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:51.248681+0000 mgr.smithi067.rdualw (mgr.24569) 12225 : cluster [DBG] pgmap v10528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:51.248681+0000 mgr.smithi067.rdualw (mgr.24569) 12225 : cluster [DBG] pgmap v10528: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:54.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:53.249193+0000 mgr.smithi067.rdualw (mgr.24569) 12226 : cluster [DBG] pgmap v10529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:53.249193+0000 mgr.smithi067.rdualw (mgr.24569) 12226 : cluster [DBG] pgmap v10529: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:55.249783+0000 mgr.smithi067.rdualw (mgr.24569) 12227 : cluster [DBG] pgmap v10530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:55.249783+0000 mgr.smithi067.rdualw (mgr.24569) 12227 : cluster [DBG] pgmap v10530: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:19:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:19:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:57.250745+0000 mgr.smithi067.rdualw (mgr.24569) 12228 : cluster [DBG] pgmap v10531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:19:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:19:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:57.250745+0000 mgr.smithi067.rdualw (mgr.24569) 12228 : cluster [DBG] pgmap v10531: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:19:59.251313+0000 mgr.smithi067.rdualw (mgr.24569) 12229 : cluster [DBG] pgmap v10532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:00.000103+0000 mon.smithi061 (mon.0) 2544 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T21:20:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:20:00.478831+0000 mon.smithi067 (mon.1) 1845 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:20:01.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:20:00.480331+0000 mon.smithi067 (mon.1) 1846 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:20:01.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:20:00.481324+0000 mon.smithi067 (mon.1) 1847 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:20:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:19:59.251313+0000 mgr.smithi067.rdualw (mgr.24569) 12229 : cluster [DBG] pgmap v10532: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:00.000103+0000 mon.smithi061 (mon.0) 2544 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T21:20:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:20:00.478831+0000 mon.smithi067 (mon.1) 1845 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:20:01.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:20:00.480331+0000 mon.smithi067 (mon.1) 1846 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:20:01.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:20:00.481324+0000 mon.smithi067 (mon.1) 1847 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:20:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:20:00.482189+0000 mgr.smithi067.rdualw (mgr.24569) 12230 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:20:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:20:00.743483+0000 mon.smithi061 (mon.0) 2545 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:20:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:20:00.847030+0000 mon.smithi061 (mon.0) 2546 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:20:02.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:20:01.166570+0000 mon.smithi061 (mon.0) 2547 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:20:02.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:20:01.175643+0000 mon.smithi061 (mon.0) 2548 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:20:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:20:00.482189+0000 mgr.smithi067.rdualw (mgr.24569) 12230 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:20:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:20:00.743483+0000 mon.smithi061 (mon.0) 2545 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:20:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:20:00.847030+0000 mon.smithi061 (mon.0) 2546 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:20:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:20:01.166570+0000 mon.smithi061 (mon.0) 2547 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:20:02.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:20:01.175643+0000 mon.smithi061 (mon.0) 2548 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:20:02.278 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:20:02.571 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:20:02.572 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 2m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:20:02.572 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 2m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:20:02.572 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 2m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:20:02.572 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 2m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:20:02.573 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 2m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:20:02.573 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 2m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:20:02.573 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 2m ago 5h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:20:02.573 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 2m ago 5h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:20:02.573 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 2m ago 5h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:20:02.574 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 2m ago 5h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:20:02.574 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 2m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:20:02.574 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 2m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:20:02.574 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 2m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:20:02.574 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 2m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:20:02.575 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 2m ago 5h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:20:02.575 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 2m ago 5h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:20:02.575 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 2m ago 5h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:20:02.575 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 2m ago 5h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:20:02.576 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 2m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:20:02.576 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 2m ago 5h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:20:02.576 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 2m ago 5h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:20:02.576 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 2m ago 5h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:20:02.576 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 2m ago 5h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:20:02.912 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:20:02.912 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:20:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:20:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:20:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:20:02.913 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:20:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:20:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:20:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:20:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:20:02.914 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:20:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:20:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:20:02.915 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:20:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:20:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:20:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:20:02.916 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:20:02.917 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:20:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:01.252341+0000 mgr.smithi067.rdualw (mgr.24569) 12231 : cluster [DBG] pgmap v10533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:01.252341+0000 mgr.smithi067.rdualw (mgr.24569) 12231 : cluster [DBG] pgmap v10533: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:20:02.261691+0000 mgr.smithi067.rdualw (mgr.24569) 12232 : audit [DBG] from='client.42298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:20:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:20:02.553595+0000 mgr.smithi067.rdualw (mgr.24569) 12233 : audit [DBG] from='client.42302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:20:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:20:02.910717+0000 mon.smithi061 (mon.0) 2549 : audit [DBG] from='client.? 172.21.15.61:0/2893362920' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:20:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:20:02.261691+0000 mgr.smithi067.rdualw (mgr.24569) 12232 : audit [DBG] from='client.42298 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:20:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:20:02.553595+0000 mgr.smithi067.rdualw (mgr.24569) 12233 : audit [DBG] from='client.42302 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:20:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:20:02.910717+0000 mon.smithi061 (mon.0) 2549 : audit [DBG] from='client.? 172.21.15.61:0/2893362920' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:20:04.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:03.252781+0000 mgr.smithi067.rdualw (mgr.24569) 12234 : cluster [DBG] pgmap v10534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:03.252781+0000 mgr.smithi067.rdualw (mgr.24569) 12234 : cluster [DBG] pgmap v10534: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:05.253379+0000 mgr.smithi067.rdualw (mgr.24569) 12235 : cluster [DBG] pgmap v10535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:05.253379+0000 mgr.smithi067.rdualw (mgr.24569) 12235 : cluster [DBG] pgmap v10535: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:07.254352+0000 mgr.smithi067.rdualw (mgr.24569) 12236 : cluster [DBG] pgmap v10536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:07.254352+0000 mgr.smithi067.rdualw (mgr.24569) 12236 : cluster [DBG] pgmap v10536: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:09.254925+0000 mgr.smithi067.rdualw (mgr.24569) 12237 : cluster [DBG] pgmap v10537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:09.254925+0000 mgr.smithi067.rdualw (mgr.24569) 12237 : cluster [DBG] pgmap v10537: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:11.255836+0000 mgr.smithi067.rdualw (mgr.24569) 12238 : cluster [DBG] pgmap v10538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:11.255836+0000 mgr.smithi067.rdualw (mgr.24569) 12238 : cluster [DBG] pgmap v10538: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:13.256439+0000 mgr.smithi067.rdualw (mgr.24569) 12239 : cluster [DBG] pgmap v10539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:13.256439+0000 mgr.smithi067.rdualw (mgr.24569) 12239 : cluster [DBG] pgmap v10539: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:15.257066+0000 mgr.smithi067.rdualw (mgr.24569) 12240 : cluster [DBG] pgmap v10540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:15.257066+0000 mgr.smithi067.rdualw (mgr.24569) 12240 : cluster [DBG] pgmap v10540: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:17.258082+0000 mgr.smithi067.rdualw (mgr.24569) 12241 : cluster [DBG] pgmap v10541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:17.258082+0000 mgr.smithi067.rdualw (mgr.24569) 12241 : cluster [DBG] pgmap v10541: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:19.258717+0000 mgr.smithi067.rdualw (mgr.24569) 12242 : cluster [DBG] pgmap v10542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:19.258717+0000 mgr.smithi067.rdualw (mgr.24569) 12242 : cluster [DBG] pgmap v10542: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:21.259742+0000 mgr.smithi067.rdualw (mgr.24569) 12243 : cluster [DBG] pgmap v10543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:21.259742+0000 mgr.smithi067.rdualw (mgr.24569) 12243 : cluster [DBG] pgmap v10543: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:23.260284+0000 mgr.smithi067.rdualw (mgr.24569) 12244 : cluster [DBG] pgmap v10544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:23.260284+0000 mgr.smithi067.rdualw (mgr.24569) 12244 : cluster [DBG] pgmap v10544: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:25.261233+0000 mgr.smithi067.rdualw (mgr.24569) 12245 : cluster [DBG] pgmap v10545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:25.261233+0000 mgr.smithi067.rdualw (mgr.24569) 12245 : cluster [DBG] pgmap v10545: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:27.262072+0000 mgr.smithi067.rdualw (mgr.24569) 12246 : cluster [DBG] pgmap v10546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:27.262072+0000 mgr.smithi067.rdualw (mgr.24569) 12246 : cluster [DBG] pgmap v10546: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:29.262788+0000 mgr.smithi067.rdualw (mgr.24569) 12247 : cluster [DBG] pgmap v10547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:29.262788+0000 mgr.smithi067.rdualw (mgr.24569) 12247 : cluster [DBG] pgmap v10547: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:31.263683+0000 mgr.smithi067.rdualw (mgr.24569) 12248 : cluster [DBG] pgmap v10548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:32.815 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:31.263683+0000 mgr.smithi067.rdualw (mgr.24569) 12248 : cluster [DBG] pgmap v10548: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:33.262 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:20:33.552 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:20:33.552 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 2m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:20:33.552 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 2m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:20:33.553 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 2m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:20:33.553 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 2m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:20:33.553 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 2m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:20:33.553 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 2m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:20:33.554 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 2m ago 6h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:20:33.554 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 2m ago 5h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:20:33.554 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 2m ago 6h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:20:33.554 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 2m ago 5h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:20:33.555 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 2m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:20:33.555 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 2m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:20:33.555 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 2m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:20:33.556 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 2m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:20:33.556 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 2m ago 5h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:20:33.556 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 2m ago 5h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:20:33.556 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 2m ago 5h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:20:33.557 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 2m ago 5h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:20:33.557 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 2m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:20:33.557 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 2m ago 5h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:20:33.557 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 2m ago 5h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:20:33.558 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 2m ago 5h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:20:33.558 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 2m ago 5h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:20:33.899 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:20:33.900 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:20:33.900 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:20:33.900 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:20:33.900 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:20:33.900 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:20:33.901 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:20:33.901 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:20:33.901 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:20:33.901 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:20:33.902 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:20:33.902 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:20:33.902 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:20:33.902 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:20:33.903 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:20:33.903 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:20:33.903 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:20:33.903 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:20:33.903 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:20:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:20:33.248646+0000 mgr.smithi067.rdualw (mgr.24569) 12249 : audit [DBG] from='client.42310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:20:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:33.264270+0000 mgr.smithi067.rdualw (mgr.24569) 12250 : cluster [DBG] pgmap v10549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:34.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:20:33.534179+0000 mgr.smithi067.rdualw (mgr.24569) 12251 : audit [DBG] from='client.42314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:20:34.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:20:33.897791+0000 mon.smithi061 (mon.0) 2550 : audit [DBG] from='client.? 172.21.15.61:0/3506121615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:20:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:20:33.248646+0000 mgr.smithi067.rdualw (mgr.24569) 12249 : audit [DBG] from='client.42310 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:20:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:33.264270+0000 mgr.smithi067.rdualw (mgr.24569) 12250 : cluster [DBG] pgmap v10549: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:20:33.534179+0000 mgr.smithi067.rdualw (mgr.24569) 12251 : audit [DBG] from='client.42314 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:20:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:20:33.897791+0000 mon.smithi061 (mon.0) 2550 : audit [DBG] from='client.? 172.21.15.61:0/3506121615' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:20:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:35.265112+0000 mgr.smithi067.rdualw (mgr.24569) 12252 : cluster [DBG] pgmap v10550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:20:36.399223+0000 mon.smithi067 (mon.1) 1848 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:20:36.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:20:36.399595+0000 mon.smithi067 (mon.1) 1849 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:20:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:20:36.399787+0000 mon.smithi061 (mon.0) 2551 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:20:36.803 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:20:36.400296+0000 mon.smithi061 (mon.0) 2552 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:20:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:35.265112+0000 mgr.smithi067.rdualw (mgr.24569) 12252 : cluster [DBG] pgmap v10550: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:20:36.399223+0000 mon.smithi067 (mon.1) 1848 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:20:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:20:36.399595+0000 mon.smithi067 (mon.1) 1849 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:20:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:20:36.399787+0000 mon.smithi061 (mon.0) 2551 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:20:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:20:36.400296+0000 mon.smithi061 (mon.0) 2552 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:20:38.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:37.265842+0000 mgr.smithi067.rdualw (mgr.24569) 12253 : cluster [DBG] pgmap v10551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:37.265842+0000 mgr.smithi067.rdualw (mgr.24569) 12253 : cluster [DBG] pgmap v10551: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:40.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:39.266528+0000 mgr.smithi067.rdualw (mgr.24569) 12254 : cluster [DBG] pgmap v10552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:39.266528+0000 mgr.smithi067.rdualw (mgr.24569) 12254 : cluster [DBG] pgmap v10552: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:42.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:41.267354+0000 mgr.smithi067.rdualw (mgr.24569) 12255 : cluster [DBG] pgmap v10553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:41.267354+0000 mgr.smithi067.rdualw (mgr.24569) 12255 : cluster [DBG] pgmap v10553: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:44.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:43.268108+0000 mgr.smithi067.rdualw (mgr.24569) 12256 : cluster [DBG] pgmap v10554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:43.268108+0000 mgr.smithi067.rdualw (mgr.24569) 12256 : cluster [DBG] pgmap v10554: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:46.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:45.268809+0000 mgr.smithi067.rdualw (mgr.24569) 12257 : cluster [DBG] pgmap v10555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:46.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:45.268809+0000 mgr.smithi067.rdualw (mgr.24569) 12257 : cluster [DBG] pgmap v10555: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:48.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:47.269688+0000 mgr.smithi067.rdualw (mgr.24569) 12258 : cluster [DBG] pgmap v10556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:48.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:47.269688+0000 mgr.smithi067.rdualw (mgr.24569) 12258 : cluster [DBG] pgmap v10556: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:50.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:49.270234+0000 mgr.smithi067.rdualw (mgr.24569) 12259 : cluster [DBG] pgmap v10557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:50.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:49.270234+0000 mgr.smithi067.rdualw (mgr.24569) 12259 : cluster [DBG] pgmap v10557: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:52.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:51.271378+0000 mgr.smithi067.rdualw (mgr.24569) 12260 : cluster [DBG] pgmap v10558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:51.271378+0000 mgr.smithi067.rdualw (mgr.24569) 12260 : cluster [DBG] pgmap v10558: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:54.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:53.272030+0000 mgr.smithi067.rdualw (mgr.24569) 12261 : cluster [DBG] pgmap v10559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:53.272030+0000 mgr.smithi067.rdualw (mgr.24569) 12261 : cluster [DBG] pgmap v10559: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:56.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:55.272744+0000 mgr.smithi067.rdualw (mgr.24569) 12262 : cluster [DBG] pgmap v10560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:55.272744+0000 mgr.smithi067.rdualw (mgr.24569) 12262 : cluster [DBG] pgmap v10560: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:20:58.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:20:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:57.273667+0000 mgr.smithi067.rdualw (mgr.24569) 12263 : cluster [DBG] pgmap v10561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:20:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:20:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:57.273667+0000 mgr.smithi067.rdualw (mgr.24569) 12263 : cluster [DBG] pgmap v10561: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:20:59.274205+0000 mgr.smithi067.rdualw (mgr.24569) 12264 : cluster [DBG] pgmap v10562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:20:59.274205+0000 mgr.smithi067.rdualw (mgr.24569) 12264 : cluster [DBG] pgmap v10562: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:21:01.179926+0000 mon.smithi067 (mon.1) 1850 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:21:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:21:01.181350+0000 mon.smithi067 (mon.1) 1851 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:21:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:21:01.182344+0000 mon.smithi067 (mon.1) 1852 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:21:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:21:01.179926+0000 mon.smithi067 (mon.1) 1850 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:21:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:21:01.181350+0000 mon.smithi067 (mon.1) 1851 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:21:02.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:21:01.182344+0000 mon.smithi067 (mon.1) 1852 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:21:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:21:01.183202+0000 mgr.smithi067.rdualw (mgr.24569) 12265 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:21:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:01.274961+0000 mgr.smithi067.rdualw (mgr.24569) 12266 : cluster [DBG] pgmap v10563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:21:01.604657+0000 mon.smithi061 (mon.0) 2553 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:21:03.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:21:01.610165+0000 mon.smithi061 (mon.0) 2554 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:21:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:21:01.183202+0000 mgr.smithi067.rdualw (mgr.24569) 12265 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:21:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:01.274961+0000 mgr.smithi067.rdualw (mgr.24569) 12266 : cluster [DBG] pgmap v10563: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:21:01.604657+0000 mon.smithi061 (mon.0) 2553 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:21:03.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:21:01.610165+0000 mon.smithi061 (mon.0) 2554 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:21:04.213 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:21:04.515 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:21:04.515 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 3m ago 5h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:21:04.516 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 3m ago 5h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:21:04.516 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 3m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:21:04.516 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 3m ago 5h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:21:04.516 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 3m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:21:04.517 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 3m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:21:04.517 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 3m ago 6h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:21:04.517 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 3m ago 5h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:21:04.517 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 3m ago 6h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:21:04.517 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 3m ago 5h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:21:04.518 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 3m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:21:04.518 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 3m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:21:04.518 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 3m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:21:04.518 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 3m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:21:04.519 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 3m ago 5h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:21:04.519 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 3m ago 5h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:21:04.519 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 3m ago 5h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:21:04.519 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 3m ago 5h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:21:04.520 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 3m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:21:04.520 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 3m ago 5h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:21:04.520 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 3m ago 5h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:21:04.520 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 3m ago 5h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:21:04.520 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 3m ago 5h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:21:04.859 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:21:04.860 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:21:04.860 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:21:04.860 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:21:04.860 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:21:04.861 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:21:04.861 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:21:04.861 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:21:04.861 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:21:04.862 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:21:04.862 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:21:04.862 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:21:04.862 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:21:04.863 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:21:04.863 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:21:04.863 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:21:04.863 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:21:04.863 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:21:04.864 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:21:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:03.275461+0000 mgr.smithi067.rdualw (mgr.24569) 12267 : cluster [DBG] pgmap v10564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:03.275461+0000 mgr.smithi067.rdualw (mgr.24569) 12267 : cluster [DBG] pgmap v10564: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:21:04.199628+0000 mgr.smithi067.rdualw (mgr.24569) 12268 : audit [DBG] from='client.42322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:21:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:21:04.497097+0000 mgr.smithi067.rdualw (mgr.24569) 12269 : audit [DBG] from='client.42326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:21:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:21:04.857056+0000 mon.smithi061 (mon.0) 2555 : audit [DBG] from='client.? 172.21.15.61:0/983605841' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:21:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:21:04.199628+0000 mgr.smithi067.rdualw (mgr.24569) 12268 : audit [DBG] from='client.42322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:21:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:21:04.497097+0000 mgr.smithi067.rdualw (mgr.24569) 12269 : audit [DBG] from='client.42326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:21:06.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:21:04.857056+0000 mon.smithi061 (mon.0) 2555 : audit [DBG] from='client.? 172.21.15.61:0/983605841' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:21:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:05.276285+0000 mgr.smithi067.rdualw (mgr.24569) 12270 : cluster [DBG] pgmap v10565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:05.276285+0000 mgr.smithi067.rdualw (mgr.24569) 12270 : cluster [DBG] pgmap v10565: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:07.277092+0000 mgr.smithi067.rdualw (mgr.24569) 12271 : cluster [DBG] pgmap v10566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:07.277092+0000 mgr.smithi067.rdualw (mgr.24569) 12271 : cluster [DBG] pgmap v10566: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:09.277685+0000 mgr.smithi067.rdualw (mgr.24569) 12272 : cluster [DBG] pgmap v10567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:09.277685+0000 mgr.smithi067.rdualw (mgr.24569) 12272 : cluster [DBG] pgmap v10567: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:12.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:11.278657+0000 mgr.smithi067.rdualw (mgr.24569) 12273 : cluster [DBG] pgmap v10568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:12.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:11.278657+0000 mgr.smithi067.rdualw (mgr.24569) 12273 : cluster [DBG] pgmap v10568: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:14.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:13.279276+0000 mgr.smithi067.rdualw (mgr.24569) 12274 : cluster [DBG] pgmap v10569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:14.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:13.279276+0000 mgr.smithi067.rdualw (mgr.24569) 12274 : cluster [DBG] pgmap v10569: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:16.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:15.279968+0000 mgr.smithi067.rdualw (mgr.24569) 12275 : cluster [DBG] pgmap v10570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:16.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:15.279968+0000 mgr.smithi067.rdualw (mgr.24569) 12275 : cluster [DBG] pgmap v10570: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:17.280892+0000 mgr.smithi067.rdualw (mgr.24569) 12276 : cluster [DBG] pgmap v10571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:17.280892+0000 mgr.smithi067.rdualw (mgr.24569) 12276 : cluster [DBG] pgmap v10571: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:19.281667+0000 mgr.smithi067.rdualw (mgr.24569) 12277 : cluster [DBG] pgmap v10572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:19.281667+0000 mgr.smithi067.rdualw (mgr.24569) 12277 : cluster [DBG] pgmap v10572: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:21.282761+0000 mgr.smithi067.rdualw (mgr.24569) 12278 : cluster [DBG] pgmap v10573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:21.282761+0000 mgr.smithi067.rdualw (mgr.24569) 12278 : cluster [DBG] pgmap v10573: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:23.283474+0000 mgr.smithi067.rdualw (mgr.24569) 12279 : cluster [DBG] pgmap v10574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:23.283474+0000 mgr.smithi067.rdualw (mgr.24569) 12279 : cluster [DBG] pgmap v10574: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:25.284182+0000 mgr.smithi067.rdualw (mgr.24569) 12280 : cluster [DBG] pgmap v10575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:25.284182+0000 mgr.smithi067.rdualw (mgr.24569) 12280 : cluster [DBG] pgmap v10575: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:27.284912+0000 mgr.smithi067.rdualw (mgr.24569) 12281 : cluster [DBG] pgmap v10576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:27.284912+0000 mgr.smithi067.rdualw (mgr.24569) 12281 : cluster [DBG] pgmap v10576: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:29.285663+0000 mgr.smithi067.rdualw (mgr.24569) 12282 : cluster [DBG] pgmap v10577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:29.285663+0000 mgr.smithi067.rdualw (mgr.24569) 12282 : cluster [DBG] pgmap v10577: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:31.286708+0000 mgr.smithi067.rdualw (mgr.24569) 12283 : cluster [DBG] pgmap v10578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:33.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:31.286708+0000 mgr.smithi067.rdualw (mgr.24569) 12283 : cluster [DBG] pgmap v10578: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:33.287271+0000 mgr.smithi067.rdualw (mgr.24569) 12284 : cluster [DBG] pgmap v10579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:33.287271+0000 mgr.smithi067.rdualw (mgr.24569) 12284 : cluster [DBG] pgmap v10579: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:35.166 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:21:35.457 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:21:35.457 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 3m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:21:35.458 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 3m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:21:35.458 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 3m ago 5h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:21:35.458 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 3m ago 6h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:21:35.458 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 3m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:21:35.459 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 3m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:21:35.459 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 3m ago 6h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:21:35.459 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 3m ago 5h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:21:35.459 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 3m ago 6h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:21:35.459 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 3m ago 5h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:21:35.460 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 3m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:21:35.460 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 3m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:21:35.460 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (5h) 3m ago 5h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:21:35.460 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 3m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:21:35.461 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 3m ago 5h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:21:35.461 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 3m ago 5h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:21:35.461 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 3m ago 5h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:21:35.461 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 3m ago 5h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:21:35.461 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 3m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:21:35.462 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 3m ago 5h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:21:35.462 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 3m ago 5h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:21:35.462 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 3m ago 5h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:21:35.462 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 3m ago 5h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:21:35.806 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:21:35.806 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:21:35.806 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:21:35.807 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:21:35.807 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:21:35.807 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:21:35.807 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:21:35.807 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:21:35.808 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:21:35.808 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:21:35.808 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:21:35.808 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:21:35.809 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:21:35.809 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:21:35.809 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:21:35.809 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:21:35.809 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:21:35.810 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:21:35.810 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:21:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:21:35.152511+0000 mgr.smithi067.rdualw (mgr.24569) 12285 : audit [DBG] from='client.42334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:21:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:35.288086+0000 mgr.smithi067.rdualw (mgr.24569) 12286 : cluster [DBG] pgmap v10580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:21:35.439200+0000 mgr.smithi067.rdualw (mgr.24569) 12287 : audit [DBG] from='client.42338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:21:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:21:35.804221+0000 mon.smithi061 (mon.0) 2556 : audit [DBG] from='client.? 172.21.15.61:0/2830445185' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:21:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:21:36.405016+0000 mon.smithi067 (mon.1) 1853 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:21:36.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:21:36.405337+0000 mon.smithi067 (mon.1) 1854 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:21:36.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:21:36.405715+0000 mon.smithi061 (mon.0) 2557 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:21:36.818 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:21:36.406013+0000 mon.smithi061 (mon.0) 2558 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:21:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:21:35.152511+0000 mgr.smithi067.rdualw (mgr.24569) 12285 : audit [DBG] from='client.42334 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:21:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:35.288086+0000 mgr.smithi067.rdualw (mgr.24569) 12286 : cluster [DBG] pgmap v10580: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:21:35.439200+0000 mgr.smithi067.rdualw (mgr.24569) 12287 : audit [DBG] from='client.42338 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:21:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:21:35.804221+0000 mon.smithi061 (mon.0) 2556 : audit [DBG] from='client.? 172.21.15.61:0/2830445185' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:21:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:21:36.405016+0000 mon.smithi067 (mon.1) 1853 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:21:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:21:36.405337+0000 mon.smithi067 (mon.1) 1854 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:21:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:21:36.405715+0000 mon.smithi061 (mon.0) 2557 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:21:37.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:21:36.406013+0000 mon.smithi061 (mon.0) 2558 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:21:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:37.288873+0000 mgr.smithi067.rdualw (mgr.24569) 12288 : cluster [DBG] pgmap v10581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:37.288873+0000 mgr.smithi067.rdualw (mgr.24569) 12288 : cluster [DBG] pgmap v10581: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:39.289425+0000 mgr.smithi067.rdualw (mgr.24569) 12289 : cluster [DBG] pgmap v10582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:39.289425+0000 mgr.smithi067.rdualw (mgr.24569) 12289 : cluster [DBG] pgmap v10582: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:41.290375+0000 mgr.smithi067.rdualw (mgr.24569) 12290 : cluster [DBG] pgmap v10583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:41.290375+0000 mgr.smithi067.rdualw (mgr.24569) 12290 : cluster [DBG] pgmap v10583: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:44.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:43.290965+0000 mgr.smithi067.rdualw (mgr.24569) 12291 : cluster [DBG] pgmap v10584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:43.290965+0000 mgr.smithi067.rdualw (mgr.24569) 12291 : cluster [DBG] pgmap v10584: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:45.291679+0000 mgr.smithi067.rdualw (mgr.24569) 12292 : cluster [DBG] pgmap v10585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:45.291679+0000 mgr.smithi067.rdualw (mgr.24569) 12292 : cluster [DBG] pgmap v10585: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:47.292406+0000 mgr.smithi067.rdualw (mgr.24569) 12293 : cluster [DBG] pgmap v10586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:47.292406+0000 mgr.smithi067.rdualw (mgr.24569) 12293 : cluster [DBG] pgmap v10586: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:49.293063+0000 mgr.smithi067.rdualw (mgr.24569) 12294 : cluster [DBG] pgmap v10587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:49.293063+0000 mgr.smithi067.rdualw (mgr.24569) 12294 : cluster [DBG] pgmap v10587: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:51.294198+0000 mgr.smithi067.rdualw (mgr.24569) 12295 : cluster [DBG] pgmap v10588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:51.294198+0000 mgr.smithi067.rdualw (mgr.24569) 12295 : cluster [DBG] pgmap v10588: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:53.294975+0000 mgr.smithi067.rdualw (mgr.24569) 12296 : cluster [DBG] pgmap v10589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:53.294975+0000 mgr.smithi067.rdualw (mgr.24569) 12296 : cluster [DBG] pgmap v10589: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:55.295961+0000 mgr.smithi067.rdualw (mgr.24569) 12297 : cluster [DBG] pgmap v10590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:55.295961+0000 mgr.smithi067.rdualw (mgr.24569) 12297 : cluster [DBG] pgmap v10590: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:21:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:21:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:57.296830+0000 mgr.smithi067.rdualw (mgr.24569) 12298 : cluster [DBG] pgmap v10591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:21:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:21:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:57.296830+0000 mgr.smithi067.rdualw (mgr.24569) 12298 : cluster [DBG] pgmap v10591: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:21:59.297429+0000 mgr.smithi067.rdualw (mgr.24569) 12299 : cluster [DBG] pgmap v10592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:21:59.297429+0000 mgr.smithi067.rdualw (mgr.24569) 12299 : cluster [DBG] pgmap v10592: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:01.298340+0000 mgr.smithi067.rdualw (mgr.24569) 12300 : cluster [DBG] pgmap v10593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:22:01.613135+0000 mon.smithi067 (mon.1) 1855 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:22:03.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:22:01.614608+0000 mon.smithi067 (mon.1) 1856 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:22:03.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:22:01.615600+0000 mon.smithi067 (mon.1) 1857 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:22:03.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:22:01.616459+0000 mgr.smithi067.rdualw (mgr.24569) 12301 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:22:03.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:22:02.019585+0000 mon.smithi061 (mon.0) 2559 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:22:03.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:22:02.024913+0000 mon.smithi061 (mon.0) 2560 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:22:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:01.298340+0000 mgr.smithi067.rdualw (mgr.24569) 12300 : cluster [DBG] pgmap v10593: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:22:01.613135+0000 mon.smithi067 (mon.1) 1855 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:22:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:22:01.614608+0000 mon.smithi067 (mon.1) 1856 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:22:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:22:01.615600+0000 mon.smithi067 (mon.1) 1857 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:22:03.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:22:01.616459+0000 mgr.smithi067.rdualw (mgr.24569) 12301 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:22:03.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:22:02.019585+0000 mon.smithi061 (mon.0) 2559 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:22:03.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:22:02.024913+0000 mon.smithi061 (mon.0) 2560 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:22:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:03.299025+0000 mgr.smithi067.rdualw (mgr.24569) 12302 : cluster [DBG] pgmap v10594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:03.299025+0000 mgr.smithi067.rdualw (mgr.24569) 12302 : cluster [DBG] pgmap v10594: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:06.117 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:22:06.410 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:22:06.411 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (5h) 4m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:22:06.411 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 4m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:22:06.411 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 4m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:22:06.411 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (5h) 4m ago 6h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:22:06.412 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 4m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:22:06.412 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 4m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:22:06.412 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 4m ago 6h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:22:06.412 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 4m ago 6h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:22:06.412 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 4m ago 6h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:22:06.413 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 4m ago 6h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:22:06.413 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 4m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:22:06.413 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 4m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:22:06.413 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 4m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:22:06.413 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (5h) 4m ago 5h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:22:06.414 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 4m ago 5h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:22:06.414 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 4m ago 5h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:22:06.414 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 4m ago 5h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:22:06.414 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 4m ago 5h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:22:06.414 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 4m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:22:06.415 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 4m ago 5h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:22:06.415 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 4m ago 5h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:22:06.415 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 4m ago 5h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:22:06.415 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 4m ago 6h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:22:06.750 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:22:06.751 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:22:06.751 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:22:06.751 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:22:06.751 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:22:06.751 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:22:06.752 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:22:06.752 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:22:06.752 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:22:06.752 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:22:06.752 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:22:06.753 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:22:06.753 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:22:06.753 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:22:06.753 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:22:06.754 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:22:06.754 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:22:06.754 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:22:06.754 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:22:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:05.299732+0000 mgr.smithi067.rdualw (mgr.24569) 12303 : cluster [DBG] pgmap v10595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:05.299732+0000 mgr.smithi067.rdualw (mgr.24569) 12303 : cluster [DBG] pgmap v10595: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:22:06.103894+0000 mgr.smithi067.rdualw (mgr.24569) 12304 : audit [DBG] from='client.42346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:22:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:22:06.392376+0000 mgr.smithi067.rdualw (mgr.24569) 12305 : audit [DBG] from='client.42350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:22:08.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:22:06.748817+0000 mon.smithi061 (mon.0) 2561 : audit [DBG] from='client.? 172.21.15.61:0/4176056629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:22:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:22:06.103894+0000 mgr.smithi067.rdualw (mgr.24569) 12304 : audit [DBG] from='client.42346 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:22:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:22:06.392376+0000 mgr.smithi067.rdualw (mgr.24569) 12305 : audit [DBG] from='client.42350 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:22:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:22:06.748817+0000 mon.smithi061 (mon.0) 2561 : audit [DBG] from='client.? 172.21.15.61:0/4176056629' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:22:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:07.300344+0000 mgr.smithi067.rdualw (mgr.24569) 12306 : cluster [DBG] pgmap v10596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:07.300344+0000 mgr.smithi067.rdualw (mgr.24569) 12306 : cluster [DBG] pgmap v10596: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:09.301011+0000 mgr.smithi067.rdualw (mgr.24569) 12307 : cluster [DBG] pgmap v10597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:09.301011+0000 mgr.smithi067.rdualw (mgr.24569) 12307 : cluster [DBG] pgmap v10597: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:11.301955+0000 mgr.smithi067.rdualw (mgr.24569) 12308 : cluster [DBG] pgmap v10598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:11.301955+0000 mgr.smithi067.rdualw (mgr.24569) 12308 : cluster [DBG] pgmap v10598: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:13.302653+0000 mgr.smithi067.rdualw (mgr.24569) 12309 : cluster [DBG] pgmap v10599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:13.302653+0000 mgr.smithi067.rdualw (mgr.24569) 12309 : cluster [DBG] pgmap v10599: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:15.303448+0000 mgr.smithi067.rdualw (mgr.24569) 12310 : cluster [DBG] pgmap v10600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:15.303448+0000 mgr.smithi067.rdualw (mgr.24569) 12310 : cluster [DBG] pgmap v10600: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:18.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:17.304081+0000 mgr.smithi067.rdualw (mgr.24569) 12311 : cluster [DBG] pgmap v10601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:18.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:17.304081+0000 mgr.smithi067.rdualw (mgr.24569) 12311 : cluster [DBG] pgmap v10601: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:20.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:19.304719+0000 mgr.smithi067.rdualw (mgr.24569) 12312 : cluster [DBG] pgmap v10602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:20.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:19.304719+0000 mgr.smithi067.rdualw (mgr.24569) 12312 : cluster [DBG] pgmap v10602: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:22.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:21.305515+0000 mgr.smithi067.rdualw (mgr.24569) 12313 : cluster [DBG] pgmap v10603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:21.305515+0000 mgr.smithi067.rdualw (mgr.24569) 12313 : cluster [DBG] pgmap v10603: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:24.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:23.306108+0000 mgr.smithi067.rdualw (mgr.24569) 12314 : cluster [DBG] pgmap v10604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:24.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:23.306108+0000 mgr.smithi067.rdualw (mgr.24569) 12314 : cluster [DBG] pgmap v10604: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:26.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:25.306989+0000 mgr.smithi067.rdualw (mgr.24569) 12315 : cluster [DBG] pgmap v10605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:25.306989+0000 mgr.smithi067.rdualw (mgr.24569) 12315 : cluster [DBG] pgmap v10605: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:27.307901+0000 mgr.smithi067.rdualw (mgr.24569) 12316 : cluster [DBG] pgmap v10606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:27.307901+0000 mgr.smithi067.rdualw (mgr.24569) 12316 : cluster [DBG] pgmap v10606: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:29.308506+0000 mgr.smithi067.rdualw (mgr.24569) 12317 : cluster [DBG] pgmap v10607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:29.308506+0000 mgr.smithi067.rdualw (mgr.24569) 12317 : cluster [DBG] pgmap v10607: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:31.309451+0000 mgr.smithi067.rdualw (mgr.24569) 12318 : cluster [DBG] pgmap v10608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:31.309451+0000 mgr.smithi067.rdualw (mgr.24569) 12318 : cluster [DBG] pgmap v10608: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:33.309943+0000 mgr.smithi067.rdualw (mgr.24569) 12319 : cluster [DBG] pgmap v10609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:33.309943+0000 mgr.smithi067.rdualw (mgr.24569) 12319 : cluster [DBG] pgmap v10609: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:35.310679+0000 mgr.smithi067.rdualw (mgr.24569) 12320 : cluster [DBG] pgmap v10610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:22:36.410846+0000 mon.smithi067 (mon.1) 1858 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:22:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:22:36.411108+0000 mon.smithi067 (mon.1) 1859 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:22:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:22:36.411354+0000 mon.smithi061 (mon.0) 2562 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:22:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:22:36.411661+0000 mon.smithi061 (mon.0) 2563 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:22:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:35.310679+0000 mgr.smithi067.rdualw (mgr.24569) 12320 : cluster [DBG] pgmap v10610: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:22:36.410846+0000 mon.smithi067 (mon.1) 1858 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:22:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:22:36.411108+0000 mon.smithi067 (mon.1) 1859 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:22:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:22:36.411354+0000 mon.smithi061 (mon.0) 2562 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:22:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:22:36.411661+0000 mon.smithi061 (mon.0) 2563 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:22:37.056 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:22:37.346 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:22:37.346 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 4m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:22:37.346 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 4m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:22:37.347 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 4m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:22:37.347 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 4m ago 6h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:22:37.347 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 4m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:22:37.347 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 4m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:22:37.348 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 4m ago 6h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:22:37.348 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 4m ago 6h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:22:37.348 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 4m ago 6h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:22:37.348 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 4m ago 6h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:22:37.349 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 4m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:22:37.349 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 4m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:22:37.349 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 4m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:22:37.349 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 4m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:22:37.349 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 4m ago 6h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:22:37.350 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (5h) 4m ago 5h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:22:37.350 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (5h) 4m ago 5h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:22:37.350 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 4m ago 5h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:22:37.350 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 4m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:22:37.351 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 4m ago 5h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:22:37.351 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 4m ago 5h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:22:37.351 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 4m ago 5h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:22:37.351 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (5h) 4m ago 6h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:22:37.708 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:22:37.709 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:22:37.709 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:22:37.709 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:22:37.709 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:22:37.710 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:22:37.710 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:22:37.710 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:22:37.710 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:22:37.711 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:22:37.711 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:22:37.711 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:22:37.711 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:22:37.711 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:22:37.712 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:22:37.712 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:22:37.712 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:22:37.712 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:22:37.713 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:22:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:22:37.042433+0000 mgr.smithi067.rdualw (mgr.24569) 12321 : audit [DBG] from='client.42358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:22:38.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:37.311440+0000 mgr.smithi067.rdualw (mgr.24569) 12322 : cluster [DBG] pgmap v10611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:38.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:22:37.327713+0000 mgr.smithi067.rdualw (mgr.24569) 12323 : audit [DBG] from='client.42362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:22:38.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:22:37.706855+0000 mon.smithi061 (mon.0) 2564 : audit [DBG] from='client.? 172.21.15.61:0/3412988983' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:22:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:22:37.042433+0000 mgr.smithi067.rdualw (mgr.24569) 12321 : audit [DBG] from='client.42358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:22:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:37.311440+0000 mgr.smithi067.rdualw (mgr.24569) 12322 : cluster [DBG] pgmap v10611: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:22:37.327713+0000 mgr.smithi067.rdualw (mgr.24569) 12323 : audit [DBG] from='client.42362 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:22:39.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:22:37.706855+0000 mon.smithi061 (mon.0) 2564 : audit [DBG] from='client.? 172.21.15.61:0/3412988983' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:22:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:39.312050+0000 mgr.smithi067.rdualw (mgr.24569) 12324 : cluster [DBG] pgmap v10612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:39.312050+0000 mgr.smithi067.rdualw (mgr.24569) 12324 : cluster [DBG] pgmap v10612: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:41.312894+0000 mgr.smithi067.rdualw (mgr.24569) 12325 : cluster [DBG] pgmap v10613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:41.312894+0000 mgr.smithi067.rdualw (mgr.24569) 12325 : cluster [DBG] pgmap v10613: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:44.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:43.313407+0000 mgr.smithi067.rdualw (mgr.24569) 12326 : cluster [DBG] pgmap v10614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:43.313407+0000 mgr.smithi067.rdualw (mgr.24569) 12326 : cluster [DBG] pgmap v10614: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:45.314406+0000 mgr.smithi067.rdualw (mgr.24569) 12327 : cluster [DBG] pgmap v10615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:45.314406+0000 mgr.smithi067.rdualw (mgr.24569) 12327 : cluster [DBG] pgmap v10615: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:47.315204+0000 mgr.smithi067.rdualw (mgr.24569) 12328 : cluster [DBG] pgmap v10616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:47.315204+0000 mgr.smithi067.rdualw (mgr.24569) 12328 : cluster [DBG] pgmap v10616: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:49.315825+0000 mgr.smithi067.rdualw (mgr.24569) 12329 : cluster [DBG] pgmap v10617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:49.315825+0000 mgr.smithi067.rdualw (mgr.24569) 12329 : cluster [DBG] pgmap v10617: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:51.316827+0000 mgr.smithi067.rdualw (mgr.24569) 12330 : cluster [DBG] pgmap v10618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:51.316827+0000 mgr.smithi067.rdualw (mgr.24569) 12330 : cluster [DBG] pgmap v10618: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:54.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:53.317412+0000 mgr.smithi067.rdualw (mgr.24569) 12331 : cluster [DBG] pgmap v10619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:53.317412+0000 mgr.smithi067.rdualw (mgr.24569) 12331 : cluster [DBG] pgmap v10619: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:55.318138+0000 mgr.smithi067.rdualw (mgr.24569) 12332 : cluster [DBG] pgmap v10620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:55.318138+0000 mgr.smithi067.rdualw (mgr.24569) 12332 : cluster [DBG] pgmap v10620: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:22:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:22:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:57.318783+0000 mgr.smithi067.rdualw (mgr.24569) 12333 : cluster [DBG] pgmap v10621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:22:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:22:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:57.318783+0000 mgr.smithi067.rdualw (mgr.24569) 12333 : cluster [DBG] pgmap v10621: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:22:59.319349+0000 mgr.smithi067.rdualw (mgr.24569) 12334 : cluster [DBG] pgmap v10622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:22:59.319349+0000 mgr.smithi067.rdualw (mgr.24569) 12334 : cluster [DBG] pgmap v10622: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:01.320296+0000 mgr.smithi067.rdualw (mgr.24569) 12335 : cluster [DBG] pgmap v10623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:23:02.028457+0000 mon.smithi067 (mon.1) 1860 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:23:03.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:23:02.029913+0000 mon.smithi067 (mon.1) 1861 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:23:03.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:23:02.030924+0000 mon.smithi067 (mon.1) 1862 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:23:03.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:23:02.445947+0000 mon.smithi061 (mon.0) 2565 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:23:03.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:23:02.452119+0000 mon.smithi061 (mon.0) 2566 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:23:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:01.320296+0000 mgr.smithi067.rdualw (mgr.24569) 12335 : cluster [DBG] pgmap v10623: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:23:02.028457+0000 mon.smithi067 (mon.1) 1860 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:23:03.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:23:02.029913+0000 mon.smithi067 (mon.1) 1861 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:23:03.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:23:02.030924+0000 mon.smithi067 (mon.1) 1862 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:23:03.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:23:02.445947+0000 mon.smithi061 (mon.0) 2565 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:23:03.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:23:02.452119+0000 mon.smithi061 (mon.0) 2566 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:23:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:23:02.031840+0000 mgr.smithi067.rdualw (mgr.24569) 12336 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:23:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:23:02.031840+0000 mgr.smithi067.rdualw (mgr.24569) 12336 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:23:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:03.320954+0000 mgr.smithi067.rdualw (mgr.24569) 12337 : cluster [DBG] pgmap v10624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:03.320954+0000 mgr.smithi067.rdualw (mgr.24569) 12337 : cluster [DBG] pgmap v10624: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:05.321740+0000 mgr.smithi067.rdualw (mgr.24569) 12338 : cluster [DBG] pgmap v10625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:05.321740+0000 mgr.smithi067.rdualw (mgr.24569) 12338 : cluster [DBG] pgmap v10625: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:08.020 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:23:08.336 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:23:08.337 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 5m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:23:08.337 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 5m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:23:08.337 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 5m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:23:08.338 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 5m ago 6h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:23:08.338 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 5m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:23:08.338 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 5m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:23:08.338 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 5m ago 6h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:23:08.339 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 5m ago 6h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:23:08.339 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 5m ago 6h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:23:08.339 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 5m ago 6h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:23:08.339 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 5m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:23:08.340 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 5m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:23:08.340 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 5m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:23:08.340 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 5m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:23:08.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 5m ago 6h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:23:08.340 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 5m ago 6h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:23:08.341 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 5m ago 6h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:23:08.341 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (5h) 5m ago 5h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:23:08.341 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (5h) 5m ago 5h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:23:08.341 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 5m ago 5h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:23:08.342 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 5m ago 5h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:23:08.342 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 5m ago 5h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:23:08.342 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 5m ago 6h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:23:08.681 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:23:08.681 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:23:08.681 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:23:08.682 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:23:08.682 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:23:08.682 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:23:08.683 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:23:08.683 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:23:08.683 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:23:08.683 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:23:08.684 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:23:08.684 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:23:08.684 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:23:08.685 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:23:08.685 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:23:08.685 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:23:08.686 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:23:08.686 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:23:08.686 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:23:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:07.322598+0000 mgr.smithi067.rdualw (mgr.24569) 12339 : cluster [DBG] pgmap v10626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:07.322598+0000 mgr.smithi067.rdualw (mgr.24569) 12339 : cluster [DBG] pgmap v10626: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:23:08.003995+0000 mgr.smithi067.rdualw (mgr.24569) 12340 : audit [DBG] from='client.42370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:23:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:23:08.317496+0000 mgr.smithi067.rdualw (mgr.24569) 12341 : audit [DBG] from='client.42374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:23:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:23:08.679522+0000 mon.smithi061 (mon.0) 2567 : audit [DBG] from='client.? 172.21.15.61:0/3856114675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:23:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:23:08.003995+0000 mgr.smithi067.rdualw (mgr.24569) 12340 : audit [DBG] from='client.42370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:23:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:23:08.317496+0000 mgr.smithi067.rdualw (mgr.24569) 12341 : audit [DBG] from='client.42374 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:23:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:23:08.679522+0000 mon.smithi061 (mon.0) 2567 : audit [DBG] from='client.? 172.21.15.61:0/3856114675' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:23:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:09.323166+0000 mgr.smithi067.rdualw (mgr.24569) 12342 : cluster [DBG] pgmap v10627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:09.323166+0000 mgr.smithi067.rdualw (mgr.24569) 12342 : cluster [DBG] pgmap v10627: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:11.324192+0000 mgr.smithi067.rdualw (mgr.24569) 12343 : cluster [DBG] pgmap v10628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:11.324192+0000 mgr.smithi067.rdualw (mgr.24569) 12343 : cluster [DBG] pgmap v10628: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:13.324711+0000 mgr.smithi067.rdualw (mgr.24569) 12344 : cluster [DBG] pgmap v10629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:13.324711+0000 mgr.smithi067.rdualw (mgr.24569) 12344 : cluster [DBG] pgmap v10629: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:15.325700+0000 mgr.smithi067.rdualw (mgr.24569) 12345 : cluster [DBG] pgmap v10630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:15.325700+0000 mgr.smithi067.rdualw (mgr.24569) 12345 : cluster [DBG] pgmap v10630: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:17.326392+0000 mgr.smithi067.rdualw (mgr.24569) 12346 : cluster [DBG] pgmap v10631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:17.326392+0000 mgr.smithi067.rdualw (mgr.24569) 12346 : cluster [DBG] pgmap v10631: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:19.326977+0000 mgr.smithi067.rdualw (mgr.24569) 12347 : cluster [DBG] pgmap v10632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:19.326977+0000 mgr.smithi067.rdualw (mgr.24569) 12347 : cluster [DBG] pgmap v10632: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:21.327937+0000 mgr.smithi067.rdualw (mgr.24569) 12348 : cluster [DBG] pgmap v10633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:21.327937+0000 mgr.smithi067.rdualw (mgr.24569) 12348 : cluster [DBG] pgmap v10633: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:23.328529+0000 mgr.smithi067.rdualw (mgr.24569) 12349 : cluster [DBG] pgmap v10634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:23.328529+0000 mgr.smithi067.rdualw (mgr.24569) 12349 : cluster [DBG] pgmap v10634: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:26.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:25.329438+0000 mgr.smithi067.rdualw (mgr.24569) 12350 : cluster [DBG] pgmap v10635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:26.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:25.329438+0000 mgr.smithi067.rdualw (mgr.24569) 12350 : cluster [DBG] pgmap v10635: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:28.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:27.330205+0000 mgr.smithi067.rdualw (mgr.24569) 12351 : cluster [DBG] pgmap v10636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:28.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:27.330205+0000 mgr.smithi067.rdualw (mgr.24569) 12351 : cluster [DBG] pgmap v10636: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:30.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:29.330795+0000 mgr.smithi067.rdualw (mgr.24569) 12352 : cluster [DBG] pgmap v10637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:30.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:29.330795+0000 mgr.smithi067.rdualw (mgr.24569) 12352 : cluster [DBG] pgmap v10637: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:32.802 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:31.331665+0000 mgr.smithi067.rdualw (mgr.24569) 12353 : cluster [DBG] pgmap v10638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:32.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:31.331665+0000 mgr.smithi067.rdualw (mgr.24569) 12353 : cluster [DBG] pgmap v10638: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:34.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:33.332385+0000 mgr.smithi067.rdualw (mgr.24569) 12354 : cluster [DBG] pgmap v10639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:33.332385+0000 mgr.smithi067.rdualw (mgr.24569) 12354 : cluster [DBG] pgmap v10639: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:35.333082+0000 mgr.smithi067.rdualw (mgr.24569) 12355 : cluster [DBG] pgmap v10640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:23:36.416693+0000 mon.smithi067 (mon.1) 1863 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:23:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:23:36.416962+0000 mon.smithi067 (mon.1) 1864 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:23:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:23:36.417513+0000 mon.smithi061 (mon.0) 2568 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:23:36.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:23:36.417830+0000 mon.smithi061 (mon.0) 2569 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:23:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:35.333082+0000 mgr.smithi067.rdualw (mgr.24569) 12355 : cluster [DBG] pgmap v10640: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:23:36.416693+0000 mon.smithi067 (mon.1) 1863 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:23:37.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:23:36.416962+0000 mon.smithi067 (mon.1) 1864 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:23:37.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:23:36.417513+0000 mon.smithi061 (mon.0) 2568 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:23:37.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:23:36.417830+0000 mon.smithi061 (mon.0) 2569 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:23:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:37.333964+0000 mgr.smithi067.rdualw (mgr.24569) 12356 : cluster [DBG] pgmap v10641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:38.988 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:23:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:37.333964+0000 mgr.smithi067.rdualw (mgr.24569) 12356 : cluster [DBG] pgmap v10641: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:39.303 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:23:39.303 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 5m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:23:39.304 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 5m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:23:39.304 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 5m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:23:39.304 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 5m ago 6h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:23:39.304 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 5m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:23:39.305 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 5m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:23:39.305 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 5m ago 6h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:23:39.305 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 5m ago 6h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:23:39.305 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 5m ago 6h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:23:39.305 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 5m ago 6h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:23:39.306 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 5m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:23:39.306 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 5m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:23:39.306 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 5m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:23:39.306 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 5m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:23:39.306 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 5m ago 6h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:23:39.307 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 5m ago 6h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:23:39.307 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 5m ago 6h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:23:39.307 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 5m ago 6h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:23:39.307 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 5m ago 6h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:23:39.308 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (5h) 5m ago 5h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:23:39.308 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (5h) 5m ago 5h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:23:39.308 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 5m ago 5h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:23:39.308 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 5m ago 6h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:23:39.717 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:23:39.717 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:23:39.717 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:23:39.718 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:23:39.718 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:23:39.718 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:23:39.718 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:23:39.719 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:23:39.719 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:23:39.719 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:23:39.719 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:23:39.719 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:23:39.720 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:23:39.720 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:23:39.720 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:23:39.720 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:23:39.721 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:23:39.721 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:23:39.721 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:23:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:23:38.974431+0000 mgr.smithi067.rdualw (mgr.24569) 12357 : audit [DBG] from='client.42382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:23:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:23:39.285426+0000 mgr.smithi067.rdualw (mgr.24569) 12358 : audit [DBG] from='client.42386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:23:40.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:39.334766+0000 mgr.smithi067.rdualw (mgr.24569) 12359 : cluster [DBG] pgmap v10642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:40.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:23:39.715466+0000 mon.smithi061 (mon.0) 2570 : audit [DBG] from='client.? 172.21.15.61:0/2759223374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:23:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:23:38.974431+0000 mgr.smithi067.rdualw (mgr.24569) 12357 : audit [DBG] from='client.42382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:23:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:23:39.285426+0000 mgr.smithi067.rdualw (mgr.24569) 12358 : audit [DBG] from='client.42386 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:23:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:39.334766+0000 mgr.smithi067.rdualw (mgr.24569) 12359 : cluster [DBG] pgmap v10642: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:41.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:23:39.715466+0000 mon.smithi061 (mon.0) 2570 : audit [DBG] from='client.? 172.21.15.61:0/2759223374' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:23:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:41.335682+0000 mgr.smithi067.rdualw (mgr.24569) 12360 : cluster [DBG] pgmap v10643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:41.335682+0000 mgr.smithi067.rdualw (mgr.24569) 12360 : cluster [DBG] pgmap v10643: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:44.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:43.336224+0000 mgr.smithi067.rdualw (mgr.24569) 12361 : cluster [DBG] pgmap v10644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:43.336224+0000 mgr.smithi067.rdualw (mgr.24569) 12361 : cluster [DBG] pgmap v10644: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:45.337201+0000 mgr.smithi067.rdualw (mgr.24569) 12362 : cluster [DBG] pgmap v10645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:45.337201+0000 mgr.smithi067.rdualw (mgr.24569) 12362 : cluster [DBG] pgmap v10645: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:47.338012+0000 mgr.smithi067.rdualw (mgr.24569) 12363 : cluster [DBG] pgmap v10646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:47.338012+0000 mgr.smithi067.rdualw (mgr.24569) 12363 : cluster [DBG] pgmap v10646: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:49.338609+0000 mgr.smithi067.rdualw (mgr.24569) 12364 : cluster [DBG] pgmap v10647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:49.338609+0000 mgr.smithi067.rdualw (mgr.24569) 12364 : cluster [DBG] pgmap v10647: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:51.339656+0000 mgr.smithi067.rdualw (mgr.24569) 12365 : cluster [DBG] pgmap v10648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:51.339656+0000 mgr.smithi067.rdualw (mgr.24569) 12365 : cluster [DBG] pgmap v10648: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:54.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:53.340197+0000 mgr.smithi067.rdualw (mgr.24569) 12366 : cluster [DBG] pgmap v10649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:53.340197+0000 mgr.smithi067.rdualw (mgr.24569) 12366 : cluster [DBG] pgmap v10649: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:55.340936+0000 mgr.smithi067.rdualw (mgr.24569) 12367 : cluster [DBG] pgmap v10650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:55.340936+0000 mgr.smithi067.rdualw (mgr.24569) 12367 : cluster [DBG] pgmap v10650: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:23:59.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:23:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:57.341784+0000 mgr.smithi067.rdualw (mgr.24569) 12368 : cluster [DBG] pgmap v10651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:23:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:23:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:57.341784+0000 mgr.smithi067.rdualw (mgr.24569) 12368 : cluster [DBG] pgmap v10651: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:23:59.342356+0000 mgr.smithi067.rdualw (mgr.24569) 12369 : cluster [DBG] pgmap v10652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:23:59.342356+0000 mgr.smithi067.rdualw (mgr.24569) 12369 : cluster [DBG] pgmap v10652: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:01.343275+0000 mgr.smithi067.rdualw (mgr.24569) 12370 : cluster [DBG] pgmap v10653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:24:02.455159+0000 mon.smithi067 (mon.1) 1865 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:24:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:24:02.456634+0000 mon.smithi067 (mon.1) 1866 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:24:03.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:24:02.457563+0000 mon.smithi067 (mon.1) 1867 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:24:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:01.343275+0000 mgr.smithi067.rdualw (mgr.24569) 12370 : cluster [DBG] pgmap v10653: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:24:02.455159+0000 mon.smithi067 (mon.1) 1865 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:24:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:24:02.456634+0000 mon.smithi067 (mon.1) 1866 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:24:03.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:24:02.457563+0000 mon.smithi067 (mon.1) 1867 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:24:04.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:24:02.458382+0000 mgr.smithi067.rdualw (mgr.24569) 12371 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:24:04.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:24:02.876751+0000 mon.smithi061 (mon.0) 2571 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:24:04.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:24:02.882415+0000 mon.smithi061 (mon.0) 2572 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:24:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:24:02.458382+0000 mgr.smithi067.rdualw (mgr.24569) 12371 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:24:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:24:02.876751+0000 mon.smithi061 (mon.0) 2571 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:24:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:24:02.882415+0000 mon.smithi061 (mon.0) 2572 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:24:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:03.343753+0000 mgr.smithi067.rdualw (mgr.24569) 12372 : cluster [DBG] pgmap v10654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:03.343753+0000 mgr.smithi067.rdualw (mgr.24569) 12372 : cluster [DBG] pgmap v10654: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:05.344615+0000 mgr.smithi067.rdualw (mgr.24569) 12373 : cluster [DBG] pgmap v10655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:05.344615+0000 mgr.smithi067.rdualw (mgr.24569) 12373 : cluster [DBG] pgmap v10655: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:07.345269+0000 mgr.smithi067.rdualw (mgr.24569) 12374 : cluster [DBG] pgmap v10656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:09.251 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:07.345269+0000 mgr.smithi067.rdualw (mgr.24569) 12374 : cluster [DBG] pgmap v10656: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:10.023 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:24:10.333 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:24:10.334 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 6m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:24:10.334 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 6m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:24:10.334 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 6m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:24:10.335 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 6m ago 6h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:24:10.335 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 6m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:24:10.335 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 6m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:24:10.335 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 6m ago 6h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:24:10.336 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 6m ago 6h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:24:10.336 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 6m ago 6h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:24:10.336 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 6m ago 6h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:24:10.336 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 6m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:24:10.337 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 6m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:24:10.337 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 6m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:24:10.337 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 6m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:24:10.338 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 6m ago 6h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:24:10.338 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 6m ago 6h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:24:10.338 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 6m ago 6h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:24:10.338 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 6m ago 6h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:24:10.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 6m ago 6h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:24:10.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 6m ago 6h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:24:10.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 6m ago 6h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:24:10.339 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (5h) 6m ago 5h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:24:10.339 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 6m ago 6h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:24:10.677 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:24:10.678 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:24:10.678 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:24:10.678 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:24:10.679 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:24:10.679 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:24:10.679 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:24:10.679 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:24:10.680 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:24:10.680 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:24:10.680 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:24:10.680 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:24:10.680 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:24:10.681 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:24:10.681 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:24:10.681 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:24:10.681 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:24:10.682 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:24:10.682 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:24:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:09.345864+0000 mgr.smithi067.rdualw (mgr.24569) 12375 : cluster [DBG] pgmap v10657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:09.345864+0000 mgr.smithi067.rdualw (mgr.24569) 12375 : cluster [DBG] pgmap v10657: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:12.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:24:10.009813+0000 mgr.smithi067.rdualw (mgr.24569) 12376 : audit [DBG] from='client.42394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:24:12.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:24:10.315576+0000 mgr.smithi067.rdualw (mgr.24569) 12377 : audit [DBG] from='client.42398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:24:12.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:24:10.676056+0000 mon.smithi061 (mon.0) 2573 : audit [DBG] from='client.? 172.21.15.61:0/3174200180' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:24:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:24:10.009813+0000 mgr.smithi067.rdualw (mgr.24569) 12376 : audit [DBG] from='client.42394 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:24:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:24:10.315576+0000 mgr.smithi067.rdualw (mgr.24569) 12377 : audit [DBG] from='client.42398 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:24:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:24:10.676056+0000 mon.smithi061 (mon.0) 2573 : audit [DBG] from='client.? 172.21.15.61:0/3174200180' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:24:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:11.346768+0000 mgr.smithi067.rdualw (mgr.24569) 12378 : cluster [DBG] pgmap v10658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:11.346768+0000 mgr.smithi067.rdualw (mgr.24569) 12378 : cluster [DBG] pgmap v10658: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:13.347294+0000 mgr.smithi067.rdualw (mgr.24569) 12379 : cluster [DBG] pgmap v10659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:13.347294+0000 mgr.smithi067.rdualw (mgr.24569) 12379 : cluster [DBG] pgmap v10659: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:15.348115+0000 mgr.smithi067.rdualw (mgr.24569) 12380 : cluster [DBG] pgmap v10660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:15.348115+0000 mgr.smithi067.rdualw (mgr.24569) 12380 : cluster [DBG] pgmap v10660: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:17.348959+0000 mgr.smithi067.rdualw (mgr.24569) 12381 : cluster [DBG] pgmap v10661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:17.348959+0000 mgr.smithi067.rdualw (mgr.24569) 12381 : cluster [DBG] pgmap v10661: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:19.349633+0000 mgr.smithi067.rdualw (mgr.24569) 12382 : cluster [DBG] pgmap v10662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:19.349633+0000 mgr.smithi067.rdualw (mgr.24569) 12382 : cluster [DBG] pgmap v10662: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:21.350633+0000 mgr.smithi067.rdualw (mgr.24569) 12383 : cluster [DBG] pgmap v10663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:21.350633+0000 mgr.smithi067.rdualw (mgr.24569) 12383 : cluster [DBG] pgmap v10663: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:23.351296+0000 mgr.smithi067.rdualw (mgr.24569) 12384 : cluster [DBG] pgmap v10664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:23.351296+0000 mgr.smithi067.rdualw (mgr.24569) 12384 : cluster [DBG] pgmap v10664: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:25.352045+0000 mgr.smithi067.rdualw (mgr.24569) 12385 : cluster [DBG] pgmap v10665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:25.352045+0000 mgr.smithi067.rdualw (mgr.24569) 12385 : cluster [DBG] pgmap v10665: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:27.352766+0000 mgr.smithi067.rdualw (mgr.24569) 12386 : cluster [DBG] pgmap v10666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:27.352766+0000 mgr.smithi067.rdualw (mgr.24569) 12386 : cluster [DBG] pgmap v10666: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:29.353342+0000 mgr.smithi067.rdualw (mgr.24569) 12387 : cluster [DBG] pgmap v10667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:29.353342+0000 mgr.smithi067.rdualw (mgr.24569) 12387 : cluster [DBG] pgmap v10667: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:31.354357+0000 mgr.smithi067.rdualw (mgr.24569) 12388 : cluster [DBG] pgmap v10668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:31.354357+0000 mgr.smithi067.rdualw (mgr.24569) 12388 : cluster [DBG] pgmap v10668: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:34.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:33 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:33.354904+0000 mgr.smithi067.rdualw (mgr.24569) 12389 : cluster [DBG] pgmap v10669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:34.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:33 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:33.354904+0000 mgr.smithi067.rdualw (mgr.24569) 12389 : cluster [DBG] pgmap v10669: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:36.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:35.355687+0000 mgr.smithi067.rdualw (mgr.24569) 12390 : cluster [DBG] pgmap v10670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:36.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:35.355687+0000 mgr.smithi067.rdualw (mgr.24569) 12390 : cluster [DBG] pgmap v10670: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:24:36.422515+0000 mon.smithi067 (mon.1) 1868 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:24:37.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:24:36.422756+0000 mon.smithi067 (mon.1) 1869 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:24:37.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:24:36.423102+0000 mon.smithi061 (mon.0) 2574 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:24:37.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:24:36.423340+0000 mon.smithi061 (mon.0) 2575 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:24:37.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:24:36.422515+0000 mon.smithi067 (mon.1) 1868 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:24:37.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:24:36.422756+0000 mon.smithi067 (mon.1) 1869 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:24:37.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:24:36.423102+0000 mon.smithi061 (mon.0) 2574 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:24:37.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:24:36.423340+0000 mon.smithi061 (mon.0) 2575 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:24:38.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:37.356513+0000 mgr.smithi067.rdualw (mgr.24569) 12391 : cluster [DBG] pgmap v10671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:37.356513+0000 mgr.smithi067.rdualw (mgr.24569) 12391 : cluster [DBG] pgmap v10671: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:40.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:39.357332+0000 mgr.smithi067.rdualw (mgr.24569) 12392 : cluster [DBG] pgmap v10672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:39.357332+0000 mgr.smithi067.rdualw (mgr.24569) 12392 : cluster [DBG] pgmap v10672: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:41.072 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:24:41.364 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:24:41.365 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 6m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:24:41.365 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 6m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:24:41.365 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 6m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:24:41.365 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 6m ago 6h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:24:41.365 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 6m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:24:41.366 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 6m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:24:41.366 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 6m ago 6h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:24:41.366 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 6m ago 6h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:24:41.366 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 6m ago 6h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:24:41.367 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 6m ago 6h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:24:41.367 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 6m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:24:41.367 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 6m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:24:41.367 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 6m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:24:41.367 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 6m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:24:41.368 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 6m ago 6h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:24:41.368 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 6m ago 6h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:24:41.368 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 6m ago 6h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:24:41.368 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 6m ago 6h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:24:41.369 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 6m ago 6h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:24:41.369 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 6m ago 6h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:24:41.369 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 6m ago 6h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:24:41.369 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 6m ago 6h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:24:41.369 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 6m ago 6h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:24:41.708 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:24:41.708 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:24:41.708 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:24:41.709 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:24:41.709 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:24:41.709 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:24:41.709 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:24:41.709 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:24:41.710 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:24:41.710 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:24:41.710 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:24:41.710 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:24:41.711 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:24:41.711 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:24:41.711 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:24:41.711 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:24:41.712 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:24:41.712 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:24:41.712 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:24:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:24:41.057702+0000 mgr.smithi067.rdualw (mgr.24569) 12393 : audit [DBG] from='client.42406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:24:42.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:24:41.345510+0000 mgr.smithi067.rdualw (mgr.24569) 12394 : audit [DBG] from='client.42410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:24:42.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:41.358138+0000 mgr.smithi067.rdualw (mgr.24569) 12395 : cluster [DBG] pgmap v10673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:42.817 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:24:41.706197+0000 mon.smithi061 (mon.0) 2576 : audit [DBG] from='client.? 172.21.15.61:0/3584010550' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:24:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:24:41.057702+0000 mgr.smithi067.rdualw (mgr.24569) 12393 : audit [DBG] from='client.42406 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:24:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:24:41.345510+0000 mgr.smithi067.rdualw (mgr.24569) 12394 : audit [DBG] from='client.42410 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:24:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:41.358138+0000 mgr.smithi067.rdualw (mgr.24569) 12395 : cluster [DBG] pgmap v10673: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:43.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:24:41.706197+0000 mon.smithi061 (mon.0) 2576 : audit [DBG] from='client.? 172.21.15.61:0/3584010550' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:24:44.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:43.358775+0000 mgr.smithi067.rdualw (mgr.24569) 12396 : cluster [DBG] pgmap v10674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:43.358775+0000 mgr.smithi067.rdualw (mgr.24569) 12396 : cluster [DBG] pgmap v10674: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:45.359602+0000 mgr.smithi067.rdualw (mgr.24569) 12397 : cluster [DBG] pgmap v10675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:45.359602+0000 mgr.smithi067.rdualw (mgr.24569) 12397 : cluster [DBG] pgmap v10675: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:47.360426+0000 mgr.smithi067.rdualw (mgr.24569) 12398 : cluster [DBG] pgmap v10676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:47.360426+0000 mgr.smithi067.rdualw (mgr.24569) 12398 : cluster [DBG] pgmap v10676: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:49.361085+0000 mgr.smithi067.rdualw (mgr.24569) 12399 : cluster [DBG] pgmap v10677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:49.361085+0000 mgr.smithi067.rdualw (mgr.24569) 12399 : cluster [DBG] pgmap v10677: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:51.362041+0000 mgr.smithi067.rdualw (mgr.24569) 12400 : cluster [DBG] pgmap v10678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:51.362041+0000 mgr.smithi067.rdualw (mgr.24569) 12400 : cluster [DBG] pgmap v10678: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:54.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:53.362763+0000 mgr.smithi067.rdualw (mgr.24569) 12401 : cluster [DBG] pgmap v10679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:53.362763+0000 mgr.smithi067.rdualw (mgr.24569) 12401 : cluster [DBG] pgmap v10679: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:55.363659+0000 mgr.smithi067.rdualw (mgr.24569) 12402 : cluster [DBG] pgmap v10680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:57.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:55.363659+0000 mgr.smithi067.rdualw (mgr.24569) 12402 : cluster [DBG] pgmap v10680: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:24:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:24:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:57.364261+0000 mgr.smithi067.rdualw (mgr.24569) 12403 : cluster [DBG] pgmap v10681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:24:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:24:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:57.364261+0000 mgr.smithi067.rdualw (mgr.24569) 12403 : cluster [DBG] pgmap v10681: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:24:59.364976+0000 mgr.smithi067.rdualw (mgr.24569) 12404 : cluster [DBG] pgmap v10682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:24:59.364976+0000 mgr.smithi067.rdualw (mgr.24569) 12404 : cluster [DBG] pgmap v10682: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:01.365944+0000 mgr.smithi067.rdualw (mgr.24569) 12405 : cluster [DBG] pgmap v10683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:03.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:01.365944+0000 mgr.smithi067.rdualw (mgr.24569) 12405 : cluster [DBG] pgmap v10683: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:04.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:25:02.885596+0000 mon.smithi067 (mon.1) 1870 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:25:04.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:25:02.887062+0000 mon.smithi067 (mon.1) 1871 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:25:04.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:25:02.887994+0000 mon.smithi067 (mon.1) 1872 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:25:04.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:25:03.301885+0000 mon.smithi061 (mon.0) 2577 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:25:04.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:25:03.308045+0000 mon.smithi061 (mon.0) 2578 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:25:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:25:02.885596+0000 mon.smithi067 (mon.1) 1870 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:25:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:25:02.887062+0000 mon.smithi067 (mon.1) 1871 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:25:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:25:02.887994+0000 mon.smithi067 (mon.1) 1872 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:25:04.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:25:03.301885+0000 mon.smithi061 (mon.0) 2577 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:25:04.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:25:03.308045+0000 mon.smithi061 (mon.0) 2578 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:25:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:25:02.888850+0000 mgr.smithi067.rdualw (mgr.24569) 12406 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:25:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:03.366384+0000 mgr.smithi067.rdualw (mgr.24569) 12407 : cluster [DBG] pgmap v10684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:25:02.888850+0000 mgr.smithi067.rdualw (mgr.24569) 12406 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:25:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:03.366384+0000 mgr.smithi067.rdualw (mgr.24569) 12407 : cluster [DBG] pgmap v10684: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:05.367357+0000 mgr.smithi067.rdualw (mgr.24569) 12408 : cluster [DBG] pgmap v10685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:05.367357+0000 mgr.smithi067.rdualw (mgr.24569) 12408 : cluster [DBG] pgmap v10685: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:07.368025+0000 mgr.smithi067.rdualw (mgr.24569) 12409 : cluster [DBG] pgmap v10686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:07.368025+0000 mgr.smithi067.rdualw (mgr.24569) 12409 : cluster [DBG] pgmap v10686: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:09.368726+0000 mgr.smithi067.rdualw (mgr.24569) 12410 : cluster [DBG] pgmap v10687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:09.368726+0000 mgr.smithi067.rdualw (mgr.24569) 12410 : cluster [DBG] pgmap v10687: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:12.019 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:25:12.309 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:25:12.310 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 7m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:25:12.310 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 7m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:25:12.310 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 7m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:25:12.311 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 7m ago 6h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:25:12.311 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 7m ago 5h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:25:12.311 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 7m ago 5h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:25:12.311 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 7m ago 6h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:25:12.312 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 7m ago 6h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:25:12.312 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 7m ago 6h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:25:12.312 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 7m ago 6h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:25:12.312 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 7m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:25:12.313 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 7m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:25:12.313 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 7m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:25:12.313 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 7m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:25:12.313 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 7m ago 6h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:25:12.313 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 7m ago 6h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:25:12.314 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 7m ago 6h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:25:12.314 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 7m ago 6h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:25:12.314 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 7m ago 6h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:25:12.314 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 7m ago 6h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:25:12.315 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 7m ago 6h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:25:12.315 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 7m ago 6h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:25:12.315 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 7m ago 6h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:25:12.651 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:25:12.651 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:25:12.652 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:25:12.652 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:25:12.652 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:25:12.652 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:25:12.652 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:25:12.653 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:25:12.653 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:25:12.653 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:25:12.653 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:25:12.654 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:25:12.654 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:25:12.654 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:25:12.654 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:25:12.655 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:25:12.655 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:25:12.656 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:25:12.656 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:25:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:11.369812+0000 mgr.smithi067.rdualw (mgr.24569) 12411 : cluster [DBG] pgmap v10688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:11.369812+0000 mgr.smithi067.rdualw (mgr.24569) 12411 : cluster [DBG] pgmap v10688: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:14.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:25:12.005358+0000 mgr.smithi067.rdualw (mgr.24569) 12412 : audit [DBG] from='client.42418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:25:14.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:25:12.292085+0000 mgr.smithi067.rdualw (mgr.24569) 12413 : audit [DBG] from='client.42422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:25:14.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:25:12.649570+0000 mon.smithi061 (mon.0) 2579 : audit [DBG] from='client.? 172.21.15.61:0/1495829721' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:25:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:25:12.005358+0000 mgr.smithi067.rdualw (mgr.24569) 12412 : audit [DBG] from='client.42418 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:25:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:25:12.292085+0000 mgr.smithi067.rdualw (mgr.24569) 12413 : audit [DBG] from='client.42422 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:25:14.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:25:12.649570+0000 mon.smithi061 (mon.0) 2579 : audit [DBG] from='client.? 172.21.15.61:0/1495829721' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:25:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:13.370335+0000 mgr.smithi067.rdualw (mgr.24569) 12414 : cluster [DBG] pgmap v10689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:13.370335+0000 mgr.smithi067.rdualw (mgr.24569) 12414 : cluster [DBG] pgmap v10689: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:15.371176+0000 mgr.smithi067.rdualw (mgr.24569) 12415 : cluster [DBG] pgmap v10690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:15.371176+0000 mgr.smithi067.rdualw (mgr.24569) 12415 : cluster [DBG] pgmap v10690: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:17.371922+0000 mgr.smithi067.rdualw (mgr.24569) 12416 : cluster [DBG] pgmap v10691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:17.371922+0000 mgr.smithi067.rdualw (mgr.24569) 12416 : cluster [DBG] pgmap v10691: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:19.372634+0000 mgr.smithi067.rdualw (mgr.24569) 12417 : cluster [DBG] pgmap v10692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:21.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:19.372634+0000 mgr.smithi067.rdualw (mgr.24569) 12417 : cluster [DBG] pgmap v10692: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:21.373551+0000 mgr.smithi067.rdualw (mgr.24569) 12418 : cluster [DBG] pgmap v10693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:21.373551+0000 mgr.smithi067.rdualw (mgr.24569) 12418 : cluster [DBG] pgmap v10693: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:24.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:23.374040+0000 mgr.smithi067.rdualw (mgr.24569) 12419 : cluster [DBG] pgmap v10694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:23.374040+0000 mgr.smithi067.rdualw (mgr.24569) 12419 : cluster [DBG] pgmap v10694: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:25.374824+0000 mgr.smithi067.rdualw (mgr.24569) 12420 : cluster [DBG] pgmap v10695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:25.374824+0000 mgr.smithi067.rdualw (mgr.24569) 12420 : cluster [DBG] pgmap v10695: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:27.375650+0000 mgr.smithi067.rdualw (mgr.24569) 12421 : cluster [DBG] pgmap v10696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:27.375650+0000 mgr.smithi067.rdualw (mgr.24569) 12421 : cluster [DBG] pgmap v10696: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:29.376258+0000 mgr.smithi067.rdualw (mgr.24569) 12422 : cluster [DBG] pgmap v10697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:29.376258+0000 mgr.smithi067.rdualw (mgr.24569) 12422 : cluster [DBG] pgmap v10697: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:31.377323+0000 mgr.smithi067.rdualw (mgr.24569) 12423 : cluster [DBG] pgmap v10698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:31.377323+0000 mgr.smithi067.rdualw (mgr.24569) 12423 : cluster [DBG] pgmap v10698: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:34.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:33.378005+0000 mgr.smithi067.rdualw (mgr.24569) 12424 : cluster [DBG] pgmap v10699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:33.378005+0000 mgr.smithi067.rdualw (mgr.24569) 12424 : cluster [DBG] pgmap v10699: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:35.378841+0000 mgr.smithi067.rdualw (mgr.24569) 12425 : cluster [DBG] pgmap v10700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:25:36.427466+0000 mon.smithi067 (mon.1) 1873 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:25:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:25:36.427860+0000 mon.smithi067 (mon.1) 1874 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:25:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:25:36.428072+0000 mon.smithi061 (mon.0) 2580 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:25:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:25:36.428450+0000 mon.smithi061 (mon.0) 2581 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:25:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:35.378841+0000 mgr.smithi067.rdualw (mgr.24569) 12425 : cluster [DBG] pgmap v10700: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:25:36.427466+0000 mon.smithi067 (mon.1) 1873 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:25:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:25:36.427860+0000 mon.smithi067 (mon.1) 1874 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:25:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:25:36.428072+0000 mon.smithi061 (mon.0) 2580 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:25:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:25:36.428450+0000 mon.smithi061 (mon.0) 2581 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:25:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:37.379512+0000 mgr.smithi067.rdualw (mgr.24569) 12426 : cluster [DBG] pgmap v10701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:37.379512+0000 mgr.smithi067.rdualw (mgr.24569) 12426 : cluster [DBG] pgmap v10701: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:39.380108+0000 mgr.smithi067.rdualw (mgr.24569) 12427 : cluster [DBG] pgmap v10702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:39.380108+0000 mgr.smithi067.rdualw (mgr.24569) 12427 : cluster [DBG] pgmap v10702: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:42.958 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:25:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:41.381177+0000 mgr.smithi067.rdualw (mgr.24569) 12428 : cluster [DBG] pgmap v10703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:41.381177+0000 mgr.smithi067.rdualw (mgr.24569) 12428 : cluster [DBG] pgmap v10703: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:43.252 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:25:43.253 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 7m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:25:43.253 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 7m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:25:43.253 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 7m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:25:43.253 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 7m ago 6h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:25:43.254 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 7m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:25:43.254 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 7m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:25:43.254 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 7m ago 6h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:25:43.255 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 7m ago 6h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:25:43.255 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 7m ago 6h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:25:43.255 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 7m ago 6h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:25:43.255 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 7m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:25:43.256 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 7m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:25:43.256 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 7m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:25:43.256 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 7m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:25:43.256 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 7m ago 6h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:25:43.257 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 7m ago 6h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:25:43.257 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 7m ago 6h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:25:43.257 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 7m ago 6h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:25:43.257 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 7m ago 6h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:25:43.258 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 7m ago 6h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:25:43.258 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 7m ago 6h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:25:43.258 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 7m ago 6h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:25:43.259 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 7m ago 6h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:25:43.592 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:25:43.593 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:25:43.593 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:25:43.593 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:25:43.593 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:25:43.594 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:25:43.594 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:25:43.594 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:25:43.594 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:25:43.595 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:25:43.595 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:25:43.595 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:25:43.595 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:25:43.596 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:25:43.596 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:25:43.596 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:25:43.596 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:25:43.596 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:25:43.597 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:25:44.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:43 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:25:43.590846+0000 mon.smithi061 (mon.0) 2582 : audit [DBG] from='client.? 172.21.15.61:0/682699755' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:25:44.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:43 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:25:43.590846+0000 mon.smithi061 (mon.0) 2582 : audit [DBG] from='client.? 172.21.15.61:0/682699755' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:25:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:25:42.945001+0000 mgr.smithi067.rdualw (mgr.24569) 12429 : audit [DBG] from='client.42430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:25:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:25:43.234208+0000 mgr.smithi067.rdualw (mgr.24569) 12430 : audit [DBG] from='client.42434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:25:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:43.381693+0000 mgr.smithi067.rdualw (mgr.24569) 12431 : cluster [DBG] pgmap v10704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:25:42.945001+0000 mgr.smithi067.rdualw (mgr.24569) 12429 : audit [DBG] from='client.42430 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:25:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:25:43.234208+0000 mgr.smithi067.rdualw (mgr.24569) 12430 : audit [DBG] from='client.42434 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:25:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:43.381693+0000 mgr.smithi067.rdualw (mgr.24569) 12431 : cluster [DBG] pgmap v10704: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:45.382554+0000 mgr.smithi067.rdualw (mgr.24569) 12432 : cluster [DBG] pgmap v10705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:45.382554+0000 mgr.smithi067.rdualw (mgr.24569) 12432 : cluster [DBG] pgmap v10705: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:47.383190+0000 mgr.smithi067.rdualw (mgr.24569) 12433 : cluster [DBG] pgmap v10706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:47.383190+0000 mgr.smithi067.rdualw (mgr.24569) 12433 : cluster [DBG] pgmap v10706: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:49.383847+0000 mgr.smithi067.rdualw (mgr.24569) 12434 : cluster [DBG] pgmap v10707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:49.383847+0000 mgr.smithi067.rdualw (mgr.24569) 12434 : cluster [DBG] pgmap v10707: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:51.384903+0000 mgr.smithi067.rdualw (mgr.24569) 12435 : cluster [DBG] pgmap v10708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:51.384903+0000 mgr.smithi067.rdualw (mgr.24569) 12435 : cluster [DBG] pgmap v10708: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:53.385452+0000 mgr.smithi067.rdualw (mgr.24569) 12436 : cluster [DBG] pgmap v10709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:53.385452+0000 mgr.smithi067.rdualw (mgr.24569) 12436 : cluster [DBG] pgmap v10709: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:55.386215+0000 mgr.smithi067.rdualw (mgr.24569) 12437 : cluster [DBG] pgmap v10710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:55.386215+0000 mgr.smithi067.rdualw (mgr.24569) 12437 : cluster [DBG] pgmap v10710: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:25:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:25:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:57.387072+0000 mgr.smithi067.rdualw (mgr.24569) 12438 : cluster [DBG] pgmap v10711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:25:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:25:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:57.387072+0000 mgr.smithi067.rdualw (mgr.24569) 12438 : cluster [DBG] pgmap v10711: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:25:59.387845+0000 mgr.smithi067.rdualw (mgr.24569) 12439 : cluster [DBG] pgmap v10712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:25:59.387845+0000 mgr.smithi067.rdualw (mgr.24569) 12439 : cluster [DBG] pgmap v10712: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:01.388737+0000 mgr.smithi067.rdualw (mgr.24569) 12440 : cluster [DBG] pgmap v10713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:01.388737+0000 mgr.smithi067.rdualw (mgr.24569) 12440 : cluster [DBG] pgmap v10713: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:26:03.312017+0000 mon.smithi067 (mon.1) 1875 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:26:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:26:03.313469+0000 mon.smithi067 (mon.1) 1876 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:26:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:26:03.314337+0000 mon.smithi067 (mon.1) 1877 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:26:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:26:03.312017+0000 mon.smithi067 (mon.1) 1875 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:26:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:26:03.313469+0000 mon.smithi067 (mon.1) 1876 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:26:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:26:03.314337+0000 mon.smithi067 (mon.1) 1877 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:26:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:26:03.315127+0000 mgr.smithi067.rdualw (mgr.24569) 12441 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:26:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:03.389214+0000 mgr.smithi067.rdualw (mgr.24569) 12442 : cluster [DBG] pgmap v10714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:26:03.733351+0000 mon.smithi061 (mon.0) 2583 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:26:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:26:03.741140+0000 mon.smithi061 (mon.0) 2584 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:26:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:26:03.315127+0000 mgr.smithi067.rdualw (mgr.24569) 12441 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:26:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:03.389214+0000 mgr.smithi067.rdualw (mgr.24569) 12442 : cluster [DBG] pgmap v10714: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:05.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:26:03.733351+0000 mon.smithi061 (mon.0) 2583 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:26:05.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:26:03.741140+0000 mon.smithi061 (mon.0) 2584 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:26:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:05.390059+0000 mgr.smithi067.rdualw (mgr.24569) 12443 : cluster [DBG] pgmap v10715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:05.390059+0000 mgr.smithi067.rdualw (mgr.24569) 12443 : cluster [DBG] pgmap v10715: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:07.390819+0000 mgr.smithi067.rdualw (mgr.24569) 12444 : cluster [DBG] pgmap v10716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:07.390819+0000 mgr.smithi067.rdualw (mgr.24569) 12444 : cluster [DBG] pgmap v10716: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:09.391327+0000 mgr.smithi067.rdualw (mgr.24569) 12445 : cluster [DBG] pgmap v10717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:09.391327+0000 mgr.smithi067.rdualw (mgr.24569) 12445 : cluster [DBG] pgmap v10717: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:11.392187+0000 mgr.smithi067.rdualw (mgr.24569) 12446 : cluster [DBG] pgmap v10718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:11.392187+0000 mgr.smithi067.rdualw (mgr.24569) 12446 : cluster [DBG] pgmap v10718: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:13.902 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:26:14.201 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:26:14.201 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 8m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:26:14.202 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 8m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:26:14.202 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 8m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:26:14.202 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 8m ago 6h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:26:14.202 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 8m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:26:14.203 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 8m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:26:14.203 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 8m ago 6h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:26:14.203 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 8m ago 6h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:26:14.203 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 8m ago 6h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:26:14.204 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 8m ago 6h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:26:14.204 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 8m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:26:14.204 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 8m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:26:14.204 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 8m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:26:14.205 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 8m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:26:14.205 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 8m ago 6h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:26:14.205 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 8m ago 6h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:26:14.205 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 8m ago 6h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:26:14.205 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 8m ago 6h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:26:14.206 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 8m ago 6h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:26:14.206 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 8m ago 6h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:26:14.206 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 8m ago 6h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:26:14.206 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 8m ago 6h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:26:14.207 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 8m ago 6h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:26:14.540 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:26:14.541 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:26:14.541 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:26:14.541 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:26:14.541 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:26:14.541 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:26:14.542 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:26:14.542 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:26:14.542 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:26:14.542 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:26:14.543 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:26:14.543 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:26:14.543 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:26:14.543 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:26:14.543 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:26:14.544 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:26:14.544 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:26:14.544 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:26:14.544 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:26:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:13.392824+0000 mgr.smithi067.rdualw (mgr.24569) 12447 : cluster [DBG] pgmap v10719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:26:14.538835+0000 mon.smithi061 (mon.0) 2585 : audit [DBG] from='client.? 172.21.15.61:0/3630110495' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:26:15.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:13.392824+0000 mgr.smithi067.rdualw (mgr.24569) 12447 : cluster [DBG] pgmap v10719: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:15.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:26:14.538835+0000 mon.smithi061 (mon.0) 2585 : audit [DBG] from='client.? 172.21.15.61:0/3630110495' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:26:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:26:13.888216+0000 mgr.smithi067.rdualw (mgr.24569) 12448 : audit [DBG] from='client.42442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:26:16.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:15 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:26:14.183467+0000 mgr.smithi067.rdualw (mgr.24569) 12449 : audit [DBG] from='client.42446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:26:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:26:13.888216+0000 mgr.smithi067.rdualw (mgr.24569) 12448 : audit [DBG] from='client.42442 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:26:16.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:15 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:26:14.183467+0000 mgr.smithi067.rdualw (mgr.24569) 12449 : audit [DBG] from='client.42446 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:26:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:15.393653+0000 mgr.smithi067.rdualw (mgr.24569) 12450 : cluster [DBG] pgmap v10720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:15.393653+0000 mgr.smithi067.rdualw (mgr.24569) 12450 : cluster [DBG] pgmap v10720: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:17.394287+0000 mgr.smithi067.rdualw (mgr.24569) 12451 : cluster [DBG] pgmap v10721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:17.394287+0000 mgr.smithi067.rdualw (mgr.24569) 12451 : cluster [DBG] pgmap v10721: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:19.394911+0000 mgr.smithi067.rdualw (mgr.24569) 12452 : cluster [DBG] pgmap v10722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:19.394911+0000 mgr.smithi067.rdualw (mgr.24569) 12452 : cluster [DBG] pgmap v10722: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:22.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:21.395739+0000 mgr.smithi067.rdualw (mgr.24569) 12453 : cluster [DBG] pgmap v10723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:22.816 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:21.395739+0000 mgr.smithi067.rdualw (mgr.24569) 12453 : cluster [DBG] pgmap v10723: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:24.839 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:23.396246+0000 mgr.smithi067.rdualw (mgr.24569) 12454 : cluster [DBG] pgmap v10724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:23.396246+0000 mgr.smithi067.rdualw (mgr.24569) 12454 : cluster [DBG] pgmap v10724: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:25.397020+0000 mgr.smithi067.rdualw (mgr.24569) 12455 : cluster [DBG] pgmap v10725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:25.397020+0000 mgr.smithi067.rdualw (mgr.24569) 12455 : cluster [DBG] pgmap v10725: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:27.397556+0000 mgr.smithi067.rdualw (mgr.24569) 12456 : cluster [DBG] pgmap v10726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:27.397556+0000 mgr.smithi067.rdualw (mgr.24569) 12456 : cluster [DBG] pgmap v10726: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:29.398215+0000 mgr.smithi067.rdualw (mgr.24569) 12457 : cluster [DBG] pgmap v10727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:29.398215+0000 mgr.smithi067.rdualw (mgr.24569) 12457 : cluster [DBG] pgmap v10727: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:31.399262+0000 mgr.smithi067.rdualw (mgr.24569) 12458 : cluster [DBG] pgmap v10728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:31.399262+0000 mgr.smithi067.rdualw (mgr.24569) 12458 : cluster [DBG] pgmap v10728: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:34.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:33.399819+0000 mgr.smithi067.rdualw (mgr.24569) 12459 : cluster [DBG] pgmap v10729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:33.399819+0000 mgr.smithi067.rdualw (mgr.24569) 12459 : cluster [DBG] pgmap v10729: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:35.400899+0000 mgr.smithi067.rdualw (mgr.24569) 12460 : cluster [DBG] pgmap v10730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:26:36.432913+0000 mon.smithi067 (mon.1) 1878 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:26:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:26:36.433169+0000 mon.smithi067 (mon.1) 1879 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:26:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:26:36.433425+0000 mon.smithi061 (mon.0) 2586 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:26:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:26:36.433725+0000 mon.smithi061 (mon.0) 2587 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:26:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:35.400899+0000 mgr.smithi067.rdualw (mgr.24569) 12460 : cluster [DBG] pgmap v10730: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:26:36.432913+0000 mon.smithi067 (mon.1) 1878 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:26:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:26:36.433169+0000 mon.smithi067 (mon.1) 1879 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:26:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:26:36.433425+0000 mon.smithi061 (mon.0) 2586 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:26:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:26:36.433725+0000 mon.smithi061 (mon.0) 2587 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:26:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:37.401605+0000 mgr.smithi067.rdualw (mgr.24569) 12461 : cluster [DBG] pgmap v10731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:37.401605+0000 mgr.smithi067.rdualw (mgr.24569) 12461 : cluster [DBG] pgmap v10731: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:39.402187+0000 mgr.smithi067.rdualw (mgr.24569) 12462 : cluster [DBG] pgmap v10732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:39.402187+0000 mgr.smithi067.rdualw (mgr.24569) 12462 : cluster [DBG] pgmap v10732: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:41.403126+0000 mgr.smithi067.rdualw (mgr.24569) 12463 : cluster [DBG] pgmap v10733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:41.403126+0000 mgr.smithi067.rdualw (mgr.24569) 12463 : cluster [DBG] pgmap v10733: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:44.934 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:26:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:43.403721+0000 mgr.smithi067.rdualw (mgr.24569) 12464 : cluster [DBG] pgmap v10734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:43.403721+0000 mgr.smithi067.rdualw (mgr.24569) 12464 : cluster [DBG] pgmap v10734: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:45.226 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:26:45.226 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 8m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:26:45.226 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 8m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:26:45.227 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 8m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:26:45.227 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 8m ago 6h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:26:45.227 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 8m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:26:45.227 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 8m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:26:45.227 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 8m ago 6h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:26:45.228 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 8m ago 6h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:26:45.228 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 8m ago 6h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:26:45.228 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 8m ago 6h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:26:45.228 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 8m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:26:45.229 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 8m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:26:45.229 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 8m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:26:45.229 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 8m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:26:45.229 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 8m ago 6h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:26:45.229 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 8m ago 6h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:26:45.230 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 8m ago 6h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:26:45.230 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 8m ago 6h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:26:45.230 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 8m ago 6h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:26:45.230 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 8m ago 6h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:26:45.230 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 8m ago 6h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:26:45.231 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 8m ago 6h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:26:45.231 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 8m ago 6h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:26:45.569 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:26:45.569 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:26:45.569 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:26:45.570 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:26:45.570 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:26:45.570 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:26:45.570 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:26:45.571 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:26:45.571 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:26:45.571 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:26:45.571 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:26:45.572 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:26:45.572 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:26:45.572 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:26:45.572 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:26:45.572 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:26:45.573 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:26:45.573 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:26:45.573 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:26:46.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:45 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:26:45.567171+0000 mon.smithi061 (mon.0) 2588 : audit [DBG] from='client.? 172.21.15.61:0/2036011135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:26:46.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:45 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:26:45.567171+0000 mon.smithi061 (mon.0) 2588 : audit [DBG] from='client.? 172.21.15.61:0/2036011135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:26:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:26:44.919722+0000 mgr.smithi067.rdualw (mgr.24569) 12465 : audit [DBG] from='client.42454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:26:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:26:45.208117+0000 mgr.smithi067.rdualw (mgr.24569) 12466 : audit [DBG] from='client.42458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:26:47.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:45.404734+0000 mgr.smithi067.rdualw (mgr.24569) 12467 : cluster [DBG] pgmap v10735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:26:44.919722+0000 mgr.smithi067.rdualw (mgr.24569) 12465 : audit [DBG] from='client.42454 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:26:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:26:45.208117+0000 mgr.smithi067.rdualw (mgr.24569) 12466 : audit [DBG] from='client.42458 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:26:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:45.404734+0000 mgr.smithi067.rdualw (mgr.24569) 12467 : cluster [DBG] pgmap v10735: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:49.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:47.405362+0000 mgr.smithi067.rdualw (mgr.24569) 12468 : cluster [DBG] pgmap v10736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:47.405362+0000 mgr.smithi067.rdualw (mgr.24569) 12468 : cluster [DBG] pgmap v10736: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:49.405970+0000 mgr.smithi067.rdualw (mgr.24569) 12469 : cluster [DBG] pgmap v10737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:49.405970+0000 mgr.smithi067.rdualw (mgr.24569) 12469 : cluster [DBG] pgmap v10737: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:51.406881+0000 mgr.smithi067.rdualw (mgr.24569) 12470 : cluster [DBG] pgmap v10738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:51.406881+0000 mgr.smithi067.rdualw (mgr.24569) 12470 : cluster [DBG] pgmap v10738: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:53.407556+0000 mgr.smithi067.rdualw (mgr.24569) 12471 : cluster [DBG] pgmap v10739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:53.407556+0000 mgr.smithi067.rdualw (mgr.24569) 12471 : cluster [DBG] pgmap v10739: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:57.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:55.408445+0000 mgr.smithi067.rdualw (mgr.24569) 12472 : cluster [DBG] pgmap v10740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:55.408445+0000 mgr.smithi067.rdualw (mgr.24569) 12472 : cluster [DBG] pgmap v10740: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:26:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:26:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:57.409123+0000 mgr.smithi067.rdualw (mgr.24569) 12473 : cluster [DBG] pgmap v10741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:26:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:26:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:57.409123+0000 mgr.smithi067.rdualw (mgr.24569) 12473 : cluster [DBG] pgmap v10741: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:26:59.409782+0000 mgr.smithi067.rdualw (mgr.24569) 12474 : cluster [DBG] pgmap v10742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:26:59.409782+0000 mgr.smithi067.rdualw (mgr.24569) 12474 : cluster [DBG] pgmap v10742: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:01.410697+0000 mgr.smithi067.rdualw (mgr.24569) 12475 : cluster [DBG] pgmap v10743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:01.410697+0000 mgr.smithi067.rdualw (mgr.24569) 12475 : cluster [DBG] pgmap v10743: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:03.411393+0000 mgr.smithi067.rdualw (mgr.24569) 12476 : cluster [DBG] pgmap v10744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:27:03.744425+0000 mon.smithi067 (mon.1) 1880 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:27:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:27:03.745816+0000 mon.smithi067 (mon.1) 1881 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:27:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:27:03.746740+0000 mon.smithi067 (mon.1) 1882 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:27:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:27:04.159686+0000 mon.smithi061 (mon.0) 2589 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:27:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:27:04.165146+0000 mon.smithi061 (mon.0) 2590 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:27:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:03.411393+0000 mgr.smithi067.rdualw (mgr.24569) 12476 : cluster [DBG] pgmap v10744: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:27:03.744425+0000 mon.smithi067 (mon.1) 1880 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:27:05.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:27:03.745816+0000 mon.smithi067 (mon.1) 1881 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:27:05.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:27:03.746740+0000 mon.smithi067 (mon.1) 1882 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:27:05.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:27:04.159686+0000 mon.smithi061 (mon.0) 2589 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:27:05.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:27:04.165146+0000 mon.smithi061 (mon.0) 2590 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:27:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:27:03.747546+0000 mgr.smithi067.rdualw (mgr.24569) 12477 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:27:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:27:03.747546+0000 mgr.smithi067.rdualw (mgr.24569) 12477 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:27:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:05.412283+0000 mgr.smithi067.rdualw (mgr.24569) 12478 : cluster [DBG] pgmap v10745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:05.412283+0000 mgr.smithi067.rdualw (mgr.24569) 12478 : cluster [DBG] pgmap v10745: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:07.412944+0000 mgr.smithi067.rdualw (mgr.24569) 12479 : cluster [DBG] pgmap v10746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:07.412944+0000 mgr.smithi067.rdualw (mgr.24569) 12479 : cluster [DBG] pgmap v10746: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:09.413563+0000 mgr.smithi067.rdualw (mgr.24569) 12480 : cluster [DBG] pgmap v10747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:09.413563+0000 mgr.smithi067.rdualw (mgr.24569) 12480 : cluster [DBG] pgmap v10747: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:11.414442+0000 mgr.smithi067.rdualw (mgr.24569) 12481 : cluster [DBG] pgmap v10748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:11.414442+0000 mgr.smithi067.rdualw (mgr.24569) 12481 : cluster [DBG] pgmap v10748: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:15.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:13.414951+0000 mgr.smithi067.rdualw (mgr.24569) 12482 : cluster [DBG] pgmap v10749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:13.414951+0000 mgr.smithi067.rdualw (mgr.24569) 12482 : cluster [DBG] pgmap v10749: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:15.875 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:27:16.164 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:27:16.165 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 9m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:27:16.165 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 9m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:27:16.166 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 9m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:27:16.166 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 9m ago 6h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:27:16.166 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 9m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:27:16.167 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 9m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:27:16.167 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 9m ago 6h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:27:16.167 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 9m ago 6h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:27:16.167 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 9m ago 6h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:27:16.168 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 9m ago 6h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:27:16.168 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 9m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:27:16.169 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 9m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:27:16.169 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 9m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:27:16.169 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 9m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:27:16.169 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 9m ago 6h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:27:16.170 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 9m ago 6h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:27:16.170 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 9m ago 6h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:27:16.170 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 9m ago 6h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:27:16.170 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 9m ago 6h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:27:16.171 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 9m ago 6h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:27:16.171 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 9m ago 6h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:27:16.171 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 9m ago 6h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:27:16.171 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 9m ago 6h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:27:16.505 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:27:16.505 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:27:16.506 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:27:16.506 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:27:16.506 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:27:16.506 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:27:16.507 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:27:16.507 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:27:16.507 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:27:16.507 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:27:16.507 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:27:16.508 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:27:16.508 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:27:16.508 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:27:16.508 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:27:16.508 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:27:16.509 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:27:16.509 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:27:16.509 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:27:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:15.415812+0000 mgr.smithi067.rdualw (mgr.24569) 12483 : cluster [DBG] pgmap v10750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:27:16.503817+0000 mon.smithi061 (mon.0) 2591 : audit [DBG] from='client.? 172.21.15.61:0/2868583925' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:27:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:15.415812+0000 mgr.smithi067.rdualw (mgr.24569) 12483 : cluster [DBG] pgmap v10750: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:27:16.503817+0000 mon.smithi061 (mon.0) 2591 : audit [DBG] from='client.? 172.21.15.61:0/2868583925' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:27:18.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:27:15.861828+0000 mgr.smithi067.rdualw (mgr.24569) 12484 : audit [DBG] from='client.42466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:27:18.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:27:16.146737+0000 mgr.smithi067.rdualw (mgr.24569) 12485 : audit [DBG] from='client.42470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:27:18.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:27:15.861828+0000 mgr.smithi067.rdualw (mgr.24569) 12484 : audit [DBG] from='client.42466 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:27:18.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:27:16.146737+0000 mgr.smithi067.rdualw (mgr.24569) 12485 : audit [DBG] from='client.42470 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:27:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:17.416312+0000 mgr.smithi067.rdualw (mgr.24569) 12486 : cluster [DBG] pgmap v10751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:17.416312+0000 mgr.smithi067.rdualw (mgr.24569) 12486 : cluster [DBG] pgmap v10751: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:19.416998+0000 mgr.smithi067.rdualw (mgr.24569) 12487 : cluster [DBG] pgmap v10752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:19.416998+0000 mgr.smithi067.rdualw (mgr.24569) 12487 : cluster [DBG] pgmap v10752: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:21.417960+0000 mgr.smithi067.rdualw (mgr.24569) 12488 : cluster [DBG] pgmap v10753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:21.417960+0000 mgr.smithi067.rdualw (mgr.24569) 12488 : cluster [DBG] pgmap v10753: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:23.418684+0000 mgr.smithi067.rdualw (mgr.24569) 12489 : cluster [DBG] pgmap v10754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:25.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:23.418684+0000 mgr.smithi067.rdualw (mgr.24569) 12489 : cluster [DBG] pgmap v10754: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:26.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:25.419550+0000 mgr.smithi067.rdualw (mgr.24569) 12490 : cluster [DBG] pgmap v10755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:25.419550+0000 mgr.smithi067.rdualw (mgr.24569) 12490 : cluster [DBG] pgmap v10755: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:27.420203+0000 mgr.smithi067.rdualw (mgr.24569) 12491 : cluster [DBG] pgmap v10756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:27.420203+0000 mgr.smithi067.rdualw (mgr.24569) 12491 : cluster [DBG] pgmap v10756: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:29.420836+0000 mgr.smithi067.rdualw (mgr.24569) 12492 : cluster [DBG] pgmap v10757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:29.420836+0000 mgr.smithi067.rdualw (mgr.24569) 12492 : cluster [DBG] pgmap v10757: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:31.421770+0000 mgr.smithi067.rdualw (mgr.24569) 12493 : cluster [DBG] pgmap v10758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:33.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:31.421770+0000 mgr.smithi067.rdualw (mgr.24569) 12493 : cluster [DBG] pgmap v10758: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:34.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:33.422447+0000 mgr.smithi067.rdualw (mgr.24569) 12494 : cluster [DBG] pgmap v10759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:33.422447+0000 mgr.smithi067.rdualw (mgr.24569) 12494 : cluster [DBG] pgmap v10759: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:35.423353+0000 mgr.smithi067.rdualw (mgr.24569) 12495 : cluster [DBG] pgmap v10760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:27:36.438605+0000 mon.smithi067 (mon.1) 1883 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:27:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:27:36.438849+0000 mon.smithi067 (mon.1) 1884 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:27:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:27:36.439218+0000 mon.smithi061 (mon.0) 2592 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:27:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:27:36.439496+0000 mon.smithi061 (mon.0) 2593 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:27:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:35.423353+0000 mgr.smithi067.rdualw (mgr.24569) 12495 : cluster [DBG] pgmap v10760: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:27:36.438605+0000 mon.smithi067 (mon.1) 1883 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:27:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:27:36.438849+0000 mon.smithi067 (mon.1) 1884 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:27:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:27:36.439218+0000 mon.smithi061 (mon.0) 2592 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:27:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:27:36.439496+0000 mon.smithi061 (mon.0) 2593 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:27:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:37.423870+0000 mgr.smithi067.rdualw (mgr.24569) 12496 : cluster [DBG] pgmap v10761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:37.423870+0000 mgr.smithi067.rdualw (mgr.24569) 12496 : cluster [DBG] pgmap v10761: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:39.424459+0000 mgr.smithi067.rdualw (mgr.24569) 12497 : cluster [DBG] pgmap v10762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:39.424459+0000 mgr.smithi067.rdualw (mgr.24569) 12497 : cluster [DBG] pgmap v10762: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:41.425320+0000 mgr.smithi067.rdualw (mgr.24569) 12498 : cluster [DBG] pgmap v10763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:41.425320+0000 mgr.smithi067.rdualw (mgr.24569) 12498 : cluster [DBG] pgmap v10763: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:43.425906+0000 mgr.smithi067.rdualw (mgr.24569) 12499 : cluster [DBG] pgmap v10764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:43.425906+0000 mgr.smithi067.rdualw (mgr.24569) 12499 : cluster [DBG] pgmap v10764: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:46.814 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:27:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:45.426761+0000 mgr.smithi067.rdualw (mgr.24569) 12500 : cluster [DBG] pgmap v10765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:45.426761+0000 mgr.smithi067.rdualw (mgr.24569) 12500 : cluster [DBG] pgmap v10765: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:47.131 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:27:47.132 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 9m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:27:47.132 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 9m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:27:47.132 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 9m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:27:47.132 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 9m ago 6h 42.6M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:27:47.132 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 9m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:27:47.133 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 9m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:27:47.133 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (5h) 9m ago 6h 495M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:27:47.133 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 9m ago 6h 672M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:27:47.133 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 9m ago 6h 2038M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:27:47.134 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 9m ago 6h 1188M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:27:47.134 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (5h) 9m ago 5h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:27:47.134 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (5h) 9m ago 5h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:27:47.134 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 9m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:27:47.135 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 9m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:27:47.135 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 9m ago 6h 1374M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:27:47.135 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 9m ago 6h 2302M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:27:47.136 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 9m ago 6h 1451M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:27:47.136 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 9m ago 6h 2459M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:27:47.136 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 9m ago 6h 2266M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:27:47.136 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 9m ago 6h 2406M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:27:47.136 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 9m ago 6h 1983M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:27:47.137 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 9m ago 6h 2981M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:27:47.137 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 9m ago 6h 134M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:27:47.478 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:27:47.478 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:27:47.478 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:27:47.479 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:27:47.479 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:27:47.479 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:27:47.479 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:27:47.480 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:27:47.480 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:27:47.480 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:27:47.480 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:27:47.481 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:27:47.481 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:27:47.481 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:27:47.481 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:27:47.481 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:27:47.482 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:27:47.482 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:27:47.482 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:27:48.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:47 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:27:47.476497+0000 mon.smithi061 (mon.0) 2594 : audit [DBG] from='client.? 172.21.15.61:0/1390324520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:27:48.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:47 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:27:47.476497+0000 mon.smithi061 (mon.0) 2594 : audit [DBG] from='client.? 172.21.15.61:0/1390324520' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:27:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:27:46.800856+0000 mgr.smithi067.rdualw (mgr.24569) 12501 : audit [DBG] from='client.42478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:27:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:27:47.112782+0000 mgr.smithi067.rdualw (mgr.24569) 12502 : audit [DBG] from='client.42482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:27:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:47.427383+0000 mgr.smithi067.rdualw (mgr.24569) 12503 : cluster [DBG] pgmap v10766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:27:46.800856+0000 mgr.smithi067.rdualw (mgr.24569) 12501 : audit [DBG] from='client.42478 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:27:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:27:47.112782+0000 mgr.smithi067.rdualw (mgr.24569) 12502 : audit [DBG] from='client.42482 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:27:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:47.427383+0000 mgr.smithi067.rdualw (mgr.24569) 12503 : cluster [DBG] pgmap v10766: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:49.428056+0000 mgr.smithi067.rdualw (mgr.24569) 12504 : cluster [DBG] pgmap v10767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:49.428056+0000 mgr.smithi067.rdualw (mgr.24569) 12504 : cluster [DBG] pgmap v10767: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:51.429103+0000 mgr.smithi067.rdualw (mgr.24569) 12505 : cluster [DBG] pgmap v10768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:51.429103+0000 mgr.smithi067.rdualw (mgr.24569) 12505 : cluster [DBG] pgmap v10768: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:53.429776+0000 mgr.smithi067.rdualw (mgr.24569) 12506 : cluster [DBG] pgmap v10769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:53.429776+0000 mgr.smithi067.rdualw (mgr.24569) 12506 : cluster [DBG] pgmap v10769: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:55.430593+0000 mgr.smithi067.rdualw (mgr.24569) 12507 : cluster [DBG] pgmap v10770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:55.430593+0000 mgr.smithi067.rdualw (mgr.24569) 12507 : cluster [DBG] pgmap v10770: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:27:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:27:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:57.431151+0000 mgr.smithi067.rdualw (mgr.24569) 12508 : cluster [DBG] pgmap v10771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:27:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:27:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:57.431151+0000 mgr.smithi067.rdualw (mgr.24569) 12508 : cluster [DBG] pgmap v10771: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:27:59.431796+0000 mgr.smithi067.rdualw (mgr.24569) 12509 : cluster [DBG] pgmap v10772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:27:59.431796+0000 mgr.smithi067.rdualw (mgr.24569) 12509 : cluster [DBG] pgmap v10772: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:01.432695+0000 mgr.smithi067.rdualw (mgr.24569) 12510 : cluster [DBG] pgmap v10773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:01.432695+0000 mgr.smithi067.rdualw (mgr.24569) 12510 : cluster [DBG] pgmap v10773: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:03.433307+0000 mgr.smithi067.rdualw (mgr.24569) 12511 : cluster [DBG] pgmap v10774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:04.168462+0000 mon.smithi067 (mon.1) 1885 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:28:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:04.169955+0000 mon.smithi067 (mon.1) 1886 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:28:05.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:04.170965+0000 mon.smithi067 (mon.1) 1887 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:28:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:03.433307+0000 mgr.smithi067.rdualw (mgr.24569) 12511 : cluster [DBG] pgmap v10774: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:05.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:04.168462+0000 mon.smithi067 (mon.1) 1885 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:28:05.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:04.169955+0000 mon.smithi067 (mon.1) 1886 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:28:05.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:04.170965+0000 mon.smithi067 (mon.1) 1887 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:28:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:28:04.171858+0000 mgr.smithi067.rdualw (mgr.24569) 12512 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:28:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:28:04.171858+0000 mgr.smithi067.rdualw (mgr.24569) 12512 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:28:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:05.434068+0000 mgr.smithi067.rdualw (mgr.24569) 12513 : cluster [DBG] pgmap v10775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:05.434068+0000 mgr.smithi067.rdualw (mgr.24569) 12513 : cluster [DBG] pgmap v10775: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:07.434494+0000 mgr.smithi067.rdualw (mgr.24569) 12514 : cluster [DBG] pgmap v10776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:07.434494+0000 mgr.smithi067.rdualw (mgr.24569) 12514 : cluster [DBG] pgmap v10776: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:08.756200+0000 mon.smithi061 (mon.0) 2595 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:28:10.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:09.155414+0000 mon.smithi067 (mon.1) 1888 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:28:10.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:09.156111+0000 mon.smithi061 (mon.0) 2596 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:28:10.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:09.434972+0000 mgr.smithi067.rdualw (mgr.24569) 12515 : cluster [DBG] pgmap v10777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:08.756200+0000 mon.smithi061 (mon.0) 2595 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:28:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:09.155414+0000 mon.smithi067 (mon.1) 1888 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:28:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:09.156111+0000 mon.smithi061 (mon.0) 2596 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:28:10.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:09.434972+0000 mgr.smithi067.rdualw (mgr.24569) 12515 : cluster [DBG] pgmap v10777: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:12.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:11.302470+0000 mon.smithi061 (mon.0) 2597 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:28:12.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:11.435825+0000 mgr.smithi067.rdualw (mgr.24569) 12516 : cluster [DBG] pgmap v10778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:12.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:11.616119+0000 mon.smithi067 (mon.1) 1889 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:28:12.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:11.616737+0000 mon.smithi061 (mon.0) 2598 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:28:12.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:11.623610+0000 mon.smithi061 (mon.0) 2599 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:28:12.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:11.633132+0000 mon.smithi061 (mon.0) 2600 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:28:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:11.302470+0000 mon.smithi061 (mon.0) 2597 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:28:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:11.435825+0000 mgr.smithi067.rdualw (mgr.24569) 12516 : cluster [DBG] pgmap v10778: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:12.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:11.616119+0000 mon.smithi067 (mon.1) 1889 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:28:12.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:11.616737+0000 mon.smithi061 (mon.0) 2598 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:28:12.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:11.623610+0000 mon.smithi061 (mon.0) 2599 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:28:12.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:11.633132+0000 mon.smithi061 (mon.0) 2600 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:28:14.838 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:13.436315+0000 mgr.smithi067.rdualw (mgr.24569) 12517 : cluster [DBG] pgmap v10779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:13.436315+0000 mgr.smithi067.rdualw (mgr.24569) 12517 : cluster [DBG] pgmap v10779: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:15.437302+0000 mgr.smithi067.rdualw (mgr.24569) 12518 : cluster [DBG] pgmap v10780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:15.437302+0000 mgr.smithi067.rdualw (mgr.24569) 12518 : cluster [DBG] pgmap v10780: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:17.787 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:28:18.080 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:28:18.080 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 6s ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:28:18.081 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 6s ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:28:18.081 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 9s ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:28:18.081 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 6s ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:28:18.081 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 6s ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:28:18.082 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 9s ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:28:18.082 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 6s ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:28:18.082 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (5h) 9s ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:28:18.082 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (5h) 6s ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:28:18.082 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 9s ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:28:18.083 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 6s ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:28:18.083 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 9s ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:28:18.083 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 6s ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:28:18.083 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 9s ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:28:18.084 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 6s ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:28:18.084 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 6s ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:28:18.084 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 6s ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:28:18.084 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 6s ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:28:18.084 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 9s ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:28:18.085 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 9s ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:28:18.085 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 9s ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:28:18.085 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 9s ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:28:18.085 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 6s ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:28:18.424 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:28:18.425 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:28:18.425 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:28:18.425 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:28:18.426 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:28:18.426 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:28:18.426 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:28:18.426 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:28:18.427 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:28:18.427 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:28:18.428 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:28:18.428 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:28:18.428 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:28:18.429 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:28:18.429 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:28:18.429 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:28:18.429 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:28:18.430 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:28:18.430 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:28:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:17.437938+0000 mgr.smithi067.rdualw (mgr.24569) 12519 : cluster [DBG] pgmap v10781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:18.423114+0000 mon.smithi061 (mon.0) 2601 : audit [DBG] from='client.? 172.21.15.61:0/3188931819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:28:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:17.437938+0000 mgr.smithi067.rdualw (mgr.24569) 12519 : cluster [DBG] pgmap v10781: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:18.423114+0000 mon.smithi061 (mon.0) 2601 : audit [DBG] from='client.? 172.21.15.61:0/3188931819' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:28:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:17.772964+0000 mgr.smithi067.rdualw (mgr.24569) 12520 : audit [DBG] from='client.42490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:28:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:18.062347+0000 mgr.smithi067.rdualw (mgr.24569) 12521 : audit [DBG] from='client.42494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:28:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:17.772964+0000 mgr.smithi067.rdualw (mgr.24569) 12520 : audit [DBG] from='client.42490 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:28:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:18.062347+0000 mgr.smithi067.rdualw (mgr.24569) 12521 : audit [DBG] from='client.42494 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:28:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:19.438568+0000 mgr.smithi067.rdualw (mgr.24569) 12522 : cluster [DBG] pgmap v10782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:19.438568+0000 mgr.smithi067.rdualw (mgr.24569) 12522 : cluster [DBG] pgmap v10782: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:21.439396+0000 mgr.smithi067.rdualw (mgr.24569) 12523 : cluster [DBG] pgmap v10783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:21.439396+0000 mgr.smithi067.rdualw (mgr.24569) 12523 : cluster [DBG] pgmap v10783: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:23.440193+0000 mgr.smithi067.rdualw (mgr.24569) 12524 : cluster [DBG] pgmap v10784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:23.440193+0000 mgr.smithi067.rdualw (mgr.24569) 12524 : cluster [DBG] pgmap v10784: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:25.441012+0000 mgr.smithi067.rdualw (mgr.24569) 12525 : cluster [DBG] pgmap v10785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:25.441012+0000 mgr.smithi067.rdualw (mgr.24569) 12525 : cluster [DBG] pgmap v10785: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:27.441605+0000 mgr.smithi067.rdualw (mgr.24569) 12526 : cluster [DBG] pgmap v10786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:27.441605+0000 mgr.smithi067.rdualw (mgr.24569) 12526 : cluster [DBG] pgmap v10786: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:29.442331+0000 mgr.smithi067.rdualw (mgr.24569) 12527 : cluster [DBG] pgmap v10787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:29.442331+0000 mgr.smithi067.rdualw (mgr.24569) 12527 : cluster [DBG] pgmap v10787: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:31.443161+0000 mgr.smithi067.rdualw (mgr.24569) 12528 : cluster [DBG] pgmap v10788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:31.443161+0000 mgr.smithi067.rdualw (mgr.24569) 12528 : cluster [DBG] pgmap v10788: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:33.443882+0000 mgr.smithi067.rdualw (mgr.24569) 12529 : cluster [DBG] pgmap v10789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:33.443882+0000 mgr.smithi067.rdualw (mgr.24569) 12529 : cluster [DBG] pgmap v10789: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:35.444745+0000 mgr.smithi067.rdualw (mgr.24569) 12530 : cluster [DBG] pgmap v10790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:36.443844+0000 mon.smithi067 (mon.1) 1890 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:28:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:36.444097+0000 mon.smithi067 (mon.1) 1891 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:28:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:36.444793+0000 mon.smithi061 (mon.0) 2602 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:28:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:36.445118+0000 mon.smithi061 (mon.0) 2603 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:28:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:35.444745+0000 mgr.smithi067.rdualw (mgr.24569) 12530 : cluster [DBG] pgmap v10790: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:36.443844+0000 mon.smithi067 (mon.1) 1890 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:28:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:36.444097+0000 mon.smithi067 (mon.1) 1891 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:28:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:36.444793+0000 mon.smithi061 (mon.0) 2602 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:28:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:36.445118+0000 mon.smithi061 (mon.0) 2603 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:28:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:37.445387+0000 mgr.smithi067.rdualw (mgr.24569) 12531 : cluster [DBG] pgmap v10791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:37.445387+0000 mgr.smithi067.rdualw (mgr.24569) 12531 : cluster [DBG] pgmap v10791: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:39.445893+0000 mgr.smithi067.rdualw (mgr.24569) 12532 : cluster [DBG] pgmap v10792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:39.445893+0000 mgr.smithi067.rdualw (mgr.24569) 12532 : cluster [DBG] pgmap v10792: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:41.446790+0000 mgr.smithi067.rdualw (mgr.24569) 12533 : cluster [DBG] pgmap v10793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:41.446790+0000 mgr.smithi067.rdualw (mgr.24569) 12533 : cluster [DBG] pgmap v10793: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:43.447304+0000 mgr.smithi067.rdualw (mgr.24569) 12534 : cluster [DBG] pgmap v10794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:43.447304+0000 mgr.smithi067.rdualw (mgr.24569) 12534 : cluster [DBG] pgmap v10794: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:45.448066+0000 mgr.smithi067.rdualw (mgr.24569) 12535 : cluster [DBG] pgmap v10795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:45.448066+0000 mgr.smithi067.rdualw (mgr.24569) 12535 : cluster [DBG] pgmap v10795: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:48.760 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:28:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:47.448766+0000 mgr.smithi067.rdualw (mgr.24569) 12536 : cluster [DBG] pgmap v10796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:49.058 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:28:49.059 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 37s ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:28:49.059 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 37s ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:28:49.060 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 40s ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:28:49.060 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 37s ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:28:49.060 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (5h) 37s ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:28:49.061 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 40s ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:28:49.061 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 37s ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:28:49.062 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 40s ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:28:49.062 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 37s ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:28:49.063 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (5h) 40s ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:28:49.063 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 37s ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:28:49.063 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 40s ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:28:49.064 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 37s ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:28:49.064 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 40s ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:28:49.065 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 37s ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:28:49.065 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 37s ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:28:49.065 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 37s ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:28:49.066 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 37s ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:28:49.066 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 40s ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:28:49.067 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 40s ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:28:49.067 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 40s ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:28:49.068 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 40s ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:28:49.068 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 37s ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:28:49.069 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:47.448766+0000 mgr.smithi067.rdualw (mgr.24569) 12536 : cluster [DBG] pgmap v10796: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:49.421 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:28:49.421 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:28:49.422 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:28:49.422 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:28:49.422 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:28:49.422 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:28:49.423 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:28:49.423 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:28:49.423 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:28:49.423 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:28:49.424 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:28:49.424 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:28:49.424 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:28:49.424 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:28:49.425 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:28:49.425 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:28:49.425 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:28:49.425 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:28:49.425 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:28:50.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:49 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:49.419657+0000 mon.smithi061 (mon.0) 2604 : audit [DBG] from='client.? 172.21.15.61:0/870479598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:28:50.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:49 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:49.419657+0000 mon.smithi061 (mon.0) 2604 : audit [DBG] from='client.? 172.21.15.61:0/870479598' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:28:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:48.746150+0000 mgr.smithi067.rdualw (mgr.24569) 12537 : audit [DBG] from='client.42502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:28:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:28:49.040546+0000 mgr.smithi067.rdualw (mgr.24569) 12538 : audit [DBG] from='client.42506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:28:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:49.449323+0000 mgr.smithi067.rdualw (mgr.24569) 12539 : cluster [DBG] pgmap v10797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:48.746150+0000 mgr.smithi067.rdualw (mgr.24569) 12537 : audit [DBG] from='client.42502 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:28:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:28:49.040546+0000 mgr.smithi067.rdualw (mgr.24569) 12538 : audit [DBG] from='client.42506 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:28:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:49.449323+0000 mgr.smithi067.rdualw (mgr.24569) 12539 : cluster [DBG] pgmap v10797: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:51.450338+0000 mgr.smithi067.rdualw (mgr.24569) 12540 : cluster [DBG] pgmap v10798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:51.450338+0000 mgr.smithi067.rdualw (mgr.24569) 12540 : cluster [DBG] pgmap v10798: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:53.450823+0000 mgr.smithi067.rdualw (mgr.24569) 12541 : cluster [DBG] pgmap v10799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:53.450823+0000 mgr.smithi067.rdualw (mgr.24569) 12541 : cluster [DBG] pgmap v10799: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:55.451660+0000 mgr.smithi067.rdualw (mgr.24569) 12542 : cluster [DBG] pgmap v10800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:55.451660+0000 mgr.smithi067.rdualw (mgr.24569) 12542 : cluster [DBG] pgmap v10800: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:28:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:28:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:57.452124+0000 mgr.smithi067.rdualw (mgr.24569) 12543 : cluster [DBG] pgmap v10801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:28:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:28:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:57.452124+0000 mgr.smithi067.rdualw (mgr.24569) 12543 : cluster [DBG] pgmap v10801: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:28:59.452869+0000 mgr.smithi067.rdualw (mgr.24569) 12544 : cluster [DBG] pgmap v10802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:28:59.452869+0000 mgr.smithi067.rdualw (mgr.24569) 12544 : cluster [DBG] pgmap v10802: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:01.453696+0000 mgr.smithi067.rdualw (mgr.24569) 12545 : cluster [DBG] pgmap v10803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:01.453696+0000 mgr.smithi067.rdualw (mgr.24569) 12545 : cluster [DBG] pgmap v10803: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:03.454285+0000 mgr.smithi067.rdualw (mgr.24569) 12546 : cluster [DBG] pgmap v10804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:03.454285+0000 mgr.smithi067.rdualw (mgr.24569) 12546 : cluster [DBG] pgmap v10804: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:05.455182+0000 mgr.smithi067.rdualw (mgr.24569) 12547 : cluster [DBG] pgmap v10805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:05.455182+0000 mgr.smithi067.rdualw (mgr.24569) 12547 : cluster [DBG] pgmap v10805: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:07.455782+0000 mgr.smithi067.rdualw (mgr.24569) 12548 : cluster [DBG] pgmap v10806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:07.455782+0000 mgr.smithi067.rdualw (mgr.24569) 12548 : cluster [DBG] pgmap v10806: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:09.456440+0000 mgr.smithi067.rdualw (mgr.24569) 12549 : cluster [DBG] pgmap v10807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:09.456440+0000 mgr.smithi067.rdualw (mgr.24569) 12549 : cluster [DBG] pgmap v10807: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:11.457393+0000 mgr.smithi067.rdualw (mgr.24569) 12550 : cluster [DBG] pgmap v10808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:29:11.637980+0000 mon.smithi067 (mon.1) 1892 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:29:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:29:11.639365+0000 mon.smithi067 (mon.1) 1893 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:29:13.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:29:11.640306+0000 mon.smithi067 (mon.1) 1894 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:29:13.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:29:11.641170+0000 mgr.smithi067.rdualw (mgr.24569) 12551 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:29:13.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:29:12.049279+0000 mon.smithi061 (mon.0) 2605 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:29:13.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:29:12.054939+0000 mon.smithi061 (mon.0) 2606 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:29:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:11.457393+0000 mgr.smithi067.rdualw (mgr.24569) 12550 : cluster [DBG] pgmap v10808: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:29:11.637980+0000 mon.smithi067 (mon.1) 1892 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:29:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:29:11.639365+0000 mon.smithi067 (mon.1) 1893 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:29:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:29:11.640306+0000 mon.smithi067 (mon.1) 1894 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:29:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:29:11.641170+0000 mgr.smithi067.rdualw (mgr.24569) 12551 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:29:13.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:29:12.049279+0000 mon.smithi061 (mon.0) 2605 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:29:13.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:29:12.054939+0000 mon.smithi061 (mon.0) 2606 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:29:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:13.457931+0000 mgr.smithi067.rdualw (mgr.24569) 12552 : cluster [DBG] pgmap v10809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:13.457931+0000 mgr.smithi067.rdualw (mgr.24569) 12552 : cluster [DBG] pgmap v10809: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:15.459059+0000 mgr.smithi067.rdualw (mgr.24569) 12553 : cluster [DBG] pgmap v10810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:15.459059+0000 mgr.smithi067.rdualw (mgr.24569) 12553 : cluster [DBG] pgmap v10810: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:19.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:17.459785+0000 mgr.smithi067.rdualw (mgr.24569) 12554 : cluster [DBG] pgmap v10811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:20.409 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:17.459785+0000 mgr.smithi067.rdualw (mgr.24569) 12554 : cluster [DBG] pgmap v10811: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:20.410 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:29:20.411 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:29:20.411 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 68s ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:29:20.411 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (5h) 68s ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:29:20.411 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 71s ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:29:20.411 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 68s ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:29:20.412 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 68s ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:29:20.412 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (5h) 71s ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:29:20.412 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 68s ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:29:20.412 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 71s ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:29:20.413 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 68s ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:29:20.413 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 71s ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:29:20.413 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 68s ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:29:20.413 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 71s ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:29:20.414 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 68s ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:29:20.414 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 71s ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:29:20.414 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 68s ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:29:20.414 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 68s ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:29:20.414 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 68s ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:29:20.415 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 68s ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:29:20.415 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 71s ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:29:20.415 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 71s ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:29:20.415 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 71s ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:29:20.416 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 71s ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:29:20.416 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 68s ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:29:20.416 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:29:20.416 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:29:20.416 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:29:20.417 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:29:20.417 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:29:20.417 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:29:20.417 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:29:20.417 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:29:20.418 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:29:20.418 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:29:20.418 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:29:20.418 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:29:20.419 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:29:20.419 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:29:20.419 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:29:20.419 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:29:20.419 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:29:20.420 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:29:20.420 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:29:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:19.460417+0000 mgr.smithi067.rdualw (mgr.24569) 12555 : cluster [DBG] pgmap v10812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:29:20.359254+0000 mon.smithi061 (mon.0) 2607 : audit [DBG] from='client.? 172.21.15.61:0/4177231752' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:29:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:19.460417+0000 mgr.smithi067.rdualw (mgr.24569) 12555 : cluster [DBG] pgmap v10812: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:29:20.359254+0000 mon.smithi061 (mon.0) 2607 : audit [DBG] from='client.? 172.21.15.61:0/4177231752' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:29:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:29:19.716286+0000 mgr.smithi067.rdualw (mgr.24569) 12556 : audit [DBG] from='client.42514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:29:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:29:20.001874+0000 mgr.smithi067.rdualw (mgr.24569) 12557 : audit [DBG] from='client.42518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:29:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:29:19.716286+0000 mgr.smithi067.rdualw (mgr.24569) 12556 : audit [DBG] from='client.42514 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:29:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:29:20.001874+0000 mgr.smithi067.rdualw (mgr.24569) 12557 : audit [DBG] from='client.42518 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:29:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:21.461285+0000 mgr.smithi067.rdualw (mgr.24569) 12558 : cluster [DBG] pgmap v10813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:21.461285+0000 mgr.smithi067.rdualw (mgr.24569) 12558 : cluster [DBG] pgmap v10813: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:23.461998+0000 mgr.smithi067.rdualw (mgr.24569) 12559 : cluster [DBG] pgmap v10814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:23.461998+0000 mgr.smithi067.rdualw (mgr.24569) 12559 : cluster [DBG] pgmap v10814: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:25.462837+0000 mgr.smithi067.rdualw (mgr.24569) 12560 : cluster [DBG] pgmap v10815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:25.462837+0000 mgr.smithi067.rdualw (mgr.24569) 12560 : cluster [DBG] pgmap v10815: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:27.463392+0000 mgr.smithi067.rdualw (mgr.24569) 12561 : cluster [DBG] pgmap v10816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:27.463392+0000 mgr.smithi067.rdualw (mgr.24569) 12561 : cluster [DBG] pgmap v10816: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:29.463999+0000 mgr.smithi067.rdualw (mgr.24569) 12562 : cluster [DBG] pgmap v10817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:29.463999+0000 mgr.smithi067.rdualw (mgr.24569) 12562 : cluster [DBG] pgmap v10817: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:31.464913+0000 mgr.smithi067.rdualw (mgr.24569) 12563 : cluster [DBG] pgmap v10818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:31.464913+0000 mgr.smithi067.rdualw (mgr.24569) 12563 : cluster [DBG] pgmap v10818: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:33.465510+0000 mgr.smithi067.rdualw (mgr.24569) 12564 : cluster [DBG] pgmap v10819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:33.465510+0000 mgr.smithi067.rdualw (mgr.24569) 12564 : cluster [DBG] pgmap v10819: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:35.466384+0000 mgr.smithi067.rdualw (mgr.24569) 12565 : cluster [DBG] pgmap v10820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:29:36.449777+0000 mon.smithi067 (mon.1) 1895 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:29:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:29:36.450016+0000 mon.smithi067 (mon.1) 1896 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:29:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:29:36.450353+0000 mon.smithi061 (mon.0) 2608 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:29:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:29:36.450591+0000 mon.smithi061 (mon.0) 2609 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:29:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:35.466384+0000 mgr.smithi067.rdualw (mgr.24569) 12565 : cluster [DBG] pgmap v10820: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:29:36.449777+0000 mon.smithi067 (mon.1) 1895 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:29:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:29:36.450016+0000 mon.smithi067 (mon.1) 1896 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:29:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:29:36.450353+0000 mon.smithi061 (mon.0) 2608 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:29:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:29:36.450591+0000 mon.smithi061 (mon.0) 2609 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:29:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:37.466989+0000 mgr.smithi067.rdualw (mgr.24569) 12566 : cluster [DBG] pgmap v10821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:37.466989+0000 mgr.smithi067.rdualw (mgr.24569) 12566 : cluster [DBG] pgmap v10821: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:39.467742+0000 mgr.smithi067.rdualw (mgr.24569) 12567 : cluster [DBG] pgmap v10822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:39.467742+0000 mgr.smithi067.rdualw (mgr.24569) 12567 : cluster [DBG] pgmap v10822: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:41.468606+0000 mgr.smithi067.rdualw (mgr.24569) 12568 : cluster [DBG] pgmap v10823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:41.468606+0000 mgr.smithi067.rdualw (mgr.24569) 12568 : cluster [DBG] pgmap v10823: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:43.469102+0000 mgr.smithi067.rdualw (mgr.24569) 12569 : cluster [DBG] pgmap v10824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:43.469102+0000 mgr.smithi067.rdualw (mgr.24569) 12569 : cluster [DBG] pgmap v10824: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:45.470089+0000 mgr.smithi067.rdualw (mgr.24569) 12570 : cluster [DBG] pgmap v10825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:45.470089+0000 mgr.smithi067.rdualw (mgr.24569) 12570 : cluster [DBG] pgmap v10825: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:47.470590+0000 mgr.smithi067.rdualw (mgr.24569) 12571 : cluster [DBG] pgmap v10826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:47.470590+0000 mgr.smithi067.rdualw (mgr.24569) 12571 : cluster [DBG] pgmap v10826: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:50.668 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:29:50.966 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:29:50.966 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 99s ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:29:50.967 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 99s ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:29:50.967 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (5h) 102s ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:29:50.967 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 99s ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:29:50.967 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 99s ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:29:50.967 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 102s ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:29:50.968 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 99s ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:29:50.968 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 102s ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:29:50.968 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 99s ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:29:50.968 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 102s ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:29:50.969 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 99s ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:29:50.969 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 102s ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:29:50.969 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 99s ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:29:50.969 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 102s ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:29:50.969 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 99s ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:29:50.970 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 99s ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:29:50.970 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 99s ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:29:50.970 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 99s ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:29:50.970 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 102s ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:29:50.970 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 102s ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:29:50.971 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 102s ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:29:50.971 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 102s ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:29:50.971 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 99s ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:29:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:49.471130+0000 mgr.smithi067.rdualw (mgr.24569) 12572 : cluster [DBG] pgmap v10827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:49.471130+0000 mgr.smithi067.rdualw (mgr.24569) 12572 : cluster [DBG] pgmap v10827: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:51.310 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:29:51.310 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:29:51.310 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:29:51.311 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:29:51.311 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:29:51.311 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:29:51.311 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:29:51.312 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:29:51.312 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:29:51.312 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:29:51.313 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:29:51.313 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:29:51.313 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:29:51.313 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:29:51.313 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:29:51.314 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:29:51.314 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:29:51.314 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:29:51.314 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:29:52.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:29:50.654977+0000 mgr.smithi067.rdualw (mgr.24569) 12573 : audit [DBG] from='client.42526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:29:52.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:51 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:29:51.308536+0000 mon.smithi061 (mon.0) 2610 : audit [DBG] from='client.? 172.21.15.61:0/1139904977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:29:52.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:29:50.654977+0000 mgr.smithi067.rdualw (mgr.24569) 12573 : audit [DBG] from='client.42526 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:29:52.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:51 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:29:51.308536+0000 mon.smithi061 (mon.0) 2610 : audit [DBG] from='client.? 172.21.15.61:0/1139904977' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:29:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:29:50.947994+0000 mgr.smithi067.rdualw (mgr.24569) 12574 : audit [DBG] from='client.42530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:29:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:51.471946+0000 mgr.smithi067.rdualw (mgr.24569) 12575 : cluster [DBG] pgmap v10828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:29:50.947994+0000 mgr.smithi067.rdualw (mgr.24569) 12574 : audit [DBG] from='client.42530 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:29:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:51.471946+0000 mgr.smithi067.rdualw (mgr.24569) 12575 : cluster [DBG] pgmap v10828: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:53.472519+0000 mgr.smithi067.rdualw (mgr.24569) 12576 : cluster [DBG] pgmap v10829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:53.472519+0000 mgr.smithi067.rdualw (mgr.24569) 12576 : cluster [DBG] pgmap v10829: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:55.473389+0000 mgr.smithi067.rdualw (mgr.24569) 12577 : cluster [DBG] pgmap v10830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:55.473389+0000 mgr.smithi067.rdualw (mgr.24569) 12577 : cluster [DBG] pgmap v10830: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:29:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:29:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:57.473887+0000 mgr.smithi067.rdualw (mgr.24569) 12578 : cluster [DBG] pgmap v10831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:29:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:29:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:57.473887+0000 mgr.smithi067.rdualw (mgr.24569) 12578 : cluster [DBG] pgmap v10831: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:29:59.474618+0000 mgr.smithi067.rdualw (mgr.24569) 12579 : cluster [DBG] pgmap v10832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:00.000092+0000 mon.smithi061 (mon.0) 2611 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T21:30:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:29:59.474618+0000 mgr.smithi067.rdualw (mgr.24569) 12579 : cluster [DBG] pgmap v10832: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:00.000092+0000 mon.smithi061 (mon.0) 2611 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T21:30:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:01.475512+0000 mgr.smithi067.rdualw (mgr.24569) 12580 : cluster [DBG] pgmap v10833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:01.475512+0000 mgr.smithi067.rdualw (mgr.24569) 12580 : cluster [DBG] pgmap v10833: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:03.476094+0000 mgr.smithi067.rdualw (mgr.24569) 12581 : cluster [DBG] pgmap v10834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:03.476094+0000 mgr.smithi067.rdualw (mgr.24569) 12581 : cluster [DBG] pgmap v10834: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:05.477094+0000 mgr.smithi067.rdualw (mgr.24569) 12582 : cluster [DBG] pgmap v10835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:05.477094+0000 mgr.smithi067.rdualw (mgr.24569) 12582 : cluster [DBG] pgmap v10835: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:07.477696+0000 mgr.smithi067.rdualw (mgr.24569) 12583 : cluster [DBG] pgmap v10836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:07.477696+0000 mgr.smithi067.rdualw (mgr.24569) 12583 : cluster [DBG] pgmap v10836: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:09.478335+0000 mgr.smithi067.rdualw (mgr.24569) 12584 : cluster [DBG] pgmap v10837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:09.478335+0000 mgr.smithi067.rdualw (mgr.24569) 12584 : cluster [DBG] pgmap v10837: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:11.479375+0000 mgr.smithi067.rdualw (mgr.24569) 12585 : cluster [DBG] pgmap v10838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:30:12.058144+0000 mon.smithi067 (mon.1) 1897 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:30:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:30:12.059576+0000 mon.smithi067 (mon.1) 1898 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:30:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:30:12.060542+0000 mon.smithi067 (mon.1) 1899 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:30:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:30:12.418389+0000 mon.smithi061 (mon.0) 2612 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:30:13.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:30:12.428896+0000 mon.smithi061 (mon.0) 2613 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:30:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:11.479375+0000 mgr.smithi067.rdualw (mgr.24569) 12585 : cluster [DBG] pgmap v10838: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:30:12.058144+0000 mon.smithi067 (mon.1) 1897 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:30:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:30:12.059576+0000 mon.smithi067 (mon.1) 1898 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:30:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:30:12.060542+0000 mon.smithi067 (mon.1) 1899 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:30:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:30:12.418389+0000 mon.smithi061 (mon.0) 2612 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:30:13.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:30:12.428896+0000 mon.smithi061 (mon.0) 2613 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:30:14.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:30:12.061354+0000 mgr.smithi067.rdualw (mgr.24569) 12586 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:30:14.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:30:12.833256+0000 mon.smithi061 (mon.0) 2614 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:30:14.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:30:12.842680+0000 mon.smithi061 (mon.0) 2615 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:30:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:30:12.061354+0000 mgr.smithi067.rdualw (mgr.24569) 12586 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:30:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:30:12.833256+0000 mon.smithi061 (mon.0) 2614 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:30:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:30:12.842680+0000 mon.smithi061 (mon.0) 2615 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:30:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:13.480000+0000 mgr.smithi067.rdualw (mgr.24569) 12587 : cluster [DBG] pgmap v10839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:13.480000+0000 mgr.smithi067.rdualw (mgr.24569) 12587 : cluster [DBG] pgmap v10839: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:15.480943+0000 mgr.smithi067.rdualw (mgr.24569) 12588 : cluster [DBG] pgmap v10840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:15.480943+0000 mgr.smithi067.rdualw (mgr.24569) 12588 : cluster [DBG] pgmap v10840: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:17.481462+0000 mgr.smithi067.rdualw (mgr.24569) 12589 : cluster [DBG] pgmap v10841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:17.481462+0000 mgr.smithi067.rdualw (mgr.24569) 12589 : cluster [DBG] pgmap v10841: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:19.482072+0000 mgr.smithi067.rdualw (mgr.24569) 12590 : cluster [DBG] pgmap v10842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:19.482072+0000 mgr.smithi067.rdualw (mgr.24569) 12590 : cluster [DBG] pgmap v10842: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:21.620 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:30:21.939 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:30:21.939 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 2m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:30:21.939 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 2m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:30:21.940 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 2m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:30:21.940 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 2m ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:30:21.940 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 2m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:30:21.940 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 2m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:30:21.940 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 2m ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:30:21.941 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 2m ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:30:21.941 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 2m ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:30:21.941 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 2m ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:30:21.941 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 2m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:30:21.942 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 2m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:30:21.942 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 2m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:30:21.942 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 2m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:30:21.942 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 2m ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:30:21.943 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 2m ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:30:21.943 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 2m ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:30:21.943 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 2m ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:30:21.943 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 2m ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:30:21.943 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 2m ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:30:21.944 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 2m ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:30:21.944 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 2m ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:30:21.944 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 2m ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:30:22.284 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:30:22.284 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:30:22.284 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:30:22.285 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:30:22.285 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:30:22.285 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:30:22.285 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:30:22.286 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:30:22.286 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:30:22.286 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:30:22.286 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:30:22.286 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:30:22.287 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:30:22.287 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:30:22.287 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:30:22.287 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:30:22.288 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:30:22.288 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:30:22.288 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:30:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:21.482925+0000 mgr.smithi067.rdualw (mgr.24569) 12591 : cluster [DBG] pgmap v10843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:30:21.606238+0000 mgr.smithi067.rdualw (mgr.24569) 12592 : audit [DBG] from='client.42538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:30:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:30:22.282376+0000 mon.smithi061 (mon.0) 2616 : audit [DBG] from='client.? 172.21.15.61:0/2315557195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:30:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:21.482925+0000 mgr.smithi067.rdualw (mgr.24569) 12591 : cluster [DBG] pgmap v10843: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:30:21.606238+0000 mgr.smithi067.rdualw (mgr.24569) 12592 : audit [DBG] from='client.42538 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:30:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:30:22.282376+0000 mon.smithi061 (mon.0) 2616 : audit [DBG] from='client.? 172.21.15.61:0/2315557195' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:30:24.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:23 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:30:21.920767+0000 mgr.smithi067.rdualw (mgr.24569) 12593 : audit [DBG] from='client.42542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:30:24.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:23 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:30:21.920767+0000 mgr.smithi067.rdualw (mgr.24569) 12593 : audit [DBG] from='client.42542 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:30:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:23.483442+0000 mgr.smithi067.rdualw (mgr.24569) 12594 : cluster [DBG] pgmap v10844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:23.483442+0000 mgr.smithi067.rdualw (mgr.24569) 12594 : cluster [DBG] pgmap v10844: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:25.484255+0000 mgr.smithi067.rdualw (mgr.24569) 12595 : cluster [DBG] pgmap v10845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:25.484255+0000 mgr.smithi067.rdualw (mgr.24569) 12595 : cluster [DBG] pgmap v10845: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:27.484986+0000 mgr.smithi067.rdualw (mgr.24569) 12596 : cluster [DBG] pgmap v10846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:27.484986+0000 mgr.smithi067.rdualw (mgr.24569) 12596 : cluster [DBG] pgmap v10846: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:29.485590+0000 mgr.smithi067.rdualw (mgr.24569) 12597 : cluster [DBG] pgmap v10847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:29.485590+0000 mgr.smithi067.rdualw (mgr.24569) 12597 : cluster [DBG] pgmap v10847: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:31.486404+0000 mgr.smithi067.rdualw (mgr.24569) 12598 : cluster [DBG] pgmap v10848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:31.486404+0000 mgr.smithi067.rdualw (mgr.24569) 12598 : cluster [DBG] pgmap v10848: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:33.487114+0000 mgr.smithi067.rdualw (mgr.24569) 12599 : cluster [DBG] pgmap v10849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:33.487114+0000 mgr.smithi067.rdualw (mgr.24569) 12599 : cluster [DBG] pgmap v10849: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:35.488217+0000 mgr.smithi067.rdualw (mgr.24569) 12600 : cluster [DBG] pgmap v10850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:30:36.455791+0000 mon.smithi067 (mon.1) 1900 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:30:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:30:36.456164+0000 mon.smithi067 (mon.1) 1901 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:30:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:30:36.456329+0000 mon.smithi061 (mon.0) 2617 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:30:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:30:36.456579+0000 mon.smithi061 (mon.0) 2618 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:30:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:35.488217+0000 mgr.smithi067.rdualw (mgr.24569) 12600 : cluster [DBG] pgmap v10850: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:30:36.455791+0000 mon.smithi067 (mon.1) 1900 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:30:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:30:36.456164+0000 mon.smithi067 (mon.1) 1901 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:30:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:30:36.456329+0000 mon.smithi061 (mon.0) 2617 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:30:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:30:36.456579+0000 mon.smithi061 (mon.0) 2618 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:30:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:37.488958+0000 mgr.smithi067.rdualw (mgr.24569) 12601 : cluster [DBG] pgmap v10851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:37.488958+0000 mgr.smithi067.rdualw (mgr.24569) 12601 : cluster [DBG] pgmap v10851: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:39.489599+0000 mgr.smithi067.rdualw (mgr.24569) 12602 : cluster [DBG] pgmap v10852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:39.489599+0000 mgr.smithi067.rdualw (mgr.24569) 12602 : cluster [DBG] pgmap v10852: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:41.490459+0000 mgr.smithi067.rdualw (mgr.24569) 12603 : cluster [DBG] pgmap v10853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:41.490459+0000 mgr.smithi067.rdualw (mgr.24569) 12603 : cluster [DBG] pgmap v10853: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:43.491024+0000 mgr.smithi067.rdualw (mgr.24569) 12604 : cluster [DBG] pgmap v10854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:43.491024+0000 mgr.smithi067.rdualw (mgr.24569) 12604 : cluster [DBG] pgmap v10854: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:45.491867+0000 mgr.smithi067.rdualw (mgr.24569) 12605 : cluster [DBG] pgmap v10855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:45.491867+0000 mgr.smithi067.rdualw (mgr.24569) 12605 : cluster [DBG] pgmap v10855: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:47.492361+0000 mgr.smithi067.rdualw (mgr.24569) 12606 : cluster [DBG] pgmap v10856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:47.492361+0000 mgr.smithi067.rdualw (mgr.24569) 12606 : cluster [DBG] pgmap v10856: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:49.492922+0000 mgr.smithi067.rdualw (mgr.24569) 12607 : cluster [DBG] pgmap v10857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:51.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:49.492922+0000 mgr.smithi067.rdualw (mgr.24569) 12607 : cluster [DBG] pgmap v10857: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:52.595 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:30:52.909 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:30:52.909 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 2m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:30:52.909 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 2m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:30:52.910 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 2m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:30:52.910 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 2m ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:30:52.910 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 2m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:30:52.910 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 2m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:30:52.911 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 2m ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:30:52.911 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 2m ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:30:52.911 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 2m ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:30:52.911 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 2m ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:30:52.912 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 2m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:30:52.912 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 2m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:30:52.912 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 2m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:30:52.913 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 2m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:30:52.913 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 2m ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:30:52.913 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 2m ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:30:52.913 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 2m ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:30:52.913 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 2m ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:30:52.914 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 2m ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:30:52.914 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 2m ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:30:52.914 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 2m ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:30:52.914 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 2m ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:30:52.914 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 2m ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:30:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:51.493766+0000 mgr.smithi067.rdualw (mgr.24569) 12608 : cluster [DBG] pgmap v10858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:51.493766+0000 mgr.smithi067.rdualw (mgr.24569) 12608 : cluster [DBG] pgmap v10858: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:53.252 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:30:53.252 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:30:53.252 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:30:53.253 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:30:53.253 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:30:53.253 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:30:53.253 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:30:53.254 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:30:53.254 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:30:53.254 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:30:53.255 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:30:53.255 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:30:53.255 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:30:53.255 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:30:53.255 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:30:53.256 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:30:53.256 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:30:53.256 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:30:53.256 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:30:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:30:52.581306+0000 mgr.smithi067.rdualw (mgr.24569) 12609 : audit [DBG] from='client.42550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:30:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:30:53.250144+0000 mon.smithi061 (mon.0) 2619 : audit [DBG] from='client.? 172.21.15.61:0/777812057' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:30:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:30:52.581306+0000 mgr.smithi067.rdualw (mgr.24569) 12609 : audit [DBG] from='client.42550 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:30:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:30:53.250144+0000 mon.smithi061 (mon.0) 2619 : audit [DBG] from='client.? 172.21.15.61:0/777812057' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:30:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:30:52.890882+0000 mgr.smithi067.rdualw (mgr.24569) 12610 : audit [DBG] from='client.42554 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:30:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:53.494328+0000 mgr.smithi067.rdualw (mgr.24569) 12611 : cluster [DBG] pgmap v10859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:30:52.890882+0000 mgr.smithi067.rdualw (mgr.24569) 12610 : audit [DBG] from='client.42554 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:30:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:53.494328+0000 mgr.smithi067.rdualw (mgr.24569) 12611 : cluster [DBG] pgmap v10859: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:55.495283+0000 mgr.smithi067.rdualw (mgr.24569) 12612 : cluster [DBG] pgmap v10860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:55.495283+0000 mgr.smithi067.rdualw (mgr.24569) 12612 : cluster [DBG] pgmap v10860: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:30:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:30:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:57.495911+0000 mgr.smithi067.rdualw (mgr.24569) 12613 : cluster [DBG] pgmap v10861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:30:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:30:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:57.495911+0000 mgr.smithi067.rdualw (mgr.24569) 12613 : cluster [DBG] pgmap v10861: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:30:59.496556+0000 mgr.smithi067.rdualw (mgr.24569) 12614 : cluster [DBG] pgmap v10862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:30:59.496556+0000 mgr.smithi067.rdualw (mgr.24569) 12614 : cluster [DBG] pgmap v10862: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:01.497479+0000 mgr.smithi067.rdualw (mgr.24569) 12615 : cluster [DBG] pgmap v10863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:01.497479+0000 mgr.smithi067.rdualw (mgr.24569) 12615 : cluster [DBG] pgmap v10863: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:03.497981+0000 mgr.smithi067.rdualw (mgr.24569) 12616 : cluster [DBG] pgmap v10864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:03.497981+0000 mgr.smithi067.rdualw (mgr.24569) 12616 : cluster [DBG] pgmap v10864: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:06.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:05.498985+0000 mgr.smithi067.rdualw (mgr.24569) 12617 : cluster [DBG] pgmap v10865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:05.498985+0000 mgr.smithi067.rdualw (mgr.24569) 12617 : cluster [DBG] pgmap v10865: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:07.499635+0000 mgr.smithi067.rdualw (mgr.24569) 12618 : cluster [DBG] pgmap v10866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:07.499635+0000 mgr.smithi067.rdualw (mgr.24569) 12618 : cluster [DBG] pgmap v10866: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:09.500389+0000 mgr.smithi067.rdualw (mgr.24569) 12619 : cluster [DBG] pgmap v10867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:09.500389+0000 mgr.smithi067.rdualw (mgr.24569) 12619 : cluster [DBG] pgmap v10867: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:11.501225+0000 mgr.smithi067.rdualw (mgr.24569) 12620 : cluster [DBG] pgmap v10868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:11.501225+0000 mgr.smithi067.rdualw (mgr.24569) 12620 : cluster [DBG] pgmap v10868: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:13.905 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:31:12.846161+0000 mon.smithi067 (mon.1) 1902 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:31:13.906 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:31:12.847597+0000 mon.smithi067 (mon.1) 1903 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:31:13.906 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:31:12.848525+0000 mon.smithi067 (mon.1) 1904 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:31:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:31:12.846161+0000 mon.smithi067 (mon.1) 1902 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:31:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:31:12.847597+0000 mon.smithi067 (mon.1) 1903 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:31:14.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:31:12.848525+0000 mon.smithi067 (mon.1) 1904 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:31:15.021 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:31:12.849394+0000 mgr.smithi067.rdualw (mgr.24569) 12621 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:31:15.022 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:13.501742+0000 mgr.smithi067.rdualw (mgr.24569) 12622 : cluster [DBG] pgmap v10869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:31:12.849394+0000 mgr.smithi067.rdualw (mgr.24569) 12621 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:31:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:13.501742+0000 mgr.smithi067.rdualw (mgr.24569) 12622 : cluster [DBG] pgmap v10869: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:17.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:15.502806+0000 mgr.smithi067.rdualw (mgr.24569) 12623 : cluster [DBG] pgmap v10870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:17.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:31:15.756649+0000 mon.smithi061 (mon.0) 2620 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:31:17.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:31:16.166198+0000 mon.smithi061 (mon.0) 2621 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:31:17.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:31:16.173336+0000 mon.smithi061 (mon.0) 2622 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:31:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:15.502806+0000 mgr.smithi067.rdualw (mgr.24569) 12623 : cluster [DBG] pgmap v10870: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:17.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:31:15.756649+0000 mon.smithi061 (mon.0) 2620 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:31:17.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:31:16.166198+0000 mon.smithi061 (mon.0) 2621 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:31:17.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:31:16.173336+0000 mon.smithi061 (mon.0) 2622 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:31:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:17.503362+0000 mgr.smithi067.rdualw (mgr.24569) 12624 : cluster [DBG] pgmap v10871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:17.503362+0000 mgr.smithi067.rdualw (mgr.24569) 12624 : cluster [DBG] pgmap v10871: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:19.503980+0000 mgr.smithi067.rdualw (mgr.24569) 12625 : cluster [DBG] pgmap v10872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:19.503980+0000 mgr.smithi067.rdualw (mgr.24569) 12625 : cluster [DBG] pgmap v10872: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:21.504865+0000 mgr.smithi067.rdualw (mgr.24569) 12626 : cluster [DBG] pgmap v10873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:21.504865+0000 mgr.smithi067.rdualw (mgr.24569) 12626 : cluster [DBG] pgmap v10873: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:23.562 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:31:23.853 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:31:23.854 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 3m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:31:23.854 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 3m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:31:23.854 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 3m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:31:23.854 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 3m ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:31:23.855 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 3m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:31:23.855 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 3m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:31:23.855 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 3m ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:31:23.855 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 3m ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:31:23.855 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 3m ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:31:23.856 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 3m ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:31:23.856 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 3m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:31:23.856 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 3m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:31:23.856 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 3m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:31:23.857 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 3m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:31:23.857 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 3m ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:31:23.857 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 3m ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:31:23.857 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 3m ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:31:23.858 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 3m ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:31:23.858 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 3m ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:31:23.858 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 3m ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:31:23.858 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 3m ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:31:23.858 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 3m ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:31:23.859 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 3m ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:31:24.193 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:31:24.194 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:31:24.194 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:31:24.195 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:31:24.195 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:31:24.195 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:31:24.195 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:31:24.196 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:31:24.196 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:31:24.196 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:31:24.196 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:31:24.197 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:31:24.197 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:31:24.197 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:31:24.197 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:31:24.197 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:31:24.198 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:31:24.198 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:31:24.198 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:31:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:23.505392+0000 mgr.smithi067.rdualw (mgr.24569) 12627 : cluster [DBG] pgmap v10874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:31:23.548305+0000 mgr.smithi067.rdualw (mgr.24569) 12628 : audit [DBG] from='client.42562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:31:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:31:24.192242+0000 mon.smithi061 (mon.0) 2623 : audit [DBG] from='client.? 172.21.15.61:0/627431433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:31:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:23.505392+0000 mgr.smithi067.rdualw (mgr.24569) 12627 : cluster [DBG] pgmap v10874: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:31:23.548305+0000 mgr.smithi067.rdualw (mgr.24569) 12628 : audit [DBG] from='client.42562 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:31:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:31:24.192242+0000 mon.smithi061 (mon.0) 2623 : audit [DBG] from='client.? 172.21.15.61:0/627431433' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:31:26.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:25 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:31:23.835517+0000 mgr.smithi067.rdualw (mgr.24569) 12629 : audit [DBG] from='client.42566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:31:26.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:25 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:31:23.835517+0000 mgr.smithi067.rdualw (mgr.24569) 12629 : audit [DBG] from='client.42566 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:31:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:25.506183+0000 mgr.smithi067.rdualw (mgr.24569) 12630 : cluster [DBG] pgmap v10875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:25.506183+0000 mgr.smithi067.rdualw (mgr.24569) 12630 : cluster [DBG] pgmap v10875: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:27.506711+0000 mgr.smithi067.rdualw (mgr.24569) 12631 : cluster [DBG] pgmap v10876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:27.506711+0000 mgr.smithi067.rdualw (mgr.24569) 12631 : cluster [DBG] pgmap v10876: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:29.507441+0000 mgr.smithi067.rdualw (mgr.24569) 12632 : cluster [DBG] pgmap v10877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:29.507441+0000 mgr.smithi067.rdualw (mgr.24569) 12632 : cluster [DBG] pgmap v10877: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:31.508345+0000 mgr.smithi067.rdualw (mgr.24569) 12633 : cluster [DBG] pgmap v10878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:31.508345+0000 mgr.smithi067.rdualw (mgr.24569) 12633 : cluster [DBG] pgmap v10878: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:33.508900+0000 mgr.smithi067.rdualw (mgr.24569) 12634 : cluster [DBG] pgmap v10879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:33.508900+0000 mgr.smithi067.rdualw (mgr.24569) 12634 : cluster [DBG] pgmap v10879: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:35.509787+0000 mgr.smithi067.rdualw (mgr.24569) 12635 : cluster [DBG] pgmap v10880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:31:36.461669+0000 mon.smithi067 (mon.1) 1905 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:31:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:31:36.461900+0000 mon.smithi067 (mon.1) 1906 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:31:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:31:36.462206+0000 mon.smithi061 (mon.0) 2624 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:31:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:31:36.462445+0000 mon.smithi061 (mon.0) 2625 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:31:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:35.509787+0000 mgr.smithi067.rdualw (mgr.24569) 12635 : cluster [DBG] pgmap v10880: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:31:36.461669+0000 mon.smithi067 (mon.1) 1905 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:31:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:31:36.461900+0000 mon.smithi067 (mon.1) 1906 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:31:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:31:36.462206+0000 mon.smithi061 (mon.0) 2624 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:31:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:31:36.462445+0000 mon.smithi061 (mon.0) 2625 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:31:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:37.510316+0000 mgr.smithi067.rdualw (mgr.24569) 12636 : cluster [DBG] pgmap v10881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:37.510316+0000 mgr.smithi067.rdualw (mgr.24569) 12636 : cluster [DBG] pgmap v10881: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:39.510914+0000 mgr.smithi067.rdualw (mgr.24569) 12637 : cluster [DBG] pgmap v10882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:39.510914+0000 mgr.smithi067.rdualw (mgr.24569) 12637 : cluster [DBG] pgmap v10882: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:41.511817+0000 mgr.smithi067.rdualw (mgr.24569) 12638 : cluster [DBG] pgmap v10883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:41.511817+0000 mgr.smithi067.rdualw (mgr.24569) 12638 : cluster [DBG] pgmap v10883: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:43.512440+0000 mgr.smithi067.rdualw (mgr.24569) 12639 : cluster [DBG] pgmap v10884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:43.512440+0000 mgr.smithi067.rdualw (mgr.24569) 12639 : cluster [DBG] pgmap v10884: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:45.513293+0000 mgr.smithi067.rdualw (mgr.24569) 12640 : cluster [DBG] pgmap v10885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:45.513293+0000 mgr.smithi067.rdualw (mgr.24569) 12640 : cluster [DBG] pgmap v10885: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:47.514021+0000 mgr.smithi067.rdualw (mgr.24569) 12641 : cluster [DBG] pgmap v10886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:47.514021+0000 mgr.smithi067.rdualw (mgr.24569) 12641 : cluster [DBG] pgmap v10886: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:49.514801+0000 mgr.smithi067.rdualw (mgr.24569) 12642 : cluster [DBG] pgmap v10887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:49.514801+0000 mgr.smithi067.rdualw (mgr.24569) 12642 : cluster [DBG] pgmap v10887: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:51.515635+0000 mgr.smithi067.rdualw (mgr.24569) 12643 : cluster [DBG] pgmap v10888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:51.515635+0000 mgr.smithi067.rdualw (mgr.24569) 12643 : cluster [DBG] pgmap v10888: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:54.505 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:31:54.801 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:31:54.802 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 3m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:31:54.802 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 3m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:31:54.803 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 3m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:31:54.803 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 3m ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:31:54.803 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 3m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:31:54.803 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 3m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:31:54.804 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 3m ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:31:54.804 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 3m ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:31:54.804 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 3m ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:31:54.804 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 3m ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:31:54.805 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 3m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:31:54.805 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 3m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:31:54.805 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 3m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:31:54.805 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 3m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:31:54.805 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 3m ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:31:54.806 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 3m ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:31:54.806 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 3m ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:31:54.806 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 3m ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:31:54.806 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 3m ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:31:54.807 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 3m ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:31:54.807 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 3m ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:31:54.807 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 3m ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:31:54.807 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 3m ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:31:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:53.516119+0000 mgr.smithi067.rdualw (mgr.24569) 12644 : cluster [DBG] pgmap v10889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:53.516119+0000 mgr.smithi067.rdualw (mgr.24569) 12644 : cluster [DBG] pgmap v10889: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:55.167 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:31:55.168 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:31:55.168 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:31:55.168 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:31:55.169 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:31:55.169 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:31:55.169 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:31:55.169 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:31:55.169 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:31:55.170 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:31:55.170 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:31:55.170 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:31:55.170 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:31:55.171 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:31:55.171 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:31:55.171 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:31:55.171 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:31:55.171 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:31:55.172 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:31:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:31:54.491457+0000 mgr.smithi067.rdualw (mgr.24569) 12645 : audit [DBG] from='client.42574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:31:56.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:55 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:31:55.165976+0000 mon.smithi061 (mon.0) 2626 : audit [DBG] from='client.? 172.21.15.61:0/3001133505' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:31:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:31:54.491457+0000 mgr.smithi067.rdualw (mgr.24569) 12645 : audit [DBG] from='client.42574 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:31:56.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:55 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:31:55.165976+0000 mon.smithi061 (mon.0) 2626 : audit [DBG] from='client.? 172.21.15.61:0/3001133505' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:31:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:31:54.783833+0000 mgr.smithi067.rdualw (mgr.24569) 12646 : audit [DBG] from='client.42578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:31:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:55.517116+0000 mgr.smithi067.rdualw (mgr.24569) 12647 : cluster [DBG] pgmap v10890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:31:54.783833+0000 mgr.smithi067.rdualw (mgr.24569) 12646 : audit [DBG] from='client.42578 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:31:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:55.517116+0000 mgr.smithi067.rdualw (mgr.24569) 12647 : cluster [DBG] pgmap v10890: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:31:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:31:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:57.517585+0000 mgr.smithi067.rdualw (mgr.24569) 12648 : cluster [DBG] pgmap v10891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:31:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:31:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:57.517585+0000 mgr.smithi067.rdualw (mgr.24569) 12648 : cluster [DBG] pgmap v10891: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:31:59.518123+0000 mgr.smithi067.rdualw (mgr.24569) 12649 : cluster [DBG] pgmap v10892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:31:59.518123+0000 mgr.smithi067.rdualw (mgr.24569) 12649 : cluster [DBG] pgmap v10892: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:01.519145+0000 mgr.smithi067.rdualw (mgr.24569) 12650 : cluster [DBG] pgmap v10893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:01.519145+0000 mgr.smithi067.rdualw (mgr.24569) 12650 : cluster [DBG] pgmap v10893: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:03.519756+0000 mgr.smithi067.rdualw (mgr.24569) 12651 : cluster [DBG] pgmap v10894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:03.519756+0000 mgr.smithi067.rdualw (mgr.24569) 12651 : cluster [DBG] pgmap v10894: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:05.520692+0000 mgr.smithi067.rdualw (mgr.24569) 12652 : cluster [DBG] pgmap v10895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:05.520692+0000 mgr.smithi067.rdualw (mgr.24569) 12652 : cluster [DBG] pgmap v10895: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:07.521203+0000 mgr.smithi067.rdualw (mgr.24569) 12653 : cluster [DBG] pgmap v10896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:07.521203+0000 mgr.smithi067.rdualw (mgr.24569) 12653 : cluster [DBG] pgmap v10896: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:11.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:09.521926+0000 mgr.smithi067.rdualw (mgr.24569) 12654 : cluster [DBG] pgmap v10897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:09.521926+0000 mgr.smithi067.rdualw (mgr.24569) 12654 : cluster [DBG] pgmap v10897: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:11.522899+0000 mgr.smithi067.rdualw (mgr.24569) 12655 : cluster [DBG] pgmap v10898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:11.522899+0000 mgr.smithi067.rdualw (mgr.24569) 12655 : cluster [DBG] pgmap v10898: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:13.523452+0000 mgr.smithi067.rdualw (mgr.24569) 12656 : cluster [DBG] pgmap v10899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:13.523452+0000 mgr.smithi067.rdualw (mgr.24569) 12656 : cluster [DBG] pgmap v10899: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:17.012 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:15.524468+0000 mgr.smithi067.rdualw (mgr.24569) 12657 : cluster [DBG] pgmap v10900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:17.012 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:32:16.179854+0000 mon.smithi067 (mon.1) 1907 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:32:17.013 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:32:16.181336+0000 mon.smithi067 (mon.1) 1908 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:32:17.013 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:32:16.182301+0000 mon.smithi067 (mon.1) 1909 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:32:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:15.524468+0000 mgr.smithi067.rdualw (mgr.24569) 12657 : cluster [DBG] pgmap v10900: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:17.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:32:16.179854+0000 mon.smithi067 (mon.1) 1907 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:32:17.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:32:16.181336+0000 mon.smithi067 (mon.1) 1908 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:32:17.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:32:16.182301+0000 mon.smithi067 (mon.1) 1909 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:32:18.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:17 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:32:16.183208+0000 mgr.smithi067.rdualw (mgr.24569) 12658 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:32:18.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:17 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:32:16.183208+0000 mgr.smithi067.rdualw (mgr.24569) 12658 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:32:18.707 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:17.524901+0000 mgr.smithi067.rdualw (mgr.24569) 12659 : cluster [DBG] pgmap v10901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:19.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:17.524901+0000 mgr.smithi067.rdualw (mgr.24569) 12659 : cluster [DBG] pgmap v10901: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:32:19.096648+0000 mon.smithi061 (mon.0) 2627 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:32:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:32:19.503516+0000 mon.smithi061 (mon.0) 2628 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:32:20.552 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:32:19.512048+0000 mon.smithi061 (mon.0) 2629 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:32:20.553 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:19.525564+0000 mgr.smithi067.rdualw (mgr.24569) 12660 : cluster [DBG] pgmap v10902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:32:19.096648+0000 mon.smithi061 (mon.0) 2627 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:32:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:32:19.503516+0000 mon.smithi061 (mon.0) 2628 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:32:20.566 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:32:19.512048+0000 mon.smithi061 (mon.0) 2629 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:32:20.567 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:19.525564+0000 mgr.smithi067.rdualw (mgr.24569) 12660 : cluster [DBG] pgmap v10902: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:21.526340+0000 mgr.smithi067.rdualw (mgr.24569) 12661 : cluster [DBG] pgmap v10903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:21.526340+0000 mgr.smithi067.rdualw (mgr.24569) 12661 : cluster [DBG] pgmap v10903: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:23.527068+0000 mgr.smithi067.rdualw (mgr.24569) 12662 : cluster [DBG] pgmap v10904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:23.527068+0000 mgr.smithi067.rdualw (mgr.24569) 12662 : cluster [DBG] pgmap v10904: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:25.479 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:32:25.771 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:32:25.771 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 4m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:32:25.772 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 4m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:32:25.772 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 4m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:32:25.772 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 4m ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:32:25.772 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 4m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:32:25.772 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 4m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:32:25.773 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 4m ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:32:25.773 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 4m ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:32:25.773 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 4m ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:32:25.773 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 4m ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:32:25.774 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 4m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:32:25.774 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 4m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:32:25.774 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 4m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:32:25.774 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 4m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:32:25.774 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 4m ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:32:25.775 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 4m ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:32:25.775 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 4m ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:32:25.775 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 4m ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:32:25.775 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 4m ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:32:25.776 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 4m ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:32:25.776 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 4m ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:32:25.776 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 4m ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:32:25.776 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 4m ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:32:26.113 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:32:26.114 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:32:26.114 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:32:26.114 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:32:26.115 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:32:26.115 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:32:26.115 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:32:26.115 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:32:26.116 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:32:26.116 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:32:26.116 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:32:26.116 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:32:26.117 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:32:26.117 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:32:26.117 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:32:26.117 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:32:26.118 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:32:26.118 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:32:26.118 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:32:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:32:25.464221+0000 mgr.smithi067.rdualw (mgr.24569) 12663 : audit [DBG] from='client.42586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:32:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:25.527919+0000 mgr.smithi067.rdualw (mgr.24569) 12664 : cluster [DBG] pgmap v10905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:27.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:32:26.111932+0000 mon.smithi061 (mon.0) 2630 : audit [DBG] from='client.? 172.21.15.61:0/1100718723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:32:27.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:32:25.464221+0000 mgr.smithi067.rdualw (mgr.24569) 12663 : audit [DBG] from='client.42586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:32:27.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:25.527919+0000 mgr.smithi067.rdualw (mgr.24569) 12664 : cluster [DBG] pgmap v10905: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:27.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:32:26.111932+0000 mon.smithi061 (mon.0) 2630 : audit [DBG] from='client.? 172.21.15.61:0/1100718723' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:32:28.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:32:25.753068+0000 mgr.smithi067.rdualw (mgr.24569) 12665 : audit [DBG] from='client.42590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:32:28.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:32:25.753068+0000 mgr.smithi067.rdualw (mgr.24569) 12665 : audit [DBG] from='client.42590 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:32:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:27.528409+0000 mgr.smithi067.rdualw (mgr.24569) 12666 : cluster [DBG] pgmap v10906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:27.528409+0000 mgr.smithi067.rdualw (mgr.24569) 12666 : cluster [DBG] pgmap v10906: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:29.529005+0000 mgr.smithi067.rdualw (mgr.24569) 12667 : cluster [DBG] pgmap v10907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:29.529005+0000 mgr.smithi067.rdualw (mgr.24569) 12667 : cluster [DBG] pgmap v10907: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:31.529960+0000 mgr.smithi067.rdualw (mgr.24569) 12668 : cluster [DBG] pgmap v10908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:31.529960+0000 mgr.smithi067.rdualw (mgr.24569) 12668 : cluster [DBG] pgmap v10908: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:33.530484+0000 mgr.smithi067.rdualw (mgr.24569) 12669 : cluster [DBG] pgmap v10909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:33.530484+0000 mgr.smithi067.rdualw (mgr.24569) 12669 : cluster [DBG] pgmap v10909: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:35.531311+0000 mgr.smithi067.rdualw (mgr.24569) 12670 : cluster [DBG] pgmap v10910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:32:36.467271+0000 mon.smithi067 (mon.1) 1910 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:32:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:32:36.467543+0000 mon.smithi067 (mon.1) 1911 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:32:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:32:36.467724+0000 mon.smithi061 (mon.0) 2631 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:32:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:32:36.468007+0000 mon.smithi061 (mon.0) 2632 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:32:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:35.531311+0000 mgr.smithi067.rdualw (mgr.24569) 12670 : cluster [DBG] pgmap v10910: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:32:36.467271+0000 mon.smithi067 (mon.1) 1910 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:32:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:32:36.467543+0000 mon.smithi067 (mon.1) 1911 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:32:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:32:36.467724+0000 mon.smithi061 (mon.0) 2631 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:32:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:32:36.468007+0000 mon.smithi061 (mon.0) 2632 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:32:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:37.531841+0000 mgr.smithi067.rdualw (mgr.24569) 12671 : cluster [DBG] pgmap v10911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:37.531841+0000 mgr.smithi067.rdualw (mgr.24569) 12671 : cluster [DBG] pgmap v10911: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:39.532455+0000 mgr.smithi067.rdualw (mgr.24569) 12672 : cluster [DBG] pgmap v10912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:41.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:39.532455+0000 mgr.smithi067.rdualw (mgr.24569) 12672 : cluster [DBG] pgmap v10912: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:41.533330+0000 mgr.smithi067.rdualw (mgr.24569) 12673 : cluster [DBG] pgmap v10913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:41.533330+0000 mgr.smithi067.rdualw (mgr.24569) 12673 : cluster [DBG] pgmap v10913: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:43.534070+0000 mgr.smithi067.rdualw (mgr.24569) 12674 : cluster [DBG] pgmap v10914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:43.534070+0000 mgr.smithi067.rdualw (mgr.24569) 12674 : cluster [DBG] pgmap v10914: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:45.534997+0000 mgr.smithi067.rdualw (mgr.24569) 12675 : cluster [DBG] pgmap v10915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:45.534997+0000 mgr.smithi067.rdualw (mgr.24569) 12675 : cluster [DBG] pgmap v10915: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:47.535553+0000 mgr.smithi067.rdualw (mgr.24569) 12676 : cluster [DBG] pgmap v10916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:47.535553+0000 mgr.smithi067.rdualw (mgr.24569) 12676 : cluster [DBG] pgmap v10916: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:51.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:49.536307+0000 mgr.smithi067.rdualw (mgr.24569) 12677 : cluster [DBG] pgmap v10917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:49.536307+0000 mgr.smithi067.rdualw (mgr.24569) 12677 : cluster [DBG] pgmap v10917: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:51.537351+0000 mgr.smithi067.rdualw (mgr.24569) 12678 : cluster [DBG] pgmap v10918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:51.537351+0000 mgr.smithi067.rdualw (mgr.24569) 12678 : cluster [DBG] pgmap v10918: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:53.537908+0000 mgr.smithi067.rdualw (mgr.24569) 12679 : cluster [DBG] pgmap v10919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:53.537908+0000 mgr.smithi067.rdualw (mgr.24569) 12679 : cluster [DBG] pgmap v10919: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:56.419 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:32:56.710 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:32:56.710 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 4m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:32:56.711 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 4m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:32:56.711 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 4m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:32:56.711 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 4m ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:32:56.711 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 4m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:32:56.712 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 4m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:32:56.712 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 4m ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:32:56.712 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 4m ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:32:56.712 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 4m ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:32:56.713 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 4m ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:32:56.713 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 4m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:32:56.713 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 4m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:32:56.713 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 4m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:32:56.713 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 4m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:32:56.714 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 4m ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:32:56.714 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 4m ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:32:56.714 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 4m ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:32:56.715 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 4m ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:32:56.715 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 4m ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:32:56.715 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 4m ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:32:56.715 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 4m ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:32:56.716 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 4m ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:32:56.716 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 4m ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:32:57.050 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:32:57.051 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:32:57.051 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:32:57.051 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:32:57.052 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:32:57.052 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:32:57.052 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:32:57.052 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:32:57.053 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:32:57.053 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:32:57.053 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:32:57.053 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:32:57.053 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:32:57.054 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:32:57.054 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:32:57.054 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:32:57.054 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:32:57.054 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:32:57.055 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:32:57.055 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:55.538778+0000 mgr.smithi067.rdualw (mgr.24569) 12680 : cluster [DBG] pgmap v10920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:57.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:55.538778+0000 mgr.smithi067.rdualw (mgr.24569) 12680 : cluster [DBG] pgmap v10920: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:32:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:32:56.405925+0000 mgr.smithi067.rdualw (mgr.24569) 12681 : audit [DBG] from='client.42598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:32:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:32:56.692132+0000 mgr.smithi067.rdualw (mgr.24569) 12682 : audit [DBG] from='client.42602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:32:58.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:57 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:32:57.048843+0000 mon.smithi061 (mon.0) 2633 : audit [DBG] from='client.? 172.21.15.61:0/2624989049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:32:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:32:56.405925+0000 mgr.smithi067.rdualw (mgr.24569) 12681 : audit [DBG] from='client.42598 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:32:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:32:56.692132+0000 mgr.smithi067.rdualw (mgr.24569) 12682 : audit [DBG] from='client.42602 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:32:58.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:57 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:32:57.048843+0000 mon.smithi061 (mon.0) 2633 : audit [DBG] from='client.? 172.21.15.61:0/2624989049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:32:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:32:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:57.539425+0000 mgr.smithi067.rdualw (mgr.24569) 12683 : cluster [DBG] pgmap v10921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:32:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:32:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:57.539425+0000 mgr.smithi067.rdualw (mgr.24569) 12683 : cluster [DBG] pgmap v10921: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:32:59.539974+0000 mgr.smithi067.rdualw (mgr.24569) 12684 : cluster [DBG] pgmap v10922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:32:59.539974+0000 mgr.smithi067.rdualw (mgr.24569) 12684 : cluster [DBG] pgmap v10922: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:01.540824+0000 mgr.smithi067.rdualw (mgr.24569) 12685 : cluster [DBG] pgmap v10923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:01.540824+0000 mgr.smithi067.rdualw (mgr.24569) 12685 : cluster [DBG] pgmap v10923: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:03.541517+0000 mgr.smithi067.rdualw (mgr.24569) 12686 : cluster [DBG] pgmap v10924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:03.541517+0000 mgr.smithi067.rdualw (mgr.24569) 12686 : cluster [DBG] pgmap v10924: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:05.542380+0000 mgr.smithi067.rdualw (mgr.24569) 12687 : cluster [DBG] pgmap v10925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:05.542380+0000 mgr.smithi067.rdualw (mgr.24569) 12687 : cluster [DBG] pgmap v10925: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:07.542971+0000 mgr.smithi067.rdualw (mgr.24569) 12688 : cluster [DBG] pgmap v10926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:07.542971+0000 mgr.smithi067.rdualw (mgr.24569) 12688 : cluster [DBG] pgmap v10926: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:09.543578+0000 mgr.smithi067.rdualw (mgr.24569) 12689 : cluster [DBG] pgmap v10927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:09.543578+0000 mgr.smithi067.rdualw (mgr.24569) 12689 : cluster [DBG] pgmap v10927: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:11.544439+0000 mgr.smithi067.rdualw (mgr.24569) 12690 : cluster [DBG] pgmap v10928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:11.544439+0000 mgr.smithi067.rdualw (mgr.24569) 12690 : cluster [DBG] pgmap v10928: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:13.544948+0000 mgr.smithi067.rdualw (mgr.24569) 12691 : cluster [DBG] pgmap v10929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:13.544948+0000 mgr.smithi067.rdualw (mgr.24569) 12691 : cluster [DBG] pgmap v10929: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:15.545818+0000 mgr.smithi067.rdualw (mgr.24569) 12692 : cluster [DBG] pgmap v10930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:15.545818+0000 mgr.smithi067.rdualw (mgr.24569) 12692 : cluster [DBG] pgmap v10930: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:17.546309+0000 mgr.smithi067.rdualw (mgr.24569) 12693 : cluster [DBG] pgmap v10931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:17.546309+0000 mgr.smithi067.rdualw (mgr.24569) 12693 : cluster [DBG] pgmap v10931: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:33:19.515633+0000 mon.smithi067 (mon.1) 1912 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:33:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:33:19.517086+0000 mon.smithi067 (mon.1) 1913 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:33:20.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:19 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:33:19.518108+0000 mon.smithi067 (mon.1) 1914 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:33:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:33:19.515633+0000 mon.smithi067 (mon.1) 1912 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:33:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:33:19.517086+0000 mon.smithi067 (mon.1) 1913 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:33:20.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:19 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:33:19.518108+0000 mon.smithi067 (mon.1) 1914 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:33:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:33:19.518992+0000 mgr.smithi067.rdualw (mgr.24569) 12694 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:33:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:19.546904+0000 mgr.smithi067.rdualw (mgr.24569) 12695 : cluster [DBG] pgmap v10932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:21.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:33:19.954535+0000 mon.smithi061 (mon.0) 2634 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:33:21.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:33:19.962609+0000 mon.smithi061 (mon.0) 2635 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:33:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:33:19.518992+0000 mgr.smithi067.rdualw (mgr.24569) 12694 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:33:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:19.546904+0000 mgr.smithi067.rdualw (mgr.24569) 12695 : cluster [DBG] pgmap v10932: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:21.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:33:19.954535+0000 mon.smithi061 (mon.0) 2634 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:33:21.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:33:19.962609+0000 mon.smithi061 (mon.0) 2635 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:33:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:21.547843+0000 mgr.smithi067.rdualw (mgr.24569) 12696 : cluster [DBG] pgmap v10933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:21.547843+0000 mgr.smithi067.rdualw (mgr.24569) 12696 : cluster [DBG] pgmap v10933: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:23.548455+0000 mgr.smithi067.rdualw (mgr.24569) 12697 : cluster [DBG] pgmap v10934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:23.548455+0000 mgr.smithi067.rdualw (mgr.24569) 12697 : cluster [DBG] pgmap v10934: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:25.549414+0000 mgr.smithi067.rdualw (mgr.24569) 12698 : cluster [DBG] pgmap v10935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:25.549414+0000 mgr.smithi067.rdualw (mgr.24569) 12698 : cluster [DBG] pgmap v10935: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:27.359 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:33:27.653 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:33:27.653 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 5m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:33:27.654 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 5m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:33:27.654 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 5m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:33:27.654 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 5m ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:33:27.654 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 5m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:33:27.655 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 5m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:33:27.655 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 5m ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:33:27.655 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 5m ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:33:27.655 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 5m ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:33:27.655 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 5m ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:33:27.656 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 5m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:33:27.656 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 5m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:33:27.656 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 5m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:33:27.656 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 5m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:33:27.656 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 5m ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:33:27.657 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 5m ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:33:27.657 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 5m ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:33:27.657 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 5m ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:33:27.657 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 5m ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:33:27.658 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 5m ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:33:27.658 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 5m ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:33:27.658 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 5m ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:33:27.658 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 5m ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:33:27.997 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:33:27.998 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:33:27.998 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:33:27.998 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:33:27.999 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:33:27.999 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:33:27.999 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:33:27.999 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:33:28.000 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:33:28.000 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:33:28.000 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:33:28.000 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:33:28.001 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:33:28.001 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:33:28.001 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:33:28.001 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:33:28.001 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:33:28.002 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:33:28.002 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:33:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:33:27.343037+0000 mgr.smithi067.rdualw (mgr.24569) 12699 : audit [DBG] from='client.42610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:33:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:27.549918+0000 mgr.smithi067.rdualw (mgr.24569) 12700 : cluster [DBG] pgmap v10936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:29.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:33:27.635277+0000 mgr.smithi067.rdualw (mgr.24569) 12701 : audit [DBG] from='client.42614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:33:29.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:33:27.996010+0000 mon.smithi061 (mon.0) 2636 : audit [DBG] from='client.? 172.21.15.61:0/1226352264' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:33:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:33:27.343037+0000 mgr.smithi067.rdualw (mgr.24569) 12699 : audit [DBG] from='client.42610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:33:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:27.549918+0000 mgr.smithi067.rdualw (mgr.24569) 12700 : cluster [DBG] pgmap v10936: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:29.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:33:27.635277+0000 mgr.smithi067.rdualw (mgr.24569) 12701 : audit [DBG] from='client.42614 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:33:29.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:33:27.996010+0000 mon.smithi061 (mon.0) 2636 : audit [DBG] from='client.? 172.21.15.61:0/1226352264' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:33:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:29.550621+0000 mgr.smithi067.rdualw (mgr.24569) 12702 : cluster [DBG] pgmap v10937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:29.550621+0000 mgr.smithi067.rdualw (mgr.24569) 12702 : cluster [DBG] pgmap v10937: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:31.551530+0000 mgr.smithi067.rdualw (mgr.24569) 12703 : cluster [DBG] pgmap v10938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:31.551530+0000 mgr.smithi067.rdualw (mgr.24569) 12703 : cluster [DBG] pgmap v10938: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:33.552113+0000 mgr.smithi067.rdualw (mgr.24569) 12704 : cluster [DBG] pgmap v10939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:33.552113+0000 mgr.smithi067.rdualw (mgr.24569) 12704 : cluster [DBG] pgmap v10939: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:35.552961+0000 mgr.smithi067.rdualw (mgr.24569) 12705 : cluster [DBG] pgmap v10940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:33:36.473087+0000 mon.smithi067 (mon.1) 1915 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:33:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:33:36.473420+0000 mon.smithi067 (mon.1) 1916 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:33:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:33:36.473676+0000 mon.smithi061 (mon.0) 2637 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:33:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:33:36.474325+0000 mon.smithi061 (mon.0) 2638 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:33:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:35.552961+0000 mgr.smithi067.rdualw (mgr.24569) 12705 : cluster [DBG] pgmap v10940: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:33:36.473087+0000 mon.smithi067 (mon.1) 1915 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:33:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:33:36.473420+0000 mon.smithi067 (mon.1) 1916 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:33:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:33:36.473676+0000 mon.smithi061 (mon.0) 2637 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:33:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:33:36.474325+0000 mon.smithi061 (mon.0) 2638 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:33:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:37.553680+0000 mgr.smithi067.rdualw (mgr.24569) 12706 : cluster [DBG] pgmap v10941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:37.553680+0000 mgr.smithi067.rdualw (mgr.24569) 12706 : cluster [DBG] pgmap v10941: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:39.554401+0000 mgr.smithi067.rdualw (mgr.24569) 12707 : cluster [DBG] pgmap v10942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:39.554401+0000 mgr.smithi067.rdualw (mgr.24569) 12707 : cluster [DBG] pgmap v10942: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:41.555340+0000 mgr.smithi067.rdualw (mgr.24569) 12708 : cluster [DBG] pgmap v10943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:41.555340+0000 mgr.smithi067.rdualw (mgr.24569) 12708 : cluster [DBG] pgmap v10943: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:43.556068+0000 mgr.smithi067.rdualw (mgr.24569) 12709 : cluster [DBG] pgmap v10944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:43.556068+0000 mgr.smithi067.rdualw (mgr.24569) 12709 : cluster [DBG] pgmap v10944: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:45.556959+0000 mgr.smithi067.rdualw (mgr.24569) 12710 : cluster [DBG] pgmap v10945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:45.556959+0000 mgr.smithi067.rdualw (mgr.24569) 12710 : cluster [DBG] pgmap v10945: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:47.557547+0000 mgr.smithi067.rdualw (mgr.24569) 12711 : cluster [DBG] pgmap v10946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:47.557547+0000 mgr.smithi067.rdualw (mgr.24569) 12711 : cluster [DBG] pgmap v10946: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:49.558125+0000 mgr.smithi067.rdualw (mgr.24569) 12712 : cluster [DBG] pgmap v10947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:49.558125+0000 mgr.smithi067.rdualw (mgr.24569) 12712 : cluster [DBG] pgmap v10947: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:51.559253+0000 mgr.smithi067.rdualw (mgr.24569) 12713 : cluster [DBG] pgmap v10948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:51.559253+0000 mgr.smithi067.rdualw (mgr.24569) 12713 : cluster [DBG] pgmap v10948: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:53.559754+0000 mgr.smithi067.rdualw (mgr.24569) 12714 : cluster [DBG] pgmap v10949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:53.559754+0000 mgr.smithi067.rdualw (mgr.24569) 12714 : cluster [DBG] pgmap v10949: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:55.560660+0000 mgr.smithi067.rdualw (mgr.24569) 12715 : cluster [DBG] pgmap v10950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:55.560660+0000 mgr.smithi067.rdualw (mgr.24569) 12715 : cluster [DBG] pgmap v10950: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:33:58.310 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:33:58.601 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:33:58.602 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 5m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:33:58.602 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 5m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:33:58.602 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 5m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:33:58.603 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 5m ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:33:58.603 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 5m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:33:58.603 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 5m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:33:58.603 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 5m ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:33:58.604 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 5m ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:33:58.604 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 5m ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:33:58.604 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 5m ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:33:58.604 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 5m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:33:58.604 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 5m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:33:58.605 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 5m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:33:58.605 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 5m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:33:58.605 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 5m ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:33:58.605 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 5m ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:33:58.606 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 5m ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:33:58.606 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 5m ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:33:58.606 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 5m ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:33:58.606 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 5m ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:33:58.607 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 5m ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:33:58.607 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 5m ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:33:58.607 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 5m ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:33:58.962 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:33:58.962 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:33:58.963 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:33:58.963 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:33:58.964 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:33:58.964 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:33:58.964 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:33:58.965 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:33:58.965 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:33:58.966 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:33:58.966 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:33:58.966 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:33:58.967 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:33:58.967 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:33:58.968 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:33:58.968 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:33:58.968 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:33:58.969 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:33:58.969 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:33:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:57.561130+0000 mgr.smithi067.rdualw (mgr.24569) 12716 : cluster [DBG] pgmap v10951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:33:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:57.561130+0000 mgr.smithi067.rdualw (mgr.24569) 12716 : cluster [DBG] pgmap v10951: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:33:58.294064+0000 mgr.smithi067.rdualw (mgr.24569) 12717 : audit [DBG] from='client.42622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:34:00.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:33:58.583151+0000 mgr.smithi067.rdualw (mgr.24569) 12718 : audit [DBG] from='client.42626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:34:00.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:33:59 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:33:58.959966+0000 mon.smithi061 (mon.0) 2639 : audit [DBG] from='client.? 172.21.15.61:0/281185001' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:34:00.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:33:58.294064+0000 mgr.smithi067.rdualw (mgr.24569) 12717 : audit [DBG] from='client.42622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:34:00.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:33:58.583151+0000 mgr.smithi067.rdualw (mgr.24569) 12718 : audit [DBG] from='client.42626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:34:00.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:33:59 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:33:58.959966+0000 mon.smithi061 (mon.0) 2639 : audit [DBG] from='client.? 172.21.15.61:0/281185001' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:34:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:33:59.561728+0000 mgr.smithi067.rdualw (mgr.24569) 12719 : cluster [DBG] pgmap v10952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:33:59.561728+0000 mgr.smithi067.rdualw (mgr.24569) 12719 : cluster [DBG] pgmap v10952: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:01.562825+0000 mgr.smithi067.rdualw (mgr.24569) 12720 : cluster [DBG] pgmap v10953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:01.562825+0000 mgr.smithi067.rdualw (mgr.24569) 12720 : cluster [DBG] pgmap v10953: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:03.563466+0000 mgr.smithi067.rdualw (mgr.24569) 12721 : cluster [DBG] pgmap v10954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:03.563466+0000 mgr.smithi067.rdualw (mgr.24569) 12721 : cluster [DBG] pgmap v10954: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:05.564274+0000 mgr.smithi067.rdualw (mgr.24569) 12722 : cluster [DBG] pgmap v10955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:05.564274+0000 mgr.smithi067.rdualw (mgr.24569) 12722 : cluster [DBG] pgmap v10955: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:07.564875+0000 mgr.smithi067.rdualw (mgr.24569) 12723 : cluster [DBG] pgmap v10956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:07.564875+0000 mgr.smithi067.rdualw (mgr.24569) 12723 : cluster [DBG] pgmap v10956: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:09.565605+0000 mgr.smithi067.rdualw (mgr.24569) 12724 : cluster [DBG] pgmap v10957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:09.565605+0000 mgr.smithi067.rdualw (mgr.24569) 12724 : cluster [DBG] pgmap v10957: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:11.566502+0000 mgr.smithi067.rdualw (mgr.24569) 12725 : cluster [DBG] pgmap v10958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:11.566502+0000 mgr.smithi067.rdualw (mgr.24569) 12725 : cluster [DBG] pgmap v10958: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:13.567028+0000 mgr.smithi067.rdualw (mgr.24569) 12726 : cluster [DBG] pgmap v10959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:13.567028+0000 mgr.smithi067.rdualw (mgr.24569) 12726 : cluster [DBG] pgmap v10959: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:15.568048+0000 mgr.smithi067.rdualw (mgr.24569) 12727 : cluster [DBG] pgmap v10960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:15.568048+0000 mgr.smithi067.rdualw (mgr.24569) 12727 : cluster [DBG] pgmap v10960: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:17.568743+0000 mgr.smithi067.rdualw (mgr.24569) 12728 : cluster [DBG] pgmap v10961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:19.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:17.568743+0000 mgr.smithi067.rdualw (mgr.24569) 12728 : cluster [DBG] pgmap v10961: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:19.569294+0000 mgr.smithi067.rdualw (mgr.24569) 12729 : cluster [DBG] pgmap v10962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:34:19.965664+0000 mon.smithi067 (mon.1) 1917 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:34:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:34:19.967088+0000 mon.smithi067 (mon.1) 1918 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:34:21.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:34:19.968020+0000 mon.smithi067 (mon.1) 1919 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:34:21.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:34:20.385991+0000 mon.smithi061 (mon.0) 2640 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:34:21.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:34:20.391379+0000 mon.smithi061 (mon.0) 2641 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:34:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:19.569294+0000 mgr.smithi067.rdualw (mgr.24569) 12729 : cluster [DBG] pgmap v10962: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:34:19.965664+0000 mon.smithi067 (mon.1) 1917 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:34:21.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:34:19.967088+0000 mon.smithi067 (mon.1) 1918 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:34:21.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:34:19.968020+0000 mon.smithi067 (mon.1) 1919 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:34:21.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:34:20.385991+0000 mon.smithi061 (mon.0) 2640 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:34:21.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:34:20.391379+0000 mon.smithi061 (mon.0) 2641 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:34:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:34:19.968854+0000 mgr.smithi067.rdualw (mgr.24569) 12730 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:34:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:34:19.968854+0000 mgr.smithi067.rdualw (mgr.24569) 12730 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:34:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:21.570358+0000 mgr.smithi067.rdualw (mgr.24569) 12731 : cluster [DBG] pgmap v10963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:21.570358+0000 mgr.smithi067.rdualw (mgr.24569) 12731 : cluster [DBG] pgmap v10963: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:23.570979+0000 mgr.smithi067.rdualw (mgr.24569) 12732 : cluster [DBG] pgmap v10964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:23.570979+0000 mgr.smithi067.rdualw (mgr.24569) 12732 : cluster [DBG] pgmap v10964: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:25.571868+0000 mgr.smithi067.rdualw (mgr.24569) 12733 : cluster [DBG] pgmap v10965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:25.571868+0000 mgr.smithi067.rdualw (mgr.24569) 12733 : cluster [DBG] pgmap v10965: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:27.572392+0000 mgr.smithi067.rdualw (mgr.24569) 12734 : cluster [DBG] pgmap v10966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:27.572392+0000 mgr.smithi067.rdualw (mgr.24569) 12734 : cluster [DBG] pgmap v10966: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:29.268 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:34:29.559 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:34:29.560 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 6m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:34:29.560 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 6m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:34:29.560 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 6m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:34:29.561 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 6m ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:34:29.561 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 6m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:34:29.561 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 6m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:34:29.561 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 6m ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:34:29.561 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 6m ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:34:29.562 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 6m ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:34:29.562 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 6m ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:34:29.562 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 6m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:34:29.562 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 6m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:34:29.563 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 6m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:34:29.563 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 6m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:34:29.563 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 6m ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:34:29.563 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 6m ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:34:29.564 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 6m ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:34:29.564 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 6m ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:34:29.564 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 6m ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:34:29.564 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 6m ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:34:29.564 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 6m ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:34:29.565 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 6m ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:34:29.565 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 6m ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:34:29.931 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:34:29.932 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:34:29.932 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:34:29.932 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:34:29.933 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:34:29.933 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:34:29.933 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:34:29.933 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:34:29.934 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:34:29.934 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:34:29.934 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:34:29.934 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:34:29.934 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:34:29.935 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:34:29.935 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:34:29.935 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:34:29.935 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:34:29.936 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:34:29.936 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:34:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:34:29.254442+0000 mgr.smithi067.rdualw (mgr.24569) 12735 : audit [DBG] from='client.42634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:34:31.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:34:29.541700+0000 mgr.smithi067.rdualw (mgr.24569) 12736 : audit [DBG] from='client.42638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:34:31.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:29.573116+0000 mgr.smithi067.rdualw (mgr.24569) 12737 : cluster [DBG] pgmap v10967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:31.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:34:29.929753+0000 mon.smithi061 (mon.0) 2642 : audit [DBG] from='client.? 172.21.15.61:0/662549441' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:34:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:34:29.254442+0000 mgr.smithi067.rdualw (mgr.24569) 12735 : audit [DBG] from='client.42634 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:34:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:34:29.541700+0000 mgr.smithi067.rdualw (mgr.24569) 12736 : audit [DBG] from='client.42638 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:34:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:29.573116+0000 mgr.smithi067.rdualw (mgr.24569) 12737 : cluster [DBG] pgmap v10967: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:31.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:34:29.929753+0000 mon.smithi061 (mon.0) 2642 : audit [DBG] from='client.? 172.21.15.61:0/662549441' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:34:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:31.574247+0000 mgr.smithi067.rdualw (mgr.24569) 12738 : cluster [DBG] pgmap v10968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:31.574247+0000 mgr.smithi067.rdualw (mgr.24569) 12738 : cluster [DBG] pgmap v10968: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:33.574747+0000 mgr.smithi067.rdualw (mgr.24569) 12739 : cluster [DBG] pgmap v10969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:33.574747+0000 mgr.smithi067.rdualw (mgr.24569) 12739 : cluster [DBG] pgmap v10969: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:35.575687+0000 mgr.smithi067.rdualw (mgr.24569) 12740 : cluster [DBG] pgmap v10970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:34:36.478066+0000 mon.smithi067 (mon.1) 1920 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:34:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:34:36.478438+0000 mon.smithi067 (mon.1) 1921 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:34:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:34:36.478608+0000 mon.smithi061 (mon.0) 2643 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:34:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:34:36.478860+0000 mon.smithi061 (mon.0) 2644 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:34:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:35.575687+0000 mgr.smithi067.rdualw (mgr.24569) 12740 : cluster [DBG] pgmap v10970: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:34:36.478066+0000 mon.smithi067 (mon.1) 1920 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:34:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:34:36.478438+0000 mon.smithi067 (mon.1) 1921 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:34:37.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:34:36.478608+0000 mon.smithi061 (mon.0) 2643 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:34:37.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:34:36.478860+0000 mon.smithi061 (mon.0) 2644 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:34:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:37.576379+0000 mgr.smithi067.rdualw (mgr.24569) 12741 : cluster [DBG] pgmap v10971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:37.576379+0000 mgr.smithi067.rdualw (mgr.24569) 12741 : cluster [DBG] pgmap v10971: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:39.576901+0000 mgr.smithi067.rdualw (mgr.24569) 12742 : cluster [DBG] pgmap v10972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:39.576901+0000 mgr.smithi067.rdualw (mgr.24569) 12742 : cluster [DBG] pgmap v10972: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:41.577988+0000 mgr.smithi067.rdualw (mgr.24569) 12743 : cluster [DBG] pgmap v10973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:41.577988+0000 mgr.smithi067.rdualw (mgr.24569) 12743 : cluster [DBG] pgmap v10973: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:43.578698+0000 mgr.smithi067.rdualw (mgr.24569) 12744 : cluster [DBG] pgmap v10974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:43.578698+0000 mgr.smithi067.rdualw (mgr.24569) 12744 : cluster [DBG] pgmap v10974: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:45.579476+0000 mgr.smithi067.rdualw (mgr.24569) 12745 : cluster [DBG] pgmap v10975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:45.579476+0000 mgr.smithi067.rdualw (mgr.24569) 12745 : cluster [DBG] pgmap v10975: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:47.579952+0000 mgr.smithi067.rdualw (mgr.24569) 12746 : cluster [DBG] pgmap v10976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:47.579952+0000 mgr.smithi067.rdualw (mgr.24569) 12746 : cluster [DBG] pgmap v10976: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:49.580649+0000 mgr.smithi067.rdualw (mgr.24569) 12747 : cluster [DBG] pgmap v10977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:49.580649+0000 mgr.smithi067.rdualw (mgr.24569) 12747 : cluster [DBG] pgmap v10977: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:51.581518+0000 mgr.smithi067.rdualw (mgr.24569) 12748 : cluster [DBG] pgmap v10978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:51.581518+0000 mgr.smithi067.rdualw (mgr.24569) 12748 : cluster [DBG] pgmap v10978: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:53.582289+0000 mgr.smithi067.rdualw (mgr.24569) 12749 : cluster [DBG] pgmap v10979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:53.582289+0000 mgr.smithi067.rdualw (mgr.24569) 12749 : cluster [DBG] pgmap v10979: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:55.583275+0000 mgr.smithi067.rdualw (mgr.24569) 12750 : cluster [DBG] pgmap v10980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:55.583275+0000 mgr.smithi067.rdualw (mgr.24569) 12750 : cluster [DBG] pgmap v10980: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:34:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:34:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:57.583958+0000 mgr.smithi067.rdualw (mgr.24569) 12751 : cluster [DBG] pgmap v10981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:34:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:34:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:57.583958+0000 mgr.smithi067.rdualw (mgr.24569) 12751 : cluster [DBG] pgmap v10981: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:00.238 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:35:00.529 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:35:00.530 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 6m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:35:00.530 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 6m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:35:00.530 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 6m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:35:00.530 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 6m ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:35:00.531 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 6m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:35:00.531 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 6m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:35:00.531 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 6m ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:35:00.531 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 6m ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:35:00.532 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 6m ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:35:00.532 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 6m ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:35:00.532 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 6m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:35:00.532 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 6m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:35:00.532 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 6m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:35:00.533 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 6m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:35:00.533 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 6m ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:35:00.533 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 6m ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:35:00.533 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 6m ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:35:00.534 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 6m ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:35:00.534 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 6m ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:35:00.534 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 6m ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:35:00.534 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 6m ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:35:00.535 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 6m ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:35:00.535 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 6m ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:35:00.874 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:35:00.874 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:35:00.874 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:35:00.875 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:35:00.875 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:35:00.875 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:35:00.876 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:35:00.876 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:35:00.876 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:35:00.876 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:35:00.877 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:35:00.877 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:35:00.878 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:35:00.878 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:35:00.878 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:35:00.878 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:35:00.879 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:35:00.879 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:35:00.879 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:35:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:34:59.584557+0000 mgr.smithi067.rdualw (mgr.24569) 12752 : cluster [DBG] pgmap v10982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:34:59.584557+0000 mgr.smithi067.rdualw (mgr.24569) 12752 : cluster [DBG] pgmap v10982: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:35:00.224680+0000 mgr.smithi067.rdualw (mgr.24569) 12753 : audit [DBG] from='client.42646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:35:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:35:00.511595+0000 mgr.smithi067.rdualw (mgr.24569) 12754 : audit [DBG] from='client.42650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:35:02.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:01 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:35:00.872252+0000 mon.smithi061 (mon.0) 2645 : audit [DBG] from='client.? 172.21.15.61:0/2041512808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:35:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:35:00.224680+0000 mgr.smithi067.rdualw (mgr.24569) 12753 : audit [DBG] from='client.42646 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:35:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:35:00.511595+0000 mgr.smithi067.rdualw (mgr.24569) 12754 : audit [DBG] from='client.42650 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:35:02.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:01 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:35:00.872252+0000 mon.smithi061 (mon.0) 2645 : audit [DBG] from='client.? 172.21.15.61:0/2041512808' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:35:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:01.585447+0000 mgr.smithi067.rdualw (mgr.24569) 12755 : cluster [DBG] pgmap v10983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:01.585447+0000 mgr.smithi067.rdualw (mgr.24569) 12755 : cluster [DBG] pgmap v10983: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:03.586198+0000 mgr.smithi067.rdualw (mgr.24569) 12756 : cluster [DBG] pgmap v10984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:03.586198+0000 mgr.smithi067.rdualw (mgr.24569) 12756 : cluster [DBG] pgmap v10984: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:05.587306+0000 mgr.smithi067.rdualw (mgr.24569) 12757 : cluster [DBG] pgmap v10985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:05.587306+0000 mgr.smithi067.rdualw (mgr.24569) 12757 : cluster [DBG] pgmap v10985: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:07.587907+0000 mgr.smithi067.rdualw (mgr.24569) 12758 : cluster [DBG] pgmap v10986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:07.587907+0000 mgr.smithi067.rdualw (mgr.24569) 12758 : cluster [DBG] pgmap v10986: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:09.588721+0000 mgr.smithi067.rdualw (mgr.24569) 12759 : cluster [DBG] pgmap v10987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:09.588721+0000 mgr.smithi067.rdualw (mgr.24569) 12759 : cluster [DBG] pgmap v10987: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:11.589798+0000 mgr.smithi067.rdualw (mgr.24569) 12760 : cluster [DBG] pgmap v10988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:11.589798+0000 mgr.smithi067.rdualw (mgr.24569) 12760 : cluster [DBG] pgmap v10988: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:13.590340+0000 mgr.smithi067.rdualw (mgr.24569) 12761 : cluster [DBG] pgmap v10989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:13.590340+0000 mgr.smithi067.rdualw (mgr.24569) 12761 : cluster [DBG] pgmap v10989: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:15.591182+0000 mgr.smithi067.rdualw (mgr.24569) 12762 : cluster [DBG] pgmap v10990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:15.591182+0000 mgr.smithi067.rdualw (mgr.24569) 12762 : cluster [DBG] pgmap v10990: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:17.591778+0000 mgr.smithi067.rdualw (mgr.24569) 12763 : cluster [DBG] pgmap v10991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:17.591778+0000 mgr.smithi067.rdualw (mgr.24569) 12763 : cluster [DBG] pgmap v10991: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:19.592330+0000 mgr.smithi067.rdualw (mgr.24569) 12764 : cluster [DBG] pgmap v10992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:35:20.394581+0000 mon.smithi067 (mon.1) 1922 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:35:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:35:20.396035+0000 mon.smithi067 (mon.1) 1923 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:35:21.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:35:20.396977+0000 mon.smithi067 (mon.1) 1924 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:35:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:19.592330+0000 mgr.smithi067.rdualw (mgr.24569) 12764 : cluster [DBG] pgmap v10992: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:35:20.394581+0000 mon.smithi067 (mon.1) 1922 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:35:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:35:20.396035+0000 mon.smithi067 (mon.1) 1923 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:35:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:35:20.396977+0000 mon.smithi067 (mon.1) 1924 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:35:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:35:20.397809+0000 mgr.smithi067.rdualw (mgr.24569) 12765 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:35:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:35:20.815158+0000 mon.smithi061 (mon.0) 2646 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:35:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:35:20.821296+0000 mon.smithi061 (mon.0) 2647 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:35:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:35:20.397809+0000 mgr.smithi067.rdualw (mgr.24569) 12765 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:35:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:35:20.815158+0000 mon.smithi061 (mon.0) 2646 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:35:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:35:20.821296+0000 mon.smithi061 (mon.0) 2647 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:35:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:21.593409+0000 mgr.smithi067.rdualw (mgr.24569) 12766 : cluster [DBG] pgmap v10993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:21.593409+0000 mgr.smithi067.rdualw (mgr.24569) 12766 : cluster [DBG] pgmap v10993: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:23.594048+0000 mgr.smithi067.rdualw (mgr.24569) 12767 : cluster [DBG] pgmap v10994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:23.594048+0000 mgr.smithi067.rdualw (mgr.24569) 12767 : cluster [DBG] pgmap v10994: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:25.595176+0000 mgr.smithi067.rdualw (mgr.24569) 12768 : cluster [DBG] pgmap v10995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:25.595176+0000 mgr.smithi067.rdualw (mgr.24569) 12768 : cluster [DBG] pgmap v10995: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:27.595915+0000 mgr.smithi067.rdualw (mgr.24569) 12769 : cluster [DBG] pgmap v10996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:27.595915+0000 mgr.smithi067.rdualw (mgr.24569) 12769 : cluster [DBG] pgmap v10996: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:29.596471+0000 mgr.smithi067.rdualw (mgr.24569) 12770 : cluster [DBG] pgmap v10997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:29.596471+0000 mgr.smithi067.rdualw (mgr.24569) 12770 : cluster [DBG] pgmap v10997: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:31.202 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:35:31.493 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:35:31.494 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 7m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:35:31.494 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 7m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:35:31.494 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 7m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:35:31.495 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 7m ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:35:31.495 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 7m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:35:31.496 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 7m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:35:31.496 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 7m ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:35:31.496 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 7m ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:35:31.497 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 7m ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:35:31.497 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 7m ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:35:31.498 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 7m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:35:31.499 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 7m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:35:31.499 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 7m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:35:31.499 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 7m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:35:31.500 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 7m ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:35:31.500 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 7m ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:35:31.501 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 7m ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:35:31.501 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 7m ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:35:31.501 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 7m ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:35:31.502 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 7m ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:35:31.502 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 7m ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:35:31.502 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 7m ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:35:31.503 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 7m ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:35:31.851 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:35:31.852 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:35:31.852 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:35:31.852 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:35:31.853 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:35:31.853 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:35:31.853 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:35:31.853 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:35:31.853 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:35:31.854 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:35:31.854 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:35:31.854 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:35:31.854 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:35:31.855 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:35:31.855 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:35:31.855 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:35:31.855 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:35:31.856 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:35:31.856 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:35:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:35:31.185299+0000 mgr.smithi067.rdualw (mgr.24569) 12771 : audit [DBG] from='client.42658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:35:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:35:31.474706+0000 mgr.smithi067.rdualw (mgr.24569) 12772 : audit [DBG] from='client.42662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:35:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:31.597273+0000 mgr.smithi067.rdualw (mgr.24569) 12773 : cluster [DBG] pgmap v10998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:33.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:35:31.850173+0000 mon.smithi061 (mon.0) 2648 : audit [DBG] from='client.? 172.21.15.61:0/3992094373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:35:33.070 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:35:31.185299+0000 mgr.smithi067.rdualw (mgr.24569) 12771 : audit [DBG] from='client.42658 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:35:33.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:35:31.474706+0000 mgr.smithi067.rdualw (mgr.24569) 12772 : audit [DBG] from='client.42662 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:35:33.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:31.597273+0000 mgr.smithi067.rdualw (mgr.24569) 12773 : cluster [DBG] pgmap v10998: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:33.071 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:35:31.850173+0000 mon.smithi061 (mon.0) 2648 : audit [DBG] from='client.? 172.21.15.61:0/3992094373' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:35:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:33.597888+0000 mgr.smithi067.rdualw (mgr.24569) 12774 : cluster [DBG] pgmap v10999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:33.597888+0000 mgr.smithi067.rdualw (mgr.24569) 12774 : cluster [DBG] pgmap v10999: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:35.598810+0000 mgr.smithi067.rdualw (mgr.24569) 12775 : cluster [DBG] pgmap v11000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:35:36.483451+0000 mon.smithi067 (mon.1) 1925 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:35:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:35:36.483701+0000 mon.smithi067 (mon.1) 1926 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:35:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:35:36.484090+0000 mon.smithi061 (mon.0) 2649 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:35:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:35:36.484397+0000 mon.smithi061 (mon.0) 2650 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:35:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:35.598810+0000 mgr.smithi067.rdualw (mgr.24569) 12775 : cluster [DBG] pgmap v11000: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:35:36.483451+0000 mon.smithi067 (mon.1) 1925 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:35:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:35:36.483701+0000 mon.smithi067 (mon.1) 1926 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:35:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:35:36.484090+0000 mon.smithi061 (mon.0) 2649 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:35:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:35:36.484397+0000 mon.smithi061 (mon.0) 2650 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:35:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:37.599319+0000 mgr.smithi067.rdualw (mgr.24569) 12776 : cluster [DBG] pgmap v11001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:37.599319+0000 mgr.smithi067.rdualw (mgr.24569) 12776 : cluster [DBG] pgmap v11001: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:39.599903+0000 mgr.smithi067.rdualw (mgr.24569) 12777 : cluster [DBG] pgmap v11002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:39.599903+0000 mgr.smithi067.rdualw (mgr.24569) 12777 : cluster [DBG] pgmap v11002: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:41.600766+0000 mgr.smithi067.rdualw (mgr.24569) 12778 : cluster [DBG] pgmap v11003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:43.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:41.600766+0000 mgr.smithi067.rdualw (mgr.24569) 12778 : cluster [DBG] pgmap v11003: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:43.601564+0000 mgr.smithi067.rdualw (mgr.24569) 12779 : cluster [DBG] pgmap v11004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:45.273 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:43.601564+0000 mgr.smithi067.rdualw (mgr.24569) 12779 : cluster [DBG] pgmap v11004: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:47.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:45.602672+0000 mgr.smithi067.rdualw (mgr.24569) 12780 : cluster [DBG] pgmap v11005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:45.602672+0000 mgr.smithi067.rdualw (mgr.24569) 12780 : cluster [DBG] pgmap v11005: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:49.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:47.603183+0000 mgr.smithi067.rdualw (mgr.24569) 12781 : cluster [DBG] pgmap v11006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:49.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:47.603183+0000 mgr.smithi067.rdualw (mgr.24569) 12781 : cluster [DBG] pgmap v11006: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:49.603835+0000 mgr.smithi067.rdualw (mgr.24569) 12782 : cluster [DBG] pgmap v11007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:49.603835+0000 mgr.smithi067.rdualw (mgr.24569) 12782 : cluster [DBG] pgmap v11007: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:51.604617+0000 mgr.smithi067.rdualw (mgr.24569) 12783 : cluster [DBG] pgmap v11008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:51.604617+0000 mgr.smithi067.rdualw (mgr.24569) 12783 : cluster [DBG] pgmap v11008: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:53.605165+0000 mgr.smithi067.rdualw (mgr.24569) 12784 : cluster [DBG] pgmap v11009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:53.605165+0000 mgr.smithi067.rdualw (mgr.24569) 12784 : cluster [DBG] pgmap v11009: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:55.606080+0000 mgr.smithi067.rdualw (mgr.24569) 12785 : cluster [DBG] pgmap v11010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:55.606080+0000 mgr.smithi067.rdualw (mgr.24569) 12785 : cluster [DBG] pgmap v11010: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:35:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:35:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:57.606675+0000 mgr.smithi067.rdualw (mgr.24569) 12786 : cluster [DBG] pgmap v11011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:35:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:35:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:57.606675+0000 mgr.smithi067.rdualw (mgr.24569) 12786 : cluster [DBG] pgmap v11011: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:01.051 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:35:59.607478+0000 mgr.smithi067.rdualw (mgr.24569) 12787 : cluster [DBG] pgmap v11012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:35:59.607478+0000 mgr.smithi067.rdualw (mgr.24569) 12787 : cluster [DBG] pgmap v11012: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:02.156 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:36:02.447 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:36:02.448 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 7m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:36:02.448 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 7m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:36:02.448 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 7m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:36:02.448 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 7m ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:36:02.449 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 7m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:36:02.449 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 7m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:36:02.449 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 7m ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:36:02.449 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 7m ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:36:02.450 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 7m ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:36:02.450 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 7m ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:36:02.450 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 7m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:36:02.450 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 7m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:36:02.451 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 7m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:36:02.451 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 7m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:36:02.451 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 7m ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:36:02.451 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 7m ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:36:02.451 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 7m ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:36:02.452 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 7m ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:36:02.452 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 7m ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:36:02.452 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 7m ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:36:02.452 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 7m ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:36:02.453 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 7m ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:36:02.453 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 7m ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:36:02.790 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:36:02.790 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:36:02.791 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:36:02.791 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:36:02.791 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:36:02.791 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:36:02.792 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:36:02.792 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:36:02.792 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:36:02.792 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:36:02.793 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:36:02.793 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:36:02.793 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:36:02.793 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:36:02.794 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:36:02.794 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:36:02.794 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:36:02.794 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:36:02.795 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:36:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:01.608374+0000 mgr.smithi067.rdualw (mgr.24569) 12788 : cluster [DBG] pgmap v11013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:01.608374+0000 mgr.smithi067.rdualw (mgr.24569) 12788 : cluster [DBG] pgmap v11013: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:36:02.142391+0000 mgr.smithi067.rdualw (mgr.24569) 12789 : audit [DBG] from='client.42670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:36:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:36:02.429218+0000 mgr.smithi067.rdualw (mgr.24569) 12790 : audit [DBG] from='client.42674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:36:04.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:03 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:36:02.788652+0000 mon.smithi061 (mon.0) 2651 : audit [DBG] from='client.? 172.21.15.61:0/1856238763' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:36:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:36:02.142391+0000 mgr.smithi067.rdualw (mgr.24569) 12789 : audit [DBG] from='client.42670 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:36:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:36:02.429218+0000 mgr.smithi067.rdualw (mgr.24569) 12790 : audit [DBG] from='client.42674 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:36:04.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:03 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:36:02.788652+0000 mon.smithi061 (mon.0) 2651 : audit [DBG] from='client.? 172.21.15.61:0/1856238763' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:36:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:03.609042+0000 mgr.smithi067.rdualw (mgr.24569) 12791 : cluster [DBG] pgmap v11014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:03.609042+0000 mgr.smithi067.rdualw (mgr.24569) 12791 : cluster [DBG] pgmap v11014: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:05.609844+0000 mgr.smithi067.rdualw (mgr.24569) 12792 : cluster [DBG] pgmap v11015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:05.609844+0000 mgr.smithi067.rdualw (mgr.24569) 12792 : cluster [DBG] pgmap v11015: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:07.610404+0000 mgr.smithi067.rdualw (mgr.24569) 12793 : cluster [DBG] pgmap v11016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:07.610404+0000 mgr.smithi067.rdualw (mgr.24569) 12793 : cluster [DBG] pgmap v11016: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:09.610956+0000 mgr.smithi067.rdualw (mgr.24569) 12794 : cluster [DBG] pgmap v11017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:09.610956+0000 mgr.smithi067.rdualw (mgr.24569) 12794 : cluster [DBG] pgmap v11017: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:11.611840+0000 mgr.smithi067.rdualw (mgr.24569) 12795 : cluster [DBG] pgmap v11018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:11.611840+0000 mgr.smithi067.rdualw (mgr.24569) 12795 : cluster [DBG] pgmap v11018: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:14.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:13.612329+0000 mgr.smithi067.rdualw (mgr.24569) 12796 : cluster [DBG] pgmap v11019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:13.612329+0000 mgr.smithi067.rdualw (mgr.24569) 12796 : cluster [DBG] pgmap v11019: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:15.613271+0000 mgr.smithi067.rdualw (mgr.24569) 12797 : cluster [DBG] pgmap v11020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:15.613271+0000 mgr.smithi067.rdualw (mgr.24569) 12797 : cluster [DBG] pgmap v11020: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:19.056 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:17.613743+0000 mgr.smithi067.rdualw (mgr.24569) 12798 : cluster [DBG] pgmap v11021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:17.613743+0000 mgr.smithi067.rdualw (mgr.24569) 12798 : cluster [DBG] pgmap v11021: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:19.614458+0000 mgr.smithi067.rdualw (mgr.24569) 12799 : cluster [DBG] pgmap v11022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:19.614458+0000 mgr.smithi067.rdualw (mgr.24569) 12799 : cluster [DBG] pgmap v11022: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:36:20.824569+0000 mon.smithi067 (mon.1) 1927 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:36:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:36:20.826046+0000 mon.smithi067 (mon.1) 1928 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:36:22.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:36:20.827045+0000 mon.smithi067 (mon.1) 1929 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:36:22.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:36:21.242830+0000 mon.smithi061 (mon.0) 2652 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:36:22.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:36:21.248484+0000 mon.smithi061 (mon.0) 2653 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:36:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:36:20.824569+0000 mon.smithi067 (mon.1) 1927 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:36:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:36:20.826046+0000 mon.smithi067 (mon.1) 1928 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:36:22.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:36:20.827045+0000 mon.smithi067 (mon.1) 1929 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:36:22.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:36:21.242830+0000 mon.smithi061 (mon.0) 2652 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:36:22.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:36:21.248484+0000 mon.smithi061 (mon.0) 2653 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:36:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:36:20.827933+0000 mgr.smithi067.rdualw (mgr.24569) 12800 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:36:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:21.615244+0000 mgr.smithi067.rdualw (mgr.24569) 12801 : cluster [DBG] pgmap v11023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:36:20.827933+0000 mgr.smithi067.rdualw (mgr.24569) 12800 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:36:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:21.615244+0000 mgr.smithi067.rdualw (mgr.24569) 12801 : cluster [DBG] pgmap v11023: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:23.615741+0000 mgr.smithi067.rdualw (mgr.24569) 12802 : cluster [DBG] pgmap v11024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:23.615741+0000 mgr.smithi067.rdualw (mgr.24569) 12802 : cluster [DBG] pgmap v11024: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:25.616702+0000 mgr.smithi067.rdualw (mgr.24569) 12803 : cluster [DBG] pgmap v11025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:25.616702+0000 mgr.smithi067.rdualw (mgr.24569) 12803 : cluster [DBG] pgmap v11025: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:27.617384+0000 mgr.smithi067.rdualw (mgr.24569) 12804 : cluster [DBG] pgmap v11026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:27.617384+0000 mgr.smithi067.rdualw (mgr.24569) 12804 : cluster [DBG] pgmap v11026: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:29.618105+0000 mgr.smithi067.rdualw (mgr.24569) 12805 : cluster [DBG] pgmap v11027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:29.618105+0000 mgr.smithi067.rdualw (mgr.24569) 12805 : cluster [DBG] pgmap v11027: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:31.619213+0000 mgr.smithi067.rdualw (mgr.24569) 12806 : cluster [DBG] pgmap v11028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:31.619213+0000 mgr.smithi067.rdualw (mgr.24569) 12806 : cluster [DBG] pgmap v11028: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:33.126 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:36:33.415 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:36:33.415 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 8m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:36:33.416 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 8m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:36:33.416 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 8m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:36:33.416 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 8m ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:36:33.416 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 8m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:36:33.417 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 8m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:36:33.418 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 8m ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:36:33.418 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 8m ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:36:33.418 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 8m ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:36:33.419 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 8m ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:36:33.419 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 8m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:36:33.419 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 8m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:36:33.419 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 8m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:36:33.420 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 8m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:36:33.420 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 8m ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:36:33.420 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 8m ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:36:33.420 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 8m ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:36:33.420 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 8m ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:36:33.421 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 8m ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:36:33.421 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 8m ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:36:33.421 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 8m ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:36:33.421 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 8m ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:36:33.422 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 8m ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:36:33.795 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:36:33.795 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:36:33.795 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:36:33.796 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:36:33.796 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:36:33.796 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:36:33.796 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:36:33.797 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:36:33.797 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:36:33.797 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:36:33.797 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:36:33.797 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:36:33.798 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:36:33.798 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:36:33.798 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:36:33.798 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:36:33.799 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:36:33.799 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:36:33.799 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:36:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:36:33.111311+0000 mgr.smithi067.rdualw (mgr.24569) 12807 : audit [DBG] from='client.42682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:36:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:36:33.397165+0000 mgr.smithi067.rdualw (mgr.24569) 12808 : audit [DBG] from='client.42686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:36:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:33.619837+0000 mgr.smithi067.rdualw (mgr.24569) 12809 : cluster [DBG] pgmap v11029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:35.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:36:33.792852+0000 mon.smithi061 (mon.0) 2654 : audit [DBG] from='client.? 172.21.15.61:0/931959836' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:36:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:36:33.111311+0000 mgr.smithi067.rdualw (mgr.24569) 12807 : audit [DBG] from='client.42682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:36:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:36:33.397165+0000 mgr.smithi067.rdualw (mgr.24569) 12808 : audit [DBG] from='client.42686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:36:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:33.619837+0000 mgr.smithi067.rdualw (mgr.24569) 12809 : cluster [DBG] pgmap v11029: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:35.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:36:33.792852+0000 mon.smithi061 (mon.0) 2654 : audit [DBG] from='client.? 172.21.15.61:0/931959836' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:36:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:35.620654+0000 mgr.smithi067.rdualw (mgr.24569) 12810 : cluster [DBG] pgmap v11030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:36:36.488568+0000 mon.smithi067 (mon.1) 1930 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:36:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:36:36.488854+0000 mon.smithi067 (mon.1) 1931 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:36:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:36:36.489301+0000 mon.smithi061 (mon.0) 2655 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:36:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:36:36.489646+0000 mon.smithi061 (mon.0) 2656 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:36:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:35.620654+0000 mgr.smithi067.rdualw (mgr.24569) 12810 : cluster [DBG] pgmap v11030: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:36:36.488568+0000 mon.smithi067 (mon.1) 1930 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:36:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:36:36.488854+0000 mon.smithi067 (mon.1) 1931 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:36:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:36:36.489301+0000 mon.smithi061 (mon.0) 2655 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:36:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:36:36.489646+0000 mon.smithi061 (mon.0) 2656 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:36:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:37.621202+0000 mgr.smithi067.rdualw (mgr.24569) 12811 : cluster [DBG] pgmap v11031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:37.621202+0000 mgr.smithi067.rdualw (mgr.24569) 12811 : cluster [DBG] pgmap v11031: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:39.622019+0000 mgr.smithi067.rdualw (mgr.24569) 12812 : cluster [DBG] pgmap v11032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:39.622019+0000 mgr.smithi067.rdualw (mgr.24569) 12812 : cluster [DBG] pgmap v11032: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:41.622992+0000 mgr.smithi067.rdualw (mgr.24569) 12813 : cluster [DBG] pgmap v11033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:41.622992+0000 mgr.smithi067.rdualw (mgr.24569) 12813 : cluster [DBG] pgmap v11033: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:43.623455+0000 mgr.smithi067.rdualw (mgr.24569) 12814 : cluster [DBG] pgmap v11034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:43.623455+0000 mgr.smithi067.rdualw (mgr.24569) 12814 : cluster [DBG] pgmap v11034: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:45.624439+0000 mgr.smithi067.rdualw (mgr.24569) 12815 : cluster [DBG] pgmap v11035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:45.624439+0000 mgr.smithi067.rdualw (mgr.24569) 12815 : cluster [DBG] pgmap v11035: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:47.625123+0000 mgr.smithi067.rdualw (mgr.24569) 12816 : cluster [DBG] pgmap v11036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:47.625123+0000 mgr.smithi067.rdualw (mgr.24569) 12816 : cluster [DBG] pgmap v11036: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:49.625838+0000 mgr.smithi067.rdualw (mgr.24569) 12817 : cluster [DBG] pgmap v11037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:49.625838+0000 mgr.smithi067.rdualw (mgr.24569) 12817 : cluster [DBG] pgmap v11037: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:51.627107+0000 mgr.smithi067.rdualw (mgr.24569) 12818 : cluster [DBG] pgmap v11038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:53.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:51.627107+0000 mgr.smithi067.rdualw (mgr.24569) 12818 : cluster [DBG] pgmap v11038: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:55.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:53.627812+0000 mgr.smithi067.rdualw (mgr.24569) 12819 : cluster [DBG] pgmap v11039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:55.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:53.627812+0000 mgr.smithi067.rdualw (mgr.24569) 12819 : cluster [DBG] pgmap v11039: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:55.628655+0000 mgr.smithi067.rdualw (mgr.24569) 12820 : cluster [DBG] pgmap v11040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:55.628655+0000 mgr.smithi067.rdualw (mgr.24569) 12820 : cluster [DBG] pgmap v11040: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:36:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:36:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:57.629344+0000 mgr.smithi067.rdualw (mgr.24569) 12821 : cluster [DBG] pgmap v11041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:36:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:36:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:57.629344+0000 mgr.smithi067.rdualw (mgr.24569) 12821 : cluster [DBG] pgmap v11041: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:36:59.629864+0000 mgr.smithi067.rdualw (mgr.24569) 12822 : cluster [DBG] pgmap v11042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:36:59.629864+0000 mgr.smithi067.rdualw (mgr.24569) 12822 : cluster [DBG] pgmap v11042: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:01.630898+0000 mgr.smithi067.rdualw (mgr.24569) 12823 : cluster [DBG] pgmap v11043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:01.630898+0000 mgr.smithi067.rdualw (mgr.24569) 12823 : cluster [DBG] pgmap v11043: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:04.126 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:37:04.418 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:37:04.418 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 8m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:37:04.419 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 8m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:37:04.419 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 8m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:37:04.419 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 8m ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:37:04.419 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 8m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:37:04.420 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 8m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:37:04.420 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 8m ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:37:04.420 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 8m ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:37:04.420 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 8m ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:37:04.420 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 8m ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:37:04.421 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 8m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:37:04.421 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 8m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:37:04.421 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 8m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:37:04.421 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 8m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:37:04.421 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 8m ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:37:04.422 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 8m ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:37:04.422 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 8m ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:37:04.422 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 8m ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:37:04.422 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 8m ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:37:04.423 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 8m ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:37:04.423 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 8m ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:37:04.423 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 8m ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:37:04.423 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 8m ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:37:04.761 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:37:04.761 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:37:04.761 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:37:04.761 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:37:04.762 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:37:04.762 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:37:04.762 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:37:04.763 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:37:04.763 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:37:04.763 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:37:04.763 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:37:04.764 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:37:04.764 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:37:04.764 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:37:04.764 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:37:04.764 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:37:04.765 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:37:04.765 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:37:04.765 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:37:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:03.631658+0000 mgr.smithi067.rdualw (mgr.24569) 12824 : cluster [DBG] pgmap v11044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:03.631658+0000 mgr.smithi067.rdualw (mgr.24569) 12824 : cluster [DBG] pgmap v11044: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:06.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:37:04.112824+0000 mgr.smithi067.rdualw (mgr.24569) 12825 : audit [DBG] from='client.42694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:37:06.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:37:04.400305+0000 mgr.smithi067.rdualw (mgr.24569) 12826 : audit [DBG] from='client.42698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:37:06.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:37:04.759180+0000 mon.smithi061 (mon.0) 2657 : audit [DBG] from='client.? 172.21.15.61:0/1842971406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:37:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:37:04.112824+0000 mgr.smithi067.rdualw (mgr.24569) 12825 : audit [DBG] from='client.42694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:37:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:37:04.400305+0000 mgr.smithi067.rdualw (mgr.24569) 12826 : audit [DBG] from='client.42698 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:37:06.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:37:04.759180+0000 mon.smithi061 (mon.0) 2657 : audit [DBG] from='client.? 172.21.15.61:0/1842971406' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:37:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:05.632615+0000 mgr.smithi067.rdualw (mgr.24569) 12827 : cluster [DBG] pgmap v11045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:05.632615+0000 mgr.smithi067.rdualw (mgr.24569) 12827 : cluster [DBG] pgmap v11045: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:07.633094+0000 mgr.smithi067.rdualw (mgr.24569) 12828 : cluster [DBG] pgmap v11046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:09.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:07.633094+0000 mgr.smithi067.rdualw (mgr.24569) 12828 : cluster [DBG] pgmap v11046: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:09.633759+0000 mgr.smithi067.rdualw (mgr.24569) 12829 : cluster [DBG] pgmap v11047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:10.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:09.633759+0000 mgr.smithi067.rdualw (mgr.24569) 12829 : cluster [DBG] pgmap v11047: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:11.634637+0000 mgr.smithi067.rdualw (mgr.24569) 12830 : cluster [DBG] pgmap v11048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:11.634637+0000 mgr.smithi067.rdualw (mgr.24569) 12830 : cluster [DBG] pgmap v11048: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:13.635183+0000 mgr.smithi067.rdualw (mgr.24569) 12831 : cluster [DBG] pgmap v11049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:13.635183+0000 mgr.smithi067.rdualw (mgr.24569) 12831 : cluster [DBG] pgmap v11049: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:17.057 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:15.636076+0000 mgr.smithi067.rdualw (mgr.24569) 12832 : cluster [DBG] pgmap v11050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:15.636076+0000 mgr.smithi067.rdualw (mgr.24569) 12832 : cluster [DBG] pgmap v11050: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:17.636756+0000 mgr.smithi067.rdualw (mgr.24569) 12833 : cluster [DBG] pgmap v11051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:17.636756+0000 mgr.smithi067.rdualw (mgr.24569) 12833 : cluster [DBG] pgmap v11051: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:19.637406+0000 mgr.smithi067.rdualw (mgr.24569) 12834 : cluster [DBG] pgmap v11052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:19.637406+0000 mgr.smithi067.rdualw (mgr.24569) 12834 : cluster [DBG] pgmap v11052: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:37:21.252207+0000 mon.smithi067 (mon.1) 1932 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:37:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:37:21.253694+0000 mon.smithi067 (mon.1) 1933 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:37:22.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:37:21.254597+0000 mon.smithi067 (mon.1) 1934 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:37:22.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:37:21.661583+0000 mon.smithi061 (mon.0) 2658 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:37:22.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:37:21.669229+0000 mon.smithi061 (mon.0) 2659 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:37:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:37:21.252207+0000 mon.smithi067 (mon.1) 1932 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:37:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:37:21.253694+0000 mon.smithi067 (mon.1) 1933 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:37:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:37:21.254597+0000 mon.smithi067 (mon.1) 1934 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:37:22.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:37:21.661583+0000 mon.smithi061 (mon.0) 2658 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:37:22.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:37:21.669229+0000 mon.smithi061 (mon.0) 2659 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:37:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:37:21.255379+0000 mgr.smithi067.rdualw (mgr.24569) 12835 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:37:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:21.638133+0000 mgr.smithi067.rdualw (mgr.24569) 12836 : cluster [DBG] pgmap v11053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:37:21.255379+0000 mgr.smithi067.rdualw (mgr.24569) 12835 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:37:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:21.638133+0000 mgr.smithi067.rdualw (mgr.24569) 12836 : cluster [DBG] pgmap v11053: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:23.638744+0000 mgr.smithi067.rdualw (mgr.24569) 12837 : cluster [DBG] pgmap v11054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:23.638744+0000 mgr.smithi067.rdualw (mgr.24569) 12837 : cluster [DBG] pgmap v11054: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:25.639517+0000 mgr.smithi067.rdualw (mgr.24569) 12838 : cluster [DBG] pgmap v11055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:27.065 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:25.639517+0000 mgr.smithi067.rdualw (mgr.24569) 12838 : cluster [DBG] pgmap v11055: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:29.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:27.640032+0000 mgr.smithi067.rdualw (mgr.24569) 12839 : cluster [DBG] pgmap v11056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:27.640032+0000 mgr.smithi067.rdualw (mgr.24569) 12839 : cluster [DBG] pgmap v11056: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:29.640768+0000 mgr.smithi067.rdualw (mgr.24569) 12840 : cluster [DBG] pgmap v11057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:29.640768+0000 mgr.smithi067.rdualw (mgr.24569) 12840 : cluster [DBG] pgmap v11057: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:31.641742+0000 mgr.smithi067.rdualw (mgr.24569) 12841 : cluster [DBG] pgmap v11058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:31.641742+0000 mgr.smithi067.rdualw (mgr.24569) 12841 : cluster [DBG] pgmap v11058: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:33.642284+0000 mgr.smithi067.rdualw (mgr.24569) 12842 : cluster [DBG] pgmap v11059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:33.642284+0000 mgr.smithi067.rdualw (mgr.24569) 12842 : cluster [DBG] pgmap v11059: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:35.068 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:37:35.360 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:37:35.361 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 9m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:37:35.361 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 9m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:37:35.362 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 9m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:37:35.362 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 9m ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:37:35.362 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 9m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:37:35.362 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 9m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:37:35.363 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 9m ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:37:35.363 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 9m ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:37:35.363 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 9m ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:37:35.363 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 9m ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:37:35.363 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 9m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:37:35.364 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 9m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:37:35.364 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 9m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:37:35.364 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 9m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:37:35.364 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 9m ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:37:35.365 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 9m ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:37:35.365 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 9m ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:37:35.365 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 9m ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:37:35.365 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 9m ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:37:35.365 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 9m ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:37:35.366 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 9m ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:37:35.366 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 9m ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:37:35.366 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 9m ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:37:35.721 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:37:35.721 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:37:35.722 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:37:35.722 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:37:35.722 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:37:35.722 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:37:35.723 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:37:35.723 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:37:35.723 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:37:35.723 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:37:35.724 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:37:35.724 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:37:35.724 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:37:35.724 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:37:35.725 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:37:35.725 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:37:35.725 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:37:35.725 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:37:35.725 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:37:36.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:35 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:37:35.719476+0000 mon.smithi061 (mon.0) 2660 : audit [DBG] from='client.? 172.21.15.61:0/3576413416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:37:36.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:35 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:37:35.719476+0000 mon.smithi061 (mon.0) 2660 : audit [DBG] from='client.? 172.21.15.61:0/3576413416' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:37:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:37:35.055145+0000 mgr.smithi067.rdualw (mgr.24569) 12843 : audit [DBG] from='client.42706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:37:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:37:35.342284+0000 mgr.smithi067.rdualw (mgr.24569) 12844 : audit [DBG] from='client.42710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:37:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:35.643132+0000 mgr.smithi067.rdualw (mgr.24569) 12845 : cluster [DBG] pgmap v11060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:37:36.493999+0000 mon.smithi067 (mon.1) 1935 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:37:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:37:36.494249+0000 mon.smithi067 (mon.1) 1936 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:37:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:37:36.494674+0000 mon.smithi061 (mon.0) 2661 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:37:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:37:36.494978+0000 mon.smithi061 (mon.0) 2662 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:37:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:37:35.055145+0000 mgr.smithi067.rdualw (mgr.24569) 12843 : audit [DBG] from='client.42706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:37:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:37:35.342284+0000 mgr.smithi067.rdualw (mgr.24569) 12844 : audit [DBG] from='client.42710 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:37:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:35.643132+0000 mgr.smithi067.rdualw (mgr.24569) 12845 : cluster [DBG] pgmap v11060: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:37:36.493999+0000 mon.smithi067 (mon.1) 1935 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:37:37.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:37:36.494249+0000 mon.smithi067 (mon.1) 1936 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:37:37.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:37:36.494674+0000 mon.smithi061 (mon.0) 2661 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:37:37.068 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:37:36.494978+0000 mon.smithi061 (mon.0) 2662 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:37:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:37.643694+0000 mgr.smithi067.rdualw (mgr.24569) 12846 : cluster [DBG] pgmap v11061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:37.643694+0000 mgr.smithi067.rdualw (mgr.24569) 12846 : cluster [DBG] pgmap v11061: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:39.644501+0000 mgr.smithi067.rdualw (mgr.24569) 12847 : cluster [DBG] pgmap v11062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:39.644501+0000 mgr.smithi067.rdualw (mgr.24569) 12847 : cluster [DBG] pgmap v11062: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:41.645673+0000 mgr.smithi067.rdualw (mgr.24569) 12848 : cluster [DBG] pgmap v11063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:41.645673+0000 mgr.smithi067.rdualw (mgr.24569) 12848 : cluster [DBG] pgmap v11063: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:43.646239+0000 mgr.smithi067.rdualw (mgr.24569) 12849 : cluster [DBG] pgmap v11064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:43.646239+0000 mgr.smithi067.rdualw (mgr.24569) 12849 : cluster [DBG] pgmap v11064: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:45.647113+0000 mgr.smithi067.rdualw (mgr.24569) 12850 : cluster [DBG] pgmap v11065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:45.647113+0000 mgr.smithi067.rdualw (mgr.24569) 12850 : cluster [DBG] pgmap v11065: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:47.647667+0000 mgr.smithi067.rdualw (mgr.24569) 12851 : cluster [DBG] pgmap v11066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:47.647667+0000 mgr.smithi067.rdualw (mgr.24569) 12851 : cluster [DBG] pgmap v11066: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:49.648283+0000 mgr.smithi067.rdualw (mgr.24569) 12852 : cluster [DBG] pgmap v11067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:49.648283+0000 mgr.smithi067.rdualw (mgr.24569) 12852 : cluster [DBG] pgmap v11067: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:51.649229+0000 mgr.smithi067.rdualw (mgr.24569) 12853 : cluster [DBG] pgmap v11068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:51.649229+0000 mgr.smithi067.rdualw (mgr.24569) 12853 : cluster [DBG] pgmap v11068: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:54.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:53 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:53.649751+0000 mgr.smithi067.rdualw (mgr.24569) 12854 : cluster [DBG] pgmap v11069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:54.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:53 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:53.649751+0000 mgr.smithi067.rdualw (mgr.24569) 12854 : cluster [DBG] pgmap v11069: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:55.650584+0000 mgr.smithi067.rdualw (mgr.24569) 12855 : cluster [DBG] pgmap v11070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:55.650584+0000 mgr.smithi067.rdualw (mgr.24569) 12855 : cluster [DBG] pgmap v11070: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:37:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:37:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:57.651054+0000 mgr.smithi067.rdualw (mgr.24569) 12856 : cluster [DBG] pgmap v11071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:37:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:37:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:57.651054+0000 mgr.smithi067.rdualw (mgr.24569) 12856 : cluster [DBG] pgmap v11071: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:37:59.651653+0000 mgr.smithi067.rdualw (mgr.24569) 12857 : cluster [DBG] pgmap v11072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:37:59.651653+0000 mgr.smithi067.rdualw (mgr.24569) 12857 : cluster [DBG] pgmap v11072: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:01.652496+0000 mgr.smithi067.rdualw (mgr.24569) 12858 : cluster [DBG] pgmap v11073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:01.652496+0000 mgr.smithi067.rdualw (mgr.24569) 12858 : cluster [DBG] pgmap v11073: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:03.653107+0000 mgr.smithi067.rdualw (mgr.24569) 12859 : cluster [DBG] pgmap v11074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:03.653107+0000 mgr.smithi067.rdualw (mgr.24569) 12859 : cluster [DBG] pgmap v11074: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:06.027 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:38:06.318 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:38:06.318 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 9m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:38:06.319 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 9m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:38:06.319 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 9m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:38:06.320 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 9m ago 6h 42.9M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:38:06.320 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 9m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:38:06.320 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 9m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:38:06.321 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 9m ago 6h 497M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:38:06.321 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 9m ago 6h 678M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:38:06.322 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 9m ago 6h 2077M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:38:06.322 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 9m ago 6h 1240M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:38:06.323 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 9m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:38:06.323 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 9m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:38:06.323 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 9m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:38:06.324 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 9m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:38:06.324 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 9m ago 6h 1402M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:38:06.324 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 9m ago 6h 2336M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:38:06.325 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 9m ago 6h 1472M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:38:06.325 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 9m ago 6h 2494M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:38:06.326 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 9m ago 6h 2297M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:38:06.326 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 9m ago 6h 2435M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:38:06.326 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 9m ago 6h 2009M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:38:06.327 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 9m ago 6h 3013M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:38:06.327 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 9m ago 6h 137M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:38:06.658 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:38:06.658 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:38:06.659 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:38:06.659 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:38:06.659 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:38:06.659 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:38:06.660 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:38:06.660 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:38:06.660 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:38:06.660 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:38:06.660 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:38:06.661 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:38:06.661 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:38:06.661 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:38:06.661 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:38:06.662 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:38:06.662 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:38:06.662 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:38:06.662 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:38:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:05.654147+0000 mgr.smithi067.rdualw (mgr.24569) 12860 : cluster [DBG] pgmap v11075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:06.656669+0000 mon.smithi061 (mon.0) 2663 : audit [DBG] from='client.? 172.21.15.61:0/2049232625' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:38:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:05.654147+0000 mgr.smithi067.rdualw (mgr.24569) 12860 : cluster [DBG] pgmap v11075: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:06.656669+0000 mon.smithi061 (mon.0) 2663 : audit [DBG] from='client.? 172.21.15.61:0/2049232625' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:38:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:06.013597+0000 mgr.smithi067.rdualw (mgr.24569) 12861 : audit [DBG] from='client.42718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:38:08.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:07 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:06.300332+0000 mgr.smithi067.rdualw (mgr.24569) 12862 : audit [DBG] from='client.42722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:38:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:06.013597+0000 mgr.smithi067.rdualw (mgr.24569) 12861 : audit [DBG] from='client.42718 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:38:08.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:07 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:06.300332+0000 mgr.smithi067.rdualw (mgr.24569) 12862 : audit [DBG] from='client.42722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:38:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:07.654790+0000 mgr.smithi067.rdualw (mgr.24569) 12863 : cluster [DBG] pgmap v11076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:07.654790+0000 mgr.smithi067.rdualw (mgr.24569) 12863 : cluster [DBG] pgmap v11076: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:09.655437+0000 mgr.smithi067.rdualw (mgr.24569) 12864 : cluster [DBG] pgmap v11077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:09.655437+0000 mgr.smithi067.rdualw (mgr.24569) 12864 : cluster [DBG] pgmap v11077: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:11.656496+0000 mgr.smithi067.rdualw (mgr.24569) 12865 : cluster [DBG] pgmap v11078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:11.656496+0000 mgr.smithi067.rdualw (mgr.24569) 12865 : cluster [DBG] pgmap v11078: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:13.657149+0000 mgr.smithi067.rdualw (mgr.24569) 12866 : cluster [DBG] pgmap v11079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:13.657149+0000 mgr.smithi067.rdualw (mgr.24569) 12866 : cluster [DBG] pgmap v11079: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:15.658158+0000 mgr.smithi067.rdualw (mgr.24569) 12867 : cluster [DBG] pgmap v11080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:15.658158+0000 mgr.smithi067.rdualw (mgr.24569) 12867 : cluster [DBG] pgmap v11080: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:17.658759+0000 mgr.smithi067.rdualw (mgr.24569) 12868 : cluster [DBG] pgmap v11081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:17.658759+0000 mgr.smithi067.rdualw (mgr.24569) 12868 : cluster [DBG] pgmap v11081: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:19.659474+0000 mgr.smithi067.rdualw (mgr.24569) 12869 : cluster [DBG] pgmap v11082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:19.659474+0000 mgr.smithi067.rdualw (mgr.24569) 12869 : cluster [DBG] pgmap v11082: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:21.672660+0000 mon.smithi067 (mon.1) 1937 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:38:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:21.674174+0000 mon.smithi067 (mon.1) 1938 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:38:22.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:21 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:21.675085+0000 mon.smithi067 (mon.1) 1939 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:38:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:21.672660+0000 mon.smithi067 (mon.1) 1937 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:38:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:21.674174+0000 mon.smithi067 (mon.1) 1938 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:38:22.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:21 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:21.675085+0000 mon.smithi067 (mon.1) 1939 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:38:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:21.660473+0000 mgr.smithi067.rdualw (mgr.24569) 12870 : cluster [DBG] pgmap v11083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:38:21.675915+0000 mgr.smithi067.rdualw (mgr.24569) 12871 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:38:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:21.660473+0000 mgr.smithi067.rdualw (mgr.24569) 12870 : cluster [DBG] pgmap v11083: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:38:21.675915+0000 mgr.smithi067.rdualw (mgr.24569) 12871 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:38:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:23.660928+0000 mgr.smithi067.rdualw (mgr.24569) 12872 : cluster [DBG] pgmap v11084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:23.660928+0000 mgr.smithi067.rdualw (mgr.24569) 12872 : cluster [DBG] pgmap v11084: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:25.661885+0000 mgr.smithi067.rdualw (mgr.24569) 12873 : cluster [DBG] pgmap v11085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:26.377092+0000 mon.smithi061 (mon.0) 2664 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:38:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:25.661885+0000 mgr.smithi067.rdualw (mgr.24569) 12873 : cluster [DBG] pgmap v11085: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:26.377092+0000 mon.smithi061 (mon.0) 2664 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:38:28.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:26.778312+0000 mon.smithi067 (mon.1) 1940 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:38:28.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:27 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:26.778754+0000 mon.smithi061 (mon.0) 2665 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:38:28.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:26.778312+0000 mon.smithi067 (mon.1) 1940 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:38:28.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:27 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:26.778754+0000 mon.smithi061 (mon.0) 2665 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi067", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:38:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:27.662587+0000 mgr.smithi067.rdualw (mgr.24569) 12874 : cluster [DBG] pgmap v11086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:28.566182+0000 mon.smithi061 (mon.0) 2666 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:38:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:27.662587+0000 mgr.smithi067.rdualw (mgr.24569) 12874 : cluster [DBG] pgmap v11086: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:28.566182+0000 mon.smithi061 (mon.0) 2666 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:38:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:28.976784+0000 mon.smithi067 (mon.1) 1941 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:38:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:28.977371+0000 mon.smithi061 (mon.0) 2667 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:38:30.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:28.984160+0000 mon.smithi061 (mon.0) 2668 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:38:30.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:28.990980+0000 mon.smithi061 (mon.0) 2669 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:38:30.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:29.663175+0000 mgr.smithi067.rdualw (mgr.24569) 12875 : cluster [DBG] pgmap v11087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:28.976784+0000 mon.smithi067 (mon.1) 1941 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:38:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:28.977371+0000 mon.smithi061 (mon.0) 2667 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config rm", "who": "osd/host:smithi061", "name": "osd_memory_target"}]: dispatch 2022-03-17T21:38:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:28.984160+0000 mon.smithi061 (mon.0) 2668 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:38:30.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:28.990980+0000 mon.smithi061 (mon.0) 2669 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:38:30.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:29.663175+0000 mgr.smithi067.rdualw (mgr.24569) 12875 : cluster [DBG] pgmap v11087: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:31.664235+0000 mgr.smithi067.rdualw (mgr.24569) 12876 : cluster [DBG] pgmap v11088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:33.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:31.664235+0000 mgr.smithi067.rdualw (mgr.24569) 12876 : cluster [DBG] pgmap v11088: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:33.664858+0000 mgr.smithi067.rdualw (mgr.24569) 12877 : cluster [DBG] pgmap v11089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:33.664858+0000 mgr.smithi067.rdualw (mgr.24569) 12877 : cluster [DBG] pgmap v11089: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:36.968 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:38:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:35.665837+0000 mgr.smithi067.rdualw (mgr.24569) 12878 : cluster [DBG] pgmap v11090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:36.499737+0000 mon.smithi067 (mon.1) 1942 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:38:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:36.499998+0000 mon.smithi067 (mon.1) 1943 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:38:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:36.500357+0000 mon.smithi061 (mon.0) 2670 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:38:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:36.500907+0000 mon.smithi061 (mon.0) 2671 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:38:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:35.665837+0000 mgr.smithi067.rdualw (mgr.24569) 12878 : cluster [DBG] pgmap v11090: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:36.499737+0000 mon.smithi067 (mon.1) 1942 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:38:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:36.499998+0000 mon.smithi067 (mon.1) 1943 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:38:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:36.500357+0000 mon.smithi061 (mon.0) 2670 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:38:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:36.500907+0000 mon.smithi061 (mon.0) 2671 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:38:37.258 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:38:37.258 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 8s ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:38:37.259 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 8s ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:38:37.259 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 10s ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:38:37.259 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 8s ago 6h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:38:37.259 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 8s ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:38:37.260 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 10s ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:38:37.260 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 8s ago 6h 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:38:37.260 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 10s ago 6h 684M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:38:37.260 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 8s ago 6h 2100M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:38:37.261 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 10s ago 6h 1264M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:38:37.261 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 8s ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:38:37.261 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 10s ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:38:37.261 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 8s ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:38:37.262 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 10s ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:38:37.262 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (5h) 8s ago 6h 1431M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:38:37.262 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 8s ago 6h 2370M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:38:37.262 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 8s ago 6h 1495M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:38:37.263 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 8s ago 6h 2529M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:38:37.263 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 10s ago 6h 2329M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:38:37.263 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 10s ago 6h 2462M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:38:37.263 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 10s ago 6h 2035M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:38:37.263 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 10s ago 6h 3045M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:38:37.264 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 8s ago 6h 139M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:38:37.602 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:38:37.603 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:38:37.603 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:38:37.603 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:38:37.604 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:38:37.604 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:38:37.604 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:38:37.604 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:38:37.604 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:38:37.605 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:38:37.605 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:38:37.605 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:38:37.605 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:38:37.606 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:38:37.606 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:38:37.606 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:38:37.606 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:38:37.606 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:38:37.607 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:38:38.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:37 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:37.600709+0000 mon.smithi061 (mon.0) 2672 : audit [DBG] from='client.? 172.21.15.61:0/3466156790' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:38:38.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:37 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:37.600709+0000 mon.smithi061 (mon.0) 2672 : audit [DBG] from='client.? 172.21.15.61:0/3466156790' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:38:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:36.953289+0000 mgr.smithi067.rdualw (mgr.24569) 12879 : audit [DBG] from='client.42730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:38:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:38:37.240038+0000 mgr.smithi067.rdualw (mgr.24569) 12880 : audit [DBG] from='client.42734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:38:39.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:37.666457+0000 mgr.smithi067.rdualw (mgr.24569) 12881 : cluster [DBG] pgmap v11091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:36.953289+0000 mgr.smithi067.rdualw (mgr.24569) 12879 : audit [DBG] from='client.42730 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:38:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:38:37.240038+0000 mgr.smithi067.rdualw (mgr.24569) 12880 : audit [DBG] from='client.42734 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:38:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:37.666457+0000 mgr.smithi067.rdualw (mgr.24569) 12881 : cluster [DBG] pgmap v11091: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:39.667094+0000 mgr.smithi067.rdualw (mgr.24569) 12882 : cluster [DBG] pgmap v11092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:39.667094+0000 mgr.smithi067.rdualw (mgr.24569) 12882 : cluster [DBG] pgmap v11092: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:41.668071+0000 mgr.smithi067.rdualw (mgr.24569) 12883 : cluster [DBG] pgmap v11093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:41.668071+0000 mgr.smithi067.rdualw (mgr.24569) 12883 : cluster [DBG] pgmap v11093: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:43.668631+0000 mgr.smithi067.rdualw (mgr.24569) 12884 : cluster [DBG] pgmap v11094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:43.668631+0000 mgr.smithi067.rdualw (mgr.24569) 12884 : cluster [DBG] pgmap v11094: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:45.669530+0000 mgr.smithi067.rdualw (mgr.24569) 12885 : cluster [DBG] pgmap v11095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:45.669530+0000 mgr.smithi067.rdualw (mgr.24569) 12885 : cluster [DBG] pgmap v11095: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:47.670071+0000 mgr.smithi067.rdualw (mgr.24569) 12886 : cluster [DBG] pgmap v11096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:47.670071+0000 mgr.smithi067.rdualw (mgr.24569) 12886 : cluster [DBG] pgmap v11096: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:49.670896+0000 mgr.smithi067.rdualw (mgr.24569) 12887 : cluster [DBG] pgmap v11097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:49.670896+0000 mgr.smithi067.rdualw (mgr.24569) 12887 : cluster [DBG] pgmap v11097: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:51.671841+0000 mgr.smithi067.rdualw (mgr.24569) 12888 : cluster [DBG] pgmap v11098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:51.671841+0000 mgr.smithi067.rdualw (mgr.24569) 12888 : cluster [DBG] pgmap v11098: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:53.672379+0000 mgr.smithi067.rdualw (mgr.24569) 12889 : cluster [DBG] pgmap v11099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:53.672379+0000 mgr.smithi067.rdualw (mgr.24569) 12889 : cluster [DBG] pgmap v11099: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:55.673214+0000 mgr.smithi067.rdualw (mgr.24569) 12890 : cluster [DBG] pgmap v11100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:55.673214+0000 mgr.smithi067.rdualw (mgr.24569) 12890 : cluster [DBG] pgmap v11100: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:38:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:38:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:57.673781+0000 mgr.smithi067.rdualw (mgr.24569) 12891 : cluster [DBG] pgmap v11101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:38:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:38:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:57.673781+0000 mgr.smithi067.rdualw (mgr.24569) 12891 : cluster [DBG] pgmap v11101: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:38:59.674509+0000 mgr.smithi067.rdualw (mgr.24569) 12892 : cluster [DBG] pgmap v11102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:38:59.674509+0000 mgr.smithi067.rdualw (mgr.24569) 12892 : cluster [DBG] pgmap v11102: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:01.675405+0000 mgr.smithi067.rdualw (mgr.24569) 12893 : cluster [DBG] pgmap v11103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:01.675405+0000 mgr.smithi067.rdualw (mgr.24569) 12893 : cluster [DBG] pgmap v11103: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:03.676007+0000 mgr.smithi067.rdualw (mgr.24569) 12894 : cluster [DBG] pgmap v11104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:03.676007+0000 mgr.smithi067.rdualw (mgr.24569) 12894 : cluster [DBG] pgmap v11104: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:06.302 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:05 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:05.676992+0000 mgr.smithi067.rdualw (mgr.24569) 12895 : cluster [DBG] pgmap v11105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:06.316 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:05 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:05.676992+0000 mgr.smithi067.rdualw (mgr.24569) 12895 : cluster [DBG] pgmap v11105: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:07.958 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:39:08.250 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:39:08.251 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 39s ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:39:08.251 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 39s ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:39:08.251 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 41s ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:39:08.251 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 39s ago 6h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:39:08.252 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 39s ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:39:08.252 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 41s ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:39:08.252 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 39s ago 6h 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:39:08.252 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 41s ago 6h 684M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:39:08.252 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 39s ago 6h 2100M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:39:08.253 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 41s ago 6h 1264M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:39:08.253 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 39s ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:39:08.253 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 41s ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:39:08.253 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 39s ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:39:08.253 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 41s ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:39:08.254 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (6h) 39s ago 6h 1431M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:39:08.254 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 39s ago 6h 2370M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:39:08.254 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 39s ago 6h 1495M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:39:08.254 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 39s ago 6h 2529M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:39:08.254 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 41s ago 6h 2329M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:39:08.255 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 41s ago 6h 2462M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:39:08.255 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 41s ago 6h 2035M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:39:08.255 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 41s ago 6h 3045M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:39:08.255 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 39s ago 6h 139M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:39:08.596 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:39:08.596 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:39:08.597 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:39:08.597 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:39:08.597 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:39:08.597 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:39:08.598 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:39:08.598 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:39:08.598 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:39:08.598 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:39:08.598 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:39:08.599 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:39:08.599 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:39:08.599 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:39:08.599 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:39:08.600 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:39:08.600 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:39:08.600 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:39:08.600 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:39:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:07.677620+0000 mgr.smithi067.rdualw (mgr.24569) 12896 : cluster [DBG] pgmap v11106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:39:08.594538+0000 mon.smithi061 (mon.0) 2673 : audit [DBG] from='client.? 172.21.15.61:0/2327001259' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:39:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:07.677620+0000 mgr.smithi067.rdualw (mgr.24569) 12896 : cluster [DBG] pgmap v11106: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:39:08.594538+0000 mon.smithi061 (mon.0) 2673 : audit [DBG] from='client.? 172.21.15.61:0/2327001259' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:39:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:39:07.943779+0000 mgr.smithi067.rdualw (mgr.24569) 12897 : audit [DBG] from='client.42742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:39:10.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:09 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:39:08.232300+0000 mgr.smithi067.rdualw (mgr.24569) 12898 : audit [DBG] from='client.42746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:39:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:39:07.943779+0000 mgr.smithi067.rdualw (mgr.24569) 12897 : audit [DBG] from='client.42742 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:39:10.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:09 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:39:08.232300+0000 mgr.smithi067.rdualw (mgr.24569) 12898 : audit [DBG] from='client.42746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:39:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:09.678133+0000 mgr.smithi067.rdualw (mgr.24569) 12899 : cluster [DBG] pgmap v11107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:09.678133+0000 mgr.smithi067.rdualw (mgr.24569) 12899 : cluster [DBG] pgmap v11107: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:11.679078+0000 mgr.smithi067.rdualw (mgr.24569) 12900 : cluster [DBG] pgmap v11108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:11.679078+0000 mgr.smithi067.rdualw (mgr.24569) 12900 : cluster [DBG] pgmap v11108: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:13.679610+0000 mgr.smithi067.rdualw (mgr.24569) 12901 : cluster [DBG] pgmap v11109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:13.679610+0000 mgr.smithi067.rdualw (mgr.24569) 12901 : cluster [DBG] pgmap v11109: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:15.680522+0000 mgr.smithi067.rdualw (mgr.24569) 12902 : cluster [DBG] pgmap v11110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:15.680522+0000 mgr.smithi067.rdualw (mgr.24569) 12902 : cluster [DBG] pgmap v11110: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:17.681008+0000 mgr.smithi067.rdualw (mgr.24569) 12903 : cluster [DBG] pgmap v11111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:17.681008+0000 mgr.smithi067.rdualw (mgr.24569) 12903 : cluster [DBG] pgmap v11111: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:19.681638+0000 mgr.smithi067.rdualw (mgr.24569) 12904 : cluster [DBG] pgmap v11112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:19.681638+0000 mgr.smithi067.rdualw (mgr.24569) 12904 : cluster [DBG] pgmap v11112: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:21.682712+0000 mgr.smithi067.rdualw (mgr.24569) 12905 : cluster [DBG] pgmap v11113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:21.682712+0000 mgr.smithi067.rdualw (mgr.24569) 12905 : cluster [DBG] pgmap v11113: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:23.683353+0000 mgr.smithi067.rdualw (mgr.24569) 12906 : cluster [DBG] pgmap v11114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:23.683353+0000 mgr.smithi067.rdualw (mgr.24569) 12906 : cluster [DBG] pgmap v11114: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:25.684353+0000 mgr.smithi067.rdualw (mgr.24569) 12907 : cluster [DBG] pgmap v11115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:25.684353+0000 mgr.smithi067.rdualw (mgr.24569) 12907 : cluster [DBG] pgmap v11115: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:27.684845+0000 mgr.smithi067.rdualw (mgr.24569) 12908 : cluster [DBG] pgmap v11116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:27.684845+0000 mgr.smithi067.rdualw (mgr.24569) 12908 : cluster [DBG] pgmap v11116: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:39:28.995232+0000 mon.smithi067 (mon.1) 1944 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:39:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:39:28.996674+0000 mon.smithi067 (mon.1) 1945 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:39:30.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:39:28.997660+0000 mon.smithi067 (mon.1) 1946 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:39:30.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:39:29.416690+0000 mon.smithi061 (mon.0) 2674 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:39:30.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:39:29.422133+0000 mon.smithi061 (mon.0) 2675 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:39:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:39:28.995232+0000 mon.smithi067 (mon.1) 1944 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:39:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:39:28.996674+0000 mon.smithi067 (mon.1) 1945 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:39:30.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:39:28.997660+0000 mon.smithi067 (mon.1) 1946 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:39:30.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:39:29.416690+0000 mon.smithi061 (mon.0) 2674 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:39:30.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:39:29.422133+0000 mon.smithi061 (mon.0) 2675 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:39:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:39:28.998529+0000 mgr.smithi067.rdualw (mgr.24569) 12909 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:39:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:29.685590+0000 mgr.smithi067.rdualw (mgr.24569) 12910 : cluster [DBG] pgmap v11117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:39:28.998529+0000 mgr.smithi067.rdualw (mgr.24569) 12909 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:39:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:29.685590+0000 mgr.smithi067.rdualw (mgr.24569) 12910 : cluster [DBG] pgmap v11117: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:31.686614+0000 mgr.smithi067.rdualw (mgr.24569) 12911 : cluster [DBG] pgmap v11118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:33.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:31.686614+0000 mgr.smithi067.rdualw (mgr.24569) 12911 : cluster [DBG] pgmap v11118: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:33.687178+0000 mgr.smithi067.rdualw (mgr.24569) 12912 : cluster [DBG] pgmap v11119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:33.687178+0000 mgr.smithi067.rdualw (mgr.24569) 12912 : cluster [DBG] pgmap v11119: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:35.687914+0000 mgr.smithi067.rdualw (mgr.24569) 12913 : cluster [DBG] pgmap v11120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:39:36.505398+0000 mon.smithi067 (mon.1) 1947 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:39:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:39:36.505751+0000 mon.smithi067 (mon.1) 1948 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:39:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:39:36.506108+0000 mon.smithi061 (mon.0) 2676 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:39:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:39:36.506419+0000 mon.smithi061 (mon.0) 2677 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:39:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:35.687914+0000 mgr.smithi067.rdualw (mgr.24569) 12913 : cluster [DBG] pgmap v11120: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:39:36.505398+0000 mon.smithi067 (mon.1) 1947 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:39:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:39:36.505751+0000 mon.smithi067 (mon.1) 1948 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:39:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:39:36.506108+0000 mon.smithi061 (mon.0) 2676 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:39:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:39:36.506419+0000 mon.smithi061 (mon.0) 2677 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:39:38.991 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:39:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:37.688610+0000 mgr.smithi067.rdualw (mgr.24569) 12914 : cluster [DBG] pgmap v11121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:37.688610+0000 mgr.smithi067.rdualw (mgr.24569) 12914 : cluster [DBG] pgmap v11121: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:39.282 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:39:39.283 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 70s ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:39:39.283 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 70s ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:39:39.283 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 72s ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:39:39.283 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 70s ago 6h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:39:39.284 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 70s ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:39:39.284 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 72s ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:39:39.284 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 70s ago 6h 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:39:39.284 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 72s ago 6h 684M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:39:39.284 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 70s ago 6h 2100M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:39:39.285 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 72s ago 6h 1264M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:39:39.285 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 70s ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:39:39.285 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 72s ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:39:39.285 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 70s ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:39:39.286 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 72s ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:39:39.286 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (6h) 70s ago 6h 1431M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:39:39.286 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 70s ago 6h 2370M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:39:39.286 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 70s ago 6h 1495M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:39:39.286 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 70s ago 6h 2529M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:39:39.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 72s ago 6h 2329M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:39:39.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 72s ago 6h 2462M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:39:39.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 72s ago 6h 2035M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:39:39.287 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 72s ago 6h 3045M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:39:39.288 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 70s ago 6h 139M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:39:39.623 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:39:39.624 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:39:39.624 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:39:39.624 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:39:39.624 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:39:39.624 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:39:39.625 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:39:39.625 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:39:39.625 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:39:39.625 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:39:39.626 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:39:39.626 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:39:39.626 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:39:39.626 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:39:39.626 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:39:39.627 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:39:39.627 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:39:39.627 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:39:39.627 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:39:40.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:39 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:39:39.621700+0000 mon.smithi061 (mon.0) 2678 : audit [DBG] from='client.? 172.21.15.61:0/670985572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:39:40.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:39 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:39:39.621700+0000 mon.smithi061 (mon.0) 2678 : audit [DBG] from='client.? 172.21.15.61:0/670985572' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:39:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:39:38.974348+0000 mgr.smithi067.rdualw (mgr.24569) 12915 : audit [DBG] from='client.42754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:39:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:39:39.264389+0000 mgr.smithi067.rdualw (mgr.24569) 12916 : audit [DBG] from='client.42758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:39:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:39.689183+0000 mgr.smithi067.rdualw (mgr.24569) 12917 : cluster [DBG] pgmap v11122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:39:38.974348+0000 mgr.smithi067.rdualw (mgr.24569) 12915 : audit [DBG] from='client.42754 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:39:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:39:39.264389+0000 mgr.smithi067.rdualw (mgr.24569) 12916 : audit [DBG] from='client.42758 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:39:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:39.689183+0000 mgr.smithi067.rdualw (mgr.24569) 12917 : cluster [DBG] pgmap v11122: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:41.690024+0000 mgr.smithi067.rdualw (mgr.24569) 12918 : cluster [DBG] pgmap v11123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:41.690024+0000 mgr.smithi067.rdualw (mgr.24569) 12918 : cluster [DBG] pgmap v11123: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:43.690769+0000 mgr.smithi067.rdualw (mgr.24569) 12919 : cluster [DBG] pgmap v11124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:43.690769+0000 mgr.smithi067.rdualw (mgr.24569) 12919 : cluster [DBG] pgmap v11124: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:45.691624+0000 mgr.smithi067.rdualw (mgr.24569) 12920 : cluster [DBG] pgmap v11125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:45.691624+0000 mgr.smithi067.rdualw (mgr.24569) 12920 : cluster [DBG] pgmap v11125: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:47.692111+0000 mgr.smithi067.rdualw (mgr.24569) 12921 : cluster [DBG] pgmap v11126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:47.692111+0000 mgr.smithi067.rdualw (mgr.24569) 12921 : cluster [DBG] pgmap v11126: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:49.692723+0000 mgr.smithi067.rdualw (mgr.24569) 12922 : cluster [DBG] pgmap v11127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:49.692723+0000 mgr.smithi067.rdualw (mgr.24569) 12922 : cluster [DBG] pgmap v11127: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:51.693778+0000 mgr.smithi067.rdualw (mgr.24569) 12923 : cluster [DBG] pgmap v11128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:51.693778+0000 mgr.smithi067.rdualw (mgr.24569) 12923 : cluster [DBG] pgmap v11128: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:53.694420+0000 mgr.smithi067.rdualw (mgr.24569) 12924 : cluster [DBG] pgmap v11129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:53.694420+0000 mgr.smithi067.rdualw (mgr.24569) 12924 : cluster [DBG] pgmap v11129: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:55.695323+0000 mgr.smithi067.rdualw (mgr.24569) 12925 : cluster [DBG] pgmap v11130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:55.695323+0000 mgr.smithi067.rdualw (mgr.24569) 12925 : cluster [DBG] pgmap v11130: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:39:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:39:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:57.695982+0000 mgr.smithi067.rdualw (mgr.24569) 12926 : cluster [DBG] pgmap v11131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:39:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:39:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:57.695982+0000 mgr.smithi067.rdualw (mgr.24569) 12926 : cluster [DBG] pgmap v11131: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:39:59.696568+0000 mgr.smithi067.rdualw (mgr.24569) 12927 : cluster [DBG] pgmap v11132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:00.000166+0000 mon.smithi061 (mon.0) 2679 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T21:40:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:39:59.696568+0000 mgr.smithi067.rdualw (mgr.24569) 12927 : cluster [DBG] pgmap v11132: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:00.000166+0000 mon.smithi061 (mon.0) 2679 : cluster [WRN] overall HEALTH_WARN 3 daemons have recently crashed; Upgrading daemon osd.0 on host smithi061 failed. 2022-03-17T21:40:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:01.697410+0000 mgr.smithi067.rdualw (mgr.24569) 12928 : cluster [DBG] pgmap v11133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:01.697410+0000 mgr.smithi067.rdualw (mgr.24569) 12928 : cluster [DBG] pgmap v11133: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:03.697939+0000 mgr.smithi067.rdualw (mgr.24569) 12929 : cluster [DBG] pgmap v11134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:03.697939+0000 mgr.smithi067.rdualw (mgr.24569) 12929 : cluster [DBG] pgmap v11134: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:05.698847+0000 mgr.smithi067.rdualw (mgr.24569) 12930 : cluster [DBG] pgmap v11135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:05.698847+0000 mgr.smithi067.rdualw (mgr.24569) 12930 : cluster [DBG] pgmap v11135: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:07.699506+0000 mgr.smithi067.rdualw (mgr.24569) 12931 : cluster [DBG] pgmap v11136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:07.699506+0000 mgr.smithi067.rdualw (mgr.24569) 12931 : cluster [DBG] pgmap v11136: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:09.932 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:40:10.233 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:40:10.233 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 101s ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:40:10.233 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 101s ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:40:10.233 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 103s ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:40:10.234 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 101s ago 6h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:40:10.234 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 101s ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:40:10.234 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 103s ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:40:10.234 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 101s ago 6h 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:40:10.235 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 103s ago 6h 684M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:40:10.235 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 101s ago 6h 2100M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:40:10.235 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 103s ago 6h 1264M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:40:10.235 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 101s ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:40:10.236 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 103s ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:40:10.236 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 101s ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:40:10.236 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 103s ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:40:10.236 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (6h) 101s ago 6h 1431M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:40:10.236 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 101s ago 6h 2370M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:40:10.237 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 101s ago 6h 1495M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:40:10.237 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 101s ago 6h 2529M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:40:10.237 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 103s ago 6h 2329M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:40:10.237 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 103s ago 6h 2462M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:40:10.238 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 103s ago 6h 2035M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:40:10.238 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 103s ago 6h 3045M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:40:10.238 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 101s ago 6h 139M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:40:10.577 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:40:10.577 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:40:10.577 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:40:10.578 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:40:10.578 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:40:10.578 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:40:10.578 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:40:10.579 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:40:10.579 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:40:10.579 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:40:10.579 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:40:10.579 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:40:10.580 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:40:10.580 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:40:10.580 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:40:10.580 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:40:10.581 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:40:10.581 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:40:10.581 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:40:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:09.700108+0000 mgr.smithi067.rdualw (mgr.24569) 12932 : cluster [DBG] pgmap v11137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:40:10.575175+0000 mon.smithi061 (mon.0) 2680 : audit [DBG] from='client.? 172.21.15.61:0/2166904573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:40:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:09.700108+0000 mgr.smithi067.rdualw (mgr.24569) 12932 : cluster [DBG] pgmap v11137: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:40:10.575175+0000 mon.smithi061 (mon.0) 2680 : audit [DBG] from='client.? 172.21.15.61:0/2166904573' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:40:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:40:09.919216+0000 mgr.smithi067.rdualw (mgr.24569) 12933 : audit [DBG] from='client.42766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:40:12.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:11 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:40:10.215070+0000 mgr.smithi067.rdualw (mgr.24569) 12934 : audit [DBG] from='client.42770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:40:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:40:09.919216+0000 mgr.smithi067.rdualw (mgr.24569) 12933 : audit [DBG] from='client.42766 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:40:12.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:11 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:40:10.215070+0000 mgr.smithi067.rdualw (mgr.24569) 12934 : audit [DBG] from='client.42770 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:40:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:11.700993+0000 mgr.smithi067.rdualw (mgr.24569) 12935 : cluster [DBG] pgmap v11138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:11.700993+0000 mgr.smithi067.rdualw (mgr.24569) 12935 : cluster [DBG] pgmap v11138: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:13.701703+0000 mgr.smithi067.rdualw (mgr.24569) 12936 : cluster [DBG] pgmap v11139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:13.701703+0000 mgr.smithi067.rdualw (mgr.24569) 12936 : cluster [DBG] pgmap v11139: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:15.702630+0000 mgr.smithi067.rdualw (mgr.24569) 12937 : cluster [DBG] pgmap v11140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:15.702630+0000 mgr.smithi067.rdualw (mgr.24569) 12937 : cluster [DBG] pgmap v11140: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:17.703194+0000 mgr.smithi067.rdualw (mgr.24569) 12938 : cluster [DBG] pgmap v11141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:17.703194+0000 mgr.smithi067.rdualw (mgr.24569) 12938 : cluster [DBG] pgmap v11141: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:19.703933+0000 mgr.smithi067.rdualw (mgr.24569) 12939 : cluster [DBG] pgmap v11142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:19.703933+0000 mgr.smithi067.rdualw (mgr.24569) 12939 : cluster [DBG] pgmap v11142: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:23.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:22 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:21.704911+0000 mgr.smithi067.rdualw (mgr.24569) 12940 : cluster [DBG] pgmap v11143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:23.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:22 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:21.704911+0000 mgr.smithi067.rdualw (mgr.24569) 12940 : cluster [DBG] pgmap v11143: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:25.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:24 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:23.705462+0000 mgr.smithi067.rdualw (mgr.24569) 12941 : cluster [DBG] pgmap v11144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:25.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:24 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:23.705462+0000 mgr.smithi067.rdualw (mgr.24569) 12941 : cluster [DBG] pgmap v11144: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:27.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:26 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:25.706218+0000 mgr.smithi067.rdualw (mgr.24569) 12942 : cluster [DBG] pgmap v11145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:27.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:26 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:25.706218+0000 mgr.smithi067.rdualw (mgr.24569) 12942 : cluster [DBG] pgmap v11145: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:29.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:28 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:27.706794+0000 mgr.smithi067.rdualw (mgr.24569) 12943 : cluster [DBG] pgmap v11146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:29.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:28 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:27.706794+0000 mgr.smithi067.rdualw (mgr.24569) 12943 : cluster [DBG] pgmap v11146: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:40:29.427873+0000 mon.smithi067 (mon.1) 1949 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:40:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:40:29.429427+0000 mon.smithi067 (mon.1) 1950 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:40:30.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:29 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:40:29.430409+0000 mon.smithi067 (mon.1) 1951 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:40:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:40:29.427873+0000 mon.smithi067 (mon.1) 1949 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2022-03-17T21:40:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:40:29.429427+0000 mon.smithi067 (mon.1) 1950 : audit [DBG] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2022-03-17T21:40:30.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:29 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:40:29.430409+0000 mon.smithi067 (mon.1) 1951 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2022-03-17T21:40:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cephadm 2022-03-17T21:40:29.431363+0000 mgr.smithi067.rdualw (mgr.24569) 12944 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:40:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:29.707489+0000 mgr.smithi067.rdualw (mgr.24569) 12945 : cluster [DBG] pgmap v11147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:31.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:40:29.791318+0000 mon.smithi061 (mon.0) 2681 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:40:31.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:40:29.799683+0000 mon.smithi061 (mon.0) 2682 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:40:31.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:40:30.202089+0000 mon.smithi061 (mon.0) 2683 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:40:31.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:30 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:40:30.209949+0000 mon.smithi061 (mon.0) 2684 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:40:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cephadm 2022-03-17T21:40:29.431363+0000 mgr.smithi067.rdualw (mgr.24569) 12944 : cephadm [WRN] unable to calc client keyring client.admin placement PlacementSpec(label='_admin'): Cannot place : No matching hosts for label _admin 2022-03-17T21:40:31.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:29.707489+0000 mgr.smithi067.rdualw (mgr.24569) 12945 : cluster [DBG] pgmap v11147: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:31.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:40:29.791318+0000 mon.smithi061 (mon.0) 2681 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:40:31.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:40:29.799683+0000 mon.smithi061 (mon.0) 2682 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:40:31.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:40:30.202089+0000 mon.smithi061 (mon.0) 2683 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:40:31.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:30 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:40:30.209949+0000 mon.smithi061 (mon.0) 2684 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' 2022-03-17T21:40:33.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:32 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:31.708416+0000 mgr.smithi067.rdualw (mgr.24569) 12946 : cluster [DBG] pgmap v11148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:33.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:32 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:31.708416+0000 mgr.smithi067.rdualw (mgr.24569) 12946 : cluster [DBG] pgmap v11148: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:35.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:34 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:33.708961+0000 mgr.smithi067.rdualw (mgr.24569) 12947 : cluster [DBG] pgmap v11149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:35.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:34 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:33.708961+0000 mgr.smithi067.rdualw (mgr.24569) 12947 : cluster [DBG] pgmap v11149: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:35.709885+0000 mgr.smithi067.rdualw (mgr.24569) 12948 : cluster [DBG] pgmap v11150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:37.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:40:36.511180+0000 mon.smithi067 (mon.1) 1952 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:40:37.053 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:40:36.511549+0000 mon.smithi067 (mon.1) 1953 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:40:37.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:40:36.511675+0000 mon.smithi061 (mon.0) 2685 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:40:37.054 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:36 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:40:36.511935+0000 mon.smithi061 (mon.0) 2686 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:40:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:35.709885+0000 mgr.smithi067.rdualw (mgr.24569) 12948 : cluster [DBG] pgmap v11150: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:37.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:40:36.511180+0000 mon.smithi067 (mon.1) 1952 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:40:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:40:36.511549+0000 mon.smithi067 (mon.1) 1953 : audit [INF] from='mgr.24569 172.21.15.67:0/4002824812' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:40:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:40:36.511675+0000 mon.smithi061 (mon.0) 2685 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/trash_purge_schedule"}]: dispatch 2022-03-17T21:40:37.067 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:36 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:40:36.511935+0000 mon.smithi061 (mon.0) 2686 : audit [INF] from='mgr.24569 ' entity='mgr.smithi067.rdualw' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi067.rdualw/mirror_snapshot_schedule"}]: dispatch 2022-03-17T21:40:39.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:38 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:37.710446+0000 mgr.smithi067.rdualw (mgr.24569) 12949 : cluster [DBG] pgmap v11151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:39.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:38 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:37.710446+0000 mgr.smithi067.rdualw (mgr.24569) 12949 : cluster [DBG] pgmap v11151: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:40.889 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:40:41.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:40 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:39.711042+0000 mgr.smithi067.rdualw (mgr.24569) 12950 : cluster [DBG] pgmap v11152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:41.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:40 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:39.711042+0000 mgr.smithi067.rdualw (mgr.24569) 12950 : cluster [DBG] pgmap v11152: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:41.180 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:40:41.181 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 2m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:40:41.181 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 2m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:40:41.181 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 2m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:40:41.181 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 2m ago 6h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:40:41.182 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 2m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:40:41.182 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 2m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:40:41.182 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 2m ago 6h 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:40:41.183 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 2m ago 6h 684M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:40:41.183 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 2m ago 6h 2100M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:40:41.183 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 2m ago 6h 1264M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:40:41.183 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 2m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:40:41.183 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 2m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:40:41.184 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 2m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:40:41.184 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 2m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:40:41.184 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (6h) 2m ago 6h 1431M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:40:41.185 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 2m ago 6h 2370M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:40:41.185 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 2m ago 6h 1495M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:40:41.185 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 2m ago 6h 2529M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:40:41.185 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 2m ago 6h 2329M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:40:41.185 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 2m ago 6h 2462M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:40:41.185 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 2m ago 6h 2035M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:40:41.186 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 2m ago 6h 3045M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:40:41.186 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 2m ago 6h 139M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:40:41.522 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:40:41.523 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:40:41.523 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:40:41.523 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:40:41.523 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:40:41.524 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:40:41.524 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:40:41.524 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:40:41.524 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:40:41.525 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:40:41.525 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:40:41.525 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:40:41.525 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:40:41.525 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:40:41.526 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:40:41.526 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:40:41.526 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:40:41.526 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:40:41.526 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:40:42.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:41 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:40:41.520812+0000 mon.smithi061 (mon.0) 2687 : audit [DBG] from='client.? 172.21.15.61:0/373600785' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:40:42.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:41 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:40:41.520812+0000 mon.smithi061 (mon.0) 2687 : audit [DBG] from='client.? 172.21.15.61:0/373600785' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:40:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:40:40.874623+0000 mgr.smithi067.rdualw (mgr.24569) 12951 : audit [DBG] from='client.42778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:40:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:40:41.160766+0000 mgr.smithi067.rdualw (mgr.24569) 12952 : audit [DBG] from='client.42782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:40:43.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:42 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:41.711976+0000 mgr.smithi067.rdualw (mgr.24569) 12953 : cluster [DBG] pgmap v11153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:40:40.874623+0000 mgr.smithi067.rdualw (mgr.24569) 12951 : audit [DBG] from='client.42778 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:40:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:40:41.160766+0000 mgr.smithi067.rdualw (mgr.24569) 12952 : audit [DBG] from='client.42782 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:40:43.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:42 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:41.711976+0000 mgr.smithi067.rdualw (mgr.24569) 12953 : cluster [DBG] pgmap v11153: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:45.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:44 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:43.712620+0000 mgr.smithi067.rdualw (mgr.24569) 12954 : cluster [DBG] pgmap v11154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:45.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:44 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:43.712620+0000 mgr.smithi067.rdualw (mgr.24569) 12954 : cluster [DBG] pgmap v11154: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:47.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:46 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:45.713506+0000 mgr.smithi067.rdualw (mgr.24569) 12955 : cluster [DBG] pgmap v11155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:47.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:46 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:45.713506+0000 mgr.smithi067.rdualw (mgr.24569) 12955 : cluster [DBG] pgmap v11155: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:49.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:48 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:47.714061+0000 mgr.smithi067.rdualw (mgr.24569) 12956 : cluster [DBG] pgmap v11156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:49.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:48 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:47.714061+0000 mgr.smithi067.rdualw (mgr.24569) 12956 : cluster [DBG] pgmap v11156: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:51.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:50 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:49.714873+0000 mgr.smithi067.rdualw (mgr.24569) 12957 : cluster [DBG] pgmap v11157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:51.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:50 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:49.714873+0000 mgr.smithi067.rdualw (mgr.24569) 12957 : cluster [DBG] pgmap v11157: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:53.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:52 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:51.715952+0000 mgr.smithi067.rdualw (mgr.24569) 12958 : cluster [DBG] pgmap v11158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:53.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:52 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:51.715952+0000 mgr.smithi067.rdualw (mgr.24569) 12958 : cluster [DBG] pgmap v11158: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:55.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:54 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:53.716720+0000 mgr.smithi067.rdualw (mgr.24569) 12959 : cluster [DBG] pgmap v11159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:55.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:54 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:53.716720+0000 mgr.smithi067.rdualw (mgr.24569) 12959 : cluster [DBG] pgmap v11159: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:57.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:56 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:55.717686+0000 mgr.smithi067.rdualw (mgr.24569) 12960 : cluster [DBG] pgmap v11160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:57.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:56 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:55.717686+0000 mgr.smithi067.rdualw (mgr.24569) 12960 : cluster [DBG] pgmap v11160: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:40:59.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:40:58 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:57.718292+0000 mgr.smithi067.rdualw (mgr.24569) 12961 : cluster [DBG] pgmap v11161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:40:59.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:40:58 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:57.718292+0000 mgr.smithi067.rdualw (mgr.24569) 12961 : cluster [DBG] pgmap v11161: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:41:01.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:41:00 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:40:59.718919+0000 mgr.smithi067.rdualw (mgr.24569) 12962 : cluster [DBG] pgmap v11162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:41:01.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:41:00 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:40:59.718919+0000 mgr.smithi067.rdualw (mgr.24569) 12962 : cluster [DBG] pgmap v11162: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:41:03.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:41:02 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:41:01.719764+0000 mgr.smithi067.rdualw (mgr.24569) 12963 : cluster [DBG] pgmap v11163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:41:03.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:41:02 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:41:01.719764+0000 mgr.smithi067.rdualw (mgr.24569) 12963 : cluster [DBG] pgmap v11163: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:41:05.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:41:04 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:41:03.720272+0000 mgr.smithi067.rdualw (mgr.24569) 12964 : cluster [DBG] pgmap v11164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:41:05.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:41:04 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:41:03.720272+0000 mgr.smithi067.rdualw (mgr.24569) 12964 : cluster [DBG] pgmap v11164: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:41:07.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:41:06 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:41:05.721131+0000 mgr.smithi067.rdualw (mgr.24569) 12965 : cluster [DBG] pgmap v11165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:41:07.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:41:06 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:41:05.721131+0000 mgr.smithi067.rdualw (mgr.24569) 12965 : cluster [DBG] pgmap v11165: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:41:09.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:41:08 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:41:07.721865+0000 mgr.smithi067.rdualw (mgr.24569) 12966 : cluster [DBG] pgmap v11166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:41:09.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:41:08 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:41:07.721865+0000 mgr.smithi067.rdualw (mgr.24569) 12966 : cluster [DBG] pgmap v11166: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:41:11.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:41:10 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:41:09.722682+0000 mgr.smithi067.rdualw (mgr.24569) 12967 : cluster [DBG] pgmap v11167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:41:11.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:41:10 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:41:09.722682+0000 mgr.smithi067.rdualw (mgr.24569) 12967 : cluster [DBG] pgmap v11167: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:41:11.836 INFO:teuthology.orchestra.run.smithi061.stdout:true 2022-03-17T21:41:12.125 INFO:teuthology.orchestra.run.smithi061.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2022-03-17T21:41:12.126 INFO:teuthology.orchestra.run.smithi061.stdout:alertmanager.smithi061 smithi061 *:9093,9094 running (6h) 2m ago 6h 20.0M - 0.20.0 0881eb8f169f 6cfcea131832 2022-03-17T21:41:12.126 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi061 smithi061 running (6h) 2m ago 6h 7197k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 34e1d90a6e1e 2022-03-17T21:41:12.126 INFO:teuthology.orchestra.run.smithi061.stdout:crash.smithi067 smithi067 running (6h) 2m ago 6h 7222k - 16.2.7-635-gb5b991d4 7a9bb649a3f7 107e9ff533a1 2022-03-17T21:41:12.126 INFO:teuthology.orchestra.run.smithi061.stdout:grafana.smithi061 smithi061 *:3000 running (6h) 2m ago 6h 42.7M - 6.7.4 557c83e11646 444c51fb5f73 2022-03-17T21:41:12.126 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi061.atvhsa smithi061 running (6h) 2m ago 6h 42.9M - 16.2.4 8d91d370c2b8 98dbbd4dedc9 2022-03-17T21:41:12.127 INFO:teuthology.orchestra.run.smithi061.stdout:mds.foofs.smithi067.osftcx smithi067 running (6h) 2m ago 6h 25.0M - 16.2.4 8d91d370c2b8 3def1fb2a33d 2022-03-17T21:41:12.127 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi061.kxplwz smithi061 *:8443,9283 running (6h) 2m ago 6h 499M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 41cfdff8ece2 2022-03-17T21:41:12.127 INFO:teuthology.orchestra.run.smithi061.stdout:mgr.smithi067.rdualw smithi067 *:8443,9283 running (6h) 2m ago 6h 684M - 16.2.7-635-gb5b991d4 7a9bb649a3f7 333f3eadb4af 2022-03-17T21:41:12.127 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi061 smithi061 running (6h) 2m ago 6h 2100M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 220bb5209e2a 2022-03-17T21:41:12.128 INFO:teuthology.orchestra.run.smithi061.stdout:mon.smithi067 smithi067 running (6h) 2m ago 6h 1264M 2048M 16.2.7-635-gb5b991d4 7a9bb649a3f7 0c4131715971 2022-03-17T21:41:12.128 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.0.0.smithi061.vliecs smithi061 *:2049 running (6h) 2m ago 6h 188M - 3.5 8d91d370c2b8 92d00b68207d 2022-03-17T21:41:12.128 INFO:teuthology.orchestra.run.smithi061.stdout:nfs.foo.1.0.smithi067.ycbiqg smithi067 *:2049 running (6h) 2m ago 6h 117M - 3.5 8d91d370c2b8 b6f2224ee115 2022-03-17T21:41:12.128 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi061 smithi061 *:9100 running (6h) 2m ago 6h 18.5M - 0.18.1 e5a616e4b9cf 7028fb4364ef 2022-03-17T21:41:12.128 INFO:teuthology.orchestra.run.smithi061.stdout:node-exporter.smithi067 smithi067 *:9100 running (6h) 2m ago 6h 18.4M - 0.18.1 e5a616e4b9cf 9250364141c5 2022-03-17T21:41:12.129 INFO:teuthology.orchestra.run.smithi061.stdout:osd.0 smithi061 running (6h) 2m ago 6h 1431M 4096M 16.2.7-635-gb5b991d4 7a9bb649a3f7 a6b168048b8f 2022-03-17T21:41:12.129 INFO:teuthology.orchestra.run.smithi061.stdout:osd.1 smithi061 running (6h) 2m ago 6h 2370M 4096M 16.2.4 8d91d370c2b8 e39c1bef0f2f 2022-03-17T21:41:12.129 INFO:teuthology.orchestra.run.smithi061.stdout:osd.2 smithi061 running (6h) 2m ago 6h 1495M 4096M 16.2.4 8d91d370c2b8 23ad0ff1c0f9 2022-03-17T21:41:12.129 INFO:teuthology.orchestra.run.smithi061.stdout:osd.3 smithi061 running (6h) 2m ago 6h 2529M 4096M 16.2.4 8d91d370c2b8 a93ec42efbeb 2022-03-17T21:41:12.129 INFO:teuthology.orchestra.run.smithi061.stdout:osd.4 smithi067 running (6h) 2m ago 6h 2329M 4096M 16.2.4 8d91d370c2b8 efefd5b0495f 2022-03-17T21:41:12.130 INFO:teuthology.orchestra.run.smithi061.stdout:osd.5 smithi067 running (6h) 2m ago 6h 2462M 4096M 16.2.4 8d91d370c2b8 f665dccdf9d4 2022-03-17T21:41:12.130 INFO:teuthology.orchestra.run.smithi061.stdout:osd.6 smithi067 running (6h) 2m ago 6h 2035M 4096M 16.2.4 8d91d370c2b8 11efef08130f 2022-03-17T21:41:12.130 INFO:teuthology.orchestra.run.smithi061.stdout:osd.7 smithi067 running (6h) 2m ago 6h 3045M 4096M 16.2.4 8d91d370c2b8 8a3acdcaa3ce 2022-03-17T21:41:12.130 INFO:teuthology.orchestra.run.smithi061.stdout:prometheus.smithi061 smithi061 *:9095 running (6h) 2m ago 6h 139M - 2.18.1 de242295e225 49fa7aa582f4 2022-03-17T21:41:12.464 INFO:teuthology.orchestra.run.smithi061.stdout:{ 2022-03-17T21:41:12.464 INFO:teuthology.orchestra.run.smithi061.stdout: "mon": { 2022-03-17T21:41:12.465 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 2 2022-03-17T21:41:12.465 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:41:12.465 INFO:teuthology.orchestra.run.smithi061.stdout: "mgr": { 2022-03-17T21:41:12.465 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:41:12.465 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:41:12.466 INFO:teuthology.orchestra.run.smithi061.stdout: "osd": { 2022-03-17T21:41:12.466 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 7, 2022-03-17T21:41:12.466 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 1 2022-03-17T21:41:12.466 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:41:12.467 INFO:teuthology.orchestra.run.smithi061.stdout: "mds": { 2022-03-17T21:41:12.467 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 2 2022-03-17T21:41:12.467 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-03-17T21:41:12.467 INFO:teuthology.orchestra.run.smithi061.stdout: "overall": { 2022-03-17T21:41:12.467 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.4 (3cbe25cde3cfa028984618ad32de9edc4c1eaed0) pacific (stable)": 9, 2022-03-17T21:41:12.468 INFO:teuthology.orchestra.run.smithi061.stdout: "ceph version 16.2.7-635-gb5b991d4 (b5b991d49cb3b04a2ddb8f088114acd2fe9d86b6) pacific (stable)": 4 2022-03-17T21:41:12.468 INFO:teuthology.orchestra.run.smithi061.stdout: } 2022-03-17T21:41:12.468 INFO:teuthology.orchestra.run.smithi061.stdout:} 2022-03-17T21:41:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:41:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:41:11.723572+0000 mgr.smithi067.rdualw (mgr.24569) 12968 : cluster [DBG] pgmap v11168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:41:13.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:41:12 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:41:12.462397+0000 mon.smithi061 (mon.0) 2688 : audit [DBG] from='client.? 172.21.15.61:0/2835914110' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:41:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:41:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:41:11.723572+0000 mgr.smithi067.rdualw (mgr.24569) 12968 : cluster [DBG] pgmap v11168: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:41:13.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:41:12 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:41:12.462397+0000 mon.smithi061 (mon.0) 2688 : audit [DBG] from='client.? 172.21.15.61:0/2835914110' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2022-03-17T21:41:14.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:41:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:41:11.821087+0000 mgr.smithi067.rdualw (mgr.24569) 12969 : audit [DBG] from='client.42790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:41:14.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:41:13 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: audit 2022-03-17T21:41:12.107554+0000 mgr.smithi067.rdualw (mgr.24569) 12970 : audit [DBG] from='client.42794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:41:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:41:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:41:11.821087+0000 mgr.smithi067.rdualw (mgr.24569) 12969 : audit [DBG] from='client.42790 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:41:14.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:41:13 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: audit 2022-03-17T21:41:12.107554+0000 mgr.smithi067.rdualw (mgr.24569) 12970 : audit [DBG] from='client.42794 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2022-03-17T21:41:15.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:41:14 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:41:13.724096+0000 mgr.smithi067.rdualw (mgr.24569) 12971 : cluster [DBG] pgmap v11169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:41:15.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:41:14 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:41:13.724096+0000 mgr.smithi067.rdualw (mgr.24569) 12971 : cluster [DBG] pgmap v11169: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:41:17.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:41:16 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:41:15.724949+0000 mgr.smithi067.rdualw (mgr.24569) 12972 : cluster [DBG] pgmap v11170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:41:17.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:41:16 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:41:15.724949+0000 mgr.smithi067.rdualw (mgr.24569) 12972 : cluster [DBG] pgmap v11170: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2022-03-17T21:41:19.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:41:18 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:41:17.725477+0000 mgr.smithi067.rdualw (mgr.24569) 12973 : cluster [DBG] pgmap v11171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:41:19.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:41:18 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:41:17.725477+0000 mgr.smithi067.rdualw (mgr.24569) 12973 : cluster [DBG] pgmap v11171: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:41:21.052 INFO:journalctl@ceph.mon.smithi061.smithi061.stdout:Mar 17 21:41:20 smithi061 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi061[74619]: cluster 2022-03-17T21:41:19.726196+0000 mgr.smithi067.rdualw (mgr.24569) 12974 : cluster [DBG] pgmap v11172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:41:21.066 INFO:journalctl@ceph.mon.smithi067.smithi067.stdout:Mar 17 21:41:20 smithi067 ceph-ae1b9b88-a605-11ec-8c35-001a4aab830c-mon-smithi067[54525]: cluster 2022-03-17T21:41:19.726196+0000 mgr.smithi067.rdualw (mgr.24569) 12974 : cluster [DBG] pgmap v11172: 129 pgs: 129 active+clean; 212 MiB data, 2.0 GiB used, 713 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2022-03-17T21:41:22.110 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2022-03-17T21:41:22.113 DEBUG:teuthology.task.console_log:Killing console logger for smithi061 2022-03-17T21:41:22.114 DEBUG:teuthology.task.console_log:Killing console logger for smithi067 2022-03-17T21:41:22.114 DEBUG:teuthology.exit:Finished running handlers